1
|
Khan M, Banerjee S, Muskawad S, Maity R, Chowdhury SR, Ejaz R, Kuuzie E, Satnarine T. The Impact of Artificial Intelligence on Allergy Diagnosis and Treatment. Curr Allergy Asthma Rep 2024; 24:361-372. [PMID: 38954325 DOI: 10.1007/s11882-024-01152-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/19/2024] [Indexed: 07/04/2024]
Abstract
PURPOSE OF REVIEW Artificial intelligence (AI), be it neuronal networks, machine learning or deep learning, has numerous beneficial effects on healthcare systems; however, its potential applications and diagnostic capabilities for immunologic diseases have yet to be explored. Understanding AI systems can help healthcare workers better assimilate artificial intelligence into their practice and unravel its potential in diagnostics, clinical research, and disease management. RECENT FINDINGS We reviewed recent advancements in AI systems and their integration in healthcare systems, along with their potential benefits in the diagnosis and management of diseases. We explored machine learning as employed in allergy diagnosis and its learning patterns from patient datasets, as well as the possible advantages of using AI in the field of research related to allergic reactions and even remote monitoring. Considering the ethical challenges and privacy concerns raised by clinicians and patients with regard to integrating AI in healthcare, we explored the new guidelines adapted by regulatory bodies. Despite these challenges, AI appears to have been successfully incorporated into various healthcare systems and is providing patient-centered solutions while simultaneously assisting healthcare workers. Artificial intelligence offers new hope in the field of immunologic disease diagnosis, monitoring, and management and thus has the potential to revolutionize healthcare systems.
Collapse
Affiliation(s)
- Maham Khan
- Fatima Jinnah Medical University, Lahore, Pakistan.
| | | | | | - Rick Maity
- Institute of Post Graduate Medical Education and Research, Kolkata, West Bengal, India
| | | | - Rida Ejaz
- Shifa College of Medicine, Islamabad, Pakistan
| | | | | |
Collapse
|
2
|
Li Pomi F, Papa V, Borgia F, Vaccaro M, Pioggia G, Gangemi S. Artificial Intelligence: A Snapshot of Its Application in Chronic Inflammatory and Autoimmune Skin Diseases. Life (Basel) 2024; 14:516. [PMID: 38672786 PMCID: PMC11051135 DOI: 10.3390/life14040516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Revised: 04/10/2024] [Accepted: 04/16/2024] [Indexed: 04/28/2024] Open
Abstract
Immuno-correlated dermatological pathologies refer to skin disorders that are closely associated with immune system dysfunction or abnormal immune responses. Advancements in the field of artificial intelligence (AI) have shown promise in enhancing the diagnosis, management, and assessment of immuno-correlated dermatological pathologies. This intersection of dermatology and immunology plays a pivotal role in comprehending and addressing complex skin disorders with immune system involvement. The paper explores the knowledge known so far and the evolution and achievements of AI in diagnosis; discusses segmentation and the classification of medical images; and reviews existing challenges, in immunological-related skin diseases. From our review, the role of AI has emerged, especially in the analysis of images for both diagnostic and severity assessment purposes. Furthermore, the possibility of predicting patients' response to therapies is emerging, in order to create tailored therapies.
Collapse
Affiliation(s)
- Federica Li Pomi
- Department of Precision Medicine in Medical, Surgical and Critical Care (Me.Pre.C.C.), University of Palermo, 90127 Palermo, Italy;
| | - Vincenzo Papa
- Department of Clinical and Experimental Medicine, School and Operative Unit of Allergy and Clinical Immunology, University of Messina, 98125 Messina, Italy; (V.P.); (S.G.)
| | - Francesco Borgia
- Department of Clinical and Experimental Medicine, Section of Dermatology, University of Messina, 98125 Messina, Italy;
| | - Mario Vaccaro
- Department of Clinical and Experimental Medicine, Section of Dermatology, University of Messina, 98125 Messina, Italy;
| | - Giovanni Pioggia
- Institute for Biomedical Research and Innovation (IRIB), National Research Council of Italy (CNR), 98164 Messina, Italy;
| | - Sebastiano Gangemi
- Department of Clinical and Experimental Medicine, School and Operative Unit of Allergy and Clinical Immunology, University of Messina, 98125 Messina, Italy; (V.P.); (S.G.)
| |
Collapse
|
3
|
Maulana A, Noviandy TR, Suhendra R, Earlia N, Bulqiah M, Idroes GM, Niode NJ, Sofyan H, Subianto M, Idroes R. Evaluation of atopic dermatitis severity using artificial intelligence. NARRA J 2023; 3:e511. [PMID: 38450339 PMCID: PMC10914065 DOI: 10.52225/narra.v3i3.511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 12/18/2023] [Indexed: 03/08/2024]
Abstract
Atopic dermatitis is a prevalent and persistent chronic inflammatory skin disorder that poses significant challenges when it comes to accurately assessing its severity. The aim of this study was to evaluate deep learning models for automated atopic dermatitis severity scoring using a dataset of Aceh ethnicity individuals in Indonesia. The dataset of clinical images was collected from 250 patients at Dr. Zainoel Abidin Hospital, Banda Aceh, Indonesia and labeled by dermatologists as mild, moderate, severe, or none. Five pretrained convolutional neural networks (CNN) architectures were evaluated: ResNet50, VGGNet19, MobileNetV3, MnasNet, and EfficientNetB0. The evaluation metrics, including accuracy, precision, sensitivity, specificity, and F1-score, were employed to assess the models. Among the models, ResNet50 emerged as the most proficient, demonstrating an accuracy of 89.8%, precision of 90.00%, sensitivity of 89.80%, specificity of 96.60%, and an F1-score of 89.85%. These results highlight the potential of incorporating advanced, data-driven models into the field of dermatology. These models can serve as invaluable tools to assist dermatologists in making early and precise assessments of atopic dermatitis severity and therefore improve patient care and outcomes.
Collapse
Affiliation(s)
- Aga Maulana
- Department of Informatics, Faculty of Mathematics and Natural Sciences, Universitas Syiah Kuala, Banda Aceh, Indonesia
| | - Teuku R Noviandy
- Department of Informatics, Faculty of Mathematics and Natural Sciences, Universitas Syiah Kuala, Banda Aceh, Indonesia
| | - Rivansyah Suhendra
- Department of Information Technology, Faculty of Engineering, Universitas Teuku Umar, Meulaboh, Indonesia
| | - Nanda Earlia
- Dermatology Division, Dr. Zainoel Abidin Hospital, Banda Aceh, Indonesia
- Department of Dermatology and Venereology, Faculty of Medicine, Universitas Syiah Kuala, Banda Aceh, Indonesia
| | - Mikyal Bulqiah
- Dermatology Division, Dr. Zainoel Abidin Hospital, Banda Aceh, Indonesia
| | - Ghazi M Idroes
- Department of Occupational Health and Safety, Faculty of Health Sciences, Universitas Abulyatama, Aceh Besar, Indonesia
| | - Nurdjannah J Niode
- Department of Dermatology and Venereology, Faculty of Medicine, Sam Ratulangi University, Manado, Indonesia
| | - Hizir Sofyan
- Department of Statistics, Faculty of Mathematics and Natural Sciences, Universitas Syiah Kuala, Banda Aceh, Indonesia
| | - Muhammad Subianto
- Department of Statistics, Faculty of Mathematics and Natural Sciences, Universitas Syiah Kuala, Banda Aceh, Indonesia
| | - Rinaldi Idroes
- Department of Pharmacy, Faculty of Mathematics and Natural Sciences, Universitas Syiah Kuala, Banda Aceh, Indonesia
- Department of Statistics, Faculty of Mathematics and Natural Sciences, Universitas Syiah Kuala, Banda Aceh, Indonesia
| |
Collapse
|
4
|
van Breugel M, Fehrmann RSN, Bügel M, Rezwan FI, Holloway JW, Nawijn MC, Fontanella S, Custovic A, Koppelman GH. Current state and prospects of artificial intelligence in allergy. Allergy 2023; 78:2623-2643. [PMID: 37584170 DOI: 10.1111/all.15849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 07/08/2023] [Accepted: 07/31/2023] [Indexed: 08/17/2023]
Abstract
The field of medicine is witnessing an exponential growth of interest in artificial intelligence (AI), which enables new research questions and the analysis of larger and new types of data. Nevertheless, applications that go beyond proof of concepts and deliver clinical value remain rare, especially in the field of allergy. This narrative review provides a fundamental understanding of the core concepts of AI and critically discusses its limitations and open challenges, such as data availability and bias, along with potential directions to surmount them. We provide a conceptual framework to structure AI applications within this field and discuss forefront case examples. Most of these applications of AI and machine learning in allergy concern supervised learning and unsupervised clustering, with a strong emphasis on diagnosis and subtyping. A perspective is shared on guidelines for good AI practice to guide readers in applying it effectively and safely, along with prospects of field advancement and initiatives to increase clinical impact. We anticipate that AI can further deepen our knowledge of disease mechanisms and contribute to precision medicine in allergy.
Collapse
Affiliation(s)
- Merlijn van Breugel
- Department of Pediatric Pulmonology and Pediatric Allergology, Beatrix Children's Hospital, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- Groningen Research Institute for Asthma and COPD (GRIAC), University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- MIcompany, Amsterdam, the Netherlands
| | - Rudolf S N Fehrmann
- Department of Medical Oncology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | | | - Faisal I Rezwan
- Human Development and Health, Faculty of Medicine, University of Southampton, Southampton, UK
- Department of Computer Science, Aberystwyth University, Aberystwyth, UK
| | - John W Holloway
- Human Development and Health, Faculty of Medicine, University of Southampton, Southampton, UK
- National Institute for Health and Care Research Southampton Biomedical Research Centre, University Hospitals Southampton NHS Foundation Trust, Southampton, UK
| | - Martijn C Nawijn
- Groningen Research Institute for Asthma and COPD (GRIAC), University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- Department of Pathology and Medical Biology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Sara Fontanella
- National Heart and Lung Institute, Imperial College London, London, UK
- National Institute for Health and Care Research Imperial Biomedical Research Centre (BRC), London, UK
| | - Adnan Custovic
- National Heart and Lung Institute, Imperial College London, London, UK
- National Institute for Health and Care Research Imperial Biomedical Research Centre (BRC), London, UK
| | - Gerard H Koppelman
- Department of Pediatric Pulmonology and Pediatric Allergology, Beatrix Children's Hospital, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- Groningen Research Institute for Asthma and COPD (GRIAC), University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| |
Collapse
|
5
|
Luo N, Zhong X, Su L, Cheng Z, Ma W, Hao P. Artificial intelligence-assisted dermatology diagnosis: From unimodal to multimodal. Comput Biol Med 2023; 165:107413. [PMID: 37703714 DOI: 10.1016/j.compbiomed.2023.107413] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 08/02/2023] [Accepted: 08/28/2023] [Indexed: 09/15/2023]
Abstract
Artificial Intelligence (AI) is progressively permeating medicine, notably in the realm of assisted diagnosis. However, the traditional unimodal AI models, reliant on large volumes of accurately labeled data and single data type usage, prove insufficient to assist dermatological diagnosis. Augmenting these models with text data from patient narratives, laboratory reports, and image data from skin lesions, dermoscopy, and pathologies could significantly enhance their diagnostic capacity. Large-scale pre-training multimodal models offer a promising solution, exploiting the burgeoning reservoir of clinical data and amalgamating various data types. This paper delves into unimodal models' methodologies, applications, and shortcomings while exploring how multimodal models can enhance accuracy and reliability. Furthermore, integrating cutting-edge technologies like federated learning and multi-party privacy computing with AI can substantially mitigate patient privacy concerns in dermatological datasets and further fosters a move towards high-precision self-diagnosis. Diagnostic systems underpinned by large-scale pre-training multimodal models can facilitate dermatology physicians in formulating effective diagnostic and treatment strategies and herald a transformative era in healthcare.
Collapse
Affiliation(s)
- Nan Luo
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Xiaojing Zhong
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Luxin Su
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Zilin Cheng
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Wenyi Ma
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Pingsheng Hao
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| |
Collapse
|
6
|
Chen KJ, Han Y, Wang ZY, Cui Y. Submicron resolution techniques: Multiphoton microscopy in skin disease. Exp Dermatol 2023; 32:1613-1623. [PMID: 37522747 DOI: 10.1111/exd.14899] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Revised: 07/18/2023] [Accepted: 07/19/2023] [Indexed: 08/01/2023]
Abstract
Non-invasive optical examination plays a crucial role in various aspects of dermatology, such as diagnosis, management and research. Multiphoton microscopy uses a unique submicron technology to stimulate autofluorescence (AF), allowing for the observation of cellular structure, assessment of redox status and quantification of collagen fibres. This advanced imaging technique offers dermatologists novel insights into the skin's structure, positioning it as a promising 'stethoscope' for future development in the field. This review provides an overview of multiphoton microscopy's principles, technology and application in studying normal skin, tumour and inflammatory diseases, as well as collagen-related and pigmentary diseases.
Collapse
Affiliation(s)
- Ke-Jun Chen
- Department of Dermatology, China-Japan Friendship Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China
| | - Yang Han
- Department of Dermatology, China-Japan Friendship Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China
| | - Zi-Yi Wang
- Department of Dermatology, China-Japan Friendship Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China
| | - Yong Cui
- Department of Dermatology, China-Japan Friendship Hospital, Beijing, China
| |
Collapse
|
7
|
Stafie CS, Sufaru IG, Ghiciuc CM, Stafie II, Sufaru EC, Solomon SM, Hancianu M. Exploring the Intersection of Artificial Intelligence and Clinical Healthcare: A Multidisciplinary Review. Diagnostics (Basel) 2023; 13:1995. [PMID: 37370890 DOI: 10.3390/diagnostics13121995] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2023] [Revised: 05/31/2023] [Accepted: 06/05/2023] [Indexed: 06/29/2023] Open
Abstract
Artificial intelligence (AI) plays a more and more important role in our everyday life due to the advantages that it brings when used, such as 24/7 availability, a very low percentage of errors, ability to provide real time insights, or performing a fast analysis. AI is increasingly being used in clinical medical and dental healthcare analyses, with valuable applications, which include disease diagnosis, risk assessment, treatment planning, and drug discovery. This paper presents a narrative literature review of AI use in healthcare from a multi-disciplinary perspective, specifically in the cardiology, allergology, endocrinology, and dental fields. The paper highlights data from recent research and development efforts in AI for healthcare, as well as challenges and limitations associated with AI implementation, such as data privacy and security considerations, along with ethical and legal concerns. The regulation of responsible design, development, and use of AI in healthcare is still in early stages due to the rapid evolution of the field. However, it is our duty to carefully consider the ethical implications of implementing AI and to respond appropriately. With the potential to reshape healthcare delivery and enhance patient outcomes, AI systems continue to reveal their capabilities.
Collapse
Affiliation(s)
- Celina Silvia Stafie
- Department of Preventive Medicine and Interdisciplinarity, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| | - Irina-Georgeta Sufaru
- Department of Periodontology, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| | - Cristina Mihaela Ghiciuc
- Department of Morpho-Functional Sciences II-Pharmacology and Clinical Pharmacology, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| | - Ingrid-Ioana Stafie
- Endocrinology Residency Program, Sf. Spiridon Clinical Emergency Hospital, Independentei 1, 700111 Iasi, Romania
| | | | - Sorina Mihaela Solomon
- Department of Periodontology, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| | - Monica Hancianu
- Pharmacognosy-Phytotherapy, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| |
Collapse
|
8
|
MacMath D, Chen M, Khoury P. Artificial Intelligence: Exploring the Future of Innovation in Allergy Immunology. Curr Allergy Asthma Rep 2023:10.1007/s11882-023-01084-z. [PMID: 37160554 PMCID: PMC10169188 DOI: 10.1007/s11882-023-01084-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/21/2023] [Indexed: 05/11/2023]
Abstract
PURPOSE OF REVIEW Artificial intelligence (AI) has increasingly been used in healthcare. Given the capacity of AI to handle large data and complex relationships between variables, AI is well suited for applications in healthcare. Recently, AI has been applied to allergy research. RECENT FINDINGS In this article, we review how AI technologies have been utilized in basic science and clinical allergy research for asthma, atopic dermatitis, rhinology, adverse reactions to drugs and vaccines, food allergy, anaphylaxis, urticaria, and eosinophilic gastrointestinal disorders. We discuss barriers for AI adoption to improve the care of patients with atopic diseases. These studies demonstrate the utility of applying AI to the field of allergy to help investigators expand their understanding of disease pathogenesis, improve diagnostic accuracy, enable prediction for treatments and outcomes, and for drug discovery.
Collapse
Affiliation(s)
- Derek MacMath
- Department of Medicine, Department of Pediatrics, Baylor College of Medicine, Houston, TX, USA
| | - Meng Chen
- Division of Pulmonary, Allergy & Critical Care Medicine, Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA
| | - Paneez Khoury
- National Institutes of Allergic and Infectious Diseases, National Institutes of Health, 9000 Rockville Pike, Bethesda, MD, USA.
| |
Collapse
|
9
|
Multiphoton FLIM Analyses of Native and UVA-Modified Synthetic Melanins. Int J Mol Sci 2023; 24:ijms24054517. [PMID: 36901948 PMCID: PMC10002570 DOI: 10.3390/ijms24054517] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 02/14/2023] [Accepted: 02/21/2023] [Indexed: 03/02/2023] Open
Abstract
To better understand the impact of solar light exposure on human skin, the chemical characterization of native melanins and their structural photo-modifications is of central interest. As the methods used today are invasive, we investigated the possibility of using multiphoton fluorescence lifetime (FLIM) imaging, along with phasor and bi-exponential fitting analyses, as a non-invasive alternative method for the chemical analysis of native and UVA-exposed melanins. We demonstrated that multiphoton FLIM allows the discrimination between native DHI, DHICA, Dopa eumelanins, pheomelanin, and mixed eu-/pheo-melanin polymers. We exposed melanin samples to high UVA doses to maximize their structural modifications. The UVA-induced oxidative, photo-degradation, and crosslinking changes were evidenced via an increase in fluorescence lifetimes along with a decrease in their relative contributions. Moreover, we introduced a new phasor parameter of a relative fraction of a UVA-modified species and provided evidence for its sensitivity in assessing the UVA effects. Globally, the fluorescence lifetime properties were modulated in a melanin-dependent and UVA dose-dependent manner, with the strongest modifications being observed for DHICA eumelanin and the weakest for pheomelanin. Multiphoton FLIM phasor and bi-exponential analyses hold promising perspectives for in vivo human skin mixed melanins characterization under UVA or other sunlight exposure conditions.
Collapse
|
10
|
Li Y, Zhao D, Xu Z, Heidari AA, Chen H, Jiang X, Liu Z, Wang M, Zhou Q, Xu S. bSRWPSO-FKNN: A boosted PSO with fuzzy K-nearest neighbor classifier for predicting atopic dermatitis disease. Front Neuroinform 2023; 16:1063048. [PMID: 36726405 PMCID: PMC9884708 DOI: 10.3389/fninf.2022.1063048] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 12/05/2022] [Indexed: 01/18/2023] Open
Abstract
Introduction Atopic dermatitis (AD) is an allergic disease with extreme itching that bothers patients. However, diagnosing AD depends on clinicians' subjective judgment, which may be missed or misdiagnosed sometimes. Methods This paper establishes a medical prediction model for the first time on the basis of the enhanced particle swarm optimization (SRWPSO) algorithm and the fuzzy K-nearest neighbor (FKNN), called bSRWPSO-FKNN, which is practiced on a dataset related to patients with AD. In SRWPSO, the Sobol sequence is introduced into particle swarm optimization (PSO) to make the particle distribution of the initial population more uniform, thus improving the population's diversity and traversal. At the same time, this study also adds a random replacement strategy and adaptive weight strategy to the population updating process of PSO to overcome the shortcomings of poor convergence accuracy and easily fall into the local optimum of PSO. In bSRWPSO-FKNN, the core of which is to optimize the classification performance of FKNN through binary SRWPSO. Results To prove that the study has scientific significance, this paper first successfully demonstrates the core advantages of SRWPSO in well-known algorithms through benchmark function validation experiments. Secondly, this article demonstrates that the bSRWPSO-FKNN has practical medical significance and effectiveness through nine public and medical datasets. Discussion The 10 times 10-fold cross-validation experiments demonstrate that bSRWPSO-FKNN can pick up the key features of AD, including the content of lymphocytes (LY), Cat dander, Milk, Dermatophagoides Pteronyssinus/Farinae, Ragweed, Cod, and Total IgE. Therefore, the established bSRWPSO-FKNN method practically aids in the diagnosis of AD.
Collapse
Affiliation(s)
- Yupeng Li
- College of Computer Science and Technology, Changchun Normal University, Changchun, Jilin, China
| | - Dong Zhao
- College of Computer Science and Technology, Changchun Normal University, Changchun, Jilin, China,*Correspondence: Dong Zhao,
| | - Zhangze Xu
- College of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, China
| | - Ali Asghar Heidari
- School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran, Iran
| | - Huiling Chen
- College of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, China,Huiling Chen,
| | - Xinyu Jiang
- Department of Dermatology, The Affiliated Hospital of Medical School, Ningbo University, Ningbo, China,School of Medicine, Ningbo University, Ningbo, Zhejiang, China
| | - Zhifang Liu
- Department of Dermatology, The Affiliated Hospital of Medical School, Ningbo University, Ningbo, China,School of Medicine, Ningbo University, Ningbo, Zhejiang, China
| | - Mengmeng Wang
- Department of Dermatology, The Affiliated Hospital of Medical School, Ningbo University, Ningbo, China,School of Medicine, Ningbo University, Ningbo, Zhejiang, China
| | - Qiongyan Zhou
- Department of Dermatology, The Affiliated Hospital of Medical School, Ningbo University, Ningbo, China
| | - Suling Xu
- Department of Dermatology, The Affiliated Hospital of Medical School, Ningbo University, Ningbo, China,Suling Xu,
| |
Collapse
|
11
|
Batista A, Guimarães P, Domingues JP, Quadrado MJ, Morgado AM. Two-Photon Imaging for Non-Invasive Corneal Examination. SENSORS (BASEL, SWITZERLAND) 2022; 22:9699. [PMID: 36560071 PMCID: PMC9783858 DOI: 10.3390/s22249699] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 12/02/2022] [Accepted: 12/04/2022] [Indexed: 06/17/2023]
Abstract
Two-photon imaging (TPI) microscopy, namely, two-photon excited fluorescence (TPEF), fluorescence lifetime imaging (FLIM), and second-harmonic generation (SHG) modalities, has emerged in the past years as a powerful tool for the examination of biological tissues. These modalities rely on different contrast mechanisms and are often used simultaneously to provide complementary information on morphology, metabolism, and structural properties of the imaged tissue. The cornea, being a transparent tissue, rich in collagen and with several cellular layers, is well-suited to be imaged by TPI microscopy. In this review, we discuss the physical principles behind TPI as well as its instrumentation. We also provide an overview of the current advances in TPI instrumentation and image analysis. We describe how TPI can be leveraged to retrieve unique information on the cornea and to complement the information provided by current clinical devices. The present state of corneal TPI is outlined. Finally, we discuss the obstacles that must be overcome and offer perspectives and outlooks to make clinical TPI of the human cornea a reality.
Collapse
Affiliation(s)
- Ana Batista
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, 3000-548 Coimbra, Portugal
- Institute for Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, 3000-548 Coimbra, Portugal
- Department of Physics, Faculty of Science and Technology, University of Coimbra, 3004-516 Coimbra, Portugal
| | - Pedro Guimarães
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, 3000-548 Coimbra, Portugal
- Institute for Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, 3000-548 Coimbra, Portugal
| | - José Paulo Domingues
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, 3000-548 Coimbra, Portugal
- Institute for Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, 3000-548 Coimbra, Portugal
- Department of Physics, Faculty of Science and Technology, University of Coimbra, 3004-516 Coimbra, Portugal
| | - Maria João Quadrado
- Department of Ophthalmology, Centro Hospitalar e Universitário de Coimbra, 3004-561 Coimbra, Portugal
- Coimbra Institute for Clinical and Biomedical Research (iCBR), Faculty of Medicine, University of Coimbra, 3000-548 Coimbra, Portugal
| | - António Miguel Morgado
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, 3000-548 Coimbra, Portugal
- Institute for Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, 3000-548 Coimbra, Portugal
- Department of Physics, Faculty of Science and Technology, University of Coimbra, 3004-516 Coimbra, Portugal
| |
Collapse
|
12
|
Li Z, Koban KC, Schenck TL, Giunta RE, Li Q, Sun Y. Artificial Intelligence in Dermatology Image Analysis: Current Developments and Future Trends. J Clin Med 2022; 11:jcm11226826. [PMID: 36431301 PMCID: PMC9693628 DOI: 10.3390/jcm11226826] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 10/24/2022] [Accepted: 10/28/2022] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND Thanks to the rapid development of computer-based systems and deep-learning-based algorithms, artificial intelligence (AI) has long been integrated into the healthcare field. AI is also particularly helpful in image recognition, surgical assistance and basic research. Due to the unique nature of dermatology, AI-aided dermatological diagnosis based on image recognition has become a modern focus and future trend. Key scientific concepts of review: The use of 3D imaging systems allows clinicians to screen and label skin pigmented lesions and distributed disorders, which can provide an objective assessment and image documentation of lesion sites. Dermatoscopes combined with intelligent software help the dermatologist to easily correlate each close-up image with the corresponding marked lesion in the 3D body map. In addition, AI in the field of prosthetics can assist in the rehabilitation of patients and help to restore limb function after amputation in patients with skin tumors. THE AIM OF THE STUDY For the benefit of patients, dermatologists have an obligation to explore the opportunities, risks and limitations of AI applications. This study focuses on the application of emerging AI in dermatology to aid clinical diagnosis and treatment, analyzes the current state of the field and summarizes its future trends and prospects so as to help dermatologists realize the impact of new technological innovations on traditional practices so that they can embrace and use AI-based medical approaches more quickly.
Collapse
Affiliation(s)
- Zhouxiao Li
- Department of Plastic and Reconstructive Surgery, Shanghai 9th People’s Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200023, China
- Division of Hand, Plastic and Aesthetic Surgery, University Hospital, LMU Munich, 80339 Munich, Germany
| | | | - Thilo Ludwig Schenck
- Division of Hand, Plastic and Aesthetic Surgery, University Hospital, LMU Munich, 80339 Munich, Germany
| | - Riccardo Enzo Giunta
- Division of Hand, Plastic and Aesthetic Surgery, University Hospital, LMU Munich, 80339 Munich, Germany
| | - Qingfeng Li
- Department of Plastic and Reconstructive Surgery, Shanghai 9th People’s Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200023, China
- Correspondence: (Q.L.); (Y.S.)
| | - Yangbai Sun
- Department of Plastic and Reconstructive Surgery, Shanghai 9th People’s Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200023, China
- Correspondence: (Q.L.); (Y.S.)
| |
Collapse
|
13
|
Xu HL, Gong TT, Liu FH, Chen HY, Xiao Q, Hou Y, Huang Y, Sun HZ, Shi Y, Gao S, Lou Y, Chang Q, Zhao YH, Gao QL, Wu QJ. Artificial intelligence performance in image-based ovarian cancer identification: A systematic review and meta-analysis. EClinicalMedicine 2022; 53:101662. [PMID: 36147628 PMCID: PMC9486055 DOI: 10.1016/j.eclinm.2022.101662] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 08/25/2022] [Accepted: 08/30/2022] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND Accurate identification of ovarian cancer (OC) is of paramount importance in clinical treatment success. Artificial intelligence (AI) is a potentially reliable assistant for the medical imaging recognition. We systematically review articles on the diagnostic performance of AI in OC from medical imaging for the first time. METHODS The Medline, Embase, IEEE, PubMed, Web of Science, and the Cochrane library databases were searched for related studies published until August 1, 2022. Inclusion criteria were studies that developed or used AI algorithms in the diagnosis of OC from medical images. The binary diagnostic accuracy data were extracted to derive the outcomes of interest: sensitivity (SE), specificity (SP), and Area Under the Curve (AUC). The study was registered with the PROSPERO, CRD42022324611. FINDINGS Thirty-four eligible studies were identified, of which twenty-eight studies were included in the meta-analysis with a pooled SE of 88% (95%CI: 85-90%), SP of 85% (82-88%), and AUC of 0.93 (0.91-0.95). Analysis for different algorithms revealed a pooled SE of 89% (85-92%) and SP of 88% (82-92%) for machine learning; and a pooled SE of 88% (84-91%) and SP of 84% (80-87%) for deep learning. Acceptable diagnostic performance was demonstrated in subgroup analyses stratified by imaging modalities (Ultrasound, Magnetic Resonance Imaging, or Computed Tomography), sample size (≤300 or >300), AI algorithms versus clinicians, year of publication (before or after 2020), geographical distribution (Asia or non Asia), and the different risk of bias levels (≥3 domain low risk or < 3 domain low risk). INTERPRETATION AI algorithms exhibited favorable performance for the diagnosis of OC through medical imaging. More rigorous reporting standards that address specific challenges of AI research could improve future studies. FUNDING This work was supported by the Natural Science Foundation of China (No. 82073647 to Q-JW and No. 82103914 to T-TG), LiaoNing Revitalization Talents Program (No. XLYC1907102 to Q-JW), and 345 Talent Project of Shengjing Hospital of China Medical University (No. M0268 to Q-JW and No. M0952 to T-TG).
Collapse
Key Words
- AI, Artificial intelligence
- AUC, Area Under the Curve
- Artificial intelligence
- CT, Computed Tomography
- DL, Deep learning
- ML, Machine learning
- MRI, Magnetic Resonance Imaging
- Medical imaging
- Meta-analysis
- OC, Ovarian cancer
- Ovarian cancer
- SE, Sensitivity
- SP, Specificity
- US, Ultrasound
- XAI, Explainable artificial intelligence
Collapse
Affiliation(s)
- He-Li Xu
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Ting-Ting Gong
- Department of Obstetrics and Gynecology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Fang-Hua Liu
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Hong-Yu Chen
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Qian Xiao
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Yang Hou
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Ying Huang
- Department of Ultrasound, Shengjing Hospital of China Medical University, Shenyang, China
| | - Hong-Zan Sun
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Yu Shi
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Song Gao
- Department of Obstetrics and Gynecology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Yan Lou
- Department of Intelligent Medicine, China Medical University, China
| | - Qing Chang
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Yu-Hong Zhao
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
| | - Qing-Lei Gao
- National Clinical Research Center for Obstetrics and Gynecology, Cancer Biology Research Centre (Key Laboratory of the Ministry of Education) and Department of Gynecology and Obstetrics, Tongji Hospital, Wuhan, China
| | - Qi-Jun Wu
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, China
- Clinical Research Center, Shengjing Hospital of China Medical University, Shenyang, China
- Key Laboratory of Precision Medical Research on Major Chronic Disease, Shengjing Hospital of China Medical University, Shenyang, China
- Department of Obstetrics and Gynecology, Shengjing Hospital of China Medical University, Shenyang, China
- Corresponding author at: Department of Clinical Epidemiology, Department of Obstetrics and Gynecology, Clinical Research Center, Shengjing Hospital of China Medical University, Address: No. 36, San Hao Street, Shenyang, Liaoning 110004, PR China.
| |
Collapse
|
14
|
Goldust Y, Sameem F, Mearaj S, Gupta A, Patil A, Goldust M. COVID-19 and artificial intelligence: Experts and dermatologists perspective. J Cosmet Dermatol 2022; 22:11-15. [PMID: 35976075 PMCID: PMC9537934 DOI: 10.1111/jocd.15310] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2022] [Accepted: 08/13/2022] [Indexed: 01/24/2023]
Abstract
INTRODUCTION Artificial intelligence (AI) has an important role to play in future healthcare offerings. Machine learning and artificial neural networks are subsets of AI that refer to the incorporation of human intelligence into computers to think and behave like humans. OBJECTIVE The objective of this review article is to discuss perspectives on the AI in relation to Coronavirus disease (COVID-19). METHODS Google Scholar and PubMed databases were searched to retrieve articles related to COVID-19 and AI. The current evidence is analysed and perspectives on the usefulness of AI in COVID-19 is discussed. RESULTS The coronavirus pandemic has rendered the entire world immobile, crashing economies, industries, and health care. Telemedicine or tele-dermatology for dermatologists has become one of the most common solutions to tackle this crisis while adhering to social distancing for consultations. While it has not yet achieved its full potential, AI is being used to combat coronavirus disease on multiple fronts. AI has made its impact in predicting disease onset by issuing early warnings and alerts, monitoring, forecasting the spread of disease and supporting therapy. In addition, AI has helped us to build a model of a virtual protein structure and has played a role in teaching as well as social control. CONCLUSION Full potential of AI is yet to be realized. Expert data collection, analysis, and implementation are needed to improve this advancement.
Collapse
Affiliation(s)
- Yaser Goldust
- Department of Architecture, Faculty of Art and ArchitectureUniversity of MazandaranBabolsarIran
| | - Farah Sameem
- Dermatology SKIMS Medical College Srinagar KashmirSrinagarIndia
| | - Samia Mearaj
- Institute of Dermatology Srinagar KashmirSrinagarIndia
| | | | - Anant Patil
- Department of PharmacologyDr. DY Patil Medical CollegeNavi MumbaiIndia
| | - Mohamad Goldust
- Department of DermatologyUniversity Medical Center of the Johannes Gutenberg UniversityMainzGermany
| |
Collapse
|
15
|
Medela A, Mac Carthy T, Aguilar Robles SA, Chiesa-Estomba CM, Grimalt R. Automatic SCOring of Atopic Dermatitis using Deep Learning (ASCORAD): A Pilot Study. JID INNOVATIONS 2022; 2:100107. [PMID: 35990535 PMCID: PMC9382656 DOI: 10.1016/j.xjidi.2022.100107] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2021] [Revised: 12/28/2021] [Accepted: 12/29/2021] [Indexed: 11/18/2022] Open
Abstract
Atopic dermatitis (AD) is a chronic, itchy skin condition that affects 15–20% of children but may occur at any age. It is estimated that 16.5 million US adults (7.3%) have AD that initially began at age >2 years, with nearly 40% affected by moderate or severe disease. Therefore, a quantitative measurement that tracks the evolution of AD severity could be extremely useful in assessing patient evolution and therapeutic efficacy. Currently, SCOring Atopic Dermatitis (SCORAD) is the most frequently used measurement tool in clinical practice. However, SCORAD has the following disadvantages: (i) time consuming—calculating SCORAD usually takes about 7–10 minutes per patient, which poses a heavy burden on dermatologists and (ii) inconsistency—owing to the complexity of SCORAD calculation, even well-trained dermatologists could give different scores for the same case. In this study, we introduce the Automatic SCORAD, an automatic version of the SCORAD that deploys state-of-the-art convolutional neural networks that measure AD severity by analyzing skin lesion images. Overall, we have shown that Automatic SCORAD may prove to be a rapid and objective alternative method for the automatic assessment of AD, achieving results comparable with those of human expert assessment while reducing interobserver variability.
Collapse
Affiliation(s)
- Alfonso Medela
- Department of Medical Computer Vision and PROMs, Legit.Health, Bilbao, Spain
- Correspondence: Alfonso Medela, Department of Medical Computer Vision and PROMs, Legit.Health, Bilbao 48013, Spain.
| | - Taig Mac Carthy
- Department of Clinical Endpoint Innovation, Legit.Health, Bilbao, Spain
| | | | - Carlos M. Chiesa-Estomba
- Department of Otorhinolaryngology, Osakidetza Donostia University Hospital, San Sebastian, Spain
- Biodonostia Health Research Institute, San Sebastian, Spain
| | - Ramon Grimalt
- Faculty of Medicine and Health Sciences, UIC Barcelona, International University of Catalonia, Barcelona, Spain
| |
Collapse
|
16
|
Jiang Z, Li J, Kong N, Kim JH, Kim BS, Lee MJ, Park YM, Lee SY, Hong SJ, Sul JH. Accurate diagnosis of atopic dermatitis by combining transcriptome and microbiota data with supervised machine learning. Sci Rep 2022; 12:290. [PMID: 34997172 PMCID: PMC8741793 DOI: 10.1038/s41598-021-04373-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Accepted: 12/14/2021] [Indexed: 11/16/2022] Open
Abstract
Atopic dermatitis (AD) is a common skin disease in childhood whose diagnosis requires expertise in dermatology. Recent studies have indicated that host genes–microbial interactions in the gut contribute to human diseases including AD. We sought to develop an accurate and automated pipeline for AD diagnosis based on transcriptome and microbiota data. Using these data of 161 subjects including AD patients and healthy controls, we trained a machine learning classifier to predict the risk of AD. We found that the classifier could accurately differentiate subjects with AD and healthy individuals based on the omics data with an average F1-score of 0.84. With this classifier, we also identified a set of 35 genes and 50 microbiota features that are predictive for AD. Among the selected features, we discovered at least three genes and three microorganisms directly or indirectly associated with AD. Although further replications in other cohorts are needed, our findings suggest that these genes and microbiota features may provide novel biological insights and may be developed into useful biomarkers of AD prediction.
Collapse
Affiliation(s)
- Ziyuan Jiang
- Department of Automation, Tsinghua University, Beijing, 100084, China
| | - Jiajin Li
- Department of Human Genetics, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, 90095, USA
| | - Nahyun Kong
- Department of Biological Sciences, Korea Advanced Institute of Science and Technology, Daejeon, Daejeon, 34141, Republic of Korea
| | - Jeong-Hyun Kim
- Department of Medicine, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| | - Bong-Soo Kim
- Department of Life Science, Multidisciplinary Genome Institute, Hallym University, Chuncheon, 24252, Republic of Korea
| | - Min-Jung Lee
- Department of Life Science, Multidisciplinary Genome Institute, Hallym University, Chuncheon, 24252, Republic of Korea
| | - Yoon Mee Park
- Department of Medicine, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| | - So-Yeon Lee
- Department of Pediatrics, Asan Medical Center, Childhood Asthma Atopy Center, Humidifier Disinfectant Health Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| | - Soo-Jong Hong
- Department of Pediatrics, Asan Medical Center, Childhood Asthma Atopy Center, Humidifier Disinfectant Health Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea.
| | - Jae Hoon Sul
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, 90095, USA.
| |
Collapse
|
17
|
Terradillos E, Saratxaga CL, Mattana S, Cicchi R, Pavone FS, Andraka N, Glover BJ, Arbide N, Velasco J, Etxezarraga MC, Picon A. Analysis on the Characterization of Multiphoton Microscopy Images for Malignant Neoplastic Colon Lesion Detection under Deep Learning Methods. J Pathol Inform 2021; 12:27. [PMID: 34447607 PMCID: PMC8359734 DOI: 10.4103/jpi.jpi_113_20] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 04/29/2021] [Accepted: 06/21/2021] [Indexed: 12/22/2022] Open
Abstract
Background: Colorectal cancer has a high incidence rate worldwide, with over 1.8 million new cases and 880,792 deaths in 2018. Fortunately, its early detection significantly increases the survival rate, reaching a cure rate of 90% when diagnosed at a localized stage. Colonoscopy is the gold standard technique for detection and removal of colorectal lesions with potential to evolve into cancer. When polyps are found in a patient, the current procedure is their complete removal. However, in this process, gastroenterologists cannot assure complete resection and clean margins which are given by the histopathology analysis of the removed tissue, which is performed at laboratory. Aims: In this paper, we demonstrate the capabilities of multiphoton microscopy (MPM) technology to provide imaging biomarkers that can be extracted by deep learning techniques to identify malignant neoplastic colon lesions and distinguish them from healthy, hyperplastic, or benign neoplastic tissue, without the need for histopathological staining. Materials and Methods: To this end, we present a novel MPM public dataset containing 14,712 images obtained from 42 patients and grouped into 2 classes. A convolutional neural network is trained on this dataset and a spatially coherent predictions scheme is applied for performance improvement. Results: We obtained a sensitivity of 0.8228 ± 0.1575 and a specificity of 0.9114 ± 0.0814 on detecting malignant neoplastic lesions. We also validated this approach to estimate the self-confidence of the network on its own predictions, obtaining a mean sensitivity of 0.8697 and a mean specificity of 0.9524 with the 18.67% of the images classified as uncertain. Conclusions: This work lays the foundations for performing in vivo optical colon biopsies by combining this novel imaging technology together with deep learning algorithms, hence avoiding unnecessary polyp resection and allowing in situ diagnosis assessment.
Collapse
Affiliation(s)
| | | | - Sara Mattana
- European Laboratory for Non-Linear Spectroscopy, Sesto Fiorentino, Italy
| | - Riccardo Cicchi
- European Laboratory for Non-Linear Spectroscopy, Sesto Fiorentino, Italy
| | - Francesco S Pavone
- European Laboratory for Non-Linear Spectroscopy, Sesto Fiorentino, Italy
| | - Nagore Andraka
- Basque Foundation for Health Innovation and Research, Barakaldo, Spain
| | - Benjamin J Glover
- Department of Surgery and Cancer, Imperial College London, London, UK
| | - Nagore Arbide
- Department of Pathological Anatomy, Osakidetza Basque Health Service, Basurto University Hospital, Bilbao, Spain
| | - Jacques Velasco
- Department of Pathological Anatomy, Osakidetza Basque Health Service, Basurto University Hospital, Bilbao, Spain
| | - Mª Carmen Etxezarraga
- Department of Pathological Anatomy, Osakidetza Basque Health Service, Basurto University Hospital, Bilbao, Spain
| | - Artzai Picon
- University of the Basque Country UPV/EHU, Bilbao, Spain
| |
Collapse
|
18
|
Prinke P, Haueisen J, Klee S, Rizqie MQ, Supriyanto E, König K, Breunig HG, Piątek Ł. Automatic segmentation of skin cells in multiphoton data using multi-stage merging. Sci Rep 2021; 11:14534. [PMID: 34267247 PMCID: PMC8282875 DOI: 10.1038/s41598-021-93682-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 06/27/2021] [Indexed: 01/10/2023] Open
Abstract
We propose a novel automatic segmentation algorithm that separates the components of human skin cells from the rest of the tissue in fluorescence data of three-dimensional scans using non-invasive multiphoton tomography. The algorithm encompasses a multi-stage merging on preprocessed superpixel images to ensure independence from a single empirical global threshold. This leads to a high robustness of the segmentation considering the depth-dependent data characteristics, which include variable contrasts and cell sizes. The subsequent classification of cell cytoplasm and nuclei are based on a cell model described by a set of four features. Two novel features, a relationship between outer cell and inner nucleus (OCIN) and a stability index, were derived. The OCIN feature describes the topology of the model, while the stability index indicates segment quality in the multi-stage merging process. These two new features, combined with the local gradient magnitude and compactness, are used for the model-based fuzzy evaluation of the cell segments. We exemplify our approach on an image stack with 200 × 200 × 100 μm3, including the skin layers of the stratum spinosum and the stratum basale of a healthy volunteer. Our image processing pipeline contributes to the fully automated classification of human skin cells in multiphoton data and provides a basis for the detection of skin cancer using non-invasive optical biopsy.
Collapse
Affiliation(s)
- Philipp Prinke
- Institute for Biomedical Engineering and Informatics, Technische Universität Ilmenau, 98693, Ilmenau, Germany.
| | - Jens Haueisen
- Institute for Biomedical Engineering and Informatics, Technische Universität Ilmenau, 98693, Ilmenau, Germany
| | - Sascha Klee
- Institute for Biomedical Engineering and Informatics, Technische Universität Ilmenau, 98693, Ilmenau, Germany.,Division Biostatistics and Data Science, Department of General Health Studies, Karl Landsteiner University of Health Sciences, Dr. Karl-Dorrek-Straße 30, 3500, Krems, Austria
| | - Muhammad Qurhanul Rizqie
- Institute for Biomedical Engineering and Informatics, Technische Universität Ilmenau, 98693, Ilmenau, Germany.,Informatics Engineering Program, Universitas Sriwijaya, Palembang, South Sumatera, Indonesia
| | - Eko Supriyanto
- Institute for Biomedical Engineering and Informatics, Technische Universität Ilmenau, 98693, Ilmenau, Germany.,IJN-UTM Cardiovascular Engineering Centre, Universiti Teknologi Malaysia, Johor Bahru, Johor, Malaysia
| | - Karsten König
- Department of Biophotonics and Laser Technology, Saarland University, Campus A5.1, 66123, Saarbrücken, Germany.,JenLab GmbH, Johann-Hittorf-Straße 8, 12489, Berlin, Germany
| | - Hans Georg Breunig
- Department of Biophotonics and Laser Technology, Saarland University, Campus A5.1, 66123, Saarbrücken, Germany.,JenLab GmbH, Johann-Hittorf-Straße 8, 12489, Berlin, Germany
| | - Łukasz Piątek
- Institute for Biomedical Engineering and Informatics, Technische Universität Ilmenau, 98693, Ilmenau, Germany.,Department of Artificial Intelligence, University of Information Technology and Management, H. Sucharskiego 2 Str, 35-225, Rzeszów, Poland
| |
Collapse
|
19
|
Shabestri B, Anastasio MA, Fei B, Leblond F. Special Series Guest Editorial: Artificial Intelligence and Machine Learning in Biomedical Optics. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-21-0414. [PMID: 33973425 PMCID: PMC8109026 DOI: 10.1117/1.jbo.26.5.052901] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/01/2021] [Accepted: 01/01/2021] [Indexed: 06/12/2023]
Abstract
Guest editors Behrouz Shabestri, Mark Anastasio, Baowei Fei, and Frédéric Leblond provide an overview of the JBO Special Series on Artificial Intelligence Machine Learning in Biomedical Optics.
Collapse
Affiliation(s)
- Behrouz Shabestri
- National Institute of Biomedical Imaging and Bioengineering, Maryland, United States
| | | | - Baowei Fei
- University of Texas at Dallas, Texas, United States
- UT Southwestern Medical Center, Texas United States
| | - Frédéric Leblond
- Department of Engineering Physics, Polytechnique Montréal, Montreal, Quebec, Canada
- Centre de recherche du Centre hospitalier de l’Université de Montréal, Montreal, Quebec, Canada
| |
Collapse
|
20
|
Csuka EA, Ward SC, Ekelem C, Csuka DA, Ardigò M, Mesinkovska NA. Reflectance Confocal Microscopy, Optical Coherence Tomography, and Multiphoton Microscopy in Inflammatory Skin Disease Diagnosis. Lasers Surg Med 2021; 53:776-797. [PMID: 33527483 DOI: 10.1002/lsm.23386] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2020] [Revised: 01/13/2021] [Accepted: 01/18/2021] [Indexed: 12/27/2022]
Abstract
BACKGROUND AND OBJECTIVES Technological advances in medicine have brought about many novel skin imaging devices. This review aims to evaluate the scientific evidence supporting the use of noninvasive optical imaging techniques to aid in the diagnosis and prognosis of inflammatory skin diseases. STUDY DESIGN/MATERIALS AND METHODS PubMed and Scopus were searched in September 2020 according to PRISMA guidelines for articles using reflectance confocal microscopy (RCM), optical coherence tomography (OCT), and multiphoton microscopy (MPM) in inflammatory skin diseases, excluding studies monitoring treatment efficacy. RESULTS At the time of the study, there were 66 articles that addressed the utilization of noninvasive imaging in interface, spongiotic, psoriasiform, vesiculobullous, and fibrosing/sclerosing inflammatory skin dermatoses: RCM was utilized in 46, OCT in 16, and MPM in 5 articles. RCM was most investigated in psoriasiform dermatoses, whereas OCT and MPM were both most investigated in spongiotic dermatoses, including atopic dermatitis and allergic contact dermatitis. CONCLUSIONS There is preliminary evidence to support the diagnostic potential of noninvasive optical imaging techniques in inflammatory skin diseases. Improvements in the devices and further correlation with histology will help broaden their utility. Additional studies are needed to determine the parameters for diagnostic features, disease differentiation, and staging of inflammatory skin conditions. Lasers Surg. Med. © 2021 Wiley Periodicals LLC.
Collapse
Affiliation(s)
- Ella A Csuka
- Department of Dermatology, University of California, Irvine, Irvine, California, 92697
| | - Suzanne C Ward
- Department of Dermatology, University of California, Irvine, Irvine, California, 92697
| | - Chloe Ekelem
- Department of Dermatology, University of California, Irvine, Irvine, California, 92697
| | - David A Csuka
- Department of Dermatology, University of California, Irvine, Irvine, California, 92697
| | - Marco Ardigò
- San Gallicano Dermatological Institute-IRCCS, Via Chianesi 53, Rome, 00144, Italy
| | - Natasha A Mesinkovska
- Department of Dermatology, University of California, Irvine, Irvine, California, 92697
| |
Collapse
|
21
|
Influence of number of membership functions on prediction of membrane systems using adaptive network based fuzzy inference system (ANFIS). Sci Rep 2020; 10:16110. [PMID: 32999437 PMCID: PMC7527959 DOI: 10.1038/s41598-020-73175-0] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Accepted: 09/14/2020] [Indexed: 12/04/2022] Open
Abstract
In membrane separation technologies, membrane modules are used to separate chemical components. In membrane technology, understanding the behavior of fluids inside membrane module is challenging, and numerical methods are possible by using computational fluid dynamics (CFD). On the other hand, the optimization of membrane technology via CFD needs time and computational costs. Artificial Intelligence (AI) and CFD together can model a chemical process, including membrane technology and phase separation. This process can learn the process by learning the neural networks, and point by point learning of CFD mesh elements (computing nodes), and the fuzzy logic system can predict this process. In the current study, the adaptive neuro-fuzzy inference system (ANFIS) model and different parameters of ANFIS for learning a process based on membrane technology was used. The purpose behind using this model is to see how different tuning parameters of the ANFIS model can be used for increasing the exactness of the AI model and prediction of the membrane technology. These parameters were changed in this study, and the accuracy of the prediction was investigated. The results indicated that with low number of inputs, poor regression was obtained, less than 0.32 (R-value), but by increasing the number of inputs, the AI algorithm led to an increase in the prediction capability of the model. When the number of inputs increased to 4, the R-value was increased to 0.99, showing the high accuracy of model as well as its high capability in prediction of membrane process. The AI results were in good agreement with the CFD results. AI results were achieved in a limited time and with low computational costs. In terms of the categorization of CFD data-set, the AI framework plays a critical role in storing data in short memory, and the recovery mechanism can be very easy for users. Furthermore, the results were compared with Particle Swarm Optimization (PSOFIS), and Genetic Algorithm (GAFIS). The time for prediction and learning were compared to study the capability of the methods in prediction and their accuracy.
Collapse
|
22
|
Gorzelanny C, Mess C, Schneider SW, Huck V, Brandner JM. Skin Barriers in Dermal Drug Delivery: Which Barriers Have to Be Overcome and How Can We Measure Them? Pharmaceutics 2020; 12:E684. [PMID: 32698388 PMCID: PMC7407329 DOI: 10.3390/pharmaceutics12070684] [Citation(s) in RCA: 80] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Revised: 07/11/2020] [Accepted: 07/14/2020] [Indexed: 12/13/2022] Open
Abstract
Although, drugs are required in the various skin compartments such as viable epidermis, dermis, or hair follicles, to efficiently treat skin diseases, drug delivery into and across the skin is still challenging. An improved understanding of skin barrier physiology is mandatory to optimize drug penetration and permeation. The various barriers of the skin have to be known in detail, which means methods are needed to measure their functionality and outside-in or inside-out passage of molecules through the various barriers. In this review, we summarize our current knowledge about mechanical barriers, i.e., stratum corneum and tight junctions, in interfollicular epidermis, hair follicles and glands. Furthermore, we discuss the barrier properties of the basement membrane and dermal blood vessels. Barrier alterations found in skin of patients with atopic dermatitis are described. Finally, we critically compare the up-to-date applicability of several physical, biochemical and microscopic methods such as transepidermal water loss, impedance spectroscopy, Raman spectroscopy, immunohistochemical stainings, optical coherence microscopy and multiphoton microscopy to distinctly address the different barriers and to measure permeation through these barriers in vitro and in vivo.
Collapse
Affiliation(s)
| | | | | | | | - Johanna M. Brandner
- Department of Dermatology and Venerology, Center for Internal Medicine, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany; (C.G.); (C.M.); (S.W.S.); (V.H.)
| |
Collapse
|