1
|
Yang Y, Qian Z, Wu C, Cheng Y, Yang B, Shao J, Zhao J, Zhu X, Jia X, Feng L. Differential absorption and metabolic characteristics of organic acid components in pudilan xiaoyan oral liquid between young rats and adult rats. JOURNAL OF ETHNOPHARMACOLOGY 2024; 334:118528. [PMID: 38972526 DOI: 10.1016/j.jep.2024.118528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Revised: 07/01/2024] [Accepted: 07/04/2024] [Indexed: 07/09/2024]
Abstract
ETHNOPHARMACOLOGICAL RELEVANCE Pudilan Xiaoyan Oral Liquid (PDL) is a proprietary Chinese medicinal preparation approved by the State for treating acute pharyngitis in both adults and children (Approval No. Z20030095). It is worth noting that children exhibit unique physiopathological characteristics compared to adults. However, the in vivo regulatory characteristics of PDL in treating acute pharyngitis in children remain incompletely understood. AIM OF THE STUDY The differential absorption and metabolism characteristics of the main pharmacological components in PDL in young and adult rats were investigated with a view to providing a reference for preclinical data of PDL in medication for children. MATERIALS AND METHODS This study utilized UPLC-Q-TOF-MS to investigate the pharmacodynamic material basis of PDL. The focus was on the gastrointestinal digestion and absorption characteristics of organic acid components in PDL (PDL-OAC), known as the primary pharmacodynamic components in this formulation. The research combined in vitro dynamic simulation and a Quadruple single-pass intestinal perfusion model to examine these characteristics. The permeability properties of PDL-OAC were evaluated using an artificial parallel membrane model. Additionally, an acute pharyngitis model was established to evaluate the histopathological condition of the pharynx in young rats using H&E staining. The levels of IL-1β, TNF-α, IL-6, and IL-10 in blood and pharyngeal tissue homogenates of young rats were quantified using ELISA kits. RESULTS A total of 91 components were identified in PDL, including 33 organic acids, 24 flavonoids, 14 alkaloids, 5 terpenoids and coumarins, 3 sugars, and 12 amino acids. The PDL-OAC exhibited a significant reduction in IL-1β, TNF-α, IL-6, and IL-10 levels in the pharyngeal tissues of young rats with acute pharyngitis. Results from dynamic simulation studies of gastrointestinal fluids revealed that the PDL-OAC (Specifically chlorogenic acid (CGA), gallic acid (GA), chicoric acid (CRA), and caffeic acid (CA)) were effectively stabilized in the gastrointestinal fluids of both children and adults in vitro. Young rats, characterized by thinner intestinal walls and higher permeability, efficiently absorbed the four organic acids across the entire intestinal segment. The absorption of CGA, GA, and CRA followed a concentration-dependent pattern, with CGA and GA absorption being influenced by exocytosis. CONCLUSION The efficacy of the PDL-OAC in treating acute pharyngitis was demonstrated in young rats. The absorption rate of these components was observed to be faster in young rats compared to adult rats, underscoring the need for dedicated studies on the drug's usage in children. This research provides valuable insights for the appropriate clinical use of PDL in pediatric patients.
Collapse
Affiliation(s)
- Yanjun Yang
- School of Traditional Chinese Pharmacy, Innovation Center for Industry-Education Integration of Pediatrics and Traditional Chinese Medicine, State Key Laboratory of Natural Medicines, China Pharmaceutical University, Nanjing, 211198, PR China.
| | - Zhouyang Qian
- School of Traditional Chinese Pharmacy, Innovation Center for Industry-Education Integration of Pediatrics and Traditional Chinese Medicine, State Key Laboratory of Natural Medicines, China Pharmaceutical University, Nanjing, 211198, PR China.
| | - Chenhui Wu
- School of Traditional Chinese Pharmacy, Innovation Center for Industry-Education Integration of Pediatrics and Traditional Chinese Medicine, State Key Laboratory of Natural Medicines, China Pharmaceutical University, Nanjing, 211198, PR China.
| | - Yue Cheng
- School of Traditional Chinese Pharmacy, Innovation Center for Industry-Education Integration of Pediatrics and Traditional Chinese Medicine, State Key Laboratory of Natural Medicines, China Pharmaceutical University, Nanjing, 211198, PR China.
| | - Bing Yang
- School of Traditional Chinese Pharmacy, Innovation Center for Industry-Education Integration of Pediatrics and Traditional Chinese Medicine, State Key Laboratory of Natural Medicines, China Pharmaceutical University, Nanjing, 211198, PR China.
| | - Jianguo Shao
- Jiangsu Key Laboratory of Chinese Medicine and Characteristic Preparations for Paediatrics, Jumpcan Pharmaceutical Co., Ltd., Taixing, 225400, PR China.
| | - Jing Zhao
- Jiangsu Key Laboratory of Chinese Medicine and Characteristic Preparations for Paediatrics, Jumpcan Pharmaceutical Co., Ltd., Taixing, 225400, PR China.
| | - Xiangjun Zhu
- Jiangsu Health Development Research Center, National Health and Family Planning Commission Contraceptives Adverse Reaction Surveillance Center, Nanjing, 210036, PR China.
| | - Xiaobin Jia
- School of Traditional Chinese Pharmacy, Innovation Center for Industry-Education Integration of Pediatrics and Traditional Chinese Medicine, State Key Laboratory of Natural Medicines, China Pharmaceutical University, Nanjing, 211198, PR China.
| | - Liang Feng
- School of Traditional Chinese Pharmacy, Innovation Center for Industry-Education Integration of Pediatrics and Traditional Chinese Medicine, State Key Laboratory of Natural Medicines, China Pharmaceutical University, Nanjing, 211198, PR China.
| |
Collapse
|
2
|
Jeng PH, Yang CY, Huang TR, Kuo CF, Liu SC. Harnessing AI for precision tonsillitis diagnosis: a revolutionary approach in endoscopic analysis. Eur Arch Otorhinolaryngol 2024:10.1007/s00405-024-08938-w. [PMID: 39230610 DOI: 10.1007/s00405-024-08938-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2024] [Accepted: 08/19/2024] [Indexed: 09/05/2024]
Abstract
BACKGROUND Diagnosing and treating tonsillitis pose no significant challenge for otolaryngologists; however, it can increase the infection risk for healthcare professionals amidst the coronavirus pandemic. In recent years, with the advancement of artificial intelligence (AI), its application in medical imaging has also thrived. This research is to identify the optimal convolutional neural network (CNN) algorithm for accurate diagnosis of tonsillitis and early precision treatment. METHODS Semi-supervised learning with pseudo-labels used for self-training was adopted to train our CNN, with the algorithm including UNet, PSPNet, and FPN. A total of 485 pharyngoscopic images from 485 participants were included, comprising healthy individuals (133 cases), patients with the common cold (295 cases), and patients with tonsillitis (57 cases). Both color and texture features from 485 images are extracted for analysis. RESULTS UNet outperformed PSPNet and FPN in accurately segmenting oropharyngeal anatomy automatically, with average Dice coefficient of 97.74% and a pixel accuracy of 98.12%, making it suitable for enhancing the diagnosis of tonsillitis. The normal tonsils generally have more uniform and smooth textures and have pinkish color, similar to the surrounding mucosal tissues, while tonsillitis, particularly the antibiotic-required type, shows white or yellowish pus-filled spots or patches, and shows more granular or lumpy texture in contrast, indicating inflammation and changes in tissue structure. After training with 485 cases, our algorithm with UNet achieved accuracy rates of 93.75%, 97.1%, and 91.67% in differentiating the three tonsil groups, demonstrating excellent results. CONCLUSION Our research highlights the potential of using UNet for fully automated semantic segmentation of oropharyngeal structures, which aids in subsequent feature extraction, machine learning, and enables accurate AI diagnosis of tonsillitis. This innovation shows promise for enhancing both the accuracy and speed of tonsillitis assessments.
Collapse
Affiliation(s)
- Po-Hsuan Jeng
- Department of Otolaryngology-Head and Neck Surgery Tri-Service General Hospital, National Defense Medical Center, No. 325, Sec. 2, Cheng-Gong Road, Neihu District, Taipei, Taiwan 114, Republic of China
- Graduate Institute of Medical Science, National Defense Medical Center, Taipei, Taiwan
| | - Chien-Yi Yang
- Division of General Surgery, Department of Surgery Tri-Service General Hospital Songshan Branch, National Defense Medical Center, Taipei, Taiwan, Republic of China
| | - Tien-Ru Huang
- Department of Otolaryngology-Head and Neck Surgery Tri-Service General Hospital, National Defense Medical Center, No. 325, Sec. 2, Cheng-Gong Road, Neihu District, Taipei, Taiwan 114, Republic of China
| | - Chung-Feng Kuo
- Department of Material Science & Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan, Republic of China
| | - Shao-Cheng Liu
- Department of Otolaryngology-Head and Neck Surgery Tri-Service General Hospital, National Defense Medical Center, No. 325, Sec. 2, Cheng-Gong Road, Neihu District, Taipei, Taiwan 114, Republic of China.
| |
Collapse
|
3
|
Chng SY, Tern PJW, Kan MRX, Cheng LTE. Deep Learning Model and its Application for the Diagnosis of Exudative Pharyngitis. Healthc Inform Res 2024; 30:42-48. [PMID: 38359848 PMCID: PMC10879828 DOI: 10.4258/hir.2024.30.1.42] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Revised: 12/16/2023] [Accepted: 01/15/2024] [Indexed: 02/17/2024] Open
Abstract
OBJECTIVES Telemedicine is firmly established in the healthcare landscape of many countries. Acute respiratory infections are the most common reason for telemedicine consultations. A throat examination is important for diagnosing bacterial pharyngitis, but this is challenging for doctors during a telemedicine consultation. A solution could be for patients to upload images of their throat to a web application. This study aimed to develop a deep learning model for the automated diagnosis of exudative pharyngitis. Thereafter, the model will be deployed online. METHODS We used 343 throat images (139 with exudative pharyngitis and 204 without pharyngitis) in the study. ImageDataGenerator was used to augment the training data. The convolutional neural network models of MobileNetV3, ResNet50, and EfficientNetB0 were implemented to train the dataset, with hyperparameter tuning. RESULTS All three models were trained successfully; with successive epochs, the loss and training loss decreased, and accuracy and training accuracy increased. The EfficientNetB0 model achieved the highest accuracy (95.5%), compared to MobileNetV3 (82.1%) and ResNet50 (88.1%). The EfficientNetB0 model also achieved high precision (1.00), recall (0.89) and F1-score (0.94). CONCLUSIONS We trained a deep learning model based on EfficientNetB0 that can diagnose exudative pharyngitis. Our model was able to achieve the highest accuracy, at 95.5%, out of all previous studies that used machine learning for the diagnosis of exudative pharyngitis. We have deployed the model on a web application that can be used to augment the doctor's diagnosis of exudative pharyngitis.
Collapse
Affiliation(s)
- Seo Yi Chng
- Department of Paediatrics, National University of Singapore,
Singapore
| | | | | | | |
Collapse
|
4
|
Guntinas-Lichius O, Geißler K, Mäkitie AA, Ronen O, Bradley PJ, Rinaldo A, Takes RP, Ferlito A. Treatment of recurrent acute tonsillitis-a systematic review and clinical practice recommendations. Front Surg 2023; 10:1221932. [PMID: 37881239 PMCID: PMC10597714 DOI: 10.3389/fsurg.2023.1221932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2023] [Accepted: 09/11/2023] [Indexed: 10/27/2023] Open
Abstract
Background There is an ongoing debate on the indications for tonsil surgery in both children and adults with recurrent acute tonsillitis. The aim is to provide practical recommendations for diagnostics and treatment for recurrent acute tonsillitis including evidence-based decision making for tonsillectomy. Methods A systematic literature search in PubMed, Embase, Web of Science, and ScienceDirect from 2014 until April 2023 resulted in 68 articles. These were the basis for the review and a comprehensive series of consensus statements on the most important diagnostics and indications for both non-surgical and surgical therapy. A consensus paper was circulated among the authors and members of the International Head and Neck Scientific Group until a final agreement was reached for all recommendations. Results The differentiation between sore throat and tonsillitis patient episodes is mostly not feasible and hence is not relevant for diagnostic decision making. Diagnostics of a tonsillitis/sore throat episode should always include a classification with a scoring system (Centor, McIssac, FeverPAIN score) to estimate the probability of a bacterial tonsillitis, mainly due to group A streptococcus (GAS). In ambiguous cases, a point-of-care test GAS swab test is helpful. Consecutive counting of the tonsillitis/sore throat episodes is important. In addition, a specific quality of life score (Tonsillectomy Outcome Inventory 14 or Tonsil and Adenoid Health Status Instrument) should be used for each episode. Conservative treatment includes a combination of paracetamol and/or non-steroidal anti-inflammatory drugs. In case of high probability of bacterial tonsillitis, and only in such cases, especially in patients at risk, standard antibiotic treatment is initiated directly or by delayed prescription. Tonsillectomy is indicated and is highly effective if the patient has had ≥7 adequately treated episodes in the preceding year, ≥5 such episodes in each of the preceding 2 years, or ≥3 such episodes in each of the preceding 3 years. An essential part of surgery is standardized pain management because severe postoperative pain can be expected in most patients. Conclusion It is necessary to follow a stringent treatment algorithm for an optimal and evidence-based treatment for patients with recurrent acute tonsillitis. This will help decrease worldwide treatment variability, antibiotic overuse, and avoid ineffective tonsillectomy.
Collapse
Affiliation(s)
| | - Katharina Geißler
- Department of Otorhinolaryngology, Jena University Hospital, Jena, Germany
| | - Antti A. Mäkitie
- Department of Otorhinolaryngology-Head and Neck Surgery, Research Program in Systems Oncology, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| | - Ohad Ronen
- Department of Otolaryngology, Head and Neck Surgery, Galilee Medical Center, Affiliated with Azrieli Faculty of Medicine, Bar-Ilan University, Safed, Israel
| | - Patrick J. Bradley
- Department Otorhinolaryngology, Head and Neck Surgery, Nottingham University Hospitals, Queens Medical Centre Campus, Nottingham, United Kingdom
| | | | - Robert P. Takes
- Department of Otolaryngology, Head and Neck Surgery, Radboud University Medical Center, Nijmegen, Netherlands
| | - Alfio Ferlito
- International Head and Neck Scientific Group, Padua, Italy
| |
Collapse
|
5
|
Romaszko-Wojtowicz A, Jaśkiewicz Ł, Jurczak P, Doboszyńska A. Telemedicine in Primary Practice in the Age of the COVID-19 Pandemic-Review. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:1541. [PMID: 37763659 PMCID: PMC10532942 DOI: 10.3390/medicina59091541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Revised: 08/18/2023] [Accepted: 08/22/2023] [Indexed: 09/29/2023]
Abstract
Background and Objectives: In the era of the COVID-19 pandemic, telemedicine, so far underestimated, has gained in value. Currently, telemedicine is not only a telephone or chat consultation, but also the possibility of the remote recording of signals (such as ECG, saturation, and heart rate) or even remote auscultation of the lungs. The objective of this review article is to present a potential role for, and disseminate knowledge of, telemedicine during the COVID-19 pandemic. Material and Methods: In order to analyze the research material in accordance with PRISMA guidelines, a systematic search of the ScienceDirect, Web of Science, and PubMed databases was conducted. Out of the total number of 363 papers identified, 22 original articles were subjected to analysis. Results: This article presents the possibilities of remote patient registration, which contributes to an improvement in remote diagnostics and diagnoses. Conclusions: Telemedicine is, although not always and not by everyone, an accepted form of providing medical services. It cannot replace direct patient-doctor contact, but it can undoubtedly contribute to accelerating diagnoses and improving their quality at a distance.
Collapse
Affiliation(s)
- Anna Romaszko-Wojtowicz
- Department of Pulmonology, School of Public Health, Collegium Medicum, University of Warmia and Mazury in Olsztyn, 10-719 Olsztyn, Poland;
| | - Łukasz Jaśkiewicz
- Department of Human Physiology and Pathophysiology, School of Medicine, Collegium Medicum, University of Warmia and Mazury in Olsztyn, 10-082 Olsztyn, Poland;
| | - Paweł Jurczak
- Student Scientific Club of Cardiopulmonology and Rare Diseases of the Respiratory System, School of Medicine, Collegium Medicum, University of Warmia and Mazury in Olsztyn, 10-082 Olsztyn, Poland;
| | - Anna Doboszyńska
- Department of Pulmonology, School of Public Health, Collegium Medicum, University of Warmia and Mazury in Olsztyn, 10-719 Olsztyn, Poland;
| |
Collapse
|
6
|
Kim GH, Hwang YJ, Lee H, Sung ES, Nam KW. Convolutional neural network-based vocal cord tumor classification technique for home-based self-prescreening purpose. Biomed Eng Online 2023; 22:81. [PMID: 37596652 PMCID: PMC10439563 DOI: 10.1186/s12938-023-01139-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Accepted: 07/20/2023] [Indexed: 08/20/2023] Open
Abstract
BACKGROUND In this study, we proposed a deep learning technique that can simultaneously detect suspicious positions of benign vocal cord tumors in laparoscopic images and classify the types of tumors into cysts, granulomas, leukoplakia, nodules and polyps. This technique is useful for simplified home-based self-prescreening purposes to detect the generation of tumors around the vocal cord early in the benign stage. RESULTS We implemented four convolutional neural network (CNN) models (two Mask R-CNNs, Yolo V4, and a single-shot detector) that were trained, validated and tested using 2183 laryngoscopic images. The experimental results demonstrated that among the four applied models, Yolo V4 showed the highest F1-score for all tumor types (0.7664, cyst; 0.9875, granuloma; 0.8214, leukoplakia; 0.8119, nodule; and 0.8271, polyp). The model with the lowest false-negative rate was different for each tumor type (Yolo V4 for cysts/granulomas and Mask R-CNN for leukoplakia/nodules/polyps). In addition, the embedded-operated Yolo V4 model showed an approximately equivalent F1-score (0.8529) to that of the computer-operated Yolo-4 model (0.8683). CONCLUSIONS Based on these results, we conclude that the proposed deep-learning-based home screening techniques have the potential to aid in the early detection of tumors around the vocal cord and can improve the long-term survival of patients with vocal cord tumors.
Collapse
Affiliation(s)
- Gun Ho Kim
- Medical Research Institute, Pusan National University, Yangsan, Korea
- Department of Biomedical Engineering, Pusan National University Yangsan Hospital, Yangsan, Korea
| | - Young Jun Hwang
- Department of Biomedical Engineering, School of Medicine, Pusan National University, 49, Busandaehak-Ro, Mulgeum-Eup, Yangsan, 50629, Korea
| | - Hongje Lee
- Department of Nuclear Medicine, Dongnam Institute of Radiological & Medical Sciences, Busan, Korea
| | - Eui-Suk Sung
- Department of Otolaryngology-Head and Neck Surgery, Pusan National University Yangsan Hospital, Yangsan, Korea.
- Department of Otolaryngology-Head and Neck Surgery, School of Medicine, Pusan National University, Yangsan, Korea.
- Research Institute for Convergence of Biomedical Science and Technology, Pusan National University Yangsan Hospital, Yangsan, Korea.
| | - Kyoung Won Nam
- Department of Biomedical Engineering, Pusan National University Yangsan Hospital, Yangsan, Korea.
- Department of Biomedical Engineering, School of Medicine, Pusan National University, 49, Busandaehak-Ro, Mulgeum-Eup, Yangsan, 50629, Korea.
- Research Institute for Convergence of Biomedical Science and Technology, Pusan National University Yangsan Hospital, Yangsan, Korea.
| |
Collapse
|
7
|
Bansal K, Bathla RK, Kumar Y. Deep transfer learning techniques with hybrid optimization in early prediction and diagnosis of different types of oral cancer. Soft comput 2022. [DOI: 10.1007/s00500-022-07246-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
8
|
Susanto AP, Winarto H, Fahira A, Abdurrohman H, Muharram AP, Widitha UR, Warman Efirianti GE, Eduard George YA, Tjoa K. Building an artificial intelligence-powered medical image recognition smartphone application: What medical practitioners need to know. INFORMATICS IN MEDICINE UNLOCKED 2022. [DOI: 10.1016/j.imu.2022.101017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022] Open
|
9
|
Han Z, Huang H, Fan Q, Li Y, Li Y, Chen X. SMD-YOLO: An efficient and lightweight detection method for mask wearing status during the COVID-19 pandemic. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 221:106888. [PMID: 35598435 PMCID: PMC9098810 DOI: 10.1016/j.cmpb.2022.106888] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2022] [Revised: 04/30/2022] [Accepted: 05/11/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND AND OBJECTIVE At present, the COVID-19 epidemic is still spreading worldwide and wearing a mask in public areas is an effective way to prevent the spread of the respiratory virus. Although there are many deep learning methods used for detecting the face masks, there are few lightweight detectors having a good effect on small or medium-size face masks detection in the complicated environments. METHODS In this work we propose an efficient and lightweight detection method based on YOLOv4-tiny, and a face mask detection and monitoring system for mask wearing status. Two feasible improvement strategies, network structure optimization and K-means++ clustering algorithm, are utilized for improving the detection accuracy on the premise of ensuring the real-time face masks recognition. Particularly, the improved residual module and cross fusion module are designed to aim at extracting the features of small or medium-size targets effectively. Moreover, the enhanced dual attention mechanism and the improved spatial pyramid pooling module are employed for merging sufficiently the deep and shallow semantic information and expanding the receptive field. Afterwards, the detection accuracy is compensated through the combination of activation functions. Finally, the depthwise separable convolution module is used to reduce the quantity of parameters and improve the detection efficiency. Our proposed detector is evaluated on a public face mask dataset, and an ablation experiment is also provided to verify the effectiveness of our proposed model, which is compared with the state-of-the-art (SOTA) models as well. RESULTS Our proposed detector increases the AP (average precision) values in each category of the public face mask dataset compared with the original YOLOv4-tiny. The mAP (mean average precision) is improved by 4.56% and the speed reaches 92.81 FPS. Meanwhile, the quantity of parameters and the FLOPs (floating-point operations) are reduced by 1/3, 16.48%, respectively. CONCLUSIONS The proposed detector achieves better overall detection performance compared with other SOTA detectors for real-time mask detection, demonstrated the superiority with both theoretical value and practical significance. The developed system also brings greater flexibility to the application of face mask detection in hospitals, campuses, communities, etc.
Collapse
Affiliation(s)
- Zhenggong Han
- Key Laboratory of Advanced Manufacturing Technology, Ministry of Education, Guizhou University, Guiyang 550025, Guizhou, China
| | - Haisong Huang
- Key Laboratory of Advanced Manufacturing Technology, Ministry of Education, Guizhou University, Guiyang 550025, Guizhou, China; Chongqing Vocational and Technical University of Mechatronics, Chongqing 400036, China
| | - Qingsong Fan
- Key Laboratory of Advanced Manufacturing Technology, Ministry of Education, Guizhou University, Guiyang 550025, Guizhou, China
| | - Yiting Li
- College of Big Data Statistics, GuiZhou University of Finance and Economics, Guiyang 550025, Guizhou, China
| | - Yuqin Li
- Stomotological Hospital of Guizhou Medical University, Guiyang 550004, Guizhou, China
| | - Xingran Chen
- Key Laboratory of Advanced Manufacturing Technology, Ministry of Education, Guizhou University, Guiyang 550025, Guizhou, China
| |
Collapse
|
10
|
You A, Kim JK, Ryu IH, Yoo TK. Application of generative adversarial networks (GAN) for ophthalmology image domains: a survey. EYE AND VISION (LONDON, ENGLAND) 2022; 9:6. [PMID: 35109930 PMCID: PMC8808986 DOI: 10.1186/s40662-022-00277-3] [Citation(s) in RCA: 51] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 01/11/2022] [Indexed: 12/12/2022]
Abstract
BACKGROUND Recent advances in deep learning techniques have led to improved diagnostic abilities in ophthalmology. A generative adversarial network (GAN), which consists of two competing types of deep neural networks, including a generator and a discriminator, has demonstrated remarkable performance in image synthesis and image-to-image translation. The adoption of GAN for medical imaging is increasing for image generation and translation, but it is not familiar to researchers in the field of ophthalmology. In this work, we present a literature review on the application of GAN in ophthalmology image domains to discuss important contributions and to identify potential future research directions. METHODS We performed a survey on studies using GAN published before June 2021 only, and we introduced various applications of GAN in ophthalmology image domains. The search identified 48 peer-reviewed papers in the final review. The type of GAN used in the analysis, task, imaging domain, and the outcome were collected to verify the usefulness of the GAN. RESULTS In ophthalmology image domains, GAN can perform segmentation, data augmentation, denoising, domain transfer, super-resolution, post-intervention prediction, and feature extraction. GAN techniques have established an extension of datasets and modalities in ophthalmology. GAN has several limitations, such as mode collapse, spatial deformities, unintended changes, and the generation of high-frequency noises and artifacts of checkerboard patterns. CONCLUSIONS The use of GAN has benefited the various tasks in ophthalmology image domains. Based on our observations, the adoption of GAN in ophthalmology is still in a very early stage of clinical validation compared with deep learning classification techniques because several problems need to be overcome for practical use. However, the proper selection of the GAN technique and statistical modeling of ocular imaging will greatly improve the performance of each image analysis. Finally, this survey would enable researchers to access the appropriate GAN technique to maximize the potential of ophthalmology datasets for deep learning research.
Collapse
Affiliation(s)
- Aram You
- School of Architecture, Kumoh National Institute of Technology, Gumi, Gyeongbuk, South Korea
| | - Jin Kuk Kim
- B&VIIT Eye Center, Seoul, South Korea
- VISUWORKS, Seoul, South Korea
| | - Ik Hee Ryu
- B&VIIT Eye Center, Seoul, South Korea
- VISUWORKS, Seoul, South Korea
| | - Tae Keun Yoo
- B&VIIT Eye Center, Seoul, South Korea.
- Department of Ophthalmology, Aerospace Medical Center, Republic of Korea Air Force, 635 Danjae-ro, Namil-myeon, Cheongwon-gun, Cheongju, Chungcheongbuk-do, 363-849, South Korea.
| |
Collapse
|
11
|
Yoo TK, Choi JY, Kim HK, Ryu IH, Kim JK. Adopting low-shot deep learning for the detection of conjunctival melanoma using ocular surface images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 205:106086. [PMID: 33862570 DOI: 10.1016/j.cmpb.2021.106086] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Accepted: 03/30/2021] [Indexed: 05/05/2023]
Abstract
BACKGROUND AND OBJECTIVE The purpose of the present study was to investigate low-shot deep learning models applied to conjunctival melanoma detection using a small dataset with ocular surface images. METHODS A dataset was composed of anonymized images of four classes; conjunctival melanoma (136), nevus or melanosis (93), pterygium (75), and normal conjunctiva (94). Before training involving conventional deep learning models, two generative adversarial networks (GANs) were constructed to augment the training dataset for low-shot learning. The collected data were randomly divided into training (70%), validation (10%), and test (20%) datasets. Moreover, 3D melanoma phantoms were designed to build an external validation set using a smartphone. The GoogleNet, InceptionV3, NASNet, ResNet50, and MobileNetV2 architectures were trained through transfer learning and validated using the test and external validation datasets. RESULTS The deep learning model demonstrated a significant improvement in the classification accuracy of conjunctival lesions using synthetic images generated by the GAN models. MobileNetV2 with GAN-based augmentation displayed the highest accuracy of 87.5% in the four-class classification and 97.2% in the binary classification for the detection of conjunctival melanoma. It showed an accuracy of 94.0% using 3D melanoma phantom images captured using a smartphone camera. CONCLUSIONS The present study described a low-shot deep learning model that can detect conjunctival melanomas using ocular surface images. To the best of our knowledge, this study is the first to develop a deep learning model to detect conjunctival melanoma using a digital imaging device such as smartphone camera.
Collapse
Affiliation(s)
- Tae Keun Yoo
- Department of Ophthalmology, Aerospace Medical Center, Republic of Korea Air Force, Cheongju, Republic of Korea.
| | - Joon Yul Choi
- Epilepsy Center, Neurological Institute, Cleveland Clinic, Cleveland, OH, USA.
| | - Hong Kyu Kim
- Department of Ophthalmology, Dankook University Hospital, Dankook University College of Medicine, Cheonan, South Korea
| | - Ik Hee Ryu
- B&VIIT Eye Center, Seoul, South Korea; VISUWORKS, Seoul, South Korea
| | - Jin Kuk Kim
- B&VIIT Eye Center, Seoul, South Korea; VISUWORKS, Seoul, South Korea
| |
Collapse
|
12
|
Yoo TK, Choi JY, Kim HK. Feasibility study to improve deep learning in OCT diagnosis of rare retinal diseases with few-shot classification. Med Biol Eng Comput 2021; 59:401-415. [PMID: 33492598 PMCID: PMC7829497 DOI: 10.1007/s11517-021-02321-1] [Citation(s) in RCA: 39] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Accepted: 01/15/2021] [Indexed: 01/16/2023]
Abstract
Deep learning (DL) has been successfully applied to the diagnosis of ophthalmic diseases. However, rare diseases are commonly neglected due to insufficient data. Here, we demonstrate that few-shot learning (FSL) using a generative adversarial network (GAN) can improve the applicability of DL in the optical coherence tomography (OCT) diagnosis of rare diseases. Four major classes with a large number of datasets and five rare disease classes with a few-shot dataset are included in this study. Before training the classifier, we constructed GAN models to generate pathological OCT images of each rare disease from normal OCT images. The Inception-v3 architecture was trained using an augmented training dataset, and the final model was validated using an independent test dataset. The synthetic images helped in the extraction of the characteristic features of each rare disease. The proposed DL model demonstrated a significant improvement in the accuracy of the OCT diagnosis of rare retinal diseases and outperformed the traditional DL models, Siamese network, and prototypical network. By increasing the accuracy of diagnosing rare retinal diseases through FSL, clinicians can avoid neglecting rare diseases with DL assistance, thereby reducing diagnosis delay and patient burden.
Collapse
Affiliation(s)
- Tae Keun Yoo
- Department of Ophthalmology, Medical Research Center, Aerospace Medical Center, Republic of Korea Air Force, 635 Danjae-ro, Sangdang-gu, Cheongju, South Korea.
| | - Joon Yul Choi
- Epilepsy Center, Neurological Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Hong Kyu Kim
- Department of Ophthalmology, Dankook University Hospital, Dankook University College of Medicine, Cheonan, South Korea
| |
Collapse
|