1
|
Dubois C, Eigen D, Simon F, Couloigner V, Gormish M, Chalumeau M, Schmoll L, Cohen JF. Development and validation of a smartphone-based deep-learning-enabled system to detect middle-ear conditions in otoscopic images. NPJ Digit Med 2024; 7:162. [PMID: 38902477 PMCID: PMC11189910 DOI: 10.1038/s41746-024-01159-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 06/10/2024] [Indexed: 06/22/2024] Open
Abstract
Middle-ear conditions are common causes of primary care visits, hearing impairment, and inappropriate antibiotic use. Deep learning (DL) may assist clinicians in interpreting otoscopic images. This study included patients over 5 years old from an ambulatory ENT practice in Strasbourg, France, between 2013 and 2020. Digital otoscopic images were obtained using a smartphone-attached otoscope (Smart Scope, Karl Storz, Germany) and labeled by a senior ENT specialist across 11 diagnostic classes (reference standard). An Inception-v2 DL model was trained using 41,664 otoscopic images, and its diagnostic accuracy was evaluated by calculating class-specific estimates of sensitivity and specificity. The model was then incorporated into a smartphone app called i-Nside. The DL model was evaluated on a validation set of 3,962 images and a held-out test set comprising 326 images. On the validation set, all class-specific estimates of sensitivity and specificity exceeded 98%. On the test set, the DL model achieved a sensitivity of 99.0% (95% confidence interval: 94.5-100) and a specificity of 95.2% (91.5-97.6) for the binary classification of normal vs. abnormal images; wax plugs were detected with a sensitivity of 100% (94.6-100) and specificity of 97.7% (95.0-99.1); other class-specific estimates of sensitivity and specificity ranged from 33.3% to 92.3% and 96.0% to 100%, respectively. We present an end-to-end DL-enabled system able to achieve expert-level diagnostic accuracy for identifying normal tympanic aspects and wax plugs within digital otoscopic images. However, the system's performance varied for other middle-ear conditions. Further prospective validation is necessary before wider clinical deployment.
Collapse
Affiliation(s)
| | | | - François Simon
- Department of Pediatric Otolaryngology, Necker-Enfants malades Hospital, APHP, Université Paris Cité, Paris, France
| | - Vincent Couloigner
- Department of Pediatric Otolaryngology, Necker-Enfants malades Hospital, APHP, Université Paris Cité, Paris, France
| | | | - Martin Chalumeau
- Inserm UMR1153 (CRESS), Université Paris Cité, Paris, France
- Department of General Pediatrics and Pediatric Infectious Diseases, Necker-Enfants malades Hospital, APHP, Université Paris Cité, Paris, France
| | | | - Jérémie F Cohen
- Inserm UMR1153 (CRESS), Université Paris Cité, Paris, France.
- Department of General Pediatrics and Pediatric Infectious Diseases, Necker-Enfants malades Hospital, APHP, Université Paris Cité, Paris, France.
| |
Collapse
|
2
|
Fang TY, Lin TY, Shen CM, Hsu SY, Lin SH, Kuo YJ, Chen MH, Yin TK, Liu CH, Lo MT, Wang PC. Algorithm-Driven Tele-otoscope for Remote Care for Patients With Otitis Media. Otolaryngol Head Neck Surg 2024; 170:1590-1597. [PMID: 38545686 DOI: 10.1002/ohn.738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 02/05/2024] [Accepted: 02/29/2024] [Indexed: 05/31/2024]
Abstract
OBJECTIVE The COVID-19 pandemic has spurred a growing demand for telemedicine. Artificial intelligence and image processing systems with wireless transmission functionalities can facilitate remote care for otitis media (OM). Accordingly, this study developed and validated an algorithm-driven tele-otoscope system equipped with Wi-Fi transmission and a cloud-based automatic OM diagnostic algorithm. STUDY DESIGN Prospective, cross-sectional, diagnostic study. SETTING Tertiary Academic Medical Center. METHODS We designed a tele-otoscope (Otiscan, SyncVision Technology Corp) equipped with digital imaging and processing modules, Wi-Fi transmission capabilities, and an automatic OM diagnostic algorithm. A total of 1137 otoscopic images, comprising 987 images of normal cases and 150 images of cases of acute OM and OM with effusion, were used as the dataset for image classification. Two convolutional neural network models, trained using our dataset, were used for raw image segmentation and OM classification. RESULTS The tele-otoscope delivered images with a resolution of 1280 × 720 pixels. Our tele-otoscope effectively differentiated OM from normal images, achieving a classification accuracy rate of up to 94% (sensitivity, 80%; specificity, 96%). CONCLUSION Our study demonstrated that the developed tele-otoscope has acceptable accuracy in diagnosing OM. This system can assist health care professionals in early detection and continuous remote monitoring, thus mitigating the consequences of OM.
Collapse
Affiliation(s)
- Te-Yung Fang
- Department of Otolaryngology, Cathay General Hospital, Taipei, Taiwan
- School of Medicine, Fu-Jen Catholic University, New Taipei City, Taiwan
- Department of Otolaryngology, Sijhih Cathay General Hospital, New Taipei City, Taiwan
| | - Tse-Yu Lin
- Department of Biomedical Sciences and Engineering, National Central University, Taoyuan, Taiwan
| | - Chung-Min Shen
- School of Medicine, Fu-Jen Catholic University, New Taipei City, Taiwan
- Department of Pediatric, Cathay General Hospital, Taipei, Taiwan
| | - Su-Yi Hsu
- Department of Otolaryngology, Cathay General Hospital, Taipei, Taiwan
- School of Medicine, Fu-Jen Catholic University, New Taipei City, Taiwan
| | - Shing-Huey Lin
- School of Medicine, Fu-Jen Catholic University, New Taipei City, Taiwan
- Department of Family and Community Medicine, Cathay General Hospital, Taipei, Taiwan
| | - Yu-Jung Kuo
- Department of Biomedical Sciences and Engineering, National Central University, Taoyuan, Taiwan
| | - Ming-Hsu Chen
- Department of Otolaryngology, Cathay General Hospital, Taipei, Taiwan
| | - Tan-Kuei Yin
- Department of Otolaryngology, Cathay General Hospital, Taipei, Taiwan
| | - Chih-Hsien Liu
- Department of Otolaryngology, Cathay General Hospital, Taipei, Taiwan
| | - Men-Tzung Lo
- Department of Biomedical Sciences and Engineering, National Central University, Taoyuan, Taiwan
| | - Pa-Chun Wang
- Department of Otolaryngology, Cathay General Hospital, Taipei, Taiwan
- School of Medicine, Fu-Jen Catholic University, New Taipei City, Taiwan
- Department of Biomedical Sciences and Engineering, National Central University, Taoyuan, Taiwan
- Department of Medical Research, China Medical University Hospital, China Medical University, Taichung, Taiwan
| |
Collapse
|
3
|
Tai J, Han M, Choi BY, Kang SH, Kim H, Kwak J, Lee D, Lee TH, Cho Y, Kim TH. Deep learning model for differentiating nasal cavity masses based on nasal endoscopy images. BMC Med Inform Decis Mak 2024; 24:145. [PMID: 38811961 PMCID: PMC11138030 DOI: 10.1186/s12911-024-02517-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Accepted: 04/17/2024] [Indexed: 05/31/2024] Open
Abstract
BACKGROUND Nasal polyps and inverted papillomas often look similar. Clinically, it is difficult to distinguish the masses by endoscopic examination. Therefore, in this study, we aimed to develop a deep learning algorithm for computer-aided diagnosis of nasal endoscopic images, which may provide a more accurate clinical diagnosis before pathologic confirmation of the nasal masses. METHODS By performing deep learning of nasal endoscope images, we evaluated our computer-aided diagnosis system's assessment ability for nasal polyps and inverted papilloma and the feasibility of their clinical application. We used curriculum learning pre-trained with patches of nasal endoscopic images and full-sized images. The proposed model's performance for classifying nasal polyps, inverted papilloma, and normal tissue was analyzed using five-fold cross-validation. RESULTS The normal scores for our best-performing network were 0.9520 for recall, 0.7900 for precision, 0.8648 for F1-score, 0.97 for the area under the curve, and 0.8273 for accuracy. For nasal polyps, the best performance was 0.8162, 0.8496, 0.8409, 0.89, and 0.8273, respectively, for recall, precision, F1-score, area under the curve, and accuracy. Finally, for inverted papilloma, the best performance was obtained for recall, precision, F1-score, area under the curve, and accuracy values of 0.5172, 0.8125, 0.6122, 0.83, and 0.8273, respectively. CONCLUSION Although there were some misclassifications, the results of gradient-weighted class activation mapping were generally consistent with the areas under the curve determined by otolaryngologists. These results suggest that the convolutional neural network is highly reliable in resolving lesion locations in nasal endoscopic images.
Collapse
Affiliation(s)
- Junhu Tai
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea
| | - Munsoo Han
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea
- Mucosal Immunology Institute, College of Medicine, Korea University, Seoul, Republic of Korea
| | - Bo Yoon Choi
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea
| | - Sung Hoon Kang
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea
| | - Hyeongeun Kim
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea
| | - Jiwon Kwak
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea
| | - Dabin Lee
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea
| | - Tae Hoon Lee
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea
| | - Yongwon Cho
- Department of Radiology and AI center, College of Medicine, Korea University, Seoul, Republic of Korea.
- Department of Computer Science and Engineering, Soonchunhyang University, Cheonan-Asan, Republic of Korea.
| | - Tae Hoon Kim
- Department of Otorhinolaryngology-Head & Neck Surgery, College of Medicine, Korea University, Seoul, Republic of Korea.
- Mucosal Immunology Institute, College of Medicine, Korea University, Seoul, Republic of Korea.
| |
Collapse
|
4
|
Shaikh N, Conway SJ, Kovačević J, Condessa F, Shope TR, Haralam MA, Campese C, Lee MC, Larsson T, Cavdar Z, Hoberman A. Development and Validation of an Automated Classifier to Diagnose Acute Otitis Media in Children. JAMA Pediatr 2024; 178:401-407. [PMID: 38436941 PMCID: PMC10985552 DOI: 10.1001/jamapediatrics.2024.0011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Accepted: 11/17/2023] [Indexed: 03/05/2024]
Abstract
Importance Acute otitis media (AOM) is a frequently diagnosed illness in children, yet the accuracy of diagnosis has been consistently low. Multiple neural networks have been developed to recognize the presence of AOM with limited clinical application. Objective To develop and internally validate an artificial intelligence decision-support tool to interpret videos of the tympanic membrane and enhance accuracy in the diagnosis of AOM. Design, Setting, and Participants This diagnostic study analyzed otoscopic videos of the tympanic membrane captured using a smartphone during outpatient clinic visits at 2 sites in Pennsylvania between 2018 and 2023. Eligible participants included children who presented for sick visits or wellness visits. Exposure Otoscopic examination. Main Outcomes and Measures Using the otoscopic videos that were annotated by validated otoscopists, a deep residual-recurrent neural network was trained to predict both features of the tympanic membrane and the diagnosis of AOM vs no AOM. The accuracy of this network was compared with a second network trained using a decision tree approach. A noise quality filter was also trained to prompt users that the video segment acquired may not be adequate for diagnostic purposes. Results Using 1151 videos from 635 children (majority younger than 3 years of age), the deep residual-recurrent neural network had almost identical diagnostic accuracy as the decision tree network. The finalized deep residual-recurrent neural network algorithm classified tympanic membrane videos into AOM vs no AOM categories with a sensitivity of 93.8% (95% CI, 92.6%-95.0%) and specificity of 93.5% (95% CI, 92.8%-94.3%) and the decision tree model had a sensitivity of 93.7% (95% CI, 92.4%-94.9%) and specificity of 93.3% (92.5%-94.1%). Of the tympanic membrane features outputted, bulging of the TM most closely aligned with the predicted diagnosis; bulging was present in 230 of 230 cases (100%) in which the diagnosis was predicted to be AOM in the test set. Conclusions and Relevance These findings suggest that given its high accuracy, the algorithm and medical-grade application that facilitates image acquisition and quality filtering could reasonably be used in primary care or acute care settings to aid with automated diagnosis of AOM and decisions regarding treatment.
Collapse
Affiliation(s)
- Nader Shaikh
- Department of Pediatrics, Division of General Academic Pediatrics, University of Pittsburgh School of Medicine, University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh, Pennsylvania
| | - Shannon J. Conway
- Department of Pediatrics, Division of General Academic Pediatrics, University of Pittsburgh School of Medicine, University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh, Pennsylvania
| | - Jelena Kovačević
- Tandon School of Engineering, New York University, New York, New York
| | - Filipe Condessa
- Bosch Center for Artificial Intelligence, Pittsburgh, Pennsylvania
| | - Timothy R. Shope
- Department of Pediatrics, Division of General Academic Pediatrics, University of Pittsburgh School of Medicine, University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh, Pennsylvania
| | - Mary Ann Haralam
- Department of Pediatrics, Division of General Academic Pediatrics, University of Pittsburgh School of Medicine, University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh, Pennsylvania
| | - Catherine Campese
- Department of Pediatrics, Division of General Academic Pediatrics, University of Pittsburgh School of Medicine, University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh, Pennsylvania
| | - Matthew C. Lee
- Department of Pediatrics, Division of General Academic Pediatrics, University of Pittsburgh School of Medicine, University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh, Pennsylvania
| | | | | | - Alejandro Hoberman
- Department of Pediatrics, Division of General Academic Pediatrics, University of Pittsburgh School of Medicine, University of Pittsburgh Medical Center Children’s Hospital of Pittsburgh, Pennsylvania
| |
Collapse
|
5
|
Shim JH, Sunwoo W, Choi BY, Kim KG, Kim YJ. Improving the Accuracy of Otitis Media with Effusion Diagnosis in Pediatric Patients Using Deep Learning. Bioengineering (Basel) 2023; 10:1337. [PMID: 38002461 PMCID: PMC10669592 DOI: 10.3390/bioengineering10111337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/09/2023] [Accepted: 11/13/2023] [Indexed: 11/26/2023] Open
Abstract
Otitis media with effusion (OME), primarily seen in children aged 2 years and younger, is characterized by the presence of fluid in the middle ear, often resulting in hearing loss and aural fullness. While deep learning networks have been explored to aid OME diagnosis, prior work did not often specify if pediatric images were used for training, causing uncertainties about their clinical relevance, especially due to important distinctions between the tympanic membranes of small children and adults. We trained cross-validated ResNet50, DenseNet201, InceptionV3, and InceptionResNetV2 models on 1150 pediatric tympanic membrane images from otoendoscopes to classify OME. When assessed using a separate dataset of 100 pediatric tympanic membrane images, the models achieved mean accuracies of 92.9% (ResNet50), 97.2% (DenseNet201), 96.0% (InceptionV3), and 94.8% (InceptionResNetV2), compared to the seven otolaryngologists that achieved accuracies between 84.0% and 69.0%. The results showed that even the worst-performing model trained on fold 3 of InceptionResNetV2 with an accuracy of 88.0% exceeded the accuracy of the highest-performing otolaryngologist at 84.0%. Our findings suggest that these specifically trained deep learning models can potentially enhance the clinical diagnosis of OME using pediatric otoendoscopic tympanic membrane images.
Collapse
Affiliation(s)
- Jae-Hyuk Shim
- Department of Biomedical Engineering, Gil Medical Center, Gachon University College of Medicine, Incheon 21565, Republic of Korea
| | - Woongsang Sunwoo
- Department of Otorhinolaryngology-Head and Neck Surgery, Gil Medical Center, Gachon University College of Medicine, Incheon 21565, Republic of Korea
| | - Byung Yoon Choi
- Department of Otorhinolaryngology-Head and Neck Surgery, Seoul National University Bundang Hospital, Seongnam 13620, Republic of Korea
| | - Kwang Gi Kim
- Department of Biomedical Engineering, Gil Medical Center, Gachon University College of Medicine, Incheon 21565, Republic of Korea
| | - Young Jae Kim
- Department of Biomedical Engineering, Gil Medical Center, Gachon University College of Medicine, Incheon 21565, Republic of Korea
| |
Collapse
|
6
|
Tamir SO, Bialasiewicz S, Brennan-Jones CG, Der C, Kariv L, Macharia I, Marsh RL, Seguya A, Thornton R. ISOM 2023 research Panel 4 - Diagnostics and microbiology of otitis media. Int J Pediatr Otorhinolaryngol 2023; 174:111741. [PMID: 37788516 DOI: 10.1016/j.ijporl.2023.111741] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Revised: 09/17/2023] [Accepted: 09/19/2023] [Indexed: 10/05/2023]
Abstract
OBJECTIVES To identify and review key research advances from the literature published between 2019 and 2023 on the diagnosis and microbiology of otitis media (OM) including acute otitis media (AOM), recurrent AOM (rAOM), otitis media with effusion (OME), chronic suppurative otitis media (CSOM) and AOM complications (mastoiditis). DATA SOURCES PubMed database of the National Library of Medicine. REVIEW METHODS All relevant original articles published in Medline in English between July 2019 and February 2023 were identified. Studies that were reviews, case studies, relating to OM complications (other than mastoiditis), and studies focusing on guideline adherence, and consensus statements were excluded. Members of the panel drafted the report based on these search results. MAIN FINDINGS For the diagnosis section, 2294 unique records screened, 55 were eligible for inclusion. For the microbiology section 705 unique records were screened and 137 articles were eligible for inclusion. The main themes that arose in OM diagnosis were the need to incorporate multiple modalities including video-otoscopy, tympanometry, telemedicine and artificial intelligence for accurate diagnoses in all diagnostic settings. Further to this, was the use of new, cheap, readily available tools which may improve access in rural and lowmiddle income (LMIC) settings. For OM aetiology, PCR remains the most sensitive method for detecting middle ear pathogens with microbiome analysis still largely restricted to research use. The global pandemic response reduced rates of OM in children, but post-pandemic shifts should be monitored. IMPLICATION FOR PRACTICE AND FUTURE RESEARCH Cheap, easy to use multi-technique assessments combined with artificial intelligence and/or telemedicine should be integrated into future practice to improve diagnosis and treatment pathways in OM diagnosis. Longitudinal studies investigating the in-vivo process of OM development, timings and in-depth interactions between the triad of bacteria, viruses and the host immune response are still required. Standardized methods of collection and analysis for microbiome studies to enable inter-study comparisons are required. There is a need to target underlying biofilms if going to effectively prevent rAOM and OME and possibly enhance ventilation tube retention.
Collapse
Affiliation(s)
- Sharon Ovnat Tamir
- Department of Otolaryngology-Head and Neck Surgery, Sasmon Assuta Ashdod University Hospital, Faculty of Health Sciences, Ben Gurion University of the Negev, Israel.
| | - Seweryn Bialasiewicz
- Australian Centre for Ecogenomics, School of Chemistry and Molecular Biosciences, The University of Queensland, St Lucia, QLD, 4072, Australia
| | - Christopher G Brennan-Jones
- Wesfarmers Centre of Vaccines and Infectious Diseases, Telethon Kids Institute, The University of Western Australia, Perth, Western Australia, Australia; Faculty of Health Sciences, Curtin University, Perth, Western Australia, Australia
| | - Carolina Der
- Facultad de Medicina, Universidad Del Desarrollo, Dr Luis Calvo Mackenna Hospital, Santiago, Chile
| | - Liron Kariv
- Hearing, Speech and Language Institute, Sasmon Assuta Ashdod University Hospital, Israel
| | - Ian Macharia
- Kenyatta University Teaching, Referral & Research Hospital, Kenya
| | - Robyn L Marsh
- Menzies School of Health Research, Darwin, Australia; School of Health Sciences, University of Tasmania, Launceston, Australia
| | - Amina Seguya
- Department of Otolaryngology - Head and Neck Surgery, Mulago National Referral Hospital, Kampala, Uganda
| | - Ruth Thornton
- Wesfarmers Centre of Vaccines and Infectious Diseases, Telethon Kids Institute, The University of Western Australia, Perth, Western Australia, Australia; Centre for Child Health Research, University of Western Australia, Perth, Australia
| |
Collapse
|
7
|
Wu Q, Wang X, Liang G, Luo X, Zhou M, Deng H, Zhang Y, Huang X, Yang Q. Advances in Image-Based Artificial Intelligence in Otorhinolaryngology-Head and Neck Surgery: A Systematic Review. Otolaryngol Head Neck Surg 2023; 169:1132-1142. [PMID: 37288505 DOI: 10.1002/ohn.391] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 04/27/2023] [Accepted: 05/13/2023] [Indexed: 06/09/2023]
Abstract
OBJECTIVE To update the literature and provide a systematic review of image-based artificial intelligence (AI) applications in otolaryngology, highlight its advances, and propose future challenges. DATA SOURCES Web of Science, Embase, PubMed, and Cochrane Library. REVIEW METHODS Studies written in English, published between January 2020 and December 2022. Two independent authors screened the search results, extracted data, and assessed studies. RESULTS Overall, 686 studies were identified. After screening titles and abstracts, 325 full-text studies were assessed for eligibility, and 78 studies were included in this systematic review. The studies originated from 16 countries. Among these countries, the top 3 were China (n = 29), Korea (n = 8), the United States, and Japan (n = 7 each). The most common area was otology (n = 35), followed by rhinology (n = 20), pharyngology (n = 18), and head and neck surgery (n = 5). Most applications of AI in otology, rhinology, pharyngology, and head and neck surgery mainly included chronic otitis media (n = 9), nasal polyps (n = 4), laryngeal cancer (n = 12), and head and neck squamous cell carcinoma (n = 3), respectively. The overall performance of AI in accuracy, the area under the curve, sensitivity, and specificity were 88.39 ± 9.78%, 91.91 ± 6.70%, 86.93 ± 11.59%, and 88.62 ± 14.03%, respectively. CONCLUSION This state-of-the-art review aimed to highlight the increasing applications of image-based AI in otorhinolaryngology head and neck surgery. The following steps will entail multicentre collaboration to ensure data reliability, ongoing optimization of AI algorithms, and integration into real-world clinical practice. Future studies should consider 3-dimensional (3D)-based AI, such as 3D surgical AI.
Collapse
Affiliation(s)
- Qingwu Wu
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
- Department of Allergy, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xinyue Wang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Guixian Liang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xin Luo
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Min Zhou
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
- Department of Allergy, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Huiyi Deng
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yana Zhang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xuekun Huang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Qintai Yang
- Department of Otorhinolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
- Department of Allergy, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
8
|
Ding X, Huang Y, Tian X, Zhao Y, Feng G, Gao Z. Diagnosis, Treatment, and Management of Otitis Media with Artificial Intelligence. Diagnostics (Basel) 2023; 13:2309. [PMID: 37443702 DOI: 10.3390/diagnostics13132309] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 06/04/2023] [Accepted: 06/14/2023] [Indexed: 07/15/2023] Open
Abstract
A common infectious disease, otitis media (OM) has a low rate of early diagnosis, which significantly increases the difficulty of treating the disease and the likelihood of serious complications developing including hearing loss, speech impairment, and even intracranial infection. Several areas of healthcare have shown great promise in the application of artificial intelligence (AI) systems, such as the accurate detection of diseases, the automated interpretation of images, and the prediction of patient outcomes. Several articles have reported some machine learning (ML) algorithms such as ResNet, InceptionV3 and Unet, were applied to the diagnosis of OM successfully. The use of these techniques in the OM is still in its infancy, but their potential is enormous. We present in this review important concepts related to ML and AI, describe how these technologies are currently being applied to diagnosing, treating, and managing OM, and discuss the challenges associated with developing AI-assisted OM technologies in the future.
Collapse
Affiliation(s)
- Xin Ding
- Department of Otorhinolaryngology Head and Neck Surgery, The Peaking Union Medical College Hospital, No. 1, Shuaifuyuan, Dongcheng District, Beijing 100010, China
| | - Yu Huang
- Department of Otorhinolaryngology Head and Neck Surgery, The Peaking Union Medical College Hospital, No. 1, Shuaifuyuan, Dongcheng District, Beijing 100010, China
| | - Xu Tian
- Department of Otorhinolaryngology Head and Neck Surgery, The Peaking Union Medical College Hospital, No. 1, Shuaifuyuan, Dongcheng District, Beijing 100010, China
| | - Yang Zhao
- Department of Otorhinolaryngology Head and Neck Surgery, The Peaking Union Medical College Hospital, No. 1, Shuaifuyuan, Dongcheng District, Beijing 100010, China
| | - Guodong Feng
- Department of Otorhinolaryngology Head and Neck Surgery, The Peaking Union Medical College Hospital, No. 1, Shuaifuyuan, Dongcheng District, Beijing 100010, China
| | - Zhiqiang Gao
- Department of Otorhinolaryngology Head and Neck Surgery, The Peaking Union Medical College Hospital, No. 1, Shuaifuyuan, Dongcheng District, Beijing 100010, China
| |
Collapse
|
9
|
A deep learning approach to the diagnosis of atelectasis and attic retraction pocket in otitis media with effusion using otoscopic images. Eur Arch Otorhinolaryngol 2023; 280:1621-1627. [PMID: 36227348 PMCID: PMC9988777 DOI: 10.1007/s00405-022-07632-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 08/25/2022] [Indexed: 11/03/2022]
Abstract
BACKGROUND This study aimed to develop and validate a deep learning (DL) model to identify atelectasis and attic retraction pocket in cases of otitis media with effusion (OME) using multi-center otoscopic images. METHOD A total of 6393 OME otoscopic images from three centers were used to develop and validate a DL model for detecting atelectasis and attic retraction pocket. A threefold random cross-validation procedure was adopted to divide the dataset into training validation sets on a patient level. A team of otologists was assigned to diagnose and characterize atelectasis and attic retraction pocket in otoscopic images. Receiver operating characteristic (ROC) curves, including area under the ROC curve (AUC), accuracy, sensitivity, and specificity were used to assess the performance of the DL model. Class Activation Mapping (CAM) illustrated the discriminative regions in the otoscopic images. RESULTS Among all OME otoscopic images, 3564 (55.74%) were identified with attic retraction pocket, and 2460 (38.48%) with atelectasis. The diagnostic DL model of attic retraction pocket and atelectasis achieved a threefold cross-validation accuracy of 89% and 79%, AUC of 0.89 and 0.87, a sensitivity of 0.93 and 0.71, and a specificity of 0.62 and 0.84, respectively. Larger and deeper cases of atelectasis and attic retraction pocket showed greater weight, based on the red color depicted in the heat map of CAM. CONCLUSION The DL algorithm could be employed to identify atelectasis and attic retraction pocket in otoscopic images of OME, and as a tool to assist in the accurate diagnosis of OME.
Collapse
|
10
|
Cao Z, Chen F, Grais EM, Yue F, Cai Y, Swanepoel DW, Zhao F. Machine Learning in Diagnosing Middle Ear Disorders Using Tympanic Membrane Images: A Meta-Analysis. Laryngoscope 2023; 133:732-741. [PMID: 35848851 DOI: 10.1002/lary.30291] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2022] [Revised: 06/18/2022] [Accepted: 06/21/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE To systematically evaluate the development of Machine Learning (ML) models and compare their diagnostic accuracy for the classification of Middle Ear Disorders (MED) using Tympanic Membrane (TM) images. METHODS PubMed, EMBASE, CINAHL, and CENTRAL were searched up until November 30, 2021. Studies on the development of ML approaches for diagnosing MED using TM images were selected according to the inclusion criteria. PRISMA guidelines were followed with study design, analysis method, and outcomes extracted. Sensitivity, specificity, and area under the curve (AUC) were used to summarize the performance metrics of the meta-analysis. Risk of Bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool in combination with the Prediction Model Risk of Bias Assessment Tool. RESULTS Sixteen studies were included, encompassing 20254 TM images (7025 normal TM and 13229 MED). The sample size ranged from 45 to 6066 per study. The accuracy of the 25 included ML approaches ranged from 76.00% to 98.26%. Eleven studies (68.8%) were rated as having a low risk of bias, with the reference standard as the major domain of high risk of bias (37.5%). Sensitivity and specificity were 93% (95% CI, 90%-95%) and 85% (95% CI, 82%-88%), respectively. The AUC of total TM images was 94% (95% CI, 91%-96%). The greater AUC was found using otoendoscopic images than otoscopic images. CONCLUSIONS ML approaches perform robustly in distinguishing between normal ears and MED, however, it is proposed that a standardized TM image acquisition and annotation protocol should be developed. LEVEL OF EVIDENCE NA Laryngoscope, 133:732-741, 2023.
Collapse
Affiliation(s)
- Zuwei Cao
- Center for Rehabilitative Auditory Research, Guizhou Provincial People's Hospital, Guiyang City, China
| | - Feifan Chen
- Centre for Speech and Language Therapy and Hearing Science, Cardiff School of Sport and Health Sciences, Cardiff Metropolitan University, Cardiff, UK
| | - Emad M Grais
- Centre for Speech and Language Therapy and Hearing Science, Cardiff School of Sport and Health Sciences, Cardiff Metropolitan University, Cardiff, UK
| | - Fengjuan Yue
- Medical Examination Center, Guizhou Provincial People's Hospital, Guiyang City, China
| | - Yuexin Cai
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou City, China
| | - De Wet Swanepoel
- Department of Speech-Language Pathology and Audiology, University of Pretoria, Pretoria, South Africa
| | - Fei Zhao
- Centre for Speech and Language Therapy and Hearing Science, Cardiff School of Sport and Health Sciences, Cardiff Metropolitan University, Cardiff, UK
| |
Collapse
|
11
|
Liu M, Mei S, Liu P, Gasimov Y, Cattani C. A New X-ray Medical-Image-Enhancement Method Based on Multiscale Shannon-Cosine Wavelet. ENTROPY (BASEL, SWITZERLAND) 2022; 24:1754. [PMID: 36554159 PMCID: PMC9777674 DOI: 10.3390/e24121754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 11/25/2022] [Accepted: 11/25/2022] [Indexed: 06/17/2023]
Abstract
Because of noise interference, improper exposure, and the over thickness of human tissues, the detailed information of DR (digital radiography) images can be masked, including unclear edges and reduced contrast. An image-enhancement algorithm based on wavelet multiscale decomposition is proposed to address the shortcomings of existing single-scale image-enhancement algorithms. The proposed algorithm is based on Shannon-Cosine wavelets by taking advantage of the interpolation, smoothness, tight support, and normalization properties. Next a multiscale interpolation wavelet operator is constructed to divide the image into several sub-images from high frequency to low frequency, and to perform different multi-scale wavelet transforms on the detailed image of each channel. So that the most subtle and diagnostically useful information in the image can be effectively enhanced. Moreover, the image will not be over-enhanced and combined with the high contrast sensitivity of the human eye's visual system in smooth regions, different attenuation coefficients are used for different regions to achieve the purpose of suppressing noise while enhancing details. The results obtained by some simulations show that this method can effectively eliminate the noise in the DR image, and the enhanced DR image detail information is clearer than before while having high effectiveness and robustness.
Collapse
Affiliation(s)
- Meng Liu
- College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China
| | - Shuli Mei
- College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China
| | - Pengfei Liu
- Huiying Medical Technology Co., Ltd., Beijing 100192, China
| | - Yusif Gasimov
- Department of Mathematics and Informatics, Azerbaijan University, AZ1007 Baku, Azerbaijan
- Institute of Mathematics and Mechanics, ANAS, B. Vahabzade Str., 9, AZ1148 Baku, Azerbaijan
- Institute of Physical Problems, Baku State University, Z. Khalilov, 23, AZ1148 Baku, Azerbaijan
| | - Carlo Cattani
- Department of Mathematics and Informatics, Azerbaijan University, AZ1007 Baku, Azerbaijan
- Engineering School, DEIM, University of Tuscia, 01100 Viterbo, Italy
| |
Collapse
|
12
|
Byun H, Lee SH, Kim TH, Oh J, Chung JH. Feasibility of the Machine Learning Network to Diagnose Tympanic Membrane Lesions without Coding Experience. J Pers Med 2022; 12:jpm12111855. [PMID: 36579584 PMCID: PMC9697619 DOI: 10.3390/jpm12111855] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 09/29/2022] [Accepted: 10/31/2022] [Indexed: 11/10/2022] Open
Abstract
A machine learning platform operated without coding knowledge (Teachable machine®) has been introduced. The aims of the present study were to assess the performance of the Teachable machine® for diagnosing tympanic membrane lesions. A total of 3024 tympanic membrane images were used to train and validate the diagnostic performance of the network. Tympanic membrane images were labeled as normal, otitis media with effusion (OME), chronic otitis media (COM), and cholesteatoma. According to the complexity of the categorization, Level I refers to normal versus abnormal tympanic membrane; Level II was defined as normal, OME, or COM + cholesteatoma; and Level III distinguishes between all four pathologies. In addition, eighty representative test images were used to assess the performance. Teachable machine® automatically creates a classification network and presents diagnostic performance when images are uploaded. The mean accuracy of the Teachable machine® for classifying tympanic membranes as normal or abnormal (Level I) was 90.1%. For Level II, the mean accuracy was 89.0% and for Level III it was 86.2%. The overall accuracy of the classification of the 80 representative tympanic membrane images was 78.75%, and the hit rates for normal, OME, COM, and cholesteatoma were 95.0%, 70.0%, 90.0%, and 60.0%, respectively. Teachable machine® could successfully generate the diagnostic network for classifying tympanic membrane.
Collapse
Affiliation(s)
- Hayoung Byun
- Department of Otolaryngology & Head and Neck Surgery, College of Medicine, Hanyang University, Seoul 04763, Korea
- Machine Learning Research Center for Medical Data, Hanyang University, Seoul 04763, Korea
| | - Seung Hwan Lee
- Department of Otolaryngology & Head and Neck Surgery, College of Medicine, Hanyang University, Seoul 04763, Korea
| | - Tae Hyun Kim
- Machine Learning Research Center for Medical Data, Hanyang University, Seoul 04763, Korea
- Department of Computer Science, Hanyang University, Seoul 04763, Korea
| | - Jaehoon Oh
- Machine Learning Research Center for Medical Data, Hanyang University, Seoul 04763, Korea
- Department of Emergency Medicine, College of Medicine, Hanyang University, Seoul 04763, Korea
| | - Jae Ho Chung
- Department of Otolaryngology & Head and Neck Surgery, College of Medicine, Hanyang University, Seoul 04763, Korea
- Machine Learning Research Center for Medical Data, Hanyang University, Seoul 04763, Korea
- Department of HY-KIST Bio-Convergence, College of Medicine, Hanyang University, Seoul 04763, Korea
- Correspondence:
| |
Collapse
|
13
|
Mao C, Li A, Hu J, Wang P, Peng D, Wang J, Sun Y. Efficient and accurate diagnosis of otomycosis using an ensemble deep-learning model. Front Mol Biosci 2022; 9:951432. [PMID: 36060244 PMCID: PMC9437247 DOI: 10.3389/fmolb.2022.951432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Accepted: 07/27/2022] [Indexed: 11/13/2022] Open
Abstract
Otomycosis accounts for over 15% of cases of external otitis worldwide. It is common in humid regions and Chinese cultures with ear-cleaning custom. Aspergillus and Candida are the major pathogens causing long-term infection. Early endoscopic and microbiological examinations, performed by otologists and microbiologists, respectively, are important for the appropriate medical treatment of otomycosis. The deep-learning model is a novel automatic diagnostic program that provides quick and accurate diagnoses using a large database of images acquired in clinical settings. The aim of the present study was to introduce a machine-learning model to accurately and quickly diagnose otomycosis caused by Aspergillus and Candida. We propose a computer-aided decision-making system based on a deep-learning model comprising two subsystems: Java web application and image classification. The web application subsystem provides a user-friendly webpage to collect consulted images and display the calculation results. The image classification subsystem mainly trained neural network models for end-to-end data inference. The end user uploads a few images obtained with the ear endoscope, and the system returns the classification results to the user in the form of category probability values. To accurately diagnose otomycosis, we used otoendoscopic images and fungal culture secretion. Fungal fluorescence, culture, and DNA sequencing were performed to confirm the pathogens Aspergillus or Candida spp. In addition, impacted cerumen, external otitis, and normal external auditory canal endoscopic images were retained for reference. We merged these four types of images into an otoendoscopic image gallery. To achieve better accuracy and generalization abilities after model-training, we selected 2,182 of approximately 4,000 ear endoscopic images as training samples and 475 as validation samples. After selecting the deep neural network models, we tested the ResNet, SENet, and EfficientNet neural network models with different numbers of layers. Considering the accuracy and operation speed, we finally chose the EfficientNetB6 model, and the probability values of the four categories of otomycosis, impacted cerumen, external otitis, and normal cases were outputted. After multiple model training iterations, the average accuracy of the overall validation sample reached 92.42%. The results suggest that the system could be used as a reference for general practitioners to obtain more accurate diagnoses of otomycosis.
Collapse
Affiliation(s)
- Chenggang Mao
- Department of Otolaryngology Head and Neck Surgery, Jingzhou Hospital Affiliated to Yangtze University, Jingzhou, Hubei, China
| | - Aimin Li
- Department of Pediatrics, Jingzhou Hospital Affiliated to Yangtze University, Jingzhou, Hubei, China
| | - Jing Hu
- Department of Dermatology, Jingzhou Hospital Affiliated to Yangtze University, Jingzhou, Hubei, China
| | - Pengjun Wang
- Health Science Center, Yangtze University, Jingzhou, Hubei, China
| | - Dan Peng
- Department of Otolaryngology Head and Neck Surgery, Jingzhou Hospital Affiliated to Yangtze University, Jingzhou, Hubei, China
| | - Juehui Wang
- Department of Information Engineering, Jingzhou University, Jingzhou, Hubei, China
- *Correspondence: Juehui Wang,
| | - Yi Sun
- Department of Dermatology, Jingzhou Hospital Affiliated to Yangtze University, Jingzhou, Hubei, China
| |
Collapse
|
14
|
Zeng J, Kang W, Chen S, Lin Y, Deng W, Wang Y, Chen G, Ma K, Zhao F, Zheng Y, Liang M, Zeng L, Ye W, Li P, Chen Y, Chen G, Gao J, Wu M, Su Y, Zheng Y, Cai Y. A Deep Learning Approach to Predict Conductive Hearing Loss in Patients With Otitis Media With Effusion Using Otoscopic Images. JAMA Otolaryngol Head Neck Surg 2022; 148:612-620. [PMID: 35588049 DOI: 10.1001/jamaoto.2022.0900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Importance Otitis media with effusion (OME) is one of the most common causes of acquired conductive hearing loss (CHL). Persistent hearing loss is associated with poor childhood speech and language development and other adverse consequence. However, to obtain accurate and reliable hearing thresholds largely requires a high degree of cooperation from the patients. Objective To predict CHL from otoscopic images using deep learning (DL) techniques and a logistic regression model based on tympanic membrane features. Design, Setting, and Participants A retrospective diagnostic/prognostic study was conducted using 2790 otoscopic images obtained from multiple centers between January 2015 and November 2020. Participants were aged between 4 and 89 years. Of 1239 participants, there were 209 ears from children and adolescents (aged 4-18 years [16.87%]), 804 ears from adults (aged 18-60 years [64.89%]), and 226 ears from older people (aged >60 years, [18.24%]). Overall, 679 ears (54.8%) were from men. The 2790 otoscopic images were randomly assigned into a training set (2232 [80%]), and validation set (558 [20%]). The DL model was developed to predict an average air-bone gap greater than 10 dB. A logistic regression model was also developed based on otoscopic features. Main Outcomes and Measures The performance of the DL model in predicting CHL was measured using the area under the receiver operating curve (AUC), accuracy, and F1 score (a measure of the quality of a classifier, which is the harmonic mean of precision and recall; a higher F1 score means better performance). In addition, these evaluation parameters were compared to results obtained from the logistic regression model and predictions made by three otologists. Results The performance of the DL model in predicting CHL showed the AUC of 0.74, accuracy of 81%, and F1 score of 0.89. This was better than the results from the logistic regression model (ie, AUC of 0.60, accuracy of 76%, and F1 score of 0.82), and much improved on the performance of the 3 otologists; accuracy of 16%, 30%, 39%, and F1 scores of 0.09, 0.18, and 0.25, respectively. Furthermore, the DL model took 2.5 seconds to predict from 205 otoscopic images, whereas the 3 otologists spent 633 seconds, 645 seconds, and 692 seconds, respectively. Conclusions and Relevance The model in this diagnostic/prognostic study provided greater accuracy in prediction of CHL in ears with OME than those obtained from the logistic regression model and otologists. This indicates great potential for the use of artificial intelligence tools to facilitate CHL evaluation when CHL is unable to be measured.
Collapse
Affiliation(s)
- Junbo Zeng
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Weibiao Kang
- The second Hospital, Medical College, Shantou University, Shantou, Guangdong Province, China
| | - Suijun Chen
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yi Lin
- Jarvis Lab, Tencent, Shen Zhen city, Guangdong Province, China.,Hong Kong University of Science and Technology, Hong Kong, China
| | - Wenting Deng
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yajing Wang
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Guisheng Chen
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Kai Ma
- Jarvis Lab, Tencent, Shen Zhen city, Guangdong Province, China
| | - Fei Zhao
- Centre for Speech and Language Therapy and Hearing Science, Cardiff School of Sport and Health Sciences, Cardiff Metropolitan University, Wales, United Kingdom
| | - Yefeng Zheng
- Jarvis Lab, Tencent, Shen Zhen city, Guangdong Province, China
| | - Maojin Liang
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Linqi Zeng
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, China
| | - Weijie Ye
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, China
| | - Peng Li
- Department of Otolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yubin Chen
- Department of Otolaryngology-Head and Neck Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Guoping Chen
- Department of Otolaryngology, Zhongshan City People's Hospital, Zhongshan Affiliated Hospital of Sun Yat-sen University, Zhongshan, Guangdong Province, China
| | - Jinliang Gao
- Department of Otolaryngology, Shenzhen Baoan Women's and Children's Hospital, Shenzhen, Guangdong Province, China
| | - Minjian Wu
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yuejia Su
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yiqing Zheng
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China.,Shenzhen-Shanwei Central Hospital, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Shanwei City, Guangdong Province, China
| | - Yuexin Cai
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China.,Shenzhen-Shanwei Central Hospital, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Shanwei City, Guangdong Province, China
| |
Collapse
|
15
|
Habib AR, Crossland G, Patel H, Wong E, Kong K, Gunasekera H, Richards B, Caffery L, Perry C, Sacks R, Kumar A, Singh N. An Artificial Intelligence Computer-vision Algorithm to Triage Otoscopic Images From Australian Aboriginal and Torres Strait Islander Children. Otol Neurotol 2022; 43:481-488. [PMID: 35239622 DOI: 10.1097/mao.0000000000003484] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE To develop an artificial intelligence image classification algorithm to triage otoscopic images from rural and remote Australian Aboriginal and Torres Strait Islander children. STUDY DESIGN Retrospective observational study. SETTING Tertiary referral center. PATIENTS Rural and remote Aboriginal and Torres Strait Islander children who underwent tele-otology ear health screening in the Northern Territory, Australia between 2010 and 2018. INTERVENTIONS Otoscopic images were labeled by otolaryngologists to classify the ground truth. Deep and transfer learning methods were used to develop an image classification algorithm. MAIN OUTCOME MEASURES Accuracy, sensitivity, specificity, positive predictive value, negative predictive value, area under the curve (AUC) of the resultant algorithm compared with the ground truth. RESULTS Six thousand five hundred twenty seven images were used (5927 images for training and 600 for testing). The algorithm achieved an accuracy of 99.3% for acute otitis media, 96.3% for chronic otitis media, 77.8% for otitis media with effusion (OME), and 98.2% to classify wax/obstructed canal. To differentiate between multiple diagnoses, the algorithm achieved 74.4 to 92.8% accuracy and an AUC of 0.963 to 0.997. The most common incorrect classification pattern was OME misclassified as normal tympanic membranes. CONCLUSIONS The paucity of access to tertiary otolaryngology care for rural and remote Aboriginal and Torres Strait Islander communities may contribute to an under-identification of ear disease. Computer vision image classification algorithms can accurately classify ear disease from otoscopic images of Indigenous Australian children. In the future, a validated algorithm may integrate with existing telemedicine initiatives to support effective triage and facilitate early treatment and referral.
Collapse
Affiliation(s)
- Al-Rahim Habib
- Sydney Medical School, Faculty of Medicine and Health, University of Sydney, Camperdown, New South Wales, Australia
- Department of Otolaryngology-Head and Neck Surgery, Princess Alexandra Hospital, Brisbane, Queensland, Australia
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, Sydney, New South Wales, Australia
| | - Graeme Crossland
- Department of Otolaryngology - Head and Neck Surgery, Royal Darwin Hospital, Darwin, Northern Territory, Australia
| | - Hemi Patel
- Department of Otolaryngology - Head and Neck Surgery, Royal Darwin Hospital, Darwin, Northern Territory, Australia
| | - Eugene Wong
- Sydney Medical School, Faculty of Medicine and Health, University of Sydney, Camperdown, New South Wales, Australia
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, Sydney, New South Wales, Australia
| | - Kelvin Kong
- School of Medicine and Public Health, University of Newcastle, Newcastle, New South Wales, Australia
- Department of Linguistics, Faculty of Medicine, Macquarie University, Sydney, New South Wales, Australia
- School of Population Health, Faculty of Medicine, University of New South Wales, Sydney, Australia
| | - Hasantha Gunasekera
- Sydney Medical School, Faculty of Medicine and Health, University of Sydney, Camperdown, New South Wales, Australia
- The Children's Hospital at Westmead, Sydney, New South Wales, Australia
| | - Brent Richards
- Division of Medical Services, Gold Coast University Hospital, Gold Coast, Queensland, Australia
- Griffith Health, Griffith University Queensland, Australia
| | - Liam Caffery
- Centre for Online Health, University of Queensland, Australia
| | - Chris Perry
- Centre for Online Health, University of Queensland, Australia
| | - Raymond Sacks
- Sydney Medical School, Faculty of Medicine and Health, University of Sydney, Camperdown, New South Wales, Australia
| | - Ashnil Kumar
- School of Biomedical Engineering, Faculty of Engineering, University of Sydney, Camperdown, New South Wales, Australia
| | - Narinder Singh
- Sydney Medical School, Faculty of Medicine and Health, University of Sydney, Camperdown, New South Wales, Australia
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, Sydney, New South Wales, Australia
| |
Collapse
|
16
|
Habib AR, Kajbafzadeh M, Hasan Z, Wong E, Gunasekera H, Perry C, Sacks R, Kumar A, Singh N. Artificial intelligence to classify ear disease from otoscopy: A systematic review and meta-analysis. Clin Otolaryngol 2022; 47:401-413. [PMID: 35253378 PMCID: PMC9310803 DOI: 10.1111/coa.13925] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2021] [Revised: 01/08/2022] [Accepted: 02/27/2022] [Indexed: 11/29/2022]
Abstract
Objectives To summarise the accuracy of artificial intelligence (AI) computer vision algorithms to classify ear disease from otoscopy. Design Systematic review and meta‐analysis. Methods Using the PRISMA guidelines, nine online databases were searched for articles that used AI computer vision algorithms developed from various methods (convolutional neural networks, artificial neural networks, support vector machines, decision trees and k‐nearest neighbours) to classify otoscopic images. Diagnostic classes of interest: normal tympanic membrane, acute otitis media (AOM), otitis media with effusion (OME), chronic otitis media (COM) with or without perforation, cholesteatoma and canal obstruction. Main outcome measures Accuracy to correctly classify otoscopic images compared to otolaryngologists (ground truth). The Quality Assessment of Diagnostic Accuracy Studies Version 2 tool was used to assess the quality of methodology and risk of bias. Results Thirty‐nine articles were included. Algorithms achieved 90.7% (95%CI: 90.1–91.3%) accuracy to difference between normal or abnormal otoscopy images in 14 studies. The most common multiclassification algorithm (3 or more diagnostic classes) achieved 97.6% (95%CI: 97.3–97.9%) accuracy to differentiate between normal, AOM and OME in three studies. AI algorithms outperformed human assessors to classify otoscopy images achieving 93.4% (95%CI: 90.5–96.4%) versus 73.2% (95%CI: 67.9–78.5%) accuracy in three studies. Convolutional neural networks achieved the highest accuracy compared to other classification methods. Conclusion AI can classify ear disease from otoscopy. A concerted effort is required to establish a comprehensive and reliable otoscopy database for algorithm training. An AI‐supported otoscopy system may assist health care workers, trainees and primary care practitioners with less otology experience identify ear disease.
Collapse
Affiliation(s)
- Al-Rahim Habib
- Faculty of Medicine and Health, University of Sydney, New South Wales, Australia.,Department of Otolaryngology - Head and Neck Surgery, Princess Alexandra Hospital, Queensland, Australia.,Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, New South Wales, Australia
| | - Majid Kajbafzadeh
- Faculty of Medicine and Health, University of Sydney, New South Wales, Australia
| | - Zubair Hasan
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, New South Wales, Australia
| | - Eugene Wong
- Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, New South Wales, Australia
| | - Hasantha Gunasekera
- Faculty of Medicine and Health, University of Sydney, New South Wales, Australia.,The Children's Hospital at Westmead, New South Wales, Australia
| | - Chris Perry
- Department of Otolaryngology - Head and Neck Surgery, Princess Alexandra Hospital, Queensland, Australia.,University of Queensland Medical School, Queensland, Australia
| | - Raymond Sacks
- Faculty of Medicine and Health, University of Sydney, New South Wales, Australia
| | - Ashnil Kumar
- School of Biomedical Engineering, Faculty of Engineering, University of Sydney, New South Wales, Australia
| | - Narinder Singh
- Faculty of Medicine and Health, University of Sydney, New South Wales, Australia.,Department of Otolaryngology - Head and Neck Surgery, Westmead Hospital, New South Wales, Australia
| |
Collapse
|
17
|
Chawdhary G, Shoman N. Emerging artificial intelligence applications in otological imaging. Curr Opin Otolaryngol Head Neck Surg 2021; 29:357-364. [PMID: 34459798 DOI: 10.1097/moo.0000000000000754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE OF REVIEW To highlight the recent literature on artificial intelligence (AI) pertaining to otological imaging and to discuss future directions, obstacles and opportunities. RECENT FINDINGS The main themes in the recent literature centre around automated otoscopic image diagnosis and automated image segmentation for application in virtual reality surgical simulation and planning. Other applications that have been studied include identification of tinnitus MRI biomarkers, facial palsy analysis, intraoperative augmented reality systems, vertigo diagnosis and endolymphatic hydrops ratio calculation in Meniere's disease. Studies are presently at a preclinical, proof-of-concept stage. SUMMARY The recent literature on AI in otological imaging is promising and demonstrates the future potential of this technology in automating certain imaging tasks in a healthcare environment of ever-increasing demand and workload. Some studies have shown equivalence or superiority of the algorithm over physicians, albeit in narrowly defined realms. Future challenges in developing this technology include the compilation of large high quality annotated datasets, fostering strong collaborations between the health and technology sectors, testing the technology within real-world clinical pathways and bolstering trust among patients and physicians in this new method of delivering healthcare.
Collapse
Affiliation(s)
- Gaurav Chawdhary
- ENT Department, Royal Hallamshire Hospital, Broomhall, Sheffield, UK
| | - Nael Shoman
- ENT Department, Queen Elizabeth II Health Sciences Centre, Halifax, Nova Scotia, Canada
| |
Collapse
|