Machine Learning for Accurate Intraoperative Pediatric Middle Ear Effusion Diagnosis

Artificial Intelligence and Pediatric Otolaryngology

Artificial intelligence (AI) studies show how to program computers to simulate human intelligence and perform data interpretation, learning, and adaptive decision-making. Within pediatric otolaryngology, there is a growing body of evidence for the role of AI in diagnosis and triaging of acute otitis media and middle ear effusion, pediatric sleep disorders, and syndromic craniofacial anomalies. The use of automated machine learning with robotic devices intraoperatively is an evolving field of study, particularly in the realms of pediatric otologic surgery and computer-aided planning for maxillofacial reconstruction, and we will likely continue seeing novel applications of machine learning in otolaryngologic surgery.

Using Machine Learning for Endoscopic Detection of Low-Grade Subglottic Stenosis: A Proof of Principle

The current study trains, tests, and evaluates a deep learning algorithm to detect subglottic stenosis (SGS) on endoscopy. A retrospective review of patients undergoing microlaryngoscopy-bronchoscopy was performed. A pretrained image classifier (Resnet50) was retrained and tested on 159 images of airways taken at the glottis, 106 normal-sized airways, and 122 with SGS. Data augmentation was performed given the small sample size to prevent overfitting. Overall model accuracy was 73.3% (SD: 3.8). Precision and recall for stenosis were 77.3% (SD: 4.0) and 72.7 (SD: 4.0). F1 score for the detection of stenosis was 0.75 (SD: 0.04). Precision and recall for normal-sized images were lower at 69% (SD: 4.35) and 74% (SD: 4), with an F1 score of 0.71 (SD: 0.04). This study demonstrates that an image classification algorithm can identify SGS on endoscopic images. Work is needed to improve diagnostic accuracy for eventual deployment of the algorithm into clinical care.

Pediatric tympanostomy tube assessment via deep learning

PURPOSE

Tympanostomy tube (TT) placement is the most frequently performed ambulatory surgery in children under 15. After the procedure it is recommended that patients follow up regularly for "tube checks" until TT extrusion. Such visits incur direct and indirect costs to families in the form of days off from work, copays, and travel expenses. This pilot study aims to compare the efficacy of tympanic membrane (TM) evaluation by an artificial intelligence algorithm with that of clinical staff for determining presence or absence of a tympanostomy tube within the TM.

METHODS

Using a digital otoscope, we performed a prospective study in children (ages 10 months-10 years) with a history of TTs who were being seen for follow up in a pediatric otolaryngology clinic. A smartphone otoscope was used by study personnel who were not physicians to take ear exam images, then through conventional otoscopic exam, ears were assessed by a clinician for tubes being in place or tubes having extruded from the TM. We trained and tested a deep learning (artificial intelligence) algorithm to assess the images and compared that with the clinician's assessment.

RESULTS

A total of 123 images were obtained from 28 subjects. The algorithm classified images as TM with or without tube in place. Overall classification accuracy was 97.7 %. Recall and precision were 100 % and 96 %, respectively, for TM without a tube present, and 95 % and 100 %, respectively, for TM with a tube in place.

DISCUSSION

This is a promising deep learning algorithm for classifying ear tube presence in the TM utilizing images obtained in awake children using an over-the-counter otoscope available to the lay population. We are continuing enrollment, with the goal of building an algorithm to assess tube patency and extrusion.

Development and validation of a smartphone-based deep-learning-enabled system to detect middle-ear conditions in otoscopic images

Middle-ear conditions are common causes of primary care visits, hearing impairment, and inappropriate antibiotic use. Deep learning (DL) may assist clinicians in interpreting otoscopic images. This study included patients over 5 years old from an ambulatory ENT practice in Strasbourg, France, between 2013 and 2020. Digital otoscopic images were obtained using a smartphone-attached otoscope (Smart Scope, Karl Storz, Germany) and labeled by a senior ENT specialist across 11 diagnostic classes (reference standard). An Inception-v2 DL model was trained using 41,664 otoscopic images, and its diagnostic accuracy was evaluated by calculating class-specific estimates of sensitivity and specificity. The model was then incorporated into a smartphone app called i-Nside. The DL model was evaluated on a validation set of 3,962 images and a held-out test set comprising 326 images. On the validation set, all class-specific estimates of sensitivity and specificity exceeded 98%. On the test set, the DL model achieved a sensitivity of 99.0% (95% confidence interval: 94.5-100) and a specificity of 95.2% (91.5-97.6) for the binary classification of normal vs. abnormal images; wax plugs were detected with a sensitivity of 100% (94.6-100) and specificity of 97.7% (95.0-99.1); other class-specific estimates of sensitivity and specificity ranged from 33.3% to 92.3% and 96.0% to 100%, respectively. We present an end-to-end DL-enabled system able to achieve expert-level diagnostic accuracy for identifying normal tympanic aspects and wax plugs within digital otoscopic images. However, the system's performance varied for other middle-ear conditions. Further prospective validation is necessary before wider clinical deployment.

AI Model Versus Clinician Otoscopy in the Operative Setting for Otitis Media Diagnosis

Prior work has demonstrated improved accuracy in otitis media diagnosis based on otoscopy using artificial intelligence (AI)-based approaches compared to clinician evaluation. However, this difference in accuracy has not been shown in a setting resembling the point-of-care. In this study, we compare the diagnostic accuracy of a machine-learning model to that of pediatricians using standard handheld otoscopes. We find that the model is more accurate than clinicians (90.6% vs 59.4%, P = .01). This is a step towards validation of AI-based diagnosis under more real-world conditions. With further validation, for example on different patient populations and in deployment, this technology could be a useful addition to the clinician's toolbox in accurately diagnosing otitis media.

Development and Validation of an Automated Classifier to Diagnose Acute Otitis Media in Children

Importance

Acute otitis media (AOM) is a frequently diagnosed illness in children, yet the accuracy of diagnosis has been consistently low. Multiple neural networks have been developed to recognize the presence of AOM with limited clinical application.

Objective

To develop and internally validate an artificial intelligence decision-support tool to interpret videos of the tympanic membrane and enhance accuracy in the diagnosis of AOM.

Design, Setting, and Participants

This diagnostic study analyzed otoscopic videos of the tympanic membrane captured using a smartphone during outpatient clinic visits at 2 sites in Pennsylvania between 2018 and 2023. Eligible participants included children who presented for sick visits or wellness visits.

Exposure

Otoscopic examination.

Main Outcomes and Measures

Using the otoscopic videos that were annotated by validated otoscopists, a deep residual-recurrent neural network was trained to predict both features of the tympanic membrane and the diagnosis of AOM vs no AOM. The accuracy of this network was compared with a second network trained using a decision tree approach. A noise quality filter was also trained to prompt users that the video segment acquired may not be adequate for diagnostic purposes.

Results

Using 1151 videos from 635 children (majority younger than 3 years of age), the deep residual-recurrent neural network had almost identical diagnostic accuracy as the decision tree network. The finalized deep residual-recurrent neural network algorithm classified tympanic membrane videos into AOM vs no AOM categories with a sensitivity of 93.8% (95% CI, 92.6%-95.0%) and specificity of 93.5% (95% CI, 92.8%-94.3%) and the decision tree model had a sensitivity of 93.7% (95% CI, 92.4%-94.9%) and specificity of 93.3% (92.5%-94.1%). Of the tympanic membrane features outputted, bulging of the TM most closely aligned with the predicted diagnosis; bulging was present in 230 of 230 cases (100%) in which the diagnosis was predicted to be AOM in the test set.

Conclusions and Relevance

These findings suggest that given its high accuracy, the algorithm and medical-grade application that facilitates image acquisition and quality filtering could reasonably be used in primary care or acute care settings to aid with automated diagnosis of AOM and decisions regarding treatment.

Improving the Accuracy of Otitis Media with Effusion Diagnosis in Pediatric Patients Using Deep Learning

Otitis media with effusion (OME), primarily seen in children aged 2 years and younger, is characterized by the presence of fluid in the middle ear, often resulting in hearing loss and aural fullness. While deep learning networks have been explored to aid OME diagnosis, prior work did not often specify if pediatric images were used for training, causing uncertainties about their clinical relevance, especially due to important distinctions between the tympanic membranes of small children and adults. We trained cross-validated ResNet50, DenseNet201, InceptionV3, and InceptionResNetV2 models on 1150 pediatric tympanic membrane images from otoendoscopes to classify OME. When assessed using a separate dataset of 100 pediatric tympanic membrane images, the models achieved mean accuracies of 92.9% (ResNet50), 97.2% (DenseNet201), 96.0% (InceptionV3), and 94.8% (InceptionResNetV2), compared to the seven otolaryngologists that achieved accuracies between 84.0% and 69.0%. The results showed that even the worst-performing model trained on fold 3 of InceptionResNetV2 with an accuracy of 88.0% exceeded the accuracy of the highest-performing otolaryngologist at 84.0%. Our findings suggest that these specifically trained deep learning models can potentially enhance the clinical diagnosis of OME using pediatric otoendoscopic tympanic membrane images.

Image-Based Artificial Intelligence Technology for Diagnosing Middle Ear Diseases: A Systematic Review

Otolaryngological diagnoses, such as otitis media, are traditionally performed using endoscopy, wherein diagnostic accuracy can be subjective and vary among clinicians. The integration of objective tools, like artificial intelligence (AI), could potentially improve the diagnostic process by minimizing the influence of subjective biases and variability. We systematically reviewed the AI techniques using medical imaging in otolaryngology. Relevant studies related to AI-assisted otitis media diagnosis were extracted from five databases: Google Scholar, PubMed, Medline, Embase, and IEEE Xplore, without date restrictions. Publications that did not relate to AI and otitis media diagnosis or did not utilize medical imaging were excluded. Of the 32identified studies, 26 used tympanic membrane images for classification, achieving an average diagnosis accuracy of 86% (range: 48.7-99.16%). Another three studies employed both segmentation and classification techniques, reporting an average diagnosis accuracy of 90.8% (range: 88.06-93.9%). These findings suggest that AI technologies hold promise for improving otitis media diagnosis, offering benefits for telemedicine and primary care settings due to their high diagnostic accuracy. However, to ensure patient safety and optimal outcomes, further improvements in diagnostic performance are necessary.

Diagnosis, Treatment, and Management of Otitis Media with Artificial Intelligence

A common infectious disease, otitis media (OM) has a low rate of early diagnosis, which significantly increases the difficulty of treating the disease and the likelihood of serious complications developing including hearing loss, speech impairment, and even intracranial infection. Several areas of healthcare have shown great promise in the application of artificial intelligence (AI) systems, such as the accurate detection of diseases, the automated interpretation of images, and the prediction of patient outcomes. Several articles have reported some machine learning (ML) algorithms such as ResNet, InceptionV3 and Unet, were applied to the diagnosis of OM successfully. The use of these techniques in the OM is still in its infancy, but their potential is enormous. We present in this review important concepts related to ML and AI, describe how these technologies are currently being applied to diagnosing, treating, and managing OM, and discuss the challenges associated with developing AI-assisted OM technologies in the future.

Making Use of Artificial Intelligence-Generated Synthetic Tympanic Membrane Images

This diagnostic study examines the application of generative artificial intelligence in clinical tool research and development.

New insights into the treatment of acute otitis media

INTRODUCTION

Acute otitis media (AOM) affects most (80%) children by 5 years of age and is the most common reason children are prescribed antibiotics. The epidemiology of AOM has changed considerably since the widespread use of pneumococcal conjugate vaccines, which has broad-reaching implications for management.

AREAS COVERED

In this narrative review, we cover the epidemiology of AOM, best practices for diagnosis and management, new diagnostic technology, effective stewardship interventions, and future directions of the field. Literature review was performed using PubMed and ClinicalTrials.gov.

EXPERT OPINION

Inaccurate diagnoses, unnecessary antibiotic use, and increasing antimicrobial resistance remain major challenges in AOM management. Fortunately, effective tools and interventions to improve diagnostic accuracy, de-implement unnecessary antibiotic use, and individualize care are on the horizon. Successful scaling of these tools and interventions will be critical to improving overall care for children.

Machine Learning in Diagnosing Middle Ear Disorders Using Tympanic Membrane Images: A Meta-Analysis

OBJECTIVE

To systematically evaluate the development of Machine Learning (ML) models and compare their diagnostic accuracy for the classification of Middle Ear Disorders (MED) using Tympanic Membrane (TM) images.

METHODS

PubMed, EMBASE, CINAHL, and CENTRAL were searched up until November 30, 2021. Studies on the development of ML approaches for diagnosing MED using TM images were selected according to the inclusion criteria. PRISMA guidelines were followed with study design, analysis method, and outcomes extracted. Sensitivity, specificity, and area under the curve (AUC) were used to summarize the performance metrics of the meta-analysis. Risk of Bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool in combination with the Prediction Model Risk of Bias Assessment Tool.

RESULTS

Sixteen studies were included, encompassing 20254 TM images (7025 normal TM and 13229 MED). The sample size ranged from 45 to 6066 per study. The accuracy of the 25 included ML approaches ranged from 76.00% to 98.26%. Eleven studies (68.8%) were rated as having a low risk of bias, with the reference standard as the major domain of high risk of bias (37.5%). Sensitivity and specificity were 93% (95% CI, 90%-95%) and 85% (95% CI, 82%-88%), respectively. The AUC of total TM images was 94% (95% CI, 91%-96%). The greater AUC was found using otoendoscopic images than otoscopic images.

CONCLUSIONS

ML approaches perform robustly in distinguishing between normal ears and MED, however, it is proposed that a standardized TM image acquisition and annotation protocol should be developed.

LEVEL OF EVIDENCE

NA Laryngoscope, 133:732-741, 2023.

Evaluating the generalizability of deep learning image classification algorithms to detect middle ear disease using otoscopy

To evaluate the generalizability of artificial intelligence (AI) algorithms that use deep learning methods to identify middle ear disease from otoscopic images, between internal to external performance. 1842 otoscopic images were collected from three independent sources: (a) Van, Turkey, (b) Santiago, Chile, and (c) Ohio, USA. Diagnostic categories consisted of (i) normal or (ii) abnormal. Deep learning methods were used to develop models to evaluate internal and external performance, using area under the curve (AUC) estimates. A pooled assessment was performed by combining all cohorts together with fivefold cross validation. AI-otoscopy algorithms achieved high internal performance (mean AUC: 0.95, 95%CI: 0.80-1.00). However, performance was reduced when tested on external otoscopic images not used for training (mean AUC: 0.76, 95%CI: 0.61-0.91). Overall, external performance was significantly lower than internal performance (mean difference in AUC: -0.19, p ≤ 0.04). Combining cohorts achieved a substantial pooled performance (AUC: 0.96, standard error: 0.01). Internally applied algorithms for otoscopy performed well to identify middle ear disease from otoscopy images. However, external performance was reduced when applied to new test cohorts. Further efforts are required to explore data augmentation and pre-processing techniques that might improve external performance and develop a robust, generalizable algorithm for real-world clinical applications.

Optimizing the Definition of Proximal Junctional Kyphosis: A Sensitivity Analysis

STUDY DESIGN

Diagnostic binary threshold analysis.

OBJECTIVE

(1) Perform a sensitivity analysis demonstrating the test performance metrics for any combination of proximal junctional angle (PJA) magnitude and change; (2) Propose a new proximal junctional kyphosis (PJK) criteria.

SUMMARY OF BACKGROUND DATA

Previous definitions of PJK have been arbitrarily selected and then tested through retrospective case series, often showing little correlation with clinical outcomes.

MATERIALS AND METHODS

Surgically treated adult spinal deformity patients (≥4 levels fused) enrolled into a prospective, multicenter database were evaluated at a minimum 2-year follow-up for proximal junctional failure (PJF). Using PJF as the outcome of interest, test performance metrics including sensitivity, positive predictive value, and F1 metrics (harmonic mean of precision and recall) were calculated for all combinations of PJA magnitude and change using different combinations of perijunctional vertebrae. The combination with the highest F1 score was selected as the new PJK criteria. Performance metrics of previous PJK definitions and the new PJK definition were compared.

RESULTS

Of the total, 669 patients were reviewed. PJF rate was 10%. Overall, the highest F1 scores were achieved when the upper instrumented vertebrae -1 (UIV-1)/UIV+2 angle was measured. For lower thoracic cases, out of all the PJA and magnitude/change combinations tested, a UIV-1/UIV+2 magnitude of -28° and a change of -20° was associated with the highest F1 score. For upper thoracic cases, a UIV-1/UIV+2 magnitude of -30° and a change of -24° were associated with the highest F1 score. Using PJF as the outcome, patients meeting this new criterion (11.5%) at 6 weeks had the lowest survival rate (74.7%) at 2 years postoperative, compared with Glattes (84.4%) and Bridwell (77.4%).

CONCLUSIONS

Out of all possible PJA magnitude and change combinations, without stratifying by upper thoracic versus lower thoracic fusions, a magnitude of ≤-28° and a change of ≤-22° provide the best test performance metrics for predicting PJF.

Generation of synthetic tympanic membrane images: Development, human validation, and clinical implications of synthetic data

Synthetic clinical images could augment real medical image datasets, a novel approach in otolaryngology-head and neck surgery (OHNS). Our objective was to develop a generative adversarial network (GAN) for tympanic membrane images and to validate the quality of synthetic images with human reviewers. Our model was developed using a state-of-the-art GAN architecture, StyleGAN2-ADA. The network was trained on intraoperative high-definition (HD) endoscopic images of tympanic membranes collected from pediatric patients undergoing myringotomy with possible tympanostomy tube placement. A human validation survey was administered to a cohort of OHNS and pediatrics trainees at our institution. The primary measure of model quality was the Frechet Inception Distance (FID), a metric comparing the distribution of generated images with the distribution of real images. The measures used for human reviewer validation were the sensitivity, specificity, and area under the curve (AUC) for humans' ability to discern synthetic from real images. Our dataset comprised 202 images. The best GAN was trained at 512x512 image resolution with a FID of 47.0. The progression of images through training showed stepwise "learning" of the anatomic features of a tympanic membrane. The validation survey was taken by 65 persons who reviewed 925 images. Human reviewers demonstrated a sensitivity of 66%, specificity of 73%, and AUC of 0.69 for the detection of synthetic images. In summary, we successfully developed a GAN to produce synthetic tympanic membrane images and validated this with human reviewers. These images could be used to bolster real datasets with various pathologies and develop more robust deep learning models such as those used for diagnostic predictions from otoscopic images. However, caution should be exercised with the use of synthetic data given issues regarding data diversity and performance validation. Any model trained using synthetic data will require robust external validation to ensure validity and generalizability.

Using Machine Learning to Predict Operating Room Case Duration: A Case Study in Otolaryngology

OBJECTIVE

Optimizing operating room (OR) efficiency depends on accurate case duration estimates. Machine learning (ML) methods have been used to predict OR case durations in other subspecialties. We hypothesize that ML methods improve projected case lengths over existing non-ML techniques for otolaryngology-head and neck surgery cases.

METHODS

Deidentified patient information from otolaryngology surgical cases at 1 academic institution were reviewed from 2016 to 2020. Variables collected included patient, surgeon, procedure, and facility data known preoperatively so as to capture all realistic contributors. Available case data were divided into a training and testing data set. Several ML algorithms were evaluated based on best performance of predicted case duration when compared to actual case duration. Performance of all models was compared by the average root mean squared error and mean absolute error (MAE).

RESULTS

In total, 50,888 otolaryngology surgical cases were evaluated with an average case duration of 98.3 ± 86.9 minutes. Most cases were general otolaryngology (n = 16,620). Case features closely associated with OR duration included procedure performed, surgeon, subspecialty of case, and postoperative destination of the patient. The best-performing ML models were CatBoost and XGBoost, which reduced operative time MAE by 9.6 minutes and 8.5 minutes compared to current methods, respectively.

DISCUSSION

The incorporation of other easily identifiable features beyond procedure performed and surgeon meaningfully improved our operative duration prediction accuracy. CatBoost provided the best-performing ML model.

IMPLICATIONS FOR PRACTICE

ML algorithms to predict OR case time duration in otolaryngology can improve case duration accuracy and result in financial benefit.

Feasibility of the Machine Learning Network to Diagnose Tympanic Membrane Lesions without Coding Experience

A machine learning platform operated without coding knowledge (Teachable machine^®) has been introduced. The aims of the present study were to assess the performance of the Teachable machine^® for diagnosing tympanic membrane lesions. A total of 3024 tympanic membrane images were used to train and validate the diagnostic performance of the network. Tympanic membrane images were labeled as normal, otitis media with effusion (OME), chronic otitis media (COM), and cholesteatoma. According to the complexity of the categorization, Level I refers to normal versus abnormal tympanic membrane; Level II was defined as normal, OME, or COM + cholesteatoma; and Level III distinguishes between all four pathologies. In addition, eighty representative test images were used to assess the performance. Teachable machine^® automatically creates a classification network and presents diagnostic performance when images are uploaded. The mean accuracy of the Teachable machine^® for classifying tympanic membranes as normal or abnormal (Level I) was 90.1%. For Level II, the mean accuracy was 89.0% and for Level III it was 86.2%. The overall accuracy of the classification of the 80 representative tympanic membrane images was 78.75%, and the hit rates for normal, OME, COM, and cholesteatoma were 95.0%, 70.0%, 90.0%, and 60.0%, respectively. Teachable machine^® could successfully generate the diagnostic network for classifying tympanic membrane.

Artificial intelligence and tele-otoscopy: A window into the future of pediatric otology

Telehealth in otolaryngology is gaining popularity as a potential tool for increased access for rural populations, decreased specialist wait times, and overall savings to the healthcare system. The adoption of telehealth has been dramatically increased by the COVID-19 pandemic limiting patients' physical access to hospitals and clinics. One of the key challenges to telehealth in general otolaryngology and otology specifically is the limited physical examination possible on the ear canal and middle ear. This is compounded in pediatric populations who commonly present with middle ear pathologies which can be challenging to diagnose even in the clinic. To address this need, various otoscopes have been designed to allow patients, their parents, or primary care providers to image the tympanic membrane and middle ear, and send data to otolaryngologists for review. Furthermore, the ability of these devices to capture images in digital format has opened the possibility of using artificial intelligence for quick and reliable diagnostic workup. In this manuscript, we provide a concise review of the literature regarding the efficacy of remote otoscopy, as well as recent efforts on the use of artificial intelligence in aiding otologic diagnoses.

"Human vs Machine" Validation of a Deep Learning Algorithm for Pediatric Middle Ear Infection Diagnosis

OBJECTIVE

We compared the diagnostic performance of human clinicians with that of a neural network algorithm developed using a library of tympanic membrane images derived from children taken to the operating room with the intent of performing myringotomy and possible tube placement for recurrent acute otitis media (AOM) or otitis media with effusion (OME).

STUDY DESIGN

Retrospective cohort study.

SETTING

Tertiary academic medical center from 2018 to 2021.

METHODS

A training set of 639 images of tympanic membranes representing normal, OME, and AOM was used to train a neural network as well as a proprietary commercial image classifier from Google. Model diagnostic prediction performance in differentiating normal vs nonpurulent vs purulent effusion was scored based on classification accuracy. A web-based survey was developed to test human clinicians' diagnostic accuracy on a novel image set, and this was compared head to head against our model.

RESULTS

Our model achieved a mean prediction accuracy of 80.8% (95% CI, 77.0%-84.6%). The Google model achieved a prediction accuracy of 85.4%. In a validation survey of 39 clinicians analyzing a sample of 22 endoscopic ear images, the average diagnostic accuracy was 65.0%. On the same data set, our model achieved an accuracy of 95.5%.

CONCLUSION

Our model outperformed certain groups of human clinicians in assessing images of tympanic membranes for effusions in children. Reduced diagnostic error rates using machine learning models may have implications in reducing rates of misdiagnosis, potentially leading to fewer missed diagnoses, unnecessary antibiotic prescriptions, and surgical procedures.

An Artificial Intelligence Computer-vision Algorithm to Triage Otoscopic Images From Australian Aboriginal and Torres Strait Islander Children

OBJECTIVE

To develop an artificial intelligence image classification algorithm to triage otoscopic images from rural and remote Australian Aboriginal and Torres Strait Islander children.

STUDY DESIGN

Retrospective observational study.

SETTING

Tertiary referral center.

PATIENTS

Rural and remote Aboriginal and Torres Strait Islander children who underwent tele-otology ear health screening in the Northern Territory, Australia between 2010 and 2018.

INTERVENTIONS

Otoscopic images were labeled by otolaryngologists to classify the ground truth. Deep and transfer learning methods were used to develop an image classification algorithm.

MAIN OUTCOME MEASURES

Accuracy, sensitivity, specificity, positive predictive value, negative predictive value, area under the curve (AUC) of the resultant algorithm compared with the ground truth.

RESULTS

Six thousand five hundred twenty seven images were used (5927 images for training and 600 for testing). The algorithm achieved an accuracy of 99.3% for acute otitis media, 96.3% for chronic otitis media, 77.8% for otitis media with effusion (OME), and 98.2% to classify wax/obstructed canal. To differentiate between multiple diagnoses, the algorithm achieved 74.4 to 92.8% accuracy and an AUC of 0.963 to 0.997. The most common incorrect classification pattern was OME misclassified as normal tympanic membranes.

CONCLUSIONS

The paucity of access to tertiary otolaryngology care for rural and remote Aboriginal and Torres Strait Islander communities may contribute to an under-identification of ear disease. Computer vision image classification algorithms can accurately classify ear disease from otoscopic images of Indigenous Australian children. In the future, a validated algorithm may integrate with existing telemedicine initiatives to support effective triage and facilitate early treatment and referral.

Artificial intelligence to classify ear disease from otoscopy: A systematic review and meta-analysis

Objectives

To summarise the accuracy of artificial intelligence (AI) computer vision algorithms to classify ear disease from otoscopy.

Design

Systematic review and meta‐analysis.

Methods

Using the PRISMA guidelines, nine online databases were searched for articles that used AI computer vision algorithms developed from various methods (convolutional neural networks, artificial neural networks, support vector machines, decision trees and k‐nearest neighbours) to classify otoscopic images. Diagnostic classes of interest: normal tympanic membrane, acute otitis media (AOM), otitis media with effusion (OME), chronic otitis media (COM) with or without perforation, cholesteatoma and canal obstruction.

Main outcome measures

Accuracy to correctly classify otoscopic images compared to otolaryngologists (ground truth). The Quality Assessment of Diagnostic Accuracy Studies Version 2 tool was used to assess the quality of methodology and risk of bias.

Results

Thirty‐nine articles were included. Algorithms achieved 90.7% (95%CI: 90.1–91.3%) accuracy to difference between normal or abnormal otoscopy images in 14 studies. The most common multiclassification algorithm (3 or more diagnostic classes) achieved 97.6% (95%CI: 97.3–97.9%) accuracy to differentiate between normal, AOM and OME in three studies. AI algorithms outperformed human assessors to classify otoscopy images achieving 93.4% (95%CI: 90.5–96.4%) versus 73.2% (95%CI: 67.9–78.5%) accuracy in three studies. Convolutional neural networks achieved the highest accuracy compared to other classification methods.

Conclusion

AI can classify ear disease from otoscopy. A concerted effort is required to establish a comprehensive and reliable otoscopy database for algorithm training. An AI‐supported otoscopy system may assist health care workers, trainees and primary care practitioners with less otology experience identify ear disease.

Emerging artificial intelligence applications in otological imaging

PURPOSE OF REVIEW

To highlight the recent literature on artificial intelligence (AI) pertaining to otological imaging and to discuss future directions, obstacles and opportunities.

RECENT FINDINGS

The main themes in the recent literature centre around automated otoscopic image diagnosis and automated image segmentation for application in virtual reality surgical simulation and planning. Other applications that have been studied include identification of tinnitus MRI biomarkers, facial palsy analysis, intraoperative augmented reality systems, vertigo diagnosis and endolymphatic hydrops ratio calculation in Meniere's disease. Studies are presently at a preclinical, proof-of-concept stage.

SUMMARY

The recent literature on AI in otological imaging is promising and demonstrates the future potential of this technology in automating certain imaging tasks in a healthcare environment of ever-increasing demand and workload. Some studies have shown equivalence or superiority of the algorithm over physicians, albeit in narrowly defined realms. Future challenges in developing this technology include the compilation of large high quality annotated datasets, fostering strong collaborations between the health and technology sectors, testing the technology within real-world clinical pathways and bolstering trust among patients and physicians in this new method of delivering healthcare.

An Assistive Role of a Machine Learning Network in Diagnosis of Middle Ear Diseases

The present study aimed to develop a machine learning network to diagnose middle ear diseases with tympanic membrane images and to identify its assistive role in the diagnostic process. The medical records of subjects who underwent ear endoscopy tests were reviewed. From these records, 2272 diagnostic tympanic membranes images were appropriately labeled as normal, otitis media with effusion (OME), chronic otitis media (COM), or cholesteatoma and were used for training. We developed the “ResNet18 + Shuffle” network and validated the model performance. Seventy-one representative cases were selected to test the final accuracy of the network and resident physicians. We asked 10 resident physicians to make diagnoses from tympanic membrane images with and without the help of the machine learning network, and the change of the diagnostic performance of resident physicians with the aid of the answers from the machine learning network was assessed. The devised network showed a highest accuracy of 97.18%. A five-fold validation showed that the network successfully diagnosed ear diseases with an accuracy greater than 93%. All resident physicians were able to diagnose middle ear diseases more accurately with the help of the machine learning network. The increase in diagnostic accuracy was up to 18% (1.4% to 18.4%). The machine learning network successfully classified middle ear diseases and was assistive to clinicians in the interpretation of tympanic membrane images.

Children's Activity Classification for Domestic Risk Scenarios Using Environmental Sound and a Bayesian Network

Children’s healthcare is a relevant issue, especially the prevention of domestic accidents, since it has even been defined as a global health problem. Children’s activity classification generally uses sensors embedded in children’s clothing, which can lead to erroneous measurements for possible damage or mishandling. Having a non-invasive data source for a children’s activity classification model provides reliability to the monitoring system where it is applied. This work proposes the use of environmental sound as a data source for the generation of children’s activity classification models, implementing feature selection methods and classification techniques based on Bayesian networks, focused on the recognition of potentially triggering activities of domestic accidents, applicable in child monitoring systems. Two feature selection techniques were used: the Akaike criterion and genetic algorithms. Likewise, models were generated using three classifiers: naive Bayes, semi-naive Bayes and tree-augmented naive Bayes. The generated models, combining the methods of feature selection and the classifiers used, present accuracy of greater than 97% for most of them, with which we can conclude the efficiency of the proposal of the present work in the recognition of potentially detonating activities of domestic accidents.

Handheld Briefcase Optical Coherence Tomography with Real-Time Machine Learning Classifier for Middle Ear Infections

A middle ear infection is a prevalent inflammatory disease most common in the pediatric population, and its financial burden remains substantial. Current diagnostic methods are highly subjective, relying on visual cues gathered by an otoscope. To address this shortcoming, optical coherence tomography (OCT) has been integrated into a handheld imaging probe. This system can non-invasively and quantitatively assess middle ear effusions and identify the presence of bacterial biofilms in the middle ear cavity during ear infections. Furthermore, the complete OCT system is housed in a standard briefcase to maximize its portability as a diagnostic device. Nonetheless, interpreting OCT images of the middle ear more often requires expertise in OCT as well as middle ear infections, making it difficult for an untrained user to operate the system as an accurate stand-alone diagnostic tool in clinical settings. Here, we present a briefcase OCT system implemented with a real-time machine learning platform for middle ear infections. A random forest-based classifier can categorize images based on the presence of middle ear effusions and biofilms. This study demonstrates that our briefcase OCT system coupled with machine learning can provide user-invariant classification results of middle ear conditions, which may greatly improve the utility of this technology for the diagnosis and management of middle ear infections.