Comparisons of deep learning algorithms for diagnosing bacterial keratitis via external eye photographs

Potential applications of artificial intelligence in image analysis in cornea diseases: a review

Artificial intelligence (AI) is an emerging field which could make an intelligent healthcare model a reality and has been garnering traction in the field of medicine, with promising results. There have been recent developments in machine learning and/or deep learning algorithms for applications in ophthalmology-primarily for diabetic retinopathy, and age-related macular degeneration. However, AI research in the field of cornea diseases is relatively new. Algorithms have been described to assist clinicians in diagnosis or detection of cornea conditions such as keratoconus, infectious keratitis and dry eye disease. AI may also be used for segmentation and analysis of cornea imaging or tomography as an adjunctive tool. Despite the potential advantages that these new technologies offer, there are challenges that need to be addressed before they can be integrated into clinical practice. In this review, we aim to summarize current literature and provide an update regarding recent advances in AI technologies pertaining to corneal diseases, and its potential future application, in particular pertaining to image analysis.

Monitoring the Progression of Clinically Suspected Microbial Keratitis Using Convolutional Neural Networks

Purpose

For this study, we aimed to determine whether a convolutional neural network (CNN)-based method (based on a feature extractor and an identifier) can be applied to monitor the progression of keratitis while managing suspected microbial keratitis (MK).

Methods

This multicenter longitudinal cohort study included patients with suspected MK undergoing serial external eye photography at the 5 branches of Chang Gung Memorial Hospital from August 20, 2000, to August 19, 2020. Data were primarily analyzed from January 1 to March 25, 2022. The CNN-based model was evaluated via F1 score and accuracy. The area under the receiver operating characteristic curve (AUROC) was used to measure the precision-recall trade-off.

Results

The model was trained using 1456 image pairs from 468 patients. In comparing models via only training the identifier, statistically significant higher accuracy (P  < 0.05) in models via training both the identifier and feature extractor (full training) was verified, with 408 image pairs from 117 patients. The full training EfficientNet b3-based model showed 90.2% (getting better) and 82.1% (becoming worse) F1 scores, 87.3% accuracy, and 94.2% AUROC for 505 getting better and 272 becoming worse test image pairs from 452 patients.

Conclusions

A CNN-based approach via deep learning applied in suspected MK can monitor the progress/regress during treatment by comparing external eye image pairs.

Translational Relevance

The study bridges the gap between the investigation of the state-of-the-art CNN-based deep learning algorithm applied in ocular image analysis and the clinical care of suspected patients with MK.

Updates in Diagnostic Imaging for Infectious Keratitis: A Review

Infectious keratitis (IK) is among the top five leading causes of blindness globally. Early diagnosis is needed to guide appropriate therapy to avoid complications such as vision impairment and blindness. Slit lamp microscopy and culture of corneal scrapes are key to diagnosing IK. Slit lamp photography was transformed when digital cameras and smartphones were invented. The digital camera or smartphone camera sensor's resolution, the resolution of the slit lamp and the focal length of the smartphone camera system are key to a high-quality slit lamp image. Alternative diagnostic tools include imaging, such as optical coherence tomography (OCT) and in vivo confocal microscopy (IVCM). OCT's advantage is its ability to accurately determine the depth and extent of the corneal ulceration, infiltrates and haze, therefore characterizing the severity and progression of the infection. However, OCT is not a preferred choice in the diagnostic tool package for infectious keratitis. Rather, IVCM is a great aid in the diagnosis of fungal and Acanthamoeba keratitis with overall sensitivities of 66-74% and 80-100% and specificity of 78-100% and 84-100%, respectively. Recently, deep learning (DL) models have been shown to be promising aids for the diagnosis of IK via image recognition. Most of the studies that have developed DL models to diagnose the different types of IK have utilised slit lamp photographs. Some studies have used extremely efficient single convolutional neural network algorithms to train their models, and others used ensemble approaches with variable results. Limitations of DL models include the need for large image datasets to train the models, the difficulty in finding special features of the different types of IK, the imbalance of training models, the lack of image protocols and misclassification bias, which need to be overcome to apply these models into real-world settings. Newer artificial intelligence technology that generates synthetic data, such as generative adversarial networks, may assist in overcoming some of these limitations of CNN models.

Artificial Intelligence and Infectious Keratitis: Where Are We Now?

Infectious keratitis (IK), which is one of the most common and catastrophic ophthalmic emergencies, accounts for the leading cause of corneal blindness worldwide. Different pathogens, including bacteria, viruses, fungi, and parasites, can cause IK. The diagnosis and etiology detection of IK pose specific challenges, and delayed or incorrect diagnosis can significantly worsen the outcome. Currently, this process is mainly performed based on slit-lamp findings, corneal smear and culture, tissue biopsy, PCR, and confocal microscopy. However, these diagnostic methods have their drawbacks, including experience dependency, tissue damage, cost, and time consumption. Diagnosis and etiology detection of IK can be especially challenging in rural areas or in countries with limited resources. In recent years, artificial intelligence (AI) has opened new windows in medical fields such as ophthalmology. An increasing number of studies have utilized AI in the diagnosis of anterior segment diseases such as IK. Several studies have demonstrated that AI algorithms can diagnose and detect the etiology of IK accurately and fast, which can be valuable, especially in remote areas and in countries with limited resources. Herein, we provided a comprehensive update on the utility of AI in IK.

Deep learning for automated detection of neovascular leakage on ultra-widefield fluorescein angiography in diabetic retinopathy

Diabetic retinopathy is a leading cause of blindness in working-age adults worldwide. Neovascular leakage on fluorescein angiography indicates progression to the proliferative stage of diabetic retinopathy, which is an important distinction that requires timely ophthalmic intervention with laser or intravitreal injection treatment to reduce the risk of severe, permanent vision loss. In this study, we developed a deep learning algorithm to detect neovascular leakage on ultra-widefield fluorescein angiography images obtained from patients with diabetic retinopathy. The algorithm, an ensemble of three convolutional neural networks, was able to accurately classify neovascular leakage and distinguish this disease marker from other angiographic disease features. With additional real-world validation and testing, our algorithm could facilitate identification of neovascular leakage in the clinical setting, allowing timely intervention to reduce the burden of blinding diabetic eye disease.

A knowledge-enhanced transform-based multimodal classifier for microbial keratitis identification

Microbial keratitis, a nonviral corneal infection caused by bacteria, fungi, and protozoa, is an urgent condition in ophthalmology requiring prompt treatment in order to prevent severe complications of corneal perforation and vision loss. It is difficult to distinguish between bacterial and fungal keratitis from image unimodal alone, as the characteristics of the sample images themselves are very close. Therefore, this study aims to develop a new deep learning model called knowledge-enhanced transform-based multimodal classifier that exploited the potential of slit-lamp images along with treatment texts to identify bacterial keratitis (BK) and fungal keratitis (FK). The model performance was evaluated in terms of the accuracy, specificity, sensitivity and the area under the curve (AUC). 704 images from 352 patients were divided into training, validation and testing set. In the testing set, our model reached the best accuracy was 93%, sensitivity was 0.97(95% CI [0.84,1]), specificity was 0.92(95% CI [0.76,0.98]) and AUC was 0.94(95% CI [0.92,0.96]), exceeding the benchmark accuracy of 0.86. The diagnostic average accuracies of BK ranged from 81 to 92%, respectively and those for FK were 89-97%. It is the first study to focus on the influence of disease changes and medication interventions on infectious keratitis and our model outperformed the benchmark models and reaching the state-of-the-art performance.

Advances in artificial intelligence applications for ocular surface diseases diagnosis

In recent years, with the rapid development of computer technology, continual optimization of various learning algorithms and architectures, and establishment of numerous large databases, artificial intelligence (AI) has been unprecedentedly developed and applied in the field of ophthalmology. In the past, ophthalmological AI research mainly focused on posterior segment diseases, such as diabetic retinopathy, retinopathy of prematurity, age-related macular degeneration, retinal vein occlusion, and glaucoma optic neuropathy. Meanwhile, an increasing number of studies have employed AI to diagnose ocular surface diseases. In this review, we summarize the research progress of AI in the diagnosis of several ocular surface diseases, namely keratitis, keratoconus, dry eye, and pterygium. We discuss the limitations and challenges of AI in the diagnosis of ocular surface diseases, as well as prospects for the future.

Deep Learning Approach in Image Diagnosis of Pseudomonas Keratitis

This investigation aimed to explore deep learning (DL) models' potential for diagnosing Pseudomonas keratitis using external eye images. In the retrospective research, the images of bacterial keratitis (BK, n = 929), classified as Pseudomonas (n = 618) and non-Pseudomonas (n = 311) keratitis, were collected. Eight DL algorithms, including ResNet50, DenseNet121, ResNeXt50, SE-ResNet50, and EfficientNets B0 to B3, were adopted as backbone models to train and obtain the best ensemble 2-, 3-, 4-, and 5-DL models. Five-fold cross-validation was used to determine the ability of single and ensemble models to diagnose Pseudomonas keratitis. The EfficientNet B2 model had the highest accuracy (71.2%) of the eight single-DL models, while the best ensemble 4-DL model showed the highest accuracy (72.1%) among the ensemble models. However, no statistical difference was shown in the area under the receiver operating characteristic curve and diagnostic accuracy among these single-DL models and among the four best ensemble models. As a proof of concept, the DL approach, via external eye photos, could assist in identifying Pseudomonas keratitis from BK patients. All the best ensemble models can enhance the performance of constituent DL models in diagnosing Pseudomonas keratitis, but the enhancement effect appears to be limited.

Deep learning-based classification of infectious keratitis on slit-lamp images

BACKGROUND

Infectious keratitis (IK) is an ocular emergency caused by a variety of microorganisms, including bacteria, fungi, viruses, and parasites. Culture-based methods were the gold standard for diagnosing IK, but difficult biopsy, delaying report, and low positive rate limited their clinical application.

OBJECTIVES

This study aims to construct a deep-learning-based auxiliary diagnostic model for early IK diagnosis.

DESIGN

A retrospective study.

METHODS

IK patients with pathological diagnosis were enrolled and their slit-lamp photos were collected. Image augmentation, normalization, and histogram equalization were applied, and five image classification networks were implemented and compared. Model blending technique was used to combine the advantages of single model. The performance of combined model was validated by 10-fold cross-validation, receiver operating characteristic curves (ROC), confusion matrix, Gradient-wright class activation mapping (Grad-CAM) visualization, and t-distributed Stochastic Neighbor Embedding (t-SNE). Three experienced cornea specialists were invited and competed with the combined model on making clinical decisions.

RESULTS

Overall, 4830 slit-lamp images were collected from patients diagnosed with IK between June 2010 and May 2021, including 1490 (30.8%) bacterial keratitis (BK), 1670 (34.6%) fungal keratitis (FK), 600 (12.4%) herpes simplex keratitis (HSK), and 1070 (22.2%) Acanthamoeba keratitis (AK). KeratitisNet, the combination of ResNext101_32x16d and DenseNet169, reached the highest accuracy 77.08%. The accuracy of KeratitisNet for diagnosing BK, FK, AK, and HSK was 70.27%, 77.71%, 83.81%, and 79.31%, and AUC was 0.86, 0.91, 0.96, and 0.98, respectively. KeratitisNet was mainly confused in distinguishing BK and FK. There were 20% of BK cases mispredicted into FK and 16% of FK cases mispredicted into BK. In diagnosing each type of IK, the accuracy of model was significantly higher than that of human ophthalmologists (p < 0.001).

CONCLUSION

KeratitisNet demonstrates a good performance on clinical IK diagnosis and classification. Deep learning could provide an auxiliary diagnostic method to help clinicians suspect IK using different corneal manifestations.

An overview of artificial intelligence in diabetic retinopathy and other ocular diseases

Artificial intelligence (AI), also known as machine intelligence, is a branch of science that empowers machines using human intelligence. AI refers to the technology of rendering human intelligence through computer programs. From healthcare to the precise prevention, diagnosis, and management of diseases, AI is progressing rapidly in various interdisciplinary fields, including ophthalmology. Ophthalmology is at the forefront of AI in medicine because the diagnosis of ocular diseases heavy reliance on imaging. Recently, deep learning-based AI screening and prediction models have been applied to the most common visual impairment and blindness diseases, including glaucoma, cataract, age-related macular degeneration (ARMD), and diabetic retinopathy (DR). The success of AI in medicine is primarily attributed to the development of deep learning algorithms, which are computational models composed of multiple layers of simulated neurons. These models can learn the representations of data at multiple levels of abstraction. The Inception-v3 algorithm and transfer learning concept have been applied in DR and ARMD to reuse fundus image features learned from natural images (non-medical images) to train an AI system with a fraction of the commonly used training data (<1%). The trained AI system achieved performance comparable to that of human experts in classifying ARMD and diabetic macular edema on optical coherence tomography images. In this study, we highlight the fundamental concepts of AI and its application in these four major ocular diseases and further discuss the current challenges, as well as the prospects in ophthalmology.

Artificial intelligence and corneal diseases

PURPOSE OF REVIEW

Artificial intelligence has advanced rapidly in recent years and has provided powerful tools to aid with the diagnosis, management, and treatment of ophthalmic diseases. This article aims to review the most current clinical artificial intelligence applications in anterior segment diseases, with an emphasis on microbial keratitis, keratoconus, dry eye syndrome, and Fuchs endothelial dystrophy.

RECENT FINDINGS

Most current artificial intelligence approaches have focused on developing deep learning algorithms based on various imaging modalities. Algorithms have been developed to detect and differentiate microbial keratitis classes and quantify microbial keratitis features. Artificial intelligence may aid with early detection and staging of keratoconus. Many advances have been made to detect, segment, and quantify features of dry eye syndrome and Fuchs. There is significant variability in the reporting of methodology, patient population, and outcome metrics.

SUMMARY

Artificial intelligence shows great promise in detecting, diagnosing, grading, and measuring diseases. There is a need for standardization of reporting to improve the transparency, validity, and comparability of algorithms.

Therapy for contact lens-related ulcers

PURPOSE OF REVIEW

The current review covers the current literature and practice patterns of antimicrobial therapy for contact lens-related microbial keratitis (CLMK). Although the majority of corneal ulcers are bacterial, fungus and acanthamoeba are substantial contributors in CLMK and are harder to treat due to the lack of commercially available topical medications and low efficacy of available topical therapy.

RECENT FINDINGS

Topical antimicrobials remain the mainstay of therapy for corneal ulcers. Fluoroquinolones may be used as monotherapy for small, peripheral bacterial ulcers. Antibiotic resistance is a persistent problem. Fungal ulcers are less responsive to topical medications and adjunct oral or intrastromal antifungal medications may be helpful. Acanthamoeba keratitis continues to remain a therapeutic challenge but newer antifungal and antiparasitic agents may be helpful adjuncts. Other novel and innovative therapies are being studied currently and show promise.

SUMMARY

Contact lens-associated microbial keratitis is a significant health issue that can cause vision loss. Treatment remains a challenge but many promising diagnostics and procedures are in the pipeline and offer hope.

Infectious keratitis: A review

Globally, infectious keratitis is the fifth leading cause of blindness. The main predisposing factors include contact lens wear, ocular injury and ocular surface disease. Staphylococcus species, Pseudomonas aeruginosa, Fusarium species, Candida species and Acanthamoeba species are the most common causal organisms. Culture of corneal scrapes is the preferred initial test to identify the culprit organism. Polymerase chain reaction (PCR) tests and in vivo confocal microscopy can complement the diagnosis. Empiric therapy is typically commenced with fluoroquinolones, or fortified antibiotics for bacterial keratitis; topical natamycin for fungal keratitis; and polyhexamethylene biguanide or chlorhexidine for acanthamoeba keratitis. Herpes simplex keratitis is mainly diagnosed clinically; however, PCR can also be used to confirm the initial diagnosis and in atypical cases. Antivirals and topical corticosteroids are indicated depending on the corneal layer infected. Vision impairment, blindness and even loss of the eye can occur with a delay in diagnosis and inappropriate antimicrobial therapy.

Autoantibody Markers of Increased Risk of Malignancy in Patients with Dermatomyositis

Dermatomyositis is a chronic inflammatory disease involving the skin and muscles. It most commonly occurs in adults with preponderance in females, but pediatric occurrence is also possible. The risk of malignancy in adult patients with dermatomyositis was reported to be 4.66-fold higher compared to that in the general population. A significantly increased risk of malignancy was reported within the first 12 months following the diagnosis of dermatomyositis (standardized incidence ratio equaled 17). One of the characteristic laboratory findings associated with dermatomyositis is the presence of circulating autoantibodies which are classified into two subgroups: myositis-specific and myositis-associated autoantibodies. It was shown that specific types of antibodies might be associated with an increased risk of malignancy. Current literature data indicate that the strongest correlation with malignant diseases was reported in anti-TIF1-γ-positive patients who were at a 9.37-fold higher risk of cancer. A 3.68-fold increase in the risk of cancer was also reported among patients with anti-NXP2 antibodies. Malignant diseases were reported in 14-57% of patients with anti-SAE antibodies. The presence of other autoantibodies may also be associated with an increased risk of malignancy. These data indicate that patients with circulating anti-TIF1-γ, anti-NXP2, and anti-SAE should be very closely monitored for dermatomyositis-associated malignant comorbidities. The aim of this review is to summarize the current data regarding the link between malignancy and the presence of specific antibodies in patients with dermatomyositis.