Open-Source Automatic Segmentation of Ocular Structures and Biomarkers of Microbial Keratitis on Slit-Lamp Photography Images Using Deep Learning

The AI revolution in glaucoma: Bridging challenges with opportunities

Recent advancements in artificial intelligence (AI) herald transformative potentials for reshaping glaucoma clinical management, improving screening efficacy, sharpening diagnosis precision, and refining the detection of disease progression. However, incorporating AI into healthcare usages faces significant hurdles in terms of developing algorithms and putting them into practice. When creating algorithms, issues arise due to the intensive effort required to label data, inconsistent diagnostic standards, and a lack of thorough testing, which often limits the algorithms' widespread applicability. Additionally, the "black box" nature of AI algorithms may cause doctors to be wary or skeptical. When it comes to using these tools, challenges include dealing with lower-quality images in real situations and the systems' limited ability to work well with diverse ethnic groups and different diagnostic equipment. Looking ahead, new developments aim to protect data privacy through federated learning paradigms, improving algorithm generalizability by diversifying input data modalities, and augmenting datasets with synthetic imagery. The integration of smartphones appears promising for using AI algorithms in both clinical and non-clinical settings. Furthermore, bringing in large language models (LLMs) to act as interactive tool in medicine may signify a significant change in how healthcare will be delivered in the future. By navigating through these challenges and leveraging on these as opportunities, the field of glaucoma AI will not only have improved algorithmic accuracy and optimized data integration but also a paradigmatic shift towards enhanced clinical acceptance and a transformative improvement in glaucoma care.

Use of explainable AI on slit-lamp images of anterior surface of eyes to diagnose allergic conjunctival diseases

BACKGROUND

Artificial intelligence (AI) is a promising new technology that has the potential of diagnosing allergic conjunctival diseases (ACDs). However, its development is slowed by the absence of a tailored image database and explainable AI models. Thus, the purpose of this study was to develop an explainable AI model that can not only diagnose ACDs but also present the basis for the diagnosis.

METHODS

A dataset of 4942 slit-lamp images from 10 ophthalmological institutions across Japan were used as the image database. A sequential pipeline of segmentation AI was constructed to identify 12 clinical findings in 1038 images of seasonal and perennial allergic conjunctivitis (AC), atopic keratoconjunctivitis (AKC), vernal keratoconjunctivitis (VKC), giant papillary conjunctivitis (GPC), and normal subjects. The performance of the pipeline was evaluated by determining its ability to obtain explainable results through the extraction of the findings. Its diagnostic accuracy was determined for 4 severity-based diagnosis classification of AC, AKC/VKC, GPC, and normal.

RESULTS

Segmentation AI pipeline efficiently extracted crucial ACD indicators including conjunctival hyperemia, giant papillae, and shield ulcer, and offered interpretable insights. The AI pipeline diagnosis had a high diagnostic accuracy of 86.2%, and that of the board-certified ophthalmologists was 60.0%. The pipeline had a high classification performance, and the area under the curve (AUC) was 0.959 for AC, 0.905 for normal subjects, 0.847 for GPC, 0.829 for VKC, and 0.790 for AKC.

CONCLUSIONS

An explainable AI model created by a comprehensive image database can be used for diagnosing ACDs with high degree of accuracy.

Establishment of a corneal ulcer prognostic model based on machine learning

Corneal infection is a major public health concern worldwide and the most common cause of unilateral corneal blindness. Toxic effects of different microorganisms, such as bacteria and fungi, worsen keratitis leading to corneal perforation even with optimal drug treatment. The cornea forms the main refractive surface of the eye. Diseases affecting the cornea can cause severe visual impairment. Therefore, it is crucial to analyze the risk of corneal perforation and visual impairment in corneal ulcer patients for making early treatment strategies. The modeling of a fully automated prognostic model system was performed in two parts. In the first part, the dataset contained 4973 slit lamp images of corneal ulcer patients in three centers. A deep learning model was developed and tested for segmenting and classifying five lesions (corneal ulcer, corneal scar, hypopyon, corneal descementocele, and corneal neovascularization) in the eyes of corneal ulcer patients. Further, hierarchical quantification was carried out based on policy rules. In the second part, the dataset included clinical data (name, gender, age, best corrected visual acuity, and type of corneal ulcer) of 240 patients with corneal ulcers and respective 1010 slit lamp images under two light sources (natural light and cobalt blue light). The slit lamp images were then quantified hierarchically according to the policy rules developed in the first part of the modeling. Combining the above clinical data, the features were used to build the final prognostic model system for corneal ulcer perforation outcome and visual impairment using machine learning algorithms such as XGBoost, LightGBM. The ROC curve area (AUC value) evaluated the model's performance. For segmentation of the five lesions, the accuracy rates of hypopyon, descemetocele, corneal ulcer under blue light, and corneal neovascularization were 96.86, 91.64, 90.51, and 93.97, respectively. For the corneal scar lesion classification, the accuracy rate of the final model was 69.76. The XGBoost model performed the best in predicting the 1-month prognosis of patients, with an AUC of 0.81 (95% CI 0.63-1.00) for ulcer perforation and an AUC of 0.77 (95% CI 0.63-0.91) for visual impairment. In predicting the 3-month prognosis of patients, the XGBoost model received the best AUC of 0.97 (95% CI 0.92-1.00) for ulcer perforation, while the LightGBM model achieved the best performance with an AUC of 0.98 (95% CI 0.94-1.00) for visual impairment.

Factors Associated With Laboratory Test Negativity Following a Transition in Specimen Collection in Microbial Keratitis Cases

PURPOSE

Negative laboratory results make targeting microbial keratitis treatment difficult. We investigated factors associated with laboratory negativity in patients with microbial keratitis in the context of a transition to a new specimen collection method.

METHODS

Microbial keratitis patients with associated laboratory tests were identified in the electronic health record of a tertiary care facility from August 2012 to April 2022. Patient demographics and laboratory results were obtained. Random sampling of 50% of charts was performed to assess the impact of the ocular history and pretreatment measures. The relationship between probability of negative laboratory results with demographics, ocular history, pretreatment measures, and utilization of a new specimen collection method (i.e. ESwab) was evaluated by multivariable logistic regression.

RESULTS

Of 3395 microbial keratitis patients identified, 31% (n = 1051) had laboratory tests. Laboratory testing increased over time (slope = 2.5% per year, p < 0.001; 19.6% in 2013 to 42.2% in 2021). Laboratory negative rate increased over time (slope = 2.2% per year, p = 0.022; 48.5% in 2013 to 62.3% in 2021). Almost one-third of patients (31.2%, n = 164) were pretreated with steroids. Over two-thirds of patients were pretreated with antibiotics (69.5%, n = 367). 56.5% (n = 297) of patients were outside referrals. In multivariable regression, patients with corticosteroid pretreatment had lower odds of negative laboratory results (odds ratio [OR] = 0.49, p = 0.001). There were higher odds of negative laboratory results for every additional antibiotic prescribed to a patient prior to presentation (OR = 1.30, p = 0.006) and for specimens collected using ESwabs (OR = 1.69, p = 0.005). Age, prior eye trauma, outside referrals, and contact lens wear were not significantly associated with negative laboratory results.

CONCLUSION

More microbial keratitis associated laboratory tests are being taken over time. Over 60% of tests were negative by 2022. Factors associated with negative laboratory test results included pretreatment with antibiotics and specimens collected with the new collection method.

Artificial Intelligence and Infectious Keratitis: Where Are We Now?

Infectious keratitis (IK), which is one of the most common and catastrophic ophthalmic emergencies, accounts for the leading cause of corneal blindness worldwide. Different pathogens, including bacteria, viruses, fungi, and parasites, can cause IK. The diagnosis and etiology detection of IK pose specific challenges, and delayed or incorrect diagnosis can significantly worsen the outcome. Currently, this process is mainly performed based on slit-lamp findings, corneal smear and culture, tissue biopsy, PCR, and confocal microscopy. However, these diagnostic methods have their drawbacks, including experience dependency, tissue damage, cost, and time consumption. Diagnosis and etiology detection of IK can be especially challenging in rural areas or in countries with limited resources. In recent years, artificial intelligence (AI) has opened new windows in medical fields such as ophthalmology. An increasing number of studies have utilized AI in the diagnosis of anterior segment diseases such as IK. Several studies have demonstrated that AI algorithms can diagnose and detect the etiology of IK accurately and fast, which can be valuable, especially in remote areas and in countries with limited resources. Herein, we provided a comprehensive update on the utility of AI in IK.

Guidelines for the application of artificial intelligence in the diagnosis of anterior segment diseases (2023)

The landscape of ophthalmology has observed monumental shifts with the advent of artificial intelligence (AI) technologies. This article is devoted to elaborating on the nuanced application of AI in the diagnostic realm of anterior segment eye diseases, an area ripe with potential yet complex in its imaging characteristics. Historically, AI's entrenchment in ophthalmology was predominantly rooted in the posterior segment. However, the evolution of machine learning paradigms, particularly with the advent of deep learning methodologies, has reframed the focus. When combined with the exponential surge in available electronic image data pertaining to the anterior segment, AI's role in diagnosing corneal, conjunctival, lens, and eyelid pathologies has been solidified and has emerged from the realm of theoretical to practical. In light of this transformative potential, collaborations between the Ophthalmic Imaging and Intelligent Medicine Subcommittee of the China Medical Education Association and the Ophthalmology Committee of the International Translational Medicine Association have been instrumental. These eminent bodies mobilized a consortium of experts to dissect and assimilate advancements from both national and international quarters. Their mandate was not limited to AI's application in anterior segment pathologies like the cornea, conjunctiva, lens, and eyelids, but also ventured into deciphering the existing impediments and envisioning future trajectories. After iterative deliberations, the consensus synthesized herein serves as a touchstone, assisting ophthalmologists in optimally integrating AI into their diagnostic decisions and bolstering clinical research. Through this guideline, we aspire to offer a comprehensive framework, ensuring that clinical decisions are not merely informed but transformed by AI. By building upon existing literature yet maintaining the highest standards of originality, this document stands as a testament to both innovation and academic integrity, in line with the ethos of renowned journals such as Ophthalmology.

Artificial Intelligence for Anterior Segment Diseases: A Review of Potential Developments and Clinical Applications

Artificial intelligence (AI) technology is promising in the field of healthcare. With the developments of big data and image-based analysis, AI shows potential value in ophthalmology applications. Recently, machine learning and deep learning algorithms have made significant progress. Emerging evidence has demonstrated the capability of AI in the diagnosis and management of anterior segment diseases. In this review, we provide an overview of AI applications and potential future applications in anterior segment diseases, focusing on cornea, refractive surgery, cataract, anterior chamber angle detection, and refractive error prediction.

Artificial intelligence-assisted diagnosis of ocular surface diseases

With the rapid development of computer technology, the application of artificial intelligence (AI) in ophthalmology research has gained prominence in modern medicine. Artificial intelligence-related research in ophthalmology previously focused on the screening and diagnosis of fundus diseases, particularly diabetic retinopathy, age-related macular degeneration, and glaucoma. Since fundus images are relatively fixed, their standards are easy to unify. Artificial intelligence research related to ocular surface diseases has also increased. The main issue with research on ocular surface diseases is that the images involved are complex, with many modalities. Therefore, this review aims to summarize current artificial intelligence research and technologies used to diagnose ocular surface diseases such as pterygium, keratoconus, infectious keratitis, and dry eye to identify mature artificial intelligence models that are suitable for research of ocular surface diseases and potential algorithms that may be used in the future.

The Need for Artificial Intelligence Based Risk Factor Analysis for Age-Related Macular Degeneration: A Review

In epidemiology, a risk factor is a variable associated with increased disease risk. Understanding the role of risk factors is significant for developing a strategy to improve global health. There is strong evidence that risk factors like smoking, alcohol consumption, previous cataract surgery, age, high-density lipoprotein (HDL) cholesterol, BMI, female gender, and focal hyper-pigmentation are independently associated with age-related macular degeneration (AMD). Currently, in the literature, statistical techniques like logistic regression, multivariable logistic regression, etc., are being used to identify AMD risk factors by employing numerical/categorical data. However, artificial intelligence (AI) techniques have not been used so far in the literature for identifying risk factors for AMD. On the other hand, artificial intelligence (AI) based tools can anticipate when a person is at risk of developing chronic diseases like cancer, dementia, asthma, etc., in providing personalized care. AI-based techniques can employ numerical/categorical and/or image data thus resulting in multimodal data analysis, which provides the need for AI-based tools to be used for risk factor analysis in ophthalmology. This review summarizes the statistical techniques used to identify various risk factors and the higher benefits that AI techniques provide for AMD-related disease prediction. Additional studies are required to review different techniques for risk factor identification for other ophthalmic diseases like glaucoma, diabetic macular edema, retinopathy of prematurity, cataract, and diabetic retinopathy.

Automated Detection of Corneal Ulcer Using Combination Image Processing and Deep Learning

A corneal ulcers are one of the most common eye diseases. They come from various infections, such as bacteria, viruses, or parasites. They may lead to ocular morbidity and visual disability. Therefore, early detection can reduce the probability of reaching the visually impaired. One of the most common techniques exploited for corneal ulcer screening is slit-lamp images. This paper proposes two highly accurate automated systems to localize the corneal ulcer region. The designed approaches are image processing techniques with Hough transform and deep learning approaches. The two methods are validated and tested on the publicly available SUSTech-SYSU database. The accuracy is evaluated and compared between both systems. Both systems achieve an accuracy of more than 90%. However, the deep learning approach is more accurate than the traditional image processing techniques. It reaches 98.9% accuracy and Dice similarity 99.3%. However, the first method does not require parameters to optimize an explicit training model. The two approaches can perform well in the medical field. Moreover, the first model has more leverage than the deep learning model because the last one needs a large training dataset to build reliable software in clinics. Both proposed methods help physicians in corneal ulcer level assessment and improve treatment efficiency.

Artificial intelligence and corneal diseases

PURPOSE OF REVIEW

Artificial intelligence has advanced rapidly in recent years and has provided powerful tools to aid with the diagnosis, management, and treatment of ophthalmic diseases. This article aims to review the most current clinical artificial intelligence applications in anterior segment diseases, with an emphasis on microbial keratitis, keratoconus, dry eye syndrome, and Fuchs endothelial dystrophy.

RECENT FINDINGS

Most current artificial intelligence approaches have focused on developing deep learning algorithms based on various imaging modalities. Algorithms have been developed to detect and differentiate microbial keratitis classes and quantify microbial keratitis features. Artificial intelligence may aid with early detection and staging of keratoconus. Many advances have been made to detect, segment, and quantify features of dry eye syndrome and Fuchs. There is significant variability in the reporting of methodology, patient population, and outcome metrics.

SUMMARY

Artificial intelligence shows great promise in detecting, diagnosing, grading, and measuring diseases. There is a need for standardization of reporting to improve the transparency, validity, and comparability of algorithms.

Multi-Scale Convolutional Neural Network for Accurate Corneal Segmentation in Early Detection of Fungal Keratitis

Microbial keratitis is an infection of the cornea of the eye that is commonly caused by prolonged contact lens wear, corneal trauma, pre-existing systemic disorders and other ocular surface disorders. It can result in severe visual impairment if improperly managed. According to the latest World Vision Report, at least 4.2 million people worldwide suffer from corneal opacities caused by infectious agents such as fungi, bacteria, protozoa and viruses. In patients with fungal keratitis (FK), often overt symptoms are not evident, until an advanced stage. Furthermore, it has been reported that clear discrimination between bacterial keratitis and FK is a challenging process even for trained corneal experts and is often misdiagnosed in more than 30% of the cases. However, if diagnosed early, vision impairment can be prevented through early cost-effective interventions. In this work, we propose a multi-scale convolutional neural network (MS-CNN) for accurate segmentation of the corneal region to enable early FK diagnosis. The proposed approach consists of a deep neural pipeline for corneal region segmentation followed by a ResNeXt model to differentiate between FK and non-FK classes. The model trained on the segmented images in the region of interest, achieved a diagnostic accuracy of 88.96%. The features learnt by the model emphasize that it can correctly identify dominant corneal lesions for detecting FK.

Open-Source Automatic Biomarker Measurement on Slit-Lamp Photography to Estimate Visual Acuity in Microbial Keratitis

Purpose

To assess clinical applicability of automatic image analysis in microbial keratitis (MK) by evaluating the relationship between biomarker measurements on slit-lamp photography (SLP) and best-corrected visual acuity (BCVA).

Methods

Seventy-six patients with MK with SLP images and same-day logarithm of the minimum angle of resolution (logMAR) BCVA were evaluated. MK biomarkers (stromal infiltrate, white blood cell infiltration, corneal edema, hypopyon, epithelial defect) were segmented manually by ophthalmologists and automatically by a novel, open-source, deep learning–based segmentation algorithm. Five measurements (presence, maximum width, total area, proportion of the corneal limbus area affected, centrality) were calculated. Correlations between the measurements and BCVA were calculated. An automatic regression model estimated BCVA from the measurements. Differences in performance between using manual and automatic measurements were evaluated using William's test (for correlation) and the paired-sample t-test (for absolute error).

Results

Measurements had high correlations of 0.86 (manual) and 0.84 (automatic) with true BCVA. Estimated BCVA had average (mean ± SD) absolute errors of 0.39 ± 0.27 logMAR (manual, median: 0.30) and 0.35 ± 0.28 logMAR (automatic, median: 0.30) and high correlations of 0.76 (manual) and 0.80 (automatic) with true BCVA. Differences between using manual and automatic measurements were not statistically significant for correlations of measurements with true BCVA (P = .66), absolute errors of estimated BCVA (P = .15), or correlations of estimated BCVA with true BCVA (P = .60).

Conclusions

The proposed algorithm measured MK biomarkers as accurately as ophthalmologists. Measurements were highly correlated with and estimative of visual acuity.

Translational Relevance

This study demonstrates the potential of developing fully automatic objective and standardized strategies to aid ophthalmologists in the clinical assessment of MK.

Preventing corneal blindness caused by keratitis using artificial intelligence

Keratitis is the main cause of corneal blindness worldwide. Most vision loss caused by keratitis can be avoidable via early detection and treatment. The diagnosis of keratitis often requires skilled ophthalmologists. However, the world is short of ophthalmologists, especially in resource-limited settings, making the early diagnosis of keratitis challenging. Here, we develop a deep learning system for the automated classification of keratitis, other cornea abnormalities, and normal cornea based on 6,567 slit-lamp images. Our system exhibits remarkable performance in cornea images captured by the different types of digital slit lamp cameras and a smartphone with the super macro mode (all AUCs>0.96). The comparable sensitivity and specificity in keratitis detection are observed between the system and experienced cornea specialists. Our system has the potential to be applied to both digital slit lamp cameras and smartphones to promote the early diagnosis and treatment of keratitis, preventing the corneal blindness caused by keratitis.