Deep learning-based automated diagnosis of fungal keratitis with in vivo confocal microscopy images

Overview of Mycotic Keratitis

ABSTRACT

Keratomycosis is a serious corneal infection associated with high ocular morbidity that can lead to severe vision loss. It is estimated to affect more than 1 million patients annually, most commonly occurring in tropical climates, and represents a growing threat to patients worldwide. Despite aggressive medical management, fungal infections have a higher rate of perforation requiring surgical intervention compared with other infectious etiologies. Early diagnosis and appropriate treatment are keys to preserving vision and saving patients' eyes.Timely diagnosis of fungal keratitis helps minimize corneal damage and scarring and increases the likelihood of a favorable outcome. Studies have shown that correct identification of fungal infections is often delayed up to 2 to 3 weeks after initial presentation. This leads to incorrect or ineffective treatment for many patients. Diagnostic techniques explored in this study include corneal scrapings with staining and culture, visualization with in vivo confocal microscopy, molecular diagnostic techniques including polymerase chain reaction, and recently developed omics-based technologies.Treatment of fungal keratitis begins with topical antifungals. Medical management has been proven to be effective, but with limitations including poor drug penetration and low bioavailability. Cases that do not respond to topical therapy require more invasive and novel treatments to control the infection. We review the clinical trials that have shaped current practice patterns, with focus on the efficacy of topical natamycin as the primary therapy for filamentous fungal keratitis. We explore additional management strategies such as localized intrastromal and intracameral injections of antifungal medications, photodynamic therapy, and surgical intervention.

Two-stage deep neural network for diagnosing fungal keratitis via in vivo confocal microscopy images

Timely and effective diagnosis of fungal keratitis (FK) is necessary for suitable treatment and avoiding irreversible vision loss for patients. In vivo confocal microscopy (IVCM) has been widely adopted to guide the FK diagnosis. We present a deep learning framework for diagnosing fungal keratitis using IVCM images to assist ophthalmologists. Inspired by the real diagnostic process, our method employs a two-stage deep architecture for diagnostic predictions based on both image-level and sequence-level information. To the best of our knowledge, we collected the largest dataset with 96,632 IVCM images in total with expert labeling to train and evaluate our method. The specificity and sensitivity of our method in diagnosing FK on the unseen test set achieved 96.65% and 97.57%, comparable or better than experienced ophthalmologists. The network can provide image-level, sequence-level and patient-level diagnostic suggestions to physicians. The results show great promise for assisting ophthalmologists in FK diagnosis.

Role of artificial intelligence, machine learning and deep learning models in corneal disorders - A narrative review

In the last decade, artificial intelligence (AI) has significantly impacted ophthalmology, particularly in managing corneal diseases, a major reversible cause of blindness. This review explores AI's transformative role in the corneal subspecialty, which has adopted advanced technology for superior clinical judgment, early diagnosis, and personalized therapy. While AI's role in anterior segment diseases is less documented compared to glaucoma and retinal pathologies, this review highlights its integration into corneal diagnostics through imaging techniques like slit-lamp biomicroscopy, anterior segment optical coherence tomography (AS-OCT), and in vivo confocal biomicroscopy. AI has been pivotal in refining decision-making and prognosis for conditions such as keratoconus, infectious keratitis, and dystrophies. Multi-disease deep learning neural networks (MDDNs) have shown diagnostic ability in classifying corneal diseases using AS-OCT images, achieving notable metrics like an AUC of 0.910. AI's progress over two decades has significantly improved the accuracy of diagnosing conditions like keratoconus and microbial keratitis. For instance, AI has achieved a 90.7% accuracy rate in classifying bacterial and fungal keratitis and an AUC of 0.910 in differentiating various corneal diseases. Convolutional neural networks (CNNs) have enhanced the analysis of color-coded corneal maps, yielding up to 99.3% diagnostic accuracy for keratoconus. Deep learning algorithms have also shown robust performance in detecting fungal hyphae on in vivo confocal microscopy, with precise quantification of hyphal density. AI models combining tomography scans and visual acuity have demonstrated up to 97% accuracy in keratoconus staging according to the Amsler-Krumeich classification. However, the review acknowledges the limitations of current AI models, including their reliance on binary classification, which may not capture the complexity of real-world clinical presentations with multiple coexisting disorders. Challenges also include dependency on data quality, diverse imaging protocols, and integrating multimodal images for a generalized AI diagnosis. The need for interpretability in AI models is emphasized to foster trust and applicability in clinical settings. Looking ahead, AI has the potential to unravel the intricate mechanisms behind corneal pathologies, reduce healthcare's carbon footprint, and revolutionize diagnostic and management paradigms. Ethical and regulatory considerations will accompany AI's clinical adoption, marking an era where AI not only assists but augments ophthalmic care.

Establishment of a corneal ulcer prognostic model based on machine learning

Corneal infection is a major public health concern worldwide and the most common cause of unilateral corneal blindness. Toxic effects of different microorganisms, such as bacteria and fungi, worsen keratitis leading to corneal perforation even with optimal drug treatment. The cornea forms the main refractive surface of the eye. Diseases affecting the cornea can cause severe visual impairment. Therefore, it is crucial to analyze the risk of corneal perforation and visual impairment in corneal ulcer patients for making early treatment strategies. The modeling of a fully automated prognostic model system was performed in two parts. In the first part, the dataset contained 4973 slit lamp images of corneal ulcer patients in three centers. A deep learning model was developed and tested for segmenting and classifying five lesions (corneal ulcer, corneal scar, hypopyon, corneal descementocele, and corneal neovascularization) in the eyes of corneal ulcer patients. Further, hierarchical quantification was carried out based on policy rules. In the second part, the dataset included clinical data (name, gender, age, best corrected visual acuity, and type of corneal ulcer) of 240 patients with corneal ulcers and respective 1010 slit lamp images under two light sources (natural light and cobalt blue light). The slit lamp images were then quantified hierarchically according to the policy rules developed in the first part of the modeling. Combining the above clinical data, the features were used to build the final prognostic model system for corneal ulcer perforation outcome and visual impairment using machine learning algorithms such as XGBoost, LightGBM. The ROC curve area (AUC value) evaluated the model's performance. For segmentation of the five lesions, the accuracy rates of hypopyon, descemetocele, corneal ulcer under blue light, and corneal neovascularization were 96.86, 91.64, 90.51, and 93.97, respectively. For the corneal scar lesion classification, the accuracy rate of the final model was 69.76. The XGBoost model performed the best in predicting the 1-month prognosis of patients, with an AUC of 0.81 (95% CI 0.63-1.00) for ulcer perforation and an AUC of 0.77 (95% CI 0.63-0.91) for visual impairment. In predicting the 3-month prognosis of patients, the XGBoost model received the best AUC of 0.97 (95% CI 0.92-1.00) for ulcer perforation, while the LightGBM model achieved the best performance with an AUC of 0.98 (95% CI 0.94-1.00) for visual impairment.

Artificial-Intelligence-Enhanced Analysis of In Vivo Confocal Microscopy in Corneal Diseases: A Review

Artificial intelligence (AI) has seen significant progress in medical diagnostics, particularly in image and video analysis. This review focuses on the application of AI in analyzing in vivo confocal microscopy (IVCM) images for corneal diseases. The cornea, as an exposed and delicate part of the body, necessitates the precise diagnoses of various conditions. Convolutional neural networks (CNNs), a key component of deep learning, are a powerful tool for image data analysis. This review highlights AI applications in diagnosing keratitis, dry eye disease, and diabetic corneal neuropathy. It discusses the potential of AI in detecting infectious agents, analyzing corneal nerve morphology, and identifying the subtle changes in nerve fiber characteristics in diabetic corneal neuropathy. However, challenges still remain, including limited datasets, overfitting, low-quality images, and unrepresentative training datasets. This review explores augmentation techniques and the importance of feature engineering to address these challenges. Despite the progress made, challenges are still present, such as the "black-box" nature of AI models and the need for explainable AI (XAI). Expanding datasets, fostering collaborative efforts, and developing user-friendly AI tools are crucial for enhancing the acceptance and integration of AI into clinical practice.

Potential applications of artificial intelligence in image analysis in cornea diseases: a review

Artificial intelligence (AI) is an emerging field which could make an intelligent healthcare model a reality and has been garnering traction in the field of medicine, with promising results. There have been recent developments in machine learning and/or deep learning algorithms for applications in ophthalmology-primarily for diabetic retinopathy, and age-related macular degeneration. However, AI research in the field of cornea diseases is relatively new. Algorithms have been described to assist clinicians in diagnosis or detection of cornea conditions such as keratoconus, infectious keratitis and dry eye disease. AI may also be used for segmentation and analysis of cornea imaging or tomography as an adjunctive tool. Despite the potential advantages that these new technologies offer, there are challenges that need to be addressed before they can be integrated into clinical practice. In this review, we aim to summarize current literature and provide an update regarding recent advances in AI technologies pertaining to corneal diseases, and its potential future application, in particular pertaining to image analysis.

Updates in Diagnostic Imaging for Infectious Keratitis: A Review

Infectious keratitis (IK) is among the top five leading causes of blindness globally. Early diagnosis is needed to guide appropriate therapy to avoid complications such as vision impairment and blindness. Slit lamp microscopy and culture of corneal scrapes are key to diagnosing IK. Slit lamp photography was transformed when digital cameras and smartphones were invented. The digital camera or smartphone camera sensor's resolution, the resolution of the slit lamp and the focal length of the smartphone camera system are key to a high-quality slit lamp image. Alternative diagnostic tools include imaging, such as optical coherence tomography (OCT) and in vivo confocal microscopy (IVCM). OCT's advantage is its ability to accurately determine the depth and extent of the corneal ulceration, infiltrates and haze, therefore characterizing the severity and progression of the infection. However, OCT is not a preferred choice in the diagnostic tool package for infectious keratitis. Rather, IVCM is a great aid in the diagnosis of fungal and Acanthamoeba keratitis with overall sensitivities of 66-74% and 80-100% and specificity of 78-100% and 84-100%, respectively. Recently, deep learning (DL) models have been shown to be promising aids for the diagnosis of IK via image recognition. Most of the studies that have developed DL models to diagnose the different types of IK have utilised slit lamp photographs. Some studies have used extremely efficient single convolutional neural network algorithms to train their models, and others used ensemble approaches with variable results. Limitations of DL models include the need for large image datasets to train the models, the difficulty in finding special features of the different types of IK, the imbalance of training models, the lack of image protocols and misclassification bias, which need to be overcome to apply these models into real-world settings. Newer artificial intelligence technology that generates synthetic data, such as generative adversarial networks, may assist in overcoming some of these limitations of CNN models.

Artificial Intelligence and Infectious Keratitis: Where Are We Now?

Infectious keratitis (IK), which is one of the most common and catastrophic ophthalmic emergencies, accounts for the leading cause of corneal blindness worldwide. Different pathogens, including bacteria, viruses, fungi, and parasites, can cause IK. The diagnosis and etiology detection of IK pose specific challenges, and delayed or incorrect diagnosis can significantly worsen the outcome. Currently, this process is mainly performed based on slit-lamp findings, corneal smear and culture, tissue biopsy, PCR, and confocal microscopy. However, these diagnostic methods have their drawbacks, including experience dependency, tissue damage, cost, and time consumption. Diagnosis and etiology detection of IK can be especially challenging in rural areas or in countries with limited resources. In recent years, artificial intelligence (AI) has opened new windows in medical fields such as ophthalmology. An increasing number of studies have utilized AI in the diagnosis of anterior segment diseases such as IK. Several studies have demonstrated that AI algorithms can diagnose and detect the etiology of IK accurately and fast, which can be valuable, especially in remote areas and in countries with limited resources. Herein, we provided a comprehensive update on the utility of AI in IK.

Latent diffusion augmentation enhances deep learning analysis of neuro-morphology in limbal stem cell deficiency

Introduction

Limbal Stem Cell Deficiency (LSCD) is a blinding corneal disease characterized by the loss of function or deficiency in adult stem cells located at the junction between the cornea and the sclera (i.e., the limbus), namely the limbal stem cells (LSCs). Recent advances in in vivo imaging technology have improved disease diagnosis and staging to quantify several biomarkers of in vivo LSC function including epithelial thickness measured by anterior segment optical coherence tomography, and basal epithelial cell density and subbasal nerve plexus by in vivo confocal microscopy. A decrease in central corneal sub-basal nerve density and nerve fiber and branching number has been shown to correlate with the severity of the disease in parallel with increased nerve tortuosity. Yet, image acquisition and manual quantification require a high level of expertise and are time-consuming. Manual quantification presents inevitable interobserver variability.

Methods

The current study employs a novel deep learning approach to classify neuron morphology in various LSCD stages and healthy controls, by integrating images created through latent diffusion augmentation. The proposed model, a residual U-Net, is based in part on the InceptionResNetV2 transfer learning model.

Results

Deep learning was able to determine fiber number, branching, and fiber length with high accuracy (R2 of 0.63, 0.63, and 0.80, respectively). The model trained on images generated through latent diffusion on average outperformed the same model when trained on solely original images. The model was also able to detect LSCD with an AUC of 0.867, which showed slightly higher performance compared to classification using manually assessed metrics.

Discussion

The results suggest that utilizing latent diffusion to supplement training data may be effective in bolstering model performance. The results of the model emphasize the ability as well as the shortcomings of this novel deep learning approach to predict various nerve morphology metrics as well as LSCD disease severity.

Diagnosis of Acanthamoeba Keratitis: Past, Present and Future

Acanthamoeba keratitis (AK) is a painful and sight-threatening parasitic corneal infection. In recent years, the incidence of AK has increased. Timely and accurate diagnosis is crucial during the management of AK, as delayed diagnosis often results in poor clinical outcomes. Currently, AK diagnosis is primarily achieved through a combination of clinical suspicion, microbiological investigations and corneal imaging. Historically, corneal scraping for microbiological culture has been considered to be the gold standard. Despite its technical ease, accessibility and cost-effectiveness, the long diagnostic turnaround time and variably low sensitivity of microbiological culture limit its use as a sole diagnostic test for AK in clinical practice. In this review, we aim to provide a comprehensive overview of the diagnostic modalities that are currently used to diagnose AK, including microscopy with staining, culture, corneal biopsy, in vivo confocal microscopy, polymerase chain reaction and anterior segment optical coherence tomography. We also highlight emerging techniques, such as next-generation sequencing and artificial intelligence-assisted models, which have the potential to transform the diagnostic landscape of AK.

Artificial intelligence in ophthalmology: The path to the real-world clinic

Artificial intelligence (AI) has great potential to transform healthcare by enhancing the workflow and productivity of clinicians, enabling existing staff to serve more patients, improving patient outcomes, and reducing health disparities. In the field of ophthalmology, AI systems have shown performance comparable with or even better than experienced ophthalmologists in tasks such as diabetic retinopathy detection and grading. However, despite these quite good results, very few AI systems have been deployed in real-world clinical settings, challenging the true value of these systems. This review provides an overview of the current main AI applications in ophthalmology, describes the challenges that need to be overcome prior to clinical implementation of the AI systems, and discusses the strategies that may pave the way to the clinical translation of these systems.

Diagnosis of invasive fungal infections: challenges and recent developments

BACKGROUND

The global burden of invasive fungal infections (IFIs) has shown an upsurge in recent years due to the higher load of immunocompromised patients suffering from various diseases. The role of early and accurate diagnosis in the aggressive containment of the fungal infection at the initial stages becomes crucial thus, preventing the development of a life-threatening situation. With the changing demands of clinical mycology, the field of fungal diagnostics has evolved and come a long way from traditional methods of microscopy and culturing to more advanced non-culture-based tools. With the advent of more powerful approaches such as novel PCR assays, T2 Candida, microfluidic chip technology, next generation sequencing, new generation biosensors, nanotechnology-based tools, artificial intelligence-based models, the face of fungal diagnostics is constantly changing for the better. All these advances have been reviewed here giving the latest update to our readers in the most orderly flow.

MAIN TEXT

A detailed literature survey was conducted by the team followed by data collection, pertinent data extraction, in-depth analysis, and composing the various sub-sections and the final review. The review is unique in its kind as it discusses the advances in molecular methods; advances in serology-based methods; advances in biosensor technology; and advances in machine learning-based models, all under one roof. To the best of our knowledge, there has been no review covering all of these fields (especially biosensor technology and machine learning using artificial intelligence) with relevance to invasive fungal infections.

CONCLUSION

The review will undoubtedly assist in updating the scientific community's understanding of the most recent advancements that are on the horizon and that may be implemented as adjuncts to the traditional diagnostic algorithms.

Interpretable deep learning for diagnosis of fungal and acanthamoeba keratitis using in vivo confocal microscopy images

Infectious keratitis refers to a group of corneal disorders in which corneal tissues suffer inflammation and damage caused by pathogenic infections. Among these disorders, fungal keratitis (FK) and acanthamoeba keratitis (AK) are particularly severe and can cause permanent blindness if not diagnosed early and accurately. In Vivo Confocal Microscopy (IVCM) allows for imaging of different corneal layers and provides an important tool for an early and accurate diagnosis. In this paper, we introduce the IVCM-Keratitis dataset, which comprises of a total of 4001 sample images of AK and FK, as well as non-specific keratitis (NSK) and healthy corneas classes. We use this dataset to develop multiple deep-learning models based on Convolutional Neural Networks (CNNs) to provide automated assistance in enhancing the diagnostic accuracy of confocal microscopy in infectious keratitis. Densenet161 had the best performance among these models, with an accuracy, precision, recall, and F1 score of 93.55%, 92.52%, 94.77%, and 96.93%, respectively. Our study highlights the potential of deep learning models to provide automated diagnostic assistance for infectious keratitis via confocal microscopy images, particularly in the early detection of AK and FK. The proposed model can provide valuable support to both experienced and inexperienced eye-care practitioners in confocal microscopy image analysis, by suggesting the most likely diagnosis. We further demonstrate that these models can highlight the areas of infection in the IVCM images and explain the reasons behind their diagnosis by utilizing saliency maps, a technique used in eXplainable Artificial Intelligence (XAI) to interpret these models.

Segmentation and Classification Approaches of Clinically Relevant Curvilinear Structures: A Review

Detection of curvilinear structures from microscopic images, which help the clinicians to make an unambiguous diagnosis is assuming paramount importance in recent clinical practice. Appearance and size of dermatophytic hyphae, keratitic fungi, corneal and retinal vessels vary widely making their automated detection cumbersome. Automated deep learning methods, endowed with superior self-learning capacity, have superseded the traditional machine learning methods, especially in complex images with challenging background. Automatic feature learning ability using large input data with better generalization and recognition capability, but devoid of human interference and excessive pre-processing, is highly beneficial in the above context. Varied attempts have been made by researchers to overcome challenges such as thin vessels, bifurcations and obstructive lesions in retinal vessel detection as revealed through several publications reviewed here. Revelations of diabetic neuropathic complications such as tortuosity, changes in the density and angles of the corneal fibers have been successfully sorted in many publications reviewed here. Since artifacts complicate the images and affect the quality of analysis, methods addressing these challenges have been described. Traditional and deep learning methods, that have been adapted and published between 2015 and 2021 covering retinal vessels, corneal nerves and filamentous fungi have been summarized in this review. We find several novel and meritorious ideas and techniques being put to use in the case of retinal vessel segmentation and classification, which by way of cross-domain adaptation can be utilized in the case of corneal and filamentous fungi also, making suitable adaptations to the challenges to be addressed.

Artificial Intelligence for Anterior Segment Diseases: A Review of Potential Developments and Clinical Applications

Artificial intelligence (AI) technology is promising in the field of healthcare. With the developments of big data and image-based analysis, AI shows potential value in ophthalmology applications. Recently, machine learning and deep learning algorithms have made significant progress. Emerging evidence has demonstrated the capability of AI in the diagnosis and management of anterior segment diseases. In this review, we provide an overview of AI applications and potential future applications in anterior segment diseases, focusing on cornea, refractive surgery, cataract, anterior chamber angle detection, and refractive error prediction.

Big data in corneal diseases and cataract: Current applications and future directions

The accelerated growth in electronic health records (EHR), Internet-of-Things, mHealth, telemedicine, and artificial intelligence (AI) in the recent years have significantly fuelled the interest and development in big data research. Big data refer to complex datasets that are characterized by the attributes of "5 Vs"-variety, volume, velocity, veracity, and value. Big data analytics research has so far benefitted many fields of medicine, including ophthalmology. The availability of these big data not only allow for comprehensive and timely examinations of the epidemiology, trends, characteristics, outcomes, and prognostic factors of many diseases, but also enable the development of highly accurate AI algorithms in diagnosing a wide range of medical diseases as well as discovering new patterns or associations of diseases that are previously unknown to clinicians and researchers. Within the field of ophthalmology, there is a rapidly expanding pool of large clinical registries, epidemiological studies, omics studies, and biobanks through which big data can be accessed. National corneal transplant registries, genome-wide association studies, national cataract databases, and large ophthalmology-related EHR-based registries (e.g., AAO IRIS Registry) are some of the key resources. In this review, we aim to provide a succinct overview of the availability and clinical applicability of big data in ophthalmology, particularly from the perspective of corneal diseases and cataract, the synergistic potential of big data, AI technologies, internet of things, mHealth, and wearable smart devices, and the potential barriers for realizing the clinical and research potential of big data in this field.

An artificial intelligence approach to classify pathogenic fungal genera of fungal keratitis using corneal confocal microscopy images

PURPOSE

Fungal keratitis is a common cause of blindness worldwide. Timely identification of the causative fungal genera is essential for clinical management. In vivo confocal microscopy (IVCM) provides useful information on pathogenic genera. This study attempted to apply deep learning (DL) to establish an automated method to identify pathogenic fungal genera using IVCM images.

METHODS

Deep learning networks were trained, validated, and tested using a data set of 3364 IVCM images that collected from 100 eyes of 100 patients with culture-proven filamentous fungal keratitis. Two transfer learning approaches were investigated: one was a combined framework that extracted features by a DL network and adopted decision tree (DT) as a classifier; another was a complete supervised DL model which used DL-based fully connected layers to implement the classification.

RESULTS

The DL classifier model revealed better performance compared with the DT classifier model in an independent testing set. The DL classifier model showed an area under the receiver operating characteristic curves (AUC) of 0.887 with an accuracy of 0.817, sensitivity of 0.791, specificity of 0.831, G-mean of 0.811, and F1 score of 0.749 in identifying Fusarium, and achieved an AUC of 0.827 with an accuracy of 0.757, sensitivity of 0.756, specificity of 0.759, G-mean of 0.757, and F1 score of 0.716 in identifying Aspergillus.

CONCLUSION

The DL model can classify Fusarium and Aspergillus by learning effective features in IVCM images automatically. The automated IVCM image analysis suggests a noninvasive identification of Fusarium and Aspergillus with clear potential application in early diagnosis and management of fungal keratitis.

Artificial intelligence-assisted diagnosis of ocular surface diseases

With the rapid development of computer technology, the application of artificial intelligence (AI) in ophthalmology research has gained prominence in modern medicine. Artificial intelligence-related research in ophthalmology previously focused on the screening and diagnosis of fundus diseases, particularly diabetic retinopathy, age-related macular degeneration, and glaucoma. Since fundus images are relatively fixed, their standards are easy to unify. Artificial intelligence research related to ocular surface diseases has also increased. The main issue with research on ocular surface diseases is that the images involved are complex, with many modalities. Therefore, this review aims to summarize current artificial intelligence research and technologies used to diagnose ocular surface diseases such as pterygium, keratoconus, infectious keratitis, and dry eye to identify mature artificial intelligence models that are suitable for research of ocular surface diseases and potential algorithms that may be used in the future.

Advances in artificial intelligence applications for ocular surface diseases diagnosis

In recent years, with the rapid development of computer technology, continual optimization of various learning algorithms and architectures, and establishment of numerous large databases, artificial intelligence (AI) has been unprecedentedly developed and applied in the field of ophthalmology. In the past, ophthalmological AI research mainly focused on posterior segment diseases, such as diabetic retinopathy, retinopathy of prematurity, age-related macular degeneration, retinal vein occlusion, and glaucoma optic neuropathy. Meanwhile, an increasing number of studies have employed AI to diagnose ocular surface diseases. In this review, we summarize the research progress of AI in the diagnosis of several ocular surface diseases, namely keratitis, keratoconus, dry eye, and pterygium. We discuss the limitations and challenges of AI in the diagnosis of ocular surface diseases, as well as prospects for the future.

Class-Aware Attention Network for infectious keratitis diagnosis using corneal photographs

Infectious keratitis is one of the common ophthalmic diseases and also one of the main blinding eye diseases in China, hence rapid and accurate diagnosis and treatment for infectious keratitis are urgent to prevent the progression of the disease and limit the degree of corneal injury. Unfortunately, the traditional manual diagnosis accuracy is usually unsatisfactory due to the indistinguishable visual features. In this paper, we propose a novel end-to-end fully convolutional network, named Class-Aware Attention Network (CAA-Net), for automatically diagnosing infectious keratitis (normal, viral keratitis, fungal keratitis, and bacterial keratitis) using corneal photographs. In CAA-Net, a class-aware classification module is first trained to learn class-related discriminative features using separate branches for each class. Then, the learned class-aware discriminative features are fed into the main branch and fused with other feature maps using two attention strategies to assist the final multi-class classification performance. For the experiments, we have built a new corneal photograph dataset with 1886 images from 519 patients and conducted comprehensive experiments to verify the effectiveness of our proposed method. The code is available at https://github.com/SWF-hao/CAA-Net_Pytorch.

Clinical Observation of Corneal Endothelial Plaques With Fungal and Bacterial Keratitis by Anterior Segment Optical Coherence Tomography and In Vivo Confocal Microscopy

PURPOSE

Endothelial plaque is an important sign of fungal keratitis and is related to diagnosis, surgical indications, and prognosis. However, bacterial keratitis sometimes involves fibrin formation on the back corneal surface, similar to endothelial plaques. Because corneal infiltration interferes with precise observation of the posterior corneal plaque, distinguishing pathogens with a slitlamp is difficult. We hope to assist clinicians in early diagnosis and timely treatment by observing the connection state of endothelial plaques and the corneal endothelium through anterior segment optical coherence tomography (AS-OCT) and the different forms of endothelial plaques in infectious keratopathy through in vivo confocal microscopy (IVCM).

METHODS

We analyzed 52 patients in the Eye Hospital of the First Affiliated Hospital of Harbin Medical University who were clearly diagnosed with fungal or bacterial keratitis with endothelial plaques. All patients underwent AS-OCT and IVCM on admission.

RESULTS

According to the smear, IVCM, or fungal and bacterial culture results, the patients were diagnosed with fungal (28 patients) or bacterial keratitis (24 patients). AS-OCT in 25 patients diagnosed with fungal keratitis revealed that the corneal endothelium-endothelial plaque boundary was unclear and wavy, and 24 patients had unclear cell boundaries and a large number of compactly distributed inflammatory cells in the endothelial layer according to IVCM. AS-OCT in 23 patients diagnosed with bacterial keratitis revealed clear corneal endothelium-endothelial plaque boundaries, and insufficient endothelial cell boundaries with a large number of visible and scattered inflammatory cell structures were observed through IVCM in 22 patients.

CONCLUSIONS

Corneal endothelial plaque detection by AS-OCT and IVCM can be used for early diagnosis of infectious keratitis.

Artificial intelligence and corneal diseases

PURPOSE OF REVIEW

Artificial intelligence has advanced rapidly in recent years and has provided powerful tools to aid with the diagnosis, management, and treatment of ophthalmic diseases. This article aims to review the most current clinical artificial intelligence applications in anterior segment diseases, with an emphasis on microbial keratitis, keratoconus, dry eye syndrome, and Fuchs endothelial dystrophy.

RECENT FINDINGS

Most current artificial intelligence approaches have focused on developing deep learning algorithms based on various imaging modalities. Algorithms have been developed to detect and differentiate microbial keratitis classes and quantify microbial keratitis features. Artificial intelligence may aid with early detection and staging of keratoconus. Many advances have been made to detect, segment, and quantify features of dry eye syndrome and Fuchs. There is significant variability in the reporting of methodology, patient population, and outcome metrics.

SUMMARY

Artificial intelligence shows great promise in detecting, diagnosing, grading, and measuring diseases. There is a need for standardization of reporting to improve the transparency, validity, and comparability of algorithms.

The use of in vivo confocal microscopy in fungal keratitis - Progress and challenges

Fungal keratitis (FK) is a serious and sight-threatening corneal infection with global reach. The need for prompt diagnosis is paramount, as a delay in initiation of treatment could lead to irreversible vision loss. Current "gold standard" diagnostic methods, namely corneal smear and culture, have limitations due to diagnostic insensitivity and their time-consuming nature. PCR is a newer, complementary method used in the diagnosis of fungal keratitis, whose results are also sample-dependent. In vivo confocal microscopy (IVCM) is a promising complementary diagnostic method of increasing importance as it allows non-invasive real-time direct visualization of potential fungal pathogens and manifesting infection directly in the patient's cornea. In numerous articles and case reports, FK diagnosis by IVCM has been evaluated, and different features, approaches, sensitivity/specificity, and limitations have been noted. Here, we provide an up-to-date, comprehensive review of the current literature and present the authors' combined recommendations for fungal identification in IVCM images, while also looking to the future of FK assessment by IVCM using artificial intelligence methods.

The Clinical Value of Explainable Deep Learning for Diagnosing Fungal Keratitis Using in vivo Confocal Microscopy Images

Background: Artificial intelligence (AI) has great potential to detect fungal keratitis using in vivo confocal microscopy images, but its clinical value remains unclarified. A major limitation of its clinical utility is the lack of explainability and interpretability. Methods: An explainable AI (XAI) system based on Gradient-weighted Class Activation Mapping (Grad-CAM) and Guided Grad-CAM was established. In this randomized controlled trial, nine ophthalmologists (three expert ophthalmologists, three competent ophthalmologists, and three novice ophthalmologists) read images in each of the conditions: unassisted, AI-assisted, or XAI-assisted. In unassisted condition, only the original IVCM images were shown to the readers. AI assistance comprised a histogram of model prediction probability. For XAI assistance, explanatory maps were additionally shown. The accuracy, sensitivity, and specificity were calculated against an adjudicated reference standard. Moreover, the time spent was measured. Results: Both forms of algorithmic assistance increased the accuracy and sensitivity of competent and novice ophthalmologists significantly without reducing specificity. The improvement was more pronounced in XAI-assisted condition than that in AI-assisted condition. Time spent with XAI assistance was not significantly different from that without assistance. Conclusion: AI has shown great promise in improving the accuracy of ophthalmologists. The inexperienced readers are more likely to benefit from the XAI system. With better interpretability and explainability, XAI-assistance can boost ophthalmologist performance beyond what is achievable by the reader alone or with black-box AI assistance.

Automated detection of superficial fungal infections from microscopic images through a regional convolutional neural network

Direct microscopic examination with potassium hydroxide is generally used as a screening method for diagnosing superficial fungal infections. Although this type of examination is faster than other diagnostic methods, it can still be time-consuming to evaluate a complete sample; additionally, it possesses the disadvantage of inconsistent reliability as the accuracy of the reading may differ depending on the performer’s skill. This study aims at detecting hyphae more quickly, conveniently, and consistently through deep learning using images obtained from microscopy used in real-world practice. An object detection convolutional neural network, YOLO v4, was trained on microscopy images with magnifications of 100×, 40×, and (100+40)×. The study was conducted at the Department of Dermatology at Veterans Health Service Medical Center, Seoul, Korea between January 1, 2019 and December 31, 2019, using 3,707 images (1,255 images for training, 1,645 images for testing). The average precision was used to evaluate the accuracy of object detection. Precision recall curve analysis was performed for the hyphal location determination, and receiver operating characteristic curve analysis was performed on the image classification. The F1 score, sensitivity, and specificity values were used as measures of the overall performance. The sensitivity and specificity were, respectively, 95.2% and 100% in the 100× data model, and 99% and 86.6% in the 40× data model; the sensitivity and specificity in the combined (100+40)× data model were 93.2% and 89%, respectively. The performance of our model had high sensitivity and specificity, indicating that hyphae can be detected with reliable accuracy. Thus, our deep learning-based autodetection model can detect hyphae in microscopic images obtained from real-world practice. We aim to develop an automatic hyphae detection system that can be utilized in real-world practice through continuous research.

Post-keratoplasty Infectious Keratitis: Epidemiology, Risk Factors, Management, and Outcomes

Post-keratoplasty infectious keratitis (PKIK) represents a unique clinical entity that often poses significant diagnostic and therapeutic challenges. It carries a high risk of serious complications such as graft rejection and failure, and less commonly endophthalmitis. Topical corticosteroids are often required to reduce the risk of graft rejection but their use in PKIK may act as a double-edged sword, particularly in fungal infection. The increased uptake in lamellar keratoplasty in the recent years has also led to complications such as graft-host interface infectious keratitis (IIK), which is particularly difficult to manage. The reported incidence of PKIK differs considerably across different countries, with a higher incidence observed in developing countries (9.2-11.9%) than developed countries (0.02-7.9%). Common risk factors for PKIK include the use of topical corticosteroids, suture-related problems, ocular surface diseases and previous corneal infection. PKIK after penetrating keratoplasty or (deep) anterior lamellar keratoplasty is most commonly caused by ocular surface commensals, particularly Gramme-positive bacteria, whereas PKIK after endothelial keratoplasty is usually caused by Candida spp. Empirical broad-spectrum antimicrobial treatment is the mainstay of treatment for both PKIK, though surgical interventions are required in medically refractory cases (during the acute phase) and those affected by visually significant scarring (during the late phase). In this paper, we aim to provide a comprehensive overview on PKIK, encompassing the epidemiology, risk factors, causes, management and outcomes, and to propose a treatment algorithm for systematically managing this challenging condition.

Artificial Intelligence in Cornea, Refractive Surgery, and Cataract: Basic Principles, Clinical Applications, and Future Directions

ABSTRACT

Corneal diseases, uncorrected refractive errors, and cataract represent the major causes of blindness globally. The number of refractive surgeries, either cornea- or lens-based, is also on the rise as the demand for perfect vision continues to increase. With the recent advancement and potential promises of artificial intelligence (AI) technologies demonstrated in the realm of ophthalmology, particularly retinal diseases and glaucoma, AI researchers and clinicians are now channeling their focus toward the less explored ophthalmic areas related to the anterior segment of the eye. Conditions that rely on anterior segment imaging modalities, including slit-lamp photography, anterior segment optical coherence tomography, corneal tomography, in vivo confocal microscopy and/or optical biometers, are the most commonly explored areas. These include infectious keratitis, keratoconus, corneal grafts, ocular surface pathologies, preoperative screening before refractive surgery, intraocular lens calculation, and automated refraction, among others. In this review, we aimed to provide a comprehensive update on the utilization of AI in anterior segment diseases, with particular emphasis on the recent advancement in the past few years. In addition, we demystify some of the basic principles and terminologies related to AI, particularly machine learning and deep learning, to help improve the understanding, research and clinical implementation of these AI technologies among the ophthalmologists and vision scientists. As we march toward the era of digital health, guidelines such as CONSORT-AI, SPIRIT-AI, and STARD-AI will play crucial roles in guiding and standardizing the conduct and reporting of AI-related trials, ultimately promoting their potential for clinical translation.

Preventing corneal blindness caused by keratitis using artificial intelligence

Keratitis is the main cause of corneal blindness worldwide. Most vision loss caused by keratitis can be avoidable via early detection and treatment. The diagnosis of keratitis often requires skilled ophthalmologists. However, the world is short of ophthalmologists, especially in resource-limited settings, making the early diagnosis of keratitis challenging. Here, we develop a deep learning system for the automated classification of keratitis, other cornea abnormalities, and normal cornea based on 6,567 slit-lamp images. Our system exhibits remarkable performance in cornea images captured by the different types of digital slit lamp cameras and a smartphone with the super macro mode (all AUCs>0.96). The comparable sensitivity and specificity in keratitis detection are observed between the system and experienced cornea specialists. Our system has the potential to be applied to both digital slit lamp cameras and smartphones to promote the early diagnosis and treatment of keratitis, preventing the corneal blindness caused by keratitis.

A deep transfer learning framework for the automated assessment of corneal inflammation on in vivo confocal microscopy images

Purpose

Infiltration of activated dendritic cells and inflammatory cells in cornea represents an important marker for defining corneal inflammation. Deep transfer learning has presented a promising potential and is gaining more importance in computer assisted diagnosis. This study aimed to develop deep transfer learning models for automatic detection of activated dendritic cells and inflammatory cells using in vivo confocal microscopy images.

Methods

A total of 3453 images was used to train the models. External validation was performed on an independent test set of 558 images. A ground-truth label was assigned to each image by a panel of cornea specialists. We constructed a deep transfer learning network that consisted of a pre-trained network and an adaptation layer. In this work, five pre-trained networks were considered, namely VGG-16, ResNet-101, Inception V3, Xception, and Inception-ResNet V2. The performance of each transfer network was evaluated by calculating the area under the curve (AUC) of receiver operating characteristic, accuracy, sensitivity, specificity, and G mean.

Results

The best performance was achieved by Inception-ResNet V2 transfer model. In the validation set, the best transfer system achieved an AUC of 0.9646 (P<0.001) in identifying activated dendritic cells (accuracy, 0.9319; sensitivity, 0.8171; specificity, 0.9517; and G mean, 0.8872), and 0.9901 (P<0.001) in identifying inflammatory cells (accuracy, 0.9767; sensitivity, 0.9174; specificity, 0.9931; and G mean, 0.9545).

Conclusions

The deep transfer learning models provide a completely automated analysis of corneal inflammatory cellular components with high accuracy. The implementation of such models would greatly benefit the management of corneal diseases and reduce workloads for ophthalmologists.