Evaluation of artificial intelligence models for the detection of asymmetric keratoconus eyes using Scheimpflug tomography

Role of artificial intelligence, machine learning and deep learning models in corneal disorders - A narrative review

In the last decade, artificial intelligence (AI) has significantly impacted ophthalmology, particularly in managing corneal diseases, a major reversible cause of blindness. This review explores AI's transformative role in the corneal subspecialty, which has adopted advanced technology for superior clinical judgment, early diagnosis, and personalized therapy. While AI's role in anterior segment diseases is less documented compared to glaucoma and retinal pathologies, this review highlights its integration into corneal diagnostics through imaging techniques like slit-lamp biomicroscopy, anterior segment optical coherence tomography (AS-OCT), and in vivo confocal biomicroscopy. AI has been pivotal in refining decision-making and prognosis for conditions such as keratoconus, infectious keratitis, and dystrophies. Multi-disease deep learning neural networks (MDDNs) have shown diagnostic ability in classifying corneal diseases using AS-OCT images, achieving notable metrics like an AUC of 0.910. AI's progress over two decades has significantly improved the accuracy of diagnosing conditions like keratoconus and microbial keratitis. For instance, AI has achieved a 90.7% accuracy rate in classifying bacterial and fungal keratitis and an AUC of 0.910 in differentiating various corneal diseases. Convolutional neural networks (CNNs) have enhanced the analysis of color-coded corneal maps, yielding up to 99.3% diagnostic accuracy for keratoconus. Deep learning algorithms have also shown robust performance in detecting fungal hyphae on in vivo confocal microscopy, with precise quantification of hyphal density. AI models combining tomography scans and visual acuity have demonstrated up to 97% accuracy in keratoconus staging according to the Amsler-Krumeich classification. However, the review acknowledges the limitations of current AI models, including their reliance on binary classification, which may not capture the complexity of real-world clinical presentations with multiple coexisting disorders. Challenges also include dependency on data quality, diverse imaging protocols, and integrating multimodal images for a generalized AI diagnosis. The need for interpretability in AI models is emphasized to foster trust and applicability in clinical settings. Looking ahead, AI has the potential to unravel the intricate mechanisms behind corneal pathologies, reduce healthcare's carbon footprint, and revolutionize diagnostic and management paradigms. Ethical and regulatory considerations will accompany AI's clinical adoption, marking an era where AI not only assists but augments ophthalmic care.

Utility of artificial intelligence in the diagnosis and management of keratoconus: a systematic review

Introduction

The application of artificial intelligence (AI) systems in ophthalmology is rapidly expanding. Early detection and management of keratoconus is important for preventing disease progression and the need for corneal transplant. We review studies regarding the utility of AI in the diagnosis and management of keratoconus and other corneal ectasias.

Methods

We conducted a systematic search for relevant original, English-language research studies in the PubMed, Web of Science, Embase, and Cochrane databases from inception to October 31, 2023, using a combination of the following keywords: artificial intelligence, deep learning, machine learning, keratoconus, and corneal ectasia. Case reports, literature reviews, conference proceedings, and editorials were excluded. We extracted the following data from each eligible study: type of AI, input used for training, output, ground truth or reference, dataset size, availability of algorithm/model, availability of dataset, and major study findings.

Results

Ninety-three original research studies were included in this review, with the date of publication ranging from 1994 to 2023. The majority of studies were regarding the use of AI in detecting keratoconus or subclinical keratoconus (n=61). Among studies regarding keratoconus diagnosis, the most common inputs were corneal topography, Scheimpflug-based corneal tomography, and anterior segment-optical coherence tomography. This review also summarized 16 original research studies regarding AI-based assessment of severity and clinical features, 7 studies regarding the prediction of disease progression, and 6 studies regarding the characterization of treatment response. There were only three studies regarding the use of AI in identifying susceptibility genes involved in the etiology and pathogenesis of keratoconus.

Discussion

Algorithms trained on Scheimpflug-based tomography seem promising tools for the early diagnosis of keratoconus that can be particularly applied in low-resource communities. Future studies could investigate the application of AI models trained on multimodal patient information for staging keratoconus severity and tracking disease progression.

CorNet: Autonomous feature learning in raw Corvis ST data for keratoconus diagnosis via residual CNN approach

PURPOSE

To ascertain whether the integration of raw Corvis ST data with an end-to-end CNN can enhance the diagnosis of keratoconus (KC).

METHOD

The Corvis ST is a non-contact device for in vivo measurement of corneal biomechanics. The CorNet was trained and validated on a dataset consisting of 1786 Corvis ST raw data from 1112 normal eyes and 674 KC eyes. Each raw data consists of the anterior and posterior corneal surface elevation during air-puff induced dynamic deformation. The architecture of CorNet utilizes four ResNet-inspired convolutional structures that employ 1 × 1 convolution in identity mapping. Gradient-weighted Class Activation Mapping (Grad-CAM) was adopted to visualize the attention allocation to diagnostic areas. Discriminative performance was assessed using metrics including the AUC of ROC curve, sensitivity, specificity, precision, accuracy, and F1 score.

RESULTS

CorNet demonstrated outstanding performance in distinguishing KC from normal eyes, achieving an AUC of 0.971 (sensitivity: 92.49%, specificity: 91.54%) in the validation set, outperforming the best existing Corvis ST parameters, namely the Corvis Biomechanical Index (CBI) with an AUC of 0.947, and its updated version for Chinese populations (cCBI) with an AUC of 0.963. Though the ROC curve analysis showed no significant difference between CorNet and cCBI (p = 0.295), it indicated a notable difference between CorNet and CBI (p = 0.011). The Grad-CAM visualizations highlighted the significance of corneal deformation data during the loading phase rather than the unloading phase for KC diagnosis.

CONCLUSION

This study proposed an end-to-end CNN approach utilizing raw biomechanical data by Corvis ST for KC detection, showing effectiveness comparable to or surpassing existing parameters provided by Corvis ST. The CorNet, autonomously learning comprehensive temporal and spatial features, demonstrated a promising performance for advancing KC diagnosis in ophthalmology.

Potential applications of artificial intelligence in image analysis in cornea diseases: a review

Artificial intelligence (AI) is an emerging field which could make an intelligent healthcare model a reality and has been garnering traction in the field of medicine, with promising results. There have been recent developments in machine learning and/or deep learning algorithms for applications in ophthalmology-primarily for diabetic retinopathy, and age-related macular degeneration. However, AI research in the field of cornea diseases is relatively new. Algorithms have been described to assist clinicians in diagnosis or detection of cornea conditions such as keratoconus, infectious keratitis and dry eye disease. AI may also be used for segmentation and analysis of cornea imaging or tomography as an adjunctive tool. Despite the potential advantages that these new technologies offer, there are challenges that need to be addressed before they can be integrated into clinical practice. In this review, we aim to summarize current literature and provide an update regarding recent advances in AI technologies pertaining to corneal diseases, and its potential future application, in particular pertaining to image analysis.

Deep Learning Models Used in the Diagnostic Workup of Keratoconus: A Systematic Review and Exploratory Meta-Analysis

PURPOSE

The prevalence of keratoconus in the general population is reported to be up to 1 of 84. Over the past 2 decades, diagnosis and management evolved rapidly, but keratoconus screening in clinical practice is still challenging and asks for improving the accuracy of keratoconus detection. Deep learning (DL) offers considerable promise for improving the accuracy and speed of medical imaging interpretation. We establish an inventory of studies conducted with DL algorithms that have attempted to diagnose keratoconus.

METHODS

This systematic review was conducted according to the recommendations of the PRISMA statement. We searched (Pre-)MEDLINE, Embase, Science Citation Index, Conference Proceedings Citation Index, arXiv document server, and Google Scholar from inception to February 18, 2022. We included studies that evaluated the performance of DL algorithms in the diagnosis of keratoconus. The main outcome was diagnostic performance measured as sensitivity and specificity, and the methodological quality of the included studies was assessed using QUADAS-2.

RESULTS

Searches retrieved 4100 nonduplicate records, and we included 19 studies in the qualitative synthesis and 10 studies in the exploratory meta-analysis. The overall study quality was limited because of poor reporting of patient selection and the use of inadequate reference standards. We found a pooled sensitivity of 97.5% (95% confidence interval, 93.6%-99.0%) and a pooled specificity of 97.2% (95% confidence interval, 85.7%-99.5%) for topography images as input.

CONCLUSIONS

Our systematic review found that the overall diagnostic performance of DL models to detect keratoconus was good, but the methodological quality of included studies was modest.

Artificial intelligence for detecting keratoconus

BACKGROUND

Keratoconus remains difficult to diagnose, especially in the early stages. It is a progressive disorder of the cornea that starts at a young age. Diagnosis is based on clinical examination and corneal imaging; though in the early stages, when there are no clinical signs, diagnosis depends on the interpretation of corneal imaging (e.g. topography and tomography) by trained cornea specialists. Using artificial intelligence (AI) to analyse the corneal images and detect cases of keratoconus could help prevent visual acuity loss and even corneal transplantation. However, a missed diagnosis in people seeking refractive surgery could lead to weakening of the cornea and keratoconus-like ectasia. There is a need for a reliable overview of the accuracy of AI for detecting keratoconus and the applicability of this automated method to the clinical setting.

OBJECTIVES

To assess the diagnostic accuracy of artificial intelligence (AI) algorithms for detecting keratoconus in people presenting with refractive errors, especially those whose vision can no longer be fully corrected with glasses, those seeking corneal refractive surgery, and those suspected of having keratoconus. AI could help ophthalmologists, optometrists, and other eye care professionals to make decisions on referral to cornea specialists. Secondary objectives To assess the following potential causes of heterogeneity in diagnostic performance across studies. • Different AI algorithms (e.g. neural networks, decision trees, support vector machines) • Index test methodology (preprocessing techniques, core AI method, and postprocessing techniques) • Sources of input to train algorithms (topography and tomography images from Placido disc system, Scheimpflug system, slit-scanning system, or optical coherence tomography (OCT); number of training and testing cases/images; label/endpoint variable used for training) • Study setting • Study design • Ethnicity, or geographic area as its proxy • Different index test positivity criteria provided by the topography or tomography device • Reference standard, topography or tomography, one or two cornea specialists • Definition of keratoconus • Mean age of participants • Recruitment of participants • Severity of keratoconus (clinically manifest or subclinical) SEARCH METHODS: We searched CENTRAL (which contains the Cochrane Eyes and Vision Trials Register), Ovid MEDLINE, Ovid Embase, OpenGrey, the ISRCTN registry, ClinicalTrials.gov, and the World Health Organization International Clinical Trials Registry Platform (WHO ICTRP). There were no date or language restrictions in the electronic searches for trials. We last searched the electronic databases on 29 November 2022.

SELECTION CRITERIA

We included cross-sectional and diagnostic case-control studies that investigated AI for the diagnosis of keratoconus using topography, tomography, or both. We included studies that diagnosed manifest keratoconus, subclinical keratoconus, or both. The reference standard was the interpretation of topography or tomography images by at least two cornea specialists.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted the study data and assessed the quality of studies using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. When an article contained multiple AI algorithms, we selected the algorithm with the highest Youden's index. We assessed the certainty of evidence using the GRADE approach.

MAIN RESULTS

We included 63 studies, published between 1994 and 2022, that developed and investigated the accuracy of AI for the diagnosis of keratoconus. There were three different units of analysis in the studies: eyes, participants, and images. Forty-four studies analysed 23,771 eyes, four studies analysed 3843 participants, and 15 studies analysed 38,832 images. Fifty-four articles evaluated the detection of manifest keratoconus, defined as a cornea that showed any clinical sign of keratoconus. The accuracy of AI seems almost perfect, with a summary sensitivity of 98.6% (95% confidence interval (CI) 97.6% to 99.1%) and a summary specificity of 98.3% (95% CI 97.4% to 98.9%). However, accuracy varied across studies and the certainty of the evidence was low. Twenty-eight articles evaluated the detection of subclinical keratoconus, although the definition of subclinical varied. We grouped subclinical keratoconus, forme fruste, and very asymmetrical eyes together. The tests showed good accuracy, with a summary sensitivity of 90.0% (95% CI 84.5% to 93.8%) and a summary specificity of 95.5% (95% CI 91.9% to 97.5%). However, the certainty of the evidence was very low for sensitivity and low for specificity. In both groups, we graded most studies at high risk of bias, with high applicability concerns, in the domain of patient selection, since most were case-control studies. Moreover, we graded the certainty of evidence as low to very low due to selection bias, inconsistency, and imprecision. We could not explain the heterogeneity between the studies. The sensitivity analyses based on study design, AI algorithm, imaging technique (topography versus tomography), and data source (parameters versus images) showed no differences in the results.

AUTHORS' CONCLUSIONS

AI appears to be a promising triage tool in ophthalmologic practice for diagnosing keratoconus. Test accuracy was very high for manifest keratoconus and slightly lower for subclinical keratoconus, indicating a higher chance of missing a diagnosis in people without clinical signs. This could lead to progression of keratoconus or an erroneous indication for refractive surgery, which would worsen the disease. We are unable to draw clear and reliable conclusions due to the high risk of bias, the unexplained heterogeneity of the results, and high applicability concerns, all of which reduced our confidence in the evidence. Greater standardization in future research would increase the quality of studies and improve comparability between studies.

Keratoconus Diagnosis: From Fundamentals to Artificial Intelligence: A Systematic Narrative Review

The remarkable recent advances in managing keratoconus, the most common corneal ectasia, encouraged researchers to conduct further studies on the disease. Despite the abundance of information about keratoconus, debates persist regarding the detection of mild cases. Early detection plays a crucial role in facilitating less invasive treatments. This review encompasses corneal data ranging from the basic sciences to the application of artificial intelligence in keratoconus patients. Diagnostic systems utilize automated decision trees, support vector machines, and various types of neural networks, incorporating input from various corneal imaging equipment. Although the integration of artificial intelligence techniques into corneal imaging devices may take time, their popularity in clinical practice is increasing. Most of the studies reviewed herein demonstrate a high discriminatory power between normal and keratoconus cases, with a relatively lower discriminatory power for subclinical keratoconus.

Artificial intelligence-assisted diagnosis of ocular surface diseases

With the rapid development of computer technology, the application of artificial intelligence (AI) in ophthalmology research has gained prominence in modern medicine. Artificial intelligence-related research in ophthalmology previously focused on the screening and diagnosis of fundus diseases, particularly diabetic retinopathy, age-related macular degeneration, and glaucoma. Since fundus images are relatively fixed, their standards are easy to unify. Artificial intelligence research related to ocular surface diseases has also increased. The main issue with research on ocular surface diseases is that the images involved are complex, with many modalities. Therefore, this review aims to summarize current artificial intelligence research and technologies used to diagnose ocular surface diseases such as pterygium, keratoconus, infectious keratitis, and dry eye to identify mature artificial intelligence models that are suitable for research of ocular surface diseases and potential algorithms that may be used in the future.