A Hybrid Deep Learning Construct for Detecting Keratoconus From Corneal Maps

Keratoconus disease classification with multimodel fusion and vision transformer: a pretrained model approach

OBJECTIVE

Our objective is to develop a novel keratoconus image classification system that leverages multiple pretrained models and a transformer architecture to achieve state-of-the-art performance in detecting keratoconus.

METHODS AND ANALYSIS

Three pretrained models were used to extract features from the input images. These models have been trained on large datasets and have demonstrated strong performance in various computer vision tasks.The extracted features from the three pretrained models were fused using a feature fusion technique. This fusion aimed to combine the strengths of each model and capture a more comprehensive representation of the input images. The fused features were then used as input to a vision transformer, a powerful architecture that has shown excellent performance in image classification tasks. The vision transformer learnt to classify the input images as either indicative of keratoconus or not.The proposed method was applied to the Shahroud Cohort Eye collection and keratoconus detection dataset. The performance of the model was evaluated using standard evaluation metrics such as accuracy, precision, recall and F1 score.

RESULTS

The research results demonstrated that the proposed model achieved higher accuracy compared with using each model individually.

CONCLUSION

The findings of this study suggest that the proposed approach can significantly improve the accuracy of image classification models for keratoconus detection. This approach can serve as an effective decision support system alongside physicians, aiding in the diagnosis of keratoconus and potentially reducing the need for invasive procedures such as corneal transplantation in severe cases.

Comparison of different corneal imaging modalities using artificial intelligence for diagnosis of keratoconus: a systematic review and meta-analysis

PURPOSE

This review was designed to compare different corneal imaging modalities using artificial intelligence (AI) for the diagnosis of keratoconus (KCN), subclinical KCN (SKCN), and forme fruste KCN (FFKCN).

METHODS

A comprehensive systematic search was conducted in scientific databases, including Web of Science, PubMed, Scopus, and Google Scholar based on the PRISMA statement. Two independent reviewers assessed all potential publications on AI and KCN up to March 2022. The Critical Appraisal Skills Program (CASP) 11-item checklist was used to evaluate the validity of the studies. Eligible articles were categorized into three groups (KCN, SKCN, and FFKCN) and included in the meta-analysis. The pooled estimate of accuracy (PEA) was calculated for all selected articles.

RESULTS

The initial search yielded 575 relevant publications, of which 36 met the CASP quality criteria and were included in the analysis. Qualitative assessment showed that Scheimpflug and Placido combined with biomechanical and wavefront evaluations improved KCN detection (PEA, 99.2, and 99.0, respectively). The Scheimpflug system (92.25 PEA, 95% CI, 94.76-97.51) and a combination of Scheimpflug and Placido (96.44 PEA, 95% CI, 93.13-98.19) had the highest diagnostic accuracy for the detection of SKCN and FFKCN, respectively. The meta-analysis outcomes showed no significant difference between the CASP score and accuracy of the publications (all P > 0.05).

CONCLUSIONS

Simultaneous Scheimpflug and Placido corneal imaging methods provide high diagnostic accuracy for early detection of keratoconus. The use of AI models improves the discrimination of keratoconic eyes from normal corneas.

Potential applications of artificial intelligence in image analysis in cornea diseases: a review

Artificial intelligence (AI) is an emerging field which could make an intelligent healthcare model a reality and has been garnering traction in the field of medicine, with promising results. There have been recent developments in machine learning and/or deep learning algorithms for applications in ophthalmology-primarily for diabetic retinopathy, and age-related macular degeneration. However, AI research in the field of cornea diseases is relatively new. Algorithms have been described to assist clinicians in diagnosis or detection of cornea conditions such as keratoconus, infectious keratitis and dry eye disease. AI may also be used for segmentation and analysis of cornea imaging or tomography as an adjunctive tool. Despite the potential advantages that these new technologies offer, there are challenges that need to be addressed before they can be integrated into clinical practice. In this review, we aim to summarize current literature and provide an update regarding recent advances in AI technologies pertaining to corneal diseases, and its potential future application, in particular pertaining to image analysis.

Keratoconus Detection-based on Dynamic Corneal Deformation Videos Using Deep Learning

Objective

To assess the performance of convolutional neural networks (CNNs) for automated detection of keratoconus (KC) in standalone Scheimpflug-based dynamic corneal deformation videos.

Design

Retrospective cohort study.

Participants

We retrospectively analyzed datasets with records of 734 nonconsecutive, refractive surgery candidates, and patients with unilateral or bilateral KC.

Methods

We first developed a video preprocessing pipeline to translate dynamic corneal deformation videos into 3-dimensional pseudoimage representations and then trained a CNN to directly identify KC from pseudoimages. We calculated the model's KC probability score cut-off and evaluated the performance by subjective and objective accuracy metrics using 2 independent datasets.

Main Outcome Measures

Area under the receiver operating characteristics curve (AUC), accuracy, specificity, sensitivity, and KC probability score.

Results

The model accuracy on the test subset was 0.89 with AUC of 0.94. Based on the external validation dataset, the AUC and accuracy of the CNN model for detecting KC were 0.93 and 0.88, respectively.

Conclusions

Our deep learning-based approach was highly sensitive and specific in separating normal from keratoconic eyes using dynamic corneal deformation videos at levels that may prove useful in clinical practice.

Financial Disclosures

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Deep Learning Models Used in the Diagnostic Workup of Keratoconus: A Systematic Review and Exploratory Meta-Analysis

PURPOSE

The prevalence of keratoconus in the general population is reported to be up to 1 of 84. Over the past 2 decades, diagnosis and management evolved rapidly, but keratoconus screening in clinical practice is still challenging and asks for improving the accuracy of keratoconus detection. Deep learning (DL) offers considerable promise for improving the accuracy and speed of medical imaging interpretation. We establish an inventory of studies conducted with DL algorithms that have attempted to diagnose keratoconus.

METHODS

This systematic review was conducted according to the recommendations of the PRISMA statement. We searched (Pre-)MEDLINE, Embase, Science Citation Index, Conference Proceedings Citation Index, arXiv document server, and Google Scholar from inception to February 18, 2022. We included studies that evaluated the performance of DL algorithms in the diagnosis of keratoconus. The main outcome was diagnostic performance measured as sensitivity and specificity, and the methodological quality of the included studies was assessed using QUADAS-2.

RESULTS

Searches retrieved 4100 nonduplicate records, and we included 19 studies in the qualitative synthesis and 10 studies in the exploratory meta-analysis. The overall study quality was limited because of poor reporting of patient selection and the use of inadequate reference standards. We found a pooled sensitivity of 97.5% (95% confidence interval, 93.6%-99.0%) and a pooled specificity of 97.2% (95% confidence interval, 85.7%-99.5%) for topography images as input.

CONCLUSIONS

Our systematic review found that the overall diagnostic performance of DL models to detect keratoconus was good, but the methodological quality of included studies was modest.

Deep Learning-Based Automatic Diagnosis of Keratoconus with Corneal Endothelium Image

INTRODUCTION

The primary objective of this study was to develop an end-to-end model that can accurately identify corneal endothelial cells and diagnose keratoconus based on corneal endothelial images acquired from a non-contact specular microscope.

METHODS

This was a retrospective case-control study performed at the Refractive Surgery Center of West China Hospital. A total of 403 keratoconus eyes (221 patients) and 370 myopic eyes (185 normal controls) were consecutively recruited from January 2021 to September 2022. Specular microscopy was used to image and measure the morphometric parameters of the corneal endothelial cells. A Fully Convolutional Network model with a ResNet50 (FCN_ResNet50) was established to perform the endothelial segmentation. The images were then classified using an ensemble machine learning system consisting of four pre-trained deep learning networks: DenseNet121, ResNet50, Inception_v3, and MobileNet_v2. The performance of the models was evaluated based on different metrics, such as accuracy, intersection over union (IoU), and mean IoU.

RESULTS

We established a fully end-to-end deep-learning model for the segmentation of endothelial and diagnosis of keratoconus. For endothelial segmentation, the accuracy of the FCN_ResNet50 model achieved near 90% with mean IoU converging to about 80%. The ensemble machine learning system can achieve over 92% accuracy, and > 98% area under curve (AUC) values to diagnose keratoconus with endothelial cell images. In addition, we constructed a diagnostic model based on deep-learning features and developed an associated nomogram which manifested an excellent performance for diagnosis and monitoring the progression of keratoconus.

CONCLUSIONS

Our research developed an end-to-end model to automatically identify and assess corneal endothelial morphological changes in keratoconus eyes. Moreover, we also constructed a novel nomogram, which can provide valuable information for the diagnosis, monitoring, and management of the disease.

Computer-aided diagnosis of keratoconus through VAE-augmented images using deep learning

Detecting clinical keratoconus (KCN) poses a challenging and time-consuming task. During the diagnostic process, ophthalmologists are required to review demographic and clinical ophthalmic examinations in order to make an accurate diagnosis. This study aims to develop and evaluate the accuracy of deep convolutional neural network (CNN) models for the detection of keratoconus (KCN) using corneal topographic maps. We retrospectively collected 1758 corneal images (978 normal and 780 keratoconus) from 1010 subjects of the KCN group with clinically evident keratoconus and the normal group with regular astigmatism. To expand the dataset, we developed a model using Variational Auto Encoder (VAE) to generate and augment images, resulting in a dataset of 4000 samples. Four deep learning models were used to extract and identify deep corneal features of original and synthesized images. We demonstrated that the utilization of synthesized images during training process increased classification performance. The overall average accuracy of the deep learning models ranged from 99% for VGG16 to 95% for EfficientNet-B0. All CNN models exhibited sensitivity and specificity above 0.94, with the VGG16 model achieving an AUC of 0.99. The customized CNN model achieved satisfactory results with an accuracy and AUC of 0.97 at a much faster processing speed compared to other models. In conclusion, the DL models showed high accuracy in screening for keratoconus based on corneal topography images. This is a development toward the potential clinical implementation of a more enhanced computer-aided diagnosis (CAD) system for KCN detection, which would aid ophthalmologists in validating the clinical decision and carrying out prompt and precise KCN treatment.

Artificial intelligence for detecting keratoconus

BACKGROUND

Keratoconus remains difficult to diagnose, especially in the early stages. It is a progressive disorder of the cornea that starts at a young age. Diagnosis is based on clinical examination and corneal imaging; though in the early stages, when there are no clinical signs, diagnosis depends on the interpretation of corneal imaging (e.g. topography and tomography) by trained cornea specialists. Using artificial intelligence (AI) to analyse the corneal images and detect cases of keratoconus could help prevent visual acuity loss and even corneal transplantation. However, a missed diagnosis in people seeking refractive surgery could lead to weakening of the cornea and keratoconus-like ectasia. There is a need for a reliable overview of the accuracy of AI for detecting keratoconus and the applicability of this automated method to the clinical setting.

OBJECTIVES

To assess the diagnostic accuracy of artificial intelligence (AI) algorithms for detecting keratoconus in people presenting with refractive errors, especially those whose vision can no longer be fully corrected with glasses, those seeking corneal refractive surgery, and those suspected of having keratoconus. AI could help ophthalmologists, optometrists, and other eye care professionals to make decisions on referral to cornea specialists. Secondary objectives To assess the following potential causes of heterogeneity in diagnostic performance across studies. • Different AI algorithms (e.g. neural networks, decision trees, support vector machines) • Index test methodology (preprocessing techniques, core AI method, and postprocessing techniques) • Sources of input to train algorithms (topography and tomography images from Placido disc system, Scheimpflug system, slit-scanning system, or optical coherence tomography (OCT); number of training and testing cases/images; label/endpoint variable used for training) • Study setting • Study design • Ethnicity, or geographic area as its proxy • Different index test positivity criteria provided by the topography or tomography device • Reference standard, topography or tomography, one or two cornea specialists • Definition of keratoconus • Mean age of participants • Recruitment of participants • Severity of keratoconus (clinically manifest or subclinical) SEARCH METHODS: We searched CENTRAL (which contains the Cochrane Eyes and Vision Trials Register), Ovid MEDLINE, Ovid Embase, OpenGrey, the ISRCTN registry, ClinicalTrials.gov, and the World Health Organization International Clinical Trials Registry Platform (WHO ICTRP). There were no date or language restrictions in the electronic searches for trials. We last searched the electronic databases on 29 November 2022.

SELECTION CRITERIA

We included cross-sectional and diagnostic case-control studies that investigated AI for the diagnosis of keratoconus using topography, tomography, or both. We included studies that diagnosed manifest keratoconus, subclinical keratoconus, or both. The reference standard was the interpretation of topography or tomography images by at least two cornea specialists.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted the study data and assessed the quality of studies using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. When an article contained multiple AI algorithms, we selected the algorithm with the highest Youden's index. We assessed the certainty of evidence using the GRADE approach.

MAIN RESULTS

We included 63 studies, published between 1994 and 2022, that developed and investigated the accuracy of AI for the diagnosis of keratoconus. There were three different units of analysis in the studies: eyes, participants, and images. Forty-four studies analysed 23,771 eyes, four studies analysed 3843 participants, and 15 studies analysed 38,832 images. Fifty-four articles evaluated the detection of manifest keratoconus, defined as a cornea that showed any clinical sign of keratoconus. The accuracy of AI seems almost perfect, with a summary sensitivity of 98.6% (95% confidence interval (CI) 97.6% to 99.1%) and a summary specificity of 98.3% (95% CI 97.4% to 98.9%). However, accuracy varied across studies and the certainty of the evidence was low. Twenty-eight articles evaluated the detection of subclinical keratoconus, although the definition of subclinical varied. We grouped subclinical keratoconus, forme fruste, and very asymmetrical eyes together. The tests showed good accuracy, with a summary sensitivity of 90.0% (95% CI 84.5% to 93.8%) and a summary specificity of 95.5% (95% CI 91.9% to 97.5%). However, the certainty of the evidence was very low for sensitivity and low for specificity. In both groups, we graded most studies at high risk of bias, with high applicability concerns, in the domain of patient selection, since most were case-control studies. Moreover, we graded the certainty of evidence as low to very low due to selection bias, inconsistency, and imprecision. We could not explain the heterogeneity between the studies. The sensitivity analyses based on study design, AI algorithm, imaging technique (topography versus tomography), and data source (parameters versus images) showed no differences in the results.

AUTHORS' CONCLUSIONS

AI appears to be a promising triage tool in ophthalmologic practice for diagnosing keratoconus. Test accuracy was very high for manifest keratoconus and slightly lower for subclinical keratoconus, indicating a higher chance of missing a diagnosis in people without clinical signs. This could lead to progression of keratoconus or an erroneous indication for refractive surgery, which would worsen the disease. We are unable to draw clear and reliable conclusions due to the high risk of bias, the unexplained heterogeneity of the results, and high applicability concerns, all of which reduced our confidence in the evidence. Greater standardization in future research would increase the quality of studies and improve comparability between studies.

Prediction of posterior elevation stability in keratoconus

Purpose: This study aimed to investigate the features of progressive keratoconus by means of machine learning. Methods: In total, 163 eyes from 127 patients with at least 3 examination records were enrolled in this study. Pentacam HR was used to measure corneal topography. Steepest meridian keratometry (K1), flattest meridian keratometry (K2), steepest anterior keratometry (Kmax), central corneal thickness (CCT), thinnest corneal thickness (TCT), anterior radius of cornea (ARC), posterior elevation (PE), index of surface variation (ISV), and index of height deviation (IHD) were input for analysis. Support vector machine (SVM) and logistic regression analysis were applied to construct prediction models. Results: Age, PE, and IHD showed statistically significant differences as the follow-up period extended. K2, PE, and ARC were selected for model construction. Logistic regression analysis presented a mean area under the curve (AUC) score of 0.780, while SVM presented a mean AUC of 0.659. The prediction sensitivity of SVM was 52.9%, and specificity was 79.0%. Conclusion: It is feasible to use machine learning to predict the progression and prognosis of keratoconus. Posterior elevation exhibits a sensitive prediction effect.

Artificial intelligence in ophthalmology: The path to the real-world clinic

Artificial intelligence (AI) has great potential to transform healthcare by enhancing the workflow and productivity of clinicians, enabling existing staff to serve more patients, improving patient outcomes, and reducing health disparities. In the field of ophthalmology, AI systems have shown performance comparable with or even better than experienced ophthalmologists in tasks such as diabetic retinopathy detection and grading. However, despite these quite good results, very few AI systems have been deployed in real-world clinical settings, challenging the true value of these systems. This review provides an overview of the current main AI applications in ophthalmology, describes the challenges that need to be overcome prior to clinical implementation of the AI systems, and discusses the strategies that may pave the way to the clinical translation of these systems.

A Deep Feature Fusion of Improved Suspected Keratoconus Detection with Deep Learning

Detection of early clinical keratoconus (KCN) is a challenging task, even for expert clinicians. In this study, we propose a deep learning (DL) model to address this challenge. We first used Xception and InceptionResNetV2 DL architectures to extract features from three different corneal maps collected from 1371 eyes examined in an eye clinic in Egypt. We then fused features using Xception and InceptionResNetV2 to detect subclinical forms of KCN more accurately and robustly. We obtained an area under the receiver operating characteristic curves (AUC) of 0.99 and an accuracy range of 97-100% to distinguish normal eyes from eyes with subclinical and established KCN. We further validated the model based on an independent dataset with 213 eyes examined in Iraq and obtained AUCs of 0.91-0.92 and an accuracy range of 88-92%. The proposed model is a step toward improving the detection of clinical and subclinical forms of KCN.

Advances in artificial intelligence models and algorithms in the field of optometry

The rapid development of computer science over the past few decades has led to unprecedented progress in the field of artificial intelligence (AI). Its wide application in ophthalmology, especially image processing and data analysis, is particularly extensive and its performance excellent. In recent years, AI has been increasingly applied in optometry with remarkable results. This review is a summary of the application progress of different AI models and algorithms used in optometry (for problems such as myopia, strabismus, amblyopia, keratoconus, and intraocular lens) and includes a discussion of the limitations and challenges associated with its application in this field.

Artificial intelligence-assisted diagnosis of ocular surface diseases

With the rapid development of computer technology, the application of artificial intelligence (AI) in ophthalmology research has gained prominence in modern medicine. Artificial intelligence-related research in ophthalmology previously focused on the screening and diagnosis of fundus diseases, particularly diabetic retinopathy, age-related macular degeneration, and glaucoma. Since fundus images are relatively fixed, their standards are easy to unify. Artificial intelligence research related to ocular surface diseases has also increased. The main issue with research on ocular surface diseases is that the images involved are complex, with many modalities. Therefore, this review aims to summarize current artificial intelligence research and technologies used to diagnose ocular surface diseases such as pterygium, keratoconus, infectious keratitis, and dry eye to identify mature artificial intelligence models that are suitable for research of ocular surface diseases and potential algorithms that may be used in the future.

Deep Learning Model for the Detection of Corneal Edema Before Descemet Membrane Endothelial Keratoplasty on Optical Coherence Tomography Images

Purpose

Descemet membrane endothelial keratoplasty (DMEK) is the preferred method for treating corneal endothelial dysfunction, such as Fuchs endothelial corneal dystrophy (FECD). The surgical indication is based on the patients' symptoms and the presence of corneal edema. We developed an automated tool based on deep learning to detect edema in corneal optical coherence tomography images. This study aimed to evaluate this approach in edema detection before Descemet membrane endothelial keratoplasty surgery, for patients with or without FECD.

Methods

We used our previously described model allowing to classify each pixel in the corneal optical coherence tomography images as "normal" or "edema." We included 1992 images of normal and preoperative edematous corneas. We calculated the edema fraction (EF), defined as the ratio between the number of pixels labeled as "edema," and those representing the cornea for each patient. Differential central corneal thickness (DCCT), defined as the difference in central corneal thickness before and 6 months after surgery, was used to quantify preoperative edema. AUC of EF for the edema detection was calculated for Several DCCT thresholds and a value of 20 µm was selected to define significant edema as it provided the highest area under the curve value.

Results

The area under the curve of the receiver operating characteristic curve for EF for the detection of 20 µm of DCCT was 0.97 for all patients, 0.96 for Fuchs and normal only and 0.99 for non-FECD and normal patients. The optimal EF threshold was 0.143 for all patients and patients with FECD.

Conclusions

Our model is capable of objectively detecting minimal corneal edema before Descemet membrane endothelial keratoplasty surgery.

Translational Relevance

Deep learning can help to interpret optical coherence tomography scans and aid the surgeon in decision-making.

Advances in artificial intelligence applications for ocular surface diseases diagnosis

In recent years, with the rapid development of computer technology, continual optimization of various learning algorithms and architectures, and establishment of numerous large databases, artificial intelligence (AI) has been unprecedentedly developed and applied in the field of ophthalmology. In the past, ophthalmological AI research mainly focused on posterior segment diseases, such as diabetic retinopathy, retinopathy of prematurity, age-related macular degeneration, retinal vein occlusion, and glaucoma optic neuropathy. Meanwhile, an increasing number of studies have employed AI to diagnose ocular surface diseases. In this review, we summarize the research progress of AI in the diagnosis of several ocular surface diseases, namely keratitis, keratoconus, dry eye, and pterygium. We discuss the limitations and challenges of AI in the diagnosis of ocular surface diseases, as well as prospects for the future.

Artificial intelligence and corneal diseases

PURPOSE OF REVIEW

Artificial intelligence has advanced rapidly in recent years and has provided powerful tools to aid with the diagnosis, management, and treatment of ophthalmic diseases. This article aims to review the most current clinical artificial intelligence applications in anterior segment diseases, with an emphasis on microbial keratitis, keratoconus, dry eye syndrome, and Fuchs endothelial dystrophy.

RECENT FINDINGS

Most current artificial intelligence approaches have focused on developing deep learning algorithms based on various imaging modalities. Algorithms have been developed to detect and differentiate microbial keratitis classes and quantify microbial keratitis features. Artificial intelligence may aid with early detection and staging of keratoconus. Many advances have been made to detect, segment, and quantify features of dry eye syndrome and Fuchs. There is significant variability in the reporting of methodology, patient population, and outcome metrics.

SUMMARY

Artificial intelligence shows great promise in detecting, diagnosing, grading, and measuring diseases. There is a need for standardization of reporting to improve the transparency, validity, and comparability of algorithms.