Deep Learning-Based Cataract Detection and Grading from Slit-Lamp and Retro-Illumination Photographs

Diagnosing Cataracts in the Digital Age: A Survey on AI, Metaverse, and Digital Twin Applications

PURPOSE

The study explores the evolving landscape of cataract diagnosis, focusing on both traditional methods and innovative technological integrations. It aims to address challenges with subjectivity in traditional cataract grading and to evaluate how new technologies can enhance diagnostic accuracy and accessibility.

METHODS

The research introduces and examines the use of Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) in automating and improving cataract screening processes. It also explores the role of the Metaverse, Digital Twins, and Teleophthalmology for immersive patient education, real-time virtual replicas of eyes, and remote access to specialized care.

RESULTS

Various ML and DL techniques demonstrated significant accuracy in cataract detection. The integration of these technologies, along with the Metaverse, Digital Twins, and Teleophthalmology, provides a comprehensive framework for accurate and accessible cataract diagnosis.

CONCLUSION

There is a notable paradigm shift toward individualized, predictive, and transformative eye care. The advancements in technology address existing diagnostic challenges and mitigate the shortage of ophthalmologists by extending high-quality care to underserved regions. These developments pave the way for improved cataract management and broader accessibility.

Application of Artificial Intelligence in the Diagnosis, Follow-Up and Prediction of Treatment of Ophthalmic Diseases

PURPOSE

To describe the application of artificial intelligence (AI) in ophthalmic diseases and its possible future directions.

METHODS

A retrospective review of the literature from PubMed, Web of Science, and Embase databases (2019-2024).

RESULTS

AI assists in cataract diagnosis, classification, preoperative lens calculation, surgical risk, postoperative vision prediction, and follow-up. For glaucoma, AI enhances early diagnosis, progression prediction, and surgical risk assessment. It detects diabetic retinopathy early and predicts treatment effects for diabetic macular edema. AI analyzes fundus images for age-related macular degeneration (AMD) diagnosis and risk prediction. Additionally, AI quantifies and grades vitreous opacities in uveitis. For retinopathy of prematurity, AI facilitates disease classification, predicting disease occurrence and severity. Recently, AI also predicts systemic diseases by analyzing fundus vascular changes.

CONCLUSIONS

AI has been extensively used in diagnosing, following up, and predicting treatment outcomes for common blinding eye diseases. In addition, it also has a unique role in the prediction of systemic diseases.

Implementation of anterior segment ophthalmic telemedicine

PURPOSE OF REVIEW

The growing push to integrate telemedicine into ophthalmic practices requires physicians to have a thorough understanding of ophthalmic telemedicine's applications, limitations, and recent advances in order to provide well tolerated and appropriate clinical care. This review aims to provide an overview of recent advancements in the use of ophthalmic telemedicine for anterior segment eye examinations.

RECENT FINDINGS

Virtual care for anterior segment evaluation relies on appropriate technology, novel workflows, and appropriate clinical case selection. Recent advances, particularly in the wake of the COVID-19 pandemic, have highlighted the utility of home-based assessments for visual acuity, external evaluation, tonometry, and refraction. Additionally, innovative workflows incorporating office-based testing into virtual care, termed 'hybrid telemedicine', enable high-quality ophthalmic testing to inform clinical decision-making.

SUMMARY

Novel digital tools and workflows enable high-quality anterior segment evaluation and management for select ophthalmic concerns. This review highlights the clinical tools and workflows necessary to enable anterior segment telehealth.

Development of the AI Pipeline for Corneal Opacity Detection

Ophthalmological services face global inadequacies, especially in low- and middle-income countries, which are marked by a shortage of practitioners and equipment. This study employed a portable slit lamp microscope with video capabilities and cloud storage for more equitable global diagnostic resource distribution. To enhance accessibility and quality of care, this study targets corneal opacity, which is a global cause of blindness. This study has two purposes. The first is to detect corneal opacity from videos in which the anterior segment of the eye is captured. The other is to develop an AI pipeline to detect corneal opacities. First, we extracted image frames from videos and processed them using a convolutional neural network (CNN) model. Second, we manually annotated the images to extract only the corneal margins, adjusted the contrast with CLAHE, and processed them using the CNN model. Finally, we performed semantic segmentation of the cornea using annotated data. The results showed an accuracy of 0.8 for image frames and 0.96 for corneal margins. Dice and IoU achieved a score of 0.94 for semantic segmentation of the corneal margins. Although corneal opacity detection from video frames seemed challenging in the early stages of this study, manual annotation, corneal extraction, and CLAHE contrast adjustment significantly improved accuracy. The incorporation of manual annotation into the AI pipeline, through semantic segmentation, facilitated high accuracy in detecting corneal opacity.

Adaptive enhancement of cataractous retinal images for contrast standardization

Cataract affects the quality of fundus images, especially the contrast, due to lens opacity. In this paper, we propose a scheme to enhance different cataractous retinal images to the same contrast as normal images, which can automatically choose the suitable enhancement model based on cataract grading. A multi-level cataract dataset is constructed via the degradation model with quantified contrast. Then, an adaptive enhancement strategy is introduced to choose among three enhancement networks based on a blurriness classifier. The blurriness grading loss is proposed in the enhancement models to further constrain the contrast of the enhanced images. During test, the well-trained blurriness classifier can assist in the selection of enhancement networks with specific enhancement ability. Our method performs the best on the synthetic paired data on PSNR, SSIM, and FSIM and has the best PIQE and FID on 406 clinical fundus images. There is a 7.78% improvement for our method compared with the second on the introduced [Formula: see text] score without over-enhancement according to [Formula: see text], which demonstrates that the proper enhancement by our method is close to the high-quality images. The visual evaluation on multiple clinical datasets also shows the applicability of our method for different blurriness. The proposed method can benefit clinical diagnosis and improve the performance of computer-aided algorithms such as vessel tracking and vessel segmentation.

Cataract Classification Systems: A Review

Cataract is among the leading causes of visual impairment worldwide. Innovations in treatment have drastically improved patient outcomes, but to be properly implemented, it is necessary to have the right diagnostic tools. This review explores the cataract grading systems developed by researchers in recent decades and provides insight into both merits and limitations. To this day, the gold standard for cataract classification is the Lens Opacity Classification System III. Different cataract features are graded according to standard photographs during slit lamp examination. Although widely used in research, its clinical application is rare, and it is limited by its subjective nature. Meanwhile, recent advancements in imaging technology, notably Scheimpflug imaging and optical coherence tomography, have opened the possibility of objective assessment of lens structure. With the use of automatic lens anatomy detection software, researchers demonstrated a good correlation to functional and surgical metrics such as visual acuity, phacoemulsification energy, and surgical time. The development of deep learning networks has further increased the capability of these grading systems by improving interpretability and increasing robustness when applied to norm-deviating cases. These classification systems, which can be used for both screening and preoperative diagnostics, are of value for targeted prospective studies, but still require implementation and validation in everyday clinical practice.

Application of artificial intelligence for automatic cataract staging based on anterior segment images: comparing automatic segmentation approaches to manual segmentation

Purpose

Cataract is one of the leading causes of blindness worldwide, accounting for >50% of cases of blindness in low- and middle-income countries. In this study, two artificial intelligence (AI) diagnosis platforms are proposed for cortical cataract staging to achieve a precise diagnosis.

Methods

A total of 647 high quality anterior segment images, which included the four stages of cataracts, were collected into the dataset. They were divided randomly into a training set and a test set using a stratified random-allocation technique at a ratio of 8:2. Then, after automatic or manual segmentation of the lens area of the cataract, the deep transform-learning (DTL) features extraction, PCA dimensionality reduction, multi-features fusion, fusion features selection, and classification models establishment, the automatic and manual segmentation DTL platforms were developed. Finally, the accuracy, confusion matrix, and area under the receiver operating characteristic (ROC) curve (AUC) were used to evaluate the performance of the two platforms.

Results

In the automatic segmentation DTL platform, the accuracy of the model in the training and test sets was 94.59 and 84.50%, respectively. In the manual segmentation DTL platform, the accuracy of the model in the training and test sets was 97.48 and 90.00%, respectively. In the test set, the micro and macro average AUCs of the two platforms reached >95% and the AUC for each classification was >90%. The results of a confusion matrix showed that all stages, except for mature, had a high recognition rate.

Conclusion

Two AI diagnosis platforms were proposed for cortical cataract staging. The resulting automatic segmentation platform can stage cataracts more quickly, whereas the resulting manual segmentation platform can stage cataracts more accurately.

Comprehensive Review on the Use of Artificial Intelligence in Ophthalmology and Future Research Directions

BACKGROUND

Having several applications in medicine, and in ophthalmology in particular, artificial intelligence (AI) tools have been used to detect visual function deficits, thus playing a key role in diagnosing eye diseases and in predicting the evolution of these common and disabling diseases. AI tools, i.e., artificial neural networks (ANNs), are progressively involved in detecting and customized control of ophthalmic diseases. The studies that refer to the efficiency of AI in medicine and especially in ophthalmology were analyzed in this review.

MATERIALS AND METHODS

We conducted a comprehensive review in order to collect all accounts published between 2015 and 2022 that refer to these applications of AI in medicine and especially in ophthalmology. Neural networks have a major role in establishing the demand to initiate preliminary anti-glaucoma therapy to stop the advance of the disease.

RESULTS

Different surveys in the literature review show the remarkable benefit of these AI tools in ophthalmology in evaluating the visual field, optic nerve, and retinal nerve fiber layer, thus ensuring a higher precision in detecting advances in glaucoma and retinal shifts in diabetes. We thus identified 1762 applications of artificial intelligence in ophthalmology: review articles and research articles (301 pub med, 144 scopus, 445 web of science, 872 science direct). Of these, we analyzed 70 articles and review papers (diabetic retinopathy (N = 24), glaucoma (N = 24), DMLV (N = 15), other pathologies (N = 7)) after applying the inclusion and exclusion criteria.

CONCLUSION

In medicine, AI tools are used in surgery, radiology, gynecology, oncology, etc., in making a diagnosis, predicting the evolution of a disease, and assessing the prognosis in patients with oncological pathologies. In ophthalmology, AI potentially increases the patient's access to screening/clinical diagnosis and decreases healthcare costs, mainly when there is a high risk of disease or communities face financial shortages. AI/DL (deep learning) algorithms using both OCT and FO images will change image analysis techniques and methodologies. Optimizing these (combined) technologies will accelerate progress in this area.

Integration of Artificial Intelligence into the Approach for Diagnosis and Monitoring of Dry Eye Disease

Dry eye disease (DED) is one of the most common diseases worldwide that can lead to a significant impairment of quality of life. The diagnosis and treatment of the disease are often challenging because of the lack of correlation between the signs and symptoms, limited reliability of diagnostic tests, and absence of established consensus on the diagnostic criteria. The advancement of machine learning, particularly deep learning technology, has enabled the application of artificial intelligence (AI) in various anterior segment disorders, including DED. Currently, many studies have reported promising results of AI-based algorithms for the accurate diagnosis of DED and precise and reliable assessment of data obtained by imaging devices for DED. Thus, the integration of AI into clinical approaches for DED can enhance diagnostic and therapeutic performance. In this review, in addition to a brief summary of the application of AI in anterior segment diseases, we will provide an overview of studies regarding the application of AI in DED and discuss the recent advances in the integration of AI into the clinical approach for DED.