A Deep Learning System for Automated Quality Evaluation of Optic Disc Photographs in Neuro-Ophthalmic Disorders

Retina Fundus Photograph-Based Artificial Intelligence Algorithms in Medicine: A Systematic Review

We conducted a systematic review of research in artificial intelligence (AI) for retinal fundus photographic images. We highlighted the use of various AI algorithms, including deep learning (DL) models, for application in ophthalmic and non-ophthalmic (i.e., systemic) disorders. We found that the use of AI algorithms for the interpretation of retinal images, compared to clinical data and physician experts, represents an innovative solution with demonstrated superior accuracy in identifying many ophthalmic (e.g., diabetic retinopathy (DR), age-related macular degeneration (AMD), optic nerve disorders), and non-ophthalmic disorders (e.g., dementia, cardiovascular disease). There has been a significant amount of clinical and imaging data for this research, leading to the potential incorporation of AI and DL for automated analysis. AI has the potential to transform healthcare by improving accuracy, speed, and workflow, lowering cost, increasing access, reducing mistakes, and transforming healthcare worker education and training.

Diagnostic dilemma of papilledema and pseudopapilledema

BACKGROUND

Papilledema is the optic disc swelling caused by increased intracranial pressure (ICP) that can damage the optic nerve and cause subsequent vision loss. Pseudopapilledema refers to optic disc elevation without peripapillary fluid that can arise from several optic disc disorders, with optic disc drusen (ODD) being the most frequent cause. Occasionally, pseudopapilledema patients are mistakenly diagnosed as papilledema, leading to the possibility of unneeded procedures. We aim to thoroughly examine the most current evidence on papilledema and pseudopapilledema causes and several methods for distinguishing between both conditions.

METHODS

An extensive literature search was conducted on electronic databases including PubMed and google scholar using keywords that were relevant to the assessed pathologies. Data were collected and then summarized in comprehensive form.

RESULTS

Various techniques are employed to distinguish between papilledema and pseudopapilledema. These techniques include Fundus fluorescein angiography, optical coherence tomography, ultrasonography, and magnetic resonance imaging. Lumbar puncture and other invasive procedures may be needed if results are suspicious.

CONCLUSION

Papilledema is a sight-threatening condition that may lead to visual affection. Many disc conditions may mimic papilledema. Accordingly, differentiation between papilledema and pseudopailledema is crucial and can be conducted through many modalities.

Application of a Deep Learning System to Detect Papilledema on Nonmydriatic Ocular Fundus Photographs in an Emergency Department

PURPOSE

The Fundus photography vs Ophthalmoscopy Trial Outcomes in the Emergency Department (FOTO-ED) studies showed that ED providers poorly recognized funduscopic findings in patients in the ED. We tested a modified version of the Brain and Optic Nerve Study Artificial Intelligence (BONSAI) deep learning system on nonmydriatic fundus photographs from the FOTO-ED studies to determine if the deep learning system could have improved the detection of papilledema had it been available to ED providers as a real-time diagnostic aid.

DESIGN

Retrospective secondary analysis of a cohort of patients included in the FOTO-ED studies.

METHODS

The testing data set included 1608 photographs obtained from 828 patients in the FOTO-ED studies. Photographs were reclassified according to the optic disc classification system used by the deep learning system ("normal optic discs," "papilledema," and "other optic disc abnormalities"). The system's performance was evaluated by calculating the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity using a 1-vs-rest strategy, with reference to expert neuro-ophthalmologists.

RESULTS

The BONSAI deep learning system successfully distinguished normal from abnormal optic discs (AUC 0.92 [95% confidence interval {CI} 0.90-0.93]; sensitivity 75.6% [73.7%-77.5%] and specificity 89.6% [86.3%-92.8%]), and papilledema from normal and others (AUC 0.97 [0.95-0.99]; sensitivity 84.0% [75.0%-92.6%] and specificity 98.9% [98.5%-99.4%]). Six patients with missed papilledema in 1 eye were correctly identified by the deep learning system as having papilledema in the other eye.

CONCLUSIONS

The BONSAI deep learning system was able to reliably identify papilledema and normal optic discs on nonmydriatic photographs obtained in the FOTO-ED studies. Our deep learning system has excellent potential as a diagnostic aid in EDs and non-ophthalmology clinics equipped with nonmydriatic fundus cameras. NOTE: Publication of this article is sponsored by the American Ophthalmological Society.

Enhancing Retinal Fundus Image Quality Assessment With Swin-Transformer-Based Learning Across Multiple Color-Spaces

Purpose

The assessment of retinal image (RI) quality holds significant importance in both clinical trials and large datasets, because suboptimal images can potentially conceal early signs of diseases, thereby resulting in inaccurate medical diagnoses. This study aims to develop an automatic method for Retinal Image Quality Assessment (RIQA) that incorporates visual explanations, aiming to comprehensively evaluate the quality of retinal fundus images (RIs).

Methods

We developed an automatic RIQA system, named Swin-MCSFNet, utilizing 28,792 RIs from the EyeQ dataset, as well as 2000 images from the EyePACS dataset and an additional 1,000 images from the OIA-ODIR dataset. After preprocessing, including cropping black regions, data augmentation, and normalization, a Swin-MCSFNet classifier based on the Swin-Transformer for multiple color-space fusion was proposed to grade the quality of RIs. The generalizability of Swin-MCSFNet was validated across multiple data centers. Additionally, for enhanced interpretability, a Score-CAM-generated heatmap was applied to provide visual explanations.

Results

Experimental results reveal that the proposed Swin-MCSFNet achieves promising performance, yielding a micro-receiver operating characteristic (ROC) of 0.93 and ROC scores of 0.96, 0.81, and 0.96 for the "Good," "Usable," and "Reject" categories, respectively. These scores underscore the accuracy of RIQA based on Swin-MCSF in distinguishing among the three categories. Furthermore, heatmaps generated across different RIQA classification scores and various color spaces suggest that regions in the retinal images from multiple color spaces contribute significantly to the decision-making process of the Swin-MCSFNet classifier.

Conclusions

Our study demonstrates that the proposed Swin-MCSFNet outperforms other methods in experiments conducted on multiple datasets, as evidenced by the superior performance metrics and insightful Score-CAM heatmaps.

Translational Relevance

This study constructs a new retinal image quality evaluation system, which will contribute to the subsequent research of retinal images.

The Current State of Artificial Intelligence in Neuro-Ophthalmology. A Review

This article presents a summary of recent advances in the development and use of complex systems using artificial intelligence (AI) in neuro-ophthalmology. The aim of the following article is to present the principles of AI and algorithms that are currently being used or are still in the stage of evaluation or validation within the neuro-ophthalmology environment. For the purpose of this text, a literature search was conducted using specific keywords in available scientific databases, cumulatively up to April 2023. The AI systems developed across neuro-ophthalmology mostly achieve high sensitivity, specificity and accuracy. Individual AI systems and algorithms are subsequently selected, simply described and compared in the article. The results of the individual studies differ significantly, depending on the chosen methodology, the set goals, the size of the test, evaluated set, and the evaluated parameters. It has been demonstrated that the evaluation of various diseases will be greatly speeded up with the help of AI and make the diagnosis more efficient in the future, thus showing a high potential to be a useful tool in clinical practice even with a significant increase in the number of patients.