Prediction of treatment outcome in neovascular age-related macular degeneration using a novel convolutional neural network

Artificial intelligence in individualized retinal disease management

Owing to the rapid development of modern computer technologies, artificial intelligence (AI) has emerged as an essential instrument for intelligent analysis across a range of fields. AI has been proven to be highly effective in ophthalmology, where it is frequently used for identifying, diagnosing, and typing retinal diseases. An increasing number of researchers have begun to comprehensively map patients' retinal diseases using AI, which has made individualized clinical prediction and treatment possible. These include prognostic improvement, risk prediction, progression assessment, and interventional therapies for retinal diseases. Researchers have used a range of input data methods to increase the accuracy and dependability of the results, including the use of tabular, textual, or image-based input data. They also combined the analyses of multiple types of input data. To give ophthalmologists access to precise, individualized, and high-quality treatment strategies that will further optimize treatment outcomes, this review summarizes the latest findings in AI research related to the prediction and guidance of clinical diagnosis and treatment of retinal diseases.

Associations of presenting visual acuity with morphological changes on OCT in neovascular age-related macular degeneration: PRECISE Study Report 2

PURPOSE

To study associations of optical coherence tomography (OCT) features with presenting visual acuity (VA) in treatment naive neovascular age-related macular degeneration (nAMD).

METHODS

Patients with nAMD initiated on aflibercept therapy were recruited from December 2019 to August 2021. Demographic and OCT (Spectralis, Heidelberg Engineering) features associated with good VA (VA ≥ 68 ETDRS letters, Snellen ≥ 6/12) and poor VA (VA < 54 letters, Snellen < 6/18) were analysed using Generalised Estimating Equations to account for inter-eye correlation.

RESULTS

Of 2274 eyes of 2128 patients enrolled, 2039 eyes of 1901 patients with complete data were analysed. Mean age was 79.4 (SD 7.8) years, female:male 3:2 and mean VA 58.0 (SD 14.5) letters. On multivariable analysis VA < 54 letters was associated with increased central subfield thickness (CST) (OR 1.40 per 100 µm; P < 0.001), foveal intraretinal fluid (OR 2.14; P < 0.001), polypoidal vasculopathy (PCV) relative to Type 1 macular neovascularisation (MNV) (OR 1.66; P = 0.049), presence of foveal subretinal hyperreflective material (SHRM) (OR 1.73; P = 0.002), foveal fibrosis (OR 3.85; P < 0.001), foveal atrophy (OR 5.54; P < 0.001), loss of integrity of the foveal ellipsoid zone (EZ) or external limiting membrane (ELM) relative to their preservation (OR 3.83; P < 0.001) and absence of subretinal drusenoid deposits (SDD) (presence vs absence; OR 0.75; P = 0.04). These features were associated with reduced odds of VA ≥ 68 letters except MNV subtypes and SDD.

CONCLUSION

Presence of baseline fovea-involving atrophy, fibrosis, intraretinal fluid, SHRM, PCV EZ/ELM loss and increased CST determine poor presenting VA. This highlights the need for early detection and treatment prior to structural changes that worsen baseline VA.

Deep learning in optical coherence tomography: Where are the gaps?

Optical coherence tomography (OCT) is a non-invasive optical imaging modality, which provides rapid, high-resolution and cross-sectional morphology of macular area and optic nerve head for diagnosis and managing of different eye diseases. However, interpreting OCT images requires experts in both OCT images and eye diseases since many factors such as artefacts and concomitant diseases can affect the accuracy of quantitative measurements made by post-processing algorithms. Currently, there is a growing interest in applying deep learning (DL) methods to analyse OCT images automatically. This review summarises the trends in DL-based OCT image analysis in ophthalmology, discusses the current gaps, and provides potential research directions. DL in OCT analysis shows promising performance in several tasks: (1) layers and features segmentation and quantification; (2) disease classification; (3) disease progression and prognosis; and (4) referral triage level prediction. Different studies and trends in the development of DL-based OCT image analysis are described and the following challenges are identified and described: (1) public OCT data are scarce and scattered; (2) models show performance discrepancies in real-world settings; (3) models lack of transparency; (4) there is a lack of societal acceptance and regulatory standards; and (5) OCT is still not widely available in underprivileged areas. More work is needed to tackle the challenges and gaps, before DL is further applied in OCT image analysis for clinical use.

Assistive applications of artificial intelligence in ophthalmology

PURPOSE OF REVIEW

Assistive (nonautonomous) artificial intelligence (AI) models designed to support (rather than function independently of) clinicians have received increasing attention in medicine. This review aims to highlight several recent developments in these models over the past year and their ophthalmic implications.

RECENT FINDINGS

Artificial intelligence models with a diverse range of applications in ophthalmology have been reported in the literature over the past year. Many of these systems have reported high performance in detection, classification, prognostication, and/or monitoring of retinal, glaucomatous, anterior segment, and other ocular pathologies.

SUMMARY

Over the past year, developments in AI have been made that have implications affecting ophthalmic surgical training and refractive outcomes after cataract surgery, therapeutic monitoring of disease, disease classification, and prognostication. Many of these recently developed models have obtained encouraging results and have the potential to serve as powerful clinical decision-making tools pending further external validation and evaluation of their generalizability.

PREDICTING VISUAL OUTCOME AFTER SURGERY IN PATIENTS WITH IDIOPATHIC EPIRETINAL MEMBRANE USING A NOVEL CONVOLUTIONAL NEURAL NETWORK

PURPOSE

To develop a deep convolutional neural network that enables the prediction of postoperative visual outcomes after epiretinal membrane surgery based on preoperative optical coherence tomography images and clinical parameters to refine surgical decision making.

METHODS

A total of 529 patients with idiopathic epiretinal membrane who underwent standard vitrectomy with epiretinal membrane peeling surgery by two surgeons between January 1, 2014, and June 1, 2020, were enrolled. The newly developed Heterogeneous Data Fusion Net was introduced to predict postoperative visual acuity outcomes (improvement ≥2 lines in Snellen chart) 12 months after surgery based on preoperative cross-sectional optical coherence tomography images and clinical factors, including age, sex, and preoperative visual acuity. The predictive accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve of the convolutional neural network model were evaluated.

RESULTS

The developed model demonstrated an overall accuracy for visual outcome prediction of 88.68% (95% CI, 79.0%-95.7%) with an area under the receiver operating characteristic curve of 97.8% (95% CI, 86.8%-98.0%), sensitivity of 87.0% (95% CI, 67.9%-95.5%), specificity of 92.9% (95% CI, 77.4%-98.0%), precision of 0.909, recall of 0.870, and F1 score of 0.889. The heatmaps identified the critical area for prediction as the ellipsoid zone of photoreceptors and the superficial retina, which was subjected to tangential traction of the proliferative membrane.

CONCLUSION

The novel Heterogeneous Data Fusion Net demonstrated high accuracy in the automated prediction of visual outcomes after weighing and leveraging multiple clinical parameters, including optical coherence tomography images. This approach may be helpful in establishing personalized therapeutic strategies for epiretinal membrane management.

Prediction of anti-vascular endothelial growth factor agent-specific treatment outcomes in neovascular age-related macular degeneration using a generative adversarial network

To develop an artificial intelligence (AI) model that predicts anti-vascular endothelial growth factor (VEGF) agent-specific anatomical treatment outcomes in neovascular age-related macular degeneration (AMD), thereby assisting clinicians in selecting the most suitable anti-VEGF agent for each patient. This retrospective study included patients diagnosed with neovascular AMD who received three loading injections of either ranibizumab or aflibercept. Training was performed using optical coherence tomography (OCT) images with an attention generative adversarial network (GAN) model. To test the performance of the AI model, the sensitivity and specificity to predict the presence of retinal fluid after treatment were calculated for the AI model, an experienced (Examiner 1), and a less experienced (Examiner 2) human examiners. A total of 1684 OCT images from 842 patients (419 treated with ranibizumab and 423 treated with aflibercept) were used as the training set. Testing was performed using images from 98 patients. In patients treated with ranibizumab, the sensitivity and specificity, respectively, were 0.615 and 0.667 for the AI model, 0.385 and 0.861 for Examiner 1, and 0.231 and 0.806 for Examiner 2. In patients treated with aflibercept, the sensitivity and specificity, respectively, were 0.857 and 0.881 for the AI model, 0.429 and 0.976 for Examiner 1, and 0.429 and 0.857 for Examiner 2. In 18.5% of cases, the fluid status of synthetic posttreatment images differed between ranibizumab and aflibercept. The AI model using GAN might predict anti-VEGF agent-specific short-term treatment outcomes with relatively higher sensitivity than human examiners. Additionally, there was a difference in the efficacy in fluid resolution between the anti-VEGF agents. These results suggest the potential of AI in personalized medicine for patients with neovascular AMD.

Research progress on diagnosing retinal vascular diseases based on artificial intelligence and fundus images

As the only blood vessels that can directly be seen in the whole body, pathological changes in retinal vessels are related to the metabolic state of the whole body and many systems, which seriously affect the vision and quality of life of patients. Timely diagnosis and treatment are key to improving vision prognosis. In recent years, with the rapid development of artificial intelligence, the application of artificial intelligence in ophthalmology has become increasingly extensive and in-depth, especially in the field of retinal vascular diseases. Research study results based on artificial intelligence and fundus images are remarkable and provides a great possibility for early diagnosis and treatment. This paper reviews the recent research progress on artificial intelligence in retinal vascular diseases (including diabetic retinopathy, hypertensive retinopathy, retinal vein occlusion, retinopathy of prematurity, and age-related macular degeneration). The limitations and challenges of the research process are also discussed.

An overview of artificial intelligence in diabetic retinopathy and other ocular diseases

Artificial intelligence (AI), also known as machine intelligence, is a branch of science that empowers machines using human intelligence. AI refers to the technology of rendering human intelligence through computer programs. From healthcare to the precise prevention, diagnosis, and management of diseases, AI is progressing rapidly in various interdisciplinary fields, including ophthalmology. Ophthalmology is at the forefront of AI in medicine because the diagnosis of ocular diseases heavy reliance on imaging. Recently, deep learning-based AI screening and prediction models have been applied to the most common visual impairment and blindness diseases, including glaucoma, cataract, age-related macular degeneration (ARMD), and diabetic retinopathy (DR). The success of AI in medicine is primarily attributed to the development of deep learning algorithms, which are computational models composed of multiple layers of simulated neurons. These models can learn the representations of data at multiple levels of abstraction. The Inception-v3 algorithm and transfer learning concept have been applied in DR and ARMD to reuse fundus image features learned from natural images (non-medical images) to train an AI system with a fraction of the commonly used training data (<1%). The trained AI system achieved performance comparable to that of human experts in classifying ARMD and diabetic macular edema on optical coherence tomography images. In this study, we highlight the fundamental concepts of AI and its application in these four major ocular diseases and further discuss the current challenges, as well as the prospects in ophthalmology.