Automated detection of a nonperfusion area caused by retinal vein occlusion in optical coherence tomography angiography images using deep learning

Artificial intelligence in therapeutic management of hyperlipidemic ocular pathology

Hyperlipidemia has many ocular manifestations, the most prevalent being retinal vascular occlusion. Hyperlipidemic lesions and occlusions to the vessels supplying the retina result in permanent blindness, necessitating prompt detection and treatment. Retinal vascular occlusion is diagnosed using different imaging modalities, including optical coherence tomography angiography. These diagnostic techniques obtain images representing the blood flow through the retinal vessels, providing an opportunity for AI to utilize image recognition to detect blockages and abnormalities before patients present with symptoms. AI is already being used as a non-invasive method to detect retinal vascular occlusions and other vascular pathology, as well as predict treatment outcomes. As providers see an increase in patients presenting with new retinal vascular occlusions, the use of AI to detect and treat these conditions has the potential to improve patient outcomes and reduce the financial burden on the healthcare system. This article comprehends the implications of AI in the current management strategies of retinal vascular occlusion (RVO) in hyperlipidemia and the recent developments of AI technology in the management of ocular diseases.

Multi-Plexus Nonperfusion Area Segmentation in Widefield OCT Angiography Using a Deep Convolutional Neural Network

Purpose

To train and validate a convolutional neural network to segment nonperfusion areas (NPAs) in multiple retinal vascular plexuses on widefield optical coherence tomography angiography (OCTA).

Methods

This cross-sectional study included 202 participants with a full range of diabetic retinopathy (DR) severities (diabetes mellitus without retinopathy, mild to moderate non-proliferative DR, severe non-proliferative DR, and proliferative DR) and 39 healthy participants. Consecutive 6 × 6-mm OCTA scans at the central macula, optic disc, and temporal region in one eye from 202 participants in a clinical DR study were acquired with a 70-kHz OCT commercial system (RTVue-XR). Widefield OCTA en face images were generated by montaging the scans from these three regions. A projection-resolved OCTA algorithm was applied to remove projection artifacts at the voxel scale. A deep convolutional neural network with a parallel U-Net module was designed to detect NPAs and distinguish signal reduction artifacts from flow deficits in the superficial vascular complex (SVC), intermediate capillary plexus (ICP), and deep capillary plexus (DCP). Expert graders manually labeled NPAs and signal reduction artifacts for the ground truth. Sixfold cross-validation was used to evaluate the proposed algorithm on the entire dataset.

Results

The proposed algorithm showed high agreement with the manually delineated ground truth for NPA detection in three retinal vascular plexuses on widefield OCTA (mean ± SD F-score: SVC, 0.84 ± 0.05; ICP, 0.87 ± 0.04; DCP, 0.83 ± 0.07). The extrafoveal avascular area in the DCP showed the best sensitivity for differentiating eyes with diabetes but no retinopathy (77%) from healthy controls and for differentiating DR by severity: DR versus no DR, 77%; referable DR (rDR) versus non-referable DR (nrDR), 79%; vision-threatening DR (vtDR) versus non-vision-threatening DR (nvtDR), 60%. The DCP also showed the best area under the receiver operating characteristic curve for distinguishing diabetes from healthy controls (96%), DR versus no DR (95%), and rDR versus nrDR (96%). The three-plexus-combined OCTA achieved the best result in differentiating vtDR and nvtDR (81.0%).

Conclusions

A deep learning network can accurately segment NPAs in individual retinal vascular plexuses and improve DR diagnostic accuracy.

Translational Relevance

Using a deep learning method to segment nonperfusion areas in widefield OCTA can potentially improve the diagnostic accuracy of diabetic retinopathy by OCT/OCTA systems.

Novel Approaches for Early Detection of Retinal Diseases Using Artificial Intelligence

BACKGROUND

An increasing amount of people are globally affected by retinal diseases, such as diabetes, vascular occlusions, maculopathy, alterations of systemic circulation, and metabolic syndrome.

AIM

This review will discuss novel technologies in and potential approaches to the detection and diagnosis of retinal diseases with the support of cutting-edge machines and artificial intelligence (AI).

METHODS

The demand for retinal diagnostic imaging exams has increased, but the number of eye physicians or technicians is too little to meet the request. Thus, algorithms based on AI have been used, representing valid support for early detection and helping doctors to give diagnoses and make differential diagnosis. AI helps patients living far from hub centers to have tests and quick initial diagnosis, allowing them not to waste time in movements and waiting time for medical reply.

RESULTS

Highly automated systems for screening, early diagnosis, grading and tailored therapy will facilitate the care of people, even in remote lands or countries.

CONCLUSION

A potential massive and extensive use of AI might optimize the automated detection of tiny retinal alterations, allowing eye doctors to perform their best clinical assistance and to set the best options for the treatment of retinal diseases.

Deep learning segmentation of non-perfusion area from color fundus images and AI-generated fluorescein angiography

The non-perfusion area (NPA) of the retina is an important indicator in the visual prognosis of patients with branch retinal vein occlusion (BRVO). However, the current evaluation method of NPA, fluorescein angiography (FA), is invasive and burdensome. In this study, we examined the use of deep learning models for detecting NPA in color fundus images, bypassing the need for FA, and we also investigated the utility of synthetic FA generated from color fundus images. The models were evaluated using the Dice score and Monte Carlo dropout uncertainty. We retrospectively collected 403 sets of color fundus and FA images from 319 BRVO patients. We trained three deep learning models on FA, color fundus images, and synthetic FA. As a result, though the FA model achieved the highest score, the other two models also performed comparably. We found no statistical significance in median Dice scores between the models. However, the color fundus model showed significantly higher uncertainty than the other models (p < 0.05). In conclusion, deep learning models can detect NPAs from color fundus images with reasonable accuracy, though with somewhat less prediction stability. Synthetic FA stabilizes the prediction and reduces misleading uncertainty estimates by enhancing image quality.

Artificial Intelligence (AI) for Early Diagnosis of Retinal Diseases

Artificial intelligence (AI) has emerged as a transformative tool in the field of ophthalmology, revolutionizing disease diagnosis and management. This paper provides a comprehensive overview of AI applications in various retinal diseases, highlighting its potential to enhance screening efficiency, facilitate early diagnosis, and improve patient outcomes. Herein, we elucidate the fundamental concepts of AI, including machine learning (ML) and deep learning (DL), and their application in ophthalmology, underscoring the significance of AI-driven solutions in addressing the complexity and variability of retinal diseases. Furthermore, we delve into the specific applications of AI in retinal diseases such as diabetic retinopathy (DR), age-related macular degeneration (AMD), Macular Neovascularization, retinopathy of prematurity (ROP), retinal vein occlusion (RVO), hypertensive retinopathy (HR), Retinitis Pigmentosa, Stargardt disease, best vitelliform macular dystrophy, and sickle cell retinopathy. We focus on the current landscape of AI technologies, including various AI models, their performance metrics, and clinical implications. Furthermore, we aim to address challenges and pitfalls associated with the integration of AI in clinical practice, including the "black box phenomenon", biases in data representation, and limitations in comprehensive patient assessment. In conclusion, this review emphasizes the collaborative role of AI alongside healthcare professionals, advocating for a synergistic approach to healthcare delivery. It highlights the importance of leveraging AI to augment, rather than replace, human expertise, thereby maximizing its potential to revolutionize healthcare delivery, mitigate healthcare disparities, and improve patient outcomes in the evolving landscape of medicine.

Artificial intelligence to distinguish retinal vein occlusion patients using color fundus photographs

PURPOSE

Our aim is to establish an AI model for distinguishing color fundus photographs (CFP) of RVO patients from normal individuals.

METHODS

The training dataset included 2013 CFP from fellow eyes of RVO patients and 8536 age- and gender-matched normal CFP. Model performance was assessed in two independent testing datasets. We evaluated the performance of the AI model using the area under the receiver operating characteristic curve (AUC), accuracy, precision, specificity, sensitivity, and confusion matrices. We further explained the probable clinical relevance of the AI by extracting and comparing features of the retinal images.

RESULTS

Our model achieved an average AUC was 0.9866 (95% CI: 0.9805-0.9918), accuracy was 0.9534 (95% CI: 0.9421-0.9639), precision was 0.9123 (95% CI: 0.8784-9453), specificity was 0.9810 (95% CI: 0.9729-0.9884), and sensitivity was 0.8367 (95% CI: 0.7953-0.8756) for identifying fundus images of RVO patients in training dataset. In independent external datasets 1, the AUC of the RVO group was 0.8102 (95% CI: 0.7979-0.8226), the accuracy of 0.7752 (95% CI: 0.7633-0.7875), the precision of 0.7041 (95% CI: 0.6873-0.7211), specificity of 0.6499 (95% CI: 0.6305-0.6679) and sensitivity of 0.9124 (95% CI: 0.9004-0.9241) for RVO group. There were significant differences in retinal arteriovenous ratio, optic cup to optic disc ratio, and optic disc tilt angle (p = 0.001, p = 0.0001, and p = 0.0001, respectively) between the two groups in training dataset.

CONCLUSION

We trained an AI model to classify color fundus photographs of RVO patients with stable performance both in internal and external datasets. This may be of great importance for risk prediction in patients with retinal venous occlusion.

Optical Coherence Tomography Angiography in Retinal Vascular Disorders

Traditionally, abnormalities of the retinal vasculature and perfusion in retinal vascular disorders, such as diabetic retinopathy and retinal vascular occlusions, have been visualized with dye-based fluorescein angiography (FA). Optical coherence tomography angiography (OCTA) is a newer, alternative modality for imaging the retinal vasculature, which has some advantages over FA, such as its dye-free, non-invasive nature, and depth resolution. The depth resolution of OCTA allows for characterization of the retinal microvasculature in distinct anatomic layers, and commercial OCTA platforms also provide automated quantitative vascular and perfusion metrics. Quantitative and qualitative OCTA analysis in various retinal vascular disorders has facilitated the detection of pre-clinical vascular changes, greater understanding of known clinical signs, and the development of imaging biomarkers to prognosticate and guide treatment. With further technological improvements, such as a greater field of view and better image quality processing algorithms, it is likely that OCTA will play an integral role in the study and management of retinal vascular disorders. Artificial intelligence methods-in particular, deep learning-show promise in refining the insights to be gained from the use of OCTA in retinal vascular disorders. This review aims to summarize the current literature on this imaging modality in relation to common retinal vascular disorders.

Deep learning for artery-vein classification in optical coherence tomography angiography

Major retinopathies can differentially impact the arteries and veins. Traditional fundus photography provides limited resolution for visualizing retinal vascular details. Optical coherence tomography (OCT) can provide improved resolution for retinal imaging. However, it cannot discern capillary-level structures due to the limited image contrast. As a functional extension of OCT modality, optical coherence tomography angiography (OCTA) is a non-invasive, label-free method for enhanced contrast visualization of retinal vasculatures at the capillary level. Recently differential artery-vein (AV) analysis in OCTA has been demonstrated to improve the sensitivity for staging of retinopathies. Therefore, AV classification is an essential step for disease detection and diagnosis. However, current methods for AV classification in OCTA have employed multiple imagers, that is, fundus photography and OCT, and complex algorithms, thereby making it difficult for clinical deployment. On the contrary, deep learning (DL) algorithms may be able to reduce computational complexity and automate AV classification. In this article, we summarize traditional AV classification methods, recent DL methods for AV classification in OCTA, and discuss methods for interpretability in DL models.

Application effect of an artificial intelligence-based fundus screening system: evaluation in a clinical setting and population screening

BACKGROUND

To investigate the application effect of artificial intelligence (AI)-based fundus screening system in real-world clinical environment.

METHODS

A total of 637 color fundus images were included in the analysis of the application of the AI-based fundus screening system in the clinical environment and 20,355 images were analyzed in the population screening.

RESULTS

The AI-based fundus screening system demonstrated superior diagnostic effectiveness for diabetic retinopathy (DR), retinal vein occlusion (RVO) and pathological myopia (PM) according to gold standard referral. The sensitivity, specificity, accuracy, positive predictive value (PPV) and negative predictive value (NPV) of three fundus abnormalities were greater (all > 80%) than those for age-related macular degeneration (ARMD), referable glaucoma and other abnormalities. The percentages of different diagnostic conditions were similar in both the clinical environment and the population screening.

CONCLUSIONS

In a real-world setting, our AI-based fundus screening system could detect 7 conditions, with better performance for DR, RVO and PM. Testing in the clinical environment and through population screening demonstrated the clinical utility of our AI-based fundus screening system in the early detection of ocular fundus abnormalities and the prevention of blindness.

Research progress on diagnosing retinal vascular diseases based on artificial intelligence and fundus images

As the only blood vessels that can directly be seen in the whole body, pathological changes in retinal vessels are related to the metabolic state of the whole body and many systems, which seriously affect the vision and quality of life of patients. Timely diagnosis and treatment are key to improving vision prognosis. In recent years, with the rapid development of artificial intelligence, the application of artificial intelligence in ophthalmology has become increasingly extensive and in-depth, especially in the field of retinal vascular diseases. Research study results based on artificial intelligence and fundus images are remarkable and provides a great possibility for early diagnosis and treatment. This paper reviews the recent research progress on artificial intelligence in retinal vascular diseases (including diabetic retinopathy, hypertensive retinopathy, retinal vein occlusion, retinopathy of prematurity, and age-related macular degeneration). The limitations and challenges of the research process are also discussed.

Deep Learning in Optical Coherence Tomography Angiography: Current Progress, Challenges, and Future Directions

Optical coherence tomography angiography (OCT-A) provides depth-resolved visualization of the retinal microvasculature without intravenous dye injection. It facilitates investigations of various retinal vascular diseases and glaucoma by assessment of qualitative and quantitative microvascular changes in the different retinal layers and radial peripapillary layer non-invasively, individually, and efficiently. Deep learning (DL), a subset of artificial intelligence (AI) based on deep neural networks, has been applied in OCT-A image analysis in recent years and achieved good performance for different tasks, such as image quality control, segmentation, and classification. DL technologies have further facilitated the potential implementation of OCT-A in eye clinics in an automated and efficient manner and enhanced its clinical values for detecting and evaluating various vascular retinopathies. Nevertheless, the deployment of this combination in real-world clinics is still in the "proof-of-concept" stage due to several limitations, such as small training sample size, lack of standardized data preprocessing, insufficient testing in external datasets, and absence of standardized results interpretation. In this review, we introduce the existing applications of DL in OCT-A, summarize the potential challenges of the clinical deployment, and discuss future research directions.

Machine learning classification of multiple sclerosis in children using optical coherence tomography

BACKGROUND

In children, multiple sclerosis (MS) is the ultimate diagnosis in only 1/5 to 1/3 of cases after a first episode of central nervous system (CNS) demyelination. As the visual pathway is frequently affected in MS and other CNS demyelinating disorders (DDs), structural retinal imaging such as optical coherence tomography (OCT) can be used to differentiate MS.

OBJECTIVE

This study aimed to investigate the utility of machine learning (ML) based on OCT features to identify distinct structural retinal features in children with DDs.

METHODS

This study included 512 eyes from 187 (n_eyes = 374) children with demyelinating diseases and 69 (n_eyes = 138) controls. Input features of the analysis comprised of 24 auto-segmented OCT features.

RESULTS

Random Forest classifier with recursive feature elimination yielded the highest predictive values and identified DDs with 75% and MS with 80% accuracy, while multiclass distinction between MS and monophasic DD was performed with 64% accuracy. A set of eight retinal features were identified as the most important features in this classification.

CONCLUSION

This study demonstrates that ML based on OCT features can be used to support a diagnosis of MS in children.

Deep Learning Models for Segmenting Non-perfusion Area of Color Fundus Photographs in Patients With Branch Retinal Vein Occlusion

Purpose

To develop artificial intelligence (AI)-based deep learning (DL) models for automatically detecting the ischemia type and the non-perfusion area (NPA) from color fundus photographs (CFPs) of patients with branch retinal vein occlusion (BRVO).

Methods

This was a retrospective analysis of 274 CFPs from patients diagnosed with BRVO. All DL models were trained using a deep convolutional neural network (CNN) based on 45 degree CFPs covering the fovea and the optic disk. We first trained a DL algorithm to identify BRVO patients with or without the necessity of retinal photocoagulation from 219 CFPs and validated the algorithm on 55 CFPs. Next, we trained another DL algorithm to segment NPA from 104 CFPs and validated it on 29 CFPs, in which the NPA was manually delineated by 3 experienced ophthalmologists according to fundus fluorescein angiography. Both DL models have been cross-validated 5-fold. The recall, precision, accuracy, and area under the curve (AUC) were used to evaluate the DL models in comparison with three types of independent ophthalmologists of different seniority.

Results

In the first DL model, the recall, precision, accuracy, and area under the curve (AUC) were 0.75 ± 0.08, 0.80 ± 0.07, 0.79 ± 0.02, and 0.82 ± 0.03, respectively, for predicting the necessity of laser photocoagulation for BRVO CFPs. The second DL model was able to segment NPA in CFPs of BRVO with an AUC of 0.96 ± 0.02. The recall, precision, and accuracy for segmenting NPA was 0.74 ± 0.05, 0.87 ± 0.02, and 0.89 ± 0.02, respectively. The performance of the second DL model was nearly comparable with the senior doctors and significantly better than the residents.

Conclusion

These results indicate that the DL models can directly identify and segment retinal NPA from the CFPs of patients with BRVO, which can further guide laser photocoagulation. Further research is needed to identify NPA of the peripheral retina in BRVO, or other diseases, such as diabetic retinopathy.

Deep Learning Image Analysis of Optical Coherence Tomography Angiography Measured Vessel Density Improves Classification of Healthy and Glaucoma Eyes

PURPOSE

To compare convolutional neural network (CNN) analysis of en face vessel density images to gradient boosting classifier (GBC) analysis of instrument-provided, feature-based optical coherence tomography angiography (OCTA) vessel density measurements and OCT retinal nerve fiber layer (RNFL) thickness measurements for classifying healthy and glaucomatous eyes.

DESIGN

Comparison of diagnostic approaches.

METHODS

A total of 130 eyes of 80 healthy individuals and 275 eyes of 185 glaucoma patients with optic nerve head (ONH) OCTA and OCT imaging were included. Classification performance of a VGG16 CNN trained and tested on entire en face 4.5 × 4.5-mm radial peripapillary capillary OCTA ONH images was compared to the performance of separate GBC models trained and tested on standard OCTA and OCT measurements. Five-fold cross-validation was used to test predictions for CNNs and GBCs. Areas under the precision recall curves (AUPRC) were calculated to control for training/test set size imbalance and were compared.

RESULTS

Adjusted AUPRCs for GBC models were 0.89 (95% CI = 0.82, 0.92) for whole image vessel density GBC, 0.89 (0.83, 0.92) for whole image capillary density GBC, 0.91 (0.88, 0.93) for combined whole image vessel and whole image capillary density GBC, and 0.93 (0.91, 095) for RNFL thickness GBC. The adjusted AUPRC using CNN analysis of en face vessel density images was 0.97 (0.95, 0.99) resulting in significantly improved classification compared to GBC OCTA-based results and GBC OCT-based results (P ≤ 0.01 for all comparisons).

CONCLUSION

Deep learning en face image analysis improves on feature-based GBC models for classifying healthy and glaucoma eyes.

Automated Diagnosis of Optical Coherence Tomography Angiography (OCTA) Based on Machine Learning Techniques

Diabetic retinopathy (DR) refers to the ophthalmological complications of diabetes mellitus. It is primarily a disease of the retinal vasculature that can lead to vision loss. Optical coherence tomography angiography (OCTA) demonstrates the ability to detect the changes in the retinal vascular system, which can help in the early detection of DR. In this paper, we describe a novel framework that can detect DR from OCTA based on capturing the appearance and morphological markers of the retinal vascular system. This new framework consists of the following main steps: (1) extracting retinal vascular system from OCTA images based on using joint Markov-Gibbs Random Field (MGRF) model to model the appearance of OCTA images and (2) estimating the distance map inside the extracted vascular system to be used as imaging markers that describe the morphology of the retinal vascular (RV) system. The OCTA images, extracted vascular system, and the RV-estimated distance map is then composed into a three-dimensional matrix to be used as an input to a convolutional neural network (CNN). The main motivation for using this data representation is that it combines the low-level data as well as high-level processed data to allow the CNN to capture significant features to increase its ability to distinguish DR from the normal retina. This has been applied on multi-scale levels to include the original full dimension images as well as sub-images extracted from the original OCTA images. The proposed approach was tested on in-vivo data using about 91 patients, which were qualitatively graded by retinal experts. In addition, it was quantitatively validated using datasets based on three metrics: sensitivity, specificity, and overall accuracy. Results showed the capability of the proposed approach, outperforming the current deep learning as well as features-based detecting DR approaches.

Screening of Common Retinal Diseases Using Six-Category Models Based on EfficientNet

Purpose

A six-category model of common retinal diseases is proposed to help primary medical institutions in the preliminary screening of the five common retinal diseases.

Methods

A total of 2,400 fundus images of normal and five common retinal diseases were provided by a cooperative hospital. Two six-category deep learning models of common retinal diseases based on the EfficientNet-B4 and ResNet50 models were trained. The results from the six-category models in this study and the results from a five-category model in our previous study based on ResNet50 were compared. A total of 1,315 fundus images were used to test the models, the clinical diagnosis results and the diagnosis results of the two six-category models were compared. The main evaluation indicators were sensitivity, specificity, F1-score, area under the curve (AUC), 95% confidence interval, kappa and accuracy, and the receiver operator characteristic curves of the two six-category models were compared in the study.

Results

The diagnostic accuracy rate of EfficientNet-B4 model was 95.59%, the kappa value was 94.61%, and there was high diagnostic consistency. The AUC of the normal diagnosis and the five retinal diseases were all above 0.95. The sensitivity, specificity, and F1-score for the diagnosis of normal fundus images were 100, 99.9, and 99.83%, respectively. The specificity and F1-score for RVO diagnosis were 95.68, 98.61, and 93.09%, respectively. The sensitivity, specificity, and F1-score for high myopia diagnosis were 96.1, 99.6, and 97.37%, respectively. The sensitivity, specificity, and F1-score for glaucoma diagnosis were 97.62, 99.07, and 94.62%, respectively. The sensitivity, specificity, and F1-score for DR diagnosis were 90.76, 99.16, and 93.3%, respectively. The sensitivity, specificity, and F1-score for MD diagnosis were 92.27, 98.5, and 91.51%, respectively.

Conclusion

The EfficientNet-B4 model was used to design a six-category model of common retinal diseases. It can be used to diagnose the normal fundus and five common retinal diseases based on fundus images. It can help primary doctors in the screening for common retinal diseases, and give suitable suggestions and recommendations. Timely referral can improve the efficiency of diagnosis of eye diseases in rural areas and avoid delaying treatment.

Artificial intelligence can assist with diagnosing retinal vein occlusion

AIM

To assist with retinal vein occlusion (RVO) screening, artificial intelligence (AI) methods based on deep learning (DL) have been developed to alleviate the pressure experienced by ophthalmologists and discover and treat RVO as early as possible.

METHODS

A total of 8600 color fundus photographs (CFPs) were included for training, validation, and testing of disease recognition models and lesion segmentation models. Four disease recognition and four lesion segmentation models were established and compared. Finally, one disease recognition model and one lesion segmentation model were selected as superior. Additionally, 224 CFPs from 130 patients were included as an external test set to determine the abilities of the two selected models.

RESULTS

Using the Inception-v3 model for disease identification, the mean sensitivity, specificity, and F1 for the three disease types and normal CFPs were 0.93, 0.99, and 0.95, respectively, and the mean area under the curve (AUC) was 0.99. Using the DeepLab-v3 model for lesion segmentation, the mean sensitivity, specificity, and F1 for four lesion types (abnormally dilated and tortuous blood vessels, cotton-wool spots, flame-shaped hemorrhages, and hard exudates) were 0.74, 0.97, and 0.83, respectively.

CONCLUSION

DL models show good performance when recognizing RVO and identifying lesions using CFPs. Because of the increasing number of RVO patients and increasing demand for trained ophthalmologists, DL models will be helpful for diagnosing RVO early in life and reducing vision impairment.

Optical coherence tomography (OCT) angiolytics: a review of OCT angiography quantitative biomarkers

Optical coherence tomography angiography (OCTA) provides a non-invasive method to obtain angiography of the chorioretinal vasculature leading to its recent widespread adoption. With a growing number of studies exploring the use of OCTA, various biomarkers quantifying the vascular characteristics have come to light. In the current report, we summarize the biomarkers currently described for retinal and choroidal vasculature using OCTA systems and the methods used to obtain them. Further, we present a critical review of these methods and key findings in common retinal diseases and appraise future directions, including applications of artificial intelligence in OCTA .

Narrative review of artificial intelligence in diabetic macular edema: Diagnosis and predicting treatment response using optical coherence tomography

Diabetic macular edema (DME), being a frequent manifestation of DR, disrupts the retinal symmetry. This event is particularly triggered by vascular endothelial growth factors (VEGF). Intravitreal injections of anti-VEGFs have been the most practiced treatment but an expensive option. A major challenge associated with this treatment is determining an optimal treatment regimen and differentiating patients who do not respond to anti-VEGF. As it has a significant burden for both the patient and the health care providers if the patient is not responding, any clinically acceptable method to predict the treatment outcomes holds huge value in the efficient management of DME. In such situations, artificial intelligence (AI) or machine learning (ML)-based algorithms come useful as they can analyze past clinical details of the patients and help clinicians to predict the patient's response to an anti-VEGF agent. The work presented here attempts to review the literature that is available from the peer research community to discuss solutions provided by AI/ML methodologies to tackle challenges in DME management. Lastly, a possibility for using two different types of data has been proposed, which is believed to be the key differentiators as compared to the similar and recent contributions from the peer research community.

Prediction of postoperative visual acuity after vitrectomy for macular hole using deep learning-based artificial intelligence

PURPOSE

To create a model for prediction of postoperative visual acuity (VA) after vitrectomy for macular hole (MH) treatment using preoperative optical coherence tomography (OCT) images, using deep learning (DL)-based artificial intelligence.

METHODS

This was a retrospective single-center study. We evaluated 259 eyes that underwent vitrectomy for MHs. We divided the eyes into four groups, based on their 6-month postoperative Snellen VA values: (A) ≥ 20/20; (B) 20/25-20/32; (C) 20/32-20/63; and (D) ≤ 20/100. Training data were randomly selected, comprising 20 eyes in each group. Test data were also randomly selected, comprising 52 total eyes in the same proportions as those of each group in the total database. Preoperative OCT images with corresponding postoperative VA values were used to train the original DL network. The final prediction of postoperative VA was subjected to regression analysis based on inferences made with DL network output. We created a model for predicting postoperative VA from preoperative VA, MH size, and age using multivariate linear regression. Precision values were determined, and correlation coefficients between predicted and actual postoperative VA values were calculated in two models.

RESULTS

The DL and multivariate models had precision values of 46% and 40%, respectively. The predicted postoperative VA values on the basis of DL and on preoperative VA and MH size were correlated with actual postoperative VA at 6 months postoperatively (P < .0001 and P < .0001, r = .62 and r = .55, respectively).

CONCLUSION

Postoperative VA after MH treatment could be predicted via DL using preoperative OCT images with greater accuracy than multivariate linear regression using preoperative VA, MH size, and age.

Machine learning in optical coherence tomography angiography

Optical coherence tomography angiography (OCTA) offers a noninvasive label-free solution for imaging retinal vasculatures at the capillary level resolution. In principle, improved resolution implies a better chance to reveal subtle microvascular distortions associated with eye diseases that are asymptomatic in early stages. However, massive screening requires experienced clinicians to manually examine retinal images, which may result in human error and hinder objective screening. Recently, quantitative OCTA features have been developed to standardize and document retinal vascular changes. The feasibility of using quantitative OCTA features for machine learning classification of different retinopathies has been demonstrated. Deep learning-based applications have also been explored for automatic OCTA image analysis and disease classification. In this article, we summarize recent developments of quantitative OCTA features, machine learning image analysis, and classification.

Deep Learning-Based Optical Coherence Tomography and Optical Coherence Tomography Angiography Image Analysis: An Updated Summary

ABSTRACT

Deep learning (DL) is a subset of artificial intelligence based on deep neural networks. It has made remarkable breakthroughs in medical imaging, particularly for image classification and pattern recognition. In ophthalmology, there are rising interests in applying DL methods to analyze optical coherence tomography (OCT) and optical coherence tomography angiography (OCTA) images. Studies showed that OCT and OCTA image evaluation by DL algorithms achieved good performance for disease detection, prognosis prediction, and image quality control, suggesting that the incorporation of DL technology could potentially enhance the accuracy of disease evaluation and the efficiency of clinical workflow. However, substantial issues, such as small training sample size, data preprocessing standardization, model robustness, results explanation, and performance cross-validation, are yet to be tackled before deploying these DL models in real-time clinics. This review summarized recent studies on DL-based image analysis models for OCT and OCTA images and discussed the potential challenges of clinical deployment and future research directions.

Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis

Deep learning (DL) has the potential to transform medical diagnostics. However, the diagnostic accuracy of DL is uncertain. Our aim was to evaluate the diagnostic accuracy of DL algorithms to identify pathology in medical imaging. Searches were conducted in Medline and EMBASE up to January 2020. We identified 11,921 studies, of which 503 were included in the systematic review. Eighty-two studies in ophthalmology, 82 in breast disease and 115 in respiratory disease were included for meta-analysis. Two hundred twenty-four studies in other specialities were included for qualitative review. Peer-reviewed studies that reported on the diagnostic accuracy of DL algorithms to identify pathology using medical imaging were included. Primary outcomes were measures of diagnostic accuracy, study design and reporting standards in the literature. Estimates were pooled using random-effects meta-analysis. In ophthalmology, AUC's ranged between 0.933 and 1 for diagnosing diabetic retinopathy, age-related macular degeneration and glaucoma on retinal fundus photographs and optical coherence tomography. In respiratory imaging, AUC's ranged between 0.864 and 0.937 for diagnosing lung nodules or lung cancer on chest X-ray or CT scan. For breast imaging, AUC's ranged between 0.868 and 0.909 for diagnosing breast cancer on mammogram, ultrasound, MRI and digital breast tomosynthesis. Heterogeneity was high between studies and extensive variation in methodology, terminology and outcome measures was noted. This can lead to an overestimation of the diagnostic accuracy of DL algorithms on medical imaging. There is an immediate need for the development of artificial intelligence-specific EQUATOR guidelines, particularly STARD, in order to provide guidance around key issues in this field.

Automatic screening of tear meniscus from lacrimal duct obstructions using anterior segment optical coherence tomography images by deep learning

PURPOSE

We assessed the ability of deep learning (DL) models to distinguish between tear meniscus of lacrimal duct obstruction (LDO) patients and normal subjects using anterior segment optical coherence tomography (ASOCT) images.

METHODS

The study included 117 ASOCT images (19 men and 98 women; mean age, 66.6 ± 13.6 years) from 101 LDO patients and 113 ASOCT images (29 men and 84 women; mean age, 38.3 ± 19.9 years) from 71 normal subjects. We trained to construct 9 single and 502 ensemble DL models with 9 different network structures, and calculated the area under the curve (AUC), sensitivity, and specificity to compare the distinguishing abilities of these single and ensemble DL models.

RESULTS

For the highest single DL model (DenseNet169), the AUC, sensitivity, and specificity for distinguishing LDO were 0.778, 64.6%, and 72.1%, respectively. For the highest ensemble DL model (VGG16, ResNet50, DenseNet121, DenseNet169, InceptionResNetV2, InceptionV3, and Xception), the AUC, sensitivity, and specificity for distinguishing LDO were 0.824, 84.8%, and 58.8%, respectively. The heat maps indicated that these DL models placed their focus on the tear meniscus region of the ASOCT images.

CONCLUSION

The combination of DL and ASOCT images could distinguish between tear meniscus of LDO patients and normal subjects with a high level of accuracy. These results suggest that DL might be useful for automatic screening of patients for LDO.

Prediction of age and brachial-ankle pulse-wave velocity using ultra-wide-field pseudo-color images by deep learning

This study examined whether age and brachial-ankle pulse-wave velocity (baPWV) can be predicted with ultra-wide-field pseudo-color (UWPC) images using deep learning (DL). We examined 170 UWPC images of both eyes of 85 participants (40 men and 45 women, mean age: 57.5 ± 20.9 years). Three types of images were included (total, central, and peripheral) and analyzed by k-fold cross-validation (k = 5) using Visual Geometry Group-16. After bias was eliminated using the generalized linear mixed model, the standard regression coefficients (SRCs) between actual age and baPWV and predicted age and baPWV from the UWPC images by the neural network were calculated, and the prediction accuracies of the DL model for age and baPWV were examined. The SRC between actual age and predicted age by the neural network was 0.833 for all images, 0.818 for central images, and 0.649 for peripheral images (all P < 0.001) and between the actual baPWV and the predicted baPWV was 0.390 for total images, 0.419 for central images, and 0.312 for peripheral images (all P < 0.001). These results show the potential prediction capability of DL for age and vascular aging and could be useful for disease prevention and early treatment.

Effects of Induced Astigmatism on Spectral Domain-OCT Angiography Quantitative Metrics

PURPOSE

To analyze the effect of induced astigmatism on en-face spectral-domain optical coherence tomography angiography quantitative metrics.

DESIGN

Prospective crossover study.

METHODS

Normal eyes without astigmatism and with 0.75, 1.75, and 2.75 diopters (D) of with-the-rule (WTR) astigmatism were imaged using a 3 × 3-mm scan pattern SD-OCTA CIRRUS 5000 HD-OCT with AngioPlex (Carl Zeiss Meditec, Dublin, CA, USA). Quantitative parameters, including foveal avascular zone metrics, parafoveal vessel length density (VD), and perfusion density (PD) were corrected for magnification secondary to axial length and analyzed. Univariate linear regressions were performed within each eye to correlate quantitative metrics to the level of an induced astigmatic cylinder.

RESULTS

Fifteen eyes from 15 patients were imaged. Every 1-D increase in induced WTR astigmatism was associated with a statistically significant decrease in VD and PD within all Early Treatment Diabetic Retinopathy Study inner ring quadrants; however, especially more so nasally (VD: 0.63; P < .001; PD: 0.0089; P = .001). For every 1-D increase in induced astigmatism, the resulting decrease in the inner ring superior quadrant was 12% greater for VD and 16% greater for PD versus that in the inferior quadrant. The resulting decrease in the inner ring nasal quadrant was 40% greater for VD and 48% greater for PD versus that in the temporal quadrant.

CONCLUSIONS

Increasing levels of induced WTR astigmatism correlated with globally diminishing VD and PD, was more symmetrical for vertical than horizontal quadrants, and was most pronounced nasally. This may be due to a high prevalence of horizontally oriented vessels nasally and the horizontal optical defocus induced by WTR astigmatism.

Reconstruction of high-resolution 6×6-mm OCT angiograms using deep learning

Typical optical coherence tomographic angiography (OCTA) acquisition areas on commercial devices are 3×3- or 6×6-mm. Compared to 3×3-mm angiograms with proper sampling density, 6×6-mm angiograms have significantly lower scan quality, with reduced signal-to-noise ratio and worse shadow artifacts due to undersampling. Here, we propose a deep-learning-based high-resolution angiogram reconstruction network (HARNet) to generate enhanced 6×6-mm superficial vascular complex (SVC) angiograms. The network was trained on data from 3×3-mm and 6×6-mm angiograms from the same eyes. The reconstructed 6×6-mm angiograms have significantly lower noise intensity, stronger contrast and better vascular connectivity than the original images. The algorithm did not generate false flow signal at the noise level presented by the original angiograms. The image enhancement produced by our algorithm may improve biomarker measurements and qualitative clinical assessment of 6×6-mm OCTA.

Accuracy of a deep convolutional neural network in the detection of myopic macular diseases using swept-source optical coherence tomography

This study examined and compared outcomes of deep learning (DL) in identifying swept-source optical coherence tomography (OCT) images without myopic macular lesions [i.e., no high myopia (nHM) vs. high myopia (HM)], and OCT images with myopic macular lesions [e.g., myopic choroidal neovascularization (mCNV) and retinoschisis (RS)]. A total of 910 SS-OCT images were included in the study as follows and analyzed by k-fold cross-validation (k = 5) using DL's renowned model, Visual Geometry Group-16: nHM, 146 images; HM, 531 images; mCNV, 122 images; and RS, 111 images (n = 910). The binary classification of OCT images with or without myopic macular lesions; the binary classification of HM images and images with myopic macular lesions (i.e., mCNV and RS images); and the ternary classification of HM, mCNV, and RS images were examined. Additionally, sensitivity, specificity, and the area under the curve (AUC) for the binary classifications as well as the correct answer rate for ternary classification were examined. The classification results of OCT images with or without myopic macular lesions were as follows: AUC, 0.970; sensitivity, 90.6%; specificity, 94.2%. The classification results of HM images and images with myopic macular lesions were as follows: AUC, 1.000; sensitivity, 100.0%; specificity, 100.0%. The correct answer rate in the ternary classification of HM images, mCNV images, and RS images were as follows: HM images, 96.5%; mCNV images, 77.9%; and RS, 67.6% with mean, 88.9%.Using noninvasive, easy-to-obtain swept-source OCT images, the DL model was able to classify OCT images without myopic macular lesions and OCT images with myopic macular lesions such as mCNV and RS with high accuracy. The study results suggest the possibility of conducting highly accurate screening of ocular diseases using artificial intelligence, which may improve the prevention of blindness and reduce workloads for ophthalmologists.

Usefulness of Denoising Process to Depict Myopic Choroidal Neovascularisation Using a Single Optical Coherence Tomography Angiography Image

Quality of single optical coherence tomography angiography (OCTA) images of myopic choroidal neovascularisation (mCNV) is poorer than in averaged images, although obtaining averaged images takes much time. This study evaluated the clinical usefulness of novel denoising process for depicting mCNV. This study included 20 eyes of 20 patients with mCNV. Ten en face images taken in a 3 × 3 mm macular cube were obtained from outer-retina-to-choriocapillaris layer. Three image types were prepared for analysis; single images before and after the denoising process accomplished deep learning (single and denoising groups, respectively) and up to 10 images were averaged (averaging group). Pairwise comparisons showed vessel density, vessel length density, and fractal dimension (FD) were higher; whereas, vessel density index (VDI) was lower in single group than in denoising and averaging groups. Detectable CNV indices, contrast-to-nose ratio, and CNV diagnostic scores were higher in denoising and averaging groups than in single group. No significant differences were detected in VDI, FD, or CNV diagnostic scores between denoising and averaging groups. The denoising process can utilise single OCTA images to provide results comparable to averaged OCTA images, which is clinically useful for shortening examination times with quality similar to averaging.