MEDnet, a neural network for automated detection of avascular area in OCT angiography

Quantitative Volumetric Analysis of Retinal Ischemia with an Oxygen Diffusion Model and OCT Angiography

Purpose

Retinal ischemia is a major feature of diabetic retinopathy (DR). Traditional nonperfused areas measured by OCT angiography (OCTA) measure blood supply but not ischemia. We propose a novel 3-dimensional (3D) quantitative method to derive ischemia measurements from OCTA data.

Design

Cross-sectional study.

Participants

We acquired 223 macular OCTA volumes from 33 healthy eyes, 33 diabetic eyes without retinopathy, 7 eyes with nonreferable DR, 17 eyes with referable but nonvision-threatening DR, and 133 eyes with vision-threatening DR.

Methods

Each eye was scanned using a spectral-domain OCTA system (Avanti RTVue-XR, Visionix/Optovue, Inc) with 1.6-mm scan depth in a 3 × 3-mm region (640 × 304 × 304 voxels) centered on the fovea. For each scanned OCTA volume, a custom algorithm removed flow projection artifacts. We then enhanced, binarized, and skeletonized the vasculature in each OCTA volume and generated a 3D oxygen tension map using a zero-order kinetics oxygen diffusion model. Each volume was scaled to the average retina thickness in healthy controls after foveal registration and flattening of the Bruch's membrane. Finally, we extracted 3D ischemia maps by comparison with a reference map established from scans of healthy eyes using the same processing. To assess the ability of the ischemia maps to grade DR severity, we constructed receiver operating characteristic curves for diagnosing diabetes, referable DR, and vision-threatening DR.

Main Outcome Measures

Spearman correlation coefficient and area under receiver operating characteristic curve (AUC) were used to quantify the ability of the ischemia maps to DR.

Results

The ischemia maps showed that the ischemic tissues were at or near pathologically nonperfused areas, but not the normally nonvascular tissue, such as the foveal avascular zone. We found multiple novel metrics, including inferred 3D-oxygen tension, ischemia index, and ischemic volume ratio, were strongly correlated with DR severity. The AUCs of ischemia index measured were 0.94 for diabetes, 0.89 for DR, 0.88 for referable DR, and 0.85 for vision-threatening DR.

Conclusions

A quantitative method to infer 3D oxygen tension and ischemia using OCTA in diabetic eyes can identify ischemic tissue that are more specific to pathologic changes in DR.

Financial Disclosures

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

VMseg: Using spatial variance to automatically segment retinal non-perfusion on OCT-angiography

BACKGROUND AND OBJECTIVES

To develop and test VMseg, a new image processing algorithm performing automatic segmentation of retinal non-perfusion in widefield OCT-Angiography images, in order to estimate the non-perfusion index in diabetic patients.

METHODS

We included diabetic patients with severe non-proliferative or proliferative diabetic retinopathy. We acquired images using the PlexElite 9000 OCT-A device with a photomontage of 5 images of size 12 x 12 mm. We then developed VMseg, a Python algorithm for non-perfusion detection, which binarizes a variance map calculated through convolution and morphological operations. We used 70% of our data set (development set) to fine-tune the algorithm parameters (convolution and morphological parameters, binarization thresholds) and evaluated the algorithm performance on the remaining 30% (test set). The obtained automatic segmentations were compared to a ground truth corresponding to manual segmentation from a retina expert and the inference processing time was estimated.

RESULTS

We included 51 eyes of 30 patients (27 severe non-proliferative, 24 proliferative diabetic retinopathy). Using the optimal parameters found on the development set to tune the algorithm, the mean dice for the test set was 0.683 (sd = 0.175). We found a higher dice coefficient for images with a higher area of retinal non-perfusion (rs = 0.722, p < 10-4). There was a strong correlation (rs = 0.877, p < 10-4) between VMseg estimated non-perfusion indexes and indexes estimated using the ground truth segmentation. The Bland-Altman plot revealed that 3 eyes (5.9%) were significantly under-segmented by VMseg.

CONCLUSION

We developed VMseg, an automatic algorithm for retinal non-perfusion segmentation on 12 x 12 mm OCT-A widefield photomontages. This simple algorithm was fast at inference time, segmented images in full-resolution and for the OCT-A format, was accurate enough for automatic estimation of retinal non-perfusion index in diabetic patients with diabetic retinopathy.

Multi-Plexus Nonperfusion Area Segmentation in Widefield OCT Angiography Using a Deep Convolutional Neural Network

Purpose

To train and validate a convolutional neural network to segment nonperfusion areas (NPAs) in multiple retinal vascular plexuses on widefield optical coherence tomography angiography (OCTA).

Methods

This cross-sectional study included 202 participants with a full range of diabetic retinopathy (DR) severities (diabetes mellitus without retinopathy, mild to moderate non-proliferative DR, severe non-proliferative DR, and proliferative DR) and 39 healthy participants. Consecutive 6 × 6-mm OCTA scans at the central macula, optic disc, and temporal region in one eye from 202 participants in a clinical DR study were acquired with a 70-kHz OCT commercial system (RTVue-XR). Widefield OCTA en face images were generated by montaging the scans from these three regions. A projection-resolved OCTA algorithm was applied to remove projection artifacts at the voxel scale. A deep convolutional neural network with a parallel U-Net module was designed to detect NPAs and distinguish signal reduction artifacts from flow deficits in the superficial vascular complex (SVC), intermediate capillary plexus (ICP), and deep capillary plexus (DCP). Expert graders manually labeled NPAs and signal reduction artifacts for the ground truth. Sixfold cross-validation was used to evaluate the proposed algorithm on the entire dataset.

Results

The proposed algorithm showed high agreement with the manually delineated ground truth for NPA detection in three retinal vascular plexuses on widefield OCTA (mean ± SD F-score: SVC, 0.84 ± 0.05; ICP, 0.87 ± 0.04; DCP, 0.83 ± 0.07). The extrafoveal avascular area in the DCP showed the best sensitivity for differentiating eyes with diabetes but no retinopathy (77%) from healthy controls and for differentiating DR by severity: DR versus no DR, 77%; referable DR (rDR) versus non-referable DR (nrDR), 79%; vision-threatening DR (vtDR) versus non-vision-threatening DR (nvtDR), 60%. The DCP also showed the best area under the receiver operating characteristic curve for distinguishing diabetes from healthy controls (96%), DR versus no DR (95%), and rDR versus nrDR (96%). The three-plexus-combined OCTA achieved the best result in differentiating vtDR and nvtDR (81.0%).

Conclusions

A deep learning network can accurately segment NPAs in individual retinal vascular plexuses and improve DR diagnostic accuracy.

Translational Relevance

Using a deep learning method to segment nonperfusion areas in widefield OCTA can potentially improve the diagnostic accuracy of diabetic retinopathy by OCT/OCTA systems.

OCTA-500: A retinal dataset for optical coherence tomography angiography study

Optical coherence tomography angiography (OCTA) is a novel imaging modality that has been widely utilized in ophthalmology and neuroscience studies to observe retinal vessels and microvascular systems. However, publicly available OCTA datasets remain scarce. In this paper, we introduce the largest and most comprehensive OCTA dataset dubbed OCTA-500, which contains OCTA imaging under two fields of view (FOVs) from 500 subjects. The dataset provides rich images and annotations including two modalities (OCT/OCTA volumes), six types of projections, four types of text labels (age/gender/eye/disease) and seven types of segmentation labels (large vessel/capillary/artery/vein/2D FAZ/3D FAZ/retinal layers). Then, we propose a multi-object segmentation task called CAVF, which integrates capillary segmentation, artery segmentation, vein segmentation, and FAZ segmentation under a unified framework. In addition, we optimize the 3D-to-2D image projection network (IPN) to IPN-V2 to serve as one of the segmentation baselines. Experimental results demonstrate that IPN-V2 achieves an about 10% mIoU improvement over IPN on CAVF task. Finally, we further study the impact of several dataset characteristics: the training set size, the model input (OCT/OCTA, 3D volume/2D projection), the baseline networks, and the diseases. The dataset and code are publicly available at: https://ieee-dataport.org/open-access/octa-500.

DRAC 2022: A public benchmark for diabetic retinopathy analysis on ultra-wide optical coherence tomography angiography images

We described a challenge named "DRAC - Diabetic Retinopathy Analysis Challenge" in conjunction with the 25th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2022). Within this challenge, we provided the DRAC datset, an ultra-wide optical coherence tomography angiography (UW-OCTA) dataset (1,103 images), addressing three primary clinical tasks: diabetic retinopathy (DR) lesion segmentation, image quality assessment, and DR grading. The scientific community responded positively to the challenge, with 11, 12, and 13 teams submitting different solutions for these three tasks, respectively. This paper presents a concise summary and analysis of the top-performing solutions and results across all challenge tasks. These solutions could provide practical guidance for developing accurate classification and segmentation models for image quality assessment and DR diagnosis using UW-OCTA images, potentially improving the diagnostic capabilities of healthcare professionals. The dataset has been released to support the development of computer-aided diagnostic systems for DR evaluation.

Automated segmentation of ultra-widefield fluorescein angiography of diabetic retinopathy using deep learning

BACKGROUND/AIMS

Retinal capillary non-perfusion (NP) and neovascularisation (NV) are two of the most important angiographic changes in diabetic retinopathy (DR). This study investigated the feasibility of using deep learning (DL) models to automatically segment NP and NV on ultra-widefield fluorescein angiography (UWFA) images from patients with DR.

METHODS

Retrospective cross-sectional chart review study. In total, 951 UWFA images were collected from patients with severe non-proliferative DR (NPDR) or proliferative DR (PDR). Each image was segmented and labelled for NP, NV, disc, background and outside areas. Using the labelled images, DL models were trained and validated (80%) using convolutional neural networks (CNNs) for automated segmentation and tested (20%) on test sets. Accuracy of each model and each label were assessed.

RESULTS

The best accuracy from CNN models for each label was 0.8208, 0.8338, 0.9801, 0.9253 and 0.9766 for NP, NV, disc, background and outside areas, respectively. The best Intersection over Union for each label was 0.6806, 0.5675, 0.7107, 0.8551 and 0.924 and mean mean boundary F1 score (BF score) was 0.6702, 0.8742, 0.9092, 0.8103 and 0.9006, respectively.

CONCLUSIONS

DL models can detect NV and NP as well as disc and outer margins on UWFA with good performance. This automated segmentation of important UWFA features will aid physicians in DR clinics and in overcoming grader subjectivity.

Optical coherence tomography angiography in diabetic retinopathy

There remain many unanswered questions on how to assess and treat the pathology and complications that arise from diabetic retinopathy (DR). Optical coherence tomography angiography (OCTA) is a novel and non-invasive three-dimensional imaging method that can visualize capillaries in all retinal layers. Numerous studies have confirmed that OCTA can identify early evidence of microvascular changes and provide quantitative assessment of the extent of diseases such as DR and its complications. A number of informative OCTA metrics could be used to assess DR in clinical trials, including measurements of the foveal avascular zone (FAZ; area, acircularity, 3D para-FAZ vessel density), vessel density, extrafoveal avascular zones, and neovascularization. Assessing patients with DR using a full-retinal slab OCTA image can limit segmentation errors and confounding factors such as those related to center-involved diabetic macular edema. Given emerging data suggesting the importance of the peripheral retinal vasculature in assessing and predicting DR progression, wide-field OCTA imaging should also be used. Finally, the use of automated methods and algorithms for OCTA image analysis, such as those that can distinguish between areas of true and false signals, reconstruct images, and produce quantitative metrics, such as FAZ area, will greatly improve the efficiency and standardization of results between studies. Most importantly, clinical trial protocols should account for the relatively high frequency of poor-quality data related to sub-optimal imaging conditions in DR and should incorporate time for assessing OCTA image quality and re-imaging patients where necessary.

An artificial intelligence system for the whole process from diagnosis to treatment suggestion of ischemic retinal diseases

Ischemic retinal diseases (IRDs) are a series of common blinding diseases that depend on accurate fundus fluorescein angiography (FFA) image interpretation for diagnosis and treatment. An artificial intelligence system (Ai-Doctor) was developed to interpret FFA images. Ai-Doctor performed well in image phase identification (area under the curve [AUC], 0.991-0.999, range), diabetic retinopathy (DR) and branch retinal vein occlusion (BRVO) diagnosis (AUC, 0.979-0.992), and non-perfusion area segmentation (Dice similarity coefficient [DSC], 89.7%-90.1%) and quantification. The segmentation model was expanded to unencountered IRDs (central RVO and retinal vasculitis), with DSCs of 89.2% and 83.6%, respectively. A clinically applicable ischemia index (CAII) was proposed to evaluate ischemic degree; patients with CAII values exceeding 0.17 in BRVO and 0.08 in DR may be associated with increased possibility for laser therapy. Ai-Doctor is expected to achieve accurate FFA image interpretation for IRDs, potentially reducing the reliance on retinal specialists.

Robust AMD Stage Grading with Exclusively OCTA Modality Leveraging 3D Volume

Age-related Macular Degeneration (AMD) is a degenerative eye disease that causes central vision loss. Optical Coherence Tomography Angiography (OCTA) is an emerging imaging modality that aids in the diagnosis of AMD by displaying the pathogenic vessels in the subretinal space. In this paper, we investigate the effectiveness of OCTA from the view of deep classifiers. To the best of our knowledge, this is the first study that solely uses OCTA for AMD stage grading. By developing a 2D classifier based on OCTA projections, we identify that segmentation errors in retinal layers significantly affect the accuracy of classification. To address this issue, we propose analyzing 3D OCTA volumes directly using a 2D convolutional neural network trained with additional projection supervision. Our experimental results show that we achieve over 80% accuracy on a four-stage grading task on both error-free and error-prone test sets, which is significantly higher than 60%, the accuracy of human experts. This demonstrates that OCTA provides sufficient information for AMD stage grading and the proposed 3D volume analyzer is more robust when dealing with OCTA data with segmentation errors.

Deep-learning visualization enhancement method for optical coherence tomography angiography in dermatology

Optical coherence tomography angiography (OCTA) in dermatology usually suffers from low image quality due to the highly scattering property of the skin, the complexity of cutaneous vasculature, and limited acquisition time. Deep-learning methods have achieved great success in many applications. However, the deep learning approach to improve dermatological OCTA images has not been investigated due to the requirement of high-performance OCTA systems and difficulty of obtaining high-quality images as ground truth. This study aims to generate proper datasets and develop a robust deep learning method to enhance the skin OCTA images. A swept-source skin OCTA system was employed to create low-quality and high-quality OCTA images with different scanning protocols. We propose a model named vascular visualization enhancement generative adversarial network and adopt an optimized data augmentation strategy and perceptual content loss function to achieve better image enhancement effect with small amount of training data. We demonstrate the superiority of the proposed method in skin OCTA image enhancement by quantitative and qualitative comparisons.

OCT angiography and its retinal biomarkers [Invited]

Optical coherence tomography angiography (OCTA) is a high-resolution, depth-resolved imaging modality with important applications in ophthalmic practice. An extension of structural OCT, OCTA enables non-invasive, high-contrast imaging of retinal and choroidal vasculature that are amenable to quantification. As such, OCTA offers the capability to identify and characterize biomarkers important for clinical practice and therapeutic research. Here, we review new methods for analyzing biomarkers and discuss new insights provided by OCTA.

Optical coherence tomography angiography: a review of the current literature

This narrative review presents a comprehensive examination of optical coherence tomography angiography (OCTA), a non-invasive retinal vascular imaging technology, as reported in the existing literature. Building on the coherence tomography principles of standard OCT, OCTA further delineates the retinal vascular system, thus offering an advanced alternative to conventional dye-based imaging. OCTA provides high-resolution visualisation of both the superficial and deep capillary networks, an achievement previously unattainable. However, image quality may be compromised by factors such as motion artefacts or media opacities, potentially limiting the utility of OCTA in certain patient cohorts. Despite these limitations, OCTA has various potential clinical applications in managing retinal and choroidal vascular diseases. Still, given its considerable cost implications relative to current modalities, further research is warranted to justify its broader application in clinical practice.

Foveal avascular zone segmentation using deep learning-driven image-level optimization and fundus photographs

The foveal avascular zone (FAZ) is a retinal area devoid of capillaries and associated with multiple retinal pathologies and visual acuity. Optical Coherence Tomography Angiography (OCT-A) is a very effective means of visualizing retinal vascular and avascular areas, but its use remains limited to research settings due to its complex optics limiting availability. On the other hand, fundus photography is widely available and often adopted in population studies. In this work, we test the feasibility of estimating the FAZ from fundus photos using three different approaches. The first two approaches rely on pixel-level and image-level FAZ information to segment FAZ pixels and regress FAZ area, respectively. The third is a training mask-free pipeline combining saliency maps with an active contours approach to segment FAZ pixels while being trained on image-level measures of the FAZ areas. This enables training FAZ segmentation methods without manual alignment of fundus and OCT-A images, a time-consuming process, which limits the dataset that can be used for training. Segmentation methods trained on pixel-level labels and image-level labels had good agreement with masks from a human grader (respectively DICE of 0.45 and 0.4). Results indicate the feasibility of using fundus images as a proxy to estimate the FAZ when angiography data is not available.

Reverse translation of artificial intelligence in glaucoma: Connecting basic science with clinical applications

Artificial intelligence (AI) has been approved for biomedical research in diverse areas from bedside clinical studies to benchtop basic scientific research. For ophthalmic research, in particular glaucoma, AI applications are rapidly growing for potential clinical translation given the vast data available and the introduction of federated learning. Conversely, AI for basic science remains limited despite its useful power in providing mechanistic insight. In this perspective, we discuss recent progress, opportunities, and challenges in the application of AI in glaucoma for scientific discoveries. Specifically, we focus on the research paradigm of reverse translation, in which clinical data are first used for patient-centered hypothesis generation followed by transitioning into basic science studies for hypothesis validation. We elaborate on several distinctive areas of research opportunities for reverse translation of AI in glaucoma including disease risk and progression prediction, pathology characterization, and sub-phenotype identification. We conclude with current challenges and future opportunities for AI research in basic science for glaucoma such as inter-species diversity, AI model generalizability and explainability, as well as AI applications using advanced ocular imaging and genomic data.

Deep learning-based signal-independent assessment of macular avascular area on 6×6 mm optical coherence tomography angiogram in diabetic retinopathy: a comparison to instrument-embedded software

SYNOPSIS

A deep-learning-based macular extrafoveal avascular area (EAA) on a 6×6 mm optical coherence tomography (OCT) angiogram is less dependent on the signal strength and shadow artefacts, providing better diagnostic accuracy for diabetic retinopathy (DR) severity than the commercial software measured extrafoveal vessel density (EVD).

AIMS

To compare a deep-learning-based EAA to commercial output EVD in the diagnostic accuracy of determining DR severity levels from 6×6 mm OCT angiography (OCTA) scans.

METHODS

The 6×6 mm macular OCTA scans were acquired on one eye of each participant with a spectral-domain OCTA system. After excluding the central 1 mm diameter circle, the EAA on superficial vascular complex was measured with a deep-learning-based algorithm, and the EVD was obtained with commercial software.

RESULTS

The study included 34 healthy controls and 118 diabetic patients. EAA and EVD were highly correlated with DR severity (ρ=0.812 and -0.577, respectively, both p<0.001) and visual acuity (r=-0.357 and 0.420, respectively, both p<0.001). EAA had a significantly (p<0.001) higher correlation with DR severity than EVD. With the specificity at 95%, the sensitivities of EAA for differentiating diabetes mellitus (DM), DR and severe DR from control were 80.5%, 92.0% and 100.0%, respectively, significantly higher than those of EVD 11.9% (p=0.001), 13.6% (p<0.001) and 15.8% (p<0.001), respectively. EVD was significantly correlated with signal strength index (SSI) (r=0.607, p<0.001) and shadow area (r=-0.530, p<0.001), but EAA was not (r=-0.044, p=0.805 and r=-0.046, p=0.796, respectively). Adjustment of EVD with SSI and shadow area lowered sensitivities for detection of DM, DR and severe DR.

CONCLUSION

Macular EAA on 6×6 mm OCTA measured with a deep learning-based algorithm is less dependent on the signal strength and shadow artefacts, and provides better diagnostic accuracy for DR severity than EVD measured with the instrument-embedded software.

Applications of Artificial Intelligence in Optical Coherence Tomography Angiography Imaging

Optical coherence tomography angiography (OCTA) and artificial intelligence (AI) are two emerging fields that complement each other. OCTA enables the noninvasive, in vivo, 3D visualization of retinal blood flow with a micrometer resolution, which has been impossible with other imaging modalities. As it does not need dye-based injections, it is also a safer procedure for patients. AI has excited great interest in many fields of daily life, by enabling automatic processing of huge amounts of data with a performance that greatly surpasses previous algorithms. It has been used in many breakthrough studies in recent years, such as the finding that AlphaGo can beat humans in the strategic board game of Go. This paper will give a short introduction into both fields and will then explore the manifold applications of AI in OCTA imaging that have been presented in the recent years. These range from signal generation over signal enhancement to interpretation tasks like segmentation and classification. In all these areas, AI-based algorithms have achieved state-of-the-art performance that has the potential to improve standard care in ophthalmology when integrated into the daily clinical routine.

A Deep Learning Network for Classifying Arteries and Veins in Montaged Widefield OCT Angiograms

Purpose

To propose a deep-learning-based method to differentiate arteries from veins in montaged widefield OCT angiography (OCTA).

Design

Cross-sectional study.

Participants

A total of 232 participants, including 109 participants with diabetic retinopathy (DR), 64 participants with branch retinal vein occlusion (BRVO), 27 participants with diabetes but without DR, and 32 healthy participants.

Methods

We propose a convolutional neural network (CAVnet) to classify retinal blood vessels on montaged widefield OCTA en face images as arteries and veins. A total of 240 retinal angiograms from 88 eyes were used to train CAVnet, and 302 retinal angiograms from 144 eyes were used for testing. This method takes the OCTA images as input and outputs the segmentation results with arteries and veins down to the level of precapillary arterioles and postcapillary venules. The network also identifies their intersections. We evaluated the agreement (in pixels) between segmentation results and the manually graded ground truth using sensitivity, specificity, F1-score, and Intersection over Union (IoU). Measurements of arterial and venous caliber or tortuosity are made on our algorithm's output of healthy and diseased eyes.

Main Outcome Measures

Classification of arteries and veins, arterial and venous caliber, and arterial and venous tortuosity.

Results

For classification and identification of arteries, the algorithm achieved average sensitivity of 95.3%, specificity of 99.6%, F1 score of 94.2%, and IoU of 89.3%. For veins, the algorithm achieved average sensitivity of 94.4%, specificity of 99.7%, F1 score of 94.1%, and IoU of 89.2%. We also achieved an average sensitivity of 76.3% in identifying intersection points. The results show CAVnet has high accuracy on differentiating arteries and veins in DR and BRVO cases. These classification results are robust across 2 instruments and multiple scan volume sizes. Outputs of CAVnet were used to measure arterial and venous caliber or tortuosity, and pixel-wise caliber and tortuosity maps were generated. Differences between healthy and diseased eyes were demonstrated, indicating potential clinical utility.

Conclusions

The CAVnet can classify arteries and veins and their branches with high accuracy and is potentially useful in the analysis of vessel type-specific features on diseases such as branch retinal artery occlusion and BRVO.

The Role of Different Retinal Imaging Modalities in Predicting Progression of Diabetic Retinopathy: A Survey

Diabetic retinopathy (DR) is a devastating condition caused by progressive changes in the retinal microvasculature. It is a leading cause of retinal blindness in people with diabetes. Long periods of uncontrolled blood sugar levels result in endothelial damage, leading to macular edema, altered retinal permeability, retinal ischemia, and neovascularization. In order to facilitate rapid screening and diagnosing, as well as grading of DR, different retinal modalities are utilized. Typically, a computer-aided diagnostic system (CAD) uses retinal images to aid the ophthalmologists in the diagnosis process. These CAD systems use a combination of machine learning (ML) models (e.g., deep learning (DL) approaches) to speed up the diagnosis and grading of DR. In this way, this survey provides a comprehensive overview of different imaging modalities used with ML/DL approaches in the DR diagnosis process. The four imaging modalities that we focused on are fluorescein angiography, fundus photographs, optical coherence tomography (OCT), and OCT angiography (OCTA). In addition, we discuss limitations of the literature that utilizes such modalities for DR diagnosis. In addition, we introduce research gaps and provide suggested solutions for the researchers to resolve. Lastly, we provide a thorough discussion about the challenges and future directions of the current state-of-the-art DL/ML approaches. We also elaborate on how integrating different imaging modalities with the clinical information and demographic data will lead to promising results for the scientists when diagnosing and grading DR. As a result of this article's comparative analysis and discussion, it remains necessary to use DL methods over existing ML models to detect DR in multiple modalities.

The intercapillary space spectrum as a marker of diabetic retinopathy severity on optical coherence tomography angiography

Microcirculatory disturbance plays a pivotal role in the pathogenesis in diabetic retinopathy (DR). We retrospectively quantified the total counts and morphological features of intercapillary spaces, i.e., intercapillary areas and nonperfusion areas (NPAs), on swept-source optical coherence tomography angiography (SS-OCTA) images and to evaluate their associations with DR severity grades. We acquired 3 × 3 mm OCTA images in 75 eyes of 62 diabetic patients and 22 eyes of 22 nondiabetic subjects. In the en-face superficial images within the central 2 mm, the areas enclosed by retinal vessels were automatically detected. Their total numbers decreased in some eyes with no apparent retinopathy and most eyes with DR, which allowed us to discriminate diabetic subjects from nondiabetic subjects [area under the receiver operating characteristic curve (AUC) = 0.907]. The areas and area/perimeter ratios continuously increased in DR, indicating a continuum between healthy intercapillary areas and NPAs. The number of intercapillary spaces with a high area/perimeter ratio increased according to DR severity, which showed modest performance in discriminating moderate NPDR or higher grades (AUC = 0.868). These quantified parameters of intercapillary spaces can feasibly be used for the early detection of microcirculatory impairment and the diagnosis of referable DR.

Artificial intelligence promotes the diagnosis and screening of diabetic retinopathy

Deep learning evolves into a new form of machine learning technology that is classified under artificial intelligence (AI), which has substantial potential for large-scale healthcare screening and may allow the determination of the most appropriate specific treatment for individual patients. Recent developments in diagnostic technologies facilitated studies on retinal conditions and ocular disease in metabolism and endocrinology. Globally, diabetic retinopathy (DR) is regarded as a major cause of vision loss. Deep learning systems are effective and accurate in the detection of DR from digital fundus photographs or optical coherence tomography. Thus, using AI techniques, systems with high accuracy and efficiency can be developed for diagnosing and screening DR at an early stage and without the resources that are only accessible in special clinics. Deep learning enables early diagnosis with high specificity and sensitivity, which makes decisions based on minimally handcrafted features paving the way for personalized DR progression real-time monitoring and in-time ophthalmic or endocrine therapies. This review will discuss cutting-edge AI algorithms, the automated detecting systems of DR stage grading and feature segmentation, the prediction of DR outcomes and therapeutics, and the ophthalmic indications of other systemic diseases revealed by AI.

Optical Coherence Tomography Angiography in Diabetic Patients: A Systematic Review

Background: Diabetic retinopathy (DR) is the leading cause of legal blindness in the working population in developed countries. Optical coherence tomography (OCT) angiography (OCTA) has risen as an essential tool in the diagnosis and control of diabetic patients, with and without DR, allowing visualisation of the retinal and choroidal microvasculature, their qualitative and quantitative changes, the progression of vascular disease, quantification of ischaemic areas, and the detection of preclinical changes. The aim of this article is to analyse the current applications of OCTA and provide an updated overview of them in the evaluation of DR. Methods: A systematic literature search was performed in PubMed and Embase, including the keywords “OCTA” OR “OCT angiography” OR “optical coherence tomography angiography” AND “diabetes” OR “diabetes mellitus” OR “diabetic retinopathy” OR “diabetic maculopathy” OR “diabetic macular oedema” OR “diabetic macular ischaemia”. Of the 1456 studies initially identified, 107 studies were screened after duplication, and those articles that did not meet the selection criteria were removed. Finally, after looking for missing data, we included 135 studies in this review. Results: We present the common and distinctive findings in the analysed papers after the literature search including the diagnostic use of OCTA in diabetes mellitus (DM) patients. We describe previous findings in retinal vascularization, including microaneurysms, foveal avascular zone (FAZ) changes in both size and morphology, changes in vascular perfusion, the appearance of retinal microvascular abnormalities or new vessels, and diabetic macular oedema (DME) and the use of deep learning technology applied to this disease. Conclusion: OCTA findings enable the diagnosis and follow-up of DM patients, including those with no detectable lesions with other devices. The evaluation of retinal and choroidal plexuses using OCTA is a fundamental tool for the diagnosis and prognosis of DR.

An Open-Source Deep Learning Network for Reconstruction of High-Resolution OCT Angiograms of Retinal Intermediate and Deep Capillary Plexuses

Purpose

We propose a deep learning-based image reconstruction algorithm to produce high-resolution optical coherence tomographic angiograms (OCTA) of the intermediate capillary plexus (ICP) and deep capillary plexus (DCP).

Methods

In this study, 6-mm × 6-mm macular scans with a 400 × 400 A-line sampling density and 3-mm × 3-mm scans with a 304 × 304 A-line sampling density were acquired on one or both eyes of 180 participants (including 230 eyes with diabetic retinopathy and 44 healthy controls) using a 70-kHz commercial OCT system (RTVue-XR; Optovue, Inc., Fremont, California, USA). Projection-resolved OCTA algorithm removed projection artifacts in voxel. ICP and DCP angiograms were generated by maximum projection of the OCTA signal within the respective plexus. We proposed a deep learning-based method, which receives inputs from registered 3-mm × 3-mm ICP and DCP angiograms with proper sampling density as the ground truth reference to reconstruct 6-mm × 6-mm high-resolution ICP and DCP en face OCTA. We applied the same network on 3-mm × 3-mm angiograms to enhance these images further. We evaluated the reconstructed 3-mm × 3-mm and 6-mm × 6-mm angiograms based on vascular connectivity, Weber contrast, false flow signal (flow signal erroneously generated from background), and the noise intensity in the foveal avascular zone.

Results

Compared to the originals, the Deep Capillary Angiogram Reconstruction Network (DCARnet)-enhanced 6-mm × 6-mm angiograms had significantly reduced noise intensity (ICP, 7.38 ± 25.22, P < 0.001; DCP, 11.20 ± 22.52, P < 0.001), improved vascular connectivity (ICP, 0.95 ± 0.01, P < 0.001; DCP, 0.96 ± 0.01, P < 0.001), and enhanced Weber contrast (ICP, 4.25 ± 0.10, P < 0.001; DCP, 3.84 ± 0.84, P < 0.001), without generating false flow signal when noise intensity lower than 650. The DCARnet-enhanced 3-mm × 3-mm angiograms also reduced noise, improved connectivity, and enhanced Weber contrast in 3-mm × 3-mm ICP and DCP angiograms from 101 eyes. In addition, DCARnet preserved the appearance of the dilated vessels in the reconstructed angiograms in diabetic eyes.

Conclusions

DCARnet can enhance 3-mm × 3-mm and 6-mm × 6-mm ICP and DCP angiogram image quality without introducing artifacts.

Translational Relevance

The enhanced 6-mm × 6-mm angiograms may be easier for clinicians to interpret qualitatively.

Artificial intelligence in OCT angiography

Optical coherence tomographic angiography (OCTA) is a non-invasive imaging modality that provides three-dimensional, information-rich vascular images. With numerous studies demonstrating unique capabilities in biomarker quantification, diagnosis, and monitoring, OCTA technology has seen rapid adoption in research and clinical settings. The value of OCTA imaging is significantly enhanced by image analysis tools that provide rapid and accurate quantification of vascular features and pathology. Today, the most powerful image analysis methods are based on artificial intelligence (AI). While AI encompasses a large variety of techniques, machine-learning-based, and especially deep-learning-based, image analysis provides accurate measurements in a variety of contexts, including different diseases and regions of the eye. Here, we discuss the principles of both OCTA and AI that make their combination capable of answering new questions. We also review contemporary applications of AI in OCTA, which include accurate detection of pathologies such as choroidal neovascularization, precise quantification of retinal perfusion, and reliable disease diagnosis.

Effect of optical coherence tomography and angiography sampling rate towards diabetic retinopathy severity classification

Optical coherence tomography (OCT) and OCT angiography (OCT-A) may benefit the screening of diabetic retinopathy (DR). This study investigated the effect of laterally subsampling OCT/OCT-A en face scans by up to a factor of 8 when using deep neural networks for automated referable DR classification. There was no significant difference in the classification performance across all evaluation metrics when subsampling up to a factor of 3, and only minimal differences up to a factor of 8. Our findings suggest that OCT/OCT-A can reduce the number of samples (and hence the acquisition time) for a volume for a given field of view on the retina that is acquired for rDR classification.

OPTICAL COHERENCE TOMOGRAPHY ANGIOGRAPHY ASSESSMENT OF THE DIABETIC MACULA: A Comparison Study Among Different Algorithms

PURPOSE

To assess the impact of histogram adjustments and binarization thresholding selection on quantitative measurements of diabetic macular ischemia using optical coherence tomography angiography (OCTA).

METHODS

Patients with diabetic retinopathy (DR) who had swept-source OCTA imaging obtained were enrolled. An additional group of 15 healthy control subjects was included for comparison. Previously used brightness/contrast changes and binarization thresholds were applied to original OCTA images to obtain and compare different binarized images. Qualitative and quantitative comparisons were performed.

RESULTS

Thirty patients with DR (30 eyes) were included in the analysis. Fifteen eyes displayed the presence of diabetic macular edema. Qualitative grading revealed that binarized images obtained using a global threshold had better quality compared with local or multistep thresholds. The "median" filter was most frequently graded as the histogram adjustment resulting in binarized images with best quality. In the quantitative analysis, local thresholds tended to generate higher values of measured metrics. Differences in OCTA metrics between global and local thresholds were associated with presence of diabetic macular edema and signal strength index value. In the comparison between healthy and DR eyes, differences in OCTA metrics were significantly affected by binarization threshold selection.

CONCLUSION

Quantitative OCTA parameters may be significantly influenced by strategies to quantify macular perfusion. Image quality and presence of macular edema can significantly impact OCTA-derived quantitative vascular measurements and differences between global and local binarization thresholds. These findings highlight the importance of consistent strategies to reliably generate quantitative OCTA metrics in patients with DR.

Automated Detection and Diagnosis of Diabetic Retinopathy: A Comprehensive Survey

Diabetic Retinopathy (DR) is a leading cause of vision loss in the world. In the past few years, artificial intelligence (AI) based approaches have been used to detect and grade DR. Early detection enables appropriate treatment and thus prevents vision loss. For this purpose, both fundus and optical coherence tomography (OCT) images are used to image the retina. Next, Deep-learning (DL)-/machine-learning (ML)-based approaches make it possible to extract features from the images and to detect the presence of DR, grade its severity and segment associated lesions. This review covers the literature dealing with AI approaches to DR such as ML and DL in classification and segmentation that have been published in the open literature within six years (2016-2021). In addition, a comprehensive list of available DR datasets is reported. This list was constructed using both the PICO (P-Patient, I-Intervention, C-Control, O-Outcome) and Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) 2009 search strategies. We summarize a total of 114 published articles which conformed to the scope of the review. In addition, a list of 43 major datasets is presented.

Machine learning in optical coherence tomography angiography

Optical coherence tomography angiography (OCTA) offers a noninvasive label-free solution for imaging retinal vasculatures at the capillary level resolution. In principle, improved resolution implies a better chance to reveal subtle microvascular distortions associated with eye diseases that are asymptomatic in early stages. However, massive screening requires experienced clinicians to manually examine retinal images, which may result in human error and hinder objective screening. Recently, quantitative OCTA features have been developed to standardize and document retinal vascular changes. The feasibility of using quantitative OCTA features for machine learning classification of different retinopathies has been demonstrated. Deep learning-based applications have also been explored for automatic OCTA image analysis and disease classification. In this article, we summarize recent developments of quantitative OCTA features, machine learning image analysis, and classification.

Macular Ischemia Quantification Using Deep-Learning Denoised Optical Coherence Tomography Angiography in Branch Retinal Vein Occlusion

Purpose

To examine whether deep-learning denoised optical coherence tomography angiography (OCTA) images could enhance automated macular ischemia quantification in branch retinal vein occlusion (BRVO).

Methods

This retrospective, single-center, cross-sectional study enrolled 74 patients with BRVO and 46 age-matched healthy subjects. The severity of macular ischemia was graded as mild, moderate, or severe. Denoised OCTA images were produced using a neural network model. Quantitative parameters derived from denoised images, including vessel density and nonperfusion area, were compared with those derived from the OCTA machine. The main outcome measures were correlations between quantitative parameters, and areas under receiver operating characteristic curves (AUCs) in classifying the severity of the macular ischemia.

Results

The vessel density and nonperfusion area from denoised images were correlated strongly with the corresponding parameters from machine-derived images in control eyes and BRVO eyes with mild or moderate macular ischemia (all P < 0.001). However, no such correlation was found in eyes with severe macular ischemia. The vessel density and nonperfusion area from denoised images had significantly larger area under receiver operating characteristic curve than those derived from the original images in classifying moderate versus severe macular ischemia (0.927 vs 0.802 [P = 0.042] and 0.946 vs 0.797, [P = 0.022], respectively). There were no significant differences in the areas under receiver operating characteristic curve between the denoised images and the machine-derived parameters in classifying control versus BRVO, and mild versus moderate macular ischemia.

Conclusions

A neural network model is useful for removing speckle noise on OCTA images and facilitating the automated grading of macular ischemia in eyes with BRVO.

Translational Relevance

Deep-learning denoised optical coherence tomography angiography images could enhance automated macular ischemia quantification.

Quantification of Nonperfusion Area in Montaged Widefield OCT Angiography Using Deep Learning in Diabetic Retinopathy

Purpose

To examine the efficacy of a deep learning-based algorithm to quantify the nonperfusion area (NPA) on montaged widefield OCT angiography (OCTA) for assessment of diabetic retinopathy (DR) severity.

Design

Cross-sectional study.

Participants

One hundred thirty-seven participants with a full range of DR severity and 26 healthy participants.

Methods

A deep learning-based algorithm was developed for detecting and quantifying NPA in the superficial vascular complex on widefield OCTA comprising 3 horizontally montaged 6 × 6-mm OCTA scans from the nasal, macular, and temporal regions. We trained the algorithm on 978 volumetric OCTA scans from all participants using 5-fold cross-validation. The algorithm can distinguish NPA from shadow artifacts. The F1 score evaluated segmentation accuracy. The area under the receiver operating characteristic curve and sensitivity with specificity fixed at 95% quantified network performance to distinguish patients with diabetes from healthy control participants, referable DR from nonreferable DR (nonproliferative DR [NPDR] less than moderate severity), and severe DR (severe NPDR, proliferative DR, or DR with edema) from nonsevere DR (mild to moderate NPDR).

Main Outcome Measures

Widefield OCTA NPA, visual acuity (VA), and DR severities.

Results

Automatically segmented NPA showed high agreement with the manually delineated ground truth, with a mean ± standard deviation F1 score of 0.78 ± 0.05 in nasal, 0.82 ± 0.07 in macular, and 0.78 ± 0.05 in temporal scans. The extrafoveal avascular area (EAA) in the macular scan showed the best sensitivity at 54% for differentiating those with diabetes from healthy control participants, whereas montaged widefield OCTA scan showed significantly higher sensitivity than macular scans (P < 0.0001, McNemar’s test) for detecting eyes with DR at 66%, referable DR at 63%, and severe DR at 62%. Montaged widefield OCTA showed the highest correlation (Spearman ρ = 0.74; P < 0.0001) between EAA and DR severity. The macular scan showed the strongest negative correlation (Pearson ρ = –0.42; P < 0.0001) between EAA and best-corrected VA.

Conclusions

A deep learning-based algorithm for montaged widefield OCTA can detect NPA accurately and can improve the detection of clinically important DR.

Smoking effect on peripapillary and macular microvascular structure in inactive Graves' ophthalmopathy

OBJECTIVE

The aim of this study was to evaluate the smoking effect on peripapillary and macular microvascular structure in patients with inactive Graves' ophthalmopathy (GO) and to compare these structures with those of healthy control subjects.

METHODS

A total of 34 healthy participants (control group), 22 inactive GO patients with smoking (smoker group) and 19 inactive GO patients with non-smoking (non-smoker group) were recruited in this prospective study. After detailed ophthalmological examination, vessel densities (VD) of the superficial capillary plexus (SCP), deep capillary plexus (DCP), retinal peripapillary capillary (RPC) and foveal avascular zone (FAZ) area, and acircularity index (AI) of the FAZ were analysed with optical coherence tomography angiography (OCTA) for each eye.

RESULTS

Vessel density in the total peripapillary; superior and inferior sectors of RPC were significantly lower in inactive GO patients with smoking (p < 0.05 for all sectors) compared to control group. Besides, the FAZ AI was significantly higher in smoker and non-smoker inactive GO groups compared to healthy subjects (p = 0.0001, p = 0.0001, respectively). No significant difference was found in the FAZ area, and all SCP, DCP macular measurements between groups (p > 0.05 for all).

CONCLUSION

OCTA findings of lower peripapillary VD in the smoker group show smoking effect on the optic disc head microvasculature in inactive GO patients. These results could reflect early subclinical optic disc vasculature damage in smoker inactive GO subjects.

Retinal vessel changes in cerebrovascular disease

PURPOSE OF REVIEW

The retina is growingly recognized as a window into cerebrovascular and systemic vascular conditions. The utility of noninvasive retinal vessel biomarkers in cerebrovascular risk assessment has expanded due to advances in retinal imaging techniques and machine learning-based digital analysis. The purpose of this review is to underscore the latest evidence linking retinal vascular abnormalities with stroke and vascular-related cognitive disorders; to highlight modern developments in retinal vascular imaging modalities and software-based vasculopathy quantification.

RECENT FINDINGS

Longitudinal studies undertaken for extended periods indicate that retinal vascular changes can predict cerebrovascular disorders (CVD). Cerebrovascular ties to dementia provoked recent explorations of retinal vessel imaging tools for conceivable early cognitive decline detection. Innovative biomedical engineering technologies and advanced dynamic and functional retinal vascular imaging methods have recently been added to the armamentarium, allowing an unbiased and comprehensive analysis of the retinal vasculature. Improved artificial intelligence-based deep learning algorithms have boosted the application of retinal imaging as a clinical and research tool to screen, risk stratify, and monitor with precision CVD and vascular cognitive impairment.

SUMMARY

Mounting evidence supports the use of quantitative retinal vessel analysis in predicting CVD, from clinical stroke to neuroimaging markers of stroke and neurodegeneration.

Automated segmentation of retinal nonperfusion area in fluorescein angiography in retinal vein occlusion using convolutional neural networks

PURPOSE

Retinal vein occlusion (RVO) is the second most common cause of vision loss after diabetic retinopathy due to retinal vascular disease. Retinal nonperfusion (RNP), identified on fluorescein angiograms (FA) and appearing as hypofluorescence regions, is one of the most significant characteristics of RVO. Quantification of RNP is crucial for assessing the severity and progression of RVO. However, in current clinical practice, it is mostly conducted manually, which is time-consuming, subjective, and error-prone. The purpose of this study is to develop fully automated methods for segmentation of RNP using convolutional neural networks (CNNs).

METHODS

FA images from 161 patients were analyzed, and RNP areas were annotated by three independent physicians. The optimal method to use multi-physicians' labeled data to train the CNNs was evaluated. An adaptive histogram-based data augmentation method was utilized to boost the CNN performance. CNN methods based on context encoder module were developed for automated segmentation of RNP and compared with existing state-of-the-art methods.

RESULTS

The proposed methods achieved excellent agreements with physicians for segmentation of RNP in FA images. The CNN performance can be improved significantly by the proposed adaptive histogram-based data augmentation method. Using the averaged labels from physicians to train the CNNs achieved the best consensus with all physicians, with a mean accuracy of 0.883±0.166 with fivefold cross-validation.

CONCLUSIONS

We reported CNN methods to segment RNP in RVO in FA images. Our work can help improve clinical workflow, and can be useful for further investigating the association between RNP and retinal disease progression, as well as for evaluating the optimal treatments for the management of RVO.

Machine Learning Techniques for Ophthalmic Data Processing: A Review

Machine learning and especially deep learning techniques are dominating medical image and data analysis. This article reviews machine learning approaches proposed for diagnosing ophthalmic diseases during the last four years. Three diseases are addressed in this survey, namely diabetic retinopathy, age-related macular degeneration, and glaucoma. The review covers over 60 publications and 25 public datasets and challenges related to the detection, grading, and lesion segmentation of the three considered diseases. Each section provides a summary of the public datasets and challenges related to each pathology and the current methods that have been applied to the problem. Furthermore, the recent machine learning approaches used for retinal vessels segmentation, and methods of retinal layers and fluid segmentation are reviewed. Two main imaging modalities are considered in this survey, namely color fundus imaging, and optical coherence tomography. Machine learning approaches that use eye measurements and visual field data for glaucoma detection are also included in the survey. Finally, the authors provide their views, expectations and the limitations of the future of these techniques in the clinical practice.

Image Projection Network: 3D to 2D Image Segmentation in OCTA Images

We present an image projection network (IPN), which is a novel end-to-end architecture and can achieve 3D-to-2D image segmentation in optical coherence tomography angiography (OCTA) images. Our key insight is to build a projection learning module (PLM) which uses a unidirectional pooling layer to conduct effective features selection and dimension reduction concurrently. By combining multiple PLMs, the proposed network can input 3D OCTA data, and output 2D segmentation results such as retinal vessel segmentation. It provides a new idea for the quantification of retinal indicators: without retinal layer segmentation and without projection maps. We tested the performance of our network for two crucial retinal image segmentation issues: retinal vessel (RV) segmentation and foveal avascular zone (FAZ) segmentation. The experimental results on 316 OCTA volumes demonstrate that the IPN is an effective implementation of 3D-to-2D segmentation networks, and the uses of multi-modality information and volumetric information make IPN perform better than the baseline methods.

Optical coherence tomography angiography in diabetic retinopathy: an updated review

Diabetic retinopathy (DR) is a common microvascular complication of diabetes mellitus. Optical coherence tomography angiography (OCTA) has been developed to visualize the retinal microvasculature and choriocapillaris based on the motion contrast of circulating blood cells. Depth-resolved ability and non-invasive nature of OCTA allow for repeated examinations and visualization of microvasculature at the retinal capillary plexuses and choriocapillaris. OCTA enables quantification of microvascular alterations in the retinal capillary network, in addition to the detection of classical features associated with DR, including microaneurysms, intraretinal microvascular abnormalities, and neovascularization. OCTA has a promising role as an objective tool for quantifying extent of microvascular damage and identify eyes with diabetic macular ischaemia contributed to visual loss. Furthermore, OCTA can identify preclinical microvascular abnormalities preceding the onset of clinically detectable DR. In this review, we focused on the applications of OCTA derived quantitative metrics that are relevant to early detection, staging and progression of DR. Advancement of OCTA technology in clinical research will ultimately lead to enhancement of individualised management of DR and prevention of visual impairment in patients with diabetes.

Automated Segmentation of Retinal Fluid Volumes From Structural and Angiographic Optical Coherence Tomography Using Deep Learning

Purpose

We proposed a deep convolutional neural network (CNN), named Retinal Fluid Segmentation Network (ReF-Net), to segment retinal fluid in diabetic macular edema (DME) in optical coherence tomography (OCT) volumes.

Methods

The 3- × 3-mm OCT scans were acquired on one eye by a 70-kHz OCT commercial AngioVue system (RTVue-XR; Optovue, Inc., Fremont, CA, USA) from 51 participants in a clinical diabetic retinopathy (DR) study (45 with retinal edema and six healthy controls, age 61.3 ± 10.1 (mean ± SD), 33% female, and all DR cases were diagnosed as severe NPDR or PDR). A CNN with U-Net-like architecture was constructed to detect and segment the retinal fluid. Cross-sectional OCT and angiography (OCTA) scans were used for training and testing ReF-Net. The effect of including OCTA data for retinal fluid segmentation was investigated in this study. Volumetric retinal fluid can be constructed using the output of ReF-Net. Area-under-receiver-operating-characteristic-curve, intersection-over-union (IoU), and F1-score were calculated to evaluate the performance of ReF-Net.

Results

ReF-Net shows high accuracy (F1 = 0.864 ± 0.084) in retinal fluid segmentation. The performance can be further improved (F1 = 0.892 ± 0.038) by including information from both OCTA and structural OCT. ReF-Net also shows strong robustness to shadow artifacts. Volumetric retinal fluid can provide more comprehensive information than the two-dimensional (2D) area, whether cross-sectional or en face projections.

Conclusions

A deep-learning-based method can accurately segment retinal fluid volumetrically on OCT/OCTA scans with strong robustness to shadow artifacts. OCTA data can improve retinal fluid segmentation. Volumetric representations of retinal fluid are superior to 2D projections.

Translational Relevance

Using a deep learning method to segment retinal fluid volumetrically has the potential to improve the diagnostic accuracy of diabetic macular edema by OCT systems.

Optical Coherence Tomography Angiography Avascular Area Association With 1-Year Treatment Requirement and Disease Progression in Diabetic Retinopathy

PURPOSE

To assess the association between optical coherence tomography angiography (OCTA)-quantified avascular areas (AAs) and diabetic retinopathy (DR) severity, progression, and treatment requirement in the following year.

DESIGN

Prospective cohort study.

METHODS

We recruited patients with diabetes from a tertiary academic retina practice and obtained 3-mm × 3-mm macular OCTA scans with the AngioVue system and standard 7-field color photographs at baseline and at a 1-year follow-up visit. A masked grader determined the severity of DR from the color photographs using the Early Treatment of Diabetic Retinopathy scale. A custom algorithm detected extrafoveal AA (EAA) excluding the central 1-mm circle in projection-resolved superficial vascular complex (SVC), intermediate capillary plexus (ICP), and deep capillary plexus (DCP).

RESULTS

Of 138 patients, 92 (41 men, ranging in age from 26-84 years [mean 59.4 years]) completed 1 year of follow-up. At baseline, EAAs for SVC, ICP, and DCP were all significantly correlated with retinopathy severity (P < .0001). DCP EAA was significantly associated with worse visual acuity (r = -0.24, P = .02), but SVC and ICP EAA were not. At 1 year, 11 eyes progressed in severity by at least 1 step. Multivariate logistic regression analysis demonstrated the progression was significantly associated with baseline SVC EAA (odds ratio = 8.73, P = .04). During the follow-up period, 33 eyes underwent treatment. Multivariate analysis showed that treatment requirement was significantly associated with baseline DCP EAA (odds ratio = 3.39, P = .002). No baseline metric was associated with vision loss at 1 year.

CONCLUSIONS

EAAs detected by OCTA in diabetic eyes are significantly associated with baseline DR severity, disease progression, and treatment requirement over 1 year.

Impact of blood pressure control on retinal microvasculature in patients with chronic kidney disease

Chronic kidney disease (CKD) is an emerging disease worldwide. We investigated the relationship between blood pressure (BP) control and parafoveal retinal microvascular changes in patients with CKD. This case–control study enrolled 256 patients with CKD (stage 3–5) and 70 age‐matched healthy controls. Optical coherence tomography angiography showed lower superficial vascular plexus (SVP) vessel density, lower deep vascular plexus (DVP) vessel density, and larger SVP flow void area in the CKD group. The BP parameters at enrollment and during the year before enrollment were collected in patients with CKD. Partial correlation was used to determine the relationship between BP parameters and microvascular parameters after controlling for age, sex, diabetes mellitus, axial length, and intraocular pressure. The maximum systolic blood pressure (SBP) (p = 0.003) and within-patient standard deviation (SD) of SBP (p = 0.006) in 1 year were negatively correlated with SVP vessel density. The average SBP (p = 0.040), maximum SBP (p = 0.001), within-patient SD of SBP (p < 0.001) and proportion of high BP measurement (p = 0.011) in 1 year were positively correlated with the SVP flow void area. We concluded that long-term SBP was correlated with SVP microvascular injury in patients with CKD. Superficial retinal microvascular changes may be a potential biomarker for prior long-term BP control in these patients.

Microvasculature Segmentation and Intercapillary Area Quantification of the Deep Vascular Complex Using Transfer Learning

Purpose

Optical coherence tomography angiography (OCT-A) permits visualization of the changes to the retinal circulation due to diabetic retinopathy (DR), a microvascular complication of diabetes. We demonstrate accurate segmentation of the vascular morphology for the superficial capillary plexus (SCP) and deep vascular complex (DVC) using a convolutional neural network (CNN) for quantitative analysis.

Methods

The main CNN training dataset consisted of retinal OCT-A with a 6 × 6-mm field of view (FOV), acquired using a Zeiss PlexElite. Multiple-volume acquisition and averaging enhanced the vasculature contrast used for constructing the ground truth for neural network training. We used transfer learning from a CNN trained on smaller FOVs of the SCP acquired using different OCT instruments. Quantitative analysis of perfusion was performed on the resulting automated vasculature segmentations in representative patients with DR.

Results

The automated segmentations of the OCT-A images maintained the distinct morphologies of the SCP and DVC. The network segmented the SCP with an accuracy and Dice index of 0.8599 and 0.8618, respectively, and 0.7986 and 0.8139, respectively, for the DVC. The inter-rater comparisons for the SCP had an accuracy and Dice index of 0.8300 and 0.6700, respectively, and 0.6874 and 0.7416, respectively, for the DVC.

Conclusions

Transfer learning reduces the amount of manually annotated images required while producing high-quality automatic segmentations of the SCP and DVC that exceed inter-rater comparisons. The resulting intercapillary area quantification provides a tool for in-depth clinical analysis of retinal perfusion.

Translational Relevance

Accurate retinal microvasculature segmentation with the CNN results in improved perfusion analysis in diabetic retinopathy.

Sensorless adaptive-optics optical coherence tomographic angiography

Optical coherence tomographic angiography (OCTA) can image the retinal blood flow but visualization of the capillary caliber is limited by the low lateral resolution. Adaptive optics (AO) can be used to compensate ocular aberrations when using high numerical aperture (NA), and thus improve image resolution. However, previously reported AO-OCTA instruments were large and complex, and have a small sub-millimeter field of view (FOV) that hinders the extraction of biomarkers with clinical relevance. In this manuscript, we developed a sensorless AO-OCTA prototype with an intermediate numerical aperture to produce depth-resolved angiograms with high resolution and signal-to-noise ratio over a 2 × 2 mm FOV, with a focal spot diameter of 6 µm, which is about 3 times finer than typical commercial OCT systems. We believe these parameters may represent a better tradeoff between resolution and FOV compared to large-NA AO systems, since the spot size matches better that of capillaries. The prototype corrects defocus, astigmatism, and coma using a figure of merit based on the mean reflectance projection of a slab defined with real-time segmentation of retinal layers. AO correction with the ability to optimize focusing in arbitrary retinal depths - particularly the plexuses in the inner retina - could be achieved in 1.35 seconds. The AO-OCTA images showed greater flow signal, signal-to-noise ratio, and finer capillary caliber compared to commercial OCTA. Projection artifacts were also reduced in the intermediate and deep capillary plexuses. The instrument reported here improves OCTA image quality without excessive sacrifice in FOV and device complexity, and thus may have potential for clinical translation.

Reconstruction of high-resolution 6×6-mm OCT angiograms using deep learning

Typical optical coherence tomographic angiography (OCTA) acquisition areas on commercial devices are 3×3- or 6×6-mm. Compared to 3×3-mm angiograms with proper sampling density, 6×6-mm angiograms have significantly lower scan quality, with reduced signal-to-noise ratio and worse shadow artifacts due to undersampling. Here, we propose a deep-learning-based high-resolution angiogram reconstruction network (HARNet) to generate enhanced 6×6-mm superficial vascular complex (SVC) angiograms. The network was trained on data from 3×3-mm and 6×6-mm angiograms from the same eyes. The reconstructed 6×6-mm angiograms have significantly lower noise intensity, stronger contrast and better vascular connectivity than the original images. The algorithm did not generate false flow signal at the noise level presented by the original angiograms. The image enhancement produced by our algorithm may improve biomarker measurements and qualitative clinical assessment of 6×6-mm OCTA.

Optical Coherence Tomography Angiography in Diabetes and Diabetic Retinopathy

Diabetic retinopathy (DR) is a common complication of diabetes mellitus that disrupts the retinal microvasculature and is a leading cause of vision loss globally. Recently, optical coherence tomography angiography (OCTA) has been developed to image the retinal microvasculature, by generating 3-dimensional images based on the motion contrast of circulating blood cells. OCTA offers numerous benefits over traditional fluorescein angiography in visualizing the retinal vasculature in that it is non-invasive and safer; while its depth-resolved ability makes it possible to visualize the finer capillaries of the retinal capillary plexuses and choriocapillaris. High-quality OCTA images have also enabled the visualization of features associated with DR, including microaneurysms and neovascularization and the quantification of alterations in retinal capillary and choriocapillaris, thereby suggesting a promising role for OCTA as an objective technology for accurate DR classification. Of interest is the potential of OCTA to examine the effect of DR on individual retinal layers, and to detect DR even before it is clinically detectable on fundus examination. We will focus the review on the clinical applicability of OCTA derived quantitative metrics that appear to be clinically relevant to the diagnosis, classification, and management of patients with diabetes or DR. Future studies with longitudinal design of multiethnic multicenter populations, as well as the inclusion of pertinent systemic information that may affect vascular changes, will improve our understanding on the benefit of OCTA biomarkers in the detection and progression of DR.

Deep iterative vessel segmentation in OCT angiography

This paper addresses retinal vessel segmentation on optical coherence tomography angiography (OCT-A) images of the human retina. Our approach is motivated by the need for high precision image-guided delivery of regenerative therapies in vitreo-retinal surgery. OCT-A visualizes macular vasculature, the main landmark of the surgically targeted area, at a level of detail and spatial extent unattainable by other imaging modalities. Thus, automatic extraction of detailed vessel maps can ultimately inform surgical planning. We address the task of delineation of the Superficial Vascular Plexus in 2D Maximum Intensity Projections (MIP) of OCT-A using convolutional neural networks that iteratively refine the quality of the produced vessel segmentations. We demonstrate that the proposed approach compares favourably to alternative network baselines and graph-based methodologies through extensive experimental analysis, using data collected from 50 subjects, including both individuals that underwent surgery for structural macular abnormalities and healthy subjects. Additionally, we demonstrate generalization to 3D segmentation and narrower field-of-view OCT-A. In the future, the extracted vessel maps will be leveraged for surgical planning and semi-automated intraoperative navigation in vitreo-retinal surgery.

Analysis of Foveal and Parafoveal Microvascular Density and Retinal Vessel Caliber Alteration in Inactive Graves' Ophthalmopathy

Purpose

We aimed to evaluate foveal and parafoveal density using optical coherence tomography angiography and the alteration on the retinal vessel diameter in patients with inactive Graves' ophthalmopathy compared to age-matched normal population. Materials and Methods. Patients with inactive Graves' ophthalmopathy (study group) and healthy individuals (control group) were enrolled in the cross sectionally designed study. The optical coherence tomography angiography parameters and retinal vessel diameter measurements were assessed between the study and control groups. Foveal and parafoveal microvascular density in the retina was measured using optical coherence tomography angiography. Retinal artery and vein diameter and artery/vein ratio were assessed for retinal vessel caliber changes.

Results

Patients with inactive Graves' ophthalmopathy had higher values of intraocular pressure, proptosis, and axial length (P=0.001, P=0.001, P=0.001, P=0.001, P=0.001, P=0.001, P=0.001, P=0.001, P=0.001, P=0.001, P=0.001,

Conclusion

Optical coherence tomography angiography could be a novel and promising noninvasive diagnostic technique in patients with inactive Graves' ophthalmopathy to detect foveal and parafoveal vessel density changes compared to healthy subjects. The decrease of retinal vessel diameter might be observed in patients with inactive graves ophthalmopathy.

Quantitative optical coherence tomography angiography: A review

As a new optical coherence tomography (OCT) modality, OCT angiography (OCTA) provides a noninvasive method to detect microvascular distortions correlated with eye conditions. By providing unparalleled capability to differentiate individual plexus layers in the retina, OCTA has demonstrated its excellence in clinical management of diabetic retinopathy, glaucoma, sickle cell retinopathy, diabetic macular edema, and other eye diseases. Quantitative OCTA analysis of retinal and choroidal vasculatures is essential to standardize objective interpretations of clinical outcome. Quantitative features, including blood vessel tortuosity, blood vessel caliber, blood vessel density, vessel perimeter index, fovea avascular zone area, fovea avascular zone contour irregularity, vessel branching coefficient, vessel branching angle, branching width ratio, and choroidal vascular analysis have been established for objective OCTA assessment. Moreover, differential artery–vein analysis has been recently demonstrated to improve OCTA performance for objective detection and classification of eye diseases. In this review, technical rationales and clinical applications of these quantitative OCTA features are summarized, and future prospects for using these quantitative OCTA features for artificial intelligence classification of eye conditions are discussed.

Automated diagnosis and segmentation of choroidal neovascularization in OCT angiography using deep learning

Accurate identification and segmentation of choroidal neovascularization (CNV) is essential for the diagnosis and management of exudative age-related macular degeneration (AMD). Projection-resolved optical coherence tomographic angiography (PR-OCTA) enables both cross-sectional and en face visualization of CNV. However, CNV identification and segmentation remains difficult even with PR-OCTA due to the presence of residual artifacts. In this paper, a fully automated CNV diagnosis and segmentation algorithm using convolutional neural networks (CNNs) is described. This study used a clinical dataset, including both scans with and without CNV, and scans of eyes with different pathologies. Furthermore, no scans were excluded due to image quality. In testing, all CNV cases were diagnosed from non-CNV controls with 100% sensitivity and 95% specificity. The mean intersection over union of CNV membrane segmentation was as high as 0.88. By enabling fully automated categorization and segmentation, the proposed algorithm should offer benefits for CNV diagnosis, visualization monitoring.

Robust non-perfusion area detection in three retinal plexuses using convolutional neural network in OCT angiography

Non-perfusion area (NPA) is a quantitative biomarker useful for characterizing ischemia in diabetic retinopathy (DR). Projection-resolved optical coherence tomographic angiography (PR-OCTA) allows visualization of retinal capillaries and quantify NPA in individual plexuses. However, poor scan quality can make current NPA detection algorithms unreliable and inaccurate. In this work, we present a robust NPA detection algorithm using convolutional neural network (CNN). By merging information from OCT angiograms and OCT reflectance images, the CNN could exclude signal reduction and motion artifacts and detect the avascular features from local to global with the resolution preserved. Across a wide range of signal strength indices, and on both healthy and DR eyes, the algorithm achieved high accuracy and repeatability.