An accurate multimodal 3-D vessel segmentation method based on brightness variations on OCT layers and curvelet domain fundus image analysis

Automated Detection and Diagnosis of Diabetic Retinopathy: A Comprehensive Survey

Diabetic Retinopathy (DR) is a leading cause of vision loss in the world. In the past few years, artificial intelligence (AI) based approaches have been used to detect and grade DR. Early detection enables appropriate treatment and thus prevents vision loss. For this purpose, both fundus and optical coherence tomography (OCT) images are used to image the retina. Next, Deep-learning (DL)-/machine-learning (ML)-based approaches make it possible to extract features from the images and to detect the presence of DR, grade its severity and segment associated lesions. This review covers the literature dealing with AI approaches to DR such as ML and DL in classification and segmentation that have been published in the open literature within six years (2016-2021). In addition, a comprehensive list of available DR datasets is reported. This list was constructed using both the PICO (P-Patient, I-Intervention, C-Control, O-Outcome) and Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) 2009 search strategies. We summarize a total of 114 published articles which conformed to the scope of the review. In addition, a list of 43 major datasets is presented.

Image Projection Network: 3D to 2D Image Segmentation in OCTA Images

We present an image projection network (IPN), which is a novel end-to-end architecture and can achieve 3D-to-2D image segmentation in optical coherence tomography angiography (OCTA) images. Our key insight is to build a projection learning module (PLM) which uses a unidirectional pooling layer to conduct effective features selection and dimension reduction concurrently. By combining multiple PLMs, the proposed network can input 3D OCTA data, and output 2D segmentation results such as retinal vessel segmentation. It provides a new idea for the quantification of retinal indicators: without retinal layer segmentation and without projection maps. We tested the performance of our network for two crucial retinal image segmentation issues: retinal vessel (RV) segmentation and foveal avascular zone (FAZ) segmentation. The experimental results on 316 OCTA volumes demonstrate that the IPN is an effective implementation of 3D-to-2D segmentation networks, and the uses of multi-modality information and volumetric information make IPN perform better than the baseline methods.

ARCOCT: Automatic detection of lumen border in intravascular OCT images

BACKGROUND AND OBJECTIVE

Intravascular optical coherence tomography (OCT) is an invaluable tool for the detection of pathological features on the arterial wall and the investigation of post-stenting complications. Computational lumen border detection in OCT images is highly advantageous, since it may support rapid morphometric analysis. However, automatic detection is very challenging, since OCT images typically include various artifacts that impact image clarity, including features such as side branches and intraluminal blood presence. This paper presents ARCOCT, a segmentation method for fully-automatic detection of lumen border in OCT images.

METHODS

ARCOCT relies on multiple, consecutive processing steps, accounting for image preparation, contour extraction and refinement. In particular, for contour extraction ARCOCT employs the transformation of OCT images based on physical characteristics such as reflectivity and absorption of the tissue and, for contour refinement, local regression using weighted linear least squares and a 2nd degree polynomial model is employed to achieve artifact and small-branch correction as well as smoothness of the artery mesh. Our major focus was to achieve accurate contour delineation in the various types of OCT images, i.e., even in challenging cases with branches and artifacts.

RESULTS

ARCOCT has been assessed in a dataset of 1812 images (308 from stented and 1504 from native segments) obtained from 20 patients. ARCOCT was compared against ground-truth manual segmentation performed by experts on the basis of various geometric features (e.g. area, perimeter, radius, diameter, centroid, etc.) and closed contour matching indicators (the Dice index, the Hausdorff distance and the undirected average distance), using standard statistical analysis methods. The proposed method was proven very efficient and close to the ground-truth, exhibiting non statistically-significant differences for most of the examined metrics.

CONCLUSIONS

ARCOCT allows accurate and fully-automated lumen border detection in OCT images.

A hybrid method for 3D mosaicing of OCT images of macula and Optic Nerve Head

A mosaiced image is the result of merging two or more images with overlapping area in order to generate a high resolution panorama of a large scene. A wide view of Optical Coherence Tomography (OCT) images can help clinicians in diagnosis by enabling simultaneous analysis of different portions of the gathered information. In this paper, we present a novel method for mosaicing of 3D OCT images of macula and Optic Nerve Head (ONH) that is carried out in two phases; registration of OCT projections and mosaicing of B-scans. In the first phase, in order to register the OCT projection images of macula and ONH, their corresponding color fundus image is considered as the main frame and the geometrical features of their curvelet-based extracted vessels are employed for registration. The registration parameters obtained are then applied on all x-y slices of the 3D OCT images of macula and ONH. In the B-scan mosaicing phase, the overlapping areas of corresponding reprojected B-scans are extracted and the best registration model is obtained based on line-by-line matching of corresponding A-scans in overlapping areas. This registration model is then applied to the remaining A-scans of the ONH-based B-scan. The aligned B-scans of macular OCT and OCT images of ONH are finally blended and 3D mosaiced OCT images are obtained. Two criteria are considered for assessment of mosaiced images; the quality of alignment/mosaicing of B-scans and the loss of clinical information from the B-scans after mosaicing. The average grading values of 3.5 ± 0.74 and 3.63 ± 0.55 (out of 4) are obtained for the first and second criteria, respectively.

Automatic blood vessels segmentation based on different retinal maps from OCTA scans

The retinal vascular network reflects the health of the retina, which is a useful diagnostic indicator of systemic vascular. Therefore, the segmentation of retinal blood vessels is a powerful method for diagnosing vascular diseases. This paper presents an automatic segmentation system for retinal blood vessels from Optical Coherence Tomography Angiography (OCTA) images. The system segments blood vessels from the superficial and deep retinal maps for normal and diabetic cases. Initially, we reduced the noise and improved the contrast of the OCTA images by using the Generalized Gauss-Markov random field (GGMRF) model. Secondly, we proposed a joint Markov-Gibbs random field (MGRF) model to segment the retinal blood vessels from other background tissues. It integrates both appearance and spatial models in addition to the prior probability model of OCTA images. The higher order MGRF (HO-MGRF) model in addition to the 1^st-order intensity model are used to consider the spatial information in order to overcome the low contrast between vessels and other tissues. Finally, we refined the segmentation by extracting connected regions using a 2D connectivity filter. The proposed segmentation system was trained and tested on 47 data sets, which are 23 normal data sets and 24 data sets for diabetic patients. To evaluate the accuracy and robustness of the proposed segmentation framework, we used three different metrics, which are Dice similarity coefficient (DSC), absolute vessels volume difference (VVD), and area under the curve (AUC). The results on OCTA data sets (DSC=95.04±3.75%, VVD=8.51±1.49%, and AUC=95.20±1.52%) show the promise of the proposed segmentation approach.

Segmentation Based Sparse Reconstruction of Optical Coherence Tomography Images

We demonstrate the usefulness of utilizing a segmentation step for improving the performance of sparsity based image reconstruction algorithms. In specific, we will focus on retinal optical coherence tomography (OCT) reconstruction and propose a novel segmentation based reconstruction framework with sparse representation, termed segmentation based sparse reconstruction (SSR). The SSR method uses automatically segmented retinal layer information to construct layer-specific structural dictionaries. In addition, the SSR method efficiently exploits patch similarities within each segmented layer to enhance the reconstruction performance. Our experimental results on clinical-grade retinal OCT images demonstrate the effectiveness and efficiency of the proposed SSR method for both denoising and interpolation of OCT images.