Detection of optic disc in retinal images by means of a geometrical model of vessel structure

A narrative review of retinal vascular parameters and the applications (Part I): Measuring methods

The retina is often used to evaluate the vascular health status of eyes and the whole body directly and noninvasively in vivo. Retinal vascular parameters included caliber, tortuosity and fractal dimension. These variables represent the density or geometric characteristics of the vascular network apart from reflecting structural changes in the retinal vessel system. Currently, these parameters are often used as indicators of retinal disease, cardiovascular and cerebrovascular disease. Advanced digital fundus photography apparatus and computer-assisted analysis techniques combined with artificial intelligence, make the quantitative calculation of these parameters easier, objective, and labor-saving.

ECLNet: Center localization of eye structures based on Adaptive Gaussian Ellipse Heatmap

Accurately localizing the center of specific biological structures in medical images is of great significance for clinical treatment. The center localization task can be viewed as an estimation problem of keypoints, and the heatmap is often used to describe the probability of the location of keypoints during estimation. Existing methods construct the heatmap from a Gaussian kernel function with a fixed standard deviation, therefore cannot adapt to morphologic changes of the target region. In this paper, we build a deep network, ECLNet, to localize the center of eye-related structures in medical images. Meanwhile, we propose a method called Adaptive Gaussian Ellipse Heatmap (AGEH), which can efficiently utilize the gradient feature of the target region to adjust the morphology of the heatmap. The ECLNet localizes the optic disc and fovea center with mean Euclidean Distance of 17.995 and 39.446 pixels, respectively, for IDRiD dataset. The ECLNet also successfully localizes the eye center with the mean absolute Position Error of 0.186±0.027 mm for CATARACT dataset. The results show that our proposed method has a better performance compared with some state-of-the-art methods.

AFENet: Attention Fusion Enhancement Network for Optic Disc Segmentation of Premature Infants

Retinopathy of prematurity and ischemic brain injury resulting in periventricular white matter damage are the main causes of visual impairment in premature infants. Accurate optic disc (OD) segmentation has important prognostic significance for the auxiliary diagnosis of the above two diseases of premature infants. Because of the complexity and non-uniform illumination and low contrast between background and the target area of the fundus images, the segmentation of OD for infants is challenging and rarely reported in the literature. In this article, to tackle these problems, we propose a novel attention fusion enhancement network (AFENet) for the accurate segmentation of OD in the fundus images of premature infants by fusing adjacent high-level semantic information and multiscale low-level detailed information from different levels based on encoder-decoder network. Specifically, we first design a dual-scale semantic enhancement (DsSE) module between the encoder and the decoder inspired by self-attention mechanism, which can enhance the semantic contextual information for the decoder by reconstructing skip connection. Then, to reduce the semantic gaps between the high-level and low-level features, a multiscale feature fusion (MsFF) module is developed to fuse multiple features of different levels at the top of encoder by using attention mechanism. Finally, the proposed AFENet was evaluated on the fundus images of preterm infants for OD segmentation, which shows that the proposed two modules are both promising. Based on the baseline (Res34UNet), using DsSE or MsFF module alone can increase Dice similarity coefficients by 1.51 and 1.70%, respectively, whereas the integration of the two modules together can increase 2.11%. Compared with other state-of-the-art segmentation methods, the proposed AFENet achieves a high segmentation performance.

A detailed and comparative work for retinal vessel segmentation based on the most effective heuristic approaches

Computer based imaging and analysis techniques are frequently used for the diagnosis and treatment of retinal diseases. Although retinal images are of high resolution, the contrast of the retinal blood vessels is usually very close to the background of the retinal image. The detection of the retinal blood vessels with low contrast or with contrast close to the background of the retinal image is too difficult. Therefore, improving algorithms which can successfully distinguish retinal blood vessels from the retinal image has become an important area of research. In this work, clustering based heuristic artificial bee colony, particle swarm optimization, differential evolution, teaching learning based optimization, grey wolf optimization, firefly and harmony search algorithms were applied for accurate segmentation of retinal vessels and their performances were compared in terms of convergence speed, mean squared error, standard deviation, sensitivity, specificity. accuracy and precision. From the simulation results it is seen that the performance of the algorithms in terms of convergence speed and mean squared error is close to each other. It is observed from the statistical analyses that the algorithms show stable behavior and also the vessel and the background pixels of the retinal image can successfully be clustered by the heuristic algorithms.

Grey-Wolf-Based Wang's Demons for Retinal Image Registration

Image registration has an imperative role in medical imaging. In this work, a grey-wolf optimizer (GWO)-based non-rigid demons registration is proposed to support the retinal image registration process. A comparative study of the proposed GWO-based demons registration framework with cuckoo search, firefly algorithm, and particle swarm optimization-based demons registration is conducted. In addition, a comparative analysis of different demons registration methods, such as Wang’s demons, Tang’s demons, and Thirion’s demons which are optimized using the proposed GWO is carried out. The results established the superiority of the GWO-based framework which achieved 0.9977 correlation, and fast processing compared to the use of the other optimization algorithms. Moreover, GWO-based Wang’s demons performed better accuracy compared to the Tang’s demons and Thirion’s demons framework. It also achieved the best less registration error of 8.36 × 10⁻⁵.

Robust Fovea Localization Based on Symmetry Measure

Automatic fovea localization is a challenging issue. In this article, we focus on the study of fovea localization and propose a robust fovea localization method. We propose concentric circular sectional symmetry measure (CCSSM) for symmetry axis detection, and region of interest (ROI) determination, which is a global feature descriptor robust against local feature changes, to solve the lesion interference issue, i.e., fovea visibility interference from lesions, using both structure features and morphological features. We propose the index of convexity and concavity (ICC) as the convexity-concavity measure of the surface and provide a quantitative evaluation tool for ophthalmologists to learn whether the occurrence of lesion within the ROI. We propose the weighted gradient accumulation map, which is insensitive to local intensity changes and can overcome the influence of noise and contamination, to perform refined localization. The advantages of the proposed method lies in two aspects. First, the accuracy and robustness can be achieved without typical sophisticated manner, i.e., blood vessel segmentation and parabola fitting. Second, the lesion interference is considered in our plan of fovea localization. Our proposed symmetry-based method is innovative in the solution of fovea detection, and it is simple, practical, and controllable. Experiment results show that the proposed method can resist the interference of unbalanced illumination and lesions, and achieve high accuracy rate in five datasets. Compared to the state-of-the-art methods, high robustness and accuracy of the proposed method guarantees its reliability.

Localizing Optic Disc in Retinal Image Automatically with Entropy Based Algorithm

Examining retinal image continuously plays an important role in determining human eye health; with any variation present in this image, it may be resulting from some disease. Therefore, there is a need for computer-aided scanning for retinal image to perform this task automatically and accurately. The fundamental step in this task is identification of the retina elements; optical disk localization is the most important one in this identification. Different optical disc localization algorithms have been suggested, such as an algorithm that would be proposed in this paper. The assumption is based on the fact that optical disc area has rich information, so its entropy value is more significant in this area. The suggested algorithm has recursive steps for testing the entropy of different patches in image; sliding window technique is used to get these patches in a specific way. The results of practical work were obtained using different common data set, which achieved good accuracy in trivial computation time. Finally, this paper consists of four sections: a section for introduction containing the related works, a section for methodology and material, a section for practical work with results, and a section for conclusion.

Fast detection of the main anatomical structures in digital retinal images based on intra- and inter-structure relational knowledge

BACKGROUND AND OBJECTIVE

The anatomical structure detection in retinal images is an open problem. However, most of the works in the related literature are oriented to the detection of each structure individually or assume the previous detection of a structure which is used as a reference. The objective of this paper is to obtain simultaneous detection of the main retinal structures (optic disc, macula, network of vessels and vascular bundle) in a fast and robust way.

METHODS

We propose a new methodology oriented to accomplish the mentioned objective. It consists of two stages. In an initial stage, a set of operators is applied to the retinal image. Each operator uses intra-structure relational knowledge in order to produce a set of candidate blobs that belongs to the desired structure. In a second stage, a set of tuples is created, each of which contains a different combination of the candidate blobs. Next, filtering operators, using inter-structure relational knowledge, are used in order to find the winner tuple. A method using template matching and mathematical morphology is implemented following the proposed methodology.

RESULTS

A success is achieved if the distance between the automatically detected blob center and the actual structure center is less than or equal to one optic disc radius. The success rates obtained in the different public databases analyzed were: MESSIDOR (99.33%, 98.58%, 97.92%), DIARETDB1 (96.63%, 100%, 97.75%), DRIONS (100%, n/a, 100%) and ONHSD (100%, 98.85%, 97.70%) for optic disc (OD), macula (M) and vascular bundle (VB), respectively. Finally, the overall success rate obtained in this study for each structure was: 99.26% (OD), 98.69% (M) and 98.95% (VB). The average time of processing per image was 4.16 ± 0.72 s.

CONCLUSIONS

The main advantage of the use of inter-structure relational knowledge was the reduction of the number of false positives in the detection process. The implemented method is able to simultaneously detect four structures. It is fast, robust and its detection results are competitive in relation to other methods of the recent literature.

Automatic optic disk detection in retinal images using hybrid vessel phase portrait analysis

We propose vessel vector-based phase portrait analysis (VVPPA) and a hybrid between VVPPA and a clustering method proposed earlier for automatic optic disk (OD) detection called the vessel transform (VT). The algorithms are based primarily on the location and direction of retinal blood vessels and work equally well on fine and poor quality images. To localize the OD, the direction vectors derived from the vessel network are constructed, and points of convergence of the resulting vector field are examined by phase portrait analysis. The hybrid method (HM) uses a set of rules acquired from the decision model to alternate the use of VVPPA and VT. To identify the OD contour, the scale space (SS) approach is integrated with VVPPA, HM, and the circular approximation (SSVVPPAC and SSHMC). We test the proposed combination against state-of-the-art OD detection methods. The results show that the proposed algorithms outperform the benchmark methods, especially on poor quality images. Specifically, the HM gets the highest accuracy of 98% for localization of the OD regardless of the image quality. Testing the segmentation routines SSVVPPAC and SSHMC against the conventional methods shows that SSHMC performs better than the existing methods, achieving the highest PPV of 71.81% and the highest sensitivity of 70.67% for poor quality images. Furthermore, the HM can supplement practically any segmentation model as long as it offers multiple OD candidates. In order to prove this claim, we test the efficiency of the HM in detecting retinal abnormalities in a real clinical setting. The images have been obtained by portable lens connected to a smart phone. In detecting the abnormalities related to diabetic retinopathy (DR), the algorithm provided 94.67 and 98.13% for true negatives and true positives, respectively.

Investigations of severity level measurements for diabetic macular oedema using machine learning algorithms

BACKGROUND

The macula is an important part of the human visual system and is responsible for clear and colour vision. Macular oedema happens when fluid and protein deposit on or below the macula of the eye and cause the macula to thicken and swell. Normally, it occurs due to diabetes called diabetic macular oedema. Diabetic macular oedema (DME) is one of the main causes of visual impairment in patients.

AIM

The aims of the present study are to detect and localize abnormalities in blood vessels with respect to macula in order to prevent vision loss for the diabetic patients.

METHODS

In this work, a novel fully computerized algorithm is used for the recognition of various diseases in macula using both fundus images and optical coherence tomography (OCT) images. Abnormal blood vessels are segmented using thresholding algorithm. The classification is performed by three different classifiers, namely, the support vector machine (SVM), cascade neural network (CNN) and partial least square (PLS) classifiers, which are employed to identify whether the image is normal or abnormal.

CONCLUSION

The results of all of the classifiers are compared based on their accuracy. The classifier accuracies of the SVM, cascade neural network and partial least square are 98.33, 97.16 and 94.34%, respectively. While analysing DME using both images, OCT produced efficient output than fundus images. Information about the severity of the disease and the localization of the pathologies is very useful to the ophthalmologist for diagnosing disease and choosing the proper treatment for a patient to prevent vision loss.

Localization of optic disc and fovea in retinal images using intensity based line scanning analysis

Accurate detection of diabetic retinopathy (DR) mainly depends on identification of retinal landmarks such as optic disc and fovea. Present methods suffer from challenges like less accuracy and high computational complexity. To address this issue, this paper presents a novel approach for fast and accurate localization of optic disc (OD) and fovea using one-dimensional scanned intensity profile analysis. The proposed method utilizes both time and frequency domain information effectively for localization of OD. The final OD center is located using signal peak-valley detection in time domain and discontinuity detection in frequency domain analysis. However, with the help of detected OD location, the fovea center is located using signal valley analysis. Experiments were conducted on MESSIDOR dataset, where OD was successfully located in 1197 out of 1200 images (99.75%) and fovea in 1196 out of 1200 images (99.66%) with an average computation time of 0.52s. The large scale evaluation has been carried out extensively on nine publicly available databases. The proposed method is highly efficient in terms of quickly and accurately localizing OD and fovea structure together compared with the other state-of-the-art methods.

An Approach to Evaluate Blurriness in Retinal Images with Vitreous Opacity for Cataract Diagnosis

Cataract is one of the leading causes of blindness in the world's population. A method to evaluate blurriness for cataract diagnosis in retinal images with vitreous opacity is proposed in this paper. Three types of features are extracted, which include pixel number of visible structures, mean contrast between vessels and background, and local standard deviation. To avoid the wrong detection of vitreous opacity as retinal structures, a morphological method is proposed to detect and remove such lesions from retinal visible structure segmentation. Based on the extracted features, a decision tree is trained to classify retinal images into five grades of blurriness. The proposed approach was tested using 1355 clinical retinal images, and the accuracies of two-class classification and five-grade grading compared with that of manual grading are 92.8% and 81.1%, respectively. The kappa value between automatic grading and manual grading is 0.74 in five-grade grading, in which both variance and P value are less than 0.001. Experimental results show that the grading difference between automatic grading and manual grading is all within 1 grade, which is much improvement compared with that of other available methods. The proposed grading method provides a universal measure of cataract severity and can facilitate the decision of cataract surgery.

Robust Retinal Blood Vessel Segmentation Based on Reinforcement Local Descriptions

Retinal blood vessels segmentation plays an important role for retinal image analysis. In this paper, we propose robust retinal blood vessel segmentation method based on reinforcement local descriptions. A novel line set based feature is firstly developed to capture local shape information of vessels by employing the length prior of vessels, which is robust to intensity variety. After that, local intensity feature is calculated for each pixel, and then morphological gradient feature is extracted for enhancing the local edge of smaller vessel. At last, line set based feature, local intensity feature, and morphological gradient feature are combined to obtain the reinforcement local descriptions. Compared with existing local descriptions, proposed reinforcement local description contains more local information of local shape, intensity, and edge of vessels, which is more robust. After feature extraction, SVM is trained for blood vessel segmentation. In addition, we also develop a postprocessing method based on morphological reconstruction to connect some discontinuous vessels and further obtain more accurate segmentation result. Experimental results on two public databases (DRIVE and STARE) demonstrate that proposed reinforcement local descriptions outperform the state-of-the-art method.

Medical Image Enhancement Using Edge Information-Based Methods

Medical image enhancement improves the quality and facilitates diagnosis. This chapter investigates three methods of medical image enhancement by exploiting useful edge information. Since edges have higher perceptual importance, the edge information based enhancement process is always of interest. But determination of edge information is not an easy job. The edge information is obtained from various approaches such as differential hyperbolic function, Haar filters and morphological functions. The effectively determined edge information is used for enhancement process. The retinal image enhancement method given in this chapter improves the visual quality of the vessels in the optic region. X-ray image enhancement method presented here is to increase the visibility of the bones. These algorithms are used to enhance the computer tomography, chest x-ray, retinal, and mammogram images. These images are obtained from standard datasets and experimented. The performance of these enhancement methods are quantitatively evaluated.

A review on automatic analysis techniques for color fundus photographs

In this paper, we give a review on automatic image processing tools to recognize diseases causing specific distortions in the human retina. After a brief summary of the biology of the retina, we give an overview of the types of lesions that may appear as biomarkers of both eye and non-eye diseases. We present several state-of-the-art procedures to extract the anatomic components and lesions in color fundus photographs and decision support methods to help clinical diagnosis. We list publicly available databases and appropriate measurement techniques to compare quantitatively the performance of these approaches. Furthermore, we discuss on how the performance of image processing-based systems can be improved by fusing the output of individual detector algorithms. Retinal image analysis using mobile phones is also addressed as an expected future trend in this field.

Optic Disc Localization Using Directional Models

Reliable localization of the optic disc (OD) is important for retinal image analysis and ophthalmic pathology screening. This paper presents a novel method to automatically localize ODs in retinal fundus images based on directional models. According to the characteristics of retina vessel networks, such as their origin at the OD and parabolic shape of the main vessels, a global directional model, named the relaxed biparabola directional model, is first built. In this model, the main vessels are modeled by using two parabolas with a shared vertex and different parameters. Then, a local directional model, named the disc directional model, is built to characterize the local vessel convergence in the OD as well as the shape and the brightness of the OD. Finally, the global and the local directional models are integrated to form a hybrid directional model, which can exploit the advantages of the global and local models for highly accurate OD localization. The proposed method is evaluated on nine publicly available databases, and achieves an accuracy of 100% for each database, which demonstrates the effectiveness of the proposed OD localization method.

Optic Disc Boundary and Vessel Origin Segmentation of Fundus Images

This paper presents a novel classification-based optic disc (OD) segmentation algorithm that detects the OD boundary and the location of vessel origin (VO) pixel. First, the green plane of each fundus image is resized and morphologically reconstructed using a circular structuring element. Bright regions are then extracted from the morphologically reconstructed image that lie in close vicinity of the major blood vessels. Next, the bright regions are classified as bright probable OD regions and non-OD regions using six region-based features and a Gaussian mixture model classifier. The classified bright probable OD region with maximum Vessel-Sum and Solidity is detected as the best candidate region for the OD. Other bright probable OD regions within 1-disc diameter from the centroid of the best candidate OD region are then detected as remaining candidate regions for the OD. A convex hull containing all the candidate OD regions is then estimated, and a best-fit ellipse across the convex hull becomes the segmented OD boundary. Finally, the centroid of major blood vessels within the segmented OD boundary is detected as the VO pixel location. The proposed algorithm has low computation time complexity and it is robust to variations in image illumination, imaging angles, and retinal abnormalities. This algorithm achieves 98.8%-100% OD segmentation success and OD segmentation overlap score in the range of 72%-84% on images from the six public datasets of DRIVE, DIARETDB1, DIARETDB0, CHASE_DB1, MESSIDOR, and STARE in less than 2.14 s per image. Thus, the proposed algorithm can be used for automated detection of retinal pathologies, such as glaucoma, diabetic retinopathy, and maculopathy.

Optic disc detection and boundary extraction in retinal images

With the development of digital image processing, analysis and modeling techniques, automatic retinal image analysis is emerging as an important screening tool for early detection of ophthalmologic disorders such as diabetic retinopathy and glaucoma. In this paper, a robust method for optic disc detection and extraction of the optic disc boundary is proposed to help in the development of computer-assisted diagnosis and treatment of such ophthalmic disease. The proposed method is based on morphological operations, smoothing filters, and the marker controlled watershed transform. Internal and external markers are used to first modify the gradient magnitude image and then the watershed transformation is applied on this modified gradient magnitude image for boundary extraction. This method has shown significant improvement over existing methods in terms of detection and boundary extraction of the optic disc. The proposed method has optic disc detection success rate of 100%, 100%, 100% and 98.9% for the DRIVE, Shifa, CHASE_DB1, and DIARETDB1 databases, respectively. The optic disc boundary detection achieved an average spatial overlap of 61.88%, 70.96%, 45.61%, and 54.69% for these databases, respectively, which are higher than currents methods.

Obtaining optic disc center and pixel region by automatic thresholding methods on morphologically processed fundus images

Development of automatic retinal disease diagnosis systems based on retinal image computer analysis can provide remarkably quicker screening programs for early detection. Such systems are mainly focused on the detection of the earliest ophthalmic signs of illness and require previous identification of fundal landmark features such as optic disc (OD), fovea or blood vessels. A methodology for accurate center-position location and OD retinal region segmentation on digital fundus images is presented in this paper. The methodology performs a set of iterative opening-closing morphological operations on the original retinography intensity channel to produce a bright region-enhanced image. Taking blood vessel confluence at the OD into account, a 2-step automatic thresholding procedure is then applied to obtain a reduced region of interest, where the center and the OD pixel region are finally obtained by performing the circular Hough transform on a set of OD boundary candidates generated through the application of the Prewitt edge detector. The methodology was evaluated on 1200 and 1748 fundus images from the publicly available MESSIDOR and MESSIDOR-2 databases, acquired from diabetic patients and thus being clinical cases of interest within the framework of automated diagnosis of retinal diseases associated to diabetes mellitus. This methodology proved highly accurate in OD-center location: average Euclidean distance between the methodology-provided and actual OD-center position was 6.08, 9.22 and 9.72 pixels for retinas of 910, 1380 and 1455 pixels in size, respectively. On the other hand, OD segmentation evaluation was performed in terms of Jaccard and Dice coefficients, as well as the mean average distance between estimated and actual OD boundaries. Comparison with the results reported by other reviewed OD segmentation methodologies shows our proposal renders better overall performance. Its effectiveness and robustness make this proposed automated OD location and segmentation method a suitable tool to be integrated into a complete prescreening system for early diagnosis of retinal diseases.

Optic disc and macula detection in fundus images by means of template matching

Various methods for detecting optic disc and macula in fundus images have been developed. Our aim is to propose a fairly easy method for detecting both features jointly. This is achieved by first correcting in homogenous luminosity using a polynomial approximation of the background of the images. Secondly, the use of the cross-correlation in the frequency domain between the images and a steerable template which contains both structures. The 38 photographs used in this work belong to a local database of patients suffering diabetic retinopathy along its four severity stages. Our results showed 100% optic disc centers located within the OD area and 90% macula centers located within the MC area.

Automatic optic disc detection in OCT slices via low-rank reconstruction

Optic disc measurements provide useful diagnostic information as they have correlations with certain eye diseases. In this paper, we provide an automatic method for detecting the optic disc in a single OCT slice. Our method is developed from the observation that the retinal pigment epithelium (RPE) which bounds the optic disc has a low-rank appearance structure that differs from areas within the disc. To detect the disc, our method acquires from the OCT image an RPE appearance model that is specific to the individual and imaging conditions, by learning a low-rank dictionary from image areas known to be part of the RPE according to priors on ocular anatomy. The edge of the RPE, where the optic disc is located, is then found by traversing the retinal layer containing the RPE, reconstructing local appearance with the low-rank model, and detecting the point at which appearance starts to deviate (i.e., increased reconstruction error). To aid in this detection, we also introduce a geometrical constraint called the distance bias that accounts for the smooth shape of the RPE. Experiments demonstrate that our method outperforms other OCT techniques in localizing the optic disc and estimating disc width. Moreover, we also show the potential usage of our method on optic disc area detection in 3-D OCT volumes.

Novel Accurate and Fast Optic Disc Detection in Retinal Images With Vessel Distribution and Directional Characteristics

A novel accurate and fast optic disc (OD) detection method is proposed by using vessel distribution and directional characteristics. A feature combining three vessel distribution characteristics, i.e., local vessel density, compactness, and uniformity, is designed to find possible horizontal coordinate of OD. Then, according to the global vessel direction characteristic, a General Hough Transformation is introduced to identify the vertical coordinate of OD. By confining the possible OD vertical range and by simplifying vessel structure with blocks, we greatly decrease the computational cost of the algorithm. Four public datasets have been tested. The OD localization accuracy lies from 93.8% to 99.7%, when 8-20% vessel detection results are adopted to achieve OD detection. Average computation times for STARE images are about 3.4-11.5 s, which relate to image size. The proposed method shows satisfactory robustness on both normal and diseased images. It is better than many previous methods with respect to accuracy and efficiency.