Segmentation of the optic disc, macula and vascular arch in fundus photographs

Mixture model-based approach for optic cup segmentation

Glaucoma is a leading cause of blindness with permanent damage to optic nerve head. ARGALI is an automated computer-aided diagnosis system designed for glaucoma detection via optic cup-to-disc ratio assessment. It employs several methods to determine the optic cup and disc from retinal images.

Automatic optic disc detection from retinal images by a line operator

Under the framework of computer-aided eye disease diagnosis, this paper presents an automatic optic disc (OD) detection technique. The proposed technique makes use of the unique circular brightness structure associated with the OD, i.e., the OD usually has a circular shape and is brighter than the surrounding pixels whose intensity becomes darker gradually with their distances from the OD center. A line operator is designed to capture such circular brightness structure, which evaluates the image brightness variation along multiple line segments of specific orientations that pass through each retinal image pixel. The orientation of the line segment with the minimum/maximum variation has specific pattern that can be used to locate the OD accurately. The proposed technique has been tested over four public datasets that include 130, 89, 40, and 81 images of healthy and pathological retinas, respectively. Experiments show that the designed line operator is tolerant to different types of retinal lesion and imaging artifacts, and an average OD detection accuracy of 97.4% is obtained.

Multimodal registration procedure for the initial spatial alignment of a retinal video sequence to a retinal composite image

Accurate placement of lesions is crucial for the effectiveness and safety of a retinal laser photocoagulation treatment. Computer assistance provides the capability for improvements to treatment accuracy and execution time. The idea is to use video frames acquired from a scanning digital ophthalmoscope (SDO) to compensate for retinal motion during laser treatment. This paper presents a method for the multimodal registration of the initial frame from an SDO retinal video sequence to a retinal composite image, which may contain a treatment plan. The retinal registration procedure comprises the following steps: 1) detection of vessel centerline points and identification of the optic disc; 2) prealignment of the video frame and the composite image based on optic disc parameters; and 3) iterative matching of the detected vessel centerline points in expanding matching regions. This registration algorithm was designed for the initialization of a real-time registration procedure that registers the subsequent video frames to the composite image. The algorithm demonstrated its capability to register various pairs of SDO video frames and composite images acquired from patients.

General retinal vessel segmentation using regularization-based multiconcavity modeling

Detecting blood vessels in retinal images with the presence of bright and dark lesions is a challenging unsolved problem. In this paper, a novel multiconcavity modeling approach is proposed to handle both healthy and unhealthy retinas simultaneously. The differentiable concavity measure is proposed to handle bright lesions in a perceptive space. The line-shape concavity measure is proposed to remove dark lesions which have an intensity structure different from the line-shaped vessels in a retina. The locally normalized concavity measure is designed to deal with unevenly distributed noise due to the spherical intensity variation in a retinal image. These concavity measures are combined together according to their statistical distributions to detect vessels in general retinal images. Very encouraging experimental results demonstrate that the proposed method consistently yields the best performance over existing state-of-the-art methods on the abnormal retinas and its accuracy outperforms the human observer, which has not been achieved by any of the state-of-the-art benchmark methods. Most importantly, unlike existing methods, the proposed method shows very attractive performances not only on healthy retinas but also on a mixture of healthy and pathological retinas.

Automated early detection of diabetic retinopathy

PURPOSE

To compare the performance of automated diabetic retinopathy (DR) detection, using the algorithm that won the 2009 Retinopathy Online Challenge Competition in 2009, the Challenge2009, against that of the one currently used in EyeCheck, a large computer-aided early DR detection project.

DESIGN

Evaluation of diagnostic test or technology.

PARTICIPANTS

Fundus photographic sets, consisting of 2 fundus images from each eye, were evaluated from 16670 patient visits of 16,670 people with diabetes who had not previously been diagnosed with DR.

METHODS

The fundus photographic set from each visit was analyzed by a single retinal expert; 793 of the 16,670 sets were classified as containing more than minimal DR (threshold for referral). The outcomes of the 2 algorithmic detectors were applied separately to the dataset and were compared by standard statistical measures.

MAIN OUTCOME MEASURES

The area under the receiver operating characteristic curve (AUC), a measure of the sensitivity and specificity of DR detection.

RESULTS

Agreement was high, and examination results indicating more than minimal DR were detected with an AUC of 0.839 by the EyeCheck algorithm and an AUC of 0.821 for the Challenge2009 algorithm, a statistically nonsignificant difference (z-score, 1.91). If either of the algorithms detected DR in combination, the AUC for detection was 0.86, the same as the theoretically expected maximum. At 90% sensitivity, the specificity of the EyeCheck algorithm was 47.7% and that of the Challenge2009 algorithm was 43.6%.

CONCLUSIONS

Diabetic retinopathy detection algorithms seem to be maturing, and further improvements in detection performance cannot be differentiated from best clinical practices, because the performance of competitive algorithm development now has reached the human intrareader variability limit. Additional validation studies on larger, well-defined, but more diverse populations of patients with diabetes are needed urgently, anticipating cost-effective early detection of DR in millions of people with diabetes to triage those patients who need further care at a time when they have early rather than advanced DR.

Segmentation of the optic disk in color eye fundus images using an adaptive morphological approach

The identification of some important retinal anatomical regions is a prerequisite for the computer aided diagnosis of several retinal diseases. In this paper, we propose a new adaptive method for the automatic segmentation of the optic disk in digital color fundus images, using mathematical morphology. The proposed method has been designed to be robust under varying illumination and image acquisition conditions, common in eye fundus imaging. Our experimental results based on two publicly available eye fundus image databases are encouraging, and indicate that our approach potentially can achieve a better performance than other known methods proposed in the literature. Using the DRIVE database (which consists of 40 retinal images), our method achieves a success rate of 100% in the correct location of the optic disk, with 41.47% of mean overlap. In the DIARETDB1 database (which consists of 89 retinal images), the optic disk is correctly located in 97.75% of the images, with a mean overlap of 43.65%.

Fast detection of the optic disc and fovea in color fundus photographs

A fully automated, fast method to detect the fovea and the optic disc in digital color photographs of the retina is presented. The method makes few assumptions about the location of both structures in the image. We define the problem of localizing structures in a retinal image as a regression problem. A kNN regressor is utilized to predict the distance in pixels in the image to the object of interest at any given location in the image based on a set of features measured at that location. The method combines cues measured directly in the image with cues derived from a segmentation of the retinal vasculature. A distance prediction is made for a limited number of image locations and the point with the lowest predicted distance to the optic disc is selected as the optic disc center. Based on this location the search area for the fovea is defined. The location with the lowest predicted distance to the fovea within the foveal search area is selected as the fovea location. The method is trained with 500 images for which the optic disc and fovea locations are known. An extensive evaluation was done on 500 images from a diabetic retinopathy screening program and 100 specially selected images containing gross abnormalities. The method found the optic disc in 99.4% and the fovea in 96.8% of regular screening images and for the images with abnormalities these numbers were 93.0% and 89.0% respectively.

Using a patient image archive to diagnose retinopathy

Diabetes has become an epidemic that is expected to impact 365 million people worldwide by 2025. Consequently, diabetic retinopathy is the leading cause of blindness in the industrialized world today. If detected early, treatments can preserve vision and significantly reduce debilitating blindness. Through this research we are developing and testing a method for automating the diagnosis of retinopathy in a screening environment using a patient archive and digital fundus imagery. We present an overview of our content-based image retrieval (CBIR) approach and provide performance results for a dataset of 98 images from a study in Canada when compared to an archive of 1,355 patients from a study in the Netherlands. An aggregate performance of 89% correct diagnosis is achieved, demonstrating the potential of automated, web-based diagnosis for a broad range of imagery collected under different conditions and with different cameras.

Automated localization of the optic disc and the fovea

The detection of the position of the normal anatomy in color fundus photographs is an important step in the automated analysis of retinal images. An automatic system for the detection of the position of the optic disc and the fovea is presented. The method integrates the use of local vessel geometry and image intensity features to find the correct positions in the image. A kNN regressor is used to accomplish the integration. Evaluation was performed on a set of 250 digital color fundus photographs and the detection performance for the optic disc and the fovea were 99.2% and 96.4% respectively.

Automatic tracing of optic disc and exudates from color fundus images using fixed and variable thresholds

The detection of bright objects such as optic disc (OD) and exudates in color fundus images is an important step in the diagnosis of eye diseases such as diabetic retinopathy and glaucoma. In this paper, a novel approach to automatically segment the OD and exudates is proposed. The proposed algorithm makes use of the green component of the image and preprocessing steps such as average filtering, contrast adjustment, and thresholding. The other processing techniques used are morphological opening, extended maxima operator, minima imposition, and watershed transformation. The proposed algorithm is evaluated using the test images of STARE and DRIVE databases with fixed and variable thresholds. The images drawn by human expert are taken as the reference images. The proposed method yields sensitivity values as high as 96.7%, which are better than the results reported in the literature.

Automated diagnosis of retinopathy by content-based image retrieval

PURPOSE

To describe a novel computer-based image analysis method that is being developed to assist and automate the diagnosis of retinal disease.

METHODS

Content-based image retrieval is the process of retrieving related images from large database collections using their pictorial content. The content feature list becomes the index for storage, search, and retrieval of related images from a library based upon specific visual characteristics. Low-level analyses use feature description models and higher-level analyses use perceptual organization and spatial relationships, including clinical metadata, to extract semantic information.

RESULTS

We defined, extracted, and tested a large number of region- and lesion-based features from a dataset of 395 retinal images. Using a statistical hold-one-out method, independent queries for each image were submitted to the system and a diagnostic prediction was formulated. The diagnostic sensitivity for all stratified levels of age-related macular degeneration ranged from 75% to 100%. Similarly, the sensitivity of detection and accuracy for proliferative diabetic retinopathy ranged from 75% to 91.7% and for nonproliferative diabetic retinopathy, ranged from 75% to 94.7%. The overall purity of the diagnosis (specificity) for all disease states in the dataset was 91.3%.

CONCLUSIONS

The probabilistic nature of content-based image retrieval permits us to make statistically relevant predictions regarding the presence, severity, and manifestations of common retinal diseases from digital images in an automated and deterministic manner.

Practical considerations for optic nerve location in telemedicine

The projected increase in diabetes in the United States and worldwide has created a need for broad-based, inexpensive screening for diabetic retinopathy (DR), an eye disease which can lead to vision impairment. A telemedicine network with retina cameras and automated quality control, physiological feature location, and lesion / anomaly detection is a low-cost way of achieving broad-based screening. In this work we report on the effect of quality estimation on an optic nerve (ON) detection method with a confidence metric. We report on an improvement of the method using a data set from an ophthalmologist practice then show the results of the method as a function of image quality on a set of images from an on-line telemedicine network collected in Spring 2009 and another broad-based screening program. We show that the fusion method, combined with quality estimation processing, can improve detection performance and also provide a method for utilizing a physician-in-the-loop for images that may exceed the capabilities of automated processing.

Detection of anatomic structures in human retinal imagery

The widespread availability of electronic imaging devices throughout the medical community is leading to a growing body of research on image processing and analysis to diagnose retinal disease such as diabetic retinopathy (DR). Productive computer-based screening of large, at-risk populations at low cost requires robust, automated image analysis. In this paper we present results for the automatic detection of the optic nerve and localization of the macula using digital red-free fundus photography. Our method relies on the accurate segmentation of the vasculature of the retina followed by the determination of spatial features describing the density, average thickness, and average orientation of the vasculature in relation to the position of the optic nerve. Localization of the macula follows using knowledge of the optic nerve location to detect the horizontal raphe of the retina using a geometric model of the vasculature. We report 90.4% detection performance for the optic nerve and 92.5% localization performance for the macula for red-free fundus images representing a population of 345 images corresponding to 269 patients with 18 different pathologies associated with DR and other common retinal diseases such as age-related macular degeneration.

Automated detection and differentiation of drusen, exudates, and cotton-wool spots in digital color fundus photographs for diabetic retinopathy diagnosis

PURPOSE

To describe and evaluate a machine learning-based, automated system to detect exudates and cotton-wool spots in digital color fundus photographs and differentiate them from drusen, for early diagnosis of diabetic retinopathy.

METHODS

Three hundred retinal images from one eye of 300 patients with diabetes were selected from a diabetic retinopathy telediagnosis database (nonmydriatic camera, two-field photography): 100 with previously diagnosed bright lesions and 200 without. A machine learning computer program was developed that can identify and differentiate among drusen, (hard) exudates, and cotton-wool spots. A human expert standard for the 300 images was obtained by consensus annotation by two retinal specialists. Sensitivities and specificities of the annotations on the 300 images by the automated system and a third retinal specialist were determined.

RESULTS

The system achieved an area under the receiver operating characteristic (ROC) curve of 0.95 and sensitivity/specificity pairs of 0.95/0.88 for the detection of bright lesions of any type, and 0.95/0.86, 0.70/0.93, and 0.77/0.88 for the detection of exudates, cotton-wool spots, and drusen, respectively. The third retinal specialist achieved pairs of 0.95/0.74 for bright lesions and 0.90/0.98, 0.87/0.98, and 0.92/0.79 per lesion type.

CONCLUSIONS

A machine learning-based, automated system capable of detecting exudates and cotton-wool spots and differentiating them from drusen in color images obtained in community based diabetic patients has been developed and approaches the performance level of retinal experts. If the machine learning can be improved with additional training data sets, it may be useful for detecting clinically important bright lesions, enhancing early diagnosis, and reducing visual loss in patients with diabetes.