Machine Learning and Deep Learning Techniques for Optic Disc and Cup Segmentation – A Review

Highly Accurate and Precise Automated Cup-to-Disc Ratio Quantification for Glaucoma Screening

Objective

An enlarged cup-to-disc ratio (CDR) is a hallmark of glaucomatous optic neuropathy. Manual assessment of the CDR may be less accurate and more time-consuming than automated methods. Here, we sought to develop and validate a deep learning-based algorithm to automatically determine the CDR from fundus images.

Design

Algorithm development for estimating CDR using fundus data from a population-based observational study.

Participants

A total of 181 768 fundus images from the United Kingdom Biobank (UKBB), Drishti_GS, and EyePACS.

Methods

FastAI and PyTorch libraries were used to train a convolutional neural network-based model on fundus images from the UKBB. Models were constructed to determine image gradability (classification analysis) as well as to estimate CDR (regression analysis). The best-performing model was then validated for use in glaucoma screening using a multiethnic dataset from EyePACS and Drishti_GS.

Main Outcome Measures

The area under the receiver operating characteristic curve and coefficient of determination.

Results

Our gradability model vgg19_batch normalization (bn) achieved an accuracy of 97.13% on a validation set of 16 045 images, with 99.26% precision and area under the receiver operating characteristic curve of 96.56%. Using regression analysis, our best-performing model (trained on the vgg19_bn architecture) attained a coefficient of determination of 0.8514 (95% confidence interval [CI]: 0.8459-0.8568), while the mean squared error was 0.0050 (95% CI: 0.0048-0.0051) and mean absolute error was 0.0551 (95% CI: 0.0543-0.0559) on a validation set of 12 183 images for determining CDR. The regression point was converted into classification metrics using a tolerance of 0.2 for 20 classes; the classification metrics achieved an accuracy of 99.20%. The EyePACS dataset (98 172 healthy, 3270 glaucoma) was then used to externally validate the model for glaucoma classification, with an accuracy, sensitivity, and specificity of 82.49%, 72.02%, and 82.83%, respectively.

Conclusions

Our models were precise in determining image gradability and estimating CDR. Although our artificial intelligence-derived CDR estimates achieve high accuracy, the CDR threshold for glaucoma screening will vary depending on other clinical parameters.

Financial Disclosures

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Artificial intelligence for glaucoma: state of the art and future perspectives

PURPOSE OF REVIEW

To address the current role of artificial intelligence (AI) in the field of glaucoma.

RECENT FINDINGS

Current deep learning (DL) models concerning glaucoma diagnosis have shown consistently improving diagnostic capabilities, primarily based on color fundus photography and optical coherence tomography, but also with multimodal strategies. Recent models have also suggested that AI may be helpful in detecting and estimating visual field progression from different input data. Moreover, with the emergence of newer DL architectures and synthetic data, challenges such as model generalizability and explainability have begun to be tackled.

SUMMARY

While some challenges remain before AI is routinely employed in clinical practice, new research has expanded the range in which it can be used in the context of glaucoma management and underlined the relevance of this research avenue.

Quantization of Optic Disc Characteristics in Young Adults Based on Artificial Intelligence

PURPOSE

This study aimed to automatically and quantitatively analyse the characteristics of the optic disc by applying artificial intelligence (AI) to fundus images.

METHODS

A total of 1084 undergraduates were recruited in this cross-sectional study. The optic disc area, cup-to-disc ratio (C/D), optic disc tilt, and the area, width, and height of peripapillary atrophy (PPA) were automatically and quantitatively detected using AI. Based on axial length (AL), participants were divided into five groups: Group 1 (AL ≤ 23 mm); Group 2 (23 mm < AL≤ 24 mm); Group 3 (24 mm < AL≤ 25 mm); Group 4 (25 mm < AL< 26 mm) and Group 5 (AL ≥ 26 mm). Relationships between ocular parameters and optic disc characteristics were analysed.

RESULT

A total of 999 undergraduates were included in the analysis. The prevalence of optic disc tilting and PPA were 47.1% and 92.5%, respectively, and increased with the severity of myopia. The mean optic disc area, PPA area, C/D, and optic disc tilt ratio were 1.97 ± 0.46 mm2, 0.84 ± 0.59 mm2, 0.18 ± 0.07, and 0.81 ± 0.08, respectively. In Group 5, the average optic disc area (1.84 ± 0.41 mm2) and optic disc tilt ratio (0.79 ± 0.08) were significantly smaller and the PPA area (1.12 ± 0.61 mm2) was significantly larger than those in the other groups. AL was negatively correlated with optic disc area and optic disc tilt ratio (r=-0.271, -0.219; both p < 0.001) and positively correlated with PPA area, width, and height (r = 0.421, 0.426, 0.345; all p < 0.01). A greater AL (β = 0.284, p < 0.01) and a smaller optic disc tilt ratio (β=-0.516, p < 0.01) were related to a larger PPA area.

CONCLUSION

The characteristics of the optic disc can be feasibly and efficiently extracted using AI. The quantization of the optic disc might provide new indicators for clinicians to evaluate the degree of myopia.

C2FTFNet: Coarse-to-fine transformer network for joint optic disc and cup segmentation

Glaucoma is a leading cause of worldwide blindness and visual impairment, making early screening and diagnosis is crucial to prevent vision loss. Cup-to-Disk Ratio (CDR) evaluation serves as a widely applied approach for effective glaucoma screening. At present, deep learning methods have exhibited outstanding performance in optic disk (OD) and optic cup (OC) segmentation and maturely deployed in CAD system. However, owning to the complexity of clinical data, these techniques could be constrained. Therefore, an original Coarse-to-Fine Transformer Network (C2FTFNet) is designed to segment OD and OC jointly , which is composed of two stages. In the coarse stage, to eliminate the effects of irrelevant organization on the segmented OC and OD regions, we employ U-Net and Circular Hough Transform (CHT) to segment the Region of Interest (ROI) of OD. Meanwhile, a TransUnet3+ model is designed in the fine segmentation stage to extract the OC and OD regions more accurately from ROI. In this model, to alleviate the limitation of the receptive field caused by traditional convolutional methods, a Transformer module is introduced into the backbone to capture long-distance dependent features for retaining more global information. Then, a Multi-Scale Dense Skip Connection (MSDC) module is proposed to fuse the low-level and high-level features from different layers for reducing the semantic gap among different level features. Comprehensive experiments conducted on DRIONS-DB, Drishti-GS, and REFUGE datasets validate the superior effectiveness of the proposed C2FTFNet compared to existing state-of-the-art approaches.

Performance Evaluation of Different Object Detection Models for the Segmentation of Optical Cups and Discs

Glaucoma is an eye disease that gradually deteriorates vision. Much research focuses on extracting information from the optic disc and optic cup, the structure used for measuring the cup-to-disc ratio. These structures are commonly segmented with deeplearning techniques, primarily using Encoder-Decoder models, which are hard to train and time-consuming. Object detection models using convolutional neural networks can extract features from fundus retinal images with good precision. However, the superiority of one model over another for a specific task is still being determined. The main goal of our approach is to compare object detection model performance to automate segment cups and discs on fundus images. This study brings the novelty of seeing the behavior of different object detection models in the detection and segmentation of the disc and the optical cup (Mask R-CNN, MS R-CNN, CARAFE, Cascade Mask R-CNN, GCNet, SOLO, Point_Rend), evaluated on Retinal Fundus Images for Glaucoma Analysis (REFUGE), and G1020 datasets. Reported metrics were Average Precision (AP), F1-score, IoU, and AUCPR. Several models achieved the highest AP with a perfect 1.000 when the threshold for IoU was set up at 0.50 on REFUGE, and the lowest was Cascade Mask R-CNN with an AP of 0.997. On the G1020 dataset, the best model was Point_Rend with an AP of 0.956, and the worst was SOLO with 0.906. It was concluded that the methods reviewed achieved excellent performance with high precision and recall values, showing efficiency and effectiveness. The problem of how many images are needed was addressed with an initial value of 100, with excellent results. Data augmentation, multi-scale handling, and anchor box size brought improvements. The capability to translate knowledge from one database to another shows promising results too.