Towards label-free 3D segmentation of optical coherence tomography images of the optic nerve head using deep learning

The AI revolution in glaucoma: Bridging challenges with opportunities

Recent advancements in artificial intelligence (AI) herald transformative potentials for reshaping glaucoma clinical management, improving screening efficacy, sharpening diagnosis precision, and refining the detection of disease progression. However, incorporating AI into healthcare usages faces significant hurdles in terms of developing algorithms and putting them into practice. When creating algorithms, issues arise due to the intensive effort required to label data, inconsistent diagnostic standards, and a lack of thorough testing, which often limits the algorithms' widespread applicability. Additionally, the "black box" nature of AI algorithms may cause doctors to be wary or skeptical. When it comes to using these tools, challenges include dealing with lower-quality images in real situations and the systems' limited ability to work well with diverse ethnic groups and different diagnostic equipment. Looking ahead, new developments aim to protect data privacy through federated learning paradigms, improving algorithm generalizability by diversifying input data modalities, and augmenting datasets with synthetic imagery. The integration of smartphones appears promising for using AI algorithms in both clinical and non-clinical settings. Furthermore, bringing in large language models (LLMs) to act as interactive tool in medicine may signify a significant change in how healthcare will be delivered in the future. By navigating through these challenges and leveraging on these as opportunities, the field of glaucoma AI will not only have improved algorithmic accuracy and optimized data integration but also a paradigmatic shift towards enhanced clinical acceptance and a transformative improvement in glaucoma care.

AI-based clinical assessment of optic nerve head robustness superseding biomechanical testing

BACKGROUND/AIMS

To use artificial intelligence (AI) to: (1) exploit biomechanical knowledge of the optic nerve head (ONH) from a relatively large population; (2) assess ONH robustness (ie, sensitivity of the ONH to changes in intraocular pressure (IOP)) from a single optical coherence tomography (OCT) volume scan of the ONH without the need for biomechanical testing and (3) identify what critical three-dimensional (3D) structural features dictate ONH robustness.

METHODS

316 subjects had their ONHs imaged with OCT before and after acute IOP elevation through ophthalmo-dynamometry. IOP-induced lamina cribrosa (LC) deformations were then mapped in 3D and used to classify ONHs. Those with an average effective LC strain superior to 4% were considered fragile, while those with a strain inferior to 4% robust. Learning from these data, we compared three AI algorithms to predict ONH robustness strictly from a baseline (undeformed) OCT volume: (1) a random forest classifier; (2) an autoencoder and (3) a dynamic graph convolutional neural network (DGCNN). The latter algorithm also allowed us to identify what critical 3D structural features make a given ONH robust.

RESULTS

All three methods were able to predict ONH robustness from a single OCT volume scan alone and without the need to perform biomechanical testing. The DGCNN (area under the curve (AUC): 0.76±0.08) outperformed the autoencoder (AUC: 0.72±0.09) and the random forest classifier (AUC: 0.69±0.05). Interestingly, to assess ONH robustness, the DGCNN mainly used information from the scleral canal and the LC insertion sites.

CONCLUSIONS

We propose an AI-driven approach that can assess the robustness of a given ONH solely from a single OCT volume scan of the ONH, and without the need to perform biomechanical testing. Longitudinal studies should establish whether ONH robustness could help us identify fast visual field loss progressors.

PRECIS

Using geometric deep learning, we can assess optic nerve head robustness (ie, sensitivity to a change in IOP) from a standard OCT scan that might help to identify fast visual field loss progressors.

Are Macula or Optic Nerve Head Structures Better at Diagnosing Glaucoma? An Answer Using Artificial Intelligence and Wide-Field Optical Coherence Tomography

Purpose

We wanted to develop a deep-learning algorithm to automatically segment optic nerve head (ONH) and macula structures in three-dimensional (3D) wide-field optical coherence tomography (OCT) scans and to assess whether 3D ONH or macula structures (or a combination of both) provide the best diagnostic power for glaucoma.

Methods

A cross-sectional comparative study was performed using 319 OCT scans of glaucoma eyes and 298 scans of nonglaucoma eyes. Scans were compensated to improve deep-tissue visibility. We developed a deep-learning algorithm to automatically label major tissue structures, trained with 270 manually annotated B-scans. The performance was assessed using the Dice coefficient (DC). A glaucoma classification algorithm (3D-CNN) was then designed using 500 OCT volumes and corresponding automatically segmented labels. This algorithm was trained and tested on three datasets: cropped scans of macular tissues, those of ONH tissues, and wide-field scans. The classification performance for each dataset was reported using the area under the curve (AUC).

Results

Our segmentation algorithm achieved a DC of 0.94 ± 0.003. The classification algorithm was best able to diagnose glaucoma using wide-field scans, followed by ONH scans, and finally macula scans, with AUCs of 0.99 ± 0.01, 0.93 ± 0.06 and 0.91 ± 0.11, respectively.

Conclusions

This study showed that wide-field OCT may allow for significantly improved glaucoma diagnosis over typical OCTs of the ONH or macula.

Translational Relevance

This could lead to mainstream clinical adoption of 3D wide-field OCT scan technology.

Deep learning in optical coherence tomography: Where are the gaps?

Optical coherence tomography (OCT) is a non-invasive optical imaging modality, which provides rapid, high-resolution and cross-sectional morphology of macular area and optic nerve head for diagnosis and managing of different eye diseases. However, interpreting OCT images requires experts in both OCT images and eye diseases since many factors such as artefacts and concomitant diseases can affect the accuracy of quantitative measurements made by post-processing algorithms. Currently, there is a growing interest in applying deep learning (DL) methods to analyse OCT images automatically. This review summarises the trends in DL-based OCT image analysis in ophthalmology, discusses the current gaps, and provides potential research directions. DL in OCT analysis shows promising performance in several tasks: (1) layers and features segmentation and quantification; (2) disease classification; (3) disease progression and prognosis; and (4) referral triage level prediction. Different studies and trends in the development of DL-based OCT image analysis are described and the following challenges are identified and described: (1) public OCT data are scarce and scattered; (2) models show performance discrepancies in real-world settings; (3) models lack of transparency; (4) there is a lack of societal acceptance and regulatory standards; and (5) OCT is still not widely available in underprivileged areas. More work is needed to tackle the challenges and gaps, before DL is further applied in OCT image analysis for clinical use.

Endpoints for clinical trials in ophthalmology

With the identification of novel targets, the number of interventional clinical trials in ophthalmology has increased. Visual acuity has for a long time been considered the gold standard endpoint for clinical trials, but in the recent years it became evident that other endpoints are required for many indications including geographic atrophy and inherited retinal disease. In glaucoma the currently available drugs were approved based on their IOP lowering capacity. Some recent findings do, however, indicate that at the same level of IOP reduction, not all drugs have the same effect on visual field progression. For neuroprotection trials in glaucoma, novel surrogate endpoints are required, which may either include functional or structural parameters or a combination of both. A number of potential surrogate endpoints for ophthalmology clinical trials have been identified, but their validation is complicated and requires solid scientific evidence. In this article we summarize candidates for clinical endpoints in ophthalmology with a focus on retinal disease and glaucoma. Functional and structural biomarkers, as well as quality of life measures are discussed, and their potential to serve as endpoints in pivotal trials is critically evaluated.

Three-Dimensional Structural Phenotype of the Optic Nerve Head as a Function of Glaucoma Severity

Importance

The 3-dimensional (3-D) structural phenotype of glaucoma as a function of severity was thoroughly described and analyzed, enhancing understanding of its intricate pathology beyond current clinical knowledge.

Objective

To describe the 3-D structural differences in both connective and neural tissues of the optic nerve head (ONH) between different glaucoma stages using traditional and artificial intelligence-driven approaches.

Design, Setting, and Participants

This cross-sectional, clinic-based study recruited 541 Chinese individuals receiving standard clinical care at Singapore National Eye Centre, Singapore, and 112 White participants of a prospective observational study at Vilnius University Hospital Santaros Klinikos, Vilnius, Lithuania. The study was conducted from May 2022 to January 2023. All participants had their ONH imaged using spectral-domain optical coherence tomography and had their visual field assessed by standard automated perimetry.

Main Outcomes and Measures

(1) Clinician-defined 3-D structural parameters of the ONH and (2) 3-D structural landmarks identified by geometric deep learning that differentiated ONHs among 4 groups: no glaucoma, mild glaucoma (mean deviation [MD], ≥-6.00 dB), moderate glaucoma (MD, -6.01 to -12.00 dB), and advanced glaucoma (MD, <-12.00 dB).

Results

Study participants included 213 individuals without glaucoma (mean age, 63.4 years; 95% CI, 62.5-64.3 years; 126 females [59.2%]; 213 Chinese [100%] and 0 White individuals), 204 with mild glaucoma (mean age, 66.9 years; 95% CI, 66.0-67.8 years; 91 females [44.6%]; 178 Chinese [87.3%] and 26 White [12.7%] individuals), 118 with moderate glaucoma (mean age, 68.1 years; 95% CI, 66.8-69.4 years; 49 females [41.5%]; 97 Chinese [82.2%] and 21 White [17.8%] individuals), and 118 with advanced glaucoma (mean age, 68.5 years; 95% CI, 67.1-69.9 years; 43 females [36.4%]; 53 Chinese [44.9%] and 65 White [55.1%] individuals). The majority of ONH structural differences occurred in the early glaucoma stage, followed by a plateau effect in the later stages. Using a deep neural network, 3-D ONH structural differences were found to be present in both neural and connective tissues. Specifically, a mean of 57.4% (95% CI, 54.9%-59.9%, for no to mild glaucoma), 38.7% (95% CI, 36.9%-40.5%, for mild to moderate glaucoma), and 53.1 (95% CI, 50.8%-55.4%, for moderate to advanced glaucoma) of ONH landmarks that showed major structural differences were located in neural tissues with the remaining located in connective tissues.

Conclusions and Relevance

This study uncovered complex 3-D structural differences of the ONH in both neural and connective tissues as a function of glaucoma severity. Future longitudinal studies should seek to establish a connection between specific 3-D ONH structural changes and fast visual field deterioration and aim to improve the early detection of patients with rapid visual field loss in routine clinical care.

Deep learning segmentation of the tear fluid reservoir under the sclera lens in optical coherence tomography images

The tear fluid reservoir (TFR) under the sclera lens is a unique characteristic providing optical neutralization of any aberrations from corneal irregularities. Anterior segment optical coherence tomography (AS-OCT) has become an important imaging modality for sclera lens fitting and visual rehabilitation therapy in both optometry and ophthalmology. Herein, we aimed to investigate whether deep learning can be used to segment the TFR from healthy and keratoconus eyes, with irregular corneal surfaces, in OCT images. Using AS-OCT, a dataset of 31850 images from 52 healthy and 46 keratoconus eyes, during sclera lens wear, was obtained and labeled with our previously developed algorithm of semi-automatic segmentation. A custom-improved U-shape network architecture with a full-range multi-scale feature-enhanced module (FMFE-Unet) was designed and trained. A hybrid loss function was designed to focus training on the TFR, to tackle the class imbalance problem. The experiments on our database showed an IoU, precision, specificity, and recall of 0.9426, 0.9678, 0.9965, and 0.9731, respectively. Furthermore, FMFE-Unet was found to outperform the other two state-of-the-art methods and ablation models, suggesting its strength in segmenting the TFR under the sclera lens depicted on OCT images. The application of deep learning for TFR segmentation in OCT images provides a powerful tool to assess changes in the dynamic tear film under the sclera lens, improving the efficiency and accuracy of lens fitting, and thus supporting the promotion of sclera lenses in clinical practice.

Automatic segmentation and quantification of the optic nerve on MRI using a 3D U-Net

Purpose

Pathological conditions associated with the optic nerve (ON) can cause structural changes in the nerve. Quantifying these changes could provide further understanding of disease mechanisms. We aim to develop a framework that automatically segments the ON separately from its surrounding cerebrospinal fluid (CSF) on magnetic resonance imaging (MRI) and quantifies the diameter and cross-sectional area along the entire length of the nerve.

Approach

Multicenter data were obtained from retinoblastoma referral centers, providing a heterogeneous dataset of 40 high-resolution 3D T2-weighted MRI scans with manual ground truth delineations of both ONs. A 3D U-Net was used for ON segmentation, and performance was assessed in a tenfold cross-validation (n = 32 ) and on a separate test-set (n = 8 ) by measuring spatial, volumetric, and distance agreement with manual ground truths. Segmentations were used to quantify diameter and cross-sectional area along the length of the ON, using centerline extraction of tubular 3D surface models. Absolute agreement between automated and manual measurements was assessed by the intraclass correlation coefficient (ICC).

Results

The segmentation network achieved high performance, with a mean Dice similarity coefficient score of 0.84, median Hausdorff distance of 0.64 mm, and ICC of 0.95 on the test-set. The quantification method obtained acceptable correspondence to manual reference measurements with mean ICC values of 0.76 for the diameter and 0.71 for the cross-sectional area. Compared with other methods, our method precisely identifies the ON from surrounding CSF and accurately estimates its diameter along the nerve's centerline.

Conclusions

Our automated framework provides an objective method for ON assessment in vivo.

Medical Application of Geometric Deep Learning for the Diagnosis of Glaucoma

Purpose

(1) To assess the performance of geometric deep learning in diagnosing glaucoma from a single optical coherence tomography (OCT) scan of the optic nerve head and (2) to compare its performance to that obtained with a three-dimensional (3D) convolutional neural network (CNN), and with a gold-standard parameter, namely, the retinal nerve fiber layer (RNFL) thickness.

Methods

Scans of the optic nerve head were acquired with OCT for 477 glaucoma and 2296 nonglaucoma subjects. All volumes were automatically segmented using deep learning to identify seven major neural and connective tissues. Each optic nerve head was then represented as a 3D point cloud with approximately 1000 points. Geometric deep learning (PointNet) was then used to provide a glaucoma diagnosis from a single 3D point cloud. The performance of our approach (reported using the area under the curve [AUC]) was compared with that obtained with a 3D CNN, and with the RNFL thickness.

Results

PointNet was able to provide a robust glaucoma diagnosis solely from a 3D point cloud (AUC = 0.95 ± 0.01).The performance of PointNet was superior to that obtained with a 3D CNN (AUC = 0.87 ± 0.02 [raw OCT images] and 0.91 ± 0.02 [segmented OCT images]) and with that obtained from RNFL thickness alone (AUC = 0.80 ± 0.03).

Conclusions

We provide a proof of principle for the application of geometric deep learning in glaucoma. Our technique requires significantly less information as input to perform better than a 3D CNN, and with an AUC superior to that obtained from RNFL thickness.

Translational Relevance

Geometric deep learning may help us to improve and simplify diagnosis and prognosis applications in glaucoma.

Geometric Deep Learning to Identify the Critical 3D Structural Features of the Optic Nerve Head for Glaucoma Diagnosis

PURPOSE

To compare the performance of 2 relatively recent geometric deep learning techniques in diagnosing glaucoma from a single optical coherence tomographic (OCT) scan of the optic nerve head (ONH); and to identify the 3-dimensional (3D) structural features of the ONH that are critical for the diagnosis of glaucoma.

DESIGN

Comparison and evaluation of deep learning diagnostic algorithms.

METHODS

In this study, we included a total of 2247 nonglaucoma and 2259 glaucoma scans from 1725 participants. All participants had their ONHs imaged in 3D with Spectralis OCT. All OCT scans were automatically segmented using deep learning to identify major neural and connective tissues. Each ONH was then represented as a 3D point cloud. We used PointNet and dynamic graph convolutional neural network (DGCNN) to diagnose glaucoma from such 3D ONH point clouds and to identify the critical 3D structural features of the ONH for glaucoma diagnosis.

RESULTS

Both the DGCNN (area under the curve [AUC]: 0.97±0.01) and PointNet (AUC: 0.95±0.02) were able to accurately detect glaucoma from 3D ONH point clouds. The critical points (ie, critical structural features of the ONH) formed an hourglass pattern, with most of them located within the neuroretinal rim in the inferior and superior quadrant of the ONH.

CONCLUSIONS

The diagnostic accuracy of both geometric deep learning approaches was excellent. Moreover, we were able to identify the critical 3D structural features of the ONH for glaucoma diagnosis that tremendously improved the transparency and interpretability of our method. Consequently, our approach may have strong potential to be used in clinical applications for the diagnosis and prognosis of a wide range of ophthalmic disorders.

Discriminating Between Papilledema and Optic Disc Drusen Using 3D Structural Analysis of the Optic Nerve Head

BACKGROUND AND OBJECTIVES

The distinction of papilledema from other optic nerve head (ONH) lesions mimicking papilledema, such as optic disc drusen (ODD), can be difficult in clinical practice. We aimed the following: (1) to develop a deep learning algorithm to automatically identify major structures of the ONH in 3-dimensional (3D) optical coherence tomography (OCT) scans and (2) to exploit such information to robustly differentiate among ODD, papilledema, and healthy ONHs.

METHODS

This was a cross-sectional comparative study of patients from 3 sites (Singapore, Denmark, and Australia) with confirmed ODD, those with papilledema due to raised intracranial pressure, and healthy controls. Raster scans of the ONH were acquired using OCT imaging and then processed to improve deep-tissue visibility. First, a deep learning algorithm was developed to identify major ONH tissues and ODD regions. The performance of our algorithm was assessed using the Dice coefficient. Second, a classification algorithm (random forest) was designed to perform 3-class classifications (1: ODD, 2: papilledema, and 3: healthy ONHs) strictly from their drusen and prelamina swelling scores (calculated from the segmentations). To assess performance, we reported the area under the receiver operating characteristic curve for each class.

RESULTS

A total of 241 patients (256 imaged ONHs, including 105 ODD, 51 papilledema, and 100 healthy ONHs) were retrospectively included in this study. Using OCT images of the ONH, our segmentation algorithm was able to isolate neural and connective tissues and ODD regions/conglomerates whenever present. This was confirmed by an averaged Dice coefficient of 0.93 ± 0.03 on the test set, corresponding to good segmentation performance. Classification was achieved with high AUCs, that is, 0.99 ± 0.001 for the detection of ODD, 0.99 ± 0.005 for the detection of papilledema, and 0.98 ± 0.01 for the detection of healthy ONHs.

DISCUSSION

Our artificial intelligence approach can discriminate ODD from papilledema, strictly using a single OCT scan of the ONH. Our classification performance was very good in the studied population, with the caveat that validation in a much larger population is warranted. Our approach may have the potential to establish OCT imaging as one of the mainstays of diagnostic imaging for ONH disorders in neuro-ophthalmology, in addition to fundus photography.

Reverse translation of artificial intelligence in glaucoma: Connecting basic science with clinical applications

Artificial intelligence (AI) has been approved for biomedical research in diverse areas from bedside clinical studies to benchtop basic scientific research. For ophthalmic research, in particular glaucoma, AI applications are rapidly growing for potential clinical translation given the vast data available and the introduction of federated learning. Conversely, AI for basic science remains limited despite its useful power in providing mechanistic insight. In this perspective, we discuss recent progress, opportunities, and challenges in the application of AI in glaucoma for scientific discoveries. Specifically, we focus on the research paradigm of reverse translation, in which clinical data are first used for patient-centered hypothesis generation followed by transitioning into basic science studies for hypothesis validation. We elaborate on several distinctive areas of research opportunities for reverse translation of AI in glaucoma including disease risk and progression prediction, pathology characterization, and sub-phenotype identification. We conclude with current challenges and future opportunities for AI research in basic science for glaucoma such as inter-species diversity, AI model generalizability and explainability, as well as AI applications using advanced ocular imaging and genomic data.

Quantitative optical coherence microscopy of neuron morphology in human entorhinal cortex

Introduction

The size and shape of neurons are important features indicating aging and the pathology of neurodegenerative diseases. Despite the significant advances of optical microscopy, quantitative analysis of the neuronal features in the human brain remains largely incomplete. Traditional histology on thin slices bears tremendous distortions in three-dimensional reconstruction, the magnitude of which are often greater than the structure of interest. Recently development of tissue clearing techniques enable the whole brain to be analyzed in small animals; however, the application in the human remains challenging.

Methods

In this study, we present a label-free quantitative optical coherence microscopy (OCM) technique to obtain the morphological parameters of neurons in human entorhinal cortex (EC). OCM uses the intrinsic back-scattering property of tissue to identify individual neurons in 3D. The area, length, width, and orientation of individual neurons are quantified and compared between layer II and III in EC.

Results

The high-resolution mapping of neuron size, shape, and orientation shows significant differences between layer II and III neurons in EC. The results are validated by standard Nissl staining of the same samples.

Discussion

The quantitative OCM technique in our study offers a new solution to analyze variety of neurons and their organizations in the human brain, which opens new insights in advancing our understanding of neurodegenerative diseases.

Applications of Artificial Intelligence and Deep Learning in Glaucoma

Diagnosis and detection of progression of glaucoma remains challenging. Artificial intelligence-based tools have the potential to improve and standardize the assessment of glaucoma but development of these algorithms is difficult given the multimodal and variable nature of the diagnosis. Currently, most algorithms are focused on a single imaging modality, specifically screening and diagnosis based on fundus photos or optical coherence tomography images. Use of anterior segment optical coherence tomography and goniophotographs is limited. The majority of algorithms designed for disease progression prediction are based on visual fields. No studies in our literature search assessed the use of artificial intelligence for treatment response prediction and no studies conducted prospective testing of their algorithms. Additional challenges to the development of artificial intelligence-based tools include scarcity of data and a lack of consensus in diagnostic criteria. Although research in the use of artificial intelligence for glaucoma is promising, additional work is needed to develop clinically usable tools.

Influence of signal‐to‐noise ratio, glaucoma stage and segmentation algorithm on OCT usability for quantifying layer thicknesses in the peripapillary retina

PURPOSE

OCT can be used for glaucoma assessment, but its usefulness may depend on image quality, disease stage and segmentation algorithm. We aimed to determine how layer thicknesses as assessed with different algorithms depend on image quality and disease stage, how reproducible the algorithms are, and if the algorithms (dis)agree.

METHODS

Optic disc OCT data (Canon OCT-HS100) from 20 healthy subjects and 28 early, 29 moderate, and 23 severe glaucoma patients were assessed with four different algorithms (CANON, IOWA, FWHM, DOCTRAP). We measured retinal nerve fibre layer thickness (RNFLT) and total retinal thickness (TRT) along the 1.7-mm-radius OCT measurement circle centred at the optic disc. In healthy subjects, image quality was degraded with neutral density filters (0.3-0.9 optical density [OD]); three scans were made to assess repeatability. Results were analysed with ANOVA with Bonferroni corrected t-tests for post hoc analysis and with intraclass correlation coefficient (ICC) analysis.

RESULTS

For all algorithms, RNFLT was more sensitive to image quality than TRT. Both RNFLT and TRT showed differences between healthy and glaucoma (all algorithms p < 0.001 for both RNFLT and TRT) and between early and moderate glaucoma (RNFLT: p = 0.001 to p = 0.09; TRT: p < 0.001 to p = 0.03); neither was able to discriminate between moderate and severe glaucoma (p = 0.08 to p = 1.0). Generally, repeatability was excellent (ICC >0.75); agreement between algorithms varied from moderate to excellent.

CONCLUSIONS

OCT becomes less informative with glaucoma progression, irrespective of the algorithm. For good-quality scans, RNFLT and TRT perform similarly; TRT may be advantageous with poor image quality.

Measurement of retinal nerve fiber layer thickness with a deep learning algorithm in ischemic optic neuropathy and optic neuritis

This work aims at determining the ability of a deep learning (DL) algorithm to measure retinal nerve fiber layer (RNFL) thickness from optical coherence tomography (OCT) scans in anterior ischemic optic neuropathy (NAION) and demyelinating optic neuritis (ON). The training/validation dataset included 750 RNFL OCT B-scans. Performance of our algorithm was evaluated on 194 OCT B-scans from 70 healthy eyes, 82 scans from 28 NAION eyes, and 84 scans of 29 ON eyes. Results were compared to manual segmentation as a ground-truth and to RNFL calculations from the built-in instrument software. The Dice coefficient for the test images was 0.87. The mean average RNFL thickness using our U-Net was not different from the manually segmented best estimate and OCT machine data in control and ON eyes. In NAION eyes, while the mean average RNFL thickness using our U-Net algorithm was not different from the manual segmented value, the OCT machine data were different from the manual segmented values. In NAION eyes, the MAE of the average RNFL thickness was 1.18 ± 0.69 μm and 6.65 ± 5.37 μm in the U-Net algorithm segmentation and the conventional OCT machine data, respectively (P = 0.0001).

Deep learning and optical coherence tomography in glaucoma: Bridging the diagnostic gap on structural imaging

Glaucoma is a leading cause of progressive blindness and visual impairment worldwide. Microstructural evidence of glaucomatous damage to the optic nerve head and associated tissues can be visualized using optical coherence tomography (OCT). In recent years, development of novel deep learning (DL) algorithms has led to innovative advances and improvements in automated detection of glaucomatous damage and progression on OCT imaging. DL algorithms have also been trained utilizing OCT data to improve detection of glaucomatous damage on fundus photography, thus improving the potential utility of color photos which can be more easily collected in a wider range of clinical and screening settings. This review highlights ten years of contributions to glaucoma detection through advances in deep learning models trained utilizing OCT structural data and posits future directions for translation of these discoveries into the field of aging and the basic sciences.

Automatic Segmentation of the Optic Nerve Head Region in Optical Coherence Tomography: A Methodological Review

The optic nerve head (ONH) represents the intraocular section of the optic nerve, which is prone to damage by intraocular pressure (IOP). The advent of optical coherence tomography (OCT) has enabled the evaluation of novel ONH parameters, namely the depth and curvature of the lamina cribrosa (LC). Together with the Bruch's membrane minimum-rim-width (BMO-MRW), these seem to be promising ONH parameters for diagnosis and monitoring of retinal diseases such as glaucoma. Nonetheless, these OCT derived biomarkers are mostly extracted through manual segmentation, which is time-consuming and prone to bias, thus limiting their usability in clinical practice. The automatic segmentation of ONH in OCT scans could further improve the current clinical management of glaucoma and other diseases. This review summarizes the current state-of-the-art in automatic segmentation of the ONH in OCT. PubMed and Scopus were used to perform a systematic review. Additional works from other databases (IEEE, Google Scholar and ARVO IOVS) were also included, resulting in a total of 29 reviewed studies. For each algorithm, the methods, the size and type of dataset used for validation, and the respective results were carefully analysed. The results show a lack of consensus regarding the definition of segmented regions, extracted parameters and validation approaches, highlighting the importance and need of standardized methodologies for ONH segmentation. Only with a concrete set of guidelines, these automatic segmentation algorithms will build trust in data-driven segmentation models and be able to enter clinical practice.

Describing the Structural Phenotype of the Glaucomatous Optic Nerve Head Using Artificial Intelligence

PURPOSE

To develop a novel deep-learning approach that can describe the structural phenotype of the glaucomatous optic nerve head (ONH) and can be used as a robust glaucoma diagnosis tool.

DESIGN

Retrospective, deep-learning approach diagnosis study.

METHOD

We trained a deep-learning network to segment 3 neural-tissue and 4 connective-tissue layers of the ONH. The segmented optical coherence tomography images were then processed by a customized autoencoder network with an additional parallel branch for binary classification. The encoder part of the autoencoder reduced the segmented optical coherence tomography images into a low-dimensional latent space (LS), whereas the decoder and the classification branches reconstructed the images and classified them as glaucoma or nonglaucoma, respectively. We performed principal component analysis on the latent parameters and identified the principal components (PCs). Subsequently, the magnitude of each PC was altered in steps and reported how it impacted the morphology of the ONH.

RESULTS

The image reconstruction quality and diagnostic accuracy increased with the size of the LS. With 54 parameters in the LS, the diagnostic accuracy was 92.0 ± 2.3% with a sensitivity of 90.0 ± 2.4% (at 95% specificity), and the corresponding Dice coefficient for the reconstructed images was 0.86 ± 0.04. By changing the magnitudes of PC in steps, we were able to reveal how the morphology of the ONH changes as one transitions from a "nonglaucoma" to a "glaucoma" condition.

CONCLUSIONS

Our network was able to identify novel biomarkers of the ONH for glaucoma diagnosis. Specifically, the structural features identified by our algorithm were found to be related to clinical observations of glaucoma.

The three-dimensional structural configuration of the central retinal vessel trunk and branches as a glaucoma biomarker

PURPOSE

To assess whether the 3-dimensional (3D) structural configuration of the central retinal vessel trunk and its branches (CRVT&B) could be used as a diagnostic marker for glaucoma.

DESIGN

Retrospective, deep-learning approach diagnosis study.

METHODS

We trained a deep learning network to automatically segment the CRVT&B from the B-scans of the optical coherence tomography (OCT) volume of the optic nerve head. Subsequently, 2 different approaches were used for glaucoma diagnosis using the structural configuration of the CRVT&B as extracted from the OCT volumes. In the first approach, we aimed to provide a diagnosis using only 3D convolutional neural networks and the 3D structure of the CRVT&B. For the second approach, we projected the 3D structure of the CRVT&B orthographically onto sagittal, frontal, and transverse planes to obtain 3 two-dimensional (2D) images, and then a 2D convolutional neural network was used for diagnosis. The segmentation accuracy was evaluated using the Dice coefficient, whereas the diagnostic accuracy was assessed using the area under the receiver operating characteristic curves (AUCs). The diagnostic performance of the CRVT&B was also compared with that of retinal nerve fiber layer (RNFL) thickness (calculated in the same cohorts).

RESULTS

Our segmentation network was able to efficiently segment retinal blood vessels from OCT scans. On a test set, we achieved a Dice coefficient of 0.81 ± 0.07. The 3D and 2D diagnostic networks were able to differentiate glaucoma from nonglaucoma subjects with accuracies of 82.7% and 83.3%, respectively. The corresponding AUCs for the CRVT&B were 0.89 and 0.90, higher than those obtained with RNFL thickness alone (AUCs ranging from 0.74 to 0.80).

CONCLUSIONS

Our work demonstrated that the diagnostic power of the CRVT&B is superior to that of a gold-standard glaucoma parameter, that is, RNFL thickness. Our work also suggested that the major retinal blood vessels form a "skeleton"-the configuration of which may be representative of major optic nerve head structural changes as typically observed with the development and progression of glaucoma.

Nerve optic segmentation in CT images using a deep learning model and a texture descriptor

The increased intracranial pressure (ICP) can be described as an increase in pressure around the brain and can lead to serious health problems. The assessment of ultrasound images is commonly conducted by skilled experts which is a time-consuming approach, but advanced computer-aided diagnosis (CAD) systems can assist the physician to decrease the time of ICP diagnosis. The accurate detection of the nerve optic regions, with drawing a precise slope line behind the eyeball and calculating the diameter of nerve optic, are the main aims of this research. First, the Fuzzy C-mean (FCM) clustering is employed for segmenting the input CT screening images into the different parts. Second, a histogram equalization approach is used for region-based image quality enhancement. Then, the Local Directional Number method (LDN) is used for representing some key information in a new image. Finally, a cascade Convolutional Neural Network (CNN) is employed for nerve optic segmentation by two distinct input images. Comprehensive experiments on the CT screening dataset [The Cancer Imaging Archive (TCIA)] consisting of 1600 images show the competitive results of inaccurate extraction of the brain features. Also, the indexes such as Dice, Specificity, and Precision for the proposed approach are reported 87.7%, 91.3%, and 90.1%, respectively. The final classification results show that the proposed approach effectively and accurately detects the nerve optic and its diameter in comparison with the other methods. Therefore, this method can be used for early diagnose of ICP and preventing the occurrence of serious health problems in patients.

[Artificial intelligence and glaucoma: A literature review]

In recent years, research in artificial intelligence (AI) has experienced an unprecedented surge in the field of ophthalmology, in particular glaucoma. The diagnosis and follow-up of glaucoma is complex and relies on a body of clinical evidence and ancillary tests. This large amount of information from structural and functional testing of the optic nerve and macula makes glaucoma a particularly appropriate field for the application of AI. In this paper, we will review work using AI in the field of glaucoma, whether for screening, diagnosis or detection of progression. Many AI strategies have shown promising results for glaucoma detection using fundus photography, optical coherence tomography, or automated perimetry. The combination of these imaging modalities increases the performance of AI algorithms, with results comparable to those of humans. We will discuss potential applications as well as obstacles and limitations to the deployment and validation of such models. While there is no doubt that AI has the potential to revolutionize glaucoma management and screening, research in the coming years will need to address unavoidable questions regarding the clinical significance of such results and the explicability of the predictions.

[Diagnostics of diseases of the optic nerve head in times of artificial intelligence and big data]

Hintergrund

Der Einsatz von künstlicher Intelligenz (KI) ist unter anderem in der automatischen Bildsegmentierung, -analyse und Klassifikation interessant und bereits für verschiedene Bereiche der Augenheilkunde beschrieben.

Fragestellung

Diese Arbeit soll einen Überblick über aktuelle Ansätze und Fortschritte bei der Anwendung von Big Data und KI bei verschiedenen Erkrankungen des Sehnervenkopfes geben.

Material und Methode

Es wurde eine PubMed-Recherche durchgeführt. Gesucht wurde nach Studien, die klinische Fragestellungen mithilfe von Big-Data-Ansätzen beantworteten oder klassische Methoden des maschinellen Lernens bei der Analyse von multimodaler Bildgebung des Sehnervenkopfes verwendeten.

Ergebnisse

Big Data kann bei Volkskrankheiten wie dem Glaukom helfen, klinische Fragestellungen zu beantworten. KI findet sowohl bei der Segmentierung von multimodaler Bildgebung des Sehnervenkopfes als auch bei der Klassifikation von Erkrankungen wie dem Glaukom oder der Stauungspapille auf diesen Bilddaten Anwendung.

Schlussfolgerung

Mithilfe von Big Data und KI können Zusammenhänge besser erkannt und die Diagnostik und Verlaufsbeurteilung von Erkrankungen des Sehnervenkopfes erleichtert oder automatisiert werden. Eine Voraussetzung für die klinische Anwendung ist in Europa die CE-Kennzeichnung als ein Medizinprodukt und in den USA die Zulassung durch die Food and Drug Administration.

Multi-scale GCN-assisted two-stage network for joint segmentation of retinal layers and discs in peripapillary OCT images

An accurate and automated tissue segmentation algorithm for retinal optical coherence tomography (OCT) images is crucial for the diagnosis of glaucoma. However, due to the presence of the optic disc, the anatomical structure of the peripapillary region of the retina is complicated and is challenging for segmentation. To address this issue, we develop a novel graph convolutional network (GCN)-assisted two-stage framework to simultaneously label the nine retinal layers and the optic disc. Specifically, a multi-scale global reasoning module is inserted between the encoder and decoder of a U-shape neural network to exploit anatomical prior knowledge and perform spatial reasoning. We conduct experiments on human peripapillary retinal OCT images. We also provide public access to the collected dataset, which might contribute to the research in the field of biomedical image processing. The Dice score of the proposed segmentation network is 0.820 ± 0.001 and the pixel accuracy is 0.830 ± 0.002, both of which outperform those from other state-of-the-art techniques.