Assessing Glaucoma Progression Using Machine Learning Trained on Longitudinal Visual Field and Clinical Data

The AI revolution in glaucoma: Bridging challenges with opportunities

Recent advancements in artificial intelligence (AI) herald transformative potentials for reshaping glaucoma clinical management, improving screening efficacy, sharpening diagnosis precision, and refining the detection of disease progression. However, incorporating AI into healthcare usages faces significant hurdles in terms of developing algorithms and putting them into practice. When creating algorithms, issues arise due to the intensive effort required to label data, inconsistent diagnostic standards, and a lack of thorough testing, which often limits the algorithms' widespread applicability. Additionally, the "black box" nature of AI algorithms may cause doctors to be wary or skeptical. When it comes to using these tools, challenges include dealing with lower-quality images in real situations and the systems' limited ability to work well with diverse ethnic groups and different diagnostic equipment. Looking ahead, new developments aim to protect data privacy through federated learning paradigms, improving algorithm generalizability by diversifying input data modalities, and augmenting datasets with synthetic imagery. The integration of smartphones appears promising for using AI algorithms in both clinical and non-clinical settings. Furthermore, bringing in large language models (LLMs) to act as interactive tool in medicine may signify a significant change in how healthcare will be delivered in the future. By navigating through these challenges and leveraging on these as opportunities, the field of glaucoma AI will not only have improved algorithmic accuracy and optimized data integration but also a paradigmatic shift towards enhanced clinical acceptance and a transformative improvement in glaucoma care.

[Visual field prediction based on temporal-spatial feature learning]

Glaucoma stands as the leading irreversible cause of blindness worldwide. Regular visual field examinations play a crucial role in both diagnosing and treating glaucoma. Predicting future visual field changes can assist clinicians in making timely interventions to manage the progression of this disease. To integrate temporal and spatial features from past visual field examination results and enhance visual field prediction, a convolutional long short-term memory (ConvLSTM) network was employed to construct a predictive model. The predictive performance of the ConvLSTM model was validated and compared with other methods using a dataset of perimetry tests from the Humphrey field analyzer at the University of Washington (UWHVF). Compared to traditional methods, the ConvLSTM model demonstrated higher prediction accuracy. Additionally, the relationship between visual field series length and prediction performance was investigated. In predicting the visual field using the previous three visual field results of past 1.5~6.0 years, it was found that the ConvLSTM model performed better, achieving a mean absolute error of 2.255 dB, a root mean squared error of 3.457 dB, and a coefficient of determination of 0.960. The experimental results show that the proposed method effectively utilizes existing visual field examination results to achieve more accurate visual field prediction for the next 0.5~2.0 years. This approach holds promise in assisting clinicians in diagnosing and treating visual field progression in glaucoma patients.

A Performance Evaluation of Convolutional Neural Network Architectures for Pterygium Detection in Anterior Segment Eye Images

In this article, various convolutional neural network (CNN) architectures for the detection of pterygium in the anterior segment of the eye are explored and compared. Five CNN architectures (ResNet101, ResNext101, Se-ResNext50, ResNext50, and MobileNet V2) are evaluated with the objective of identifying one that surpasses the precision and diagnostic efficacy of the current existing solutions. The results show that the Se-ResNext50 architecture offers the best overall performance in terms of precision, recall, and accuracy, with values of 93%, 92%, and 92%, respectively, for these metrics. These results demonstrate its potential to enhance diagnostic tools in ophthalmology.

Fuzzy clustering of 24-2 visual field patterns can detect glaucoma progression

PURPOSE

To represent 24-2 visual field (VF) losses of individual patients using a hybrid approach of archetypal analysis (AA) and fuzzy c-means (FCM) clustering.

METHODS

In this multicenter retrospective study, we classified characteristic patterns of 24-2 VF using AA and decomposed them with FCM clustering. We predicted the change in mean deviation (MD) through supervised machine learning from decomposition coefficient change. In addition, we compared the areas under the receiver operating characteristic curves (AUCs) of the decomposition coefficient slopes to detect VF progression using three criteria: MD slope, Visual Field Index slope, and pointwise linear regression analysis.

RESULTS

We identified 16 characteristic patterns (archetypes or ATs) of 24-2 VF from 132,938 VFs of 18,033 participants using AA. The hybrid approach using FCM revealed a lower mean squared error and greater correlation coefficient than the AA single approach for predicting MD change (all P ≤ 0.001). Three of 16 AUCs of the FCM decomposition coefficient slopes outperformed the AA decomposition coefficient slopes in detecting VF progression for all three criteria (AT5, superior altitudinal defect; AT10, double arcuate defect; AT13, total loss) (all P ≤ 0.028).

CONCLUSION

A hybrid approach combining AA and FCM to analyze 24-2 VF can visualize VF tests in characteristic patterns and enhance detection of VF progression with lossless decomposition.

Bidirectional gated recurrent unit network model can generate future visual field with variable number of input elements

PURPOSE

This study aimed to predict future visual field tests using a bidirectional gated recurrent unit (Bi-GRU) and assess its performance based on the number of input visual field tests and the prediction time interval.

MATERIALS AND METHODS

This study included patients who underwent visual field tests at least four times at five university hospitals between June 2004 and April 2022. All data were accessed in October 2022 for research purposes. In total, 23,517 eyes with 185,858 visual field tests were used as the training dataset, and 1,053 eyes with 9,459 visual field tests were used as the test dataset. The Bi-GRU architecture was designed to take a variable number of visual field tests, ranging from 3 to 80, as input and predict visual field tests at the desired arbitrary time point. It generated the mean deviation (MD), pattern standard deviation (PSD), Visual Field Index (VFI), and total deviation value (TDV) for 54 test points. To analyze the model performance, the mean absolute error between the actual and predicted values was calculated and analyzed for glaucoma severity, number of input visual field tests, and prediction time interval.

RESULTS

The prediction errors of the Bi-GRU model for MD, PSD, VFI, and TDV ranged from 1.20 to 1.68 dB, 0.95 to 1.16 dB, 3.64 to 4.51%, and 2.13 to 2.60 dB, respectively, depending on the number of input visual field tests. Prediction errors tended to increase as the prediction time interval increased; however, the difference was not statistically significant. As the severity of glaucoma worsened, the prediction errors significantly increased.

CONCLUSION

In clinical practice, the Bi-GRU model can predict future visual field tests at the desired time points using three or more previous visual field tests.

Detection of glaucoma progression on longitudinal series of en-face macular optical coherence tomography angiography images with a deep learning model

BACKGROUND/AIMS

To design a deep learning (DL) model for the detection of glaucoma progression with a longitudinal series of macular optical coherence tomography angiography (OCTA) images.

METHODS

202 eyes of 134 patients with open-angle glaucoma with ≥4 OCTA visits were followed for an average of 3.5 years. Glaucoma progression was defined as having a statistically significant negative 24-2 visual field (VF) mean deviation (MD) rate. The baseline and final macular OCTA images were aligned according to centre of fovea avascular zone automatically, by checking the highest value of correlation between the two images. A customised convolutional neural network (CNN) was designed for classification. A comparison of the CNN to logistic regression model for whole image vessel density (wiVD) loss on detection of glaucoma progression was performed. The performance of the model was defined based on the confusion matrix of the validation dataset and the area under receiver operating characteristics (AUC).

RESULTS

The average (95% CI) baseline VF MD was -3.4 (-4.1 to -2.7) dB. 28 (14%) eyes demonstrated glaucoma progression. The AUC (95% CI) of the DL model for the detection of glaucoma progression was 0.81 (0.59 to 0.93). The sensitivity, specificity and accuracy (95% CI) of DL model were 67% (34% to 78%), 83% (42% to 97%) and 80% (52% to 95%), respectively. The AUC (95% CI) for the detection of glaucoma progression based on the logistic regression model was lower than the DL model (0.69 (0.50 to 0.88)).

CONCLUSION

The optimised DL model detected glaucoma progression based on longitudinal macular OCTA images showed good performance. With external validation, it could enhance detection of glaucoma progression.

TRIAL REGISTRATION NUMBER

NCT00221897.

Prediction of visual field progression with serial optic disc photographs using deep learning

AIM

We tested the hypothesis that visual field (VF) progression can be predicted with a deep learning model based on longitudinal pairs of optic disc photographs (ODP) acquired at earlier time points during follow-up.

METHODS

3919 eyes (2259 patients) with ≥2 ODPs at least 2 years apart, and ≥5 24-2 VF exams spanning ≥3 years of follow-up were included. Serial VF mean deviation (MD) rates of change were estimated starting at the fifth visit and subsequently by adding visits until final visit. VF progression was defined as a statistically significant negative slope at two consecutive visits and final visit. We built a twin-neural network with ResNet50-backbone. A pair of ODPs acquired up to a year before the VF progression date or the last VF in non-progressing eyes were included as input. Primary outcome measures were area under the receiver operating characteristic curve (AUC) and model accuracy.

RESULTS

The average (SD) follow-up time and baseline VF MD were 8.1 (4.8) years and -3.3 (4.9) dB, respectively. VF progression was identified in 761 eyes (19%). The median (IQR) time to progression in progressing eyes was 7.3 (4.5-11.1) years. The AUC and accuracy for predicting VF progression were 0.862 (0.812-0.913) and 80.0% (73.9%-84.6%). When only fast-progressing eyes were considered (MD rate < -1.0 dB/year), AUC increased to 0.926 (0.857-0.994).

CONCLUSIONS

A deep learning model can predict subsequent glaucoma progression from longitudinal ODPs with clinically relevant accuracy. This model may be implemented, after validation, for predicting glaucoma progression in the clinical setting.

A multi-label transformer-based deep learning approach to predict focal visual field progression

PURPOSE

Tracking functional changes in visual fields (VFs) through standard automated perimetry remains a clinical standard for glaucoma diagnosis. This study aims to develop and evaluate a deep learning (DL) model to predict regional VF progression, which has not been explored in prior studies.

METHODS

The study included 2430 eyes of 1283 patients with four or more consecutive VF examinations from the baseline. A multi-label transformer-based network (MTN) using longitudinal VF data was developed to predict progression in six VF regions mapped to the optic disc. Progression was defined using the mean deviation (MD) slope and calculated for all six VF regions, referred to as clusters. Separate MTN models, trained for focal progression detection and forecasting on various numbers of VFs as model input, were tested on a held-out test set.

RESULTS

The MTNs overall demonstrated excellent macro-average AUCs above 0.884 in detecting focal VF progression given five or more VFs. With a minimum of 6 VFs, the model demonstrated superior and more stable overall and per-cluster performance, compared to 5 VFs. The MTN given 6 VFs achieved a macro-average AUC of 0.848 for forecasting progression across 8 VF tests. The MTN also achieved excellent performance (AUCs ≥ 0.86, 1.0 sensitivity, and specificity ≥ 0.70) in four out of six clusters for the eyes already with severe VF loss (baseline MD ≤  - 12 dB).

CONCLUSION

The high prediction accuracy suggested that multi-label DL networks trained with longitudinal VF results may assist in identifying and forecasting progression in VF regions.

Big data for imaging assessment in glaucoma

Glaucoma is the leading cause of irreversible blindness worldwide, with many individuals unaware of their condition until advanced stages, resulting in significant visual field impairment. Despite effective treatments, over 110 million people are projected to have glaucoma by 2040. Early detection and reliable monitoring are crucial to prevent vision loss. With the rapid development of computational technologies, artificial intelligence (AI) and deep learning (DL) algorithms are emerging as potential tools for screening, diagnosing, and monitoring glaucoma progression. Leveraging vast data sources, these technologies promise to enhance clinical practice and public health outcomes by enabling earlier disease detection, progression forecasting, and deeper understanding of underlying mechanisms. This review evaluates the use of Big Data and AI in glaucoma research, providing an overview of most relevant topics and discussing various models for screening, diagnosis, monitoring disease progression, correlating structural and functional changes, assessing image quality, and exploring innovative technologies such as generative AI.

Application of artificial intelligence in glaucoma care: An updated review

The application of artificial intelligence (AI) in ophthalmology has been increasingly explored in the past decade. Numerous studies have shown promising results supporting the utility of AI to improve the management of ophthalmic diseases, and glaucoma is of no exception. Glaucoma is an irreversible vision condition with insidious onset, complex pathophysiology, and chronic treatment. Since there remain various challenges in the clinical management of glaucoma, the potential role of AI in facilitating glaucoma care has garnered significant attention. In this study, we reviewed the relevant literature published in recent years that investigated the application of AI in glaucoma management. The main aspects of AI applications that will be discussed include glaucoma risk prediction, glaucoma detection and diagnosis, visual field estimation and pattern analysis, glaucoma progression detection, and other applications.

Deep-learning-based prediction of glaucoma conversion in normotensive glaucoma suspects

BACKGROUND/AIMS

To assess the performance of deep-learning (DL) models for prediction of conversion to normal-tension glaucoma (NTG) in normotensive glaucoma suspect (GS) patients.

METHODS

Datasets of 12 458 GS eyes were reviewed. Two hundred and ten eyes (105 eyes showing NTG conversion and 105 without conversion), followed up for a minimum of 7 years during which intraocular pressure (IOP) was lower than 21 mm Hg, were included. The features of two fundus images (optic disc photography and red-free retinal nerve fibre layer (RNFL) photography) were extracted by convolutional auto encoder. The extracted features as well as 15 clinical features including age, sex, IOP, spherical equivalent, central corneal thickness, axial length, average circumpapillary RNFL thickness, systolic/diastolic blood pressure and body mass index were used to predict NTG conversion. Prediction was performed using three machine-learning classifiers (ie, XGBoost, Random Forest, Gradient Boosting) with different feature combinations.

RESULTS

All three algorithms achieved high diagnostic accuracy for NTG conversion prediction. The AUCs ranged from 0.987 (95% CI 0.978 to 1.000; Random Forest trained with both fundus images and clinical features) and 0.994 (95% CI 0.984 to 1.000; XGBoost trained with both fundus images and clinical features). XGBoost showed the best prediction performance for time to NTG conversion (mean squared error, 2.24). The top three important clinical features for time-to-conversion prediction were baseline IOP, diastolic blood pressure and average circumpapillary RNFL thickness.

CONCLUSION

DL models, trained with both fundus images and clinical data, showed the potential to predict whether and when normotensive GS patients will show conversion to NTG.

Integrating Deep Learning with Electronic Health Records for Early Glaucoma Detection: A Multi-Dimensional Machine Learning Approach

BACKGROUND

Recent advancements in deep learning have significantly impacted ophthalmology, especially in glaucoma, a leading cause of irreversible blindness worldwide. In this study, we developed a reliable predictive model for glaucoma detection using deep learning models based on clinical data, social and behavior risk factor, and demographic data from 1652 participants, split evenly between 826 control subjects and 826 glaucoma patients.

METHODS

We extracted structural data from control and glaucoma patients' electronic health records (EHR). Three distinct machine learning classifiers, the Random Forest and Gradient Boosting algorithms, as well as the Sequential model from the Keras library of TensorFlow, were employed to conduct predictive analyses across our dataset. Key performance metrics such as accuracy, F1 score, precision, recall, and the area under the receiver operating characteristics curve (AUC) were computed to both train and optimize these models.

RESULTS

The Random Forest model achieved an accuracy of 67.5%, with a ROC AUC of 0.67, outperforming the Gradient Boosting and Sequential models, which registered accuracies of 66.3% and 64.5%, respectively. Our results highlighted key predictive factors such as intraocular pressure, family history, and body mass index, substantiating their roles in glaucoma risk assessment.

CONCLUSIONS

This study demonstrates the potential of utilizing readily available clinical, lifestyle, and demographic data from EHRs for glaucoma detection through deep learning models. While our model, using EHR data alone, has a lower accuracy compared to those incorporating imaging data, it still offers a promising avenue for early glaucoma risk assessment in primary care settings. The observed disparities in model performance and feature significance show the importance of tailoring detection strategies to individual patient characteristics, potentially leading to more effective and personalized glaucoma screening and intervention.

Prediction of Visual Field Progression with Baseline and Longitudinal Structural Measurements Using Deep Learning

PURPOSE

Identifying glaucoma patients at high risk of progression based on widely available structural data is an unmet task in clinical practice. We test the hypothesis that baseline or serial structural measures can predict visual field (VF) progression with deep learning (DL).

DESIGN

Development of a DL algorithm to predict VF progression.

METHODS

3,079 eyes (1,765 patients) with various types of glaucoma and ≥5 VFs, and ≥3 years of follow-up from a tertiary academic center were included. Serial VF mean deviation (MD) rates of change were estimated with linear-regression. VF progression was defined as negative MD slope with p<0.05. A Siamese Neural Network with ResNet-152 backbone pre-trained on ImageNet was designed to predict VF progression using serial optic-disc photographs (ODP), and baseline retinal nerve fiber layer (RNFL) thickness. We tested the model on a separate dataset (427 eyes) with RNFL data from different OCT. The Main Outcome Measure was Area under ROC curve (AUC).

RESULTS

Baseline average (SD) MD was 3.4 (4.9)dB. VF progression was detected in 900 eyes (29%). AUC (95% CI) for model incorporating baseline ODP and RNFL thickness was 0.813 (0.757-0.869). After adding the second and third ODPs, AUC increased to 0.860 and 0.894, respectively (p<0.027). This model also had highest AUC (0.911) for predicting fast progression (MD rate <1.0 dB/year). Model's performance was similar when applied to second dataset using RNFL data from another OCT device (AUC=0.893; 0.837-0.948).

CONCLUSIONS

DL model predicted VF progression with clinically relevant accuracy using baseline RNFL thickness and serial ODPs and can be implemented as a clinical tool after further validation.

The utilization of artificial intelligence in glaucoma: diagnosis versus screening

With advancements in the implementation of artificial intelligence (AI) in different ophthalmology disciplines, it continues to have a significant impact on glaucoma diagnosis and screening. This article explores the distinct roles of AI in specialized ophthalmology clinics and general practice, highlighting the critical balance between sensitivity and specificity in diagnostic and screening models. Screening models prioritize sensitivity to detect potential glaucoma cases efficiently, while diagnostic models emphasize specificity to confirm disease with high accuracy. AI applications, primarily using machine learning (ML) and deep learning (DL), have been successful in detecting glaucomatous optic neuropathy from colored fundus photographs and other retinal imaging modalities. Diagnostic models integrate data extracted from various forms of modalities (including tests that assess structural optic nerve damage as well as those evaluating functional damage) to provide a more nuanced, accurate and thorough approach to diagnosing glaucoma. As AI continues to evolve, the collaboration between technology and clinical expertise should focus more on improving specificity of glaucoma diagnostic models to assess ophthalmologists to revolutionize glaucoma diagnosis and improve patients care.

Efficacy of Smoothing Algorithms to Enhance Detection of Visual Field Progression in Glaucoma

Purpose

To evaluate and compare the effectiveness of nearest neighbor (NN)- and variational autoencoder (VAE)-smoothing algorithms to reduce variability and enhance the performance of glaucoma visual field (VF) progression models.

Design

Longitudinal cohort study.

Subjects

7150 eyes (4232 patients), with ≥ 5 years of follow-up and ≥ 6 visits.

Methods

Vsual field thresholds were smoothed with the NN and VAE algorithms. The mean total deviation (mTD) and VF index rates, pointwise linear regression (PLR), permutation of PLR (PoPLR), and the glaucoma rate index were applied to the unsmoothed and smoothed data.

Main Outcome Measures

The proportion of progressing eyes and the conversion to progression were compared between the smoothed and unsmoothed data. A simulation series of noiseless VFs with various patterns of glaucoma damage was used to evaluate the specificity of the smoothing models.

Results

The mean values of age and follow-up time were 62.8 (standard deviation: 12.6) years and 10.4 (standard deviation: 4.7) years, respectively. The proportion of progression was significantly higher for the NN and VAE smoothed data compared with the unsmoothed data. VF progression occurred significantly earlier with both smoothed data compared with unsmoothed data based on mTD rates, PLR, and PoPLR methods. The ability to detect the progressing eyes was similar for the unsmoothed and smoothed data in the simulation data.

Conclusions

Smoothing VF data with NN and VAE algorithms improves the signal-to-noise ratio for detection of change, results in earlier detection of VF progression, and could help monitor glaucoma progression more effectively in the clinical setting.

Financial Disclosures

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Recurrent and Concurrent Prediction of Longitudinal Progression of Stargardt Atrophy and Geographic Atrophy

Stargardt disease and age-related macular degeneration are the leading causes of blindness in the juvenile and geriatric populations, respectively. The formation of atrophic regions of the macula is a hallmark of the end-stages of both diseases. The progression of these diseases is tracked using various imaging modalities, two of the most common being fundus autofluorescence (FAF) imaging and spectral-domain optical coherence tomography (SD-OCT). This study seeks to investigate the use of longitudinal FAF and SD-OCT imaging (month 0, month 6, month 12, and month 18) data for the predictive modelling of future atrophy in Stargardt and geographic atrophy. To achieve such an objective, we develop a set of novel deep convolutional neural networks enhanced with recurrent network units for longitudinal prediction and concurrent learning of ensemble network units (termed ReConNet) which take advantage of improved retinal layer features beyond the mean intensity features. Using FAF images, the neural network presented in this paper achieved mean (± standard deviation, SD) and median Dice coefficients of 0.895 (± 0.086) and 0.922 for Stargardt atrophy, and 0.864 (± 0.113) and 0.893 for geographic atrophy. Using SD-OCT images for Stargardt atrophy, the neural network achieved mean and median Dice coefficients of 0.882 (± 0.101) and 0.906, respectively. When predicting only the interval growth of the atrophic lesions with FAF images, mean (± SD) and median Dice coefficients of 0.557 (± 0.094) and 0.559 were achieved for Stargardt atrophy, and 0.612 (± 0.089) and 0.601 for geographic atrophy. The prediction performance in OCT images is comparably good to that using FAF which opens a new, more efficient, and practical door in the assessment of atrophy progression for clinical trials and retina clinics, beyond widely used FAF. These results are highly encouraging for a high-performance interval growth prediction when more frequent or longer-term longitudinal data are available in our clinics. This is a pressing task for our next step in ongoing research.

Deep learning models to predict primary open-angle glaucoma

Glaucoma is a major cause of blindness and vision impairment worldwide, and visual field (VF) tests are essential for monitoring the conversion of glaucoma. While previous studies have primarily focused on using VF data at a single time point for glaucoma prediction, there has been limited exploration of longitudinal trajectories. Additionally, many deep learning techniques treat the time-to-glaucoma prediction as a binary classification problem (glaucoma Yes/No), resulting in the misclassification of some censored subjects into the nonglaucoma category and decreased power. To tackle these challenges, we propose and implement several deep-learning approaches that naturally incorporate temporal and spatial information from longitudinal VF data to predict time-to-glaucoma. When evaluated on the Ocular Hypertension Treatment Study (OHTS) dataset, our proposed convolutional neural network (CNN)-long short-term memory (LSTM) emerged as the top-performing model among all those examined. The implementation code can be found online (https://github.com/rivenzhou/VF_prediction).

Ocular Pathology and Genetics: Transformative Role of Artificial Intelligence (AI) in Anterior Segment Diseases

Artificial intelligence (AI) has become a revolutionary influence in the field of ophthalmology, providing unparalleled capabilities in data analysis and pattern recognition. This narrative review delves into the crucial role that AI plays, particularly in the context of anterior segment diseases with a genetic basis. Corneal dystrophies (CDs) exhibit significant genetic diversity, manifested by irregular substance deposition in the cornea. AI-driven diagnostic tools exhibit promising accuracy in the identification and classification of corneal diseases. Importantly, chat generative pre-trained transformer (ChatGPT)-4.0 shows significant advancement over its predecessor, ChatGPT-3.5. In the realm of glaucoma, AI significantly contributes to precise diagnostics through inventive algorithms and machine learning models, surpassing conventional methods. The incorporation of AI in predicting glaucoma progression and its role in augmenting diagnostic efficiency is readily apparent. Additionally, AI-powered models prove beneficial for early identification and risk assessment in cases of congenital cataracts, characterized by diverse inheritance patterns. Machine learning models achieving exceptional discrimination in identifying congenital cataracts underscore AI's remarkable potential. The review concludes by emphasizing the promising implications of AI in managing anterior segment diseases, spanning from early detection to the tailoring of personalized treatment strategies. These advancements signal a paradigm shift in ophthalmic care, offering optimism for enhanced patient outcomes and more streamlined healthcare delivery.

[Application of artificial intelligence in glaucoma. Part 2. Neural networks and machine learning in the monitoring and treatment of glaucoma]

The second part of the literature review on the application of artificial intelligence (AI) methods for screening, diagnosing, monitoring, and treating glaucoma provides information on how AI methods enhance the effectiveness of glaucoma monitoring and treatment, presents technologies that use machine learning, including neural networks, to predict disease progression and determine the need for anti-glaucoma surgery. The article also discusses the methods of personalized treatment based on projection machine learning methods and outlines the problems and prospects of using AI in solving tasks related to screening, diagnosing, and treating glaucoma.

Predicting 60-4 visual field tests using 3D facial reconstruction

BACKGROUND

Despite, the potential clinical utility of 60-4 visual fields, they are not frequently used in clinical practice partly, due to the purported impact of facial contour on field defects. The purpose of this study was to design and test an artificial intelligence-driven platform to predict facial structure-dependent visual field defects on 60-4 visual field tests.

METHODS

Subjects with no ocular pathology were included. Participants were subject to optical coherence tomography, 60-4 Swedish interactive thresholding algorithm visual field tests and photography. The predicted visual field was compared with observed 60-4 visual field results in subjects. Average and point-specific sensitivity, specificity, precision, negative predictive value, accuracy, and F1-scores were primary outcome measures.

RESULTS

30 healthy were enrolled. Three-dimensional facial reconstruction using a convolution neural network (CNN) was able to predict facial contour-dependent 60-4 visual field defects in 30 subjects without ocular pathology. Overall model accuracy was 97%±3% and 96%±3% and the F1-score, dependent on precision and sensitivity, was 58%±19% and 55%±15% for the right eye and left eye, respectively. Spatial-dependent model performance was observed with increased sensitivity and precision within the far inferior nasal field reflected by an average F1-score of 76%±20% and 70%±29% for the right eye and left eye, respectively.

CONCLUSIONS

This pilot study reports the development of a CNN-enhanced platform capable of predicting 60-4 visual field defects in healthy controls based on facial contour. Further study with this platform may enhance understanding of the influence of facial contour on 60-4 visual field testing.

Artificial intelligence in glaucoma: opportunities, challenges, and future directions

Artificial intelligence (AI) has shown excellent diagnostic performance in detecting various complex problems related to many areas of healthcare including ophthalmology. AI diagnostic systems developed from fundus images have become state-of-the-art tools in diagnosing retinal conditions and glaucoma as well as other ocular diseases. However, designing and implementing AI models using large imaging data is challenging. In this study, we review different machine learning (ML) and deep learning (DL) techniques applied to multiple modalities of retinal data, such as fundus images and visual fields for glaucoma detection, progression assessment, staging and so on. We summarize findings and provide several taxonomies to help the reader understand the evolution of conventional and emerging AI models in glaucoma. We discuss opportunities and challenges facing AI application in glaucoma and highlight some key themes from the existing literature that may help to explore future studies. Our goal in this systematic review is to help readers and researchers to understand critical aspects of AI related to glaucoma as well as determine the necessary steps and requirements for the successful development of AI models in glaucoma.

Machine Learning Models for Predicting Long-Term Visual Acuity in Highly Myopic Eyes

Importance

High myopia is a global concern due to its escalating prevalence and the potential risk of severe visual impairment caused by pathologic myopia. Using artificial intelligence to estimate future visual acuity (VA) could help clinicians to identify and monitor patients with a high risk of vision reduction in advance.

Objective

To develop machine learning models to predict VA at 3 and 5 years in patients with high myopia.

Design, Setting, and Participants

This retrospective, single-center, cohort study was performed on patients whose best-corrected VA (BCVA) at 3 and 5 years was known. The ophthalmic examinations of these patients were performed between October 2011 and May 2021. Thirty-four variables, including general information, basic ophthalmic information, and categories of myopic maculopathy based on fundus and optical coherence tomography images, were collected from the medical records for analysis.

Main Outcomes and Measures

Regression models were developed to predict BCVA at 3 and 5 years, and a binary classification model was developed to predict the risk of developing visual impairment at 5 years. The performance of models was evaluated by discrimination metrics, calibration belts, and decision curve analysis. The importance of relative variables was assessed by explainable artificial intelligence techniques.

Results

A total of 1616 eyes from 967 patients (mean [SD] age, 58.5 [14.0] years; 678 female [70.1%]) were included in this analysis. Findings showed that support vector machines presented the best prediction of BCVA at 3 years (R2 = 0.682; 95% CI, 0.625-0.733) and random forest at 5 years (R2 = 0.660; 95% CI, 0.604-0.710). To predict the risk of visual impairment at 5 years, logistic regression presented the best performance (area under the receiver operating characteristic curve = 0.870; 95% CI, 0.816-0.912). The baseline BCVA (logMAR odds ratio [OR], 0.298; 95% CI, 0.235-0.378; P < .001), prior myopic macular neovascularization (OR, 3.290; 95% CI, 2.209-4.899; P < .001), age (OR, 1.578; 95% CI, 1.227-2.028; P < .001), and category 4 myopic maculopathy (OR, 4.899; 95% CI, 1.431-16.769; P = .01) were the 4 most important predicting variables and associated with increased risk of visual impairment at 5 years.

Conclusions and Relevance

Study results suggest that developing models for accurate prediction of the long-term VA for highly myopic eyes based on clinical and imaging information is feasible. Such models could be used for the clinical assessments of future visual acuity.

Predicting glaucoma progression using deep learning framework guided by generative algorithm

Glaucoma is a slowly progressing optic neuropathy that may eventually lead to blindness. To help patients receive customized treatment, predicting how quickly the disease will progress is important. Structural assessment using optical coherence tomography (OCT) can be used to visualize glaucomatous optic nerve and retinal damage, while functional visual field (VF) tests can be used to measure the extent of vision loss. However, VF testing is patient-dependent and highly inconsistent, making it difficult to track glaucoma progression. In this work, we developed a multimodal deep learning model comprising a convolutional neural network (CNN) and a long short-term memory (LSTM) network, for glaucoma progression prediction. We used OCT images, VF values, demographic and clinical data of 86 glaucoma patients with five visits over 12 months. The proposed method was used to predict VF changes 12 months after the first visit by combining past multimodal inputs with synthesized future images generated using generative adversarial network (GAN). The patients were classified into two classes based on their VF mean deviation (MD) decline: slow progressors (< 3 dB) and fast progressors (> 3 dB). We showed that our generative model-based novel approach can achieve the best AUC of 0.83 for predicting the progression 6 months earlier. Further, the use of synthetic future images enabled the model to accurately predict the vision loss even earlier (9 months earlier) with an AUC of 0.81, compared to using only structural (AUC = 0.68) or only functional measures (AUC = 0.72). This study provides valuable insights into the potential of using synthetic follow-up OCT images for early detection of glaucoma progression.

Predicting mild cognitive impairment among Chinese older adults: a longitudinal study based on long short-term memory networks and machine learning

Background

Mild cognitive impairment (MCI) is a transitory yet reversible stage of dementia. Systematic, scientific and population-wide early screening system for MCI is lacking. This study aimed to construct prediction models using longitudinal data to identify potential MCI patients and explore its critical features among Chinese older adults.

Methods

A total of 2,128 participants were selected from wave 5-8 of Chinese Longitudinal Healthy Longevity Study. Cognitive function was measured using the Chinese version of Mini-Mental State Examination. Long- short-term memory (LSTM) and three machine learning techniques, including 8 sociodemographic features and 12 health behavior and health status features, were used to predict individual risk of MCI in the next year. Performances of prediction models were evaluated through receiver operating curve and decision curve analysis. The importance of predictors in prediction models were explored using Shapley Additive explanation (SHAP) model.

Results

The area under the curve values of three models were around 0.90 and decision curve analysis indicated that the net benefit of XGboost and Random Forest were approximate when threshold is lower than 0.8. SHAP models showed that age, education, respiratory disease, gastrointestinal ulcer and self-rated health are the five most important predictors of MCI.

Conclusion

This screening method of MCI, combining LSTM and machine learning, successfully predicted the risk of MCI using longitudinal datasets, and enables health care providers to implement early intervention to delay the process from MCI to dementia, reducing the incidence and treatment cost of dementia ultimately.

Normative Percentiles of Retinal Nerve Fiber Layer Thickness and Glaucomatous Visual Field Loss

Purpose

Circumpapillary retinal nerve fiber layer thickness (RNFLT) measurement aids in the clinical diagnosis of glaucoma. Spectral domain optical coherence tomography (SD-OCT) machines measure RNFLT and provide normative color-coded plots. In this retrospective study, we investigate whether normative percentiles of RNFLT (pRNFLT) from Spectralis SD-OCT improve prediction of glaucomatous visual field loss over raw RNFLT.

Methods

A longitudinal database containing OCT scans and visual fields from Massachusetts Eye & Ear glaucoma clinic patients was generated. Reliable OCT-visual field pairs were selected. Spectralis OCT normative distributions were extracted from machine printouts. Supervised machine learning models compared predictive performance between pRNFLT and raw RNFLT inputs. Regional structure-function associations were assessed with univariate regression to predict mean deviation (MD). Multivariable classification predicted MD, pattern standard deviation, MD change per year, and glaucoma hemifield test.

Results

There were 3016 OCT-visual field pairs that met the reliability criteria. Spectralis norms were found to be independent of age, sex, and ocular magnification. Regional analysis showed significant decrease in R2 from pRNFLT models compared to raw RNFLT models in inferotemporal sectors, across multiple regressors. In multivariable classification, there were no significant improvements in area under the curve of receiver operating characteristic curve (ROC-AUC) score with pRNFLT models compared to raw RNFLT models.

Conclusions

Our results challenge the assumption that normative percentiles from OCT machines improve prediction of glaucomatous visual field loss. Raw RNFLT alone shows strong prediction, with no models presenting improvement by the manufacturer norms. This may result from insufficient patient stratification in tested norms.

Translational Relevance

Understanding correlation of normative databases to visual function may improve clinical interpretation of OCT data.

Forecasting Risk of Future Rapid Glaucoma Worsening Using Early Visual Field, OCT, and Clinical Data

PURPOSE

To assess whether we can forecast future rapid visual field (VF) worsening using deep learning models (DLMs) trained on early VF, OCT, and clinical data.

DESIGN

A retrospective cohort study.

SUBJECTS

In total, 4536 eyes from 2962 patients. Overall, 263 (5.80%) eyes underwent rapid VF worsening (mean deviation slope less than -1 dB/year across all VFs).

METHODS

We included eyes that met the following criteria: (1) followed for glaucoma or suspect status; (2) had at least 5 longitudinal reliable VFs (VF1, VF2, VF3, VF4, and VF5); and (3) had 1 reliable baseline OCT scan (OCT1) and 1 set of baseline clinical measurements (clinical1) at the time of VF1. We designed a DLM to forecast future rapid VF worsening. The input consisted of spatially oriented total deviation values from VF1 (including or not including VF2 and VF3 in some models) and retinal nerve fiber layer thickness values from the baseline OCT. We passed this VF/OCT stack into a vision transformer feature extractor, the output of which was concatenated with baseline clinical data before putting it through a linear classifier to predict the eye's risk of rapid VF worsening across the 5 VFs. We compared the performance of models with differing inputs by computing area under the curve (AUC) in the test set. Specifically, we trained models with the following inputs: (1) model V: VF1; (2) VC: VF1+ Clinical1; (3) VO: VF1+ OCT1; (4) VOC: VF1+ Clinical1+ OCT1; (5) V2: VF1 + VF2; (6) V2OC: VF1 + VF2 + Clinical1 + OCT1; (7) V3: VF1 + VF2 + VF3; and (8) V3OC: VF1 + VF2 + VF3 + Clinical1 + OCT1.

MAIN OUTCOME MEASURES

The AUC of DLMs when forecasting rapidly worsening eyes.

RESULTS

Model V3OC best forecasted rapid worsening with an AUC (95% confidence interval [CI]) of 0.87 (0.77-0.97). Remaining models in descending order of performance and their respective AUC (95% CI) were as follows: (1) model V3 (0.84 [0.74-0.95]), (2) model V2OC (0.81 [0.70-0.92]), (3) model V2 (0.81 [0.70-0.82]), (4) model VOC (0.77 [0.65-0.88]), (5) model VO (0.75 [0.64-0.88]), (6) model VC (0.75 [0.63-0.87]), and (7) model V (0.74 [0.62-0.86]).

CONCLUSIONS

Deep learning models can forecast future rapid glaucoma worsening with modest to high performance when trained using data from early in the disease course. Including baseline data from multiple modalities and subsequent visits improves performance beyond using VF data alone.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

GRAPE: A multi-modal dataset of longitudinal follow-up visual field and fundus images for glaucoma management

As one of the leading causes of irreversible blindness worldwide, glaucoma is characterized by structural damage and functional loss. Glaucoma patients often have a long follow-up and prognosis prediction is an important part in treatment. However, existing public glaucoma datasets are almost cross-sectional, concentrating on segmentation on optic disc (OD) and glaucoma diagnosis. With the development of artificial intelligence (AI), the deep learning model can already provide accurate prediction of future visual field (VF) and its progression with the support of longitudinal datasets. Here, we proposed a public longitudinal glaucoma real-world appraisal progression ensemble (GRAPE) dataset. The GRAPE dataset contains 1115 follow-up records from 263 eyes, with VFs, fundus images, OCT measurements and clinical information, and OD segmentation and VF progression are annotated. Two baseline models demonstrated the feasibility in prediction of VF and its progression. This dataset will advance AI research in glaucoma management.

Visual field prediction using a deep bidirectional gated recurrent unit network model

Although deep learning architecture has been used to process sequential data, only a few studies have explored the usefulness of deep learning algorithms to detect glaucoma progression. Here, we proposed a bidirectional gated recurrent unit (Bi-GRU) algorithm to predict visual field loss. In total, 5413 eyes from 3321 patients were included in the training set, whereas 1272 eyes from 1272 patients were included in the test set. Data from five consecutive visual field examinations were used as input; the sixth visual field examinations were compared with predictions by the Bi-GRU. The performance of Bi-GRU was compared with the performances of conventional linear regression (LR) and long short-term memory (LSTM) algorithms. Overall prediction error was significantly lower for Bi-GRU than for LR and LSTM algorithms. In pointwise prediction, Bi-GRU showed the lowest prediction error among the three models in most test locations. Furthermore, Bi-GRU was the least affected model in terms of worsening reliability indices and glaucoma severity. Accurate prediction of visual field loss using the Bi-GRU algorithm may facilitate decision-making regarding the treatment of patients with glaucoma.

Review of Visualization Approaches in Deep Learning Models of Glaucoma

Glaucoma is a major cause of irreversible blindness worldwide. As glaucoma often presents without symptoms, early detection and intervention are important in delaying progression. Deep learning (DL) has emerged as a rapidly advancing tool to help achieve these objectives. In this narrative review, data types and visualization approaches for presenting model predictions, including models based on tabular data, functional data, and/or structural data, are summarized, and the importance of data source diversity for improving the utility and generalizability of DL models is explored. Examples of innovative approaches to understanding predictions of artificial intelligence (AI) models and alignment with clinicians are provided. In addition, methods to enhance the interpretability of clinical features from tabular data used to train AI models are investigated. Examples of published DL models that include interfaces to facilitate end-user engagement and minimize cognitive and time burdens are highlighted. The stages of integrating AI models into existing clinical workflows are reviewed, and challenges are discussed. Reviewing these approaches may help inform the generation of user-friendly interfaces that are successfully integrated into clinical information systems. This review details key principles regarding visualization approaches in DL models of glaucoma. The articles reviewed here focused on usability, explainability, and promotion of clinician trust to encourage wider adoption for clinical use. These studies demonstrate important progress in addressing visualization and explainability issues required for successful real-world implementation of DL models in glaucoma.

Artificial intelligence in ophthalmology: The path to the real-world clinic

Artificial intelligence (AI) has great potential to transform healthcare by enhancing the workflow and productivity of clinicians, enabling existing staff to serve more patients, improving patient outcomes, and reducing health disparities. In the field of ophthalmology, AI systems have shown performance comparable with or even better than experienced ophthalmologists in tasks such as diabetic retinopathy detection and grading. However, despite these quite good results, very few AI systems have been deployed in real-world clinical settings, challenging the true value of these systems. This review provides an overview of the current main AI applications in ophthalmology, describes the challenges that need to be overcome prior to clinical implementation of the AI systems, and discusses the strategies that may pave the way to the clinical translation of these systems.

Data Preprocessing and Augmentation Improved Visual Field Prediction of Recurrent Neural Network with Multi-Central Datasets

INTRODUCTION

The purpose of this study was to determine whether data preprocessing and augmentation could improve visual field (VF) prediction of recurrent neural network (RNN) with multi-central datasets.

METHODS

This retrospective study collected data from five glaucoma services between June 2004 and January 2021. From an initial dataset of 331,691 VFs, we considered reliable VF tests with fixed intervals. Since the VF monitoring interval is very variable, we applied data augmentation using multiple sets of data for patients with more than eight VFs. We obtained 5,430 VFs from 463 patients and 13,747 VFs from 1,076 patients by setting the fixed test interval to 365 ± 60 days (D = 365) and 180 ± 60 days (D = 180), respectively. Five consecutive VFs were provided to the constructed RNN as input and the 6th VF was compared with the output of the RNN. The performance of the periodic RNN (D = 365) was compared to that of an aperiodic RNN. The performance of the RNN with 6 long- and short-term memory (LSTM) cells (D = 180) was compared with that of the RNN with 5-LSTM cells. To compare the prediction performance, the root mean square error (RMSE) and mean absolute error (MAE) of the total deviation value (TDV) were calculated as accuracy metrics.

RESULTS

The performance of the periodic model (D = 365) improved significantly over aperiodic model. Overall prediction error (MAE) was 2.56 ± 0.46 dB versus 3.26 ± 0.41 dB (periodic vs. aperiodic) (p < 0.001). A higher perimetric frequency was better for predicting future VF. The overall prediction error (RMSE) was 3.15 ± 2.29 dB versus 3.42 ± 2.25 dB (D = 180 vs. D = 365). Increasing the number of input VFs improved the performance of VF prediction in D = 180 periodic model (3.15 ± 2.29 dB vs. 3.18 ± 2.34 dB, p < 0.001). The 6-LSTM in the D = 180 periodic model was more robust to worsening of VF reliability and disease severity. The prediction accuracy worsened as the false-negative rate increased and the mean deviation decreased.

CONCLUSION

Data preprocessing with augmentation improved the VF prediction of the RNN model using multi-center datasets. The periodic RNN model predicted the future VF significantly better than the aperiodic RNN model.

The application of artificial intelligence in glaucoma diagnosis and prediction

Artificial intelligence is a multidisciplinary and collaborative science, the ability of deep learning for image feature extraction and processing gives it a unique advantage in dealing with problems in ophthalmology. The deep learning system can assist ophthalmologists in diagnosing characteristic fundus lesions in glaucoma, such as retinal nerve fiber layer defects, optic nerve head damage, optic disc hemorrhage, etc. Early detection of these lesions can help delay structural damage, protect visual function, and reduce visual field damage. The development of deep learning led to the emergence of deep convolutional neural networks, which are pushing the integration of artificial intelligence with testing devices such as visual field meters, fundus imaging and optical coherence tomography to drive more rapid advances in clinical glaucoma diagnosis and prediction techniques. This article details advances in artificial intelligence combined with visual field, fundus photography, and optical coherence tomography in the field of glaucoma diagnosis and prediction, some of which are familiar and some not widely known. Then it further explores the challenges at this stage and the prospects for future clinical applications. In the future, the deep cooperation between artificial intelligence and medical technology will make the datasets and clinical application rules more standardized, and glaucoma diagnosis and prediction tools will be simplified in a single direction, which will benefit multiple ethnic groups.

Assistive applications of artificial intelligence in ophthalmology

PURPOSE OF REVIEW

Assistive (nonautonomous) artificial intelligence (AI) models designed to support (rather than function independently of) clinicians have received increasing attention in medicine. This review aims to highlight several recent developments in these models over the past year and their ophthalmic implications.

RECENT FINDINGS

Artificial intelligence models with a diverse range of applications in ophthalmology have been reported in the literature over the past year. Many of these systems have reported high performance in detection, classification, prognostication, and/or monitoring of retinal, glaucomatous, anterior segment, and other ocular pathologies.

SUMMARY

Over the past year, developments in AI have been made that have implications affecting ophthalmic surgical training and refractive outcomes after cataract surgery, therapeutic monitoring of disease, disease classification, and prognostication. Many of these recently developed models have obtained encouraging results and have the potential to serve as powerful clinical decision-making tools pending further external validation and evaluation of their generalizability.

Use of artificial intelligence in forecasting glaucoma progression

Artificial intelligence (AI) has been widely used in ophthalmology for disease detection and monitoring progression. For glaucoma research, AI has been used to understand progression patterns and forecast disease trajectory based on analysis of clinical and imaging data. Techniques such as machine learning, natural language processing, and deep learning have been employed for this purpose. The results from studies using AI for forecasting glaucoma progression however vary considerably due to dataset constraints, lack of a standard progression definition and differences in methodology and approach. While glaucoma detection and screening have been the focus of most research that has been published in the last few years, in this narrative review we focus on studies that specifically address glaucoma progression. We also summarize the current evidence, highlight studies that have translational potential, and provide suggestions on how future research that addresses glaucoma progression can be improved.

Assessment of visual field progression in glaucoma

PURPOSE OF REVIEW

Perimetry plays an important role in the diagnosis and management of glaucoma. This article discusses the assessment of visual field progression in patients with glaucoma.

RECENT FINDINGS

Selecting the best visual field test strategy and establishing a baseline of visual fields will assist clinicians in the detection of glaucomatous progression. Repeat testing serves to confirm or refute changes on visual field testing. More frequent testing after initial diagnosis is recommended to establish a baseline and to identify patients with rapid progression who may need more aggressive management. Statistically significant changes on event analysis can prompt examination of a patient's trend analysis to determine whether clinically significant deterioration may be occurring. Future applications of machine learning can complement existing methods of visual field interpretation.

SUMMARY

Many treated patients with glaucoma will experience visual field progression. Optimal utilization of visual field testing strategy and analytical software can help clinicians identify patients with glaucomatous progression likely to cause functional visual disability.

Detecting disease progression in mild, moderate and severe glaucoma

PURPOSE OF REVIEW

The purpose of this review is to examine contemporary techniques for detecting the progression of glaucoma. We provide a general overview of detection principles and review evidence-based diagnostic strategies and specific considerations for detecting glaucomatous progression in patients with mild, moderate and severe disease.

RECENT FINDINGS

Diagnostic techniques and technologies for glaucoma have dramatically evolved in recent years, affording clinicians an expansive toolkit with which to detect glaucoma progression. Each stage of glaucoma, however, presents unique diagnostic challenges. In mild disease, either structural or functional changes can develop first in disease progression. In moderate disease, structural or functional changes can occur either in tandem or in isolation. In severe disease, standard techniques may fail to detect further disease progression, but such detection can still be measured using other modalities.

SUMMARY

Detecting disease progression is central to the management of glaucoma. Glaucomatous progression has both structural and functional elements, both of which must be carefully monitored at all disease stages to determine when interventions are warranted.

Bidirectional Neural Network Model for Glaucoma Progression Prediction

Deep learning models are usually utilized to learn from spatial data, only a few studies are proposed to predict glaucoma time progression utilizing deep learning models. In this article, we present a bidirectional recurrent deep learning model (Bi-RM) to detect prospective progressive visual field diagnoses. A dataset of 5413 different eyes from 3321 samples is utilized as the learning phase dataset and 1272 eyes are used for testing. Five consecutive diagnoses are recorded from the dataset as input and the sixth progressive visual field diagnosis is matched with the prediction of the Bi-RM. The precision metrics of the Bi-RM are validated in association with the linear regression algorithm (LR) and term memory (TM) technique. The total prediction error of the Bi-RM is significantly less than those of LR and TM. In the class prediction, Bi-RM depicts the least prediction error in all three methods in most of the testing cases. In addition, Bi-RM is not impacted by the reliability keys and the glaucoma degree.

A deep learning model incorporating spatial and temporal information successfully detects visual field worsening using a consensus based approach

Glaucoma is a leading cause of irreversible blindness, and its worsening is most often monitored with visual field (VF) testing. Deep learning models (DLM) may help identify VF worsening consistently and reproducibly. In this study, we developed and investigated the performance of a DLM on a large population of glaucoma patients. We included 5099 patients (8705 eyes) seen at one institute from June 1990 to June 2020 that had VF testing as well as clinician assessment of VF worsening. Since there is no gold standard to identify VF worsening, we used a consensus of six commonly used algorithmic methods which include global regressions as well as point-wise change in the VFs. We used the consensus decision as a reference standard to train/test the DLM and evaluate clinician performance. 80%, 10%, and 10% of patients were included in training, validation, and test sets, respectively. Of the 873 eyes in the test set, 309 [60.6%] were from females and the median age was 62.4; (IQR 54.8-68.9). The DLM achieved an AUC of 0.94 (95% CI 0.93-0.99). Even after removing the 6 most recent VFs, providing fewer data points to the model, the DLM successfully identified worsening with an AUC of 0.78 (95% CI 0.72-0.84). Clinician assessment of worsening (based on documentation from the health record at the time of the final VF in each eye) had an AUC of 0.64 (95% CI 0.63-0.66). Both the DLM and clinician performed worse when the initial disease was more severe. This data shows that a DLM trained on a consensus of methods to define worsening successfully identified VF worsening and could help guide clinicians during routine clinical care.

Clinical Applications of Artificial Intelligence in Glaucoma

Ophthalmology is one of the major imaging-intensive fields of medicine and thus has potential for extensive applications of artificial intelligence (AI) to advance diagnosis, drug efficacy, and other treatment-related aspects of ocular disease. AI has made impressive progress in ophthalmology within the past few years and two autonomous AI-enabled systems have received US regulatory approvals for autonomously screening for mid-level or advanced diabetic retinopathy and macular edema. While no autonomous AI-enabled system for glaucoma screening has yet received US regulatory approval, numerous assistive AI-enabled software tools are already employed in commercialized instruments for quantifying retinal images and visual fields to augment glaucoma research and clinical practice. In this literature review (non-systematic), we provide an overview of AI applications in glaucoma, and highlight some limitations and considerations for AI integration and adoption into clinical practice.

Artificial Intelligence to Aid Glaucoma Diagnosis and Monitoring: State of the Art and New Directions

Recent developments in the use of artificial intelligence in the diagnosis and monitoring of glaucoma are discussed. To set the context and fix terminology, a brief historic overview of artificial intelligence is provided, along with some fundamentals of statistical modeling. Next, recent applications of artificial intelligence techniques in glaucoma diagnosis and the monitoring of glaucoma progression are reviewed, including the classification of visual field images and the detection of glaucomatous change in retinal nerve fiber layer thickness. Current challenges in the direct application of artificial intelligence to further our understating of this disease are also outlined. The article also discusses how the combined use of mathematical modeling and artificial intelligence may help to address these challenges, along with stronger communication between data scientists and clinicians.

An overview of artificial intelligence in diabetic retinopathy and other ocular diseases

Artificial intelligence (AI), also known as machine intelligence, is a branch of science that empowers machines using human intelligence. AI refers to the technology of rendering human intelligence through computer programs. From healthcare to the precise prevention, diagnosis, and management of diseases, AI is progressing rapidly in various interdisciplinary fields, including ophthalmology. Ophthalmology is at the forefront of AI in medicine because the diagnosis of ocular diseases heavy reliance on imaging. Recently, deep learning-based AI screening and prediction models have been applied to the most common visual impairment and blindness diseases, including glaucoma, cataract, age-related macular degeneration (ARMD), and diabetic retinopathy (DR). The success of AI in medicine is primarily attributed to the development of deep learning algorithms, which are computational models composed of multiple layers of simulated neurons. These models can learn the representations of data at multiple levels of abstraction. The Inception-v3 algorithm and transfer learning concept have been applied in DR and ARMD to reuse fundus image features learned from natural images (non-medical images) to train an AI system with a fraction of the commonly used training data (<1%). The trained AI system achieved performance comparable to that of human experts in classifying ARMD and diabetic macular edema on optical coherence tomography images. In this study, we highlight the fundamental concepts of AI and its application in these four major ocular diseases and further discuss the current challenges, as well as the prospects in ophthalmology.

Visual Field Prediction: Evaluating the Clinical Relevance of Deep Learning Models

Purpose

Two novel deep learning methods using a convolutional neural network (CNN) and a recurrent neural network (RNN) have recently been developed to forecast future visual fields (VFs). Although the original evaluations of these models focused on overall accuracy, it was not assessed whether they can accurately identify patients with progressive glaucomatous vision loss to aid clinicians in preventing further decline. We evaluated these 2 prediction models for potential biases in overestimating or underestimating VF changes over time.

Design

Retrospective observational cohort study.

Participants

All available and reliable Swedish Interactive Thresholding Algorithm Standard 24-2 VFs from Massachusetts Eye and Ear Glaucoma Service collected between 1999 and 2020 were extracted. Because of the methods' respective needs, the CNN data set included 54 373 samples from 7472 patients, and the RNN data set included 24 430 samples from 1809 patients.

Methods

The CNN and RNN methods were reimplemented. A fivefold cross-validation procedure was performed on each model, and pointwise mean absolute error (PMAE) was used to measure prediction accuracy. Test data were stratified into categories based on the severity of VF progression to investigate the models' performances on predicting worsening cases. The models were additionally compared with a no-change model that uses the baseline VF (for the CNN) and the last-observed VF (for the RNN) for its prediction.

Main Outcome Measures

PMAE in predictions.

Results

The overall PMAE 95% confidence intervals were 2.21 to 2.24 decibels (dB) for the CNN and 2.56 to 2.61 dB for the RNN, which were close to the original studies' reported values. However, both models exhibited large errors in identifying patients with worsening VFs and often failed to outperform the no-change model. Pointwise mean absolute error values were higher in patients with greater changes in mean sensitivity (for the CNN) and mean total deviation (for the RNN) between baseline and follow-up VFs.

Conclusions

Although our evaluation confirms the low overall PMAEs reported in the original studies, our findings also reveal that both models severely underpredict worsening of VF loss. Because the accurate detection and projection of glaucomatous VF decline is crucial in ophthalmic clinical practice, we recommend that this consideration is explicitly taken into account when developing and evaluating future deep learning models.

Artificial Intelligence for Glaucoma: Creating and Implementing Artificial Intelligence for Disease Detection and Progression

On September 3, 2020, the Collaborative Community on Ophthalmic Imaging conducted its first 2-day virtual workshop on the role of artificial intelligence (AI) and related machine learning techniques in the diagnosis and treatment of various ophthalmic conditions. In a session entitled "Artificial Intelligence for Glaucoma," a panel of glaucoma specialists, researchers, industry experts, and patients convened to share current research on the application of AI to commonly used diagnostic modalities, including fundus photography, OCT imaging, standard automated perimetry, and gonioscopy. The conference participants focused on the use of AI as a tool for disease prediction, highlighted its ability to address inequalities, and presented the limitations of and challenges to its clinical application. The panelists' discussion addressed AI and health equities from clinical, societal, and regulatory perspectives.

Novel technical and privacy-preserving technology for artificial intelligence in ophthalmology

PURPOSE OF REVIEW

The application of artificial intelligence (AI) in medicine and ophthalmology has experienced exponential breakthroughs in recent years in diagnosis, prognosis, and aiding clinical decision-making. The use of digital data has also heralded the need for privacy-preserving technology to protect patient confidentiality and to guard against threats such as adversarial attacks. Hence, this review aims to outline novel AI-based systems for ophthalmology use, privacy-preserving measures, potential challenges, and future directions of each.

RECENT FINDINGS

Several key AI algorithms used to improve disease detection and outcomes include: Data-driven, imagedriven, natural language processing (NLP)-driven, genomics-driven, and multimodality algorithms. However, deep learning systems are susceptible to adversarial attacks, and use of data for training models is associated with privacy concerns. Several data protection methods address these concerns in the form of blockchain technology, federated learning, and generative adversarial networks.

SUMMARY

AI-applications have vast potential to meet many eyecare needs, consequently reducing burden on scarce healthcare resources. A pertinent challenge would be to maintain data privacy and confidentiality while supporting AI endeavors, where data protection methods would need to rapidly evolve with AI technology needs. Ultimately, for AI to succeed in medicine and ophthalmology, a balance would need to be found between innovation and privacy.

[Artificial intelligence and glaucoma: A literature review]

In recent years, research in artificial intelligence (AI) has experienced an unprecedented surge in the field of ophthalmology, in particular glaucoma. The diagnosis and follow-up of glaucoma is complex and relies on a body of clinical evidence and ancillary tests. This large amount of information from structural and functional testing of the optic nerve and macula makes glaucoma a particularly appropriate field for the application of AI. In this paper, we will review work using AI in the field of glaucoma, whether for screening, diagnosis or detection of progression. Many AI strategies have shown promising results for glaucoma detection using fundus photography, optical coherence tomography, or automated perimetry. The combination of these imaging modalities increases the performance of AI algorithms, with results comparable to those of humans. We will discuss potential applications as well as obstacles and limitations to the deployment and validation of such models. While there is no doubt that AI has the potential to revolutionize glaucoma management and screening, research in the coming years will need to address unavoidable questions regarding the clinical significance of such results and the explicability of the predictions.

UWHVF: A Real-World, Open Source Dataset of Perimetry Tests From the Humphrey Field Analyzer at the University of Washington

Purpose

This article describes the Humphrey field analyzer (HFA) dataset from the Department of Ophthalmology at the University of Washington.

Methods

Pointwise sensitivities were extracted from HFA 24-2, stimulus III visual fields (VF). Total deviation (TD), mean TD (MTD), pattern deviation, and pattern standard deviation (PSD) were calculated. Progression analysis was performed with simple linear regression on global, regional, and pointwise values for VF series with greater than four tests spanning at least four months. VF data were extracted independently of clinical information except for patient age, gender, and laterality

Results

This dataset includes 28,943 VFs from 7248 eyes of 3871 patients. Progression was calculated for 2985 eyes from 1579 patients. Median [interquartile range] age was 64 years [54, 73], and follow-up was 2.49 years [1.11, 5.03]. Baseline MTD was −4.51 dB [−8.01, −2.65], and baseline PSD was 2.41 dB [1.7, 5.34].

Conclusion

MTD was found to decrease by −0.10 dB/yr [−0.40, 0.11] in eyes for which progression analysis was able to be performed. VFs with deep localized defects, PSD > 12 dB and MTD −15 dB to −25 dB, were plotted, visually inspected, and found to be consistent with neurologic or glaucomatous VFs from patients. For a small number of tests, extracted sensitivity values were compared to corresponding printouts and confirmed to match.

Translational Relevance

This open access pointwise VF dataset serves as a source of raw data for investigation such as VF behavior, clinical comparisons to trials, and development of new machine learning algorithms.

Understanding required to consider AI applications to the field of ophthalmology

Applications of artificial intelligence technology, especially deep learning, in ophthalmology research have started with the diagnosis of diabetic retinopathy and have now expanded to all areas of ophthalmology, mainly in the identification of fundus diseases such as glaucoma and age-related macular degeneration. In addition to fundus photography, optical coherence tomography is often used as an imaging device. In addition to simple binary classification, region identification (segmentation model) is used as an identification method for interpretability. Furthermore, there have been AI applications in the area of regression estimation, which is different from diagnostic identification. While expectations for deep learning AI are rising, regulatory agencies have begun issuing guidance on the medical applications of AI. The reason behind this trend is that there are a number of existing issues regarding the application of AI that need to be considered, including, but not limited to, the handling of personal information by large technology companies, the black-box issue, the flaming issue, the theory of responsibility, and issues related to improving the performance of commercially available AI. Furthermore, researchers have reported that there are a plethora of issues that simply cannot be solved by the high performance of artificial intelligence models, such as educating users and securing the communication environment, which are just a few of the necessary steps toward the actual implementation process of an AI society. Multifaceted perspectives and efforts are needed to create better ophthalmology care through AI.

A Case for The Use of Artificial Intelligence in Glaucoma Assessment

We hypothesize that artificial intelligence applied to relevant clinical testing in glaucoma has the potential to enhance the ability to detect glaucoma. This premise was discussed at the recent Collaborative Community for Ophthalmic Imaging meeting, "The Future of Artificial Intelligence-Enabled Ophthalmic Image Interpretation: Accelerating Innovation and Implementation Pathways," held virtually September 3-4, 2020. The Collaborative Community in Ophthalmic Imaging (CCOI) is an independent self-governing consortium of stakeholders with broad international representation from academic institutions, government agencies, and the private sector whose mission is to act as a forum for the purpose of helping speed innovation in healthcare technology. It was one of the first two such organizations officially designated by the FDA in September 2019 in response to their announcement of the collaborative community program as a strategic priority for 2018-2020. Further information on the CCOI can be found online at their website (https://www.cc-oi.org/about). Artificial intelligence for glaucoma diagnosis would have high utility globally, as access to care is limited in many parts of the world and half of all people with glaucoma are unaware of their illness. The application of artificial intelligence technology to glaucoma diagnosis has the potential to broadly increase access to care worldwide, in essence flattening the Earth by providing expert level evaluation to individuals even in the most remote regions of the planet.

Artificial Intelligence, Heuristic Biases, and the Optimization of Health Outcomes: Cautionary Optimism

The use of artificial intelligence (AI) and machine learning (ML) in clinical care offers great promise to improve patient health outcomes and reduce health inequity across patient populations. However, inherent biases in these applications, and the subsequent potential risk of harm can limit current use. Multi-modal workflows designed to minimize these limitations in the development, implementation, and evaluation of ML systems in real-world settings are needed to improve efficacy while reducing bias and the risk of potential harms. Comprehensive consideration of rapidly evolving AI technologies and the inherent risks of bias, the expanding volume and nature of data sources, and the evolving regulatory landscapes, can contribute meaningfully to the development of AI-enhanced clinical decision making and the reduction in health inequity.

A Machine Learning-Based Investigation of Gender-Specific Prognosis of Lung Cancers

Background and Objective: Primary lung cancer is a lethal and rapidly-developing cancer type and is one of the most leading causes of cancer deaths. Materials and Methods: Statistical methods such as Cox regression are usually used to detect the prognosis factors of a disease. This study investigated survival prediction using machine learning algorithms. The clinical data of 28,458 patients with primary lung cancers were collected from the Surveillance, Epidemiology, and End Results (SEER) database. Results: This study indicated that the survival rate of women with primary lung cancer was often higher than that of men (p < 0.001). Seven popular machine learning algorithms were utilized to evaluate one-year, three-year, and five-year survival prediction The two classifiers extreme gradient boosting (XGB) and logistic regression (LR) achieved the best prediction accuracies. The importance variable of the trained XGB models suggested that surgical removal (feature “Surgery”) made the largest contribution to the one-year survival prediction models, while the metastatic status (feature “N” stage) of the regional lymph nodes was the most important contributor to three-year and five-year survival prediction. The female patients’ three-year prognosis model achieved a prediction accuracy of 0.8297 on the independent future samples, while the male model only achieved the accuracy 0.7329. Conclusions: This data suggested that male patients may have more complicated factors in lung cancer than females, and it is necessary to develop gender-specific diagnosis and prognosis models.