Predicting Age From Optical Coherence Tomography Scans With Deep Learning

Developing a privacy-preserving deep learning model for glaucoma detection: a multicentre study with federated learning

BACKGROUND

Deep learning (DL) is promising to detect glaucoma. However, patients' privacy and data security are major concerns when pooling all data for model development. We developed a privacy-preserving DL model using the federated learning (FL) paradigm to detect glaucoma from optical coherence tomography (OCT) images.

METHODS

This is a multicentre study. The FL paradigm consisted of a 'central server' and seven eye centres in Hong Kong, the USA and Singapore. Each centre first trained a model locally with its own OCT optic disc volumetric dataset and then uploaded its model parameters to the central server. The central server used FedProx algorithm to aggregate all centres' model parameters. Subsequently, the aggregated parameters are redistributed to each centre for its local model optimisation. We experimented with three three-dimensional (3D) networks to evaluate the stabilities of the FL paradigm. Lastly, we tested the FL model on two prospectively collected unseen datasets.

RESULTS

We used 9326 volumetric OCT scans from 2785 subjects. The FL model performed consistently well with different networks in 7 centres (accuracies 78.3%-98.5%, 75.9%-97.0%, and 78.3%-97.5%, respectively) and stably in the 2 unseen datasets (accuracies 84.8%-87.7%, 81.3%-84.8%, and 86.0%-87.8%, respectively). The FL model achieved non-inferior performance in classifying glaucoma compared with the traditional model and significantly outperformed the individual models.

CONCLUSION

The 3D FL model could leverage all the datasets and achieve generalisable performance, without data exchange across centres. This study demonstrated an OCT-based FL paradigm for glaucoma identification with ensured patient privacy and data security, charting another course toward the real-world transition of artificial intelligence in ophthalmology.

Progression or Aging? A Deep Learning Approach for Distinguishing Glaucoma Progression From Age-Related Changes in OCT Scans

PURPOSE

To develop deep learning (DL) algorithm to detect glaucoma progression using optical coherence tomography (OCT) images, in the absence of a reference standard.

DESIGN

Retrospective cohort study.

METHODS

Glaucomatous and healthy eyes with ≥5 reliable peripapillary OCT (Spectralis, Heidelberg Engineering) circle scans were included. A weakly supervised time-series learning model, called noise positive-unlabeled (Noise-PU) DL was developed to classify whether sequences of OCT B-scans showed glaucoma progression. The model used 2 learning schemes, one to identify age-related changes by differentiating test sequences from glaucoma vs healthy eyes, and the other to identify test-retest variability based on scrambled OCTs of glaucoma eyes. Both models' bases were convolutional neural networks (CNN) and long short-term memory (LSTM) networks which were combined to form a CNN-LSTM model. Model features were combined and jointly trained to identify glaucoma progression, accounting for age-related loss. The DL model's outcomes were compared with ordinary least squares (OLS) regression of retinal nerve fiber layer (RNFL) thickness over time, matched for specificity. The hit ratio was used as a proxy for sensitivity.

RESULTS

Eight thousand seven hundred eighty-five follow-up sequences of 5 consecutive OCT tests from 3253 eyes (1859 subjects) were included in the study. The mean follow-up time was 3.5 ± 1.6 years. In the test sample, the hit ratios of the DL and OLS methods were 0.498 (95%CI: 0.470-0.526) and 0.284 (95%CI: 0.258-0.309) respectively (P < .001) when the specificities were equalized to 95%.

CONCLUSION

A DL model was able to identify longitudinal glaucomatous structural changes in OCT B-scans using a surrogate reference standard for progression.

Deep neural network-estimated age using optical coherence tomography predicts mortality

The concept of biological age has emerged as a measurement that reflects physiological and functional decline with ageing. Here we aimed to develop a deep neural network (DNN) model that predicts biological age from optical coherence tomography (OCT). A total of 84,753 high-quality OCT images from 53,159 individuals in the UK Biobank were included, among which 12,631 3D-OCT images from 8,541 participants without any reported medical conditions at baseline were used to develop an age prediction model. For the remaining 44,618 participants, OCT age gap, the difference between the OCT-predicted age and chronological age, was calculated for each participant. Cox regression models assessed the association between OCT age gap and mortality. The DNN model predicted age with a mean absolute error of 3.27 years and showed a strong correlation of 0.85 with chronological age. After a median follow-up of 11.0 years (IQR 10.9-11.1 years), 2,429 deaths (5.44%) were recorded. For each 5-year increase in OCT age gap, there was an 8% increased mortality risk (hazard ratio [HR] = 1.08, CI:1.02-1.13, P = 0.004). Compared with an OCT age gap within ± 4 years, OCT age gap less than minus 4 years was associated with a 16% decreased mortality risk (HR = 0.84, CI: 0.75-0.94, P = 0.002) and OCT age gap more than 4 years showed an 18% increased risk of death incidence (HR = 1.18, CI: 1.02-1.37, P = 0.026). OCT imaging could serve as an ageing biomarker to predict biological age with high accuracy and the OCT age gap, defined as the difference between the OCT-predicted age and chronological age, can be used as a marker of the risk of mortality.

Optical coherence tomography as a potential surrogate marker of dopaminergic modulation across the life span

The retina has been considered a "window to the brain" and shares similar innervation by the dopaminergic system with the cortex in terms of an unequal distribution of D1 and D2 receptors. Here, we provide a comprehensive overview that Optical Coherence Tomography (OCT), a non-invasive imaging technique, which provides an "in vivo" representation of the retina, shows promise to be used as a surrogate marker of dopaminergic neuromodulation in cognition. Overall, most evidence supports reduced retinal thickness in individuals with dopaminergic dysregulation (e.g., patients with Parkinson's Disease, non-demented older adults) and with poor cognitive functioning. By using the theoretical framework of metacontrol, we derive hypotheses that retinal thinning associated to decreased dopamine (DA) levels affecting D1 families, might lead to a decrease in the signal-to-noise ratio (SNR) affecting cognitive persistence (depending on D1-modulated DA activity) but not cognitive flexibility (depending on D2-modulated DA activity). We argue that the use of OCT parameters might not only be an insightful for cognitive neuroscience research, but also a potentially effective tool for individualized medicine with a focus on cognition. As our society progressively ages in the forthcoming years and decades, the preservation of cognitive abilities and promoting healthy aging will hold of crucial significance. OCT has the potential to function as a swift, non-invasive, and economical method for promptly recognizing individuals with a heightened vulnerability to cognitive deterioration throughout all stages of life.

eXplainable Artificial Intelligence (XAI) in aging clock models

XAI is a rapidly progressing field of machine learning, aiming to unravel the predictions of complex models. XAI is especially required in sensitive applications, e.g. in health care, when diagnosis, recommendations and treatment choices might rely on the decisions made by artificial intelligence systems. AI approaches have become widely used in aging research as well, in particular, in developing biological clock models and identifying biomarkers of aging and age-related diseases. However, the potential of XAI here awaits to be fully appreciated. We discuss the application of XAI for developing the "aging clocks" and present a comprehensive analysis of the literature categorized by the focus on particular physiological systems.

Multi-Dataset Comparison of Vision Transformers and Convolutional Neural Networks for Detecting Glaucomatous Optic Neuropathy from Fundus Photographs

Glaucomatous optic neuropathy (GON) can be diagnosed and monitored using fundus photography, a widely available and low-cost approach already adopted for automated screening of ophthalmic diseases such as diabetic retinopathy. Despite this, the lack of validated early screening approaches remains a major obstacle in the prevention of glaucoma-related blindness. Deep learning models have gained significant interest as potential solutions, as these models offer objective and high-throughput methods for processing image-based medical data. While convolutional neural networks (CNN) have been widely utilized for these purposes, more recent advances in the application of Transformer architectures have led to new models, including Vision Transformer (ViT,) that have shown promise in many domains of image analysis. However, previous comparisons of these two architectures have not sufficiently compared models side-by-side with more than a single dataset, making it unclear which model is more generalizable or performs better in different clinical contexts. Our purpose is to investigate comparable ViT and CNN models tasked with GON detection from fundus photos and highlight their respective strengths and weaknesses. We train CNN and ViT models on six unrelated, publicly available databases and compare their performance using well-established statistics including AUC, sensitivity, and specificity. Our results indicate that ViT models often show superior performance when compared with a similarly trained CNN model, particularly when non-glaucomatous images are over-represented in a given dataset. We discuss the clinical implications of these findings and suggest that ViT can further the development of accurate and scalable GON detection for this leading cause of irreversible blindness worldwide.

A Deep Learning Approach to Predict Chronological Age

Recently, researchers have turned their focus to predicting the age of people since numerous applications depend on facial recognition approaches. In the medical field, Alzheimer's disease mainly depends on patients' ages. Multiple methods have been implemented and developed to predict age. However, these approaches lack accuracy because every image has unique features, such as shape, pose, and scale. In Saudi Arabia, Vision 2030, concerning the quality of life, is one of the twelve initiatives that were launched recently. The health sector has gained increasing attention as the government has introduced age-based policies to improve the health of its elderly residents. These residents are urgently advised to vaccinate against COVID-19 based on their age. In this paper, proposing a practical, consistent, and trustworthy method to predict age is presented. This method uses the color intensity of eyes and a Convolutional Neural Network (CNN) to predict age in real time based on the ensemble of CNN. A segmentation algorithm is engaged since the approach takes its input from a video stream or an image. This algorithm extracts data from one of the essential parts of the face: the eyes. This part is also informative. Several experiments have been conducted on MATLAB to verify and validate results and relative errors. A Kaggle website dataset is utilized for ages 4 to 59. This dataset includes over 270,000 images, and its size is roughly 2 GB. Consequently, the proposed approach produces ±8.69 years of Mean Square Error (MSE) for the predicted ages. Lastly, a comparative evaluation of relevant studies and the presented algorithm in terms of accuracy, MSE, and Mean Absolute Error (MAE) is also provided. This evaluation shows that the approach developed in the current study outperforms all considered performance metrics since its accuracy is 97.29%. This study found that the color intensity of eyes is highly effective in predicting age, given the high accuracy and acceptable MSE and MAE results. This indicates that it is helpful to utilize this methodology in real-life applications.

Application of Deep Learning to Retinal-Image-Based Oculomics for Evaluation of Systemic Health: A Review

The retina is a window to the human body. Oculomics is the study of the correlations between ophthalmic biomarkers and systemic health or disease states. Deep learning (DL) is currently the cutting-edge machine learning technique for medical image analysis, and in recent years, DL techniques have been applied to analyze retinal images in oculomics studies. In this review, we summarized oculomics studies that used DL models to analyze retinal images-most of the published studies to date involved color fundus photographs, while others focused on optical coherence tomography images. These studies showed that some systemic variables, such as age, sex and cardiovascular disease events, could be consistently robustly predicted, while other variables, such as thyroid function and blood cell count, could not be. DL-based oculomics has demonstrated fascinating, "super-human" predictive capabilities in certain contexts, but it remains to be seen how these models will be incorporated into clinical care and whether management decisions influenced by these models will lead to improved clinical outcomes.

Federated Learning in Ocular Imaging: Current Progress and Future Direction

Advances in artificial intelligence deep learning (DL) have made tremendous impacts on the field of ocular imaging over the last few years. Specifically, DL has been utilised to detect and classify various ocular diseases on retinal photographs, optical coherence tomography (OCT) images, and OCT-angiography images. In order to achieve good robustness and generalisability of model performance, DL training strategies traditionally require extensive and diverse training datasets from various sites to be transferred and pooled into a "centralised location". However, such a data transferring process could raise practical concerns related to data security and patient privacy. Federated learning (FL) is a distributed collaborative learning paradigm which enables the coordination of multiple collaborators without the need for sharing confidential data. This distributed training approach has great potential to ensure data privacy among different institutions and reduce the potential risk of data leakage from data pooling or centralisation. This review article aims to introduce the concept of FL, provide current evidence of FL in ocular imaging, and discuss potential challenges as well as future applications.

Deep learning and optical coherence tomography in glaucoma: Bridging the diagnostic gap on structural imaging

Glaucoma is a leading cause of progressive blindness and visual impairment worldwide. Microstructural evidence of glaucomatous damage to the optic nerve head and associated tissues can be visualized using optical coherence tomography (OCT). In recent years, development of novel deep learning (DL) algorithms has led to innovative advances and improvements in automated detection of glaucomatous damage and progression on OCT imaging. DL algorithms have also been trained utilizing OCT data to improve detection of glaucomatous damage on fundus photography, thus improving the potential utility of color photos which can be more easily collected in a wider range of clinical and screening settings. This review highlights ten years of contributions to glaucoma detection through advances in deep learning models trained utilizing OCT structural data and posits future directions for translation of these discoveries into the field of aging and the basic sciences.