Automated arteriole and venule classification using deep learning for retinal images from the UK Biobank cohort

Differential artery-vein analysis improves the OCTA classification of diabetic retinopathy

This study investigates the impact of differential artery-vein (AV) analysis in optical coherence tomography angiography (OCTA) on machine learning classification of diabetic retinopathy (DR). Leveraging deep learning for arterial-venous area (AVA) segmentation, six quantitative features, including perfusion intensity density (PID), blood vessel density (BVD), vessel area flux (VAF), blood vessel caliber (BVC), blood vessel tortuosity (BVT), and vessel perimeter index (VPI) features, were derived from OCTA images before and after AV differentiation. A support vector machine (SVM) classifier was utilized to assess both binary and multiclass classifications of control, diabetic patients without DR (NoDR), mild DR, moderate DR, and severe DR groups. Initially, one-region features, i.e., quantitative features extracted from the entire OCTA, were evaluated for DR classification. Differential AV analysis improved classification accuracies from 78.86% to 87.63% and from 79.62% to 85.66% for binary and multiclass classifications, respectively. Additionally, three-region features derived from the entire image, parafovea, and perifovea, were incorporated for DR classification. Differential AV analysis further enhanced classification accuracies from 84.43% to 93.33% and from 83.40% to 89.25% for binary and multiclass classifications, respectively. These findings highlight the potential of differential AV analysis in augmenting disease diagnosis and treatment assessment using OCTA.

Deep Learning based Retinal Vessel Caliber Measurement and the Association with Hypertension

PURPOSE

To develop a highly efficient and fully automated method that measures retinal vessel caliber using digital retinal photographs and evaluate the association between retinal vessel caliber and hypertension.

METHODS

The subjects of this study were from two sources in Beijing, China, a hypertension case-control study from Tongren Hospital (Tongren study) and a community-based atherosclerosis cohort from Peking University First Hospital (Shougang study). Retinal vessel segmentation and arteriovenous classification were achieved simultaneously by a customized deep learning model. Two experienced ophthalmologists evaluated whether retinal vessels were correctly segmented and classified. The ratio of incorrectly segmented and classified retinal vessels was used to measure the accuracy of the model's recognition. Central retinal artery equivalents, central retinal vein equivalents and arteriolar-to-venular diameter ratio were computed to analyze the association between retinal vessel caliber and the risk of hypertension. The association was then compared to that derived from the widely used semi-automated software (Integrative Vessel Analysis).

RESULTS

The deep learning model achieved an arterial recognition error rate of 1.26%, a vein recognition error rate of 0.79%, and a total error rate of 1.03%. Central retinal artery equivalents and arteriolar-to-venular diameter ratio measured by both Integrative Vessel Analysis and deep learning methods were inversely associated with the odds of hypertension in both Tongren and Shougang studies. The comparisons of areas under the receiver operating characteristic curves from the proposed deep learning method and Integrative Vessel Analysis were all not significantly different (p > .05).

CONCLUSION

The proposed deep learning method showed a comparable diagnostic value to Integrative Vessel Analysis software. Compared with semi-automatic software, our deep learning model has significant advantage in efficiency and can be applied to population screening and risk evaluation.

LUNet: deep learning for the segmentation of arterioles and venules in high resolution fundus images

Objective.This study aims to automate the segmentation of retinal arterioles and venules (A/V) from digital fundus images (DFI), as changes in the spatial distribution of retinal microvasculature are indicative of cardiovascular diseases, positioning the eyes as windows to cardiovascular health.Approach.We utilized active learning to create a new DFI dataset with 240 crowd-sourced manual A/V segmentations performed by 15 medical students and reviewed by an ophthalmologist. We then developed LUNet, a novel deep learning architecture optimized for high-resolution A/V segmentation. The LUNet model features a double dilated convolutional block to widen the receptive field and reduce parameter count, alongside a high-resolution tail to refine segmentation details. A custom loss function was designed to prioritize the continuity of blood vessel segmentation.Main Results.LUNet significantly outperformed three benchmark A/V segmentation algorithms both on a local test set and on four external test sets that simulated variations in ethnicity, comorbidities and annotators.Significance.The release of the new datasets and the LUNet model (www.aimlab-technion.com/lirot-ai) provides a valuable resource for the advancement of retinal microvasculature analysis. The improvements in A/V segmentation accuracy highlight LUNet's potential as a robust tool for diagnosing and understanding cardiovascular diseases through retinal imaging.

Automatic artery/vein classification methods for retinal blood vessel: A review

Automatic retinal arteriovenous classification can assist ophthalmologists in disease early diagnosis. Deep learning-based methods and topological graph-based methods have become the main solutions for retinal arteriovenous classification in recent years. This paper reviews the automatic retinal arteriovenous classification methods from 2003 to 2022. Firstly, we compare different methods and provide comparison tables of the summary results. Secondly, we complete the classification of the public arteriovenous classification datasets and provide the annotation development tables of different datasets. Finally, we sort out the challenges of evaluation methods and provide a comprehensive evaluation system. Quantitative and qualitative analysis shows the changes in research hotspots over time, Quantitative and qualitative analyses reveal the evolution of research hotspots over time, highlighting the significance of exploring the integration of deep learning with topological information in future research.

CF-Loss: Clinically-relevant feature optimised loss function for retinal multi-class vessel segmentation and vascular feature measurement

Characterising clinically-relevant vascular features, such as vessel density and fractal dimension, can benefit biomarker discovery and disease diagnosis for both ophthalmic and systemic diseases. In this work, we explicitly encode vascular features into an end-to-end loss function for multi-class vessel segmentation, categorising pixels into artery, vein, uncertain pixels, and background. This clinically-relevant feature optimised loss function (CF-Loss) regulates networks to segment accurate multi-class vessel maps that produce precise vascular features. Our experiments first verify that CF-Loss significantly improves both multi-class vessel segmentation and vascular feature estimation, with two standard segmentation networks, on three publicly available datasets. We reveal that pixel-based segmentation performance is not always positively correlated with accuracy of vascular features, thus highlighting the importance of optimising vascular features directly via CF-Loss. Finally, we show that improved vascular features from CF-Loss, as biomarkers, can yield quantitative improvements in the prediction of ischaemic stroke, a real-world clinical downstream task. The code is available at https://github.com/rmaphoh/feature-loss.

HDR-EfficientNet: A Classification of Hypertensive and Diabetic Retinopathy Using Optimize EfficientNet Architecture

Hypertensive retinopathy (HR) and diabetic retinopathy (DR) are retinal diseases closely associated with high blood pressure. The severity and duration of hypertension directly impact the prevalence of HR. The early identification and assessment of HR are crucial to preventing blindness. Currently, limited computer-aided methods are available for detecting HR and DR. These existing systems rely on traditional machine learning approaches, which require complex image processing techniques and are often limited in their application. To address this challenge, this work introduces a deep learning (DL) method called HDR-EfficientNet, which aims to provide an efficient and accurate approach to identifying various eye-related disorders, including diabetes and hypertensive retinopathy. The proposed method utilizes an EfficientNet-V2 network for end-to-end training focused on disease classification. Additionally, a spatial-channel attention method is incorporated into the approach to enhance its ability to identify specific areas of damage and differentiate between different illnesses. The HDR-EfficientNet model is developed using transfer learning, which helps overcome the challenge of imbalanced sample classes and improves the network's generalization. Dense layers are added to the model structure to enhance the feature selection capacity. The performance of the implemented system is evaluated using a large dataset of over 36,000 augmented retinal fundus images. The results demonstrate promising accuracy, with an average area under the curve (AUC) of 0.98, a specificity (SP) of 96%, an accuracy (ACC) of 98%, and a sensitivity (SE) of 95%. These findings indicate the effectiveness of the suggested HDR-EfficientNet classifier in diagnosing HR and DR. In summary, the HDR-EfficientNet method presents a DL-based approach that offers improved accuracy and efficiency for the detection and classification of HR and DR, providing valuable support in diagnosing and managing these eye-related conditions.

Computer-aided diagnostic system for hypertensive retinopathy: A review

Hypertensive Retinopathy (HR) is a retinal disease caused by elevated blood pressure for a prolonged period. There are no obvious signs in the early stages of high blood pressure, but it affects various body parts over time, including the eyes. HR is a biomarker for several illnesses, including retinal diseases, atherosclerosis, strokes, kidney disease, and cardiovascular risks. Early microcirculation abnormalities in chronic diseases can be diagnosed through retinal examination prior to the onset of major clinical consequences. Computer-aided diagnosis (CAD) plays a vital role in the early identification of HR with improved diagnostic accuracy, which is time-efficient and demands fewer resources. Recently, numerous studies have been reported on the automatic identification of HR. This paper provides a comprehensive review of the automated tasks of Artery-Vein (A/V) classification, Arteriovenous ratio (AVR) computation, HR detection (Binary classification), and HR severity grading. The review is conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol. The paper discusses the clinical features of HR, the availability of datasets, existing methods used for A/V classification, AVR computation, HR detection, and severity grading, and performance evaluation metrics. The reviewed articles are summarized with classifiers details, adoption of different kinds of methodologies, performance comparisons, datasets details, their pros and cons, and computational platform. For each task, a summary and critical in-depth analysis are provided, as well as common research issues and challenges in the existing studies. Finally, the paper proposes future research directions to overcome challenges associated with data set availability, HR detection, and severity grading.

Automated analysis of vessel morphometry in retinal images from a Danish high street optician setting

PURPOSE

To evaluate the test performance of the QUARTZ (QUantitative Analysis of Retinal vessel Topology and siZe) software in detecting retinal features from retinal images captured by health care professionals in a Danish high street optician chain, compared with test performance from other large population studies (i.e., UK Biobank) where retinal images were captured by non-experts.

METHOD

The dataset FOREVERP (Finding Ophthalmic Risk and Evaluating the Value of Eye exams and their predictive Reliability, Pilot) contains retinal images obtained from a Danish high street optician chain. The QUARTZ algorithm utilizes both image processing and machine learning methods to determine retinal image quality, vessel segmentation, vessel width, vessel classification (arterioles or venules), and optic disc localization. Outcomes were evaluated by metrics including sensitivity, specificity, and accuracy and compared to human expert ground truths.

RESULTS

QUARTZ's performance was evaluated on a subset of 3,682 images from the FOREVERP database. 80.55% of the FOREVERP images were labelled as being of adequate quality compared to 71.53% of UK Biobank images, with a vessel segmentation sensitivity of 74.64% and specificity of 98.41% (FOREVERP) compared with a sensitivity of 69.12% and specificity of 98.88% (UK Biobank). The mean (± standard deviation) vessel width of the ground truth was 16.21 (4.73) pixels compared to that predicted by QUARTZ of 17.01 (4.49) pixels, resulting in a difference of -0.8 (1.96) pixels. The differences were stable across a range of vessels. The detection rate for optic disc localisation was similar for the two datasets.

CONCLUSION

QUARTZ showed high performance when evaluated on the FOREVERP dataset, and demonstrated robustness across datasets, providing validity to direct comparisons and pooling of retinal feature measures across data sources.

Cohort profile: rationale and methods of UK Biobank repeat imaging study eye measures to study dementia

PURPOSE

The retina provides biomarkers of neuronal and vascular health that offer promising insights into cognitive ageing, mild cognitive impairment and dementia. This article described the rationale and methodology of eye and vision assessments with the aim of supporting the study of dementia in the UK Biobank Repeat Imaging study.

PARTICIPANTS

UK Biobank is a large-scale, multicentre, prospective cohort containing in-depth genetic, lifestyle, environmental and health information from half a million participants aged 40-69 enrolled in 2006-2010 across the UK. A subset (up to 60 000 participants) of the cohort will be invited to the UK Biobank Repeat Imaging Study to collect repeated brain, cardiac and abdominal MRI scans, whole-body dual-energy X-ray absorptiometry, carotid ultrasound, as well as retinal optical coherence tomography (OCT) and colour fundus photographs.

FINDINGS TO DATE

UK Biobank has helped make significant advances in understanding risk factors for many common diseases, including for dementia and cognitive decline. Ophthalmic genetic and epidemiology studies have also benefited from the unparalleled combination of very large numbers of participants, deep phenotyping and longitudinal follow-up of the cohort, with comprehensive health data linkage to disease outcomes. In addition, we have used UK Biobank data to describe the relationship between retinal structures, cognitive function and brain MRI-derived phenotypes.

FUTURE PLANS

The collection of eye-related data (eg, OCT), as part of the UK Biobank Repeat Imaging study, will take place in 2022-2028. The depth and breadth and longitudinal nature of this dataset, coupled with its open-access policy, will create a major new resource for dementia diagnostic discovery and to better understand its association with comorbid diseases. In addition, the broad and diverse data available in this study will support research into ophthalmic diseases and various other health outcomes beyond dementia.

An open-source deep learning network AVA-Net for arterial-venous area segmentation in optical coherence tomography angiography

BACKGROUND

Differential artery-vein (AV) analysis in optical coherence tomography angiography (OCTA) holds promise for the early detection of eye diseases. However, currently available methods for AV analysis are limited for binary processing of retinal vasculature in OCTA, without quantitative information of vascular perfusion intensity. This study is to develop and validate a method for quantitative AV analysis of vascular perfusion intensity.

METHOD

A deep learning network AVA-Net has been developed for automated AV area (AVA) segmentation in OCTA. Seven new OCTA features, including arterial area (AA), venous area (VA), AVA ratio (AVAR), total perfusion intensity density (T-PID), arterial PID (A-PID), venous PID (V-PID), and arterial-venous PID ratio (AV-PIDR), were extracted and tested for early detection of diabetic retinopathy (DR). Each of these seven features was evaluated for quantitative evaluation of OCTA images from healthy controls, diabetic patients without DR (NoDR), and mild DR.

RESULTS

It was observed that the area features, i.e., AA, VA and AVAR, can reveal significant differences between the control and mild DR. Vascular perfusion parameters, including T-PID and A-PID, can differentiate mild DR from control group. AV-PIDR can disclose significant differences among all three groups, i.e., control, NoDR, and mild DR. According to Bonferroni correction, the combination of A-PID and AV-PIDR can reveal significant differences in all three groups.

CONCLUSIONS

AVA-Net, which is available on GitHub for open access, enables quantitative AV analysis of AV area and vascular perfusion intensity. Comparative analysis revealed AV-PIDR as the most sensitive feature for OCTA detection of early DR. Ensemble AV feature analysis, e.g., the combination of A-PID and AV-PIDR, can further improve the performance for early DR assessment.

Using Artificial Intelligence to Analyse the Retinal Vascular Network: The Future of Cardiovascular Risk Assessment Based on Oculomics? A Narrative Review

The healthcare burden of cardiovascular diseases remains a major issue worldwide. Understanding the underlying mechanisms and improving identification of people with a higher risk profile of systemic vascular disease through noninvasive examinations is crucial. In ophthalmology, retinal vascular network imaging is simple and noninvasive and can provide in vivo information of the microstructure and vascular health. For more than 10 years, different research teams have been working on developing software to enable automatic analysis of the retinal vascular network from different imaging techniques (retinal fundus photographs, OCT angiography, adaptive optics, etc.) and to provide a description of the geometric characteristics of its arterial and venous components. Thus, the structure of retinal vessels could be considered a witness of the systemic vascular status. A new approach called "oculomics" using retinal image datasets and artificial intelligence algorithms recently increased the interest in retinal microvascular biomarkers. Despite the large volume of associated research, the role of retinal biomarkers in the screening, monitoring, or prediction of systemic vascular disease remains uncertain. A PubMed search was conducted until August 2022 and yielded relevant peer-reviewed articles based on a set of inclusion criteria. This literature review is intended to summarize the state of the art in oculomics and cardiovascular disease research.

End-to-End Automatic Classification of Retinal Vessel Based on Generative Adversarial Networks with Improved U-Net

The retinal vessels in the human body are the only ones that can be observed directly by non-invasive imaging techniques. Retinal vessel morphology and structure are the important objects of concern for physicians in the early diagnosis and treatment of related diseases. The classification of retinal vessels has important guiding significance in the basic stage of diagnostic treatment. This paper proposes a novel method based on generative adversarial networks with improved U-Net, which can achieve synchronous automatic segmentation and classification of blood vessels by an end-to-end network. The proposed method avoids the dependency of the segmentation results in the multiple classification tasks. Moreover, the proposed method builds on an accurate classification of arteries and veins while also classifying arteriovenous crossings. The validity of the proposed method is evaluated on the RITE dataset: the accuracy of image comprehensive classification reaches 96.87%. The sensitivity and specificity of arteriovenous classification reach 91.78% and 97.25%. The results verify the effectiveness of the proposed method and show the competitive classification performance.

GWAS on retinal vasculometry phenotypes

The eye is the window through which light is transmitted and visual sensory signalling originates. It is also a window through which elements of the cardiovascular and nervous systems can be directly inspected, using ophthalmoscopy or retinal imaging. Measurements of ocular parameters may therefore offer important information on the physiology and homeostasis of these two important systems. Here we report the results of a genetic characterisation of retinal vasculature. Four genome-wide association studies performed on different aspects of retinal vasculometry phenotypes, such as arteriolar and venular tortuosity and width, found significant similarities between retinal vascular characteristics and cardiometabolic health. Our analyses identified 119 different regions of association with traits of retinal vasculature, including 89 loci associated arteriolar tortuosity, the strongest of which was rs35131825 (p = 2.00×10-108), 2 loci with arteriolar width (rs12969347, p = 3.30×10-09 and rs5442, p = 1.9E-15), 17 other loci associated with venular tortuosity and 11 novel associations with venular width. Our causal inference analyses also found that factors linked to arteriolar tortuosity cause elevated diastolic blood pressure and not vice versa.

Artificial intelligence-enabled retinal vasculometry for prediction of circulatory mortality, myocardial infarction and stroke

AIMS

We examine whether inclusion of artificial intelligence (AI)-enabled retinal vasculometry (RV) improves existing risk algorithms for incident stroke, myocardial infarction (MI) and circulatory mortality.

METHODS

AI-enabled retinal vessel image analysis processed images from 88 052 UK Biobank (UKB) participants (aged 40-69 years at image capture) and 7411 European Prospective Investigation into Cancer (EPIC)-Norfolk participants (aged 48-92). Retinal arteriolar and venular width, tortuosity and area were extracted. Prediction models were developed in UKB using multivariable Cox proportional hazards regression for circulatory mortality, incident stroke and MI, and externally validated in EPIC-Norfolk. Model performance was assessed using optimism adjusted calibration, C-statistics and R² statistics. Performance of Framingham risk scores (FRS) for incident stroke and incident MI, with addition of RV to FRS, were compared with a simpler model based on RV, age, smoking status and medical history (antihypertensive/cholesterol lowering medication, diabetes, prevalent stroke/MI).

RESULTS

UKB prognostic models were developed on 65 144 participants (mean age 56.8; median follow-up 7.7 years) and validated in 5862 EPIC-Norfolk participants (67.6, 9.1 years, respectively). Prediction models for circulatory mortality in men and women had optimism adjusted C-statistics and R² statistics between 0.75-0.77 and 0.33-0.44, respectively. For incident stroke and MI, addition of RV to FRS did not improve model performance in either cohort. However, the simpler RV model performed equally or better than FRS.

CONCLUSION

RV offers an alternative predictive biomarker to traditional risk-scores for vascular health, without the need for blood sampling or blood pressure measurement. Further work is needed to examine RV in population screening to triage individuals at high-risk.

MSGANet-RAV: A multiscale guided attention network for artery-vein segmentation and classification from optic disc and retinal images

BACKGROUND

Retinal and optic disc images are used to assess changes in the retinal vasculature. These can be changes associated with diseases such as diabetic retinopathy and glaucoma or induced using ophthalmodynamometry to measure arterial and venous pressure. Key steps toward automating the assessment of these changes are the segmentation and classification of the veins and arteries. However, such segmentation and classification are still required to be manually labelled by experts. Such automated labelling is challenging because of the complex morphology, anatomical variations, alterations due to disease and scarcity of labelled data for algorithm development. We present a deep machine learning solution called the multiscale guided attention network for retinal artery and vein segmentation and classification (MSGANet-RAV).

METHODS

MSGANet-RAV was developed and tested on 383 colour clinical optic disc images from LEI-CENTRAL, constructed in-house and 40 colour fundus images from the AV-DRIVE public dataset. The datasets have a mean optic disc occupancy per image of 60.6% and 2.18%, respectively. MSGANet-RAV is a U-shaped encoder-decoder network, where the encoder extracts multiscale features, and the decoder includes a sequence of self-attention modules. The self-attention modules explore, guide and incorporate vessel-specific structural and contextual feature information to segment and classify central optic disc and retinal vessel pixels.

RESULTS

MSGANet-RAV achieved a pixel classification accuracy of 93.15%, sensitivity of 92.19%, and specificity of 94.13% on LEI-CENTRAL, outperforming several reference models. It similarly performed highly on AV-DRIVE with an accuracy, sensitivity and specificity of 95.48%, 93.59% and 97.27%, respectively.

CONCLUSION

The results show the efficacy of MSGANet-RAV for identifying central optic disc and retinal arteries and veins. The method can be used in automated systems designed to assess vascular changes in retinal and optic disc images quantitatively.

Local-Sensitive Connectivity Filter (LS-CF): A Post-Processing Unsupervised Improvement of the Frangi, Hessian and Vesselness Filters for Multimodal Vessel Segmentation

A retinal vessel analysis is a procedure that can be used as an assessment of risks to the eye. This work proposes an unsupervised multimodal approach that improves the response of the Frangi filter, enabling automatic vessel segmentation. We propose a filter that computes pixel-level vessel continuity while introducing a local tolerance heuristic to fill in vessel discontinuities produced by the Frangi response. This proposal, called the local-sensitive connectivity filter (LS-CF), is compared against a naive connectivity filter to the baseline thresholded Frangi filter response and to the naive connectivity filter response in combination with the morphological closing and to the current approaches in the literature. The proposal was able to achieve competitive results in a variety of multimodal datasets. It was robust enough to outperform all the state-of-the-art approaches in the literature for the OSIRIX angiographic dataset in terms of accuracy and 4 out of 5 works in the case of the IOSTAR dataset while also outperforming several works in the case of the DRIVE and STARE datasets and 6 out of 10 in the CHASE-DB dataset. For the CHASE-DB, it also outperformed all the state-of-the-art unsupervised methods.

Retinal microvascular associations with cardiometabolic risk factors differ by diabetes status: results from the UK Biobank

AIMS/HYPOTHESIS

The aim of the study was to examine the association of retinal vessel morphometry with BP, body composition and biochemistry, and to determine whether these associations differ by diabetes status.

METHODS

The UK Biobank ocular assessment included 68,550 participants aged 40-70 years who underwent non-mydriatic retinal photography, BP and body composition measurements, and haematological analysis. A fully automated image analysis program provided measurements of retinal vessel diameter and tortuosity. The associations between retinal vessel morphology and cardiometabolic risk factors by diabetes status were examined using multilevel linear regression, to provide absolute differences in vessel diameter and percentage differences in tortuosity (allowing for within-person clustering).

RESULTS

A total of 50,233 participants (a reduction from 68,550) were included in these analyses. Overall, those with diabetes had significantly more tortuous venules and wider arteriolar diameters compared with those without. Associations between venular tortuosity and cardiometabolic risk factors differed according to diabetes status (p interaction <0.01) for total fat mass index, HbA_1c, C-reactive protein, white cell count and granulocyte count. For example, a unit rise in white cell count was associated with a 0.18% increase (95% CI 0.05, 0.32%) in venular tortuosity for those without diabetes and a 1.48% increase (95% CI 0.90, 2.07%) among those with diabetes. For arteriolar diameter, significant interactions were evident for systolic BP, diastolic BP, mean arterial pressure (MAP) and LDL-cholesterol. For example, a 10 mmHg rise in systolic BP was associated with a -0.92 μm difference (95% CI -0.96 to -0.88 μm) in arteriolar diameter for those without diabetes, and a -0.58 μm difference (95% CI -0.76 to -0.41 μm) among those with diabetes. No interactions were observed for arteriolar tortuosity or venular diameters.

CONCLUSIONS/INTERPRETATION

We provide clear evidence of the modifying effect of diabetes on cardiometabolic risk factor associations with retinal microvascular architecture. These observations suggest the occurrence of preclinical disease processes, and may be a sign of impaired autoregulation due to hyperglycaemia, which has been suggested to play a pivotal role in the development of diabetes-related microvascular complications.

DATA AVAILABILITY

The data supporting the results reported here are available through the UK Biobank ( https://www.ukbiobank.ac.uk/enable-your-research/apply-for-access ).

MF-AV-Net: an open-source deep learning network with multimodal fusion options for artery-vein segmentation in OCT angiography

This study is to demonstrate the effect of multimodal fusion on the performance of deep learning artery-vein (AV) segmentation in optical coherence tomography (OCT) and OCT angiography (OCTA); and to explore OCT/OCTA characteristics used in the deep learning AV segmentation. We quantitatively evaluated multimodal architectures with early and late OCT-OCTA fusions, compared to the unimodal architectures with OCT-only and OCTA-only inputs. The OCTA-only architecture, early OCT-OCTA fusion architecture, and late OCT-OCTA fusion architecture yielded competitive performances. For the 6 mm×6 mm and 3 mm×3 mm datasets, the late fusion architecture achieved an overall accuracy of 96.02% and 94.00%, slightly better than the OCTA-only architecture which achieved an overall accuracy of 95.76% and 93.79%. 6 mm×6 mm OCTA images show AV information at pre-capillary level structure, while 3 mm×3 mm OCTA images reveal AV information at capillary level detail. In order to interpret the deep learning performance, saliency maps were produced to identify OCT/OCTA image characteristics for AV segmentation. Comparative OCT and OCTA saliency maps support the capillary-free zone as one of the possible features for AV segmentation in OCTA. The deep learning network MF-AV-Net used in this study is available on GitHub for open access.

Multi-scale Interactive Network with Artery/Vein Discriminator for Retinal Vessel Classification

Automatic classification of retinal arteries and veins plays an important role in assisting clinicians to diagnosis cardiovascular and eye-related diseases. However, due to the high degree of anatomical variation across the population, and the presence of inconsistent labels by the subjective judgment of annotators in available training data, most of existing methods generally suffer from blood vessel discontinuity and arteriovenous confusion, the artery/vein (A/V) classification task still faces great challenges. In this work, we propose a multi-scale interactive network with A/V discriminator for retinal artery and vein recognition, which can reduce the arteriovenous confusion and alleviate the disturbance of noisy label. A multi-scale interaction (MI) module is designed in encoder for realizing the cross-space multi-scale features interaction of fundus images, effectively integrate high-level and low-level context information. In particular, we design an ingenious A/V discriminator (AVD) that utilizes the independent and shared information between arteries and veins, and combine with topology loss, to further strengthen the learning ability of model to resolve the arteriovenous confusion. In addition, we adopt a sample re-weighting (SW) strategy to effectively alleviate the disturbance from data labeling errors. The proposed model is verified on three publicly available fundus image datasets (AV-DRIVE, HRF, LES-AV) and a private dataset. We achieve the accuracy of 97.47%, 96.91%, 97.79%, and 98.18% respectively on these four datasets. Extensive experimental results demonstrate that our method achieves competitive performance compared with state-of-the-art methods for A/V classification. To address the problem of training data scarcity, we publicly release 100 fundus images with A/V annotations to promote relevant research in the community.

RAVIR: A Dataset and Methodology for the Semantic Segmentation and Quantitative Analysis of Retinal Arteries and Veins in Infrared Reflectance Imaging

The retinal vasculature provides important clues in the diagnosis and monitoring of systemic diseases including hypertension and diabetes. The microvascular system is of primary involvement in such conditions, and the retina is the only anatomical site where the microvasculature can be directly observed. The objective assessment of retinal vessels has long been considered a surrogate biomarker for systemic vascular diseases, and with recent advancements in retinal imaging and computer vision technologies, this topic has become the subject of renewed attention. In this paper, we present a novel dataset, dubbed RAVIR, for the semantic segmentation of Retinal Arteries and Veins in Infrared Reflectance (IR) imaging. It enables the creation of deep learning-based models that distinguish extracted vessel type without extensive post-processing. We propose a novel deep learning-based methodology, denoted as SegRAVIR, for the semantic segmentation of retinal arteries and veins and the quantitative measurement of the widths of segmented vessels. Our extensive experiments validate the effectiveness of SegRAVIR and demonstrate its superior performance in comparison to state-of-the-art models. Additionally, we propose a knowledge distillation framework for the domain adaptation of RAVIR pretrained networks on color images. We demonstrate that our pretraining procedure yields new state-of-the-art benchmarks on the DRIVE, STARE, and CHASE\_DB1 datasets. Dataset link: https://ravirdataset.github.io/data.

Improving U-Net architecture and graph cuts optimization to classify arterioles and venules in retina fundus images

The central retinal artery and its branches supply blood to the inner retina. Vascular manifestations in the retina indirectly reflect the vascular changes and damage in organs such as the heart, kidneys, and brain because of the similar vascular structure of these organs. The diabetic retinopathy and risk of stroke are caused by increased venular caliber. The degrees of these diseases depend on the changes of arterioles and venules. The ratio between the calibers of arterioles and venules (AVR) is various. AVR is considered as the useful diagnostic indicator of different associated health problems. However, the task is not easy because of the lack of information of the features being used to classify the retinal vessels as arterioles and venules. This paper proposed a method to classify the retinal vessels into the arterioles and venules based on improving U-Net architecture and graph cuts. The accuracy of the proposed method is about 97.6%. The results of the proposed method are better than the other methods in RITE dataset and AVRDB dataset.

Machine Learning-Based Automated Diagnostic Systems Developed for Heart Failure Prediction Using Different Types of Data Modalities: A Systematic Review and Future Directions

One of the leading causes of deaths around the globe is heart disease. Heart is an organ that is responsible for the supply of blood to each part of the body. Coronary artery disease (CAD) and chronic heart failure (CHF) often lead to heart attack. Traditional medical procedures (angiography) for the diagnosis of heart disease have higher cost as well as serious health concerns. Therefore, researchers have developed various automated diagnostic systems based on machine learning (ML) and data mining techniques. ML-based automated diagnostic systems provide an affordable, efficient, and reliable solutions for heart disease detection. Various ML, data mining methods, and data modalities have been utilized in the past. Many previous review papers have presented systematic reviews based on one type of data modality. This study, therefore, targets systematic review of automated diagnosis for heart disease prediction based on different types of modalities, i.e., clinical feature-based data modality, images, and ECG. Moreover, this paper critically evaluates the previous methods and presents the limitations in these methods. Finally, the article provides some future research directions in the domain of automated heart disease detection based on machine learning and multiple of data modalities.

Multithreshold Image Segmentation Technique Using Remora Optimization Algorithm for Diabetic Retinopathy Detection from Fundus Images

One of the most common complications of diabetes mellitus is diabetic retinopathy (DR), which produces lesions on the retina. A novel framework for DR detection and classification was proposed in this study. The proposed work includes four stages: pre-processing, segmentation, feature extraction, and classification. Initially, the image pre-processing is performed and after that, the Multi threshold-based Remora Optimization (MTRO) algorithm performs the vessel segmentation. The feature extraction and classification process are done by using a Region-based Convolution Neural Network (R-CNN) with Wild Geese Algorithm (WGA). Finally, the proposed R-CNN with WGA effectively classifies the different stages of DR including Non-DR, Proliferative DR, Severe, Moderate DR, Mild DR. The experimental images were collected from the DRIVE database, and the proposed framework exhibited superior DR detection performance. Compared to other existing methods like fully convolutional deep neural network (FCDNN), genetic-search feature selection (GSFS), Convolutional Neural Networks (CNN), and deep learning (DL) techniques, the proposed R-CNN with WGA provided 95.42% accuracy, 93.10% specificity, 93.20% sensitivity, and 98.28% F-score results.

Review of Machine Learning Applications Using Retinal Fundus Images

Automating screening and diagnosis in the medical field saves time and reduces the chances of misdiagnosis while saving on labor and cost for physicians. With the feasibility and development of deep learning methods, machines are now able to interpret complex features in medical data, which leads to rapid advancements in automation. Such efforts have been made in ophthalmology to analyze retinal images and build frameworks based on analysis for the identification of retinopathy and the assessment of its severity. This paper reviews recent state-of-the-art works utilizing the color fundus image taken from one of the imaging modalities used in ophthalmology. Specifically, the deep learning methods of automated screening and diagnosis for diabetic retinopathy (DR), age-related macular degeneration (AMD), and glaucoma are investigated. In addition, the machine learning techniques applied to the retinal vasculature extraction from the fundus image are covered. The challenges in developing these systems are also discussed.

An Automatic Detection and Classification System of Five Stages for Hypertensive Retinopathy Using Semantic and Instance Segmentation in DenseNet Architecture

The stage and duration of hypertension are connected to the occurrence of Hypertensive Retinopathy (HR) of eye disease. Currently, a few computerized systems have been developed to recognize HR by using only two stages. It is difficult to define specialized features to recognize five grades of HR. In addition, deep features have been used in the past, but the classification accuracy is not up-to-the-mark. In this research, a new hypertensive retinopathy (HYPER-RETINO) framework is developed to grade the HR based on five grades. The HYPER-RETINO system is implemented based on pre-trained HR-related lesions. To develop this HYPER-RETINO system, several steps are implemented such as a preprocessing, the detection of HR-related lesions by semantic and instance-based segmentation and a DenseNet architecture to classify the stages of HR. Overall, the HYPER-RETINO system determined the local regions within input retinal fundus images to recognize five grades of HR. On average, a 10-fold cross-validation test obtained sensitivity (SE) of 90.5%, specificity (SP) of 91.5%, accuracy (ACC) of 92.6%, precision (PR) of 91.7%, Matthews correlation coefficient (MCC) of 61%, F1-score of 92% and area-under-the-curve (AUC) of 0.915 on 1400 HR images. Thus, the applicability of the HYPER-RETINO method to reliably diagnose stages of HR is verified by experimental findings.

Simultaneous segmentation and classification of the retinal arteries and veins from color fundus images

BACKGROUND AND OBJECTIVES

The study of the retinal vasculature represents a fundamental stage in the screening and diagnosis of many high-incidence diseases, both systemic and ophthalmic. A complete retinal vascular analysis requires the segmentation of the vascular tree along with the classification of the blood vessels into arteries and veins. Early automatic methods approach these complementary segmentation and classification tasks in two sequential stages. However, currently, these two tasks are approached as a joint semantic segmentation, because the classification results highly depend on the effectiveness of the vessel segmentation. In that regard, we propose a novel approach for the simultaneous segmentation and classification of the retinal arteries and veins from eye fundus images.

METHODS

We propose a novel method that, unlike previous approaches, and thanks to the proposal of a novel loss, decomposes the joint task into three segmentation problems targeting arteries, veins and the whole vascular tree. This configuration allows to handle vessel crossings intuitively and directly provides accurate segmentation masks of the different target vascular trees.

RESULTS

The provided ablation study on the public Retinal Images vessel Tree Extraction (RITE) dataset demonstrates that the proposed method provides a satisfactory performance, particularly in the segmentation of the different structures. Furthermore, the comparison with the state of the art shows that our method achieves highly competitive results in the artery/vein classification, while significantly improving the vascular segmentation.

CONCLUSIONS

The proposed multi-segmentation method allows to detect more vessels and better segment the different structures, while achieving a competitive classification performance. Also, in these terms, our approach outperforms the approaches of various reference works. Moreover, in contrast with previous approaches, the proposed method allows to directly detect the vessel crossings, as well as preserving the continuity of both arteries and veins at these complex locations.

Automatic Artery/Vein Classification Using a Vessel-Constraint Network for Multicenter Fundus Images

Retinal blood vessel morphological abnormalities are generally associated with cardiovascular, cerebrovascular, and systemic diseases, automatic artery/vein (A/V) classification is particularly important for medical image analysis and clinical decision making. However, the current method still has some limitations in A/V classification, especially the blood vessel edge and end error problems caused by the single scale and the blurred boundary of the A/V. To alleviate these problems, in this work, we propose a vessel-constraint network (VC-Net) that utilizes the information of vessel distribution and edge to enhance A/V classification, which is a high-precision A/V classification model based on data fusion. Particularly, the VC-Net introduces a vessel-constraint (VC) module that combines local and global vessel information to generate a weight map to constrain the A/V features, which suppresses the background-prone features and enhances the edge and end features of blood vessels. In addition, the VC-Net employs a multiscale feature (MSF) module to extract blood vessel information with different scales to improve the feature extraction capability and robustness of the model. And the VC-Net can get vessel segmentation results simultaneously. The proposed method is tested on publicly available fundus image datasets with different scales, namely, DRIVE, LES, and HRF, and validated on two newly created multicenter datasets: Tongren and Kailuan. We achieve a balance accuracy of 0.9554 and F1 scores of 0.7616 and 0.7971 for the arteries and veins, respectively, on the DRIVE dataset. The experimental results prove that the proposed model achieves competitive performance in A/V classification and vessel segmentation tasks compared with state-of-the-art methods. Finally, we test the Kailuan dataset with other trained fusion datasets, the results also show good robustness. To promote research in this area, the Tongren dataset and source code will be made publicly available. The dataset and code will be made available at https://github.com/huawang123/VC-Net.

Differential artery-vein analysis in quantitative retinal imaging: a review

Quantitative retinal imaging is essential for eye disease detection, staging classification, and treatment assessment. It is known that different eye diseases or severity stages can affect the artery and vein systems in different ways. Therefore, differential artery-vein (AV) analysis can improve the performance of quantitative retinal imaging. In this article, we provide a brief summary of technical rationales and clinical applications of differential AV analysis in fundus photography, optical coherence tomography (OCT), and OCT angiography (OCTA).

Unsupervised sorting of retinal vessels using locally consistent Gaussian mixtures

BACKGROUND AND OBJECTIVES

Retinal blood vessels classification into arterioles and venules is a major task for biomarker identification. Especially, clustering of retinal blood vessels is a challenging task due to factors affecting the images such as contrast variability, non-uniform illumination etc. Hence, a high performance automatic retinal vessel classification system is highly prized. In this paper, we propose a novel unsupervised methodology to classify retinal vessels extracted from fundus camera images into arterioles and venules.

METHODS

The proposed method utilises the homomorphic filtering (HF) to preprocess the input image for non-uniform illumination and denoising. In the next step, an unsupervised multiscale line operator segmentation technique is used to segment the retinal vasculature before extracting the discriminating features. Finally, the Locally Consistent Gaussian Mixture Model (LCGMM) is utilised for unsupervised sorting of retinal vessels.

RESULTS

The performance of the proposed unsupervised method was assessed using three publicly accessible databases: INSPIRE-AVR, VICAVR, and MESSIDOR. The proposed framework achieved 90.14%,90.3% and 93.8% classification rate in zone B for the three datasets respectively.

CONCLUSIONS

The proposed clustering framework provided high classification rate as compared to conventional Gaussian mixture model using Expectation-Maximisation (GMM-EM) approach, thus have a great capability to enhance computer assisted diagnosis and research in field of biomarker discovery.

Topology-Aware Retinal Artery–Vein Classification via Deep Vascular Connectivity Prediction

Retinal artery–vein (AV) classification is a prerequisite for quantitative analysis of retinal vessels, which provides a biomarker for neurologic, cardiac, and systemic diseases, as well as ocular diseases. Although convolutional neural networks have presented remarkable performance on AV classification, it often comes with a topological error, like an abrupt class flipping on the same vessel segment or a weakness for thin vessels due to their indistinct appearances. In this paper, we present a new method for AV classification where the underlying vessel topology is estimated to give consistent prediction along the actual vessel structure. We cast the vessel topology estimation as iterative vascular connectivity prediction, which is implemented as deep-learning-based pairwise classification. In consequence, a whole vessel graph is separated into sub-trees, and each of them is classified as an artery or vein in whole via a voting scheme. The effectiveness and efficiency of the proposed method is validated by conducting experiments on two retinal image datasets acquired using different imaging techniques called DRIVE and IOSTAR.

ELEMENT: Multi-Modal Retinal Vessel Segmentation Based on a Coupled Region Growing and Machine Learning Approach

Vascular structures in the retina contain important information for the detection and analysis of ocular diseases, including age-related macular degeneration, diabetic retinopathy and glaucoma. Commonly used modalities in diagnosis of these diseases are fundus photography, scanning laser ophthalmoscope (SLO) and fluorescein angiography (FA). Typically, retinal vessel segmentation is carried out either manually or interactively, which makes it time consuming and prone to human errors. In this research, we propose a new multi-modal framework for vessel segmentation called ELEMENT (vEsseL sEgmentation using Machine lEarning and coNnecTivity). This framework consists of feature extraction and pixel-based classification using region growing and machine learning. The proposed features capture complementary evidence based on grey level and vessel connectivity properties. The latter information is seamlessly propagated through the pixels at the classification phase. ELEMENT reduces inconsistencies and speeds up the segmentation throughput. We analyze and compare the performance of the proposed approach against state-of-the-art vessel segmentation algorithms in three major groups of experiments, for each of the ocular modalities. Our method produced higher overall performance, with an overall accuracy of 97.40%, compared to 25 of the 26 state-of-the-art approaches, including six works based on deep learning, evaluated on the widely known DRIVE fundus image dataset. In the case of the STARE, CHASE-DB, VAMPIRE FA, IOSTAR SLO and RC-SLO datasets, the proposed framework outperformed all of the state-of-the-art methods with accuracies of 98.27%, 97.78%, 98.34%, 98.04% and 98.35%, respectively.

Retinal Vasculometry Associations With Glaucoma: Findings From the European Prospective Investigation of Cancer-Norfolk Eye Study

Purpose

To examine retinal vasculometry associations with different glaucomas in older British people.

Design

Cross-sectional study.

Methods

A total of 8,623 European Prospective Investigation into Cancer-Norfolk Eye study participants were examined, who underwent retinal imaging, ocular biometry assessment, and clinical ascertainment of ocular hypertensive or glaucoma status (including glaucoma suspect [GS], high-tension open-angle glaucoma [HTG], and normal-tension glaucoma [NTG]). Automated measures of arteriolar and venular tortuosity, area, and width from retinal images were obtained. MainOutcomeMeasures: Associations between glaucoma and retinal vasculometry outcomes were analyzed using multilevel linear regression, adjusted for age, sex, height, axial length, intraocular and systemic blood pressure, and within-person clustering, to provide absolute differences in width and area, and percentage differences in vessel tortuosity. Presence or absence of within-person-between-eye differences in retinal vasculometry by diagnoses were examined.

Results

A total of 565,593 vessel segments from 5,947 participants (mean age 67.6 years, SD 7.6 years, 57% women) were included; numbers with HTG, NTG, and GS in at least 1 eye were 87, 82, and 439, respectively. Thinner arterioles (−3.2 μm; 95% confidence interval [CI] −4.4 μm, −1.9 μm) and venules (−2.7 μm; 95% CI −4.9 μm, −0.5 μm) were associated with HTG. Reduced venular area was associated with HTG (−0.2 mm²; 95% CI −0.3 mm², −0.1 mm²) and NTG (−0.2 mm²; 95% CI −0.3 mm², −0.0 mm²). Less tortuous retinal arterioles and venules were associated with all glaucomas, but only significantly for GS (−3.9%; 95% CI −7.7%, −0.1% and −4.8%; 95% CI −7.4%, −2.1%, respectively). There was no evidence of within-person-between-eye differences in retinal vasculometry associations by diagnoses.

Conclusions

Retinal vessel width associations with glaucoma and novel associations with vessel area and tortuosity, together with no evidence of within-person-between-eye differences in retinal vasculometry, suggest a vascular cause of glaucoma.

•

Retinal vessel measurements, including (as a first report) vessel tortuosity and area, were associated with high-tension glaucoma and other glaucoma-related outcomes.

•

Novel analyses showing that within-person-between-eye glaucoma diagnoses, intraocular pressure, and retinal vasculometry were uncorrelated provides further evidence that systemic microvascular changes may cause glaucoma.

A review of machine learning methods for retinal blood vessel segmentation and artery/vein classification

The eye affords a unique opportunity to inspect a rich part of the human microvasculature non-invasively via retinal imaging. Retinal blood vessel segmentation and classification are prime steps for the diagnosis and risk assessment of microvascular and systemic diseases. A high volume of techniques based on deep learning have been published in recent years. In this context, we review 158 papers published between 2012 and 2020, focussing on methods based on machine and deep learning (DL) for automatic vessel segmentation and classification for fundus camera images. We divide the methods into various classes by task (segmentation or artery-vein classification), technique (supervised or unsupervised, deep and non-deep learning, hand-crafted methods) and more specific algorithms (e.g. multiscale, morphology). We discuss advantages and limitations, and include tables summarising results at-a-glance. Finally, we attempt to assess the quantitative merit of DL methods in terms of accuracy improvement compared to other methods. The results allow us to offer our views on the outlook for vessel segmentation and classification for fundus camera images.

A deep-learning system for the assessment of cardiovascular disease risk via the measurement of retinal-vessel calibre

Retinal blood vessels provide information on the risk of cardiovascular disease (CVD). Here, we report the development and validation of deep-learning models for the automated measurement of retinal-vessel calibre in retinal photographs, using diverse multiethnic multicountry datasets that comprise more than 70,000 images. Retinal-vessel calibre measured by the models and by expert human graders showed high agreement, with overall intraclass correlation coefficients of between 0.82 and 0.95. The models performed comparably to or better than expert graders in associations between measurements of retinal-vessel calibre and CVD risk factors, including blood pressure, body-mass index, total cholesterol and glycated-haemoglobin levels. In retrospectively measured prospective datasets from a population-based study, baseline measurements performed by the deep-learning system were associated with incident CVD. Our findings motivate the development of clinically applicable explainable end-to-end deep-learning systems for the prediction of CVD on the basis of the features of retinal vessels in retinal photographs.

AVNet: A retinal artery/vein classification network with category-attention weighted fusion

BACKGROUND AND OBJECTIVE

Automatic artery/vein (A/V) classification in retinal images is of great importance in detecting vascular abnormalities, which may provide biomarkers for early diagnosis of many systemic diseases. It is intuitive to apply popular deep semantic segmentation network for A/V classification. However, the model is required to provide powerful representation ability since vessel is much more complex than general objects. Moreover, deep network may lead to inconsistent classification results for the same vessel due to the lack of structured optimization objective.

METHODS

In this paper, we propose a novel segmentation network named AVNet, which effectively enhances the classification ability of the model by integrating category-attention weighted fusion (CWF) module, significantly improving the pixel-level A/V classification results. Then, a graph based vascular structure reconstruction (VSR) algorithm is employed to reduce the segment-wise inconsistency, verifying the effect of the graph model on noisy vessel segmentation results.

RESULTS

The proposed method has been verified on three datasets, i.e. DRIVE, LES-AV and WIDE. AVNet achieves pixel-level accuracies of 90.62%, 90.34%, and 93.16%, respectively, and VSR further improves the performance by 0.19%, 1.85% and 0.64%, achieving the state-of-the-art results on these three datasets.

CONCLUSION

The proposed method achieves competitive performance in A/V classification task.

Retinal Vascular Tortuosity and Diameter Associations with Adiposity and Components of Body Composition

OBJECTIVE

The aim of this study was to assess whether adiposity or body composition relates to microvascular characteristics of the retina, indicative of cardiometabolic function.

METHODS

A fully automated QUARTZ software processed retinal images from 68,550 UK Biobank participants (aged 40-69 years). Differences in retinal vessel diameter and tortuosity with body composition measures from the Tanita analyzer were obtained by using multilevel regression analyses adjusted for age, sex, ethnicity, clinic, smoking, and Townsend deprivation index.

RESULTS

Venular tortuosity and diameter increased by approximately 2% (P < 10^-300 ) and 0.6 μm (P < 10^-6 ), respectively, per SD increase in BMI, waist circumference index, waist-hip ratio, total body fat mass index, and fat-free mass index (FFMI). Venular associations with adiposity persisted after adjustment for FFMI, whereas associations with FFMI were weakened by FMI adjustment. Arteriolar diameter (not tortuosity) narrowing with FFMI was independent of adiposity (-0.6 μm; -0.7 to -0.4 μm per SD increment of FFMI), while adiposity associations with arteriolar diameter were largely nonsignificant after adjustment for FFMI.

CONCLUSIONS

This demonstrates, on an unprecedented scale, that venular tortuosity and diameter are more strongly associated with adiposity, whereas arteriolar diameter relates more strongly to fat-free mass. Different attributes of the retinal microvasculature may reflect distinct roles of body composition and fatness on the cardiometabolic system.

From Local to Global: A Graph Framework for Retinal Artery/Vein Classification

Fundus photography has been widely used for inspecting eye disorders by ophthalmologists or computer algorithms. Biomarkers related to retinal vessels plays an essential role to detect early diabetes. To quantify vascular biomarkers or the corresponding changes, an accurate artery and vein classification is necessary. In this work, we propose a new framework to boost local vessel classification with a global vascular network model using graph convolution. We compare our proposed method with two traditional state-of-the-art methods on a testing dataset of 750 images from the Maastricht Study. After incorporating global information, our model achieves the best accuracy of 86.45% compared to 85.5% from convolutional neural networks (CNN) and 82.9% from handcrafted pixel feature classification (HPFC). Our model also obtains the best area under receiver operating characteristic curve (AUC) of 0.95, compared to 0.93 from CNN and 0.90 from HPFC. The new classification framework has the advantage of easy deployment on top of local classification features. It corrects the local classification error by minimizing global classification error and it brings free additional classification performance.

Association between hypertension and retinal vascular features in ultra-widefield fundus imaging

Objective

Changes to the retinal vasculature are known to be associated with hypertension independently of traditional risk factors. We investigated whether measurements of retinal vascular calibre from ultra-widefield fundus imaging were associated with hypertensive status.

Methods

We retrospectively collected and semiautomatically measured ultra-widefield retinal fundus images from a subset of participants enrolled in an ongoing population study of ageing, categorised as normotensive or hypertensive according to thresholds on systolic/diastolic blood pressure (140/90 mm Hg) measured in a clinical setting. Vascular calibre in the peripheral retina was measured to calculate the nasal–annular arteriole:venule ratio (NA-AVR), a novel combined parameter.

Results

Left and right eyes were analysed from 440 participants (aged 50–59 years, mean age of 54.6±2.9 years, 247, 56.1% women), including 151 (34.3%) categorised as hypertensive. Arterioles were thinner and the NA-AVR was smaller in people with hypertension. The area under the receiver operating characteristic curve of NA-AVR for hypertensive status was 0.73 (95% CI 0.68 to 0.78) using measurements from left eyes, while for right eyes, it was 0.64 (95% CI 0.59 to 0.70), representing evidence of a statistically significant difference between the eyes (p=0.020).

Conclusions

Semiautomated measurements of NA-AVR in ultra-widefield fundus imaging were associated with hypertension. With further development, this may help screen people attending routine eye health check-ups for high blood pressure. These individuals may then follow a care pathway for suspected hypertension. Our results showed differences between left and right eyes, highlighting the importance of investigating both eyes of a patient.

Comparison of quality control methods for automated diffusion tensor imaging analysis pipelines

The processing of brain diffusion tensor imaging (DTI) data for large cohort studies requires fully automatic pipelines to perform quality control (QC) and artifact/outlier removal procedures on the raw DTI data prior to calculation of diffusion parameters. In this study, three automatic DTI processing pipelines, each complying with the general ENIGMA framework, were designed by uniquely combining multiple image processing software tools. Different QC procedures based on the RESTORE algorithm, the DTIPrep protocol, and a combination of both methods were compared using simulated ground truth and artifact containing DTI datasets modeling eddy current induced distortions, various levels of motion artifacts, and thermal noise. Variability was also examined in 20 DTI datasets acquired in subjects with vascular cognitive impairment (VCI) from the multi-site Ontario Neurodegenerative Disease Research Initiative (ONDRI). The mean fractional anisotropy (FA), mean diffusivity (MD), axial diffusivity (AD), and radial diffusivity (RD) were calculated in global brain grey matter (GM) and white matter (WM) regions. For the simulated DTI datasets, the measure used to evaluate the performance of the pipelines was the normalized difference between the mean DTI metrics measured in GM and WM regions and the corresponding ground truth DTI value. The performance of the proposed pipelines was very similar, particularly in FA measurements. However, the pipeline based on the RESTORE algorithm was the most accurate when analyzing the artifact containing DTI datasets. The pipeline that combined the DTIPrep protocol and the RESTORE algorithm produced the lowest standard deviation in FA measurements in normal appearing WM across subjects. We concluded that this pipeline was the most robust and is preferred for automated analysis of multisite brain DTI data.

Artery/vein classification of retinal vessels using classifiers fusion

The morphological changes in retinal blood vessels indicate cardiovascular diseases and consequently those diseases lead to ocular complications such as Hypertensive Retinopathy. One of the significant clinical findings related to this ocular abnormality is alteration of width of vessel. The classification of retinal vessels into arteries and veins in eye fundus images is a relevant task for the automatic assessment of vascular changes. This paper presents an important approach to solve this problem by means of feature ranking strategies and multiple classifiers decision-combination scheme that is specifically adapted for artery/vein classification. For this, three databases are used with a local dataset of 44 images and two publically available databases, INSPIRE-AVR containing 40 images and VICAVR containing 58 images. The local database also contains images with pathologically diseased structures. The performance of the proposed system is assessed by comparing the experimental results with the gold standard estimations as well as with the results of previous methodologies, achieving promising classification performance, with an over all accuracy of 90.45%, 93.90% and 87.82%, in retinal blood vessel separation for Local, INSPIRE-AVR and VICAVR dataset, respectively.

Multiloss Function Based Deep Convolutional Neural Network for Segmentation of Retinal Vasculature into Arterioles and Venules

The arterioles and venules (AV) classification of retinal vasculature is considered as the first step in the development of an automated system for analysing the vasculature biomarker association with disease prognosis. Most of the existing AV classification methods depend on the accurate segmentation of retinal blood vessels. Moreover, the unavailability of large-scale annotated data is a major hindrance in the application of deep learning techniques for AV classification. This paper presents an encoder-decoder based fully convolutional neural network for classification of retinal vasculature into arterioles and venules, without requiring the preliminary step of vessel segmentation. An optimized multiloss function is used to learn the pixel-wise and segment-wise retinal vessel labels. The proposed method is trained and evaluated on DRIVE, AVRDB, and a newly created AV classification dataset; and it attains 96%, 98%, and 97% accuracy, respectively. The new AV classification dataset is comprised of 700 annotated retinal images, which will offer the researchers a benchmark to compare their AV classification results.

Differentiating Veins From Arteries on Optical Coherence Tomography Angiography by Identifying Deep Capillary Plexus Vortices

PURPOSE

To introduce a simple method for differentiating retinal veins from arteries on optical coherence tomography angiography (OCTA).

DESIGN

Cross-sectional pilot study.

METHODS

Four default en face slabs including color depth encoded, grayscale full-thickness retina, superficial plexus, and deep capillary plexus (DCP) from nine 3×3-mm and nine 6×6-mm OCTA scans were exported and aligned. Nine ophthalmologists with minimum OCTA experience from 2 eye institutions were instructed to classify labeled vessels as arteries or veins in 3 stages. Classification was performed based on graders' own assessment at stage 1. Graders were taught that a capillary-free zone was an anatomic feature of arteries at stage 2 and were trained to identify veins originating from vortices within the DCP at stage 3. Grading accuracy was analyzed and correlated with grading time and graders' years in practice.

RESULTS

Overall grading accuracy in stages 1, 2, and 3 was (50.4% ± 17.0%), (75.4% ± 6.0%), and (94.7% ± 2.6%), respectively. Grading accuracy for 3×3-mm scans in stages 1, 2, and 3 was (49.9% ± 16.3%), (79.2% ± 9.6%), and (96.9% ± 3.1%), respectively. Accuracy for 6×6-mm scans in stages 1, 2, and 3 was (51.4% ± 20.8%), (72.3% ± 7.9%), and (93.2% ± 3.3%), respectively. Grading performance improved significantly at each stage (all P < .001). No significant correlation was found between accuracy and time spent grading or between accuracy and years in practice (r = -0.164 to 0.617, all P ≥ .077).

CONCLUSIONS

We describe a simple method for accurately distinguishing retinal arteries from veins on OCTA, which incorporates the use of vortices in the DCP to identify venous origin.

Associations of Retinal Microvascular Diameters and Tortuosity With Blood Pressure and Arterial Stiffness: United Kingdom Biobank

Supplemental Digital Content is available in the text.

To examine the baseline associations of retinal vessel morphometry with blood pressure (BP) and arterial stiffness in United Kingdom Biobank. The United Kingdom Biobank included 68 550 participants aged 40 to 69 years who underwent nonmydriatic retinal imaging, BP, and arterial stiffness index assessment. A fully automated image analysis program (QUARTZ [Quantitative Analysis of Retinal Vessel Topology and Size]) provided measures of retinal vessel diameter and tortuosity. The associations between retinal vessel morphology and cardiovascular disease risk factors/outcomes were examined using multilevel linear regression to provide absolute differences in vessel diameter and percentage differences in tortuosity (allowing within person clustering), adjusted for age, sex, ethnicity, clinic, body mass index, smoking, and deprivation index. Greater arteriolar tortuosity was associated with higher systolic BP (relative increase, 1.2%; 95% CI, 0.9; 1.4% per 10 mmHg), higher mean arterial pressure, 1.3%; 0.9, 1.7% per 10 mmHg, and higher pulse pressure (PP, 1.8%; 1.4; 2.2% per 10 mmHg). Narrower arterioles were associated with higher systolic BP (−0.9 µm; −0.94, −0.87 µm per 10 mmHg), mean arterial pressure (−1.5 µm; −1.5, −1.5 µm per 10 mmHg), PP (−0.7 µm; −0.8, −0.7 µm per 10 mmHg), and arterial stiffness index (−0.12 µm; −0.14, −0.09 µm per ms/m²). Associations were in the same direction but marginally weaker for venular tortuosity and diameter. This study assessing the retinal microvasculature at scale has shown clear associations between retinal vessel morphometry, BP, and arterial stiffness index. These observations further our understanding of the preclinical disease processes and interplay between microvascular and macrovascular disease.

Artery-vein segmentation in fundus images using a fully convolutional network

Epidemiological studies demonstrate that dimensions of retinal vessels change with ocular diseases, coronary heart disease and stroke. Different metrics have been described to quantify these changes in fundus images, with arteriolar and venular calibers among the most widely used. The analysis often includes a manual procedure during which a trained grader differentiates between arterioles and venules. This step can be time-consuming and can introduce variability, especially when large volumes of images need to be analyzed. In light of the recent successes of fully convolutional networks (FCNs) applied to biomedical image segmentation, we assess its potential in the context of retinal artery-vein (A/V) discrimination. To the best of our knowledge, a deep learning (DL) architecture for simultaneous vessel extraction and A/V discrimination has not been previously employed. With the aim of improving the automation of vessel analysis, a novel application of the U-Net semantic segmentation architecture (based on FCNs) on the discrimination of arteries and veins in fundus images is presented. By utilizing DL, results are obtained that exceed accuracies reported in the literature. Our model was trained and tested on the public DRIVE and HRF datasets. For DRIVE, measuring performance on vessels wider than two pixels, the FCN achieved accuracies of 94.42% and 94.11% on arteries and veins, respectively. This represents a decrease in error of 25% over the previous state of the art reported by Xu et al. (2017). Additionally, we introduce the HRF A/V ground truth, on which our model achieves 96.98% accuracy on all discovered centerline pixels. HRF A/V ground truth validated by an ophthalmologist, predicted A/V annotations and evaluation code are available at https://github.com/rubenhx/av-segmentation.