Automated image processing pipeline for adaptive optics scanning light ophthalmoscopy

Longitudinal Imaging of the Foveal Cone Mosaic in CNGA3-Associated Achromatopsia

Purpose

The purpose of this study was to assess the natural history of the foveal cone mosaic in CNGA3-associated achromatopsia (ACHM).

Methods

Thirteen eyes from 10 genetically confirmed patients underwent longitudinal imaging with optical coherence tomography (OCT) and non-confocal split detection adaptive optics scanning light ophthalmoscopy (AOSLO). OCT scans assessed outer nuclear layer (ONL) thickness, foveal ellipsoid zone (EZ) disruption, and foveal hypoplasia. AOSLO images were analyzed to calculate peak foveal cone density (PCD) and mean inter-cell distance (ICD) between cones. Mixed effects models were used to analyze the rate of annual change of PCD and ICD.

Results

Mean (±SD) age at visits was 29 ± 10 years, with a follow-up of 2.6 ± 1 years. There was no change in ONL thickness, degree of EZ disruption, or foveal hypoplasia over the follow-up period. We also observed a stable foveal cone mosaic using AOSLO imaging, with no significant change in PCD or ICD. Mean PCD was 15,346 cones/mm² at the mean age of 29 years old (cf. 64,000-324,000 cones/mm² in previously reported healthy controls), with a mean rate of change of -117.79 cones/mm² (0.8%) per year, P = 0.130. Mean ICD at the mean age was 13.82 µm, with a rate of change of 0.17 µm per year, P = 0.83.

Conclusions

CNGA3-associated ACHM displays stable foveal cone structure over time with a similar rate of change to CNGB3-associated ACHM (2% decline per year). The stable PCD, small cohort, and large variability within the cohort means significant age associations were not detected.

High refresh rate display for natural monocular viewing in AOSLO psychophysics experiments

By combining an external display operating at 360 frames per second with an adaptive optics scanning laser ophthalmoscope (AOSLO) for human foveal imaging, we demonstrate color stimulus delivery at high spatial and temporal resolution in AOSLO psychophysics experiments. A custom pupil relay enables viewing of the stimulus through a 3-mm effective pupil diameter and provides refractive error correction from -8 to +4 diopters. Performance of the assembled and aligned pupil relay was validated by measuring the wavefront error across the field of view and correction range, and the as-built Strehl ratio was 0.64 or better. High-acuity stimuli were rendered on the external display and imaged through the pupil relay to demonstrate that spatial frequencies up to 54 cycles per degree, corresponding to 20/11 visual acuity, are resolved. The completed external display was then used to render fixation markers across the field of view of the monitor, and a continuous retinal montage spanning 9.4 by 5.4 degrees of visual angle was acquired with the AOSLO. We conducted eye-tracking experiments during free-viewing and high-acuity tasks with polychromatic images presented on the external display. Sub-arcminute eye position uncertainty was achieved over a 1.5 by 1.5-degree trackable range, enabling precise localization of the line of sight on the stimulus while simultaneously imaging the fine structure of the human central fovea. This high refresh rate display overcomes the temporal, spectral, and field of view limitations of AOSLO-based stimulus presentation, enabling natural monocular viewing of stimuli in psychophysics experiments conducted with AOSLO.

High refresh rate display for natural monocular viewing in AOSLO psychophysics experiments

By combining an external display operating at 360 frames per second with an Adaptive Optics Scanning Laser Ophthalmoscope (AOSLO) for human foveal imaging, we demonstrate color stimulus delivery at high spatial and temporal resolution in AOSLO psychophysics experiments. A custom pupil relay enables viewing of the stimulus through a 3-mm effective pupil diameter and provides refractive error correction from -8 to +4 diopters. Performance of the assembled and aligned pupil relay was validated by measuring the wavefront error across the field of view and correction range, and the as-built Strehl ratio was 0.64 or better. High-acuity stimuli were rendered on the external display and imaged through the pupil relay to demonstrate that spatial frequencies up to 54 cycles per degree, corresponding to 20/11 visual acuity, are resolved. The completed external display was then used to render fixation markers across the field of view of the monitor, and a continuous retinal montage spanning 9.4 by 5.4 degrees of visual angle was acquired with the AOSLO. We conducted eye-tracking experiments during free-viewing and high-acuity tasks with polychromatic images presented on the external display. Sub-arcminute eye position uncertainty was achieved, enabling precise localization of the line of sight on the monitor while simultaneously imaging the fine structure of the human central fovea. This high refresh rate display overcomes the temporal, spectral, and field of view limitations of AOSLO-based stimulus presentation, enabling natural monocular viewing of stimuli in psychophysics experiments conducted with AOSLO.

Quantifying image quality in AOSLO images of photoreceptors

The use of "quality" to describe the usefulness of an image is ubiquitous but is often subject to domain specific constraints. Despite its continued use as an imaging modality, adaptive optics scanning light ophthalmoscopy (AOSLO) lacks a dedicated metric for quantifying the quality of an image of photoreceptors. Here, we present an approach to evaluating image quality that extracts an estimate of the signal to noise ratio. We evaluated its performance in 528 images of photoreceptors from two AOSLOs, two modalities, and healthy or diseased retinas. The algorithm was compared to expert graders' ratings of the images and previously published image quality metrics. We found no significant difference in the SNR and grades across all conditions. The SNR and the grades of the images were moderately correlated. Overall, this algorithm provides an objective measure of image quality that closely relates to expert assessments of quality in both confocal and split-detector AOSLO images of photoreceptors.

Minimum intensity projection of embossed quadrant-detection images for improved photoreceptor mosaic visualisation

Non-confocal split-detection imaging reveals the cone photoreceptor inner segment mosaic in a plethora of retinal conditions, with the potential of providing insight to ageing, disease, and response to treatment processes, in vivo, and allows the screening of candidates for cell rescue therapies. This imaging modality complements confocal reflectance adaptive optics scanning light ophthalmoscopy, which relies on the waveguiding properties of cones, as well as their orientation toward the pupil. Split-detection contrast, however, is directional, with each cone inner segment appearing as opposite dark and bright semicircles, presenting a challenge for either manual or automated cell identification. Quadrant-detection imaging, an evolution of split detection, could be used to generate images without directional dependence. Here, we demonstrate how the embossed-filtered quadrant-detection images, originally proposed by Migacz et al. for visualising hyalocytes, can also be used to generate photoreceptor mosaic images with better and non-directional contrast for improved visualisation. As a surrogate of visualisation improvement between legacy split-detection images and the images resulting from the method described herein, we provide preliminary results of simple image processing routines that may enable the automated identification of generic image features, as opposed to complex algorithms developed specifically for photoreceptor identification, in pathological retinas.

Adaptive Optics Retinal Imaging in RDH12-Associated Early Onset Severe Retinal Dystrophy

Purpose

RDH12 is among the most common genes found in individuals with early-onset severe retinal (EOSRD). Adaptive optics scanning light ophthalmoscopy (AOSLO) enables resolution of individual rod and cone photoreceptors in the retina. This study presents the first AOSLO imaging of individuals with RDH12-associated EOSRD.

Methods

Case series of patients who attended Moorfields Eye Hospital (London, UK). Spectral-domain optical coherence tomography, near-infrared reflectance (NIR), and blue autofluorescence imaging were analyzed. En face image sequences of photoreceptors were recorded using either of two AOSLO modalities. Cross-sectional analysis was undertaken for seven patients and longitudinal analysis for one patient.

Results

Nine eyes from eight patients are presented in this case series. The mean age at the time of the assessment was 11.2 ± 6.5 years of age (range 7-29). A subfoveal continuous ellipsoid zone (EZ) line was present in eight eyes. Posterior pole AOSLO revealed patches of cone mosaics. Average cone densities at regions of interest 0.5° to the fovea ranged from 12,620 to 23,660 cells/mm2, whereas intercell spacing ranged from 7.0 to 9.7 µm.

Conclusions

This study demonstrates that AOSLO can provide useful high-quality images in patients with EOSRD, even during childhood, with nystagmus, and early macular atrophy. Cones at the posterior pole can appear as scattered islands or, possibly later in life, as a single subfoveal conglomerate. Detailed image analysis suggests that retinal pigment epithelial stress and dysfunction may be the initial step toward degeneration, with NIR being a useful tool to assess retinal well-being in RDH12-associated EOSRD.

Automatic montaging of adaptive optics SLO retinal images based on graph theory

We present a fully automatic montage pipeline for adaptive optics SLO retinal images. It contains a flexible module to estimate the translation between pairwise images. The user can change modules to accommodate the alignment of the dataset using the most appropriate alignment technique, provided that it estimates the translation between image pairs and provides a quantitative confidence metric for the match between 0 and 1. We use these pairwise comparisons and associated metrics to construct a graph where nodes represent frames and edges represent the overlap relations. We use a small diameter spanning tree to determine the best pairwise alignment for each image based on the entire set of image relations. The final stage of the pipeline is a blending module that uses dynamic programming to improve the smoothness of the transition between frames. Data sets ranging from 26 to 119 images were obtained from individuals aged 24 to 81 years with a mix of visually normal control eyes and eyes with glaucoma or diabetes. The resulting automatically generated montages were qualitatively and quantitatively compared to results from semi-automated alignment. Data sets were specifically chosen to include both high quality and medium quality data. The results obtained from the automatic method are comparable or better than results obtained by an experienced operator performing semi-automated montaging. For the plug-in pairwise alignment module, we tested a technique that utilizes SIFT + RANSAC, Normalized cross-correlation (NCC) and a combination of the two. This pipeline produces consistent results not only on outer retinal layers, but also on inner retinal layers such as a nerve fiber layer or images of the vascular complexes, even when images are not of excellent quality.

Adaptive Optics Imaging of Inherited Retinal Disease

The human retina is amenable to direct, noninvasive visualization using a wide array of imaging modalities. In the ∼140 years since the publication of the first image of the living human retina, there has been a continued evolution of retinal imaging technology. Advances in image acquisition and processing speed now allow real-time visualization of retinal structure, which has revolutionized the diagnosis and management of eye disease. Enormous advances have come in image resolution, with adaptive optics (AO)-based systems capable of imaging the retina with single-cell resolution. In addition, newer functional imaging techniques provide the ability to assess function with exquisite spatial and temporal resolution. These imaging advances have had an especially profound impact on the field of inherited retinal disease research. Here we will review some of the advances and applications of AO retinal imaging in patients with inherited retinal disease.

Deep learning-enabled volumetric cone photoreceptor segmentation in adaptive optics optical coherence tomography images of normal and diseased eyes

Objective quantification of photoreceptor cell morphology, such as cell diameter and outer segment length, is crucial for early, accurate, and sensitive diagnosis and prognosis of retinal neurodegenerative diseases. Adaptive optics optical coherence tomography (AO-OCT) provides three-dimensional (3-D) visualization of photoreceptor cells in the living human eye. The current gold standard for extracting cell morphology from AO-OCT images involves the tedious process of 2-D manual marking. To automate this process and extend to 3-D analysis of the volumetric data, we propose a comprehensive deep learning framework to segment individual cone cells in AO-OCT scans. Our automated method achieved human-level performance in assessing cone photoreceptors of healthy and diseased participants captured with three different AO-OCT systems representing two different types of point scanning OCT: spectral domain and swept source.