Automated segmentation of retinal pigment epithelium cells in fluorescence adaptive optics images

Multimodal in-vivo maps as a tool to characterize retinal structural biomarkers for progression in adult-onset Stargardt disease

Purpose

To characterize retinal structural biomarkers for progression in adult-onset Stargardt disease from multimodal retinal imaging in-vivo maps.

Methods

Seven adult patients (29-69 years; 3 males) with genetically-confirmed and clinically diagnosed adult-onset Stargardt disease and age-matched healthy controls were imaged with confocal and non-confocal Adaptive Optics Scanning Light Ophthalmoscopy (AOSLO), optical coherence tomography (OCT), fundus infrared (FIR), short wavelength-autofluorescence (FAF) and color fundus photography (CFP). Images from each modality were scaled for differences in lateral magnification before montages of AOSLO images were aligned with en-face FIR, FAF and OCT scans to explore changes in retinal structure across imaging modalities. Photoreceptors, retinal pigment epithelium (RPE) cells, flecks, and other retinal alterations in macular regions were identified, delineated, and correlated across imaging modalities. Retinal layer-thicknesses were extracted from segmented OCT images in areas of normal appearance on clinical imaging and intact outer retinal structure on OCT. Eccentricity dependency in cell density was compared with retinal thickness and outer retinal layer thickness, evaluated across patients, and compared with data from healthy controls.

Results

In patients with Stargardt disease, alterations in retinal structure were visible in different image modalities depending on layer location and structural properties. The patients had highly variable foveal structure, associated with equally variable visual acuity (-0.02 to 0.98 logMAR). Cone and rod photoreceptors, as well as RPE-like structures in some areas, could be quantified on non-confocal split-detection AOSLO images. RPE cells were also visible on dark field AOSLO images close to the foveal center. Hypo-reflective gaps of non-waveguiding cones (dark cones) were seen on confocal AOSLO in regions with clinically normal CFP, FIR, FAF and OCT appearance and an intact cone inner segment mosaic in three patients.

Conclusion

Dark cones were identified as a possible first sign of retinal disease progression in adult-onset Stargardt disease as these are observed in retinal locations with otherwise normal appearance and outer retinal thickness. This corroborates a previous report where dark cones were proposed as a first sign of progression in childhood-onset Stargardt disease. This also supports the hypothesis that, in Stargardt disease, photoreceptor degeneration occurs before RPE cell death.

Twenty-five years of clinical applications using adaptive optics ophthalmoscopy [Invited]

Twenty-five years ago, adaptive optics (AO) was combined with fundus photography, thereby initiating a new era in the field of ophthalmic imaging. Since that time, clinical applications of AO ophthalmoscopy to investigate visual system structure and function in both health and disease abound. To date, AO ophthalmoscopy has enabled visualization of most cell types in the retina, offered insight into retinal and systemic disease pathogenesis, and been integrated into clinical trials. This article reviews clinical applications of AO ophthalmoscopy and addresses remaining challenges for AO ophthalmoscopy to become fully integrated into standard ophthalmic care.

Near infrared autofluorescence imaging of retinal pigmented epithelial cells using 663 nm excitation

PURPOSE

Fundus autofluorescence (AF) using adaptive optics scanning laser ophthalmoscopy (AOSLO) enables morphometric analysis of individual retinal pigmented epithelial (RPE) cells. However, only a few excitation wavelengths in the visible and near-infrared have been evaluated. Visible light excitation (<600 nm) presents additional safety hazards and is uncomfortable for patients. Near-infrared excitation (>700 nm) overcomes those problems but introduces others, including decreased AF signal and cone signatures that obscure RPE structure. Here we investigated the use of an intermediate wavelength, 663 nm, for excitation and compared it to 795 nm.

METHODS

Subjects were imaged using AOSLO equipped with a detection channel to collect AF emission between 814 and 850 nm. Two light sources (663 and 795 nm) were used to excite the retinal fluorophores. We recorded 90 s videos and registered them with custom software to integrate AF images for analysis.

RESULTS

We imaged healthy eyes and an eye with pattern dystrophy. Similar AF microstructures were detected with each excitation source, despite ~4 times lower excitation power with 663 nm. The signal-to-noise values showed no meaningful difference between 663 nm and 795 nm excitation and a similar trend was observed for image contrast between the two excitation wavelengths.

CONCLUSIONS

Lower light levels can be used with shorter wavelength excitation to achieve comparable images of the microstructure of the RPE as have been obtained using higher light levels at longer wavelengths. Further experiments are needed to fully characterize AF across spectrum and determine the optimal excitation and emission bandwidths that balance efficiency, patient comfort, and efficacy.

Human Foveal Cone and RPE Cell Topographies and Their Correspondence With Foveal Shape

Purpose

To characterize the association between foveal shape and cone and retinal pigment epithelium (RPE) cell topographies in healthy humans.

Methods

Multimodal adaptive scanning light ophthalmoscopy and optical coherence tomography (OCT) were used to acquire images of foveal cones, RPE cells, and retinal layers in eyes of 23 healthy participants with normal foveas. Distributions of cone and RPE cell densities were fitted with nonlinear mixed-effects models. A linear mixed-effects model was used to examine the relationship between cone and RPE inter-cell distances and foveal shape as obtained from the OCT scans of retinal thickness.

Results

The best-fit model to the cone densities was a power function with a nasal–temporal asymmetry. There was a significant linear relationship among cone and RPE cell spacing, foveal shape, and foveal cell topography. The model predictions of the central 10° show that the contributions of both the cones and RPE cells are necessary to account for foveal shape.

Conclusions

The results indicate that there is a strong relationship between cone and RPE cell spacing and the shape of the human adolescent and adult fovea. This finding adds to the existing evidence of the critical role that the RPE serves in fetal foveal development and through adolescence, possibly via the imposition of constraints on the number and distribution of foveal cones.

Multimodal Imaging of Torpedo Maculopathy With Fluorescence Adaptive Optics Imaging of Individual Retinal Pigmented Epithelial Cells

Torpedo maculopathy (TM) is a rare congenital defect of the retinal pigment epithelium (RPE). The RPE is often evaluated clinically using fundus autofluorescence (AF), a technique that visualizes RPE structure at the tissue level from the intrinsic AF of RPE fluorophores. TM lesions typically emit little or no AF, but this macroscopic assessment is unable to resolve the RPE cells, leaving the organization of the RPE cell mosaic in TM unknown. We used fluorescence adaptive optics scanning laser ophthalmoscopy (AOSLO) to show here for the first time the microscopic cellular-level structural alterations to the RPE cell mosaic in TM that underlie the tissue-level changes seen in conventional clinical imaging. We evaluated two patients with TM using conventional clinical imaging techniques and adaptive optics (AO) infrared autofluorescence (IRAF) in AOSLO. Confocal AOSLO revealed relatively normal cones outside the TM lesion but altered cone appearance within it and along its margins in both patients. We quantified cone topography and RPE cell morphometry from the fovea to the margin of the lesion in case 1 and found cone density to be within the normal range across the locations imaged. However, RPE morphometric analysis revealed disrupted RPE cells outside the margin of the lesion; the mean RPE cell area was greater than two standard deviations above the normative range up to approximately 1.5 mm from the lesion margin. Similar morphometric changes were seen to individual RPE cells in case 2. Multi-modal imaging with AOSLO reveals that RPE cells are abnormal in TM well beyond the margins of the characteristic TM lesion boundary defined with conventional clinical imaging. Since the TM fovea appears to be fully formed, with normal cone packing, it is possible that the congenital RPE defect in TM occurs relatively late in retinal development. This work demonstrates how cellular level imaging of the RPE can provide new insight into RPE pathologies, particularly for rare conditions such as TM.

Spatially Aware Dense-LinkNet Based Regression Improves Fluorescent Cell Detection in Adaptive Optics Ophthalmic Images

Retinal pigment epithelial (RPE) cells play an important role in nourishing retinal neurosensory photoreceptor cells, and numerous blinding diseases are associated with RPE defects. Their fluorescence signature can now be visualized in the living human eye using adaptive optics (AO) imaging combined with indocyanine green (ICG), which motivates us to develop an automated RPE detection method to improve the quantitative evaluation of RPE status in patients. This paper proposes a spatially-aware, Dense-LinkNet-based regression approach to improve the detection of in vivo fluorescent cell patterns, achieving precision, recall, and F1-Score of 93.6 ± 4.3%, 81.4 ± 9.5%, and 86.7 ± 5.7%, respectively. These results demonstrate the utility of incorporating spatial inputs into a deep learning-based regression framework for cell detection.

Fully automated detection, segmentation, and analysis of in vivo RPE single cells

OBJECTIVE

To develop a fully automated method of retinal pigmented epithelium (RPE) cells detection, segmentation and analysis based on in vivo cellular resolution images obtained with the transscleral optical phase imaging method (TOPI).

METHODS

Fourteen TOPI-RPE images from 11 healthy individuals were analysed. The developed image processing method encompassed image filtering and normalisation, detection and removal of blood vessels, cell detection and cell membrane segmentation. The produced measures were cellular density of RPE layer, cell area, number of neighbouring cells, eccentricity, circularity and solidity. In addition, we proposed coefficient of variation (CV) of RPE cellular membrane (CMD_CV) and the solidity of the RPE cell membrane-shape as new metrics for the assessment of RPE single cells.

RESULTS

The observed median cellular density of the RPE layer was 3743 cells/µm² (interquartile rate (IQR) 1687), with a median observed RPE cell area of 193 µm² (IQR 141). The mean number of neighbouring cells was 5.22 (standard deviation (SD) 0.05) per RPE cell. The mean RPE cell eccentricity was 0.67 (SD 0.02), median circularity 0.83 (IQR 0.01), and median solidity 0.92 (IQR 0.00). The median CMD_CV was 0.19 (IQR 0.02). The method is characterised by a median image processing and analysis time of 48 sec (IQR 12) per image.

CONCLUSIONS

The present study provides the first fully automated quantitative assessment of human RPE single cells in vivo. The method provides a baseline for future research in the field of clinical ophthalmology, enabling characterisation and diagnostics of retinal diseases at the single-cell level.

Human Retinal Pigment Epithelium: In Vivo Cell Morphometry, Multispectral Autofluorescence, and Relationship to Cone Mosaic

Purpose

To characterize in vivo morphometry and multispectral autofluorescence of the retinal pigment epithelial (RPE) cell mosaic and its relationship to cone cell topography across the macula.

Methods

RPE cell morphometrics were computed in regularly spaced regions of interest (ROIs) from contiguous short-wavelength autofluorescence (SWAF) and photoreceptor reflectance images collected across the macula in one eye of 10 normal participants (23–65 years) by using adaptive optics scanning light ophthalmoscopy (AOSLO). Infrared autofluorescence (IRAF) images of the RPE were collected with AOSLO in seven normal participants (22–65 years), with participant overlap, and compared to SWAF quantitatively and qualitatively.

Results

RPE cell statistics could be analyzed in 84% of SWAF ROIs. RPE cell density consistently decreased with eccentricity from the fovea (participant mean ± SD: 6026 ± 1590 cells/mm² at fovea; 4552 ± 1370 cells/mm² and 3757 ± 1290 cells/mm² at 3.5 mm temporally and nasally, respectively). Mean cone-to-RPE cell ratio decreased rapidly from 16.6 at the foveal center to <5 by 1 mm. IRAF revealed cells in six of seven participants, in agreement with SWAF RPE cell size and location. Differences in cell fluorescent structure, contrast, and visibility beneath vasculature were observed between modalities.

Conclusions

Improvements in AOSLO autofluorescence imaging permit efficient visualization of RPE cells with safe light exposures, allowing individual characterization of RPE cell morphometry that is variable between participants. The normative dataset and analysis of RPE cell IRAF and SWAF herein are essential for understanding microscopic characteristics of cell fluorescence and may assist in interpreting disease progression in RPE cells.

The fundus photo has met its match: optical coherence tomography and adaptive optics ophthalmoscopy are here to stay

PURPOSE

Over the past 25 years, optical coherence tomography (OCT) and adaptive optics (AO) ophthalmoscopy have revolutionised our ability to non-invasively observe the living retina. The purpose of this review is to highlight the techniques and human clinical applications of recent advances in OCT and adaptive optics scanning laser/light ophthalmoscopy (AOSLO) ophthalmic imaging.

RECENT FINDINGS

Optical coherence tomography retinal and optic nerve head (ONH) imaging technology allows high resolution in the axial direction resulting in cross-sectional visualisation of retinal and ONH lamination. Complementary AO ophthalmoscopy gives high resolution in the transverse direction resulting in en face visualisation of retinal cell mosaics. Innovative detection schemes applied to OCT and AOSLO technologies (such as spectral domain OCT, OCT angiography, confocal and non-confocal AOSLO, fluorescence, and AO-OCT) have enabled high contrast between retinal and ONH structures in three dimensions and have allowed in vivo retinal imaging to approach that of histological quality. In addition, both OCT and AOSLO have shown the capability to detect retinal reflectance changes in response to visual stimuli, paving the way for future studies to investigate objective biomarkers of visual function at the cellular level. Increasingly, these imaging techniques are being applied to clinical studies of the normal and diseased visual system.

SUMMARY

Optical coherence tomography and AOSLO technologies are capable of elucidating the structure and function of the retina and ONH noninvasively with unprecedented resolution and contrast. The techniques have proven their worth in both basic science and clinical applications and each will continue to be utilised in future studies for many years to come.

Two-Photon Autofluorescence Imaging Reveals Cellular Structures Throughout the Retina of the Living Primate Eye

PURPOSE

Although extrinsic fluorophores can be introduced to label specific cell types in the retina, endogenous fluorophores, such as NAD(P)H, FAD, collagen, and others, are present in all retinal layers. These molecules are a potential source of optical contrast and can enable noninvasive visualization of all cellular layers. We used a two-photon fluorescence adaptive optics scanning light ophthalmoscope (TPF-AOSLO) to explore the native autofluorescence of various cell classes spanning several layers in the unlabeled retina of a living primate eye.

METHODS

Three macaques were imaged on separate occasions using a custom TPF-AOSLO. Two-photon fluorescence was evoked by pulsed light at 730 and 920 nm excitation wavelengths, while fluorescence emission was collected in the visible range from several retinal layers and different locations. Backscattered light was recorded simultaneously in confocal modality and images were postprocessed to remove eye motion.

RESULTS

All retinal layers yielded two-photon signals and the heterogeneous distribution of fluorophores provided optical contrast. Several structural features were observed, such as autofluorescence from vessel walls, Müller cell processes in the nerve fibers, mosaics of cells in the ganglion cell and other nuclear layers of the inner retina, as well as photoreceptor and RPE layers in the outer retina.

CONCLUSIONS

This in vivo survey of two-photon autofluorescence throughout the primate retina demonstrates a wider variety of structural detail in the living eye than is available through conventional imaging methods, and broadens the use of two-photon imaging of normal and diseased eyes.

Semi-automated discrimination of retinal pigmented epithelial cells in two-photon fluorescence images of mouse retinas

Automated image segmentation is a critical step toward achieving a quantitative evaluation of disease states with imaging techniques. Two-photon fluorescence microscopy (TPM) has been employed to visualize the retinal pigmented epithelium (RPE) and provide images indicating the health of the retina. However, segmentation of RPE cells within TPM images is difficult due to small differences in fluorescence intensity between cell borders and cell bodies. Here we present a semi-automated method for segmenting RPE cells that relies upon multiple weak features that differentiate cell borders from the remaining image. These features were scored by a search optimization procedure that built up the cell border in segments around a nucleus of interest. With six images used as a test, our method correctly identified cell borders for 69% of nuclei on average. Performance was strongly dependent upon increasing retinosome content in the RPE. TPM image analysis has the potential of providing improved early quantitative assessments of diseases affecting the RPE.