High-speed adaptive optics line scan confocal retinal imaging for human eye

High-speed, phase contrast retinal and blood flow imaging using an adaptive optics partially confocal multi-line ophthalmoscope

High-speed, phase contrast retinal and blood flow imaging using an adaptive optics partially confocal multi-line ophthalmosocope (AO-pcMLO) is described. It allows for simultaneous confocal and phase contrast imaging with various directional multi-line illumination by using a single 2D camera and a digital micromirror device (DMD). Both vertical and horizontal line illumination directions were tested, for photoreceptor and vascular imaging. The phase contrast imaging provided improved visualization of retinal structures such as cone inner segments, vessel walls and red blood cells with images being acquired at frame rates up to 500 Hz. Blood flow velocities of small vessels (<40 µm in diameter) were measured using kymographs for capillaries and cross-correlation between subsequent images for arterioles or venules. Cardiac-related pulsatile patterns were observed with normal resting heart-beat rate, and instantaneous blood flow velocities from 0.7 to 20 mm/s were measured.

Multimodal high-resolution retinal imaging using a camera-based DMD-integrated adaptive optics flood-illumination ophthalmoscope

We demonstrate the feasibility of a multimodal adaptive optics flood-illumination ophthalmoscope, able to provide both bright-field and dark-field images (such as phase contrast). The multimodality was made possible by integrating a digital micromirror device (DMD) at the illumination path to project a sequence of complementary high-resolution patterns into the retina. Through a versatile post-processing method that digitally selects backscattered or multiply scattered photons, we were able: (1) to achieve up to four-fold contrast increase of bright-field images when imaging the photoreceptor mosaic and nerve fibers; and (2) to visualize translucent retinal features such as capillaries, red blood cells, vessel walls, ganglion cells, and photoreceptor inner segments through phase contrast.

Adaptive Optics Imaging of Inherited Retinal Disease

The human retina is amenable to direct, noninvasive visualization using a wide array of imaging modalities. In the ∼140 years since the publication of the first image of the living human retina, there has been a continued evolution of retinal imaging technology. Advances in image acquisition and processing speed now allow real-time visualization of retinal structure, which has revolutionized the diagnosis and management of eye disease. Enormous advances have come in image resolution, with adaptive optics (AO)-based systems capable of imaging the retina with single-cell resolution. In addition, newer functional imaging techniques provide the ability to assess function with exquisite spatial and temporal resolution. These imaging advances have had an especially profound impact on the field of inherited retinal disease research. Here we will review some of the advances and applications of AO retinal imaging in patients with inherited retinal disease.

High Sensitivity Near-Infrared Imaging of Fluorescent Nanosensors

Biochemical processes are fast and occur on small-length scales, which makes them difficult to measure. Optical nanosensors based on single-wall carbon nanotubes (SWCNTs) are able to capture such dynamics. They fluoresce in the near-infrared (NIR, 850-1700 nm) tissue transparency window and the emission wavelength depends on their chirality. However, NIR imaging requires specialized indium gallium arsenide (InGaAs) cameras with a typically low resolution because the quantum yield of normal Si-based cameras rapidly decreases in the NIR. Here, an efficient one-step phase separation approach to isolate monochiral (6,4)-SWCNTs (880 nm emission) from mixed SWCNT samples is developed. It enables imaging them in the NIR with high-resolution standard Si-based cameras (>50× more pixels). (6,4)-SWCNTs modified with (GT)₁₀ -ssDNA become highly sensitive to the important neurotransmitter dopamine. These sensors are 1.7× brighter and 7.5× more sensitive and allow fast imaging (<50 ms). They enable high-resolution imaging of dopamine release from cells. Thus, the assembly of biosensors from (6,4)-SWCNTs combines the advantages of nanosensors working in the NIR with the sensitivity of (Si-based) cameras and enables broad usage of these nanomaterials.

Adaptive optics wavefront correction using a damped transpose matrix of the influence function

To assess the performance of adaptive optics and predict an optimal wavefront correction, we built a wavefront reconstructor with a damped transpose matrix of the influence function. Using an integral control strategy, we tested this reconstructor with four deformable mirrors in an experimental system, an adaptive optics scanning laser ophthalmoscope, and an adaptive optics near-confocal ophthalmoscope. Testing results proved that this reconstructor could ensure a stable and precise correction for wavefront aberration compared to a conventional optimal reconstructor formed by the inverse matrix of the influence function. This method may provide a helpful tool for testing, evaluating, and optimizing adaptive optics systems.

Hybrid FPGA-CPU pupil tracker

An off-axis monocular pupil tracker designed for eventual integration in ophthalmoscopes for eye movement stabilization is described and demonstrated. The instrument consists of light-emitting diodes, a camera, a field-programmable gate array (FPGA) and a central processing unit (CPU). The raw camera image undergoes background subtraction, field-flattening, 1-dimensional low-pass filtering, thresholding and robust pupil edge detection on an FPGA pixel stream, followed by least-squares fitting of the pupil edge pixel coordinates to an ellipse in the CPU. Experimental data suggest that the proposed algorithms require raw images with a minimum of ∼32 gray levels to achieve sub-pixel pupil center accuracy. Tests with two different cameras operating at 575, 1250 and 5400 frames per second trained on a model pupil achieved 0.5-1.5 μm pupil center estimation precision with 0.6-2.1 ms combined image download, FPGA and CPU processing latency. Pupil tracking data from a fixating human subject show that the tracker operation only requires the adjustment of a single parameter, namely an image intensity threshold. The latency of the proposed pupil tracker is limited by camera download time (latency) and sensitivity (precision).

Examining Whether AOSLO-Based Foveal Cone Metrics in Achromatopsia and Albinism Are Representative of Foveal Cone Structure

Purpose

Adaptive optics scanning light ophthalmoscopy (AOSLO) imaging in patients with achromatopsia (ACHM) and albinism is not always successful. Here, we tested whether optical coherence tomography (OCT) measures of foveal structure differed between patients for whom AOSLO images were either quantifiable or unquantifiable.

Methods

The study included 166 subjects (84 with ACHM; 82 with albinism) with previously acquired OCT scans, AOSLO images, and best-corrected visual acuity (BCVA, if available). Foveal OCT scans were assessed for outer retinal structure, outer nuclear layer thickness, and hypoplasia. AOSLO images were graded as quantifiable if a peak cone density could be measured and/or usable if the location of peak density could be identified and the parafoveal mosaic was quantifiable.

Results

Forty-nine percent of subjects with ACHM and 57% of subjects with albinism had quantifiable AOSLO images. Older age and better BCVA were found in subjects with quantifiable AOSLO images for both ACHM (P = 0.0214 and P = 0.0276, respectively) and albinism (P = 0.0073 and P < 0.0004, respectively). There was a significant trend between ellipsoid zone appearance and ability to quantify AOSLO (P = 0.0028). In albinism, OCT metrics of cone structure did not differ between groups.

Conclusions

Previously reported AOSLO-based cone density measures in ACHM may not necessarily reflect the degree of remnant cone structure in these patients.

Translational Relevance

Until AOSLO is successful in all patients with ACHM and albinism, the possibility of the reported data from a particular cohort not being representative of the entire population remains an important issue to consider when interpreting results from AOSLO studies.

Virtually structured detection enables super-resolution ophthalmoscopy of rod and cone photoreceptors in human retina

BACKGROUND

High resolution imaging is desirable for advanced study and clinical management of retinal diseases. However, spatial resolution of retinal imaging has been limited due to available numerical aperture and optical aberration of the ocular optics. This study is to develop and validate virtually structured detection (VSD) to surpass diffraction limit for resolution improvement in in vivo retinal imaging of awake human.

METHODS

A rapid line scanning laser ophthalmoscope (SLO) was constructed for in vivo retinal imaging. A high speed (25,000 kHz) camera was used for recording the two-dimensional (2D) light reflectance profile, corresponding to each focused line illumination. VSD was implemented to the 2D light reflectance profiles for super-resolution reconstruction. Because each 2D light reflectance profile was recorded within 40 μs, the intra-frame blur due to eye movements can be ignored. Digital registration was implemented to further compensate for inter-frame eye movements, before the VSD processing. Based on digital processing, the modulation transfer function (MTF) of the imaging system was derived for objective identification of the cut-off frequency of ocular optics, which is essential for robust VSD processing to ensure reliable super-resolution imaging. Dynamic motility analysis of the super-resolution images was implemented to further enhance the imaging contrast of retinal rod and cone photoreceptors.

RESULTS

The VSD based super-resolution SLO significantly improved image quality compared with equivalent wide-field imaging. In vivo observation of individual retinal photoreceptors has been demonstrated unambiguously. Dynamic motility analysis of the super-resolution images enhanced the contrast of retinal rod and cone photoreceptors, and revealed sub-cellular structures in cone photoreceptors.

CONCLUSIONS

In conjunction with rapid line-scan imaging and digital registration to minimize the effect of eye movements, VSD enabled resolution improvement to observe individual retinal photoreceptors without the involvement of adaptive optics (AO). An objective method has been developed to identify MTF to enable quantitative estimation of the cut-off frequency required for robust VSD processing.

Template free eye motion correction for scanning systems

Scanning imaging systems are susceptible to image warping in the presence of target motion occurring within the time required to acquire an individual image frame. In this Letter, we introduce the use of a dual raster scanning approach to correct for motion distortion without the need for prior knowledge of the undistorted image. In the dual scanning approach, the target is imaged simultaneously with two imaging beams from the same imaging system. The two imaging beams share a common pupil but have a spatial shift between the beams on the imaging plane. The spatial shift can be used to measure high speed events, because it measures an identical region at two different times within the time required for acquisition of a single frame. In addition, it provides accurate spatial information, since two different regions on the target are imaged simultaneously, providing an undistorted estimate of the spatial relation between regions. These spatial and temporal relations accurately measure target motion. Data from adaptive optics scanning laser ophthalmoscope (AOSLO) imaging of the human retina are used to demonstrate this technique. We apply the technique to correct the shearing of retinal images produced by eye motion. Three control subjects were measured while imaging different retinal layers and retinal locations to qualify the effectiveness of the algorithm. Since the time shift between channels is readily adjustable, this method can be tuned to match different imaging situations. The major requirement is the need to separate the two images; in our case, we used different near infrared spectral regions and dichroic filters.

Optical Coherence Tomography Artifacts Are Associated With Adaptive Optics Scanning Light Ophthalmoscopy Success in Achromatopsia

Purpose

To determine whether artifacts in optical coherence tomography (OCT) images are associated with the success or failure of adaptive optics scanning light ophthalmoscopy (AOSLO) imaging in subjects with achromatopsia (ACHM).

Methods

Previously acquired OCT and non-confocal, split-detector AOSLO images from one eye of 66 subjects with genetically confirmed achromatopsia (15 CNGA3 and 51 CNGB3) were reviewed along with best-corrected visual acuity (BCVA) and axial length. OCT artifacts in interpolated vertical volumes from CIRRUS macular cubes were divided into four categories: (1) none or minimal, (2) clear and low frequency, (3) low amplitude and high frequency, and (4) high amplitude and high frequency. Each vertical volume was assessed once by two observers. AOSLO success was defined as sufficient image quality in split-detector images at the fovea to assess cone quantity.

Results

There was excellent agreement between the two observers for assessing OCT artifact severity category (weighted kappa = 0.88). Overall, AOSLO success was 47%. For subjects with OCT artifact severity category 1, AOSLO success was 65%; for category 2, 47%; for category 3, 11%; and for category 4, 0%. There was a significant association between OCT artifact severity category and AOSLO success (P = 0.0002). Neither BCVA nor axial length was associated with AOSLO success (P = 0.07 and P = 0.75, respectively).

Conclusions

Artifacts in OCT volumes are associated with AOSLO success in ACHM. Subjects with less severe OCT artifacts are more likely to be good candidates for AOSLO imaging, whereas AOSLO was successful in only 7% of subjects with category 3 or 4 OCT artifacts. These results may be useful in guiding patient selection for AOSLO imaging.

Translational Relevance

Using OCT to prescreen patients could be a valuable tool for clinical trials that utilize AOSLO to reduce costs and decrease patient testing burden.

Correcting intra-volume distortion for AO-OCT using 3D correlation based registration

Adaptive optics (AO) based ophthalmic imagers, such as scanning laser ophthalmoscopes (SLO) and optical coherence tomography (OCT), are used to evaluate the structure and function of the retina with high contrast and resolution. Fixational eye movements during a raster-scanned image acquisition lead to intra-frame and intra-volume distortion, resulting in an inaccurate reproduction of the underlying retinal structure. For three-dimensional (3D) AO-OCT, segmentation-based and 3D correlation based registration methods have been applied to correct eye motion and achieve a high signal-to-noise ratio registered volume. This involves first selecting a reference volume, either manually or automatically, and registering the image/volume stream against the reference using correlation methods. However, even within the chosen reference volume, involuntary eye motion persists and affects the accuracy with which the 3D retinal structure is finally rendered. In this article, we introduced reference volume distortion correction for AO-OCT using 3D correlation based registration and demonstrate a significant improvement in registration performance via a few metrics. Conceptually, the general paradigm follows that developed previously for intra-frame distortion correction for 2D raster-scanned images, as in an AOSLO, but extended here across all three spatial dimensions via 3D correlation analyses. We performed a frequency analysis of eye motion traces before and after intra-volume correction and revealed how periodic artifacts in eye motion estimates are effectively reduced upon correction. Further, we quantified how the intra-volume distortions and periodic artifacts in the eye motion traces, in general, decrease with increasing AO-OCT acquisition speed. Overall, 3D correlation based registration with intra-volume correction significantly improved the visualization of retinal structure and estimation of fixational eye movements.

Investigation of confocal microscopy for differentiation of renal cell carcinoma versus benign tissue. Can an optical biopsy be performed?

Objective

Novel optical imaging modalities are under development with the goal of obtaining an “optical biopsy” to efficiently provide pathologic details. One such modality is confocal microscopy which allows in situ visualization of cells within a layer of tissue and imaging of cellular-level structures. The goal of this study is to validate the ability of confocal microscopy to quickly and accurately differentiate between normal renal tissue and cancer.

Methods

Specimens were obtained from patients who underwent robotic partial nephrectomy for renal mass. Samples of suspected normal and tumor tissue were extracted from the excised portion of the kidney and stained with acridine orange. The stained samples were imaged on a Nikon E600 C1 Confocal Microscope. The samples were then submitted for hematoxylin and eosin processing and read by an expert pathologist to provide a gold-standard diagnosis that can later be compared to the confocal images.

Results

This study included 11 patients, 17 tissue samples, and 118 confocal images. Of the 17 tissue samples, 10 had a gold-standard diagnosis of cancer and seven were benign. Of 118 confocal images, 66 had a gold-standard diagnosis of cancer and 52 were benign. Six confocal images were used as a training set to train eight observers. The observers were asked to rate the test images on a six point scale and the results were analyzed using a web based receiver operating characteristic curve calculator. The average accuracy, sensitivity, specificity, and area under the empirical receiver operating characteristic curve for this study were 91%, 98%, 81%, and 0.94 respectively.

Conclusion

This preliminary study suggest that confocal microscopy can be used to distinguish cancer from normal tissue with high sensitivity and specificity. The observers in this study were trained quickly and on only six images. We expect even higher performance as observers become more familiar with the confocal images.

Volumetric fluorescein angiography (vFA) by oblique scanning laser ophthalmoscopy in mouse retina at 200 B-scans per second

Oblique scanning laser ophthalmoscopy (oSLO) is a recently developed technique to provide three-dimensional volumetric fluorescence imaging in retinas over a large field of view, without the need for depth sectioning. In this study, we present volumetric fluorescein angiography (vFA) at 200 B-scans per second in mouse retina in vivo by oSLO. By using a low-cost industrial CMOS camera, imaging speed was improved to 2 volumes per second, ∼10 times more than our previous results. Enabled by the volumetric imaging, we visualized hemodynamics at single capillary level in a depth-dependent manner, and provided methods to quantify capillary hematocrit, absolute capillary blood flow speed, and detection of capillary flow stagnancy and stalling at different vascular layers. The quantitative metrics for capillary hemodynamics enhanced by volumetric imaging can offer valuable insight into vision science and retinal pathologies.

Near infrared adaptive optics flood illumination retinal angiography

Image-based angiography is a well-adapted technique to characterize vasculature, and has been used in retinal neurovascular studies. Because the microvasculature is of particular interest, being the site of exchange between blood and tissue, a high spatio-temporal resolution is required, implying the use of adaptive optics ophthalmoscopes with a high frame rate. Creating the opportunity for decoupled stimulation and imaging of the retina makes the use of near infrared (NIR) imaging light desirable, while the need for a large field of view and a lack of distortion implies the use of a flood illumination-based setup. However, flood-illumination NIR video sequences of erythrocytes, or red blood cells (RBC), have a limited contrast compared to scanning systems and visible light. As a result, they cannot be processed via existing image-based angiography methods. We have therefore developed a new computational method relying on a spatio-temporal filtering of the sequence to isolate blood flow from noise in low-contrast sequences. Applying this computational approach enabled us to perform angiography with an adaptive optics flood illumination ophthalmoscope (AO-FIO) using NIR light, both in bright-field and dark-field modalities. Finally, we demonstrate the capabilities of our system to differentiate blood flow velocity on a retinal capillary network in vivo.

Noninvasive in vivo characterization of erythrocyte motion in human retinal capillaries using high-speed adaptive optics near-confocal imaging

The flow of erythrocytes in parafoveal capillaries was imaged in the living human eye with an adaptive optics near-confocal ophthalmoscope at a frame rate of 800 Hz with a low coherence near-infrared (NIR) light source. Spatiotemporal traces of the erythrocyte movement were extracted from consecutive images. Erythrocyte velocity was measured using custom software based on the Radon transform. The impact of imaging speed on velocity measurement was estimated using images of frame rates of 200, 400, and 800 Hz. The NIR light allowed for long imaging periods without visually stimulating the retina and disturbing the natural rheological state. High speed near-confocal imaging enabled direct and accurate measurement of erythrocyte velocity, and revealed a distinctively cardiac-dependent pulsatile velocity waveform of the erythrocyte flow in retinal capillaries, disclosed the impact of the leukocytes on erythrocyte motion, and provided new metrics for precise assessment of erythrocyte movement. The approach may facilitate new investigations on the pathophysiology of retinal microcirculation with applications for ocular and systemic diseases.

High loop rate adaptive optics flood illumination ophthalmoscope with structured illumination capability

The design and performance of an adaptive optics flood illumination ophthalmoscope (AO-FIO) platform, based on eye motion and dynamic aberrations experimental analysis, are described. The system incorporates a custom-built real-time controller, enabling up to 70 Hz loop rate without jitter, and an AO-corrected illumination capable of projecting high-resolution features in the retina. Wide-field (2.7°×5.4°) and distortionless images from vessel walls, capillaries, and the lamina cribrosa are obtained with an enhanced contrast and signal-to-noise ratio, thanks to careful control of AO parameters. The high spatial and temporal resolution (image acquisition up to 200 Hz) performance achieved by this platform enables the visualization of vessel deformation and blood flow. This system opens up the prospect of a return to favor of flood illumination adaptive optics systems provided that its high pixel rate and structured illumination capabilities are exploited.

High speed adaptive optics ophthalmoscopy with an anamorphic point spread function

Retinal imaging working with a line scan mechanism and a line camera has the potential to image the eye with a near-confocal performance at the high frame rate, but this regime has difficulty to collect sufficient imaging light while adequately digitize the optical resolution in adaptive optics imaging. To meet this challenge, we have developed an adaptive optics line scan ophthalmoscope with an anamorphic point spread function. The instrument uses a high-speed line camera to acquire the retinal image and act as a confocal gate. Meanwhile, it employs a digital micro-mirror device to modulate the imaging light into a line of point sources illuminating the retina. The anamorphic mechanism ensures adequate digitization of the optical resolution and increases light collecting efficiency. We demonstrate imaging of the living human retina with cellular level resolution at a frame rate of 200 frames/second (FPS) with a digitization of 512 × 512 pixels over a field of view of 1.2° × 1.2°. We have assessed cone photoreceptor structure in images acquired at 100, 200, and 800 FPS in 2 normal human subjects, and confirmed that retinal images acquired at high speed rendered macular cone mosaic with improved measurement repeatability.

Adaptive optics scanning laser ophthalmoscopy in fundus imaging, a review and update

Adaptive optics scanning laser ophthalmoscopy (AO-SLO) has been a promising technique in funds imaging with growing popularity. This review firstly gives a brief history of adaptive optics (AO) and AO-SLO. Then it compares AO-SLO with conventional imaging methods (fundus fluorescein angiography, fundus autofluorescence, indocyanine green angiography and optical coherence tomography) and other AO techniques (adaptive optics flood-illumination ophthalmoscopy and adaptive optics optical coherence tomography). Furthermore, an update of current research situation in AO-SLO is made based on different fundus structures as photoreceptors (cones and rods), fundus vessels, retinal pigment epithelium layer, retinal nerve fiber layer, ganglion cell layer and lamina cribrosa. Finally, this review indicates possible research directions of AO-SLO in future.

Photoreceptor-Based Biomarkers in AOSLO Retinal Imaging

Improved understanding of the mechanisms underlying inherited retinal degenerations has created the possibility of developing much needed treatments for these relentless, blinding diseases. However, standard clinical indicators of retinal health (such as visual acuity and visual field sensitivity) are insensitive measures of photoreceptor survival. In many retinal degenerations, significant photoreceptor loss must occur before measurable differences in visual function are observed. Thus, there is a recognized need for more sensitive outcome measures to assess therapeutic efficacy as numerous clinical trials are getting underway. Adaptive optics (AO) retinal imaging techniques correct for the monochromatic aberrations of the eye and can be used to provide nearly diffraction-limited images of the retina. Many groups routinely are using AO imaging tools to obtain in vivo images of the rod and cone photoreceptor mosaic, and it now is possible to monitor photoreceptor structure over time with single cell resolution. Highlighting recent work using AO scanning light ophthalmoscopy (AOSLO) across a range of patient populations, we review the development of photoreceptor-based metrics (e.g., density/geometry, reflectivity, and size) as candidate biomarkers. Going forward, there is a need for further development of automated tools and normative databases, with the latter facilitating the comparison of data sets across research groups and devices. Ongoing and future clinical trials for inherited retinal diseases will benefit from the improved resolution and sensitivity that multimodal AO retinal imaging affords to evaluate safety and efficacy of emerging therapies.