Non-common path aberration correction in an adaptive optics scanning ophthalmoscope

Modal focal adaptive optics for Bessel-focus two-photon fluorescence microscopy

Adaptive optics (AO) improves the spatial resolution of microscopy by correcting optical aberrations. While its application has been well established in microscopy modalities utilizing a circular pupil, its adaptation to systems with non-circular pupils, such as Bessel-focus two-photon fluorescence microscopy (2PFM) with an annular pupil, remains relatively uncharted. Herein, we present a modal focal AO (MFAO) method for Bessel-focus 2PFM. Measuring and correcting aberration using a spatial light modulator placed in conjugation with the focal plane of the microscope objective, MFAO employs Zernike annular polynomials - a first in AO implementation - to achieve performance on par with a previous zonal AO method, but with a notably simplified optical configuration. We validated the performance of MFAO in correcting artificial and sample-induced aberrations, as well as in in vivo imaging of zebrafish larvae and mouse brains. By expanding the application of modal AO to annular pupils as well as aberration measurement and correction to a wavefront modulator at the objective focal plane, MFAO represents a notable advancement in the implementation of AO in microscopy.

Image metric-based multi-observation single-step deep deterministic policy gradient for sensorless adaptive optics

Sensorless adaptive optics (SAO) has been widely used across diverse fields such as astronomy, microscopy, and ophthalmology. Recent advances have proved the feasibility of using the deep deterministic policy gradient (DDPG) for image metric-based SAO, achieving fast correction speeds compared to the coordinate search Zernike mode hill climbing (ZMHC) method. In this work, we present a multi-observation single-step DDPG (MOSS-DDPG) optimization framework for SAO on a confocal scanning laser ophthalmoscope (SLO) system with particular consideration for applications in preclinical retinal imaging. MOSS-DDPG optimizes N target Zernike coefficients in a single-step manner based on 2N + 1 observations of the image sharpness metric values. Through in silico simulations, MOSS-DDPG has demonstrated the capability to quickly achieve diffraction-limited resolution performance with long short-term memory (LSTM) network implementation. In situ tests suggest that knowledge learned through simulation adapts swiftly to imperfections in the real system by transfer learning, exhibiting comparable in situ performance to the ZMHC method with a greater than tenfold reduction in the required number of iterations.

Retinal microvascular and neuronal pathologies probed in vivo by adaptive optical two-photon fluorescence microscopy

The retina, behind the transparent optics of the eye, is the only neural tissue whose physiology and pathology can be non-invasively probed by optical microscopy. The aberrations intrinsic to the mouse eye, however, prevent high-resolution investigation of retinal structure and function in vivo. Optimizing the design of a two-photon fluorescence microscope (2PFM) and sample preparation procedure, we found that adaptive optics (AO), by measuring and correcting ocular aberrations, is essential for resolving putative synaptic structures and achieving three-dimensional cellular resolution in the mouse retina in vivo. Applying AO-2PFM to longitudinal retinal imaging in transgenic models of retinal pathology, we characterized microvascular lesions with sub-capillary details in a proliferative vascular retinopathy model, and found Lidocaine to effectively suppress retinal ganglion cell hyperactivity in a retinal degeneration model. Tracking structural and functional changes at high-resolution longitudinally, AO-2PFM enables microscopic investigations of retinal pathology and pharmacology for disease diagnosis and treatment in vivo.

Adaptive optics for optical microscopy [Invited]

Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.

Adaptive optics in super-resolution microscopy

Fluorescence microscopy has become a routine tool in biology for interrogating life activities with minimal perturbation. While the resolution of fluorescence microscopy is in theory governed only by the diffraction of light, the resolution obtainable in practice is also constrained by the presence of optical aberrations. The past two decades have witnessed the advent of super-resolution microscopy that overcomes the diffraction barrier, enabling numerous biological investigations at the nanoscale. Adaptive optics, a technique borrowed from astronomical imaging, has been applied to correct for optical aberrations in essentially every microscopy modality, especially in super-resolution microscopy in the last decade, to restore optimal image quality and resolution. In this review, we briefly introduce the fundamental concepts of adaptive optics and the operating principles of the major super-resolution imaging techniques. We highlight some recent implementations and advances in adaptive optics for active and dynamic aberration correction in super-resolution microscopy.

In-vivo sub-diffraction adaptive optics imaging of photoreceptors in the human eye with annular pupil illumination and sub-Airy detection

Adaptive optics scanning light ophthalmoscopy (AOSLO) allows non-invasive visualization of the living human eye at the microscopic scale; but even with correction of the ocular wavefront aberrations over a large pupil, the smallest cells in the photoreceptor mosaic cannot always be resolved. Here, we synergistically combine annular pupil illumination with sub-Airy disk confocal detection to demonstrate a 33% improvement in transverse resolution (from 2.36 to 1.58 μm) and a 13% axial resolution enhancement (from 37 to 32 μm), an important step towards the study of the complete photoreceptor mosaic in heath and disease. Interestingly, annular pupil illumination also enhanced the visualization of the photoreceptor mosaic in non-confocal detection schemes such as split detection AOSLO, providing a strategy for enhanced multimodal imaging of the cone and rod photoreceptor mosaic.

Correction of static and non-common path aberrations in an adaptive optics system using inherent calibration data

For low-order adaptive optics systems, a method that is able to correct for system aberrations in the final focal plane is presented. The paper presents a novel figure of merit, corresponding to the integrated non-normalized tip-tilt-free optical transfer function. The inherent singular value decomposition modal content of the interaction matrix is used to optimize this figure of merit. The method has proven to be stable and robust, providing a simple mean to facilitate diffraction limited imaging in an experimental setup for ophthalmic applications.

Phase retrieval of large-scale time-varying aberrations using a non-linear Kalman filtering framework

This paper presents a computationally efficient framework in which a single focal-plane image is used to obtain a high-resolution reconstruction of dynamic aberrations. Assuming small-phase aberrations, a non-linear Kalman filter implementation is developed whose computational complexity scales close to linearly with the number of pixels of the focal-plane camera. The performance of the method is tested in a simulation of an adaptive optics system, where the small-phase assumption is enforced by considering a closed-loop system that uses a low-resolution wavefront sensor to control a deformable mirror. The results confirm the computational efficiency of the algorithm and show a large robustness against noise and model uncertainties.

Adaptive optics in the mouse eye: wavefront sensing based vs. image-guided aberration correction

Adaptive Optics (AO) is required to achieve diffraction limited resolution in many real-life imaging applications in biology and medicine. AO is essential to guarantee high fidelity visualization of cellular structures for retinal imaging by correcting ocular aberrations. Aberration correction for mouse retinal imaging by direct wavefront measurement has been demonstrated with great success. However, for mouse eyes, the performance of the wavefront sensor (WFS) based AO can be limited by several factors including non-common path errors, wavefront reconstruction errors, and an ill-defined reference plane. Image-based AO can avoid these issues at the cost of algorithmic execution time. Furthermore, image-based approaches can provide improvements to compactness, accessibility, and even the performance of AO systems. Here, we demonstrate the ability of image-based AO to provide comparable aberration correction and image resolution to the conventional Shack-Hartmann WFS-based AO approach. The residual wavefront error of the mouse eye was monitored during a wavefront sensorless optimization to allow comparison with classical AO. This also allowed us to improve the performance of our AO system for small animal retinal imaging.

Identification of the dynamics of time-varying phase aberrations from time histories of the point-spread function

To optimally compensate for time-varying phase aberrations with adaptive optics, a model of the dynamics of the aberrations is required to predict the phase aberration at the next time step. We model the time-varying behavior of a phase aberration, expressed in Zernike modes, by assuming that the temporal dynamics of the Zernike coefficients can be described by a vector-valued autoregressive (VAR) model. We propose an iterative method based on a convex heuristic for a rank-constrained optimization problem, to jointly estimate the parameters of the VAR model and the Zernike coefficients from a time series of measurements of the point-spread function (PSF) of the optical system. By assuming the phase aberration is small, the relation between aberration and PSF measurements can be approximated by a quadratic function. As such, our method is a blind identification method for linear dynamics in a stochastic Wiener system with a quadratic nonlinearity at the output and a phase retrieval method that uses a time-evolution-model constraint and a single image at every time step.

Adaptive optics imaging of the human retina

Adaptive Optics (AO) retinal imaging has provided revolutionary tools to scientists and clinicians for studying retinal structure and function in the living eye. From animal models to clinical patients, AO imaging is changing the way scientists are approaching the study of the retina. By providing cellular and subcellular details without the need for histology, it is now possible to perform large scale studies as well as to understand how an individual retina changes over time. Because AO retinal imaging is non-invasive and when performed with near-IR wavelengths both safe and easily tolerated by patients, it holds promise for being incorporated into clinical trials providing cell specific approaches to monitoring diseases and therapeutic interventions. AO is being used to enhance the ability of OCT, fluorescence imaging, and reflectance imaging. By incorporating imaging that is sensitive to differences in the scattering properties of retinal tissue, it is especially sensitive to disease, which can drastically impact retinal tissue properties. This review examines human AO retinal imaging with a concentration on the use of the Adaptive Optics Scanning Laser Ophthalmoscope (AOSLO). It first covers the background and the overall approaches to human AO retinal imaging, and the technology involved, and then concentrates on using AO retinal imaging to study the structure and function of the retina.

Extended-image-based correction of aberrations using a deformable mirror with hysteresis

With a view to the next generation of large space telescopes, we investigate guide-star-free, image-based aberration correction using a unimorph deformable mirror in a plane conjugate to the primary mirror. We designed and built a high-resolution imaging testbed to evaluate control algorithms. In this paper we use an algorithm based on the heuristic hill climbing technique and compare the correction in three different domains, namely the voltage domain, the domain of the Zernike modes, and the domain of the singular modes of the deformable mirror. Through our systematic experimental study, we found that successive control in two domains effectively counteracts uncompensated hysteresis of the deformable mirror.

Handheld Adaptive Optics Scanning Laser Ophthalmoscope

Adaptive optics scanning laser ophthalmoscopy (AOSLO) has enabled in vivo visualization and enhanced understanding of retinal structure and function. Current generation AOSLOs have a large footprint and are mainly limited to imaging cooperative adult subjects. To extend the application of AOSLO to new patient populations, we have designed the first portable handheld AOSLO (HAOSLO) system. By incorporating a novel computational wavefront sensorless AO algorithm and custom optics, we have miniaturized our HAOSLO to weigh less than 200 grams. HAOSLO imaged the cones closest to the fovea with a handheld probe in adults and captured the first AO-enhanced image of cones in infants.

Sub-Airy Confocal Adaptive Optics Scanning Ophthalmoscopy

Purpose

To demonstrate the viability of improving transverse image resolution in reflectance scanning adaptive optics ophthalmoscopy using sub-Airy disk confocal detection.

Methods

The foveal cone mosaic was imaged in five human subjects free of known eye disease using two custom adaptive optics scanning light ophthalmoscopes (AOSLOs) in reflectance with 7.75 and 4.30 mm pupil diameters. Confocal pinholes of 0.5, 0.6, 0.8, and 1.0 Airy disk diameters (ADDs) were used in a retinal conjugate plane before the light detector. Average cone photoreceptor intensity profile width and power spectrum were calculated for the resulting images. Detected energy using a model eye was recorded for each pinhole size.

Results

The cone photoreceptor mosaic is better resolved with decreasing confocal pinhole size, with the high spatial frequency content of the images enhanced in both the large- and small-pupil AOSLOs. The average cone intensity profile width was reduced by ∼15% with the use of a 0.5 ADD pinhole when compared to a 1.0 ADD, with an accompanying reduction in signal greater than a factor of four.

Conclusions

The use of sub-Airy disk confocal pinhole detection without increasing retinal light exposure results in a substantial improvement in image resolution at the cost of larger than predicted signal reduction.

Translational Relevance

Improvement in transverse resolution using sub-Airy disk confocal detection is a practical and low-cost approach that is applicable to all point- and line-scanning ophthalmoscopes, including optical coherence tomographers.

Underwater Turbulence Detection Using Gated Wavefront Sensing Technique

Laser sensing has been applied in various underwater applications, ranging from underwater detection to laser underwater communications. However, there are several great challenges when profiling underwater turbulence effects. Underwater detection is greatly affected by the turbulence effect, where the acquired image suffers excessive noise, blurring, and deformation. In this paper, we propose a novel underwater turbulence detection method based on a gated wavefront sensing technique. First, we elaborate on the operating principle of gated wavefront sensing and wavefront reconstruction. We then setup an experimental system in order to validate the feasibility of our proposed method. The effect of underwater turbulence on detection is examined at different distances, and under different turbulence levels. The experimental results obtained from our gated wavefront sensing system indicate that underwater turbulence can be detected and analyzed. The proposed gated wavefront sensing system has the advantage of a simple structure and high detection efficiency for underwater environments.

Adaptive optics retinal imaging with automatic detection of the pupil and its boundary in real time using Shack-Hartmann images

Retinal imaging with an adaptive optics (AO) system usually requires that the eye be centered and stable relative to the exit pupil of the system. Aberrations are then typically corrected inside a fixed circular pupil. This approach can be restrictive when imaging some subjects, since the pupil may not be round and maintaining a stable head position can be difficult. In this paper, we present an automatic algorithm that relaxes these constraints. An image quality metric is computed for each spot of the Shack-Hartmann image to detect the pupil and its boundary, and the control algorithm is applied only to regions within the subject's pupil. Images on a model eye as well as for five subjects were obtained to show that a system exit pupil larger than the subject's eye pupil could be used for AO retinal imaging without a reduction in image quality. This algorithm automates the task of selecting pupil size. It also may relax constraints on centering the subject's pupil and on the shape of the pupil.

Wavefront sensorless adaptive optics OCT with the DONE algorithm for in vivo human retinal imaging [Invited]

In this report, which is an international collaboration of OCT, adaptive optics, and control research, we demonstrate the Data-based Online Nonlinear Extremum-seeker (DONE) algorithm to guide the image based optimization for wavefront sensorless adaptive optics (WFSL-AO) OCT for in vivo human retinal imaging. The ocular aberrations were corrected using a multi-actuator adaptive lens after linearization of the hysteresis in the piezoelectric actuators. The DONE algorithm succeeded in drastically improving image quality and the OCT signal intensity, up to a factor seven, while achieving a computational time of 1 ms per iteration, making it applicable for many high speed applications. We demonstrate the correction of five aberrations using 70 iterations of the DONE algorithm performed over 2.8 s of continuous volumetric OCT acquisition. Data acquired from an imaging phantom and in vivo from human research volunteers are presented.

Software compensation method for achieving high stability of Alpao deformable mirrors

Deformable mirrors (DMs) are used in adaptive optics for correcting optical aberrations: the DM surface can be deformed to compensate for them. Recently we reported the results on investigation of the stability of Alpao DMs, i.e. how accurately a DM surface shape can be maintained over minutes and hours without any optical feed-back. We observed a creep behavior of the DM surface and we presented a proof-of-concept software compensation for it, showing that very high stability is achievable. In this paper we develop a generalized creep compensation method that covers a wide range of DM use-cases and compensates for 90% - 95% of the creep observed. Furthermore, we report an observation of a DM shape dependence on the magnitude of the DM steering commands over the last few minutes. This effect is likely due to the warming up of the structure supporting the DM surface. Similarly as for creep, we have developed a compensation in software which corrects for about 90% of this effect. Both compensation mechanisms are based solely on pre-calibration input and do not receive any optical feedback about the actual DM surface shape. With the application of these two compensation mechanisms, the Alpao DM exhibits excellent stability and is well suited for feed-forward operation, where high reliability of the DM surface is crucial for operation in the absence of an optical feedback.

Optical coherence tomography with a 2.8-mm beam diameter and sensorless defocus and astigmatism correction

An optical coherence tomography (OCT) system with a 2.8-mm beam diameter is presented. Sensorless defocus correction can be performed with a Badal optometer and astigmatism correction with a liquid crystal device. OCT B-scans were used in an image-based optimization algorithm for aberration correction. Defocus can be corrected from ? 4.3 ?? D to + 4.3 ?? D and vertical and oblique astigmatism from ? 2.5 ?? D to + 2.5 ?? D . A contrast gain of 6.9 times was measured after aberration correction. In comparison with a 1.3-mm beam diameter OCT system, this concept achieved a 3.7-dB gain in dynamic range on a model retina. Both systems were used to image the retina of a human subject. As the correction of the liquid crystal device can take more than 60 s, the subject’s spectacle prescription was adopted instead. This resulted in a 2.5 times smaller speckle size compared with the standard OCT system. The liquid crystal device for astigmatism correction does not need a high-voltage amplifier and can be operated at 5 V. The correction device is small ( 9 ?? mm × 30 ?? mm × 38 ?? mm ) and can easily be implemented in existing designs for OCT.

Fabricating customized hydrogel contact lens

Contact lenses are increasingly used in laboratories for in vivo animal retinal imaging and pre-clinical studies. The lens shapes often need modification to optimally fit corneas of individual test subjects. However, the choices from commercially available contact lenses are rather limited. Here, we report a flexible method to fabricate customized hydrogel contact lenses. We showed that the fabricated hydrogel is highly transparent, with refractive indices ranging from 1.42 to 1.45 in the spectra range from 400 nm to 800 nm. The Young’s modulus (1.47 MPa) and hydrophobicity (with a sessile drop contact angle of 40.5°) have also been characterized experimentally. Retinal imaging using optical coherence tomography in rats wearing our customized contact lenses has the quality comparable to the control case without the contact lens. Our method could significantly reduce the cost and the lead time for fabricating soft contact lenses with customized shapes, and benefit the laboratorial-used contact lenses in pre-clinical studies.

Lens-based wavefront sensorless adaptive optics swept source OCT

Optical coherence tomography (OCT) has revolutionized modern ophthalmology, providing depth resolved images of the retinal layers in a system that is suited to a clinical environment. Although the axial resolution of OCT system, which is a function of the light source bandwidth, is sufficient to resolve retinal features at a micrometer scale, the lateral resolution is dependent on the delivery optics and is limited by ocular aberrations. Through the combination of wavefront sensorless adaptive optics and the use of dual deformable transmissive optical elements, we present a compact lens-based OCT system at an imaging wavelength of 1060 nm for high resolution retinal imaging. We utilized a commercially available variable focal length lens to correct for a wide range of defocus commonly found in patient’s eyes, and a novel multi-actuator adaptive lens for aberration correction to achieve near diffraction limited imaging performance at the retina. With a parallel processing computational platform, high resolution cross-sectional and en face retinal image acquisition and display was performed in real time. In order to demonstrate the system functionality and clinical utility, we present images of the photoreceptor cone mosaic and other retinal layers acquired in vivo from research subjects.

Wavefront sensorless adaptive optics fluorescence biomicroscope for in vivo retinal imaging in mice

Cellular-resolution in vivo fluorescence imaging is a valuable tool for longitudinal studies of retinal function in vision research. Wavefront sensorless adaptive optics (WSAO) is a developing technology that enables high-resolution imaging of the mouse retina. In place of the conventional method of using a Shack-Hartmann wavefront sensor to measure the aberrations directly, WSAO uses an image quality metric and a search algorithm to drive the shape of the adaptive element (i.e. deformable mirror). WSAO is a robust approach to AO and it is compatible with a compact, low-cost lens-based system. In this report, we demonstrated a hill-climbing algorithm for WSAO with a variable focus lens and deformable mirror for non-invasive in vivo imaging of EGFP (enhanced green fluorescent protein) labelled ganglion cells and microglia cells in the mouse retina.

Adaptive optics ophthalmoscopy

This review starts with a brief history and description of adaptive optics (AO) technology, followed by a showcase of the latest capabilities of AO systems for imaging the human retina and an extensive review of the literature on where AO is being used clinically. The review concludes with a discussion on future directions and guidance on usage and interpretation of images from AO systems for the eye.

Investigating the influence of chromatic aberration and optical illumination bandwidth on fundus imaging in rats

Abstract. Rodent models are indispensable in studying various retinal diseases. Noninvasive, high-resolution retinal imaging of rodent models is highly desired for longitudinally investigating the pathogenesis and therapeutic strategies. However, due to severe aberrations, the retinal image quality in rodents can be much worse than that in humans. We numerically and experimentally investigated the influence of chromatic aberration and optical illumination bandwidth on retinal imaging. We confirmed that the rat retinal image quality decreased with increasing illumination bandwidth. We achieved the retinal image resolution of 10  μm using a 19 nm illumination bandwidth centered at 580 nm in a home-built fundus camera. Furthermore, we observed higher chromatic aberration in albino rat eyes than in pigmented rat eyes. This study provides a design guide for high-resolution fundus camera for rodents. Our method is also beneficial to dispersion compensation in multiwavelength retinal imaging applications.

Contrast-based sensorless adaptive optics for retinal imaging

Conventional adaptive optics ophthalmoscopes use wavefront sensing methods to characterize ocular aberrations for real-time correction. However, there are important situations in which the wavefront sensing step is susceptible to difficulties that affect the accuracy of the correction. To circumvent these, wavefront sensorless adaptive optics (or non-wavefront sensing AO; NS-AO) imaging has recently been developed and has been applied to point-scanning based retinal imaging modalities. In this study we show, for the first time, contrast-based NS-AO ophthalmoscopy for full-frame in vivo imaging of human and animal eyes. We suggest a robust image quality metric that could be used for any imaging modality, and test its performance against other metrics using (physical) model eyes.