Modelling the application of adaptive optics to wide-field microscope live imaging

Light-sheets and smart microscopy, an exciting future is dawning

Light-sheet fluorescence microscopy has transformed our ability to visualize and quantitatively measure biological processes rapidly and over long time periods. In this review, we discuss current and future developments in light-sheet fluorescence microscopy that we expect to further expand its capabilities. This includes smart and adaptive imaging schemes to overcome traditional imaging trade-offs, i.e., spatiotemporal resolution, field of view and sample health. In smart microscopy, a microscope will autonomously decide where, when, what and how to image. We further assess how image restoration techniques provide avenues to overcome these tradeoffs and how "open top" light-sheet microscopes may enable multi-modal imaging with high throughput. As such, we predict that light-sheet microscopy will fulfill an important role in biomedical and clinical imaging in the future.

Efficient framework of solving time-gated reflection matrix for imaging through turbid medium

Imaging through turbid medium is a long pursuit in many research fields, such as biomedicine, astronomy and automatic vehicle, in which the reflection matrix-based method is a promising solution. However, the epi-detection geometry suffers from round-trip distortion and it is challenging to isolate the input and output aberrations in non-ideal cases due to system imperfections and measurement noises. Here, we present an efficient framework based on single scattering accumulation together with phase unwrapping that can accurately separate input and output aberrations from the noise-affected reflection matrix. We propose to only correct the output aberration while suppressing the input aberration by incoherent averaging. The proposed method is faster in convergence and more robust against noise, avoiding precise and tedious system adjustments. In both simulations and experiments, we demonstrate the diffraction-limited resolution capability under optical thickness beyond 10 scattering mean free paths, showing the potential of applications in neuroscience and dermatology.

Adaptive optics for optical microscopy [Invited]

Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.

Differentiable model-based adaptive optics with transmitted and reflected light

Aberrations limit optical systems in many situations, for example when imaging in biological tissue. Machine learning offers novel ways to improve imaging under such conditions by learning inverse models of aberrations. Learning requires datasets that cover a wide range of possible aberrations, which however becomes limiting for more strongly scattering samples, and does not take advantage of prior information about the imaging process. Here, we show that combining model-based adaptive optics with the optimization techniques of machine learning frameworks can find aberration corrections with a small number of measurements. Corrections are determined in a transmission configuration through a single aberrating layer and in a reflection configuration through two different layers at the same time. Additionally, corrections are not limited by a predetermined model of aberrations (such as combinations of Zernike modes). Focusing in transmission can be achieved based only on reflected light, compatible with an epidetection imaging configuration.

Distortion matrix concept for deep optical imaging in scattering media

In optical imaging, light propagation is affected by the inhomogeneities of the medium. Sample-induced aberrations and multiple scattering can strongly degrade the image resolution and contrast. On the basis of a dynamic correction of the incident and/or reflected wavefronts, adaptive optics has been used to compensate for those aberrations. However, it only applies to spatially invariant aberrations or to thin aberrating layers. Here, we propose a global and noninvasive approach based on the distortion matrix concept. This matrix basically connects any focusing point of the image with the distorted part of its wavefront in reflection. A singular value decomposition of the distortion matrix allows to correct for high-order aberrations and forward multiple scattering over multiple isoplanatic modes. Proof-of-concept experiments are performed through biological tissues including a turbid cornea. We demonstrate a Strehl ratio enhancement up to 2500 and recover a diffraction-limited resolution until a depth of 10 scattering mean free paths.

Wavefront correction for adaptive optics with reflected light and deep neural networks

Light scattering and aberrations limit optical microscopy in biological tissue, which motivates the development of adaptive optics techniques. Here, we develop a method for wavefront correction in adaptive optics with reflected light and deep neural networks compatible with an epi-detection configuration. Large datasets of sample aberrations which consist of excitation and detection path aberrations as well as the corresponding reflected focus images are generated. These datasets are used for training deep neural networks. After training, these networks can disentangle and independently correct excitation and detection aberrations based on reflected light images recorded from scattering samples. A similar deep learning approach is also demonstrated with scattering guide stars. The predicted aberration corrections are validated using two photon imaging.

Extended field-of-view adaptive optics in microscopy via numerical field segmentation

Sample-induced optical aberrations in microscopy are, in general, field dependent, limiting their correction via pupil adaptive optics (AO) to the center of the available field-of-view (FoV). This is a major hindrance, particularly for deep tissue imaging, where AO has a significant impact. We present a new wide-field AO microscopy scheme, in which the deformable element is located at the pupil plane of the objective. To maintain high-quality correction across its entirety, the FoV is partitioned into small segments, and a separate aberration estimation is performed for each via a modal-decomposition-based indirect wavefront sensing algorithm. A final full-field image is synthesized by stitching of the partitions corrected consecutively and independently via their respective measured aberrations. The performance and limitations of the method are experimentally explored on synthetic samples imaged via a custom-developed AO fluorescence microscope featuring an optofluidic refractive wavefront modulator.

Nanosheet wrapping-assisted coverslip-free imaging for looking deeper into a tissue at high resolution

In order to achieve deep tissue imaging, a number of optical clearing agents have been developed. However, in a conventional microscopy setup, an objective lens can only be moved until it is in contact with a coverslip, which restricts the maximum focusing depth into a cleared tissue specimen. Until now, it is still a fact that the working distance of a high magnification objective lens with a high numerical aperture is always about 100 μm. In this study, a polymer thin film (also called as nanosheet) composed of fluoropolymer with a thickness of 130 nm, less than one-thousandth that of a 170 μm thick coverslip, is employed to replace the coverslip. Owing to its excellent characteristics, such as high optical transparency, mechanical robustness, chemical resistance, and water retention ability, nanosheet is uniquely capable of providing a coverslip-free imaging. By wrapping the tissue specimen with a nanosheet, an extra distance of 170 μm for the movement of objective lens is obtained. Results show an equivalently high resolution imaging can be obtained if a homogenous refractive index between immersion liquid and mounting media is adjusted. This method will facilitate a variety of imaging tasks with off-the-shelf high magnification objectives.

Five-dimensional two-photon volumetric microscopy of in-vivo dynamic activities using liquid lens remote focusing

Multi-photon scanning microscopy provides a robust tool for optical sectioning, which can be used to capture fast biological events such as blood flow, mitochondrial activity, and neuronal action potentials. For many studies, it is important to visualize several different focal planes at a rate akin to the biological event frequency. Typically, a microscope is equipped with mechanical elements to move either the sample or the objective lens to capture volumetric information, but these strategies are limited due to their slow speeds or inertial artifacts. To overcome this problem, remote focusing methods have been developed to shift the focal plane axially without physical movement of the sample or the microscope. Among these methods is liquid lens technology, which adjusts the focus of the lens by changing the wettability of the liquid and hence its curvature. Liquid lenses are inexpensive active optical elements that have the potential for fast multi-photon volumetric imaging, hence a promising and accessible approach for the study of biological systems with complex dynamics. Although remote focusing using liquid lens technology can be used for volumetric point scanning multi-photon microscopy, optical aberrations and the effects of high energy laser pulses have been concerns in its implementation. In this paper, we characterize a liquid lens and validate its use in relevant biological applications. We measured optical aberrations that are caused by the liquid lens, and calculated its response time, defocus hysteresis, and thermal response to a pulsed laser. We applied this method of remote focusing for imaging and measurement of multiple in-vivo specimens, including mesenchymal stem cell dynamics, mouse tibialis anterior muscle mitochondrial electrical potential fluctuations, and mouse brain neural activity. Our system produces 5 dimensional (x,y,z,λ,t) data sets at the speed of 4.2 volumes per second over volumes as large as 160 x 160 x 35 µm³.

Structured illumination approaches for super-resolution in plant cells

The advent of super-resolution techniques in biological microscopy has opened new frontiers for exploring the molecular distribution of proteins and small molecules in cells. Improvements in optical design and innovations in the approaches for the collection of fluorescence emission have produced substantial gains in signal from chemical labels and fluorescent proteins. Structuring the illumination to elicit fluorescence from specific or even random patterns allows the extraction of higher order spatial frequencies from specimens labeled with conventional probes. Application of this approach to plant systems for super-resolution imaging has been relatively slow owing in large part to aberrations incurred when imaging through the plant cell wall. In this brief review, we address the use of two prominent methods for generating super-resolution images in living plant specimens and discuss future directions for gaining better access to these techniques.

Adaptive optical versus spherical aberration corrections for in vivo brain imaging

Adjusting the objective correction collar is a widely used approach to correct spherical aberrations (SA) in optical microscopy. In this work, we characterized and compared its performance with adaptive optics in the context of in vivo brain imaging with two-photon fluorescence microscopy. We found that the presence of sample tilt had a deleterious effect on the performance of SA-only correction. At large tilt angles, adjusting the correction collar even worsened image quality. In contrast, adaptive optical correction always recovered optimal imaging performance regardless of sample tilt. The extent of improvement with adaptive optics was dependent on object size, with smaller objects having larger relative gains in signal intensity and image sharpness. These observations translate into a superior performance of adaptive optics for structural and functional brain imaging applications in vivo, as we confirmed experimentally.

Large-field-of-view imaging by multi-pupil adaptive optics

For in vivo deep imaging at high spatiotemporal resolutions, we developed Multi-Pupil Adaptive Optics (MPAO) which enables simultaneous wavefront correction over a large imaging field-of-view. The current implementation improves correction area by nine times over that of conventional methods. MPAO’s capability of spatially independent wavefront control further enables 3D nonplanar imaging. We applied MPAO to in vivo structural and functional imaging of biological dynamics in mammalian brain.

Fast axial scanning for 2-photon microscopy using liquid lens technology

Scanning microscopy methods require movement of the focus in Z coordinates to produce an image of a 3-dimensional volume. In a typical imaging system, the optical setup is kept fixed and either the sample or the objective is translated with a mechanical stage driven by a stepper motor or a piezoelectric element. Mechanical Z scanning is precise, but its slow response and vulnerability to mechanical vibrations and stress make it disadvantageous to image dynamic, time-varying samples such as live cell structures. An alternative method less susceptible to these problems is to change the focal plane using conjugate optics. Deformable mirrors, acoustooptics, and electrically tunable lenses have been experimented with to achieve this goal and have attained very fast and precise Z-scanning without physically moving the sample. Here, we present the use of a liquid lens for fast axial scanning. Liquid lenses have a long functional life, high degree of phase shift, and low sensitivity to mechanical stress. They work on the principle of refraction at a liquid-liquid interface. At the boundary of a polar and an apolar liquid a spherical surface is formed whose curvature can be controlled by adjusting its relative wettability using electrowetting. We characterize the effects of the lens on attainable Z displacement, beam spectral characteristics, and pulse duration as compared with mechanical scanning.

In vivo volumetric imaging of biological dynamics in deep tissue via wavefront engineering

Biological systems undergo dynamical changes continuously which span multiple spatial and temporal scales. To study these complex biological dynamics in vivo, high-speed volumetric imaging that can work at large imaging depth is highly desired. However, deep tissue imaging suffers from wavefront distortion, resulting in reduced Strehl ratio and image quality. Here we combine the two wavefront engineering methods developed in our lab, namely the optical phase-locked ultrasound lens based volumetric imaging and the iterative multiphoton adaptive compensation technique, and demonstrate in vivo volumetric imaging of microglial and mitochondrial dynamics at large depth in mouse brain cortex and lymph node, respectively.

Axial range of conjugate adaptive optics in two-photon microscopy

We describe an adaptive optics technique for two-photon microscopy in which the deformable mirror used for aberration compensation is positioned in a plane conjugate to the plane of the aberration. We demonstrate in a proof-of-principle experiment that this technique yields a large field of view advantage in comparison to standard pupil-conjugate adaptive optics. Further, we show that the extended field of view in conjugate AO is maintained over a relatively large axial translation of the deformable mirror with respect to the conjugate plane. We conclude with a discussion of limitations and prospects for the conjugate AO technique in two-photon biological microscopy.

High-resolution in vivo imaging of mouse brain through the intact skull

Multiphoton microscopy is the current method of choice for in vivo deep-tissue imaging. The long laser wavelength suffers less scattering, and the 3D-confined excitation permits the use of scattered signal light. However, the imaging depth is still limited because of the complex refractive index distribution of biological tissue, which scrambles the incident light and destroys the optical focus needed for high resolution imaging. Here, we demonstrate a wavefront-shaping scheme that allows clear imaging through extremely turbid biological tissue, such as the skull, over an extended corrected field of view (FOV). The complex wavefront correction is obtained and directly conjugated to the turbid layer in a noninvasive manner. Using this technique, we demonstrate in vivo submicron-resolution imaging of neural dendrites and microglia dynamics through the intact skulls of adult mice. This is the first observation, to our knowledge, of dynamic morphological changes of microglia through the intact skull, allowing truly noninvasive studies of microglial immune activities free from external perturbations.

Field of view advantage of conjugate adaptive optics in microscopy applications

The imaging performance of an optical microscope can be degraded by sample-induced aberrations. A general strategy to undo the effect of these aberrations is to apply wavefront correction with a deformable mirror (DM). In most cases the DM is placed conjugate to the microscope pupil, called pupil adaptive optics (AO). When the aberrations are spatially variant an alternative configuration involves placing the DM conjugate to the main source of aberrations, called conjugate AO. We provide a theoretical and experimental comparison of both configurations for the simplified case where spatially variant aberrations are produced by a well-defined phase screen. We pay particular attention to the resulting correction field of view (FOV). Conjugate AO is found to provide a significant FOV advantage. While this result is well known in the astronomical community, our goal here is to recast it specifically for the optical microscopy community.

Phase diversity for three-dimensional imaging

Phase diversity (PD) is a powerful technique for estimating wavefront aberrations from two-dimensional images of extended scenes. PD can work with extended incoherent images and, in an adaptive optics system, does not need extra hardware in addition to the deformable mirror. For these reasons, PD should be well suited to aberration measurement in microscopy applications. But, in biological widefield microscopy, the objects being imaged are frequently three-dimensional, and the images contain out-of-focus light. In this paper, we introduce multiplane PD and show that PD can be extended to widefield imaging of three-dimensional objects. This should be particularly useful in the field of biological fluorescence microscopy where the objects are very light sensitive and the aberrations cannot easily be determined.

Characterizing the 3-D field distortions in low numerical aperture fluorescence zooming microscope

In this article, we characterize the lateral field distortions in a low numerical aperture and large field-of-view (FOV) fluorescence imaging system. To this end, we study a commercial fluorescence MACROscope setup, which is a zooming microscope. The versatility of this system lies in its ability to image at different zoom ranges, so that sample preparations can be examined in three-dimensions, at cellular, organ and whole body levels. Yet, we found that the imaging system's optics are optimized only for high magnifications where the observed FOV is small. When we studied the point-spread function (PSF) by using fluorescent polystyrene beads as "guide-stars", we noticed that the PSF is spatially varying due to field distortions. This variation was found to be laterally symmetrical and the distortions were found to increase with the distance from the center of the FOV. In this communication, we investigate the idea of using the field at the back focal plane of an optical system for characterizing distortions. As this field is unknown, we develop a theoretical framework to retrieve the amplitude and phase of the field at the back focal pupil plane, from the empirical bead images. By using the retrieved amplitude, we can understand and characterize the underlying cause of these distortions. We also propose a few approaches, before acquisition, to either avoid it or correct it at the optical design level.

Effect of depth dependent spherical aberrations in 3D structured illumination microscopy

We model the effect of depth dependent spherical aberration caused by a refractive index mismatch between the mounting and immersion mediums in a 3D structured illumination microscope (SIM). We first derive a forward model that takes into account the effect of the depth varying aberrations on both the illumination and the detection processes. From the model, we demonstrate that depth dependent spherical aberration leads to loss of signal only due to its effect on the detection response of the system, while its effect on illumination leads to phase shifts between orders that can be handled computationally in the reconstruction process. Further, by using the model, we provide guidelines for optical corrections of aberrations with different complexities, and explain how the proposed corrections simplify the forward model. Finally, we show that it is possible to correct both illumination and detection aberrations using a deformable mirror only on the detection path of the microscope.

PSF shaping using adaptive optics for three-dimensional single-molecule super-resolution imaging and tracking

We present a novel approach for three-dimensional localization of single molecules using adaptive optics. A 52-actuator deformable mirror is used to both correct aberrations and induce two-dimensional astigmatism in the point-spread-function. The dependence of the z-localization precision on the degree of astigmatism is discussed. We achieve a z-localization precision of 40 nm for fluorescent proteins and 20 nm for fluorescent dyes, over an axial depth of ~800 nm. We illustrate the capabilities of our approach for three-dimensional high-resolution microscopy with super-resolution images of actin filaments in fixed cells and single-molecule tracking of quantum-dot labeled transmembrane proteins in live HeLa cells.

Point-spread function engineering to reduce the impact of spherical aberration on 3D computational fluorescence microscopy imaging

Wavefront encoding (WFE) with different cubic phase mask designs was investigated in engineering 3D point-spread functions (PSF) to reduce their sensitivity to depth-induced spherical aberration (SA) which affects computational complexity in 3D microscopy imaging. The sensitivity of WFE-PSFs to defocus and to SA was evaluated as a function of phase mask parameters using mean-square-error metrics to facilitate the selection of mask designs for extended-depth-of-field (EDOF) microscopy and for computational optical sectioning microscopy (COSM). Further studies on pupil phase contribution and simulated WFE-microscope images evaluated the engineered PSFs and demonstrated SA insensitivity over sample depths of 30 μm. Despite its low sensitivity to SA, the successful WFE design for COSM maintains a high sensitivity to defocus as it is desired for optical sectioning.

Measurement and correction of in vivo sample aberrations employing a nonlinear guide-star in two-photon excited fluorescence microscopy

We demonstrate that sample induced aberrations can be measured in a nonlinear microscope. This uses the fact that two-photon excited fluorescence naturally produces a localized point source inside the sample: the nonlinear guide-star (NL-GS). The wavefront emitted from the NL-GS can then be recorded using a Shack-Hartmann sensor. Compensation of the recorded sample aberrations is performed by the deformable mirror in a single-step. This technique is applied to fixed and in vivo biological samples, showing, in some cases, more than one order of magnitude improvement in the total collected signal intensity.

Adaptive optics for fluorescence wide-field microscopy using spectrally independent guide star and markers

We describe the implementation and use of an adaptive optics loop in the imaging path of a commercial wide field microscope. We show that it is possible to maintain the optical performances of the original microscope when imaging through aberrant biological samples. The sources used for illuminating the adaptive optics loop are spectrally independent, in excitation and emission, from the sample, so they do not appear in the final image, and their use does not contribute to the sample bleaching. Results are compared with equivalent images obtained with an identical microscope devoid of adaptive optics system.

Live cell imaging in Drosophila melanogaster

Although many of the techniques of live cell imaging in Drosophila melanogaster are also used by the greater community of cell biologists working on other model systems, studying living fly tissues presents unique difficulties with regard to keeping the cells alive, introducing fluorescent probes, and imaging through thick, hazy cytoplasm. This article outlines the major tissue types amenable to study by time-lapse cinematography and different methods for keeping the cells alive. It describes various imaging and associated techniques best suited to following changes in the distribution of fluorescently labeled molecules in real time in these tissues. Imaging, in general, is a rapidly developing discipline, and recent advances in imaging technology are able to greatly extend what can be achieved with live cell imaging of Drosophila tissues. As far as possible, this article includes the latest technical developments and discusses likely future developments in imaging methods that could have an impact on research using Drosophila.

High-resolution wide-field microscopy with adaptive optics for spherical aberration correction and motionless focusing

Live imaging in cell biology requires three-dimensional data acquisition with the best resolution and signal-to-noise ratio possible. Depth aberrations are a major source of image degradation in three-dimensional microscopy, causing a significant loss of resolution and intensity deep into the sample. These aberrations occur because of the mismatch between the sample refractive index and the immersion medium index. We have built a wide-field fluorescence microscope that incorporates a large-throw deformable mirror to simultaneously focus and correct for depth aberration in three-dimensional imaging. Imaging fluorescent beads in water and glycerol with an oil immersion lens we demonstrate a corrected point spread function and a 2-fold improvement in signal intensity. We apply this new microscope to imaging biological samples, and show sharper images and improved deconvolution.

Fast 4D Microscopy

Many cellular processes involve fast movements of weakly labeled cellular structures in all directions, which should be recorded in 3D time-lapse microscopy (4D microscopy). This chapter introduces fast 4D imaging, which is used for sampling the cell's volume by collecting focal planes in time-lapse mode as rapidly as possible, without perturbing the sample by strong illumination. The final images should contain sufficient contrast allowing for the isolation of structures of interest by segmentation and the analysis of their intracellular movements by tracking. Because they are the most sensitive, systems using wide-field microscopy and deconvolution techniques are discussed in greater depth. We discuss important points to consider, including system components and multifunctionality, spatial resolution and sampling conditions, and mechanical and optical stability and how to test for it. We consider image formation using high numerical aperture optics and discuss the influence of optical blur and noise on image formation of living cells. Spherical aberrations, their consequences for axial image quality, and their impact on the success of deconvolution of low intensity image stacks are explained in detail. Simple protocols for acquiring and treating point spread functions (PSFs) and live cells are provided. A compromise for counteracting spherical aberration involving the use of a kit of immersion oils for PSF and cell acquisition is illustrated. Recommendations for evaluating acquisition conditions and deconvolution parameters are given. Finally, we discuss future developments based on the use of adaptive optics which will push back many of today's limits.

Adaptive optics in microscopy

The imaging properties of optical microscopes are often compromised by aberrations that reduce image resolution and contrast. Adaptive optics technology has been employed in various systems to correct these aberrations and restore performance. This has required various departures from the traditional adaptive optics schemes that are used in astronomy. This review discusses the sources of aberrations, their effects and their correction with adaptive optics, particularly in confocal and two-photon microscopes. Different methods of wavefront sensing, indirect aberration measurement and aberration correction devices are discussed. Applications of adaptive optics in the related areas of optical data storage, optical tweezers and micro/nanofabrication are also reviewed.