Practical implementation of adaptive optics in multiphoton microscopy

Spatial frequency-based correction of the spherical aberration in living brain imaging

Optical errors, including spherical aberrations, hinder high-resolution imaging of biological samples due to biochemical components and physical properties. We developed the Deep-C microscope system to achieve aberration-free images, employing a motorized correction collar and contrast-based calculations. However, current contrast-maximization techniques, such as the Brenner gradient method, inadequately assess specific frequency bands. The Peak-C method addresses this issue, but its arbitrary neighbor selection and susceptibility to the noise limit its effectiveness. In this paper, we emphasize the importance of a broad spatial frequency range for accurate spherical aberration correction and propose Peak-F. This spatial frequency-based system utilizes a fast Fourier transform as a bandpass filter. This approach overcomes Peak-C's limitations and comprehensively covers the low-frequency domain of image spatial frequencies.

Microscopic image recognition of diatoms based on deep learning

Diatoms are a crucial component in the study of aquatic ecosystems and ancient environmental records. However, traditional methods for identifying diatoms, such as morphological taxonomy and molecular detection, are costly, are time consuming, and have limitations. To address these issues, we developed an extensive collection of diatom images, consisting of 7983 images from 160 genera and 1042 species, which we expanded to 49,843 through preprocessing, segmentation, and data augmentation. Our study compared the performance of different algorithms, including backbones, batch sizes, dynamic data augmentation, and static data augmentation on experimental results. We determined that the ResNet152 network outperformed other networks, producing the most accurate results with top-1 and top-5 accuracies of 85.97% and 95.26%, respectively, in identifying 1042 diatom species. Additionally, we propose a method that combines model prediction and cosine similarity to enhance the model's performance in low-probability predictions, achieving an 86.07% accuracy rate in diatom identification. Our research contributes significantly to the recognition and classification of diatom images and has potential applications in water quality assessment, ecological monitoring, and detecting changes in aquatic biodiversity.

Universal adaptive optics for microscopy through embedded neural network control

The resolution and contrast of microscope imaging is often affected by aberrations introduced by imperfect optical systems and inhomogeneous refractive structures in specimens. Adaptive optics (AO) compensates these aberrations and restores diffraction limited performance. A wide range of AO solutions have been introduced, often tailored to a specific microscope type or application. Until now, a universal AO solution - one that can be readily transferred between microscope modalities - has not been deployed. We propose versatile and fast aberration correction using a physics-based machine learning assisted wavefront-sensorless AO control (MLAO) method. Unlike previous ML methods, we used a specially constructed neural network (NN) architecture, designed using physical understanding of the general microscope image formation, that was embedded in the control loop of different microscope systems. The approach means that not only is the resulting NN orders of magnitude simpler than previous NN methods, but the concept is translatable across microscope modalities. We demonstrated the method on a two-photon, a three-photon and a widefield three-dimensional (3D) structured illumination microscope. Results showed that the method outperformed commonly-used modal-based sensorless AO methods. We also showed that our ML-based method was robust in a range of challenging imaging conditions, such as 3D sample structures, specimen motion, low signal to noise ratio and activity-induced fluorescence fluctuations. Moreover, as the bespoke architecture encapsulated physical understanding of the imaging process, the internal NN configuration was no-longer a "black box", but provided physical insights on internal workings, which could influence future designs.

Exploiting volumetric wave correlation for enhanced depth imaging in scattering medium

Imaging an object embedded within a scattering medium requires the correction of complex sample-induced wave distortions. Existing approaches have been designed to resolve them by optimizing signal waves recorded in each 2D image. Here, we present a volumetric image reconstruction framework that merges two fundamental degrees of freedom, the wavelength and propagation angles of light waves, based on the object momentum conservation principle. On this basis, we propose methods for exploiting the correlation of signal waves from volumetric images to better cope with multiple scattering. By constructing experimental systems scanning both wavelength and illumination angle of the light source, we demonstrated a 32-fold increase in the use of signal waves compared with that of existing 2D-based approaches and achieved ultrahigh volumetric resolution (lateral resolution: 0.41 [Formula: see text], axial resolution: 0.60 [Formula: see text]) even within complex scattering medium owing to the optimal coherent use of the broad spectral bandwidth (225 nm).

Adaptive optics for optical microscopy [Invited]

Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.

Differentiable optimization of the Debye-Wolf integral for light shaping and adaptive optics in two-photon microscopy

Control of light through a microscope objective with a high numerical aperture is a common requirement in applications such as optogenetics, adaptive optics, or laser processing. Light propagation, including polarization effects, can be described under these conditions using the Debye-Wolf diffraction integral. Here, we take advantage of differentiable optimization and machine learning for efficiently optimizing the Debye-Wolf integral for such applications. For light shaping we show that this optimization approach is suitable for engineering arbitrary three-dimensional point spread functions in a two-photon microscope. For differentiable model-based adaptive optics (DAO), the developed method can find aberration corrections with intrinsic image features, for example neurons labeled with genetically encoded calcium indicators, without requiring guide stars. Using computational modeling we further discuss the range of spatial frequencies and magnitudes of aberrations which can be corrected with this approach.

Imaging mitochondria through bone in live mice using two-photon fluorescence microscopy with adaptive optics

INTRODUCTION

Mitochondria are extremely important organelles in the regulation of bone marrow and brain activity. However, live imaging of these subcellular features with high resolution in scattering tissues like brain or bone has proven challenging.

METHODS

In this study, we developed a two-photon fluorescence microscope with adaptive optics (TPFM-AO) for high-resolution imaging, which uses a home-built Shack-Hartmann wavefront sensor (SHWFS) to correct system aberrations and a sensorless approach for correcting low order tissue aberrations.

RESULTS

Using AO increases the fluorescence intensity of the point spread function (PSF) and achieves fast imaging of subcellular organelles with 400 nm resolution through 85 μm of highly scattering tissue. We achieved ~1.55×, ~3.58×, and ~1.77× intensity increases using AO, and a reduction of the PSF width by ~0.83×, ~0.74×, and ~0.9× at the depths of 0, 50 μm and 85 μm in living mouse bone marrow respectively, allowing us to characterize mitochondrial health and the survival of functioning cells with a field of view of 67.5× 67.5 μm. We also investigate the role of initial signal and background levels in sample correction quality by varying the laser power and camera exposure time and develop an intensity-based criteria for sample correction.

DISCUSSION

This study demonstrates a promising tool for imaging of mitochondria and other organelles in optically distorting biological environments, which could facilitate the study of a variety of diseases connected to mitochondrial morphology and activity in a range of biological tissues.

Through-skull brain imaging in vivo at visible wavelengths via dimensionality reduction adaptive-optical microscopy

Compensation of sample-induced optical aberrations is crucial for visualizing microscopic structures deep within biological tissues. However, strong multiple scattering poses a fundamental limitation for identifying and correcting the tissue-induced aberrations. Here, we introduce a label-free deep-tissue imaging technique termed dimensionality reduction adaptive-optical microscopy (DReAM) to selectively attenuate multiple scattering. We established a theoretical framework in which dimensionality reduction of a time-gated reflection matrix can attenuate uncorrelated multiple scattering while retaining a single-scattering signal with a strong wave correlation, irrespective of sample-induced aberrations. We performed mouse brain imaging in vivo through the intact skull with the probe beam at visible wavelengths. Despite the strong scattering and aberrations, DReAM offered a 17-fold enhancement of single scattering-to-multiple scattering ratio and provided high-contrast images of neural fibers in the brain cortex with the diffraction-limited spatial resolution of 412 nanometers and a 33-fold enhanced Strehl ratio.

Closed-loop wavefront sensing and correction in the mouse brain with computed optical coherence microscopy

Optical coherence microscopy (OCM) uses interferometric detection to capture the complex optical field with high sensitivity, which enables computational wavefront retrieval using back-scattered light from the sample. Compared to a conventional wavefront sensor, aberration sensing with OCM via computational adaptive optics (CAO) leverages coherence and confocal gating to obtain signals from the focus with less cross-talk from other depths or transverse locations within the field-of-view. Here, we present an investigation of the performance of CAO-based aberration sensing in simulation, bead phantoms, and ex vivo mouse brain tissue. We demonstrate that, due to the influence of the double-pass confocal OCM imaging geometry on the shape of computed pupil functions, computational sensing of high-order aberrations can suffer from signal attenuation in certain spatial-frequency bands and shape similarity with lower order counterparts. However, by sensing and correcting only low-order aberrations (astigmatism, coma, and trefoil), we still successfully corrected tissue-induced aberrations, leading to 3× increase in OCM signal intensity at a depth of ∼0.9 mm in a freshly dissected ex vivo mouse brain.

Two-Photon Photoexcited Photodynamic Therapy with Water-Soluble Fullerenol Serving as the Highly Effective Two-Photon Photosensitizer Against Multidrug-Resistant Bacteria

Background

Multidrug-resistant (MDR) bacterial strain is a serious medical problem. Methicillin-resistant Staphylococcus aureus (MRSA) is resistant to many antibiotics and is often associated with several diseases such as arthritis, osteomyelitis, and endocarditis. The development of an alternative treatment for eliminating MDR bacteria such as MRSA has attracted a considerable amount of research attention. Moreover, the development of a material for highly efficient generation of reactive oxygen species (ROS) involving two-photon photodynamic therapy (PDT) is currently desirable.

Materials and Methods

We present an example demonstrating that the use of water-soluble C₆₀(OH)₃₀ fullerenol with a 0.89 singlet oxygen quantum yield serving as a photosensitizer in PDT has the superior ability in effectively generating ROS.

Results

It has ultra-low energy (228.80 nJ pixel^-1) and can perform 900 scans under two-photon excitation (TPE) in the near-infrared region (760 nm) to completely eliminate the MDR species. Furthermore, the favorable two-photon properties are absorption of approximately 760 nm in wavelength, absolute cross-section of approximately 1187.50 Göeppert-Mayer units, lifetime of 6.640 ns, ratio of radiative to nonradiative decay rates of approximately 0.053, and two-photon stability under TPE.

Conclusion

This enabled water-soluble C₆₀(OH)₃₀ fullerenol to act as a promising two-photon photosensitizer proceeding with PDT to easily eliminate MDR species.

Water-Soluble Fullerenol with Hydroxyl Group Dependence for Efficient Two-Photon Excited Photodynamic Inactivation of Infectious Microbes

We successfully prepared water-soluble fullerenol [C₆₀(OH)₄₆] that exhibited a high singlet oxygen quantum yield and efficiently generated reactive oxygen species. Additionally, the water-soluble C₆₀(OH)₄₆ with a higher composition of exposed hydroxyl groups had superior two-photon stability and characteristics compared with that with a lower composition of such groups. Therefore, the prepared fullerenol can be an effective two-photon photosensitizer. The water-soluble C₆₀(OH)₄₆ had favorable two-photon properties. During two-photon photodynamic therapy, the water-soluble C₆₀(OH)₄₆ had substantial antimicrobial activity against Escherichia coli at an ultralow-energy level of 211.2 nJ pixel^-1 with 800 scans and a photoexcited wavelength of 760 nm.

Amino-Functionalized Nitrogen-Doped Graphene-Quantum-Dot-Based Nanomaterials with Nitrogen and Amino-Functionalized Group Content Dependence for Highly Efficient Two-Photon Bioimaging

We fabricated nanomaterials comprising amino-functionalized and nitrogen-doped graphene quantum dots (amino-N-GQDs) and investigated their photostability and intrinsic luminescence in the near-infrared spectrum to determine their suitability as contrast agents in two-photon imaging (TPI). We observed that amino-N-GQDs with a higher amount of bonded nitrogen and amino-functionalized groups (6.2%) exhibited superior two-photon properties to those with a lower amount of such nitrogen and groups (4.9%). These materials were conjugated with polymers containing sulfur (polystyrene sulfonate, PSS) and nitrogen atoms (polyethylenimine, PEI), forming amino-N-GQD-PSS-PEI specimens (amino-N-GQD-polymers). The polymers exhibited a high quantum yield, remarkable stability, and notable two-photon properties and generated no reactive oxygen species, rendering them excellent two-photon contrast agents for bioimaging. An antiepidermal growth factor receptor (AbEGFR) was used for labeling to increase specificity. Two-photon imaging (TPI) of amino-N-GQD (6.2%)-polymer-AbEGFR-treated A431 cancer cells revealed remarkable brightness, intensity, and signal-to-noise ratios for each observation at a two-photon excitation power of 16.9 nJ pixel-1 under 30 scans and a three-dimensional (3D) depth of 105 µm, indicating that amino-N-GQD (6.2%)-polymer-AbEGFR-treated cells can achieve two-photon luminescence with 71 times less power required for two-photon autofluorescence (1322.8 nJ pixel-1 with 500 scans) of similar intensity. This economy can minimize photodamage to cells, rendering amino-N-GQD-polymers suitable for noninvasive 3D bioimaging.

High precision wavefront correction using an influence function optimization method based on a hybrid adaptive optics system

A hybrid adaptive optics (AO) system with an influence function (IF) optimization method is presented for high precision wavefront correction of a traditional Shack-Hartmann AO system. The hybrid AO system consists of a Shack-Hartmann wavefront sensor (SHWFS) and a deflectometry system (DS) to measure the wavefront of the laser beam and the IF of the deformable mirror, respectively. An IF optimization method is used to generate a hybrid IF (H-IF) through a position-calibration algorithm and a resolution-conversion algorithm by use of the original IFs measured by the SHWFS (S-IF) and the DS (D-IF). Configuration of the hybrid AO system is introduced. Principles and calculation results of the IF optimization method are presented. Comparison of the wavefront correction ability between the H-IF and the original IF is carried out in simulation. Closed-loop performance of the hybrid AO system using the H-IF is investigated in experiment. Simulation and experiment results show that for a traditional Shack-Hartmann AO system, the H-IF has better correction ability than the original S-IF and the IF optimization method could help improve closed-loop performance without sacrificing the simplicity of the system structure and the rapidity of the closed-loop correction.

Advances in adaptive optics-based two-photon fluorescence microscopy for brain imaging

Deep tissue imaging using two-photon fluorescence (TPF) techniques have revolutionized the optical imaging community by providing in depth molecular information at the single-cell level. These techniques provide structural and functional aspects of mammalian brain at unprecedented depth and resolution. However, wavefront distortions introduced by the optical system as well as the biological sample (tissue) limit the achievable fluorescence signal-to-noise ratio and resolution with penetration depth. In this review, we discuss on the advances in TPF microscopy techniques for in vivo functional imaging and offer guidelines as to which technologies are best suited for different imaging applications with special reference to adaptive optics.

Label-free neuroimaging in vivo using synchronous angular scanning microscopy with single-scattering accumulation algorithm

Label-free in vivo imaging is crucial for elucidating the underlying mechanisms of many important biological systems in their most native states. However, the applicability of existing modalities has been limited to either superficial layers or early developmental stages due to tissue turbidity. Here, we report a synchronous angular scanning microscope for the rapid interferometric recording of the time-gated reflection matrix, which is a unique matrix characterizing full light-specimen interaction. By applying single scattering accumulation algorithm to the recorded matrix, we removed both high-order sample-induced aberrations and multiple scattering noise with the effective aberration correction speed of 10,000 modes/s. We demonstrated in vivo imaging of whole neural network throughout the hindbrain of the larval zebrafish at a matured stage where physical dissection used to be required for conventional imaging. Our method will expand the scope of applications for optical imaging, where fully non-invasive interrogation of living specimens is critical.

A major challenge of in vivo imaging is imaging deeper, including in turbid tissue. The authors report an adaptive optics based microscope that uses coherent single scattering signal to reduce sample-induced aberrations and enable fast deep-tissue imaging of in vivo larval zebrafish brain.

Simulational and experimental investigation on the print-through high-frequency aberration of the shear-joint NIF deformable mirror

A shear-joint deformable mirror (DM) is important in the high-power laser systems such as the National Ignition Facility (NIF). In this paper, the print-through high-frequency aberration (PT-HIFA) that arises from adhesive curing and is corresponding to the actuator array is reported to exist in the initial surface shape of a lab-made shear-joint NIF DM. Meanwhile, experimental results show that the PT-HIFA has a great modulation on the laser intensity. This PT-HIFA could not be corrected effectively by the DM and may result in dangerous damage in the high power laser systems. In order to eliminate the PT-HIFA, we investigate the influence of the structural parameters on the PT-HIFA in a shear-joint DM through simulation and experiment. Simulational results show that the structural parameters have different influences on the PT-HIFA. In the experiment, by optimizing the structural parameters, the PT-HIFA could be eliminated in the shear-joint NIF DM and the modulation effect on the laser intensity could be removed. This investigation could help other researchers to determine appropriate structural parameters and to achieve a fine surface shape in their own shear-joint DMs.

High-resolution nonlinear fluorescence microscopy using repetitive stimulated transition based on the saturation of stimulated emission implemented with two-color continuous-wave lasers

High-resolution nonlinear fluorescence (NF) microscopy that utilizes repetitive stimulated transition due to the saturation of stimulated emission caused by two-color continuous-wave lasers was developed. The resulting NF signal, detected via the lock-in technique, is produced by the multiplicative combination of incident beams, which results in an improvement of the optical resolution. The proposed method is demonstrated to have a three-dimensional optical resolution superior to that of conventional NF microscopy. The results of biological imaging reveal the feasibility and superiority of the proposed method.

Accurate aberration correction in confocal microscopy based on modal sensorless method

Confocal microscopy has the advantages of high resolution and optical sectioning ability over conventional microscopy. However, aberration induced by the optical system can compromise these advantages and considerably reduce the energy reaching the pointlike detector. We propose an accurate aberration correction method with a liquid-crystal spatial light modulator (LCSLM) in the confocal system. Each coefficient of Zernike aberration modes is calculated by directly measuring the variance of the images with different bias aberration modes. Large-coefficient (>0.7 rad) aberration is compensated first by LCSLM, following which aberrations with small coefficients are measured precisely, minimizing the cross talk between different kinds of aberrations. With this predistortion strategy, the aberration correction is much more accurate, and maximum image intensity in the normal and nonconjugated systems is improved by 2.5 times and 4 times compared to the normal correction method, respectively, demonstrating the effectiveness of our method.

Inversion-free image recovery from strong aberration using a minimally sampled transmission matrix

A transmission matrix (TM), a characteristic response for an input-output relation of an optical system, has been used for achieving diffraction-limited and aberration-free images through highly-aberrant imaging systems. However, its requirement of acquiring a huge-size TM along with its heavy computational load limit its widespread applications. Here we propose a method for TM-based image reconstruction, which is more efficient in terms of data manipulation and computational time. Only 10% of the TM elements for a fish-eye (FE) lens with strong aberration were sampled compared to that required for the image reconstruction by the conventional inversion method. The missing information was filled in by an iterative interpolation algorithm working in k-space. In addition, as a replacement of the time-consuming matrix inversion process, a phase pattern was created from the minimally sampled TM in order to compensate for the angle-dependent phase retardation caused by the FE lens. The focal distortion could be corrected by applying the phase correction pattern to the angular spectrums of the measured object images. The remaining spatial distortion could also be determined through the geometrical transformation also determined by the minimally sampled TM elements. Through the use of these procedures, the object image can be reconstructed 55 times faster than through the use of the usual inversion method using the full-sized TM, without compromising the reconstruction performances.

Adaptive optics imaging of the human retina

Adaptive Optics (AO) retinal imaging has provided revolutionary tools to scientists and clinicians for studying retinal structure and function in the living eye. From animal models to clinical patients, AO imaging is changing the way scientists are approaching the study of the retina. By providing cellular and subcellular details without the need for histology, it is now possible to perform large scale studies as well as to understand how an individual retina changes over time. Because AO retinal imaging is non-invasive and when performed with near-IR wavelengths both safe and easily tolerated by patients, it holds promise for being incorporated into clinical trials providing cell specific approaches to monitoring diseases and therapeutic interventions. AO is being used to enhance the ability of OCT, fluorescence imaging, and reflectance imaging. By incorporating imaging that is sensitive to differences in the scattering properties of retinal tissue, it is especially sensitive to disease, which can drastically impact retinal tissue properties. This review examines human AO retinal imaging with a concentration on the use of the Adaptive Optics Scanning Laser Ophthalmoscope (AOSLO). It first covers the background and the overall approaches to human AO retinal imaging, and the technology involved, and then concentrates on using AO retinal imaging to study the structure and function of the retina.

Handheld Adaptive Optics Scanning Laser Ophthalmoscope

Adaptive optics scanning laser ophthalmoscopy (AOSLO) has enabled in vivo visualization and enhanced understanding of retinal structure and function. Current generation AOSLOs have a large footprint and are mainly limited to imaging cooperative adult subjects. To extend the application of AOSLO to new patient populations, we have designed the first portable handheld AOSLO (HAOSLO) system. By incorporating a novel computational wavefront sensorless AO algorithm and custom optics, we have miniaturized our HAOSLO to weigh less than 200 grams. HAOSLO imaged the cones closest to the fovea with a handheld probe in adults and captured the first AO-enhanced image of cones in infants.

Simulational and experimental investigation on the actuator-corresponding high-frequency aberration of the piezoelectric stacked array deformable mirror

The high-frequency aberrations (HIFAs) that are corresponding to the actuator array have been reported to exist on the initial surface shape of many deformable mirrors (DMs), such as the bimorph DM, the unimorph DM, the monomorph DM, and the membrane DM. This actuator-corresponding high-frequency aberration (AC-HIFA) could not be corrected effectively by the DM and would limit the correction ability of the DM. In this paper, we presented the AC-HIFA in a stacked array piezoelectric (PZT) DM, which may result in ghost damage that is dangerous in the high power laser system. More importantly, we investigated a solution through simulation and experiment that by using a mirror plate and a long thin post array, which were machined integrally from a piece of BK7 glass, the AC-HIFA could be eliminated completely. In addition, the structural parameters' influences on the AC-HIFA were investigated in the simulation, which could help other researchers to determine appropriate parameters of the mirror and the posts and to make a fine surface shape in their own DMs.

Optical imaging featuring both long working distance and high spatial resolution by correcting the aberration of a large aperture lens

High-resolution optical imaging within thick objects has been a challenging task due to the short working distance of conventional high numerical aperture (NA) objective lenses. Lenses with a large physical diameter and thus a large aperture, such as microscope condenser lenses, can feature both a large NA and a long working distance. However, such lenses suffer from strong aberrations. To overcome this problem, we present a method to correct the aberrations of a transmission-mode imaging system that is composed of two condensers. The proposed method separately identifies and corrects aberrations of illumination and collection lenses of up to 1.2 NA by iteratively optimizing the total intensity of the synthetic aperture images in the forward and phase-conjugation processes. At a source wavelength of 785 nm, we demonstrated a spatial resolution of 372 nm at extremely long working distances of up to 1.6 mm, an order of magnitude improvement in comparison to conventional objective lenses. Our method of converting microscope condensers to high-quality objectives may facilitate increases in the imaging depths of super-resolution and expansion microscopes.

Wavefront correction in two-photon microscopy with a multi-actuator adaptive lens

A multi-actuator adaptive lens (AL) was incorporated into a multi-photon (MP) microscope to improve the quality of images of thick samples. Through a hill-climbing procedure the AL corrected for the specimen-induced aberrations enhancing MP images. The final images hardly differed when two different metrics were used, although the sets of Zernike coefficients were not identical. The optimized MP images acquired with the AL were also compared with those obtained with a liquid-crystal-on-silicon spatial light modulator. Results have shown that both devices lead to similar images, which corroborates the usefulness of this AL for MP imaging.

Quantitative Live Cell FLIM Imaging in Three Dimensions

In this chapter, the concept of fluorescence lifetime and its utility in quantitative live cell imaging will be introduced, along with methods to record and analyze FLIM data. Relevant applications in 3D tissue and live cell imaging, including multiplexed FLIM detection, will also be detailed.

Adaptive optical microscopy for neurobiology

With the ability to correct for the aberrations introduced by biological specimens, adaptive optics-a method originally developed for astronomical telescopes-has been applied to optical microscopy to recover diffraction-limited imaging performance deep within living tissue. In particular, this technology has been used to improve image quality and provide a more accurate characterization of both structure and function of neurons in a variety of living organisms. Among its many highlights, adaptive optical microscopy has made it possible to image large volumes with diffraction-limited resolution in zebrafish larval brains, to resolve dendritic spines over 600μm deep in the mouse brain, and to more accurately characterize the orientation tuning properties of thalamic boutons in the primary visual cortex of awake mice.

High-resolution adaptive optical imaging within thick scattering media using closed-loop accumulation of single scattering

Thick biological tissues give rise to not only the multiple scattering of incoming light waves, but also the aberrations of remaining signal waves. The challenge for existing optical microscopy methods to overcome both problems simultaneously has limited sub-micron spatial resolution imaging to shallow depths. Here we present an optical coherence imaging method that can identify aberrations of waves incident to and reflected from the samples separately, and eliminate such aberrations even in the presence of multiple light scattering. The proposed method records the time-gated complex-field maps of backscattered waves over various illumination channels, and performs a closed-loop optimization of signal waves for both forward and phase-conjugation processes. We demonstrated the enhancement of the Strehl ratio by more than 500 times, an order of magnitude or more improvement over conventional adaptive optics, and achieved a spatial resolution of 600 nm up to an imaging depth of seven scattering mean free paths.

Numerical analysis of wavefront aberration correction using multielectrode electrowetting-based devices

We present numerical simulations of multielectrode electrowetting devices used in a novel optical design to correct wavefront aberration. Our optical system consists of two multielectrode devices, preceded by a single fixed lens. The multielectrode elements function as adaptive optical devices that can be used to correct aberrations inherent in many imaging setups, biological samples, and the atmosphere. We are able to accurately simulate the liquid-liquid interface shape using computational fluid dynamics. Ray tracing analysis of these surfaces shows clear evidence of aberration correction. To demonstrate the strength of our design, we studied three different input aberrations mixtures that include astigmatism, coma, trefoil, and additional higher order aberration terms, with amplitudes as large as one wave at 633 nm.

Synchronous model-based approach for wavefront sensorless adaptive optics system

In this paper, an aberration correction algorithm for wavefront sensorless adaptive optics system is presented, which is based on the approximately linear relation between the mean square of the aberration gradients and the second moment of far-field intensity distribution. To demonstrate algorithm's performance, an experiment system of aberration corrections for Fresnel zone plates imaging is set up. The correction results show the excellent performance of this method in correction speed, and correction capability. Comparing with conventional stochastic parallel gradient descent (SPGD) algorithm, the correction speed with this method is improved about four times for the similar correction effect.

Large-field-of-view imaging by multi-pupil adaptive optics

For in vivo deep imaging at high spatiotemporal resolutions, we developed Multi-Pupil Adaptive Optics (MPAO) which enables simultaneous wavefront correction over a large imaging field-of-view. The current implementation improves correction area by nine times over that of conventional methods. MPAO’s capability of spatially independent wavefront control further enables 3D nonplanar imaging. We applied MPAO to in vivo structural and functional imaging of biological dynamics in mammalian brain.

Three-dimensional focusing through scattering media using conjugate adaptive optics with remote focusing (CAORF)

The small correction volume for conventional wavefront shaping methods limits their application in biological imaging through scattering media. We demonstrate large volume wavefront shaping through a scattering layer with a single correction by conjugate adaptive optics and remote focusing (CAORF). The remote focusing module can maintain the conjugation between the adaptive optical (AO) element and the scattering layer during three-dimensional scanning. This new configuration provides a wider correction volume by better utilization of the memory effect in a fast three-dimensional laser scanning microscope. Our results show that the proposed system can provide 10 times wider axial field of view compared with a conventional conjugate AO system when 16,384 segments are used on a spatial light modulator. We also demonstrate three-dimensional fluorescence imaging, multi-spot patterning through a scattering layer and two-photon imaging through mouse skull tissue.

Transcutical imaging with cellular and subcellular resolution

We demonstrate transcutical structural and functional imaging of neurons labeled with genetically encoded red fluorescent proteins and calcium indicators in the living Drosophila brain with cellular and subcellular resolution.

Characterization of wavefront errors in mouse cranial bone using second-harmonic generation

Optical aberrations significantly affect the resolution and signal-to-noise ratio of deep tissue microscopy. As multiphoton microscopy is applied deeper into tissue, the loss of resolution and signal due to propagation of light in a medium with heterogeneous refractive index becomes more serious. Efforts in imaging through the intact skull of mice cannot typically reach past the bone marrow ( ? 150 ?? ? m of depth) and have limited resolution and penetration depth. Mechanical bone thinning or optical ablation of bone enables deeper imaging, but these methods are highly invasive and may impact tissue biology. Adaptive optics is a promising noninvasive alternative for restoring optical resolution. We characterize the aberrations present in bone using second-harmonic generation imaging of collagen. We simulate light propagation through highly scattering bone and evaluate the effect of aberrations on the point spread function. We then calculate the wavefront and expand it in Zernike orthogonal polynomials to determine the strength of different optical aberrations. We further compare the corrected wavefront and the residual wavefront error, and suggest a correction element with high number of elements or multiconjugate wavefront correction for this highly scattering environment.

Optical coherence tomography with a 2.8-mm beam diameter and sensorless defocus and astigmatism correction

An optical coherence tomography (OCT) system with a 2.8-mm beam diameter is presented. Sensorless defocus correction can be performed with a Badal optometer and astigmatism correction with a liquid crystal device. OCT B-scans were used in an image-based optimization algorithm for aberration correction. Defocus can be corrected from ? 4.3 ?? D to + 4.3 ?? D and vertical and oblique astigmatism from ? 2.5 ?? D to + 2.5 ?? D . A contrast gain of 6.9 times was measured after aberration correction. In comparison with a 1.3-mm beam diameter OCT system, this concept achieved a 3.7-dB gain in dynamic range on a model retina. Both systems were used to image the retina of a human subject. As the correction of the liquid crystal device can take more than 60 s, the subject’s spectacle prescription was adopted instead. This resulted in a 2.5 times smaller speckle size compared with the standard OCT system. The liquid crystal device for astigmatism correction does not need a high-voltage amplifier and can be operated at 5 V. The correction device is small ( 9 ?? mm × 30 ?? mm × 38 ?? mm ) and can easily be implemented in existing designs for OCT.

Dynamic performance of microelectromechanical systems deformable mirrors for use in an active/adaptive two-photon microscope

Active optics such as deformable mirrors can be used to control both focal depth and aberrations during scanning laser microscopy. If the focal depth can be changed dynamically during scanning, then imaging of oblique surfaces becomes possible. If aberrations can be corrected dynamically during scanning, an image can be optimized throughout the field of view. Here, we characterize the speed and dynamic precision of a Boston Micromachines Corporation Multi-DM 140 element aberration correction mirror and a Revibro Optics 4-zone focus control mirror to assess suitability for use in an active and adaptive two-photon microscope. Tests for the multi-DM include both step response and sinusoidal frequency sweeps of specific Zernike modes (defocus, spherical aberration, coma, astigmatism, and trefoil). We find wavefront error settling times for mode amplitude steps as large as 400 nm to be less than 52???s, with 3 dB frequencies ranging from 6.5 to 10 kHz. The Revibro Optics mirror was tested for step response only, with wavefront error settling time less than 80???s for defocus steps up to 3000 nm, and less than 45???s for spherical aberration steps up to 600 nm. These response speeds are sufficient for intrascan correction at scan rates typical of two-photon microscopy.

Adaptive optics full-field optical coherence tomography

We describe a simple and compact full-field optical coherence tomography (FFOCT) setup coupled to a transmissive liquid crystal spatial light modulator (LCSLM) to induce or correct aberrations. To reduce the system complexity, strict pupil conjugation was abandoned because low-order aberrations are often dominant. We experimentally confirmed a recent theoretical and experimental demonstration that the image resolution was almost insensitive to aberrations that mostly induce a reduction of the signal level. As a consequence, an image-based algorithm was applied for the optimization process by using the FFOCT image intensity as the metric. Aberration corrections were demonstrated with both an USAF resolution target and biological samples for LCSLM-induced and sample-induced wavefront distortions.

In vivo volumetric imaging of biological dynamics in deep tissue via wavefront engineering

Biological systems undergo dynamical changes continuously which span multiple spatial and temporal scales. To study these complex biological dynamics in vivo, high-speed volumetric imaging that can work at large imaging depth is highly desired. However, deep tissue imaging suffers from wavefront distortion, resulting in reduced Strehl ratio and image quality. Here we combine the two wavefront engineering methods developed in our lab, namely the optical phase-locked ultrasound lens based volumetric imaging and the iterative multiphoton adaptive compensation technique, and demonstrate in vivo volumetric imaging of microglial and mitochondrial dynamics at large depth in mouse brain cortex and lymph node, respectively.

Correcting spherical aberrations in a biospecimen using a transmissive liquid crystal device in two-photon excitation laser scanning microscopy

Two-photon excitation laser scanning microscopy has enabled the visualization of deep regions in a biospecimen. However, refractive-index mismatches in the optical path cause spherical aberrations that degrade spatial resolution and the fluorescence signal, especially during observation at deeper regions. Recently, we developed transmissive liquid-crystal devices for correcting spherical aberration without changing the basic design of the optical path in a conventional laser scanning microscope. In this study, the device was inserted in front of the objective lens and supplied with the appropriate voltage according to the observation depth. First, we evaluated the device by observing fluorescent beads in single- and two-photon excitation laser scanning microscopes. Using a 25× water-immersion objective lens with a numerical aperture of 1.1 and a sample with a refractive index of 1.38, the device recovered the spatial resolution and the fluorescence signal degraded within a depth of 0.6 mm. Finally, we implemented the device for observation of a mouse brain slice in a two-photon excitation laser scanning microscope. An optical clearing reagent with a refractive index of 1.42 rendered the fixed mouse brain transparent. The device improved the spatial resolution and the yellow fluorescent protein signal within a depth of 0-0.54 mm.

Axial range of conjugate adaptive optics in two-photon microscopy

We describe an adaptive optics technique for two-photon microscopy in which the deformable mirror used for aberration compensation is positioned in a plane conjugate to the plane of the aberration. We demonstrate in a proof-of-principle experiment that this technique yields a large field of view advantage in comparison to standard pupil-conjugate adaptive optics. Further, we show that the extended field of view in conjugate AO is maintained over a relatively large axial translation of the deformable mirror with respect to the conjugate plane. We conclude with a discussion of limitations and prospects for the conjugate AO technique in two-photon biological microscopy.

A pragmatic guide to multiphoton microscope design

Multiphoton microscopy has emerged as a ubiquitous tool for studying microscopic structure and function across a broad range of disciplines. As such, the intent of this paper is to present a comprehensive resource for the construction and performance evaluation of a multiphoton microscope that will be understandable to the broad range of scientific fields that presently exploit, or wish to begin exploiting, this powerful technology. With this in mind, we have developed a guide to aid in the design of a multiphoton microscope. We discuss source selection, optical management of dispersion, image-relay systems with scan optics, objective-lens selection, single-element light-collection theory, photon-counting detection, image rendering, and finally, an illustrated guide for building an example microscope.

High-speed scanning interferometric focusing by fast measurement of binary transmission matrix for channel demixing

Using the fast measurement of a binary transmission matrix and a digital micromirror device, we demonstrate high-speed interferometric focusing through highly dynamic scattering media with binary intensity modulation. The scanning of speckles for reference optimization gives stable focusing, which can be used for focusing through a fast changing media or two dimensional scanning through a slowly changing scattering media. The system allows dynamic focusing at 12.5 Hz with 1024 input modes, and more than 60 times intensity enhancement. It was tested with a moving diffuser, a mouse brain and skull tissue. The experiment with a live drosophila embryo shows its potential in compensating dynamic scattering in live biological tissue.

Adaptive optics in spinning disk microscopy: improved contrast and brightness by a simple and fast method

Multiconfocal microscopy gives a good compromise between fast imaging and reasonable resolution. However, the low intensity of live fluorescent emitters is a major limitation to this technique. Aberrations induced by the optical setup, especially the mismatch of the refractive index and the biological sample itself, distort the point spread function and further reduce the amount of detected photons. Altogether, this leads to impaired image quality, preventing accurate analysis of molecular processes in biological samples and imaging deep in the sample. The amount of detected fluorescence can be improved with adaptive optics. Here, we used a compact adaptive optics module (adaptive optics box for sectioning optical microscopy), which was specifically designed for spinning disk confocal microscopy. The module overcomes undesired anomalies by correcting for most of the aberrations in confocal imaging. Existing aberration detection methods require prior illumination, which bleaches the sample. To avoid multiple exposures of the sample, we established an experimental model describing the depth dependence of major aberrations. This model allows us to correct for those aberrations when performing a z-stack, gradually increasing the amplitude of the correction with depth. It does not require illumination of the sample for aberration detection, thus minimizing photobleaching and phototoxicity. With this model, we improved both signal-to-background ratio and image contrast. Here, we present comparative studies on a variety of biological samples.

Field of view advantage of conjugate adaptive optics in microscopy applications

The imaging performance of an optical microscope can be degraded by sample-induced aberrations. A general strategy to undo the effect of these aberrations is to apply wavefront correction with a deformable mirror (DM). In most cases the DM is placed conjugate to the microscope pupil, called pupil adaptive optics (AO). When the aberrations are spatially variant an alternative configuration involves placing the DM conjugate to the main source of aberrations, called conjugate AO. We provide a theoretical and experimental comparison of both configurations for the simplified case where spatially variant aberrations are produced by a well-defined phase screen. We pay particular attention to the resulting correction field of view (FOV). Conjugate AO is found to provide a significant FOV advantage. While this result is well known in the astronomical community, our goal here is to recast it specifically for the optical microscopy community.

Multi-perturbation stochastic parallel gradient descent method for wavefront correction

The multi-perturbation stochastic parallel gradient descent (SPGD) method for adaptive optics is presented in this work. The method is based on a new architecture. The incoming beam with distorted wavefront is split into N sub-beams. Each sub-beam is modulated by a wavefront corrector and its performance metric is measured subsequently. Adaptive system based on the multi-perturbation SPGD can operate in two modes - the fast descent mode and the modal basis updating mode. Control methods of the two operation modes are given. Experiments were carried out to prove the effectiveness of the proposed method. Analysis as well as experimental results showed that the two operation modes of the multi-perturbation SPGD enhance the conventional SPGD in different ways. The fast descent mode provides faster convergence than the conventional SPGD. The modal basis updating mode can optimize the modal basis set for SPGD with global coupling.

Optimization-based wavefront sensorless adaptive optics for multiphoton microscopy

Optical aberrations have detrimental effects in multiphoton microscopy. These effects can be curtailed by implementing model-based wavefront sensorless adaptive optics, which only requires the addition of a wavefront shaping device, such as a deformable mirror (DM) to an existing microscope. The aberration correction is achieved by maximizing a suitable image quality metric. We implement a model-based aberration correction algorithm in a second-harmonic microscope. The tip, tilt, and defocus aberrations are removed from the basis functions used for the control of the DM, as these aberrations induce distortions in the acquired images. We compute the parameters of a quadratic polynomial that is used to model the image quality metric directly from experimental input-output measurements. Finally, we apply the aberration correction by maximizing the image quality metric using the least-squares estimate of the unknown aberration.

Snapshot coherence-gated direct wavefront sensing for multi-photon microscopy

Deep imaging in turbid media such as biological tissue is challenging due to scattering and optical aberrations. Adaptive optics has the potential to compensate the tissue aberrations. We present a wavefront sensing scheme for multi-photon scanning microscopes using the pulsed, near-infrared light reflected back from the sample utilising coherence gating and a confocal pinhole to isolate the light from a layer of interest. By interfering the back-reflected light with a tilted reference beam, we create a fringe pattern with a known spatial carrier frequency in an image of the back-aperture plane of the microscope objective. The wavefront aberrations distort this fringe pattern and thereby imprint themselves at the carrier frequency, which allows us to separate the aberrations in the Fourier domain from low spatial frequency noise. A Fourier analysis of the modulated fringes combined with a virtual Shack-Hartmann sensor for smoothing yields a modal representation of the wavefront suitable for correction. We show results with this method correcting both DM-induced and sample-induced aberrations in rat tail collagen fibres as well as a Hoechst-stained MCF-7 spheroid of cancer cells.

Shack-Hartmann wavefront sensing using interferometric focusing of light onto guide-stars

Optical microscopy provides noninvasive imaging of biological tissues at subcellular level. The optical aberrations induced by the inhomogeneous refractive index of biological samples limits the resolution and can decrease the penetration depth. To compensate refractive aberrations, adaptive optics with Shack-Hartmann wavefront sensing has been used in microscopes. Wavefront measurement requires light from a guide-star inside of the sample. The scattering effect limits the intensity of the guide-star, hence reducing the signal to noise ratio of the wavefront measurement. In this paper, we demonstrate the use of interferometric focusing of excitation light onto a guide-star embedded deeply in tissue to increase its fluorescent intensity, thus overcoming the excitation signal loss caused by scattering. With interferometric focusing, we more than doubled the signal to noise ratio of the laser guide-star through scattering tissue as well as potentially extend the imaging depth through using AO microscopy.

Measurement of the time-resolved reflection matrix for enhancing light energy delivery into a scattering medium

Multiple scatterings occurring in a turbid medium attenuate the intensity of propagating waves. Here, we propose a method to efficiently deliver light energy to the desired target depth in a scattering medium. We measure the time-resolved reflection matrix of a scattering medium using coherent time-gated detection. From this matrix, we derive and experimentally implement an incident wave pattern that optimizes the detected signal corresponding to a specific arrival time. This leads to enhanced light delivery at the target depth. The proposed method will lay a foundation for efficient phototherapy and deep-tissue in vivo imaging in the near future.