Adaptive harmonic generation microscopy of mammalian embryos

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to significant enhancements in image quality.

EVATOM: an optical, label-free, machine learning assisted embryo health assessment tool

The combination of a good quality embryo and proper maternal health factors promise higher chances of a successful in vitro fertilization (IVF) procedure leading to clinical pregnancy and live birth. Of these two factors, selection of a good embryo is a controllable aspect. The current gold standard in clinical practice is visual assessment of an embryo based on its morphological appearance by trained embryologists. More recently, machine learning has been incorporated into embryo selection "packages". Here, we report EVATOM: a machine-learning assisted embryo health assessment tool utilizing an optical quantitative phase imaging technique called artificial confocal microscopy (ACM). We present a label-free nucleus detection method with, to the best of our knowledge, novel quantitative embryo health biomarkers. Two viability assessment models are presented for grading embryos into two classes: healthy/intermediate (H/I) or sick (S) class. The models achieve a weighted F1 score of 1.0 and 0.99 respectively on the in-distribution test set of 72 fixed embryos and a weighted F1 score of 0.9 and 0.95 respectively on the out-of-distribution test dataset of 19 time-instances from 8 live embryos.

Machine learning assisted health viability assay for mouse embryos with artificial confocal microscopy (ACM)

The combination of a good quality embryo and proper maternal health factors promise higher chances of a successful in vitro fertilization (IVF) procedure leading to clinical pregnancy and live birth. Of these two factors, selection of a good embryo is a controllable aspect. The current gold standard in clinical practice is visual assessment of an embryo based on its morphological appearance by trained embryologists. More recently, machine learning has been incorporated into embryo selection "packages". Here, we report a machine-learning assisted embryo health assessment tool utilizing a quantitative phase imaging technique called artificial confocal microscopy (ACM). We present a label-free nucleus detection method with novel quantitative embryo health biomarkers. Two viability assessment models are presented for grading embryos into two classes: healthy/intermediate (H/I) or sick (S) class. The models achieve a weighted F1 score of 1.0 and 0.99 respectively on the in-distribution test set of 72 fixed embryos and a weighted F1 score of 0.9 and 0.95 respectively on the out-of-distribution test dataset of 19 time-instances from 8 live embryos.

Blind deconvolution of second harmonic microscopy images of the living human eye

Second harmonic generation (SHG) imaging microscopy of thick biological tissues is affected by the presence of aberrations and scattering within the sample. Moreover, additional problems, such as uncontrolled movements, appear when imaging in-vivo. Deconvolution methods can be used to overcome these limitations under some conditions. In particular, we present here a technique based on a marginal blind deconvolution approach for improving SHG images obtained in vivo in the human eye (cornea and sclera). Different image quality metrics are used to quantify the attained improvement. Collagen fibers in both cornea and sclera are better visualized and their spatial distributions accurately assessed. This might be a useful tool to better discriminate between healthy and pathological tissues, especially those where changes in collagen distribution occur.

Optofluidic adaptive optics in multi-photon microscopy

Adaptive optics, in combination with multi-photon techniques, is a powerful approach to image deep into a specimen. Remarkably, virtually all adaptive optics schemes today rely on wavefront modulators that are reflective, diffractive or both. This, however, can pose a severe limitation for applications. Here, we present a fast and robust sensorless adaptive optics scheme adapted for transmissive wavefront modulators. We study our scheme in numerical simulations and in experiments with a novel, optofluidic wavefront shaping device that is transmissive, refractive, polarisation-independent, and broadband. We demonstrate scatter correction of two-photon-excited fluorescence images of microbeads as well as brain cells and benchmark our device against a liquid-crystal spatial light modulator. Our method and technology could open new routes for adaptive optics in scenarios where previously, the restriction to reflective and diffractive devices may have staggered innovation and progress.

Adaptive optics for optical microscopy [Invited]

Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.

Adaptive optics: principles and applications in ophthalmology

This is a comprehensive review of the principles and applications of adaptive optics (AO) in ophthalmology. It has been combined with flood illumination ophthalmoscopy, scanning laser ophthalmoscopy, as well as optical coherence tomography to image photoreceptors, retinal pigment epithelium (RPE), retinal ganglion cells, lamina cribrosa and the retinal vasculature. In this review, we highlight the clinical studies that have utilised AO to understand disease mechanisms. However, there are some limitations to using AO in a clinical setting including the cost of running an AO imaging service, the time needed to scan patients, the lack of normative databases and the very small size of area imaged. However, it is undoubtedly an exceptional research tool that enables visualisation of the retina at a cellular level.

Label-free optical imaging in developmental biology [Invited]

Application of optical imaging in developmental biology marks an exciting frontier in biomedical optics. Optical resolution and imaging depth allow for investigation of growing embryos at subcellular, cellular, and whole organism levels, while the complexity and variety of embryonic processes set multiple challenges stimulating the development of various live dynamic embryonic imaging approaches. Among other optical methods, label-free optical techniques attract an increasing interest as they allow investigation of developmental mechanisms without application of exogenous markers or fluorescent reporters. There has been a boost in development of label-free optical imaging techniques for studying embryonic development in animal models over the last decade, which revealed new information about early development and created new areas for investigation. Here, we review the recent progress in label-free optical embryonic imaging, discuss specific applications, and comment on future developments at the interface of photonics, engineering, and developmental biology.

Imaging, Visualization, and Computation in Developmental Biology

Embryonic development is highly complex and dynamic, requiring the coordination of numerous molecular and cellular events at precise times and places. Advances in imaging technology have made it possible to follow developmental processes at cellular, tissue, and organ levels over time as they take place in the intact embryo. Parallel innovations of in vivo probes permit imaging to report on molecular, physiological, and anatomical events of embryogenesis, but the resulting multidimensional data sets pose significant challenges for extracting knowledge. In this review, we discuss recent and emerging advances in imaging technologies, in vivo labeling, and data processing that offer the greatest potential for jointly deciphering the intricate cellular dynamics and the underlying molecular mechanisms. Our discussion of the emerging area of “image-omics” highlights both the challenges of data analysis and the promise of more fully embracing computation and data science for rapidly advancing our understanding of biology.

Highly Sensitive Shack-Hartmann Wavefront Sensor: Application to Non-Transparent Tissue Mimic Imaging with Adaptive Light-Sheet Fluorescence Microscopy

High-quality in-depth imaging of three-dimensional samples remains a major challenge in modern microscopy. Selective plane illumination microscopy (SPIM) is a widely used technique that enables imaging of living tissues with subcellular resolution. However, scattering, absorption, and optical aberrations limit the depth at which useful imaging can be done. Adaptive optics (AOs) is a method capable of measuring and correcting aberrations in different kinds of fluorescence microscopes, thereby improving the performance of the optical system. We have incorporated a wavefront sensor adaptive optics scheme to SPIM (_WAOSPIM) to correct aberrations induced by optically-thick samples, such as multi-cellular tumor spheroids (MCTS). Two-photon fluorescence provides us with a tool to produce a weak non-linear guide star (NGS) in any region of the field of view. The faintness of NGS; however, led us to develop a high-sensitivity Shack–Hartmann wavefront sensor (SHWS). This paper describes this newly developed SHWS and shows the correction capabilities of _WAOSPIM using NGS in thick, inhomogeneous samples like MCTS. We report improvements of up to 79% for spatial frequencies corresponding to cellular and subcellular size features.

Investigation of structural mechanisms of laser-written waveguide formation through third-harmonic microscopy

The mechanisms of laser-induced modification of transparent materials are complex combinations of different processes that depend on the material itself and a range of processing parameters. As such, the mechanisms are still subject to ongoing study. We use a custom-built adaptive third-harmonic generation (THG) microscope to study those mechanisms. New femtosecond-laser-written phenomena are revealed through this method of imaging. This Letter, together with previous reports by Miyamoto Opt. Express24, 25718 (2016)OPEXFF1094-408710.1364/OE.24.025718 and Fernandez J. Phys. D48, 155101 (2015)JPAPBE0022-372710.1088/0022-3727/48/15/155101 suggest that the distribution of the generated plasma during writing is responsible for the newly revealed phenomena.

Inversion-free image recovery from strong aberration using a minimally sampled transmission matrix

A transmission matrix (TM), a characteristic response for an input-output relation of an optical system, has been used for achieving diffraction-limited and aberration-free images through highly-aberrant imaging systems. However, its requirement of acquiring a huge-size TM along with its heavy computational load limit its widespread applications. Here we propose a method for TM-based image reconstruction, which is more efficient in terms of data manipulation and computational time. Only 10% of the TM elements for a fish-eye (FE) lens with strong aberration were sampled compared to that required for the image reconstruction by the conventional inversion method. The missing information was filled in by an iterative interpolation algorithm working in k-space. In addition, as a replacement of the time-consuming matrix inversion process, a phase pattern was created from the minimally sampled TM in order to compensate for the angle-dependent phase retardation caused by the FE lens. The focal distortion could be corrected by applying the phase correction pattern to the angular spectrums of the measured object images. The remaining spatial distortion could also be determined through the geometrical transformation also determined by the minimally sampled TM elements. Through the use of these procedures, the object image can be reconstructed 55 times faster than through the use of the usual inversion method using the full-sized TM, without compromising the reconstruction performances.

Ultrafast laser writing quill effect in low loss waveguide fabrication regime

The quill effect is a laser writing phenomenon in which different fabrication effects occur, depending upon the direction of laser translation. It has not yet, to our knowledge, been studied in the low-loss-waveguide (LLW) writing regime, probably due to its very weak visibility under conventional transmission microscope in that regime. In this report, with the help of adaptive third harmonic generation microscopy, we reveal the quill effect in the LLW writing regime and show its influences on the properties of laser-written photonic integrated components, in terms of polarization-related properties in fused silica and beam-splitting ratios of three-waveguide-coupler in borosilicate glass.

Optimizing the metric in sensorless adaptive optical microscopy with fluorescence fluctuations

Adaptive optics (AO) strategies using optimization-based, sensorless approaches are widely used, especially for microscopy applications. To converge rapidly to the best correction, such approaches require that a quality metric and a set of modes be chosen optimally. Fluorescence fluctuations microscopy, a family of methods that provides quantitative measurements of molecular concentration and mobility in living specimen, is in particular need of adaptive optics, since its results can be strongly biased by optical aberrations. We examined two possible metrics for sensorless AO, measured in a solution of fluorophores diffusing in 3D: the fluorescence count rate and the molecular brightness (or number of photons detected per molecule in the observation volume). We studied their respective measurement noise and sensitivity to aberrations. Then, AO correction accuracy was experimentally assessed by measuring the residual aberration after correcting a known wavefront. We proposed a theoretical framework to predict the correction accuracy, knowing the metric measurement noise and sensitivity. In the small aberration range, the brightness allows more accurate corrections when fluorophores are few but bright, whereas the count rate performs better in more concentrated solutions. When correcting large aberrations, the count rate is expected to be a more reliable metric.

Hybrid laser written waveguides in fused silica for low loss and polarization independence

Photonic integrated circuits (PICs) written with an ultrashort pulsed laser provide advantages in a range of applications, such as photon-based quantum information processing, where low insertion loss and low polarization dependence are critical concerns. Here we demonstrate the inscription of hybrid waveguides in fused silica at a pulse repetition rate of 1MHz that fulfill both these criteria. The mechanisms for propagation and coupling losses are identified and decoupled, with separate sections of the waveguide minimizing for each and an adiabatic mode conversion between the two. Moreover, differing sources of birefringence were revealed to be non-parallel for the waveguides, such that structures can be designed where these competing sources cancel to remove any polarization dependence.

Development of integrated mode reformatting components for diffraction-limited spectroscopy

We present the results of our work on developing fully integrated devices (photonic dicers) for reformatting multimode light to a diffraction limited pseudo-slit. These devices can be used to couple a seeing limited telescope point spread function to a spectrograph operating at the diffraction limit, thus potentially enabling compact, high-resolution spectrographs that are free of modal noise.

Third Harmonic Generation microscopy as a reliable diagnostic tool for evaluating lipid body modification during cell activation: the example of BV-2 microglia cells

Nonlinear optical processes have found widespread applications in fields ranging from fundamental physics to biomedicine. In this study, we attempted to evaluate cell activation by using the Third Harmonic Generation (THG) imaging microscopy as a new diagnostic tool. The BV-2 microglia cell line with or without activation by lipopolysaccharide was chosen as a representative biological model. The results showed that THG imaging could discriminate between the control versus activated state of BV-2 cells not only as to THG signal intensity but also as to THG signal area, while verifying once more that the majority of the intracellular detected signal corresponds to lipid bodies. Since THG imaging is a real time, non-destructive modality and does not require any prior cell processing and staining, the results presented here provide an important tool for normal versus activated cell discrimination, which could be proved very useful in the study of inflammation.

Optimization-based wavefront sensorless adaptive optics for multiphoton microscopy

Optical aberrations have detrimental effects in multiphoton microscopy. These effects can be curtailed by implementing model-based wavefront sensorless adaptive optics, which only requires the addition of a wavefront shaping device, such as a deformable mirror (DM) to an existing microscope. The aberration correction is achieved by maximizing a suitable image quality metric. We implement a model-based aberration correction algorithm in a second-harmonic microscope. The tip, tilt, and defocus aberrations are removed from the basis functions used for the control of the DM, as these aberrations induce distortions in the acquired images. We compute the parameters of a quadratic polynomial that is used to model the image quality metric directly from experimental input-output measurements. Finally, we apply the aberration correction by maximizing the image quality metric using the least-squares estimate of the unknown aberration.

Direct wavefront sensing in adaptive optical microscopy using backscattered light

Adaptive optics has been used to compensate the detrimental effects of aberrations in a range of high-resolution microscopes. We investigate how backscattered laser illumination can be used as the source for direct wavefront sensing using a pinhole-filtered Shack-Hartmann wavefront sensor. It is found that the sensor produces linear response to input aberrations for a given specimen. The gradient of this response is dependent upon experimental configuration and specimen structure. Cross sensitivity between modes is also observed. The double pass nature of the microscope system leads in general to lower sensitivity to odd-symmetry aberration modes. The results show that there is potential for use of this type of wavefront sensing in microscopes.

Advances in multiphoton microscopy for imaging embryos

Multiphoton imaging is a promising approach for addressing current issues in systems biology and high-content investigation of embryonic development. Recent advances in multiphoton microscopy, including light-sheet illumination, optimized laser scanning, adaptive and label-free strategies, open new opportunities for embryo imaging. However, the literature is often unclear about which microscopy technique is most adapted for achieving specific experimental goals. In this review, we describe and discuss the key concepts of imaging speed, imaging depth, photodamage, and nonlinear contrast mechanisms in the context of recent advances in live embryo imaging. We illustrate the potentials of these new imaging approaches with a selection of recent applications in developmental biology.

Toward high-content/high-throughput imaging and analysis of embryonic morphogenesis

In vivo study of embryonic morphogenesis tremendously benefits from recent advances in live microscopy and computational analyses. Quantitative and automated investigation of morphogenetic processes opens the field to high-content and high-throughput strategies. Following experimental workflow currently developed in cell biology, we identify the key challenges for applying such strategies in developmental biology. We review the recent progress in embryo preparation and manipulation, live imaging, data registration, image segmentation, feature computation, and data mining dedicated to the study of embryonic morphogenesis. We discuss a selection of pioneering studies that tackled the current methodological bottlenecks and illustrated the investigation of morphogenetic processes in vivo using quantitative and automated imaging and analysis of hundreds or thousands of cells simultaneously, paving the way for high-content/high-throughput strategies and systems analysis of embryonic morphogenesis.

Long-term imaging of mouse embryos using adaptive harmonic generation microscopy

We present a detailed description of an adaptive harmonic generation (HG) microscope and culture techniques that permit long-term, three-dimensional imaging of mouse embryos. HG signal from both pre- and postimplantation stage (0.5-5.5 day-old) mouse embryos are fully characterized. The second HG images reveal central spindles during cytokinesis whereas third HG images show several features, such as lipid droplets, nucleoli, and plasma membranes. The embryos are found to develop normally during one-day-long discontinuous HG imaging, permitting the observation of several dynamic events, such as morula compaction and blastocyst formation.

Three-dimensional imaging of direct-written photonic structures

Third-harmonic generation microscopy has been used to analyze the morphology of photonic structures created using the femtosecond laser direct-write technique. Three-dimensional waveguide arrays and waveguide-Bragg gratings written in fused-silica and doped phosphate glass were investigated. A sensorless adaptive-optical system was used to correct the optical aberrations occurring in the sample and microscope system, which had a lateral resolution of less than 500 nm. This nondestructive testing method creates volume reconstructions of photonic devices and reveals details invisible to other linear microscopy and index profilometry techniques.

Shack-Hartmann wavefront-sensor-based adaptive optics system for multiphoton microscopy

The imaging depth of two-photon excitation fluorescence microscopy is partly limited by the inhomogeneity of the refractive index in biological specimens. This inhomogeneity results in a distortion of the wavefront of the excitation light. This wavefront distortion results in image resolution degradation and lower signal level. Using an adaptive optics system consisting of a Shack-Hartmann wavefront sensor and a deformable mirror, wavefront distortion can be measured and corrected. With adaptive optics compensation, we demonstrate that the resolution and signal level can be better preserved at greater imaging depth in a variety of ex-vivo tissue specimens including mouse tongue muscle, heart muscle, and brain. However, for these highly scattering tissues, we find signal degradation due to scattering to be a more dominant factor than aberration.

Third-harmonic generation for the study of Caenorhabditis elegans embryogenesis

Live microscopy techniques (i.e., differential interference contrast, confocal microscopy, etc.) have enabled the understanding of the mechanisms involved in cells and tissue formation. In long-term studies, special care must be taken in order to avoid sample damage, restricting the applicability of the different microscopy techniques. We demonstrate the potential of using third-harmonic generation (THG) microscopy for morphogenesis/embryogenesis studies in living Caenorhabditis elegans (C. elegans). Moreover, we show that the THG signal is obtained in all the embryo development stages, showing different tissue/structure information. For this research, we employ a 1550-nm femtosecond fiber laser and demonstrate that the expected water absorption at this wavelength does not severely compromise sample viability. Additionally, this has the important advantage that the THG signal is emitted at visible wavelengths (516 nm). Therefore, standard collection optics and detectors operating near maximum efficiency enable an optimal signal reconstruction. All this, to the best of our knowledge, demonstrates for the first time the noninvasiveness and strong potential of this particular wavelength to be used for high-resolution four-dimensional imaging of embryogenesis using unstained C. elegans in vivo samples.

Characterisation of the dynamic behaviour of lipid droplets in the early mouse embryo using adaptive harmonic generation microscopy

BACKGROUND

Lipid droplets (LD) are organelles with an important role in normal metabolism and disease. The lipid content of embryos has a major impact on viability and development. LD in Drosophila embryos and cultured cell lines have been shown to move and fuse in a microtubule dependent manner. Due to limitations in current imaging technology, little is known about the behaviour of LD in the mammalian embryo. Harmonic generation microscopy (HGM) allows one to image LD without the use of exogenous labels. Adaptive optics can be used to correct aberrations that would otherwise degrade the quality and information content of images.

RESULTS

We have built a harmonic generation microscope with adaptive optics to characterise early mouse embryogenesis. At fertilization, LD are small and uniformly distributed, but in the implanting blastocyst, LD are larger and enriched in the invading giant cells of the trophectoderm. Time-lapse studies reveal that LD move continuously and collide but do not fuse, instead forming aggregates that subsequently behave as single units. Using specific inhibitors, we show that the velocity and dynamic behaviour of LD is dependent not only on microtubules as in other systems, but also on microfilaments. We explore the limits within which HGM can be used to study living embryos without compromising viability and make the counterintuitive finding that 16 J of energy delivered continuously over a period of minutes can be less deleterious than an order of magnitude lower energy delivered dis-continuously over a period of hours.

CONCLUSIONS

LD in pre-implantation mouse embryos show a previously unappreciated complexity of behaviour that is dependent not only on microtubules, but also microfilaments. Unlike LD in other systems, LD in the mouse embryo do not fuse but form aggregates. This study establishes HGM with adaptive optics as a powerful tool for the study of LD biology and provides insights into the photo-toxic effects of imaging embryos.