Miniaturized multiphoton microscope with a 24Hz frame-rate

Software-Based Phase Control, Video-Rate Imaging, and Real-Time Mosaicing With a Lissajous-Scanned Confocal Microscope

We present software-based methods for automatic phase control and for mosaicing high-speed, Lissajous-scanned images. To achieve imaging speeds fast enough for mosaicing, we first increase the image update rate tenfold from 3 to 30 Hz, then vertically interpolate each sparse image in real-time to eliminate fixed pattern noise. We validate our methods by imaging fluorescent beads and automatically maintaining phase control over the course of one hour. We then image fixed mouse brain tissues at varying update rates and compare the resulting mosaics. Using reconstructed image data as feedback for phase control eliminates the need for phase sensors and feedback controllers, enabling long-term imaging experiments without additional hardware. Mosaicing subsampled images results in video-rate imaging speeds, nearly fully recovered spatial resolution, and millimeter-scale fields of view.

Design rules for dense and rapid Lissajous scanning

Lissajous microscanners are very popular in compact laser-scanning applications, such as solid-state light detection and ranging (LIDAR), owing to their high-quality factor and low power consumption. In the Lissajous scanner driven by a two-axis micro-electro-mechanical system scanning mirror (MEMS-SM), the design theory is insufficient to meet the temporal and spatial resolution at the same time. In this paper, the greatest common divisor of the two-axis driving frequency is used as the temporal resolution, the concept of the fill factor (FF) is used to describe the spatial resolution of the scanner, and a general algorithm for calculating the FF is presented. Combined with the characteristics of the Lissajous trajectory, three design rules of the general Lissajous scanner are proposed, and the design theory of the Lissajous scanner enabling MEMS LIDAR is perfected. Experimental results show that the proposed design rules can effectively meet the LIDAR design requirements.

In situ high-resolution thermal microscopy on integrated circuits

The miniaturization of metal tracks in integrated circuits (ICs) can cause abnormal heat dissipation, resulting in electrostatic discharge, overvoltage breakdown, and other unwanted issues. Unfortunately, locating areas of abnormal heat dissipation is limited either by the spatial resolution or imaging acquisition speed of current thermal analytical techniques. A rapid, non-contact approach to the thermal imaging of ICs with sub-μm resolution could help to alleviate this issue. In this work, based on the intensity of the temperature-dependent two-photon fluorescence (TPF) of Rhodamine 6G (R6G) material, we developed a novel fast and non-invasive thermal microscopy with a sub-μm resolution. Its application to the location of hotspots that may evolve into thermally induced defects in ICs was also demonstrated. To the best of our knowledge, this is the first study to present high-resolution 2D thermal microscopic images of ICs, showing the generation, propagation, and distribution of heat during its operation. According to the demonstrated results, this scheme has considerable potential for future in situ hotspot analysis during the optimization stage of IC development.

Blu-ray disk lens as the objective of a miniaturized two-photon fluorescence microscope

In this paper, we examine the performance of a Blu-ray disk (BD) aspheric lens as the objective of a miniaturized scanning nonlinear optical microscope. By combining a single 2D micro-electro mechanical system (MEMS) mirror as the scanner and with different tube lens pairs, the field of view (FOV) of the studied microscope varies from 59 μm × 93 μm up to 178 μm × 280 μm, while the corresponding lateral resolution varies from 0.6 μm to 2 μm for two-photon fluorescence (2PF) signals. With a 34/s video frame rate, in vivo dynamic observation of zebrafish heartbeat through 2PF of the excited green fluorescence protein (GFP) is demonstrated.

Imaging granularity of leukocytes with third harmonic generation microscopy

Using third harmonic generation (THG) microscopy, we demonstrate that granularity differences of leukocytes can be revealed without a label. Excited by a 1230 nm femtosecond laser, THG signals were generated at a significantly higher level in neutrophils than other mononuclear cells, whereas signals in agranular lymphocytes were one order of magnitude smaller. Interestingly, the characteristic THG features can also be observed in vivo to track the newly recruited leukocytes following lipopolysaccharide (LPS) challenge. These results suggest that label-free THG imaging may provide timely tracking of leukocyte movement without disturbing the normal cellular or physiological status.

Spatiotemporal focusing-based widefield multiphoton microscopy for fast optical sectioning

In this study, a microscope based on spatiotemporal focusing offering widefield multiphoton excitation has been developed to provide fast optical sectioning images. Key features of this microscope are the integrations of a 10 kHz repetition rate ultrafast amplifier featuring high instantaneous peak power (maximum 400 μJ/pulse at a 90 fs pulse width) and a TE-cooled, ultra-sensitive photon detecting, electron multiplying charge-coupled camera into a spatiotemporal focusing microscope. This configuration can produce multiphoton images with an excitation area larger than 200 × 100 μm² at a frame rate greater than 100 Hz (current maximum of 200 Hz). Brownian motions of fluorescent microbeads as small as 0.5 μm were observed in real-time with a lateral spatial resolution of less than 0.5 μm and an axial resolution of approximately 3.5 μm. Furthermore, second harmonic images of chicken tendons demonstrate that the developed widefield multiphoton microscope can provide high resolution z-sectioning for bioimaging.

Increased illumination uniformity and reduced photodamage offered by the Lissajous scanning in fiber-optic two-photon endomicroscopy

We compare the illumination uniformity and the associated effects of the spiral and Lissajous scanning patterns that are commonly used in an endomicroscope. Theoretical analyses and numerical simulations were first performed to quantitatively investigate the area illumination density in the spiral scanning pattern. The results revealed the potential problem of manifest photodamage due to the very high illumination density in the center of the spiral scan. Similar analyses of the Lissajous scanning pattern, which can be conveniently implemented on the same endomicroscope with no hardware modifications, showed a more uniform illumination density with about an 80-fold reduction in the peak illumination density. To underscore the benefit offered by the improved illumination uniformity, we conducted in vitro two-photon fluorescence imaging of cultured cells stained with a LIVE/DEAD viability assay using our home-built, fiber-optic, two-channel endomicroscopy system. Both the spiral and the Lissajous scans were implemented. Our experimental results showed that cells near the spiral scan center experienced obvious photodamage, whereas cells remained alive over the entire region under the Lissajous beam scanning, confirming the predicted advantage offered by the Lissajous scan over this spiral scan in an endomicroscopy setting.

Fast-updating and nonrepeating Lissajous image reconstruction method for capturing increased dynamic information

We present a fast-updating Lissajous image reconstruction methodology that uses an increased image frame rate beyond the pattern repeat rate generally used in conventional Lissajous image reconstruction methods. The fast display rate provides increased dynamic information and reduced motion blur, as compared to conventional Lissajous reconstruction, at the cost of single-frame pixel density. Importantly, this method does not discard any information from the conventional Lissajous image reconstruction, and frames from the complete Lissajous pattern can be displayed simultaneously. We present the theoretical background for this image reconstruction methodology along with images and video taken using the algorithm in a custom-built miniaturized multiphoton microscopy system.

Miniaturized multimodal CARS microscope based on MEMS scanning and a single laser source

We demonstrate a novel miniaturized multimodal coherent anti-Stokes Raman scattering (CARS) microscope based on microelectromechanical systems (MEMS) scanning mirrors and custom miniature optics. A single Ti:sapphire femtosecond pulsed laser is used as the light source to produce the CARS, two photon excitation fluorescence (TPEF) and second harmonic generation (SHG) images using this miniaturized microscope. The high resolution and distortion-free images obtained from various samples such as a USAF target, fluorescent and polystyrene microspheres and biological tissue successfully demonstrate proof of concept, and pave the path towards future integration of parts into a handheld multimodal CARS probe for non- or minimally-invasive in vivo imaging.

Miniaturized video-rate epi-third-harmonic-generation fiber-microscope

With a micro-electro-mechanical system (MEMS) mirror, we successfully developed a miniaturized epi-third-harmonic-generation (epi-THG) fiber-microscope with a video frame rate (31 Hz), which was designed for in vivo optical biopsy of human skin. With a large-mode-area (LMA) photonic crystal fiber (PCF) and a regular microscopic objective, the nonlinear distortion of the ultrafast pulses delivery could be much reduced while still achieving a 0.4 microm lateral resolution for epi-THG signals. In vivo real time virtual biopsy of the Asian skin with a video rate (31 Hz) and a sub-micron resolution was obtained. The result indicates that this miniaturized system was compact enough for the least invasive hand-held clinical use.

In vivo brain imaging using a portable 2.9 g two-photon microscope based on a microelectromechanical systems scanning mirror

We present a two-photon microscope that is approximately 2.9 g in mass and 2.0 x 1.9 x 1.1 cm(3) in size and based on a microelectromechanical systems (MEMS) laser-scanning mirror. The microscope has a focusing motor and a micro-optical assembly composed of four gradient refractive index lenses and a dichroic microprism. Fluorescence is captured without the detected emissions reflecting off the MEMS mirror, by use of separate optical fibers for fluorescence collection and delivery of ultrashort excitation pulses. Using this microscope we imaged neocortical microvasculature and tracked the flow of erythrocytes in live mice.