Fast-updating and nonrepeating Lissajous image reconstruction method for capturing increased dynamic information

High-speed forward-viewing optical coherence tomography probe based on Lissajous sampling and sparse reconstruction

We present a novel endoscopy probe using optical coherence tomography (OCT) that combines sparse Lissajous scanning and compressed sensing (CS) for faster data collection. This compact probe is only 4 mm in diameter and achieves a large field of view (FOV) of 2.25 mm2 and a 10 mm working distance. Unlike traditional OCT systems that use bulky raster scanning, our design features a dual-axis piezoelectric mechanism for efficient Lissajous pattern scanning. It employs compressive data reconstruction algorithms that minimize data collection requirements for efficient, high-speed imaging. This approach significantly enhances imaging speed by over 40%, substantially improving miniaturization and performance for endoscopic applications.

MEMS-based two-photon microscopy with Lissajous scanning and image reconstruction under a feed-forward control strategy

Two-photon microscopy (TPM) based on two-dimensional micro-electro-mechanical (MEMS) system mirrors shows promising applications in biomedicine and the life sciences. To improve the imaging quality and real-time performance of TPM, this paper proposes Lissajous scanning control and image reconstruction under a feed-forward control strategy, a dual-parameter alternating drive control algorithm and segmented phase synchronization mechanism, and pipe-lined fusion-mean filtering and median filtering to suppress image noise. A 10 fps frame rate (512 × 512 pixels), a 140 µm × 140 µm field of view, and a 0.62 µm lateral resolution were achieved. The imaging capability of MEMS-based Lissajous scanning TPM was verified by ex vivo and in vivo biological tissue imaging.

Miniature side-view dual axes confocal endomicroscope for repetitive in vivo imaging

A side-view dual axes confocal endomicroscope is demonstrated that can be inserted repetitively in hollow organs of genetically engineered mice for in vivo real-time imaging in horizontal and vertical planes. Near infrared (NIR) excitation at λex = 785 nm was used. A monolithic 3-axis parametric resonance scan mirror was fabricated using micro-electro-mechanical systems (MEMS) technology to perform post-objective scanning in the distal end of a 4.19 mm diameter instrument. Torsional and serpentine springs were designed to "switch" the mode of imaging between vertical and horizontal planes by tuning the actuation frequency. This system demonstrated real-time in-vivo images in horizontal and vertical planes with 310 µm depth and 1.75 and 7.5 µm lateral and axial resolution. Individual cells and discrete mucosal structures could be identified.

A Versatile Illumination System for Real-Time Terahertz Imaging

Terahertz technologies are attracting strong interest from high-end industrial fields, and particularly for non-destructive-testing purposes. Currently lacking compactness, integrability as well as adaptability for those implementations, the development and commercialisation of more efficient sources and detectors progressively ensure the transition toward applicative implementations, especially for real-time full-field imaging. In this work, a flexible illumination system, based on fast beam steering has been developed and characterized. Its primary goal is to suppress interferences induced by the coherence length of certain terahertz sources, spoiling terahertz images. The second goal is to ensure an enhanced signal-to-noise ratio on the detector side by the full use and optimized distribution of the available power. This system provides a homogeneous and adjustable illumination through a simplified setup to guarantee optimum real-time imaging capabilities, tailored to the sample under inspection. Working toward industrial implementations, different illumination process are conveniently assessed as a result of the versatility of this method.

Ultra-Compact Microsystems-Based Confocal Endomicroscope

Point-of-care medical diagnosis demands immediate feedback on tissue pathology. Confocal endomicroscopy can provide real-time in vivo images with histology-like features. The working channel in medical endoscopes are becoming smaller in dimension. Microsystems methods can produce tiny mechanical scanners. We demonstrate a flexible fiber instrument for in vivo imaging as an endoscope accessory. The optical path is folded on-axis to reduce length while allowing the beam to expand and achieve a numerical aperture of 0.41. A high-speed parametric resonance mirror produces large deflection angles > 13°, and is mounted on a 2 mm diameter chip designed with clamp structures for reduced space. A compact lens assembly provides diffraction-limited lateral and axial resolution of 1.5 and [Formula: see text], respectively. A working distance of [Formula: see text] and field-of-view of [Formula: see text] m are achieved. Miniature apparatus is fabricated to assemble and align the scanhead components. The optics and scanner are packaged in a distal tip with 2.4 mm diameter and 10 mm rigid length. These dimensions allow the endomicroscope to pass forward easily through the 2.8 mm diameter working channel in medical endoscopes commonly used in clinical practice. Fluorescence images are collected in vivo at 10 frames per second in the colon of genetically-engineered mice that spontaneously develop adenomas. A FITC-labeled peptide heterodimer is administered intravenously to provide specific contrast. Sub-cellular structures are visualized to distinguish pre-malignant from normal mucosa. These results demonstrate use of microsystems methods to produce an ultra-compact instrument with sufficiently small dimensions for broad use.

Software-Based Phase Control, Video-Rate Imaging, and Real-Time Mosaicing With a Lissajous-Scanned Confocal Microscope

We present software-based methods for automatic phase control and for mosaicing high-speed, Lissajous-scanned images. To achieve imaging speeds fast enough for mosaicing, we first increase the image update rate tenfold from 3 to 30 Hz, then vertically interpolate each sparse image in real-time to eliminate fixed pattern noise. We validate our methods by imaging fluorescent beads and automatically maintaining phase control over the course of one hour. We then image fixed mouse brain tissues at varying update rates and compare the resulting mosaics. Using reconstructed image data as feedback for phase control eliminates the need for phase sensors and feedback controllers, enabling long-term imaging experiments without additional hardware. Mosaicing subsampled images results in video-rate imaging speeds, nearly fully recovered spatial resolution, and millimeter-scale fields of view.

Real-time Lissajous imaging with a low-voltage 2-axis MEMS scanner based on electrothermal actuation

Laser scanning based on Micro-Electro-Mechanical Systems (MEMS) scanners has become very attractive for biomedical endoscopic imaging, such as confocal microscopy or Optical Coherence Tomography (OCT). These scanners are required to be fast to achieve real-time image reconstruction while working at low actuation voltage to comply with medical standards. In this context, we report a 2-axis Micro-Electro-Mechanical Systems (MEMS) electrothermal micro-scannercapable of imaging large fields of view at high frame rates, e.g. from 10 to 80 frames per second. For this purpose, Lissajous scan parameters are chosen to provide the optimal image quality within the scanner capabilities and the sampling rate limit, resulting from the limited A-scan rate of typical swept-sources used for OCT. Images of 233 px × 203 px and 53 px × 53 px at 10 fps and 61 fps, respectively, are experimentally obtained and demonstrate the potential of this micro-scannerfor high definition and high frame rate endoscopic Lissajous imaging.

Continuous focal translation enhances rate of point-scan volumetric microscopy

Two-Photon Laser-Scanning Microscopy is a powerful tool for exploring biological structure and function due to its ability to optically section through a sample with a tight focus. While it is possible to obtain 3D image stacks by moving a stage, this per-frame imaging process is time consuming. Here, we present a method for an easy-to-implement and inexpensive modification of an existing two-photon microscope to rapidly image in 3D using an electrically tunable lens to create a tessellating scan pattern which repeats with the volume rate. Using appropriate interpolating algorithms, the volumetric imaging rate can be increased by a factor up to four-fold. This capability provides the expansion of the two-photon microscope into the third dimension for faster volumetric imaging capable of visualizing dynamics on timescales not achievable by traditional stage-stack methods.

Joint ptycho-tomography reconstruction through alternating direction method of multipliers

We present the extension of ptychography for three-dimensional object reconstruction in a tomography setting. We describe the alternating direction method of multipliers (ADMM) as a generic reconstruction framework to efficiently solve the nonlinear optimization problem. In this framework, the ADMM breaks the joint reconstruction problem into two well-defined subproblems: ptychographic phase retrieval and tomographic reconstruction. In this paper, we use the gradient descent algorithm to solve both problems and demonstrate the efficiency of the proposed approach through numerical simulations. Further, we show that the proposed joint approach relaxes existing requirements for lateral probe overlap in conventional ptychography. Thus, it can allow more flexible data acquisition.

Scanning MEMS Mirror for High Definition and High Frame Rate Lissajous Patterns

Scanning MEMS (micro-electro-mechanical system) mirrors are attractive given their potential use in a diverse array of laser scanning display and imaging applications. Here we report on an electrostatic MEMS mirror for high definition and high frame rate (HDHF) Lissajous scanning. The MEMS mirror comprised a low Q-factor inner mirror and frame mirror, which provided two-dimensional scanning at two similar resonant scanning frequencies with high mechanical stability. The low Q inner mirror enabled a broad frequency selection range. The high definition and high frame rate (HDHF) Lissajous scanning of the MEMS mirror was achieved by selecting a set of scanning frequencies near its resonance with a high greatest common divisor (GCD) and a high total lobe number. The MEMS mirror had resonant scanning frequencies at 5402 Hz and 6702 Hz in x and y directions, respectively. The selected pseudo-resonant frequencies of 5450 Hz and 6700 Hz for HDHF scanning provided 50 frames per second with 94% fill factor in 256 × 256 pixels. This Lissajous MEMS mirror could be utilized for assorted HDHF laser scanning imaging and display applications.

Design and realization of a wide field of view infrared scanning system with an integrated micro-electromechanical system mirror

We present a wide field of view (FOV) infrared scanning system, designed for single-pixel near-infrared thermal imaging. The scanning system consisted of a two-axis micro-electromechanical system (MEMS) mirror that was incorporated within the lens. The optical system consisted of two groups of lenses and a silicon avalanche photodiode. The system was designed for both the production of thermal images and also to utilize the techniques of radiation thermometry to measure the absolute temperature of targets from 500°C to 1100°C. Our system has the potential for real-time image acquisition, with improved data acquisition electronics. The FOV of our scanning system was ±30° when fully utilizing the MEMS mirror's scanning angle of ±5°. The pixel FOV (calculated from the distance to target size ratio) was 100:1. The image quality was analyzed, including the modulation transfer function, spot diagrams, ray fan plots, lateral chromatic aberrations, distortion, relative illumination, and size-of-source effect. The instrument was fabricated in our laboratory, and one of the thermal images, which was taken with the new lens, is presented as an example of the instrument optical performance.

Spectroscopic stimulated Raman scattering imaging of highly dynamic specimens through matrix completion

Spectroscopic stimulated Raman scattering (SRS) imaging generates chemical maps of intrinsic molecules, with no need for prior knowledge. Despite great advances in instrumentation, the acquisition speed for a spectroscopic SRS image stack is fundamentally bounded by the pixel integration time. In this work, we report three-dimensional sparsely sampled spectroscopic SRS imaging that measures ~20% of pixels throughout the stack. In conjunction with related work in low-rank matrix completion (e.g., the Netflix Prize), we develop a regularized non-negative matrix factorization algorithm to decompose the sub-sampled image stack into spectral signatures and concentration maps. This design enables an acquisition speed of 0.8 s per image stack, with 50 frames in the spectral domain and 40,000 pixels in the spatial domain, which is faster than the conventional raster laser-scanning scheme by one order of magnitude. Such speed allows real-time metabolic imaging of living fungi suspended in a growth medium while effectively maintaining the spatial and spectral resolutions. This work is expected to promote broad application of matrix completion in spectroscopic laser-scanning imaging.

Frequency selection rule for high definition and high frame rate Lissajous scanning

Lissajous microscanners are very attractive in compact laser scanning applications such as endomicroscopy or pro-projection display owing to high mechanical stability and low operating voltages. The scanning frequency serves as a critical factor for determining the scanning imaging quality. Here we report the selection rule of scanning frequencies that can realize high definition and high frame-rate (HDHF) full-repeated Lissajous scanning imaging. The fill factor (FF) monotonically increases with the total lobe number of a Lissajous curve, i.e., the sum of scanning frequencies divided by the great common divisor (GCD) of bi-axial scanning frequencies. The frames per second (FPS), called the pattern repeated rate or the frame rate, linearly increases with GCD. HDHF Lissajous scanning is achieved at the bi-axial scanning frequencies, where the GCD has the maximum value among various sets of the scanning frequencies satisfying the total lobe number for a target FF. Based on this selection rule, the experimental results clearly demonstrate that conventional Lissajous scanners substantially increase both FF and FPS by slightly modulating the scanning frequencies at near the resonance within the resonance bandwidth of a Lissajous scanner. This selection rule provides a new guideline for HDHF Lissajous scanning in compact laser scanning systems.

Multi-channel beam-scanning imaging at kHz frame rates by Lissajous trajectory microscopy

A beam-scanning microscope based on Lissajous trajectory imaging is described for achieving streaming 2D imaging with continuous frame rates up to 1.4 kHz. The microscope utilizes two fast-scan resonant mirrors to direct the optical beam on a circuitous trajectory through the field of view. By separating the full Lissajous trajectory time-domain data into sub-trajectories (partial, undersampled trajectories) effective frame-rates much higher than the repeat time of the Lissajous trajectory are achieved with many unsampled pixels present. A model-based image reconstruction (MBIR) 3D in-painting algorithm is then used to interpolate the missing data for the unsampled pixels to recover full images. The MBIR algorithm uses a maximum a posteriori estimation with a generalized Gaussian Markov random field prior model for image interpolation. Because images are acquired using photomultiplier tubes or photodiodes, parallelization for multi-channel imaging is straightforward. Preliminary results show that when combined with the MBIR in-painting algorithm, this technique has the ability to generate kHz frame rate images across 6 total dimensions of space, time, and polarization for SHG, TPEF, and confocal reflective birefringence data on a multimodal imaging platform for biomedical imaging. The use of a multi-channel data acquisition card allows for multimodal imaging with perfect image overlay. Image blur due to sample motion was also reduced by using higher frame rates.

High frame-rate multichannel beam-scanning microscopy based on Lissajous trajectories

A simple beam-scanning optical design based on Lissajous trajectory imaging is described for achieving up to kHz frame-rate optical imaging on multiple simultaneous data acquisition channels. In brief, two fast-scan resonant mirrors direct the optical beam on a circuitous trajectory through the field of view, with the trajectory repeat-time given by the least common multiplier of the mirror periods. Dicing the raw time-domain data into sub-trajectories combined with model-based image reconstruction (MBIR) 3D in-painting algorithms allows for effective frame-rates much higher than the repeat time of the Lissajous trajectory. Since sub-trajectory and full-trajectory imaging are simply different methods of analyzing the same data, both high-frame rate images with relatively low resolution and low frame rate images with high resolution are simultaneously acquired. The optical hardware required to perform Lissajous imaging represents only a minor modification to established beam-scanning hardware, combined with additional control and data acquisition electronics. Preliminary studies based on laser transmittance imaging and polarization-dependent second harmonic generation microscopy support the viability of the approach both for detection of subtle changes in large signals and for trace-light detection of transient fluctuations.

A 5-mm piezo-scanning fiber device for high speed ultrafast laser microsurgery

Towards developing precise microsurgery tools for the clinic, we previously developed image-guided miniaturized devices using low repetition rate amplified ultrafast lasers for surgery. To improve the speed of tissue removal while reducing device diameter, here we present a new 5-mm diameter device that delivers high-repetition rate laser pulses for high speed ultrafast laser microsurgery. The device consists of an air-core photonic bandgap fiber (PBF) for the delivery of high energy pulses, a piezoelectric tube actuator for fiber scanning, and two aspheric lenses for focusing the light. Its inline optical architecture provides easy alignment and substantial size reduction to 5 mm diameter as compared to our previous MEMS-scanning devices while realizing improved intensity squared (two-photon) lateral and axial resolutions of 1.16 μm and 11.46 μm, respectively. Our study also sheds light on the maximum pulse energies that can be delivered through the air-core PBF and identifies cladding damage at the input facet of the fiber as the limiting factor. We have achieved a maximum energy delivery larger than 700 nJ at 92% coupling efficiency. An in depth analysis reveals how this value is greatly affected by possible slight misalignments of the beam during coupling and the measured small beam pointing fluctuations. In the absence of these imperfections, self-phase modulation becomes the limiting factor for the maximum energy delivery, setting the theoretical upper bound to near 2 μJ for a 1-m long, 7-μm, air-core PBF. Finally, the use of a 300 kHz repetition rate fiber laser enabled rapid ablation of 150 µm x 150 µm area within only 50 ms. Such ablation speeds can now allow the surgeons to translate the surgery device as fast as ~4 mm/s to continuously remove a thin layer of a 150 µm wide tissue. Thanks to a high optical transmission efficiency of the in-line optical architecture of the device and improved resolution, we could successfully perform ablation of scarred cheek pouch tissue, drilling through a thin slice. With further development, this device can serve as a precise and high speed ultrafast laser scalpel in the clinic.

Lissajous fiber scanning for forward viewing optical endomicroscopy using asymmetric stiffness modulation

We report a fully packaged and compact forward viewing endomicroscope by using a resonant fiber scanner with two dimensional Lissajous trajectories. The fiber scanner comprises a single mode fiber with additional microstructures mounted inside a piezoelectric tube with quartered electrodes. The mechanical cross-coupling between the transverse axes of a resonant fiber with a circular cross-section was completely eliminated by asymmetrically modulating the stiffness of the fiber cantilever with silicon microstructures and an off-set fiber fragment. The Lissajous fiber scanner was fully packaged as endomicroscopic catheter passing through the accessory channel of a clinical endoscope and combined with spectral domain optical coherence tomography (SD-OCT). Ex-vivo 3D OCT images were successfully reconstructed along Lissajous trajectory. The preview imaging capability of the Lissajous scanning enables rapid 3D imaging with high temporal resolution. This endoscopic catheter provides many opportunities for on-demand and non-invasive optical biopsy inside a gastrointestinal endoscope.

A handheld electromagnetically actuated fiber optic raster scanner for reflectance confocal imaging of biological tissues

We present a hand-held device aimed for reflectance-mode confocal imaging of biological tissues. The device consists of a light carrying optical fiber and a miniaturized raster scanner located at the distal end of the fiber. It is fabricated by mounting a polarization maintaining optical fiber on a cantilever beam that is attached to another beam such that their bending axes are perpendicular to each other. Fiber scanner is driven by electromagnetic forces and enables large fiber deflections with low driving currents. Optical resolutions of the system are 1.55 and 8.45 μm in the lateral and axial directions, respectively. Functionality of the system is demonstrated by obtaining confocal images of a fly wing and a human colon tissue sample.

Forward imaging OCT endoscopic catheter based on MEMS lens scanning

This Letter reports a fully packaged microelectromechanical system (MEMS) endoscopic catheter for forward imaging optical coherence tomography (OCT). Two-dimensional optical scanning of Lissajous patterns was realized by the orthogonal movement of two commercial aspherical glass lenses laterally mounted on two resonating electrostatic MEMS microstages at low operating voltages. The MEMS lens scanner was integrated on a printed circuit board and packaged with an aluminum housing, a gradient index fiber collimator, and an objective lens. A home-built spectral-domain OCT system with 60 kHz A-line acquisition rate was combined with the endoscopic MEMS catheter. Three-dimensional images of 256×256×995 voxels were directly reconstructed by mapping the A-line datasets along the Lissajous patterns. The endoscopic catheter can provide a new direction for forward endoscopic OCT imaging.