Two-dimensional single-pixel imaging by cascaded orthogonal line spatial modulation

Wavelength domain spatial frequency modulation imaging: enabling fiber optic delivery and detection

Spatial frequency modulation imaging (SPIFI) provides a simple architecture for modulating an extended illumination source that is compatible with single pixel imaging. We demonstrate wavelength domain SPIFI (WD-SPIFI) by encoding time-varying spatial frequencies in the spectral domain that can produce enhanced resolution images, like its spatial domain counterpart, spatial domain (SD) SPIFI. However, contrary to SD-SPIFI, WD-SPIFI enables remote delivery by single mode fiber, which can be attractive for applications where free-space imaging is not practical. Finally, we demonstrate a cascaded system incorporating WD-SPIFI in-line with SD-SPIFI enabling single pixel 2D imaging without any beam or sample scanning.

Cascaded domain multiphoton spatial frequency modulation imaging

Significance

Multiphoton microscopy is a powerful imaging tool for biomedical applications. A variety of techniques and respective benefits exist for multiphoton microscopy, but an enhanced resolution is especially desired. Additionally multiphoton microscopy requires ultrafast pulses for excitation, so optimization of the pulse duration at the sample is critical for strong signals.

Aim

We aim to perform enhanced resolution imaging that is robust to scattering using a structured illumination technique while also providing a rapid and easily repeatable means to optimize group delay dispersion (GDD) compensation through to the sample.

Approach

Spatial frequency modulation imaging (SPIFI) is used in two domains: the spatial domain (SD) and the wavelength domain (WD). The WD-SPIFI system is an in-line tool enabling GDD optimization that considers all material through to the sample. The SD-SPIFI system follows and enables enhanced resolution imaging.

Results

The WD-SPIFI dispersion optimization performance is confirmed with independent pulse characterization, enabling rapid optimization of pulses for imaging with the SD-SPIFI system. The SD-SPIFI system demonstrates enhanced resolution imaging without the use of photon counting enabled by signal to noise improvements due to the WD-SPIFI system.

Conclusions

Implementing SPIFI in-line in two domains enables full-path dispersion compensation optimization through to the sample for enhanced resolution multiphoton microscopy.

Design and analysis of polygonal mirror-based scan engines for improved spatial frequency modulation imaging

Spatial frequency modulation imaging (SPIFI) is a structured illumination single pixel imaging technique that is most often achieved via a rotating modulation disk. This implementation produces line images with exposure times on the order of tens of milliseconds. Here, we present a new architecture for SPIFI using a polygonal scan mirror with the following advances: (1) reducing SPIFI line image exposure times by 2 orders of magnitude, (2) facet-to-facet measurement and correction for polygonal scan design, and (3) a new anamorphic magnification scheme that improves resolution for long working distance optics.

Fisher information and the Cramér-Rao lower bound in single-pixel localization microscopy with spatiotemporally modulated illumination

Single-pixel imaging, the concept that an image can be captured via a single-pixel detector, is a cost-effective yet powerful technique to reduce data acquisition duration without sacrificing image resolution when properly structured illumination patterns are introduced. Normally, the image reconstruction process is subject to the diffraction limit. Here, we study the possibility of exploiting the information contained in the illumination patterns to enable a form of single-pixel localization microscopy (SPLM) for super-resolution. This concept is inspired by coherent holographic image reconstruction by phase transfer (CHIRPT) microscopy. CHIRPT microscopy is a single-pixel imaging technique that uses structured illumination that is spatiotemporally modulated (STM) so that a unique temporal modulation pattern is imparted to each point within a large illumination volume. The fluorescent light emitted by molecules contains the same temporal modulations as the illumination patterns at the locations of the molecules. By recording a portion of the total emitted fluorescent power, the signal may be numerically processed to form an image. Unique temporal modulation patterns that excite fluorescent probes at each point can also be used to localize individual molecules by matching their particular temporal light emission patterns to the measured temporal signal. This paper evaluates the feasibility of SPLM with STM illuminations used in and inspired by CHIRPT microscopy via the information content its data carry about the emitter location(s). More specifically, we provide the mathematical formalism of Fisher information (FI) and the Cramér-Rao lower bound (CRLB) associated with the location parameters of the emitter(s). The FI and CRLB are then numerically evaluated under different experimental assumptions to assess the effects of experimental parameters on localization precision. Last, we compare the single-pixel CRLB to that from camera-based single-molecule localization microscopy in the localization of a single emitter. We show that SPLM has several distinguishing characteristics that provide certain advantages, such as relatively constant CRLB over a very large illumination volume and improved CRLB for 3D localization due to the information coupling introduced by simultaneous modulations of the transverse axes.

Super-resolution stimulated Raman scattering microscopy with the phase-shifted spatial frequency modulation

We present a unique super-resolution stimulated Raman scattering (SRS) microscopy technique based on phase-shifted spatial frequency modulation (PSFM) under wide-field illumination, permitting super-resolution chemical imaging with single-pixel detection. Through projecting a series of the pump and Stokes laser patterns with varying spatial frequencies onto the sample and combining with the proposed π-phase shift, the higher spatial information can be rapidly retrieved by implementing the fast inverse Fourier-transform on the spatial frequency-encoded SRS data. We have derived the theory of the PSFM-SRS technique for super-resolution imaging. Our further modeling results confirm that PSFM-SRS microscopy provides a ∼2.2-fold improvement in spatial resolution but with a much-reduced laser excitation power density required as compared with conventional point-scan SRS microscopy, suggesting its potential for label-free super-resolution chemical imaging in cells and tissue.

Single-pixel camera based on a spinning mask

Single-pixel imaging (SPI) has been intensively studied in recent years for its capacity to obtain 2D images using a non-pixelated detector. However, the traditional modulation modality using an iteratively refreshed spatial light modulator has significantly restricted its imaging speed, which is a primary barrier to its widespread application. In this work, we propose and demonstrate a new, to the best of our knowledge, SPI scheme using a spinning mask for modulation. An annular binary mask is designed and spun to perform fast spatial modulation, neglecting the iterative modulation modality that limits SPI speed. A multi-spectral SPI system at 100 frames per second is demonstrated, covering a wide range of spectra, from ultraviolet to short-wave infrared light. We believe that this elegant and low-cost scheme will enable SPI to pave its way for practical application.

Full-field fluorescence lifetime dual-comb microscopy using spectral mapping and frequency multiplexing of dual-comb optical beats

Fluorescence lifetime imaging microscopy (FLIM) is a powerful tool for quantitative fluorescence imaging because fluorescence lifetime is independent of concentration of fluorescent molecules or excitation/detection efficiency and is robust to photobleaching. However, since most FLIMs are based on point-to-point measurements, mechanical scanning of a focal spot is needed for forming an image, which hampers rapid imaging. Here, we demonstrate scan-less full-field FLIM based on a one-to-one correspondence between two-dimensional (2D) image pixels and frequency-multiplexed radio frequency (RF) signals. A vast number of dual-comb optical beats between dual optical frequency combs are effectively adopted for 2D spectral mapping and high-density frequency multiplexing in the RF region. Bimodal images of fluorescence amplitude and lifetime are obtained with high quantitativeness from amplitude and phase spectra of fluorescence RF comb modes without the need for mechanical scanning. The parallelized FLIM will be useful for rapid quantitative fluorescence imaging in life science.

3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging

Transparent object detection and reconstruction are significant, due to their practical applications. The appearance and characteristics of light in these objects make reconstruction methods tailored for Lambertian surfaces fail disgracefully. In this paper, we introduce a fixed multi-viewpoint approach to ascertain the shape of transparent objects, thereby avoiding the rotation or movement of the object during imaging. In addition, a simple and cost-effective experimental setup is presented, which employs two single-pixel detectors and a digital micromirror device, for imaging transparent objects by projecting binary patterns. In the system setup, a dark framework is implemented around the object, to create shades at the boundaries of the object. By triangulating the light path from the object, the surface shape is recovered, neither considering the reflections nor the number of refractions. It can, therefore, handle transparent objects with a relatively complex shape with the unknown refractive index. The implementation of compressive sensing in this technique further simplifies the acquisition process, by reducing the number of measurements. The experimental results show that 2D images obtained from the single-pixel detectors are better in quality with a resolution of 32×32. Additionally, the obtained disparity and error map indicate the feasibility and accuracy of the proposed method. This work provides a new insight into 3D transparent object detection and reconstruction, based on single-pixel imaging at an affordable cost, with the implementation of a few numbers of detectors.

Three-dimensional single-pixel imaging of incoherent light with spatiotemporally modulated illumination

We derive analytic expressions for the three-dimensional coherent transfer function (CTF) and coherent spread function (CSF) for coherent holographic image reconstruction by phase transfer (CHIRPT) microscopy with monochromatic and broadband illumination sources. The 3D CSF and CTF were used to simulate CHIRPT images, and the results show excellent agreement with experimental data. Finally, we show that the formalism presented here for computing the CSF/CTF pair in CHIRPT microscopy can be readily extended to other forms of single-pixel imaging, such as spatial-frequency-modulated imaging.

Computational-weighted Fourier single-pixel imaging via binary illumination

Single-pixel imaging has the ability to generate images at nonvisible wavelengths and under low light conditions and thus has received increasing attention in recent years. Fourier single-pixel imaging (FSI) utilizes deterministic basis patterns for illumination to greatly improve the quality of image reconstruction. However, the original FSI based on grayscale Fourier basis illumination patterns is limited by the imaging speed as the digital micro-mirror devices (DMD) used to generate grayscale patterns operate at a low refresh rate. In this paper, a new approach is proposed to increase the imaging speed of DMD-based FSI without reducing the imaging spatial resolution. In this strategy, the grayscale Fourier basis patterns are split into a pair of grayscale patterns based on positive/negative pixel values, which are then decomposed into a cluster of binary basis patterns based on the principle of decimalization to binary. These binary patterns are used to illuminate the imaged object. The resulting detected light intensities multiply the corresponding weighted decomposed coefficients and are summed, and the results can be used to generate the Fourier spectrum for the imaged object. Finally, an inverse Fourier transform is applied to the Fourier spectrum to obtain the object image. The proposed technique is verified by a computational simulation and laboratory experiments. Both static and dynamic imaging experiments are carried out to demonstrate the proposed strategy. 128 × 128 pixels dynamic scenes at a speed of ~9 frames-per-second are captured under 22 KHz projection rate using a DMD. The reported technique accelerates the imaging speed for DMD-based FSI and provides an alternative approach to improve FSI efficiency.

General theoretical treatment of spectral modulation light-labeling spectroscopy

We theoretically derive the analytic relationship between experimental parameters and the measured incident (or illumination) optical power spectrum for a new form of spectroscopy, entitled light labeling spectroscopy. The light labeling signals are shown to arise from the interference between fields diffracted from a grating with time varying ruling density. A Gaussian model is used to illustrate the bounds of the method for recovering power spectra without artificial spectral apodization. Finally, several example systems are tabulated to give numerical insight into the possible system performances across a range of wavelength regions.

Superresolved multiphoton microscopy with spatial frequency-modulated imaging

Superresolved far-field microscopy has emerged as a powerful tool for investigating the structure of objects with resolution well below the diffraction limit of light. Nearly all superresolution imaging techniques reported to date rely on real energy states of fluorescent molecules to circumvent the diffraction limit, preventing superresolved imaging with contrast mechanisms that occur via virtual energy states, including harmonic generation (HG). We report a superresolution technique based on spatial frequency-modulated imaging (SPIFI) that permits superresolved nonlinear microscopy with any contrast mechanism and with single-pixel detection. We show multimodal superresolved images with two-photon excited fluorescence (TPEF) and second-harmonic generation (SHG) from biological and inorganic media. Multiphoton SPIFI (MP-SPIFI) provides spatial resolution up to 2η below the diffraction limit, where η is the highest power of the nonlinear intensity response. MP-SPIFI can be used to provide enhanced resolution in optically thin media and may provide a solution for superresolved imaging deep in scattering media.

Plane wave analysis of coherent holographic image reconstruction by phase transfer (CHIRPT)

Fluorescent imaging plays a critical role in a myriad of scientific endeavors, particularly in the biological sciences. Three-dimensional imaging of fluorescent intensity often requires serial data acquisition, that is, voxel-by-voxel collection of fluorescent light emitted throughout the specimen with a nonimaging single-element detector. While nonimaging fluorescence detection offers some measure of scattering robustness, the rate at which dynamic specimens can be imaged is severely limited. Other fluorescent imaging techniques utilize imaging detection to enhance collection rates. A notable example is light-sheet fluorescence microscopy, also known as selective-plane illumination microscopy, which illuminates a large region within the specimen and collects emitted fluorescent light at an angle either perpendicular or oblique to the illumination light sheet. Unfortunately, scattering of the emitted fluorescent light can cause blurring of the collected images in highly turbid biological media. We recently introduced an imaging technique called coherent holographic image reconstruction by phase transfer (CHIRPT) that combines light-sheet-like illumination with nonimaging fluorescent light detection. By combining the speed of light-sheet illumination with the scattering robustness of nonimaging detection, CHIRPT is poised to have a dramatic impact on biological imaging, particularly for in vivo preparations. Here we present the mathematical formalism for CHIRPT imaging under spatially coherent illumination and present experimental data that verifies the theoretical model.