Double-exposure optical sectioning structured illumination microscopy based on Hilbert transform reconstruction

Structured Illumination Microscopy of Mitochondrial in Mouse Hepatocytes with an Improved Image Reconstruction Algorithm

In this paper, a structured illumination microscopy (SIM) image reconstruction algorithm combined with notch function (N-SIM) is proposed. This method suppresses the defocus signal in the imaging process by processing the low-frequency signal of the image. The existing super-resolution image reconstruction algorithm produces streak artifacts caused by defocus signal. The experimental results show that the algorithm proposed in our study can well suppress the streak artifacts caused by defocused signals during the imaging process without losing the effective information of the image. The image reconstruction algorithm is used to analyze the mouse hepatocytes, and the image processing tool developed by MATLAB is applied to identify, detect and count the reconstructed images of mitochondria and lipid droplets, respectively. It is found that the mitochondrial activity in oxidative stress induced growth inhibitor 1 (OSGIN1) overexpressed mouse hepatocytes is higher than that in normal cells, and the interaction with lipid droplets is more obvious. This paper provides a reliable subcellular observation platform, which is very meaningful for biomedical work.

Background inhibited and speed-loss-free volumetric imaging in vivo based on structured-illumination Fourier light field microscopy

Benefiting from its advantages in fast volumetric imaging for recording biodynamics, Fourier light field microscopy (FLFM) has a wide range of applications in biomedical research, especially in neuroscience. However, the imaging quality of the FLFM is always deteriorated by both the out-of-focus background and the strong scattering in biological samples. Here we propose a structured-illumination and interleaved-reconstruction based Fourier light field microscopy (SI-FLFM), in which we can filter out the background fluorescence in FLFM without sacrificing imaging speed. We demonstrate the superiority of our SI-FLFM in high-speed, background-inhibited volumetric imaging of various biodynamics in larval zebrafish and mice in vivo. The signal-to-background ratio (SBR) is improved by tens of times. And the volumetric imaging speed can be up to 40 Hz, avoiding artifacts caused by temporal under-sampling in conventional structured illumination microscopy. These suggest that our SI-FLFM is suitable for applications of weak fluorescence signals but high imaging speed requirements.

Image improvement of temporal focusing multiphoton microscopy via superior spatial modulation excitation and Hilbert-Huang transform decomposition

Temporal focusing-based multiphoton excitation microscopy (TFMPEM) just provides the advantage of widefield optical sectioning ability with axial resolution of several micrometers. However, under the plane excitation, the photons emitted from the molecules in turbid tissues undergo scattering, resulting in complicated background noise and an impaired widefield image quality. Accordingly, this study constructs a general and comprehensive numerical model of TFMPEM utilizing Fourier optics and performs simulations to determine the superior spatial frequency and orientation of the structured pattern which maximize the axial excitation confinement. It is shown experimentally that the optimized pattern minimizes the intensity of the out-of-focus signal, and hence improves the quality of the image reconstructed using the Hilbert transform (HT). However, the square-like reflection components on digital micromirror device leads to pattern residuals in the demodulated image when applying high spatial frequency of structured pattern. Accordingly, the HT is replaced with Hilbert-Huang transform (HHT) in order to sift out the low-frequency background noise and pattern residuals in the demodulation process. The experimental results obtained using a kidney tissue sample show that the HHT yields a significant improvement in the TFMPEM image quality.

Computational multifocus fluorescence microscopy for three-dimensional visualization of multicellular tumor spheroids

SIGNIFICANCE

Three-dimensional (3D) visualization of multicellular tumor spheroids (MCTS) in fluorescence microscopy can rapidly provide qualitative morphological information about the architecture of these cellular aggregates, which can recapitulate key aspects of their in vivo counterpart.

AIM

The present work is aimed at overcoming the shallow depth-of-field (DoF) limitation in fluorescence microscopy while achieving 3D visualization of thick biological samples under study.

APPROACH

A custom-built fluorescence microscope with an electrically focus-tunable lens was developed to optically sweep in-depth the structure of MCTS. Acquired multifocus stacks were combined by means of postprocessing algorithms performed in the Fourier domain.

RESULTS

Images with relevant characteristics as extended DoF, stereoscopic pairs as well as reconstructed viewpoints of MCTS were obtained without segmentation of the focused regions or estimation of the depth map. The reconstructed images allowed us to observe the 3D morphology of cell aggregates.

CONCLUSIONS

Computational multifocus fluorescence microscopy can provide 3D visualization in MCTS. This tool is a promising development in assessing the morphological structure of different cellular aggregates while preserving a robust yet simple optical setup.

High-speed volumetric imaging in vivo based on structured illumination microscopy with interleaved reconstruction

Wide-field fluorescence microscopy (WFFM) is widely adopted in biomedical studies, due to its high imaging speed over large field-of-views. However, WFFM is susceptible to out-of-focus background. To overcome this problem, structured illumination microscopy (SIM) was proposed as a wide-field, optical-sectioning technique, which needs multiple raw images for image reconstruction and thus has a lower imaging speed. Here we propose SIM with interleaved reconstruction, to make SIM of lossless speed. We apply this method in volumetric imaging of neural network dynamics in brains of zebrafish larva in vivo.

Super-resolution algorithm based on Richardson-Lucy deconvolution for three-dimensional structured illumination microscopy

Three-dimensional structured illumination microscopy (3D-SIM) is a wide-field super-resolution technique in fluorescent imaging that can double the resolution beyond its classical limit. We introduce, to the best of our knowledge, a new 3D reconstruction algorithm based on the Richardson-Lucy deconvolution. The 3D-SIM imaging principle and the reconstruction steps are demonstrated in detail. Microspheres and biological specimen are used to present the performance of this method. The background of the out-of-focus portion is effectively suppressed, and true optical sectioning and super-resolution can be achieved simultaneously. For the custom-built 3D-SIM and this reconstruction algorithm, the measured resolution was 99.5±5  nm laterally and 294±9  nm axially.

Axial resolution enhancement of light-sheet microscopy by double scanning of Bessel beam and its complementary beam

The side lobes of Bessel beam will create significant out-of-focus background when scanned in light-sheet fluorescence microscopy (LSFM), limiting the axial resolution of the imaging system. Here, we propose to overcome this issue by scanning the sample twice with zeroth-order Bessel beam and another type of propagation-invariant beam, complementary to the zeroth-order Bessel beam, which greatly reduces the out-of-focus background created in the first scan. The axial resolution can be improved from 1.68 μm of the Bessel light-sheet to 1.07 μm by subtraction of the two scanned images across a whole field-of-view of up to 300 μm × 200 μm × 200 μm. The optimization procedure to create the complementary beam is described in detail and it is experimentally generated with a spatial light modulator. The imaging performance is validated experimentally with fluorescent beads as well as eGFP-labeled mouse brain neurons.

Single shot, three-dimensional fluorescence microscopy with a spatially rotating point spread function

A wide-field fluorescence microscope with a double-helix point spread function (PSF) is constructed to obtain the specimen's three-dimensional distribution with a single snapshot. Spiral-phase-based computer-generated holograms (CGHs) are adopted to make the depth-of-field of the microscope adjustable. The impact of system aberrations on the double-helix PSF at high numerical aperture is analyzed to reveal the necessity of the aberration correction. A modified cepstrum-based reconstruction scheme is promoted in accordance with properties of the new double-helix PSF. The extended depth-of-field images and the corresponding depth maps for both a simulated sample and a tilted section slice of bovine pulmonary artery endothelial (BPAE) cells are recovered, respectively, verifying that the depth-of-field is properly extended and the depth of the specimen can be estimated at a precision of 23.4nm. This three-dimensional fluorescence microscope with a framerate-rank time resolution is suitable for studying the fast developing process of thin and sparsely distributed micron-scale cells in extended depth-of-field.

Gram-Schmidt orthonormalization for retrieval of amplitude images under sinusoidal patterns of illumination

Structured illumination using sinusoidal patterns has been used for optical imaging of biological tissues in biomedical research, and of horticultural products in food quality evaluation. Implementation of structured-illumination imaging relies on retrieval of amplitude images, which is conventionally achieved by a phase-shifting technique that requires collecting a minimum of three phase-shifted images. In this study, we have proposed Gram-Schmidt orthonormalization (GSO) to retrieve amplitude component (AC) images using only two phase-shifted images. We have proposed two forms of GSO implementation, and prior to GSO processing, we eliminated the direct component (DC) background by subtracting a DC image we recovered using a spiral phase function (SPF) in the Fourier space. We demonstrated the GSO methods through numerical simulations and application examples of detection of bruise defects in apples by structured-illumination reflectance imaging (SIRI). GSO performed comparably to conventional three-phase-based demodulation. It is simple, fast and effective for amplitude retrieval and requires no prior phase information, which could facilitate fast implementation of structured-illumination imaging.