Temporal focusing-based widefield multiphoton microscopy with spatially modulated illumination for biotissue imaging

Temporal focusing multiphoton microscopy with cross-modality multi-stage 3D U-Net for fast and clear bioimaging

Temporal focusing multiphoton excitation microscopy (TFMPEM) enables fast widefield biotissue imaging with optical sectioning. However, under widefield illumination, the imaging performance is severely degraded by scattering effects, which induce signal crosstalk and a low signal-to-noise ratio in the detection process, particularly when imaging deep layers. Accordingly, the present study proposes a cross-modality learning-based neural network method for performing image registration and restoration. In the proposed method, the point-scanning multiphoton excitation microscopy images are registered to the TFMPEM images by an unsupervised U-Net model based on a global linear affine transformation process and local VoxelMorph registration network. A multi-stage 3D U-Net model with a cross-stage feature fusion mechanism and self-supervised attention module is then used to infer in-vitro fixed TFMPEM volumetric images. The experimental results obtained for in-vitro drosophila mushroom body (MB) images show that the proposed method improves the structure similarity index measures (SSIMs) of the TFMPEM images acquired with a 10-ms exposure time from 0.38 to 0.93 and 0.80 for shallow- and deep-layer images, respectively. A 3D U-Net model, pretrained on in-vitro images, is further trained using a small in-vivo MB image dataset. The transfer learning network improves the SSIMs of in-vivo drosophila MB images captured with a 1-ms exposure time to 0.97 and 0.94 for shallow and deep layers, respectively.

Image improvement of temporal focusing multiphoton microscopy via superior spatial modulation excitation and Hilbert-Huang transform decomposition

Temporal focusing-based multiphoton excitation microscopy (TFMPEM) just provides the advantage of widefield optical sectioning ability with axial resolution of several micrometers. However, under the plane excitation, the photons emitted from the molecules in turbid tissues undergo scattering, resulting in complicated background noise and an impaired widefield image quality. Accordingly, this study constructs a general and comprehensive numerical model of TFMPEM utilizing Fourier optics and performs simulations to determine the superior spatial frequency and orientation of the structured pattern which maximize the axial excitation confinement. It is shown experimentally that the optimized pattern minimizes the intensity of the out-of-focus signal, and hence improves the quality of the image reconstructed using the Hilbert transform (HT). However, the square-like reflection components on digital micromirror device leads to pattern residuals in the demodulated image when applying high spatial frequency of structured pattern. Accordingly, the HT is replaced with Hilbert-Huang transform (HHT) in order to sift out the low-frequency background noise and pattern residuals in the demodulation process. The experimental results obtained using a kidney tissue sample show that the HHT yields a significant improvement in the TFMPEM image quality.

A two-photon fluorescence probe for cell membrane imaging under temporal-focusing multiphoton excitation microscopy (TFMPEM)

A small-sized chromophore, BTTA-2OH, manifesting favorable solubility, large two-photon excitation efficiency, and good fluorescence photostability was synthesized to label the membrane of living cells for visualizing the dynamic movement of membrane-related vesicles via a two-photon fluorescence imaging technique based on wavelength-tunable temporal-focusing multiphoton excitation microscopy.

Temporal focusing multiphoton microscopy with optimized parallel multiline scanning for fast biotissue imaging

SIGNIFICANCE

Line scanning-based temporal focusing multiphoton microscopy (TFMPM) has superior axial excitation confinement (AEC) compared to conventional widefield TFMPM, but the frame rate is limited due to the limitation of the single line-to-line scanning mechanism. The development of the multiline scanning-based TFMPM requires only eight multiline patterns for full-field uniform multiphoton excitation and it still maintains superior AEC.

AIM

The optimized parallel multiline scanning TFMPM is developed, and the performance is verified with theoretical simulation. The system provides a sharp AEC equivalent to the line scanning-based TFMPM, but fewer scans are required.

APPROACH

A digital micromirror device is integrated in the TFMPM system and generates the multiline pattern for excitation. Based on the result of single-line pattern with sharp AEC, we can further model the multiline pattern to find the best structure that has the highest duty cycle together with the best AEC performance.

RESULTS

The AEC is experimentally improved to 1.7  μm from the 3.5  μm of conventional TFMPM. The adopted multiline pattern is akin to a pulse-width-modulation pattern with a spatial period of four times the diffraction-limited line width. In other words, ideally only four π  /  2 spatial phase-shift scans are required to form a full two-dimensional image with superior AEC instead of image-size-dependent line-to-line scanning.

CONCLUSIONS

We have demonstrated the developed parallel multiline scanning-based TFMPM has the multiline pattern for sharp AEC and the least scans required for full-field uniform excitation. In the experimental results, the temporal focusing-based multiphoton images of disordered biotissue of mouse skin with improved axial resolution due to the near-theoretical limit AEC are shown to clearly reduce background scattering.

Fast and improved bioimaging via temporal focusing multiphoton excitation microscopy with binary digital-micromirror-device holography

Conventional temporal focusing-based multiphoton excitation microscopy (TFMPEM) can offer widefield optical sectioning with an axial excitation confinement of a few microns. To improve the axial confinement of TFMPEM, a binary computer-generated Fourier hologram (CGFH) via a digital-micromirror-device (DMD) was implemented to intrinsically improve the axial confinement by filling the back-focal aperture of the objective lens. Experimental results show that the excitation focal volume can be condensed and the axial confinement improved about 24% according to the DMD holography. In addition, pseudouniform MPE can be achieved using two complementary CGFHs with rapid pulse-width modulation switching via the DMD. Furthermore, bioimaging of CV-1 in origin with SV40 genes-7 cells demonstrates that the TFMPEM with binary DMD holography can improve image quality by enhancing axial excitation confinement and rejecting out-of-focus excitation.