Multi-color structured illumination microscopy for live cell imaging based on the enhanced image recombination transform algorithm

Parameter-free super-resolution structured illumination microscopy via a physics-enhanced neural network

With full-field imaging and high photon efficiency advantages, structured illumination microscopy (SIM) is one of the most potent super-resolution (SR) modalities in bioscience. Regarding SR reconstruction for SIM, spatial domain reconstruction (SDR) has been proven to be faster than traditional frequency domain reconstruction (FDR), facilitating real-time imaging of live cells. Nevertheless, SDR relies on high-precision parameter estimation for reconstruction, which tends to suffer from low signal-to-noise ratio (SNR) conditions and inevitably leads to artifacts that seriously affect the accuracy of SR reconstruction. In this Letter, a physics-enhanced neural network-based parameter-free SDR (PNNP-SDR) is proposed, which can achieve SR reconstruction directly in the spatial domain. As a result, the peak-SNR (PSNR) of PNNP-SDR is improved by about 4 dB compared to the cross-correlation (COR) SR reconstruction; meanwhile, the reconstruction speed of PNNP-SDR is even about five times faster than the fast approach based on principal component analysis (PCA). Given its capability of achieving parameter-free imaging, noise robustness, and high-fidelity and high-speed SR reconstruction over conventional SIM microscope hardware, the proposed PNNP-SDR is expected to be widely adopted in biomedical SR imaging scenarios.

Fast, multicolour optical sectioning over extended fields of view with patterned illumination and machine learning

Structured illumination can reject out-of-focus signal from a sample, enabling high-speed and high-contrast imaging over large areas with widefield detection optics. However, this optical sectioning technique is currently limited by image reconstruction artefacts and poor performance at low signal-to-noise ratios. We combine multicolour interferometric pattern generation with machine learning to achieve high-contrast, real-time reconstruction of image data that is robust to background noise and sample motion. We validate the method in silico and demonstrate imaging of diverse specimens, from fixed and live biological samples to synthetic biosystems, reconstructing data live at 11 Hz across a 44 × 44μm2 field of view, and demonstrate image acquisition speeds exceeding 154 Hz.

Easily scalable multi-color DMD-based structured illumination microscopy

Structured illumination microscopy (SIM) achieves super-resolution imaging using a series of phase-shifted sinusoidal illumination patterns to down-modulate high spatial-frequency information of samples. Digital micromirror devices (DMDs) have been increasingly used to generate SIM illumination patterns due to their high speed and moderate cost. However, a DMD micromirror array's blazed grating structure causes strong angular dispersion for different wavelengths of light, thus severely hampering its application in multicolor imaging. We developed a multi-color DMD-SIM setup that employs a diffraction grating to compensate the DMD's dispersion and demonstrate super-resolution SIM imaging of both fluorescent beads and live cells samples with four color channels. This simple but effective approach can be readily scaled to more color channels, thereby greatly expanding the application of SIM in the study of complex multi-component structures and dynamics in soft matter systems.

Superresolution structured illumination microscopy reconstruction algorithms: a review

Structured illumination microscopy (SIM) has become the standard for next-generation wide-field microscopy, offering ultrahigh imaging speed, superresolution, a large field-of-view, and long-term imaging. Over the past decade, SIM hardware and software have flourished, leading to successful applications in various biological questions. However, unlocking the full potential of SIM system hardware requires the development of advanced reconstruction algorithms. Here, we introduce the basic theory of two SIM algorithms, namely, optical sectioning SIM (OS-SIM) and superresolution SIM (SR-SIM), and summarize their implementation modalities. We then provide a brief overview of existing OS-SIM processing algorithms and review the development of SR-SIM reconstruction algorithms, focusing primarily on 2D-SIM, 3D-SIM, and blind-SIM. To showcase the state-of-the-art development of SIM systems and assist users in selecting a commercial SIM system for a specific application, we compare the features of representative off-the-shelf SIM systems. Finally, we provide perspectives on the potential future developments of SIM.

Reconstruction algorithm using 2N+1 raw images for structured illumination microscopy

This paper presents a structured illumination microscopy (SIM) reconstruction algorithm that allows the reconstruction of super-resolved images with 2N + 1 raw intensity images, with N being the number of structured illumination directions used. The intensity images are recorded after using a 2D grating for the projection fringe and a spatial light modulator to select two orthogonal fringe orientations and perform phase shifting. Super-resolution images can be reconstructed from the five intensity images, enhancing the imaging speed and reducing the photobleaching by 17%, compared to conventional two-direction and three-step phase-shifting SIM. We believe the proposed technique will be further developed and widely applied in many fields.

Parameter estimation of the structured illumination pattern based on principal component analysis (PCA): PCA-SIM

Principal component analysis (PCA), a common dimensionality reduction method, is introduced into SIM to identify the frequency vectors and pattern phases of the illumination pattern with precise subpixel accuracy, fast speed, and noise-robustness, which is promising for real-time and long-term live-cell imaging.

Live-cell fluorescence spectral imaging as a data science challenge

Live-cell fluorescence spectral imaging is an evolving modality of microscopy that uses specific properties of fluorophores, such as excitation or emission spectra, to detect multiple molecules and structures in intact cells. The main challenge of analyzing live-cell fluorescence spectral imaging data is the precise quantification of fluorescent molecules despite the weak signals and high noise found when imaging living cells under non-phototoxic conditions. Beyond the optimization of fluorophores and microscopy setups, quantifying multiple fluorophores requires algorithms that separate or unmix the contributions of the numerous fluorescent signals recorded at the single pixel level. This review aims to provide both the experimental scientist and the data analyst with a straightforward description of the evolution of spectral unmixing algorithms for fluorescence live-cell imaging. We show how the initial systems of linear equations used to determine the concentration of fluorophores in a pixel progressively evolved into matrix factorization, clustering, and deep learning approaches. We outline potential future trends on combining fluorescence spectral imaging with label-free detection methods, fluorescence lifetime imaging, and deep learning image analysis.

Mitochondrial dynamics and quantification of mitochondria-derived vesicles in cardiomyoblasts using structured illumination microscopy

Mitochondria are essential energy-providing organelles of particular importance in energy-demanding tissue such as the heart. The production of mitochondria-derived vesicles (MDVs) is a cellular mechanism by which cells ensure a healthy pool of mitochondria. These vesicles are small and fast-moving objects not easily captured by imaging. In this work, we have tested the ability of the optical super-resolution technique 3DSIM to capture high-resolution images of MDVs. We optimized the imaging conditions both for high-speed video microscopy and fixed-cell imaging and analysis. From the 3DSIM videos, we observed an abundance of MDVs and many dynamic mitochondrial tubules. The density of MDVs in cells was compared for cells under normal growth conditions and cells during metabolic perturbation. Our results indicate a higher abundance of MDVs in H9c2 cells during glucose deprivation compared with cells under normal growth conditions. Furthermore, the results reveal a large untapped potential of 3DSIM in MDV research.

Polarization and Orbital Angular Momentum of Light in Biomedical Applications: feature issue introduction

In the last decade, consistent and successful innovations have been achieved in the field of lasers and optics, collectively known as 'photonics', founding new applications in biomedicine, including clinical biopsy. Non-invasive photonics-based diagnostic modalities are rapidly expanding, and with their exponential improvement, there is a great potential to develop practical instrumentation for automatic detection and identification of different types and/or sub-types of diseases at a very early stage. While using conventional light for the studies of different properties of objects in materials science, astrophysics and biomedicine already has a long history, the interaction of polarized light and optical angular momentum with turbid tissue-like scattering media has not yet been ultimately explored. Since recently this research area became a hot topic. This feature issue is a first attempt to summarize the recognitions achieved in this emerging research field of polarized light and optical angular momentum for practical biomedical applications during the last years.