Three-dimensional structured illumination microscopy with enhanced axial resolution

hydroSIM: super-resolution speckle illumination microscopy with a hydrogel diffuser

Super-resolution microscopy has emerged as an indispensable methodology for probing the intricacies of cellular biology. Structured illumination microscopy (SIM), in particular, offers an advantageous balance of spatial and temporal resolution, allowing for visualizing cellular processes with minimal disruption to biological specimens. However, the broader adoption of SIM remains hampered by the complexity of instrumentation and alignment. Here, we introduce speckle-illumination super-resolution microscopy using hydrogel diffusers (hydroSIM). The study utilizes the high scattering and optical transmissive properties of hydrogel materials and realizes a remarkably simplified approach to plug-in super-resolution imaging via a common epi-fluorescence platform. We demonstrate the hydroSIM system using various phantom and biological samples, and the results exhibited effective 3D resolution doubling, optical sectioning, and high contrast. We foresee hydroSIM, a cost-effective, biocompatible, and user-accessible super-resolution methodology, to significantly advance a wide range of biomedical imaging and applications.

Live-cell imaging powered by computation

The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preserving cell viability. Computational methods can help to address this challenge and are now shifting the boundaries of what is possible to capture in living systems. In this Review, we discuss these computational methods focusing on artificial intelligence-based approaches that can be layered on top of commonly used existing microscopies as well as hybrid methods that integrate computation and microscope hardware. We specifically discuss how computational approaches can improve the signal-to-noise ratio, spatial resolution, temporal resolution and multi-colour capacity of live-cell imaging.

Live-cell single-molecule fluorescence microscopy for protruding organelles reveals regulatory mechanisms of MYO7A-driven cargo transport in stereocilia of inner ear hair cells

Stereocilia are unidirectional F-actin-based cylindrical protrusions on the apical surface of inner ear hair cells and function as biological mechanosensors of sound and acceleration. Development of functional stereocilia requires motor activities of unconventional myosins to transport proteins necessary for elongating the F-actin cores and to assemble the mechanoelectrical transduction (MET) channel complex. However, how each myosin localizes in stereocilia using the energy from ATP hydrolysis is only partially understood. In this study, we develop a methodology for live-cell single-molecule fluorescence microscopy of organelles protruding from the apical surface using a dual-view light-sheet microscope, diSPIM. We demonstrate that MYO7A, a component of the MET machinery, traffics as a dimer in stereocilia. Movements of MYO7A are restricted when scaffolded by the plasma membrane and F-actin as mediated by MYO7A's interacting partners. Here, we discuss the technical details of our methodology and its future applications including analyses of cargo transportation in various organelles.

Single-molecule localization microscopy at 2.4-fold resolution improvement with optical lattice pattern illumination

Traditional camera-based single-molecule localization microscopy (SMLM), with its high imaging resolution and localization throughput, has made significant advancements in biological and chemical researches. However, due to the limitation of the fluorescence signal-to-noise ratio (SNR) of a single molecule, its resolution is difficult to reach to 5 nm. Optical lattice produces a nondiffracting beam pattern that holds the potential to enhance microscope performance through its high contrast and penetration depth. Here, we propose a new method named LatticeFLUX which utilizes the wide-field optical lattice pattern illumination for individual molecule excitation and localization. We calculated the Cramér-Rao lower bound of LatticeFLUX resolution and proved that our method can improve the single molecule localization precision by 2.4 times compared with the traditional SMLM. We propose a scheme using 9-frame localization, which solves the problem of uneven lattice light illumination. Based on the experimental single-molecule fluorescence SNR, we coded the image reconstruction software to further verify the resolution enhancement capability of LatticeFLUX on simulated punctate DNA origami, line pairs, and cytoskeleton. LatticeFLUX confirms the feasibility of using 2D structured light illumination to obtain high single-molecule localization precision under high localization throughput. It paves the way for further implementation of ultra-high resolution full 3D structured-light-illuminated SMLM.

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Computational super-resolution methods, including conventional analytical algorithms and deep learning models, have substantially improved optical microscopy. Among them, supervised deep neural networks have demonstrated outstanding performance, however, demanding abundant high-quality training data, which are laborious and even impractical to acquire due to the high dynamics of living cells. Here, we develop zero-shot deconvolution networks (ZS-DeconvNet) that instantly enhance the resolution of microscope images by more than 1.5-fold over the diffraction limit with 10-fold lower fluorescence than ordinary super-resolution imaging conditions, in an unsupervised manner without the need for either ground truths or additional data acquisition. We demonstrate the versatile applicability of ZS-DeconvNet on multiple imaging modalities, including total internal reflection fluorescence microscopy, three-dimensional wide-field microscopy, confocal microscopy, two-photon microscopy, lattice light-sheet microscopy, and multimodal structured illumination microscopy, which enables multi-color, long-term, super-resolution 2D/3D imaging of subcellular bioprocesses from mitotic single cells to multicellular embryos of mouse and C. elegans.

Live-cell single-molecule fluorescence microscopy for protruding organelles reveals regulatory mechanisms of MYO7A-driven cargo transport in stereocilia of inner ear hair cells

Stereocilia are unidirectional F-actin-based cylindrical protrusions on the apical surface of inner ear hair cells and function as biological mechanosensors of sound and acceleration. Development of functional stereocilia requires motor activities of unconventional myosins to transport proteins necessary for elongating the F-actin cores and to assemble the mechanoelectrical transduction (MET) channel complex. However, how each myosin localizes in stereocilia using the energy from ATP hydrolysis is only partially understood. In this study, we develop a methodology for live-cell single-molecule fluorescence microscopy of organelles protruding from the apical surface using a dual-view light-sheet microscope, diSPIM. We demonstrate that MYO7A, a component of the MET machinery, traffics as a dimer in stereocilia. Movements of MYO7A are restricted when scaffolded by the plasma membrane and F-actin as mediated by MYO7A's interacting partners. Here, we discuss the technical details of our methodology and its future applications including analyses of cargo transportation in various organelles.

Pretraining a foundation model for generalizable fluorescence microscopy-based image restoration

Fluorescence microscopy-based image restoration has received widespread attention in the life sciences and has led to significant progress, benefiting from deep learning technology. However, most current task-specific methods have limited generalizability to different fluorescence microscopy-based image restoration problems. Here, we seek to improve generalizability and explore the potential of applying a pretrained foundation model to fluorescence microscopy-based image restoration. We provide a universal fluorescence microscopy-based image restoration (UniFMIR) model to address different restoration problems, and show that UniFMIR offers higher image restoration precision, better generalization and increased versatility. Demonstrations on five tasks and 14 datasets covering a wide range of microscopy imaging modalities and biological samples demonstrate that the pretrained UniFMIR can effectively transfer knowledge to a specific situation via fine-tuning, uncover clear nanoscale biomolecular structures and facilitate high-quality imaging. This work has the potential to inspire and trigger new research highlights for fluorescence microscopy-based image restoration.

Fast volumetric multifocus structured illumination microscopy of subcellular dynamics in living cells

Studying the nanoscale dynamics of subcellular structures is possible with 2D structured illumination microscopy (SIM). The method allows for acquisition with improved resolution over typical widefield. For 3D samples, the acquisition speed is inherently limited by the need to acquire sequential two-dimensional planes to create a volume. Here, we present a development of multifocus SIM designed to provide high volumetric frame rate by using fast synchronized electro-optical components. We demonstrate the high volumetric imaging capacity of the microscope by recording the dynamics of microtubule and endoplasmatic reticulum in living cells at up to 2.3 super resolution volumes per second for a total volume of 30 × 30 × 1.8 µm3.

Cell division machinery drives cell-specific gene activation during differentiation in Bacillus subtilis

When faced with starvation, the bacterium Bacillus subtilis transforms itself into a dormant cell type called a "spore". Sporulation initiates with an asymmetric division event, which requires the relocation of the core divisome components FtsA and FtsZ, after which the sigma factor σF is exclusively activated in the smaller daughter cell. Compartment-specific activation of σF requires the SpoIIE phosphatase, which displays a biased localization on one side of the asymmetric division septum and associates with the structural protein DivIVA, but the mechanism by which this preferential localization is achieved is unclear. Here, we isolated a variant of DivIVA that indiscriminately activates σF in both daughter cells due to promiscuous localization of SpoIIE, which was corrected by overproduction of FtsA and FtsZ. We propose that the core components of the redeployed cell division machinery drive the asymmetric localization of DivIVA and SpoIIE to trigger the initiation of the sporulation program.

Advanced Interferometry with 3-D Structured Illumination Reveals the Surface Fine Structure of Complex Biospecimens

Interference reflection microscopy (IRM) is a powerful, label-free technique to visualize the surface structure of biospecimens. However, stray light outside a focal plane obscures the surface fine structures beyond the diffraction limit (dxy ≈ 200 nm). Here, we developed an advanced interferometry approach to visualize the surface fine structure of complex biospecimens, ranging from protein assemblies to single cells. Compared to 2-D, our unique 3-D structure illumination introduced to IRM enabled successful visualization of fine structures and the dynamics of protein crystal growth under lateral (dx-y ≈ 110 nm) and axial (dx-z ≤ 5 nm) resolutions and dynamical adhesion of microtubule fiber networks with lateral resolution (dx-y ≈ 120 nm), 10 times greater than unstructured IRM (dx-y ≈ 1000 nm). Simultaneous reflection/fluorescence imaging provides new physical fingerprints for studying complex biospecimens and biological processes such as myogenic differentiation and highlights the potential use of advanced interferometry to study key nanostructures of complex biospecimens.

Harnessing artificial intelligence to reduce phototoxicity in live imaging

Fluorescence microscopy is essential for studying living cells, tissues and organisms. However, the fluorescent light that switches on fluorescent molecules also harms the samples, jeopardizing the validity of results - particularly in techniques such as super-resolution microscopy, which demands extended illumination. Artificial intelligence (AI)-enabled software capable of denoising, image restoration, temporal interpolation or cross-modal style transfer has great potential to rescue live imaging data and limit photodamage. Yet we believe the focus should be on maintaining light-induced damage at levels that preserve natural cell behaviour. In this Opinion piece, we argue that a shift in role for AIs is needed - AI should be used to extract rich insights from gentle imaging rather than recover compromised data from harsh illumination. Although AI can enhance imaging, our ultimate goal should be to uncover biological truths, not just retrieve data. It is essential to prioritize minimizing photodamage over merely pushing technical limits. Our approach is aimed towards gentle acquisition and observation of undisturbed living systems, aligning with the essence of live-cell fluorescence microscopy.

Phase diversity-based wavefront sensing for fluorescence microscopy

Fluorescence microscopy is an invaluable tool in biology, yet its performance is compromised when the wavefront of light is distorted due to optical imperfections or the refractile nature of the sample. Such optical aberrations can dramatically lower the information content of images by degrading image contrast, resolution, and signal. Adaptive optics (AO) methods can sense and subsequently cancel the aberrated wavefront, but are too complex, inefficient, slow, or expensive for routine adoption by most labs. Here we introduce a rapid, sensitive, and robust wavefront sensing scheme based on phase diversity, a method successfully deployed in astronomy but underused in microscopy. Our method enables accurate wavefront sensing to less than λ/35 root mean square (RMS) error with few measurements, and AO with no additional hardware besides a corrective element. After validating the method with simulations, we demonstrate calibration of a deformable mirror > 100-fold faster than comparable methods (corresponding to wavefront sensing on the ~100 ms scale), and sensing and subsequent correction of severe aberrations (RMS wavefront distortion exceeding λ/2), restoring diffraction-limited imaging on extended biological samples.

MAxSIM: multi-angle-crossing structured illumination microscopy with height-controlled mirror for 3D topological mapping of live cells

Mapping 3D plasma membrane topology in live cells can bring unprecedented insights into cell biology. Widefield-based super-resolution methods such as 3D-structured illumination microscopy (3D-SIM) can achieve twice the axial ( ~ 300 nm) and lateral ( ~ 100 nm) resolution of widefield microscopy in real time in live cells. However, twice-resolution enhancement cannot sufficiently visualize nanoscale fine structures of the plasma membrane. Axial interferometry methods including fluorescence light interference contrast microscopy and its derivatives (e.g., scanning angle interference microscopy) can determine nanoscale axial locations of proteins on and near the plasma membrane. Thus, by combining super-resolution lateral imaging of 2D-SIM with axial interferometry, we developed multi-angle-crossing structured illumination microscopy (MAxSIM) to generate multiple incident angles by fast, optoelectronic creation of diffraction patterns. Axial localization accuracy can be enhanced by placing cells on a bottom glass substrate, locating a custom height-controlled mirror (HCM) at a fixed axial position above the glass substrate, and optimizing the height reconstruction algorithm for noisy experimental data. The HCM also enables imaging of both the apical and basal surfaces of a cell. MAxSIM with HCM offers high-fidelity nanoscale 3D topological mapping of cell plasma membranes with near-real-time ( ~ 0.5 Hz) imaging of live cells and 3D single-molecule tracking.

Simultaneous Multicolor Multifocal Scanning Microscopy

Super-resolution fluorescence microscopy has revolutionized cell biology over the past decade, enabling the visualization of subcellular complexity with unparalleled clarity and detail. However, the rapid development of image-scanning-based super-resolution systems still restrains convenient access to commonly used instruments such as epi-fluorescence microscopes. Here, we present multifocal scanning microscopy (MSM) for super-resolution imaging with simultaneous multicolor acquisition and minimal instrumental complexity. MSM implements a stationary, interposed multifocal multicolor excitation by exploiting the motion of the specimens, realizing super-resolution microscopy through a general epi-fluorescence platform without compromising the image-scanning mechanism or inducing complex instrument alignment. The system is demonstrated with various phantom and biological specimens, and the results present effective resolution doubling, optical sectioning, and contrast enhancement. We anticipate MSM, as a highly accessible and compatible super-resolution technique, to offer a promising methodological pathway for broad cell biological discoveries.

Deep self-learning enables fast, high-fidelity isotropic resolution restoration for volumetric fluorescence microscopy

One intrinsic yet critical issue that troubles the field of fluorescence microscopy ever since its introduction is the unmatched resolution in the lateral and axial directions (i.e., resolution anisotropy), which severely deteriorates the quality, reconstruction, and analysis of 3D volume images. By leveraging the natural anisotropy, we present a deep self-learning method termed Self-Net that significantly improves the resolution of axial images by using the lateral images from the same raw dataset as rational targets. By incorporating unsupervised learning for realistic anisotropic degradation and supervised learning for high-fidelity isotropic recovery, our method can effectively suppress the hallucination with substantially enhanced image quality compared to previously reported methods. In the experiments, we show that Self-Net can reconstruct high-fidelity isotropic 3D images from organelle to tissue levels via raw images from various microscopy platforms, e.g., wide-field, laser-scanning, or super-resolution microscopy. For the first time, Self-Net enables isotropic whole-brain imaging at a voxel resolution of 0.2 × 0.2 × 0.2 μm3, which addresses the last-mile problem of data quality in single-neuron morphology visualization and reconstruction with minimal effort and cost. Overall, Self-Net is a promising approach to overcoming the inherent resolution anisotropy for all classes of 3D fluorescence microscopy.

Cell division machinery drives cell-specific gene activation during bacterial differentiation

When faced with starvation, the bacterium Bacillus subtilis transforms itself into a dormant cell type called a "spore". Sporulation initiates with an asymmetric division event, which requires the relocation of the core divisome components FtsA and FtsZ, after which the sigma factor σF is exclusively activated in the smaller daughter cell. Compartment specific activation of σF requires the SpoIIE phosphatase, which displays a biased localization on one side of the asymmetric division septum and associates with the structural protein DivIVA, but the mechanism by which this preferential localization is achieved is unclear. Here, we isolated a variant of DivIVA that indiscriminately activates σF in both daughter cells due to promiscuous localization of SpoIIE, which was corrected by overproduction of FtsA and FtsZ. We propose that a unique feature of the sporulation septum, defined by the cell division machinery, drives the asymmetric localization of DivIVA and SpoIIE to trigger the initiation of the sporulation program.

Open-3DSIM: an open-source three-dimensional structured illumination microscopy reconstruction platform

Open-3DSIM is an open-source reconstruction platform for three-dimensional structured illumination microscopy. We demonstrate its superior performance for artifact suppression and high-fidelity reconstruction relative to other algorithms on various specimens and over a range of signal-to-noise levels. Open-3DSIM also offers the capacity to extract dipole orientation, paving a new avenue for interpreting subcellular structures in six dimensions (xyzθλt). The platform is available as MATLAB code, a Fiji plugin and an Exe application to maximize user-friendliness.

Augmented Super-Resolution Radial Fluctuations (aSRRF) Pushing the Limits of Structured Illumination Microscopy

Structured illumination microscopy (SIM) is a versatile super-resolution technique known for its compatibility with a wide range of probes and fast implementation. While 3D SIM is capable of achieving a spatial resolution of ∼120 nm laterally and ∼300 nm axially, attempting to further enhance the resolution through methods such as nonlinear SIM or 4-beam SIM introduces complexities in optical configurations, increased phototoxicity, and reduced temporal resolution. Here, we have developed a novel method that combines SIM with augmented super-resolution radial fluctuations (aSRRF) utilizing a single image through image augmentation. By applying aSRRF reconstruction to SIM images, we can enhance the SIM resolution to ∼50 nm isotopically, without requiring any modifications to the optical system or sample acquisition process. Additionaly, we have incorporated the aSRRF approach into an ImageJ plugin and demonstrated its versatility across various fluorescence microscopy images, showcasing a remarkable two-fold resolution increase.

High-accuracy differential autofocus system with an electrically tunable lens

We propose a quasi-confocal microscopy autofocus system incorporating an electrically tunable lens (ETL) to achieve differential detection. The ETL changes its focal length to collect differential curves at speeds <300 Hz, allowing selective locking onto desired focal layers and high-speed differential operations close to the locked focal plane. By segmenting the system's pupil, the interference between the outgoing and incoming near-infrared beams is avoided, thereby greatly improving the signal-to-noise ratio. This ultra-sensitive system, with a focus drift accuracy better than 1/22 focal depth (∼20 nm @100× objective), provides a new, to the best of our knowledge, implementation pathway to meet the requirements of various microscopy techniques.