Subcellular three-dimensional imaging deep through multicellular thick samples by structured illumination microscopy and adaptive optics

Live-cell imaging powered by computation

The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preserving cell viability. Computational methods can help to address this challenge and are now shifting the boundaries of what is possible to capture in living systems. In this Review, we discuss these computational methods focusing on artificial intelligence-based approaches that can be layered on top of commonly used existing microscopies as well as hybrid methods that integrate computation and microscope hardware. We specifically discuss how computational approaches can improve the signal-to-noise ratio, spatial resolution, temporal resolution and multi-colour capacity of live-cell imaging.

Selective-plane-activation structured illumination microscopy

The background light from out-of-focus planes hinders resolution enhancement in structured illumination microscopy when observing volumetric samples. Here we used selective plane illumination and reversibly photoswitchable fluorescent proteins to realize structured illumination within the focal plane and eliminate the out-of-focus background. Theoretical investigation of the imaging properties and experimental demonstrations show that selective plane activation is beneficial for imaging dense microstructures in cells and cell spheroids.

Ultrabright Xanthene Fluorescence Probe for Mitochondrial Super-Resolution Imaging

Mitochondria are important organelles that provide energy for cellular physiological activities. Changes in their structures may indicate the occurrence of diseases, and the super-resolution imaging of mitochondria is of great significance. However, developing fluorescent probes for mitochondrial super-resolution visualization still remains challenging due to insufficient fluorescence brightness and poor stability. Herein, we rationally synthesized an ultrabright xanthene fluorescence probe Me-hNR for mitochondria-specific super-resolution imaging using structured illumination microscopy (SIM). The rigid structure of Me-hNR provided its ultrahigh fluorescence quantum yield of up to 0.92 and ultrahigh brightness of up to 16,000. Occupying the para-position of the O atom in the xanthene skeleton by utilizing the smallest methyl group ensured its excellent stability. The study of the photophysical process indicated that Me-hNR mainly emitted fluorescence via radiative decay, and nonradiative decay and inter-system crossing were rare due to the slow nonradiative decay rate and large energy gap (ΔEst = 0.55 eV). Owing to these excellent merits, Me-hNR can specifically light up mitochondria at ultralow concentrations down to 5 nM. The unprecedented spatial resolution for mitochondria with an fwhm of 174 nm was also achieved. Therefore, this ultrabright xanthene fluorescence probe has great potential in visualizing the structural changes of mitochondria and revealing the pathogenesis of related diseases using SIM.

Adaptive Optics in an Oblique Plane Microscope

Adaptive optics (AO) can restore diffraction limited performance when imaging beyond superficial cell layers in vivo and in vitro, and as such is of interest for advanced 3D microscopy methods such as light-sheet fluorescence microscopy (LSFM). In a typical LSFM system, the illumination and detection paths are separate and subject to different optical aberrations. To achieve optimal microscope performance, it is necessary to sense and correct these aberrations in both light paths, resulting in a complex microscope system. Here, we show that in an oblique plane microscope (OPM), a type of LSFM with a single primary objective lens, the same deformable mirror can correct both the illumination and fluorescence detection. Besides reducing the complexity, we show that AO in OPM also restores the relative alignment of the light-sheet and focal plane, and that a projection imaging mode can stabilize and improve the wavefront correction in a sensorless AO format. We demonstrate OPM with AO on fluorescent nanospheres and by imaging the vasculature and cancer cells in zebrafish embryos embedded in a glass capillary, restoring diffraction limited resolution and improving the signal strength twofold.

Tandem aberration correction optics (TACO) in wide-field structured illumination microscopy

Structured illumination microscopy (SIM) is a powerful super-resolution imaging technique that uses patterned illumination to down-modulate high spatial-frequency information of samples. However, the presence of spatially-dependent aberrations can severely disrupt the illumination pattern, limiting the quality of SIM imaging. Conventional adaptive optics (AO) techniques that employ wavefront correctors at the pupil plane are not capable of effectively correcting these spatially-dependent aberrations. We introduce the Tandem Aberration Correction Optics (TACO) approach that combines both pupil AO and conjugate AO for aberration correction in SIM. TACO incorporates a deformable mirror (DM) for pupil AO in the detection path to correct for global aberrations, while a spatial light modulator (SLM) is placed at the plane conjugate to the aberration source near the sample plane, termed conjugate AO, to compensate spatially-varying aberrations in the illumination path. Our numerical simulations and experimental results show that the TACO approach can recover the illumination pattern close to an ideal condition, even when severely misshaped by aberrations, resulting in high-quality super-resolution SIM reconstruction. The TACO approach resolves a critical traditional shortcoming of aberration correction for structured illumination. This advance significantly expands the application of SIM imaging in the study of complex, particularly biological, samples and should be effective in other wide-field microscopies.

MAxSIM: multi-angle-crossing structured illumination microscopy with height-controlled mirror for 3D topological mapping of live cells

Mapping 3D plasma membrane topology in live cells can bring unprecedented insights into cell biology. Widefield-based super-resolution methods such as 3D-structured illumination microscopy (3D-SIM) can achieve twice the axial ( ~ 300 nm) and lateral ( ~ 100 nm) resolution of widefield microscopy in real time in live cells. However, twice-resolution enhancement cannot sufficiently visualize nanoscale fine structures of the plasma membrane. Axial interferometry methods including fluorescence light interference contrast microscopy and its derivatives (e.g., scanning angle interference microscopy) can determine nanoscale axial locations of proteins on and near the plasma membrane. Thus, by combining super-resolution lateral imaging of 2D-SIM with axial interferometry, we developed multi-angle-crossing structured illumination microscopy (MAxSIM) to generate multiple incident angles by fast, optoelectronic creation of diffraction patterns. Axial localization accuracy can be enhanced by placing cells on a bottom glass substrate, locating a custom height-controlled mirror (HCM) at a fixed axial position above the glass substrate, and optimizing the height reconstruction algorithm for noisy experimental data. The HCM also enables imaging of both the apical and basal surfaces of a cell. MAxSIM with HCM offers high-fidelity nanoscale 3D topological mapping of cell plasma membranes with near-real-time ( ~ 0.5 Hz) imaging of live cells and 3D single-molecule tracking.

Open-3DSIM: an open-source three-dimensional structured illumination microscopy reconstruction platform

Open-3DSIM is an open-source reconstruction platform for three-dimensional structured illumination microscopy. We demonstrate its superior performance for artifact suppression and high-fidelity reconstruction relative to other algorithms on various specimens and over a range of signal-to-noise levels. Open-3DSIM also offers the capacity to extract dipole orientation, paving a new avenue for interpreting subcellular structures in six dimensions (xyzθλt). The platform is available as MATLAB code, a Fiji plugin and an Exe application to maximize user-friendliness.

Superresolution structured illumination microscopy reconstruction algorithms: a review

Structured illumination microscopy (SIM) has become the standard for next-generation wide-field microscopy, offering ultrahigh imaging speed, superresolution, a large field-of-view, and long-term imaging. Over the past decade, SIM hardware and software have flourished, leading to successful applications in various biological questions. However, unlocking the full potential of SIM system hardware requires the development of advanced reconstruction algorithms. Here, we introduce the basic theory of two SIM algorithms, namely, optical sectioning SIM (OS-SIM) and superresolution SIM (SR-SIM), and summarize their implementation modalities. We then provide a brief overview of existing OS-SIM processing algorithms and review the development of SR-SIM reconstruction algorithms, focusing primarily on 2D-SIM, 3D-SIM, and blind-SIM. To showcase the state-of-the-art development of SIM systems and assist users in selecting a commercial SIM system for a specific application, we compare the features of representative off-the-shelf SIM systems. Finally, we provide perspectives on the potential future developments of SIM.

Rapid, artifact-reduced, image reconstruction for super-resolution structured illumination microscopy

Super-resolution structured illumination microscopy (SR-SIM) is finding increasing application in biomedical research due to its superior ability to visualize subcellular dynamics in living cells. However, during image reconstruction artifacts can be introduced and when coupled with time-consuming postprocessing procedures, limits this technique from becoming a routine imaging tool for biologists. To address these issues, an accelerated, artifact-reduced reconstruction algorithm termed joint space frequency reconstruction-based artifact reduction algorithm (JSFR-AR-SIM) was developed by integrating a high-speed reconstruction framework with a high-fidelity optimization approach designed to suppress the sidelobe artifact. Consequently, JSFR-AR-SIM produces high-quality, super-resolution images with minimal artifacts, and the reconstruction speed is increased. We anticipate this algorithm to facilitate SR-SIM becoming a routine tool in biomedical laboratories.

Adaptive aberration correction using an electrowetting array

We demonstrate a method that permits wavefront aberration correction using an array of electrowetting prisms. A fixed high fill factor microlens array followed by a lower fill factor adaptive electrowetting prism array is used to correct wavefront aberration. The design and simulation of such aberration correction mechanism is described. Our results show significant improvement to the Strehl ratio by using our aberration correction scheme which results in diffraction limited performance. Compactness and effectiveness of our design can be implemented in many applications that require aberration correction, such as microscopy and consumer electronics.

Compact structured illumination microscopy with high spatial frequency diffractive lattice patterns

Structured illumination microscopy (SIM) enables live-cell super-resolution imaging with wide field of view (FOV) and high imaging speed, but the illumination system is usually bulky. With the advantages of small structure and high efficiency, lattice patterns assisted by diffractive optical elements (DOEs) have been used for structured illumination in SIM. But it is still challenging to raise the spatial frequency of diffractive lattice patterns when using traditional DOE design method, and thus the super-resolution imaging performance is restricted. In this paper, we propose a novel design method for DOE to generate lattice patterns with spatial frequency close to the cut-off frequency. It is the first time to obtain a lattice pattern with such high spatial frequency by diffractive optics. Finally, the proposed SIM achieves a lateral resolution of 131 nm at 519 nm fluorescent light while maintaining an original size as a standard inverted fluorescence microscope by only inserting a single well-designed DOE in the illumination optical path, which may promote this compact SIM applied in super-resolution imaging field.

Recent advances in optical imaging through deep tissue: imaging probes and techniques

Optical imaging has been essential for scientific observations to date, however its biomedical applications has been restricted due to its poor penetration through tissues. In living tissue, signal attenuation and limited imaging depth caused by the wave distortion occur because of scattering and absorption of light by various molecules including hemoglobin, pigments, and water. To overcome this, methodologies have been proposed in the various fields, which can be mainly categorized into two stategies: developing new imaging probes and optical techniques. For example, imaging probes with long wavelength like NIR-II region are advantageous in tissue penetration. Bioluminescence and chemiluminescence can generate light without excitation, minimizing background signals. Afterglow imaging also has high a signal-to-background ratio because excitation light is off during imaging. Methodologies of adaptive optics (AO) and studies of complex media have been established and have produced various techniques such as direct wavefront sensing to rapidly measure and correct the wave distortion and indirect wavefront sensing involving modal and zonal methods to correct complex aberrations. Matrix-based approaches have been used to correct the high-order optical modes by numerical post-processing without any hardware feedback. These newly developed imaging probes and optical techniques enable successful optical imaging through deep tissue. In this review, we discuss recent advances for multi-scale optical imaging within deep tissue, which can provide reseachers multi-disciplinary understanding and broad perspectives in diverse fields including biophotonics for the purpose of translational medicine and convergence science.

Microscopic Visualization of Cell-Cell Adhesion Complexes at Micro and Nanoscale

Considerable progress has been made in our knowledge of the morphological and functional varieties of anchoring junctions. Cell-cell adhesion contacts consist of discrete junctional structures responsible for the mechanical coupling of cytoskeletons and allow the transmission of mechanical signals across the cell collective. The three main adhesion complexes are adherens junctions, tight junctions, and desmosomes. Microscopy has played a fundamental role in understanding these adhesion complexes on different levels in both physiological and pathological conditions. In this review, we discuss the main light and electron microscopy techniques used to unravel the structure and composition of the three cell-cell contacts in epithelial and endothelial cells. It functions as a guide to pick the appropriate imaging technique(s) for the adhesion complexes of interest. We also point out the latest techniques that have emerged. At the end, we discuss the problems investigators encounter during their cell-cell adhesion research using microscopic techniques.

Simultaneous 3D deconvolution and halo removal for spatial light interference microscopy through a two-edge apodized Wiener filter

As one of the most sensitive quantitative phase microscopy techniques, spatial light interference microscopy (SLIM) has undergone rapid development in the past decade and has seen wide application in both basic science and clinical studies. However, as with any other traditional microscope, the axial resolution is the worst among the three dimensions. This leads to lower contrast in the thicker regions of cell samples. Another common foe in the phase contrast image is the halo artifact, which can block underlying structures, in particular when high resolution is desired. Current solutions focus on either halo removal or contrast enhancement alone, and thus need two processing steps to create both high contrast and halo-free phase images. Further, raw images often suffer from artifacts that are both bright and slowly varying, dubbed here as cloud-like artifacts. After deconvolution, these cloud-like artifacts often dominate the image and obscure high-frequency information, which is typically of greatest interest. In this paper, we first analyzed the unique characteristics of the phase transfer function associated with SLIM to find the root of the cloud-like artifacts and halo artifacts. Then we designed a two-edge apodized deconvolution scheme as a counter measure. We show that even with a simple Wiener filter, the two-edge apodization (TEA) can effectively improve the contrast while suppressing the halo and cloud-like artifacts. Our algorithm, named TEA-Weiner, is non-iterative and thus can be implemented in real time. For low-contrast structures inside the cell such as the endoplasmic reticulum (ER), where ringing artifacts are more likely, we show that two-edge apodization can be combined with additional constraints such as total variation so that their contrast can be enhanced simultaneously with other bright structures inside the cell. Comparing our method with other state-of-the-art algorithms, our method has two advantages: First, deconvolution and halo removal are accomplished simultaneously; second, the image quality is highest using TEA-Weiner filtering.

Technological advances in super-resolution microscopy to study cellular processes

Since its initial demonstration in 2000, far-field super-resolution light microscopy has undergone tremendous technological developments. In parallel, these developments have opened a new window into visualizing the inner life of cells at unprecedented levels of detail. Here, we review the technical details behind the most common implementations of super-resolution microscopy and highlight some of the recent, promising advances in this field.

A Transient Mystery: Nucleolar Channel Systems

The nucleus is a complex organelle with functions beyond being a simple repository for genomic material. For example, its actions in biomechanical sensing, protein synthesis, and epigenomic regulation showcase how the nucleus integrates multiple signaling modalities to intricately regulate gene expression. This innate dynamism is underscored by subnuclear components that facilitate these roles, with elements of the nucleoskeleton, phase-separated nuclear bodies, and chromatin safeguarding by nuclear envelope proteins providing examples of this functional diversity. Among these, one of the lesser characterized nuclear organelles is the nucleolar channel system (NCS), first reported several decades ago in human endometrial biopsies. This tubular structure, believed to be derived from the inner nuclear membrane of the nuclear envelope, was first observed in secretory endometrial cells during a specific phase of the menstrual cycle. Reported as a consistent, yet transient, nuclear organelle, current interpretations of existing data suggest that it serves as a marker of a window for optimal implantation. In spite of this available data, the NCS remains incompletely characterized structurally and functionally, due in part to its transient spatial and temporal expression. As a further complication, evidence exists showing NCS expression in fetal tissue, suggesting that it may not act exclusively as a marker of uterine receptivity, but rather as a hormone sensor sensitive to estrogen and progesterone ratios. To gain a better understanding of the NCS, current technologies can be applied to profile rare cell populations or capture transient structural dynamics, for example, at a level of sensitivity and resolution not previously possible. Moving forward, advanced characterization of the NCS will shed light on an uncharacterized aspect of reproductive physiology, with the potential to refine assisted reproductive techniques.

Fluorescence Microscopy-An Outline of Hardware, Biological Handling, and Fluorophore Considerations

Fluorescence microscopy has become a critical tool for researchers to understand biological processes at the cellular level. Micrographs from fixed and live-cell imaging procedures feature in a plethora of scientific articles for the field of cell biology, but the complexities of fluorescence microscopy as an imaging tool can sometimes be overlooked or misunderstood. This review seeks to cover the three fundamental considerations when designing fluorescence microscopy experiments: (1) hardware availability; (2) amenability of biological models to fluorescence microscopy; and (3) suitability of imaging agents for intended applications. This review will help equip the reader to make judicious decisions when designing fluorescence microscopy experiments that deliver high-resolution and informative images for cell biology.

Adaptive optics in super-resolution microscopy

Fluorescence microscopy has become a routine tool in biology for interrogating life activities with minimal perturbation. While the resolution of fluorescence microscopy is in theory governed only by the diffraction of light, the resolution obtainable in practice is also constrained by the presence of optical aberrations. The past two decades have witnessed the advent of super-resolution microscopy that overcomes the diffraction barrier, enabling numerous biological investigations at the nanoscale. Adaptive optics, a technique borrowed from astronomical imaging, has been applied to correct for optical aberrations in essentially every microscopy modality, especially in super-resolution microscopy in the last decade, to restore optimal image quality and resolution. In this review, we briefly introduce the fundamental concepts of adaptive optics and the operating principles of the major super-resolution imaging techniques. We highlight some recent implementations and advances in adaptive optics for active and dynamic aberration correction in super-resolution microscopy.

Adaptive optics for high-resolution imaging

Adaptive optics (AO) is a technique that corrects for optical aberrations. It was originally proposed to correct for the blurring effect of atmospheric turbulence on images in ground-based telescopes and was instrumental in the work that resulted in the Nobel prize-winning discovery of a supermassive compact object at the centre of our galaxy. When AO is used to correct for the eye's imperfect optics, retinal changes at the cellular level can be detected, allowing us to study the operation of the visual system and to assess ocular health in the microscopic domain. By correcting for sample-induced blur in microscopy, AO has pushed the boundaries of imaging in thick tissue specimens, such as when observing neuronal processes in the brain. In this primer, we focus on the application of AO for high-resolution imaging in astronomy, vision science and microscopy. We begin with an overview of the general principles of AO and its main components, which include methods to measure the aberrations, devices for aberration correction, and how these components are linked in operation. We present results and applications from each field along with reproducibility considerations and limitations. Finally, we discuss future directions.