Resolution doubling in fluorescence microscopy with confocal spinning-disk image scanning microscopy

Structured illumination approaches for super-resolution in plant cells

The advent of super-resolution techniques in biological microscopy has opened new frontiers for exploring the molecular distribution of proteins and small molecules in cells. Improvements in optical design and innovations in the approaches for the collection of fluorescence emission have produced substantial gains in signal from chemical labels and fluorescent proteins. Structuring the illumination to elicit fluorescence from specific or even random patterns allows the extraction of higher order spatial frequencies from specimens labeled with conventional probes. Application of this approach to plant systems for super-resolution imaging has been relatively slow owing in large part to aberrations incurred when imaging through the plant cell wall. In this brief review, we address the use of two prominent methods for generating super-resolution images in living plant specimens and discuss future directions for gaining better access to these techniques.

A robust and versatile platform for image scanning microscopy enabling super-resolution FLIM

Image scanning microscopy (ISM) can improve the effective spatial resolution of confocal microscopy to its theoretical limit. However, current implementations are not robust or versatile, and are incompatible with fluorescence lifetime imaging (FLIM). We describe an implementation of ISM based on a single-photon detector array that enables super-resolution FLIM and improves multicolor, live-cell and in-depth imaging, thereby paving the way for a massive transition from confocal microscopy to ISM.

Super-resolution microscopy demystified

Super-resolution microscopy (SRM) bypasses the diffraction limit, a physical barrier that restricts the optical resolution to roughly 250 nm and was previously thought to be impenetrable. SRM techniques allow the visualization of subcellular organization with unprecedented detail, but also confront biologists with the challenge of selecting the best-suited approach for their particular research question. Here, we provide guidance on how to use SRM techniques advantageously for investigating cellular structures and dynamics to promote new discoveries.

Faster, sharper, and deeper: structured illumination microscopy for biological imaging

Structured illumination microscopy (SIM) allows rapid, super-resolution (SR) imaging in live specimens. We review recent technical advances in SR-SIM, with emphasis on imaging speed, resolution, and depth. Since its introduction decades ago, the technique has grown to offer myriad implementations, each with its own strengths and weaknesses. We discuss these, aiming to provide a practical guide for biologists and to highlight which approach is best suited to a given application.

Versatile multi-detector scheme for adaptive optics scanning laser ophthalmoscopy

Adaptive optics scanning laser ophthalmoscopy (AOSLO) is a powerful tool for imaging the retina at high spatial and temporal resolution. In this paper, we present a multi-detector scheme for AOSLO which has two main configurations: pixel reassignment and offset aperture imaging. In this detection scheme, the single element detector of the standard AOSLO is replaced by a fiber bundle which couples the detected light into multiple detectors. The pixel reassignment configuration enables high resolution imaging with an increased light collection. The increase in signal-to-noise ratio (SNR) from this configuration can improve the accuracy of motion registration techniques. The offset aperture imaging configuration enhances the detection of multiply scattered light, which improves the contrast of retinal vasculature and inner retinal layers similar to methods such as nonconfocal split-detector imaging and multi-offset aperture imaging.

Resolution enhancement in laser scanning microscopy with deconvolution switching laser modes (D-SLAM)

Laser scanning microscopy is limited in lateral resolution by the diffraction of light. Superresolution methods have been developed since the 90s to overcome this limitation. However superresolution is generally achieved at the expense of a greater complexity (high power lasers, very long acquisition times, specific fluorophores) and limitations on the observable samples. In this paper we propose a method to improve the resolution of confocal microscopy by combining different laser modes and deconvolution. Two images of the same field are acquired with the confocal microscope using different laser modes and used as inputs to a deconvolution algorithm. The two laser modes have different Point Spread Functions and thus provide complementary information leading to an image with enhanced resolution compared to using a single confocal image as input to the same deconvolution algorithm. By changing the laser modes to Bessel-Gauss beams we were able to further improve the efficiency of the deconvolution algorithm and obtain images with a residual Point Spread Function having a width of 0.14 λ (72 nm at a wavelength of 532 nm). This method only requires a laser scanning microscope and is not dependent on certain specific properties of fluorescent proteins. The proposed method requires only a few add-ons to classical confocal or two-photon microscopes and can easily be retrofitted into an existing commercial laser scanning microscope.

A frequency domain SIM reconstruction algorithm using reduced number of images

Conventional two-dimensional structured illumination microscopy (SIM) requires 9 raw images to reconstruct a super-resolved image. In order to increase the frame rate of 2DSIM, attempts are being made to reduce the number of raw SIM images. However, all the proposed SIM reconstruction algorithms (SIM-RA) capable of reconstructing super-resolution (SR) image with a reduced number of raw SIM images operate in the spatial domain. Here, we present a frequency domain SIM-RA based on ordinary least squares technique, which enables reconstruction of SR image using 4 raw SIM images. Unlike the spatial domain RA, which produces the SR image through iterative convergence, the presented RA provides a single step solution. It also reveals the fundamental limitation of least number of raw images required for resolution doubling in SIM.

Nonlinear Focal Modulation Microscopy

We demonstrate nonlinear focal modulation microscopy (NFOMM) to achieve superresolution imaging. Traditional approaches to superresolution that utilize point scanning often rely on spatially reducing the size of the emission pattern by directly narrowing (e.g., through minimizing the detection pinhole in Airyscan, Zeiss) or indirectly peeling its outer profiles [e.g., through depleting the outer emission region in stimulated emission depletion (STED) microscopy]. We show that an alternative conceptualization that focuses on maximizing the optical system's frequency shifting ability offers advantages in further improving resolution while reducing system complexity. In NFOMM, a spatial light modulator and a suitably intense laser illumination are used to implement nonlinear focal-field modulation to achieve a transverse spatial resolution of ∼60  nm (∼λ/10). We show that NFOMM is comparable with STED microscopy and suitable for fundamental biology studies, as evidenced in imaging nuclear pore complexes, tubulin and vimentin in Vero cells. Since NFOMM is readily implemented as an add-on module to a laser-scanning microscope, we anticipate wide utility of this new imaging technique.

Concepts in Light Microscopy of Viruses

Viruses threaten humans, livestock, and plants, and are difficult to combat. Imaging of viruses by light microscopy is key to uncover the nature of known and emerging viruses in the quest for finding new ways to treat viral disease and deepening the understanding of virus–host interactions. Here, we provide an overview of recent technology for imaging cells and viruses by light microscopy, in particular fluorescence microscopy in static and live-cell modes. The review lays out guidelines for how novel fluorescent chemical probes and proteins can be used in light microscopy to illuminate cells, and how they can be used to study virus infections. We discuss advantages and opportunities of confocal and multi-photon microscopy, selective plane illumination microscopy, and super-resolution microscopy. We emphasize the prevalent concepts in image processing and data analyses, and provide an outlook into label-free digital holographic microscopy for virus research.

Fast, long-term, super-resolution imaging with Hessian structured illumination microscopy

To increase the temporal resolution and maximal imaging time of super-resolution (SR) microscopy, we have developed a deconvolution algorithm for structured illumination microscopy based on Hessian matrixes (Hessian-SIM). It uses the continuity of biological structures in multiple dimensions as a priori knowledge to guide image reconstruction and attains artifact-minimized SR images with less than 10% of the photon dose used by conventional SIM while substantially outperforming current algorithms at low signal intensities. Hessian-SIM enables rapid imaging of moving vesicles or loops in the endoplasmic reticulum without motion artifacts and with a spatiotemporal resolution of 88 nm and 188 Hz. Its high sensitivity allows the use of sub-millisecond excitation pulses followed by dark recovery times to reduce photobleaching of fluorescent proteins, enabling hour-long time-lapse SR imaging of actin filaments in live cells. Finally, we observed the structural dynamics of mitochondrial cristae and structures that, to our knowledge, have not been observed previously, such as enlarged fusion pores during vesicle exocytosis.

Enhancing multi-spot structured illumination microscopy with fluorescence difference

Structured illumination microscopy is a super-resolution technique used extensively in biological research. However, this technique is limited in the maximum possible resolution increase. Here we report the results of simulations of a novel enhanced multi-spot structured illumination technique. This method combines the super-resolution technique of difference microscopy with structured illumination deconvolution. Initial results give at minimum a 1.4-fold increase in resolution over conventional structured illumination in a low-noise environment. This new technique also has the potential to be expanded to further enhance axial resolution with three-dimensional difference microscopy. The requirement for precise pattern determination in this technique also led to the development of a new pattern estimation algorithm which proved more efficient and reliable than other methods tested.

Image formation in image scanning microscopy, including the case of two-photon excitation

The effect of combining the image scanning microscopy (ISM) technique with two-photon fluorescence microscopy is analyzed. The effective spatial frequency cutoff can be doubled, as compared with conventional two-photon fluorescence microscopy, and the magnitude of the optical transfer function near the cutoff of conventional two-photon microscopy is increased by orders of magnitude. For the two-photon case, it is found that the optimum pixel reassignment factor in ISM is not equal to one half, as is often assumed in single-photon fluoresence image scanning microscopy, because the excitation and detection point spread functions are different. The optimum reassignment factor depends on the noise level, and in general the useful cutoff spatial frequency is about 1.8 times that for conventional two-photon microscopy. The effect of altering the reassignment factor in single-photon fluorescence ISM with a Stokes shift is also investigated. Illumination using pupil filters, such as by a Bessel beam, is considered. Using a ring detector array is found to result in good imaging behavior, exhibiting a sharpening of the point spread function by a factor of 1.7 compared with conventional fluorescence. Image formation in ISM can be considered in a four-dimensional spatial frequency space, giving new insight into the imaging properties. This approach is related to phase space representations such as the Wigner distribution function and the ambiguity function. A noniterative algorithm for image restoration is proposed.

Adaptive optics improves multiphoton super-resolution imaging

We improve multiphoton structured illumination microscopy using a nonlinear guide star to determine optical aberrations and a deformable mirror to correct them. We demonstrate our method on bead phantoms, cells in collagen gels, nematode larvae and embryos, Drosophila brain, and zebrafish embryos. Peak intensity is increased (up to 40-fold) and resolution recovered (up to 176 ± 10 nm laterally, 729 ± 39 nm axially) at depths ∼250 μm from the coverslip surface.

Active computational imaging for circumventing resolution limits at macroscopic scales

Macroscopic imagers are subject to constraints imposed by the wave nature of light and the geometry of image formation. The former limits the resolving power while the latter results in a loss of absolute size and shape information. The suite of methods outlined in this work enables macroscopic imagers the unique ability to capture unresolved spatial detail while recovering topographic information. The common thread connecting these methods is the notion of imaging under patterned illumination. The notion is advanced further to develop computational imagers with resolving power that is decoupled from the constraints imposed by the collection optics and the image sensor. These imagers additionally feature support for multiscale reconstruction.

Configurations of the Re-scan Confocal Microscope (RCM) for biomedical applications

The new high-sensitive and high-resolution technique, Re-scan Confocal Microscopy (RCM), is based on a standard confocal microscope extended with a re-scan detection unit. The re-scan unit includes a pair of re-scanning mirrors that project the emission light onto a camera in a scanning manner. The signal-to-noise ratio of Re-scan Confocal Microscopy is improved by a factor of 4 compared to standard confocal microscopy and the lateral resolution of Re-scan Confocal Microscopy is 170 nm (compared to 240 nm for diffraction limited resolution, 488 nm excitation, 1.49 NA). Apart from improved sensitivity and resolution, the optical setup of Re-scan Confocal Microscopy is flexible in its configuration in terms of control of the mirrors, lasers and filters. Because of this flexibility, the Re-scan Confocal Microscopy can be configured to address specific biological applications. In this paper, we explore a number of possible configurations of Re-scan Confocal Microscopy for specific biomedical applications such as multicolour, FRET, ratio-metric (e.g. pH and intracellular Ca²⁺ measurements) and FRAP imaging.

Image scanning microscopy: an overview

For almost a century, the resolution of optical microscopy was thought to be limited by Abbé's law describing the diffraction limit of light. At the turn of the millennium, aided by new technologies and fluorophores, the field of optical microscopy finally surpassed the diffraction barrier: a milestone achievement that has been recognized by the 2014 Nobel Prize in Chemistry. Many super-resolution methods rely on the unique photophysical properties of the fluorophores to improve resolution, posing significant limitations on biological imaging, such as multicoloured staining, live-cell imaging and imaging thick specimens. Structured Illumination Microscopy (SIM) is one branch of super-resolution microscopy that requires no such special properties of the applied fluorophores, making it more versatile than other techniques. Since its introduction in biological imaging, SIM has proven to be a popular tool in the biologist's arsenal for following biological interaction and probing structures of nanometre scale. SIM continues to see much advancement in design and implementation, including the development of Image Scanning Microscopy (ISM), which uses patterned excitation via either predefined arrays or raster-scanned single point-spread functions (PSF). This review aims to give a brief overview of the SIM and ISM processes and subsequent developments in the image reconstruction process. Drawing from this, and incorporating more recent achievements in light shaping (i.e. pattern scanning and super-resolution beam shaping), this study also intends to suggest potential future directions for this ever-expanding field.

Re-scan confocal microscopy (RCM) improves the resolution of confocal microscopy and increases the sensitivity

Re-scan confocal microscopy (RCM) is a new super-resolution technique based on a standard confocal microscope extended with a re-scan unit in the detection path that projects the emitted light onto a sensitive camera. In this paper the fundamental properties of RCM, lateral resolution, axial resolution and signal-to-noise ratio, are characterized and compared with properties of standard confocal microscopy. The results show that the lateral resolution of RCM is ~170 nm compared to ~240 nm of confocal microscopy for 488 nm excitation and 1.49 NA. As the theory predicts, this improved lateral resolution is independent of the pinhole diameter. In standard confocal microscopy, the same lateral resolution can only be achieved with an almost closed pinhole and, consequently, with a major loss of signal. We show that the sectioning capabilities of the standard confocal microscope are preserved in RCM and that the axial resolution of RCM is slightly better (~15%) than the standard confocal microscope. Furthermore, the signal-to-noise ratio in RCM is a factor of 2 higher than in standard confocal microscopy, also due to the use of highly sensitive modern cameras. In case the pinhole of a confocal microscope is adjusted in such way that the lateral resolution is comparable to that of RCM, the signal-to-noise ratio in RCM is 4 times higher than standard confocal microscopy. Therefore, RCM offers a good alternative to standard confocal microscopy for higher lateral resolution with the main advantage of strongly improved sensitivity.

Cytokinesis: Going Super-Resolution in Live Cells

Super-resolution fluorescence microscopy has emerged as a powerful tool for studying molecular organization, but mostly in fixed cells. New work using high-speed fluorescence photoactivation localization microscopy now reveals the organization of cytokinesis nodes and contractile rings in live fission yeast cells.

High-resolution confocal Raman microscopy using pixel reassignment

We present a practical modification of fiber-coupled confocal Raman scanning microscopes that is able to provide high confocal resolution in conjunction with high light collection efficiency. For this purpose, the single detection fiber is replaced by a hexagonal lenslet array in combination with a hexagonally packed round-to-linear multimode fiber bundle. A multiline detector is used to collect individual Raman spectra for each fiber. Data post-processing based on pixel reassignment allows one to improve the lateral resolution by up to 41% compared to a single fiber of equal light collection efficiency. We present results from an experimental implementation featuring seven collection fibers, yielding a resolution improvement of about 30%. We believe that our implementation represents an attractive upgrade for existing confocal Raman microscopes that employ multi-line detectors.

Fast, label-free super-resolution live-cell imaging using rotating coherent scattering (ROCS) microscopy

Living cells are highly dynamic systems with cellular structures being often below the optical resolution limit. Super-resolution microscopes, usually based on fluorescence cell labelling, are usually too slow to resolve small, dynamic structures. We present a label-free microscopy technique, which can generate thousands of super-resolved, high contrast images at a frame rate of 100 Hertz and without any post-processing. The technique is based on oblique sample illumination with coherent light, an approach believed to be not applicable in life sciences because of too many interference artefacts. However, by circulating an incident laser beam by 360° during one image acquisition, relevant image information is amplified. By combining total internal reflection illumination with dark-field detection, structures as small as 150 nm become separable through local destructive interferences. The technique images local changes in refractive index through scattered laser light and is applied to living mouse macrophages and helical bacteria revealing unexpected dynamic processes.

Image scanning microscopy with a quadrant detector

Confocal scanning microscopy (CSM) is the most widely used modern optical microscopy technique. Theoretically, it allows the diffraction barrier to be surpassed by a factor of 2, but practically this improvement is sacrificed to obtain a good signal-to-noise ratio (SNR). Image scanning microscopy (ISM) solves this limitation but, in the current implementations, the system complexity is increased and the versatility of CSM is reduced. Here we show that ISM can be straightforwardly implemented by substituting the single point detector of a confocal microscope with a quadrant detector of the same size, thus using a small number of detector elements. This implementation offers resolution close to the CSM theoretical value and improves the SNR by a factor of 1.5 with respect to the CSM counterpart without losing the optical sectioning capability and the system versatility.

Super-resolution spinning-disk confocal microscopy using optical photon reassignment

Spinning-disk confocal microscopy is a proven technology for investigating 3D structures of biological specimens. Here we report a super-resolution method based on spinning-disk confocal microscopy that optically improves lateral resolution by a factor of 1.37 with a single exposure. Moreover, deconvolution yields twofold improvement over the diffraction limit. With the help of newly modified Nipkow disk which comprises pinholes and micro-lenses on the front and back respectively, emitted photons from specimen can be optically reassigned to the most probable locations they originate from. Consequently, the improvement in resolution is achieved preserving inherent sectioning capabilities of confocal microscopy. This extremely simple implementation will enable reliable observations at super high resolution in biomedical routine research.

Post-processing strategies in image scanning microscopy

Image scanning microscopy (ISM) coupled with pixel reassignment offers a resolution improvement of √2 over standard widefield imaging. By scanning point-wise across the specimen and capturing an image of the fluorescent signal generated at each scan position, additional information about specimen structure is recorded and the highest accessible spatial frequency is doubled. Pixel reassignment can be achieved optically in real time or computationally a posteriori and is frequently combined with the use of a physical or digital pinhole to reject out of focus light. Here, we simulate an ISM dataset using a test image and apply standard and non-standard processing methods to address problems typically encountered in computational pixel reassignment and pinholing. We demonstrate that the predicted improvement in resolution is achieved by applying standard pixel reassignment to a simulated dataset and explore the effect of realistic displacements between the reference and true excitation positions. By identifying the position of the detected fluorescence maximum using localisation software and centring the digital pinhole on this co-ordinate before scaling around translated excitation positions, we can recover signal that would otherwise be degraded by the use of a pinhole aligned to an inaccurate excitation reference. This strategy is demonstrated using experimental data from a multiphoton ISM instrument. Finally we investigate the effect that imaging through tissue has on the positions of excitation foci at depth and observe a global scaling with respect to the applied reference grid. Using simulated and experimental data we explore the impact of a globally scaled reference on the ISM image and, by pinholing around the detected maxima, recover the signal across the whole field of view.

A joint Richardson-Lucy deconvolution algorithm for the reconstruction of multifocal structured illumination microscopy data

We demonstrate the reconstruction of images obtained by multifocal structured illumination microscopy, MSIM, using a joint Richardson-Lucy, jRL-MSIM, deconvolution algorithm, which is based on an underlying widefield image-formation model. The method is efficient in the suppression of out-of-focus light and greatly improves image contrast and resolution. Furthermore, it is particularly well suited for the processing of noise corrupted data. The principle is verified on simulated as well as experimental data and a comparison of the jRL-MSIM approach with the standard reconstruction procedure, which is based on image scanning microscopy, ISM, is made. Our algorithm is efficient and freely available in a user friendly software package.

Super-resolution imaging for cell biologists: concepts, applications, current challenges and developments

The recent 2014 Nobel Prize in chemistry honored an era of discoveries and technical advancements in the field of super-resolution microscopy. However, the applications of diffraction-unlimited imaging in biology have a long road ahead and persistently engage scientists with new challenges. Some of the bottlenecks that restrain the dissemination of super-resolution techniques are tangible, and include the limited performance of affinity probes and the yet not capillary diffusion of imaging setups. Likewise, super-resolution microscopy has introduced new paradigms in the design of projects that require imaging with nanometer-resolution and in the interpretation of biological images. Besides structural or morphological characterization, super-resolution imaging is quickly expanding towards interaction mapping, multiple target detection and live imaging. Here we review the recent progress of biologists employing super-resolution imaging, some pitfalls, implications and new trends, with the purpose of animating the field and spurring future developments.

Two-photon instant structured illumination microscopy improves the depth penetration of super-resolution imaging in thick scattering samples

Fluorescence imaging methods that achieve spatial resolution beyond the diffraction limit (super-resolution) are of great interest in biology. We describe a super-resolution method that combines two-photon excitation with structured illumination microscopy (SIM), enabling three-dimensional interrogation of live organisms with ~150 nm lateral and ~400 nm axial resolution, at frame rates of ~1 Hz. By performing optical rather than digital processing operations to improve resolution, our microscope permits super-resolution imaging with no additional cost in acquisition time or phototoxicity relative to the point-scanning two-photon microscope upon which it is based. Our method provides better depth penetration and inherent optical sectioning than all previously reported super-resolution SIM implementations, enabling super-resolution imaging at depths exceeding 100 μm from the coverslip surface. The capability of our system for interrogating thick live specimens at high resolution is demonstrated by imaging whole nematode embryos and larvae, and tissues and organs inside zebrafish embryos.

Faster fluorescence microscopy: advances in high speed biological imaging

The past decade has seen explosive growth in new high speed imaging methods. These can broadly be classified as either point-scanning (which offer better depth penetration) or parallelized systems (which offer higher speed). We discuss each class generally, and cover specific advances in diffraction-limited microscopes (laser-scanning confocal, spinning-disk, and light-sheet) and superresolution microscopes (single-molecule imaging, stimulated emission-depletion, and structured illumination). A theme of our review is that there is no free lunch: each technique has strengths and weaknesses, and an advance in speed usually comes at the expense of either spatial resolution or depth penetration.

Spinning-disk confocal microscopy: present technology and future trends

Live-cell imaging requires not only high temporal resolution but also illumination powers low enough to minimize photodamage. Traditional single-point laser scanning confocal microscopy (LSCM) is generally limited by both the relatively slow speed at which it can acquire optical sections by serial raster scanning (a few Hz) and the higher potential for phototoxicity. These limitations have driven the development of rapid, parallel forms of confocal microscopy, the most popular of which is the spinning-disk confocal microscope (SDCM). Here, we briefly introduce the SDCM technique, discuss its strengths and weaknesses against LSCM, and update the reader on some recent developments in SDCM technology that improve its performance and expand its utility for life science research now and in the future.