Three-Dimensional Localization of Single Molecules for Super-Resolution Imaging and Single-Particle Tracking

3D printing of gas-dynamic virtual nozzles and optical characterization of high-speed microjets

Gas dynamic virtual nozzles (GDVNs) produce microscopic flow-focused liquid jets and droplets and play an important role at X-ray free-electron laser (XFEL) facilities where they are used to steer a stream of hydrated biomolecules into an X-ray focus during diffraction measurements. Highly stable and reproducible microjet and microdroplets are desired, as are flexible fabrication methods that enable integrated mixing microfluidics, droplet triggering mechanisms, laser illumination, and other customized features. In this study, we develop the use of high-resolution 3D nano-printing for the production of monolithic, asymmetric GDVN designs that are difficult to fabricate by other means. We also develop a dual-pulsed nanosecond image acquisition and analysis platform for the characterization of GDVN performance, including jet speed, length, diameter, and directionality, among others. We show that printed GDVNs can form microjets with very high degree of reproducibility, down to sub-micron diameters, and with water jet speeds beyond 170 m/s.

Visualizing and Manipulating Biological Processes by Using HaloTag and SNAP-Tag Technologies

Visualizing and manipulating the behavior of proteins is crucial to understanding the physiology of the cell. Methods of biorthogonal protein labeling are important tools to attain this goal. In this review, we discuss advances in probe technology specific for self-labeling protein tags, focusing mainly on the application of HaloTag and SNAP-tag systems. We describe the latest developments in small-molecule probes that enable fluorogenic (no wash) imaging and super-resolution fluorescence microscopy. In addition, we cover several methodologies that enable the perturbation or manipulation of protein behavior and function towards the control of biological pathways. Thus, current technical advances in the HaloTag and SNAP-tag systems means that they are becoming powerful tools to enable the visualization and manipulation of biological processes, providing invaluable scientific insights that are difficult to obtain by traditional methodologies. As the multiplex of self-labeling protein tag systems continues to be developed and expanded, the utility of these protein tags will allow researchers to address previously inaccessible questions at the forefront of biology.

Super-resolution imaging and quantification of megakaryocytes and platelets

Recent advances in super-resolution (sub-diffraction limited) microscopy have yielded remarkable insights into the nanoscale architecture and behavior of cells. In addition to the capacity to provide sub 100 nm resolution, these technologies offer unique quantitative opportunities with particular relevance to platelet and megakaryocyte biology. In this review, we provide a short introduction to modern super-resolution microscopy, its applications in the field of platelet and megakaryocyte biology, and emerging quantitative approaches which will allow for unprecedented insights into the biology of these unique cell types.

A time-varying approach to single particle tracking with a nonlinear observation model

Single Particle Tracking (SPT) is a powerful class of tools for analyzing the dynamics of individual biological macromolecules moving inside living cells. The acquired data is typically in the form of a sequence of camera images that are then post-processed to reveal details about the motion. In this work, we develop a local time-varying estimation algorithm for estimating motion model parameters from the data considering nonlinear observations. Our approach uses several well-known existing tools, namely the Expectation Maximization (EM) algorithm combined with an Unscented Kalman filter (UKF) and an Unscented Rauch-Tung-Striebel smoother (URTSS), and applies them to the time-varying case through a sliding window methodology. Due to the shot noise characteristics of the photon generation process, this model uses a Poisson distribution to capture the measurement noise inherent in imaging. In order to apply our time-varying approach to the UKF, we first need to transform the measurements into a model with additive Gaussian noise. This is carried out using a variance stabilizing transform. Results from simulations show that our approach is successful in tracing time-varying diffusion constants at a range of physically relevant signal levels. We also discuss the initialization for the EM algorithm based on the available data.

Quantum limits for precisely estimating the orientation and wobble of dipole emitters

Precisely measuring molecular orientation is key to understanding how molecules organize and interact in soft matter, but the maximum theoretical limit of measurement precision has yet to be quantified. We use quantum estimation theory and Fisher information (QFI) to derive a fundamental bound on the precision of estimating the orientations of rotationally fixed molecules. While direct imaging of the microscope pupil achieves the quantum bound, it is not compatible with wide-field imaging, so we propose an interferometric imaging system that also achieves QFI-limited measurement precision. Extending our analysis to rotationally diffusing molecules, we derive conditions that enable a subset of second-order dipole orientation moments to be measured with quantum-limited precision. Interestingly, we find that no existing techniques can measure all second moments simultaneously with QFI-limited precision; there exists a fundamental trade-off between precisely measuring the mean orientation of a molecule versus its wobble. This theoretical analysis provides crucial insight for optimizing the design of orientation-sensitive imaging systems.

Nano illumination microscopy: a technique based on scanning with an array of individually addressable nanoLEDs

In lensless microscopy, spatial resolution is usually provided by the pixel density of current digital cameras, which are reaching a hard-to-surpass pixel size / resolution limit over 1 µm. As an alternative, the dependence of the resolving power can be moved from the detector to the light sources, offering a new kind of lensless microscopy setups. The use of continuously scaled-down Light-Emitting Diode (LED) arrays to scan the sample allows resolutions on order of the LED size, giving rise to compact and low-cost microscopes without mechanical scanners or optical accessories. In this paper, we present the operation principle of this new approach to lensless microscopy, with simulations that demonstrate the possibility to use it for super-resolution, as well as a first prototype. This proof-of-concept setup integrates an 8 × 8 array of LEDs, each 5 × 5 μm² pixel size and 10 μm pitch, and an optical detector. We characterize the system using Electron-Beam Lithography (EBL) pattern. Our prototype validates the imaging principle and opens the way to improve resolution by further miniaturizing the light sources.

Addressing systematic errors in axial distance measurements in single-emitter localization microscopy

Nanoscale localization of point emitters is critical to several methods in optical fluorescence microscopy, including single-molecule super-resolution imaging and tracking. While the precision of the localization procedure has been the topic of extensive study, localization accuracy has been less emphasized, in part due to the challenge of producing an experimental sample containing unperturbed point emitters at known three-dimensional positions in a relevant geometry. We report a new experimental system which reproduces a widely-adopted geometry in high-numerical aperture localization microscopy, in which molecules are situated in an aqueous medium above a glass coverslip imaged with an oil-immersion objective. We demonstrate a calibration procedure that enables measurement of the depth-dependent point spread function (PSF) for open aperture imaging as well as imaging with engineered PSFs with index mismatch. We reveal the complicated, depth-varying behavior of the focal plane position in this system and discuss the axial localization biases incurred by common approximations of this behavior. We compare our results to theoretical calculations.

DeepSTORM3D: dense 3D localization microscopy and PSF design by deep learning

An outstanding challenge in single-molecule localization microscopy is the accurate and precise localization of individual point emitters in three dimensions in densely labeled samples. One established approach for three-dimensional single-molecule localization is point-spread-function (PSF) engineering, in which the PSF is engineered to vary distinctively with emitter depth using additional optical elements. However, images of dense emitters, which are desirable for improving temporal resolution, pose a challenge for algorithmic localization of engineered PSFs, due to lateral overlap of the emitter PSFs. Here we train a neural network to localize multiple emitters with densely overlapping Tetrapod PSFs over a large axial range. We then use the network to design the optimal PSF for the multi-emitter case. We demonstrate our approach experimentally with super-resolution reconstructions of mitochondria and volumetric imaging of fluorescently labeled telomeres in cells. Our approach, DeepSTORM3D, enables the study of biological processes in whole cells at timescales that are rarely explored in localization microscopy.

Three-Dimensional Single Particle Tracking and Its Applications in Confined Environments

Single particle tracking (SPT) has proven to be a powerful technique in studying molecular dynamics in complicated systems. We review its recent development, including three-dimensional (3D) SPT and its applications in probing nanostructures and molecule-surface interactions that are important to analytical chemical processes. Several frequently used 3D SPT techniques are introduced. Especially of interest are those based on point spread function engineering, which are simple in instrumentation and can be easily adapted and used in analytical labs. Corresponding data analysis methods are briefly discussed. We present several important case studies, with a focus on probing mass transport and molecule-surface interactions in confined environments. The presented studies demonstrate the great potential of 3D SPT for understanding fundamental phenomena in confined space, which will enable us to predict basic principles involved in chemical recognition, separation, and analysis, and to optimize mass transport and responses by structural design and optimization.

Single-Molecule Imaging of Protein Interactions and Dynamics

Live-cell single-molecule fluorescence imaging has become a powerful analytical tool to investigate cellular processes that are not accessible to conventional biochemical approaches. This has greatly enriched our understanding of the behaviors of single biomolecules in their native environments and their roles in cellular events. Here, we review recent advances in fluorescence-based single-molecule bioimaging of proteins in living cells. We begin with practical considerations of the design of single-molecule fluorescence imaging experiments such as the choice of imaging modalities, fluorescent probes, and labeling methods. We then describe analytical observables from single-molecule data and the associated molecular parameters along with examples of live-cell single-molecule studies. Lastly, we discuss computational algorithms developed for single-molecule data analysis.

The cell biologist's guide to super-resolution microscopy

Fluorescence microscopy has become a ubiquitous method to observe the location of specific molecular components within cells. However, the resolution of light microscopy is limited by the laws of diffraction to a few hundred nanometers, blurring most cellular details. Over the last two decades, several techniques - grouped under the 'super-resolution microscopy' moniker - have been designed to bypass this limitation, revealing the cellular organization down to the nanoscale. The number and variety of these techniques have steadily increased, to the point that it has become difficult for cell biologists and seasoned microscopists alike to identify the specific technique best suited to their needs. Available techniques include image processing strategies that generate super-resolved images, optical imaging schemes that overcome the diffraction limit and sample manipulations that expand the size of the biological sample. In this Cell Science at a Glance article and the accompanying poster, we provide key pointers to help users navigate through the various super-resolution methods by briefly summarizing the principles behind each technique, highlighting both critical strengths and weaknesses, as well as providing example images.

Photoactivatable fluorophores for single-molecule localization microscopy of live cells

Photochemical reactions can be designed to convert either irreversibly or reversibly a nonemissive reactant into an emissive product. The irreversible disconnection of a photocleavable group from an emissive chromophore or the reversible interconversion of a photochromic component is generally exploited to implement these operating principles for fluorescence switching. In both instances, the interplay of activating radiation, to convert the nonemissive state into the emissive species, and exciting radiation, to produce fluorescence from the latter, can be exploited to switch fluorescence on in a given area of interest at a precise interval of time. Such a level of spatiotemporal control provides the opportunity to reconstruct sub-diffraction images with resolution at the nanometer level. Indeed, closely-spaced emitters can be switched on under photochemical control at distinct intervals of time and localized independently at the single-molecule level. In combination with appropriate intracellular targeting strategies, some of these photoactivatable fluorophores can be switched and localized inside live cells to permit the visualization of sub-cellular structures with a spatial resolution that would be impossible to achieve with conventional fluorophores. As a result, photoactivatable fluorophores can become invaluable probes for the implementation of super-resolution imaging schemes aimed at the elucidation of the fundamental factors controlling cellular functions at the molecular level.

Twin-Airy Point-Spread Function for Extended-Volume Particle Localization

The localization of point sources in optical microscopy enables nm-precision imaging of single-molecules and biological dynamics. We report a new method of localization microscopy using twin Airy beams that yields precise 3D localization with the key advantages of extended depth range, higher optical throughput, and potential for imaging higher emitter densities than are possible using other techniques. A precision of better than 30 nm was achieved over a depth range in excess of 7  μm using a 60×, 1.4 NA objective. An illustrative application to extended-depth-range blood-flow imaging in a live zebrafish is also demonstrated.

Image reconstruction with a deep convolutional neural network in high-density super-resolution microscopy

An accurate and fast reconstruction algorithm is crucial for the improvement of temporal resolution in high-density super-resolution microscopy, particularly in view of the challenges associated with live-cell imaging. In this work, we design a deep network based on a convolutional neural network to take advantage of its enhanced ability in high-density molecule localization, and introduce a residual layer into the network to reduce noise. The proposed scheme also incorporates robustness against variations of both the full width at half maximum (FWHM) and the pixel size. We validate our algorithm on both simulated and experimental data by achieving performance improvement in terms of loss value and image quality, and demonstrate live-cell imaging with temporal resolution of 0.5 seconds by recovering mitochondria dynamics.

Enhanced 4Pi single-molecule localization microscopy with coherent pupil based localization

Over the last decades, super-resolution techniques have revolutionized the field of fluorescence microscopy. Among them, interferometric or 4Pi microscopy methods exhibit supreme resolving power in the axial dimension. Combined with single-molecule detection/localization and adaptive optics, current 4Pi microscopy methods enabled 10–15 nm isotropic 3D resolution throughout whole cells. However, further improving the achieved 3D resolution poses challenges arising from the complexity of single-molecule emission patterns generated by these coherent single-molecule imaging systems. These complex emission patterns render a large portion of information carrying photons unusable. Here, we introduce a localization algorithm that achieves the theoretical precision limit for a 4Pi based single-molecule switching nanoscopy (4Pi-SMSN) system, and demonstrate improvements in localization precision, accuracy as well as stability comparing with state-of-the-art 4Pi-SMSN methods.

To further improve localisation precision and biases in all the three dimensions of 4Pi single molecule localisation microscopy, Huang and Liu develop a method based on coherent pupil functions and an algorithm to extract the position information content at the theoretical information limit while dynamically compensating the temperature-induced cavity drift.

The Emerging Role of the Mammalian Glycocalyx in Functional Membrane Organization and Immune System Regulation

All cells in the human body are covered by a dense layer of sugars and the proteins and lipids to which they are attached, collectively termed the "glycocalyx." For decades, the organization of the glycocalyx and its interplay with the cellular state have remained enigmatic. This changed in recent years. Latest research has shown that the glycocalyx is an organelle of vital significance, actively involved in and functionally relevant for various cellular processes, that can be directly targeted in therapeutic contexts. This review gives a brief introduction into glycocalyx biology and describes the specific challenges glycocalyx research faces. Then, the traditional view of the role of the glycocalyx is discussed before several recent breakthroughs in glycocalyx research are surveyed. These results exemplify a currently unfolding bigger picture about the role of the glycocalyx as a fundamental cellular agent.

Quantifying bio-filament morphology below the diffraction limit of an optical microscope using out-of-focus images

A method to measure the dimensions of objects below the optical diffraction limit using diffraction analysis of out-of-focus bright-field images is presented. The method relies on the comparison of the diffraction patterns of an object of unknown size to those of calibration objects of known size. Correlative scanning electron microscope measurements are used to demonstrate the applicability of this method to measure 100 nm microbeads as well as objects with a geometry different from the calibration objects. This technique is important in the context of tethered particle experiments, in which bio-filaments are bound between a substrate and a microbead. This procedure is applied to obtain the diameters of axonal extensions or neurites that are mechanically created in samples of rat hippocampal neurons. The dependence of neurite geometry on mechanical pull speed is investigated, and the diameter is found to be rate independent.

Deep learning in single-molecule microscopy: fundamentals, caveats, and recent developments [Invited]

Deep learning-based data analysis methods have gained considerable attention in all fields of science over the last decade. In recent years, this trend has reached the single-molecule community. In this review, we will survey significant contributions of the application of deep learning in single-molecule imaging experiments. Additionally, we will describe the historical events that led to the development of modern deep learning methods, summarize the fundamental concepts of deep learning, and highlight the importance of proper data composition for accurate, unbiased results.

Three-dimensional nanoscale localization of point-like objects using self-interference digital holography

We propose localizing point-like fluorescent emitters in three dimensions with nanometer precision throughout large volumes using self-interference digital holography (SIDH). SIDH enables imaging of incoherently emitting objects over large axial ranges without refocusing, and single molecule localization techniques allow sub-50 nm resolution in the lateral and axial dimensions. We demonstrate three-dimensional localization with SIDH by imaging 100 and 40 nm fluorescent nanospheres. With 49,000 photons detected, SIDH achieves a localization precision of 5 nm laterally and 40 nm axially. We are able to detect the nanospheres from as few as 13,000 detected photons.

Single-Molecule Fluorescence Microscopy for Probing the Electrochemical Interface

The electrochemical interface is an ultrathin interfacial region between the electrode and solution where electrochemical reactions occur. The study of the electrochemical interface continues to be one of the most exciting directions in modern electrochemistry research. Much of our existing knowledge about the electrochemical interface comes from ensemble measurements and ex situ imaging of the electrode surface. Due to its enormous complexity and highly dynamic nature, however, new imaging tools that can probe the interface in situ with ultrahigh spatial and temporal resolution and single-molecule sensitivity are apparently needed. Single-molecule fluorescence microscopy (SMFM) has emerged as a powerful tool that is uniquely suited for studying the electrochemical interface. In this mini-review, we first give a brief overview of various existing SMFM methods for studying electrochemical problems. We then discuss several exciting research topics involving the use of SMFM methods for studying surface-immobilized molecules, single freely diffusing molecules, single molecules as catalytic reaction indicators, and single-molecule labeling and imaging of interfacial nanobubbles. We anticipate that we will continue to see a rapid increase in publications on stochastic electrochemistry of single molecules and nanoparticles. The increased use of SMFM will likely bring new information to our study of the electrochemical interface.

Accurate and rapid background estimation in single-molecule localization microscopy using the deep neural network BGnet

Background fluorescence, especially when it exhibits undesired spatial features, is a primary factor for reduced image quality in optical microscopy. Structured background is particularly detrimental when analyzing single-molecule images for 3-dimensional localization microscopy or single-molecule tracking. Here, we introduce BGnet, a deep neural network with a U-net-type architecture, as a general method to rapidly estimate the background underlying the image of a point source with excellent accuracy, even when point-spread function (PSF) engineering is in use to create complex PSF shapes. We trained BGnet to extract the background from images of various PSFs and show that the identification is accurate for a wide range of different interfering background structures constructed from many spatial frequencies. Furthermore, we demonstrate that the obtained background-corrected PSF images, for both simulated and experimental data, lead to a substantial improvement in localization precision. Finally, we verify that structured background estimation with BGnet results in higher quality of superresolution reconstructions of biological structures.

Fast and accurate sCMOS noise correction for fluorescence microscopy

The rapid development of scientific CMOS (sCMOS) technology has greatly advanced optical microscopy for biomedical research with superior sensitivity, resolution, field-of-view, and frame rates. However, for sCMOS sensors, the parallel charge-voltage conversion and different responsivity at each pixel induces extra readout and pattern noise compared to charge-coupled devices (CCD) and electron-multiplying CCD (EM-CCD) sensors. This can produce artifacts, deteriorate imaging capability, and hinder quantification of fluorescent signals, thereby compromising strategies to reduce photo-damage to live samples. Here, we propose a content-adaptive algorithm for the automatic correction of sCMOS-related noise (ACsN) for fluorescence microscopy. ACsN combines camera physics and layered sparse filtering to significantly reduce the most relevant noise sources in a sCMOS sensor while preserving the fine details of the signal. The method improves the camera performance, enabling fast, low-light and quantitative optical microscopy with video-rate denoising for a broad range of imaging conditions and modalities.

Scientific complementary metal-oxide semiconductor (sCMOS) cameras have advanced the imaging field, but they often suffer from additional noise compared to CCD sensors. Here the authors present a content-adaptive algorithm for the automatic correction of sCMOS-related noise for fluorescence microscopy.

Novel fibrillar structure in the inversin compartment of primary cilia revealed by 3D single-molecule superresolution microscopy

Primary cilia in many cell types contain a periaxonemal subcompartment called the inversin compartment. Four proteins have been found to assemble within the inversin compartment: INVS, ANKS6, NEK8, and NPHP3. The function of the inversin compartment is unknown, but it appears to be critical for normal development, including left–right asymmetry and renal tissue homeostasis. Here we combine superresolution imaging of human RPE1 cells, a classic model for studying primary cilia in vitro, with a genetic dissection of the protein–protein binding relationships that organize compartment assembly to develop a new structural model. We observe that INVS is the core structural determinant of a compartment composed of novel fibril-like substructures, which we identify here by three-dimensional single-molecule superresolution imaging. We find that NEK8 and ANKS6 depend on INVS for localization to these fibrillar assemblies and that ANKS6-NEK8 density within the compartment is regulated by NEK8. Together, NEK8 and ANKS6 are required downstream of INVS to localize and concentrate NPHP3 within the compartment. In the absence of these upstream components, NPHP3 is redistributed within cilia. These results provide a more detailed structure for the inversin compartment and introduce a new example of a membraneless compartment organized by protein–protein interactions.

Simultaneous Two-Angle Axial Ratiometry for Fast Live and Long-Term Three-Dimensional Super-Resolution Fluorescence Imaging

The application of optical microscopy in four-dimensional (spatial and temporal) super-resolution imaging poses challenges because of the requirement of a long acquisition time or high illumination intensity. In this paper, we introduce simultaneous two-angle axial ratiometry (STARII) for <20 nm axial super-resolution imaging and for fast and long-term imaging of live cells up to hundreds of frames per second. This method involves recording two raw images in two incident angle channels in the context of evanescent wave illumination and obtaining the corresponding intensity ratio. Furthermore, we demonstrate the combination of STARII with the lateral super-resolution method to resolve three-dimensional nanoscale structures of microtubules and to visualize the long-term dynamical plasma membrane curvature and fast remodeling of endoplasmic reticulum tubule meshwork and three-way junctions. These demonstrations indicate an important potential application of STARII in investigating nanoscale cellular complex processes in the native state.

Accurate phase retrieval of complex 3D point spread functions with deep residual neural networks

Phase retrieval, i.e., the reconstruction of phase information from intensity information, is a central problem in many optical systems. Imaging the emission from a point source such as a single molecule is one example. Here, we demonstrate that a deep residual neural net is able to quickly and accurately extract the hidden phase for general point spread functions (PSFs) formed by Zernike-type phase modulations. Five slices of the 3D PSF at different focal positions within a two micrometer range around the focus are sufficient to retrieve the first six orders of Zernike coefficients.

Fluorescence imaging with tailored light

Fluorescence microscopy has long been a valuable tool for biological and medical imaging. Control of optical parameters such as the amplitude, phase, polarization and propagation angle of light gives fluorescence imaging great capabilities ranging from super-resolution imaging to long-term real-time observation of living organisms. In this review, we discuss current fluorescence imaging techniques in terms of the use of tailored or structured light for the sample illumination and fluorescence detection, providing a clear overview of their working principles and capabilities.

Single-cell transcriptomic evidence for dense intracortical neuropeptide networks

Seeking new insights into the homeostasis, modulation and plasticity of cortical synaptic networks, we have analyzed results from a single-cell RNA-seq study of 22,439 mouse neocortical neurons. Our analysis exposes transcriptomic evidence for dozens of molecularly distinct neuropeptidergic modulatory networks that directly interconnect all cortical neurons. This evidence begins with a discovery that transcripts of one or more neuropeptide precursor (NPP) and one or more neuropeptide-selective G-protein-coupled receptor (NP-GPCR) genes are highly abundant in all, or very nearly all, cortical neurons. Individual neurons express diverse subsets of NP signaling genes from palettes encoding 18 NPPs and 29 NP-GPCRs. These 47 genes comprise 37 cognate NPP/NP-GPCR pairs, implying the likelihood of local neuropeptide signaling. Here, we use neuron-type-specific patterns of NP gene expression to offer specific, testable predictions regarding 37 peptidergic neuromodulatory networks that may play prominent roles in cortical homeostasis and plasticity.

Intensity-Based Axial Localization at the Quantum Limit

We derive fundamental precision bounds for single-point axial localization. For Gaussian beams, this ultimate limit can be achieved with a single intensity scan, provided the camera is placed at one of two optimal transverse detection planes. Hence, for axial localization there is no need of more complicated detection schemes. The theory is verified with an experimental demonstration of axial resolution 3 orders of magnitude below the classical depth of focus.

Joint 3D localization and classification of space debris using a multispectral rotating point spread function

We consider the problem of joint three-dimensional (3D) localization and material classification of unresolved space debris using a multispectral rotating point spread function (RPSF). The use of RPSF allows one to estimate the 3D locations of point sources from their rotated images acquired by a single 2D sensor array, since the amount of rotation of each source image about its x, y location depends on its axial distance z. Using multispectral images, with one RPSF per spectral band, we are able not only to localize the 3D positions of the space debris but also classify their material composition. We propose a three-stage method for achieving joint localization and classification. In stage 1, we adopt an optimization scheme for localization in which the spectral signature of each material is assumed to be uniform, which significantly improves efficiency and yields better localization results than possible with a single spectral band. In stage 2, we estimate the spectral signature and refine the localization result via an alternating approach. We process classification in the final stage. Both Poisson noise and Gaussian noise models are considered, and the implementation of each is discussed. Numerical tests using multispectral data from NASA show the efficiency of our three-stage approach and illustrate the improvement of point source localization and spectral classification from using multiple bands over a single band.

Model-free 3D localization with precision estimates for brightfield-imaged particles

Volumetric imaging and 3D particle tracking are becoming increasingly common and have a variety of microscopy applications including in situ fluorescent imaging, in-vitro single-molecule characterization, and analysis of colloidal systems. While recent interest has generated discussion of optimal schemes for localizing diffraction-limited fluorescent puncta, there have been relatively few published routines for tracking particles imaged with bright-field illumination. To address this, we outline a simple, look-up-table based 3D tracking strategy, which can be adapted to most commercially available wide-field microscopes, and present two image processing algorithms that together yield high-precision localization and return estimates of statistical accuracy. Under bright-field illumination, a particle's depth can be determined based on the size and shape of its diffractive pattern due to Mie scattering. Contrary to typical "super-resolution" fluorescence tracking routines, which typically fit a diffraction-limited spot to a model point-spread-function, the lateral (XY) tracking routine relies on symmetry to locate a particle without prior knowledge of the form of the particle. At low noise levels (signal:noise > 1000), the symmetry routine estimates particle positions with accuracy better than 0.01 pixel. Depth localization is accomplished by matching images of particles to those in a pre-recorded look-up-table. The routine presented here optimally interpolates between LUT entries with better than 0.05 step accuracy. Both routines are tolerant of high levels of image noise, yielding sub-pixel/step accuracy with signal-to-noise ratios as small as 1, and, by design, return confidence intervals indicating the expected accuracy of each calculated position. The included implementations operate extremely quickly and are amenable to real-time analysis at frame rates exceeding several hundred frames per second.

Nanoscale Resolution 3D Snapshot Particle Tracking by Multifocal Microscopy

Accurate, precise, and rapid particle tracking in three dimensions remains a challenge; yet, its achievement will significantly enhance our understanding of living systems. We developed a multifocal microscopy (MFM) that allows snapshot acquisition of the imaging data, and an associated image processing approach, that together allow simultaneous 3D tracking of many fluorescent particles with nanoscale resolution. The 3D tracking was validated by measuring a known trajectory of a fluorescent bead with an axial accuracy of 19 nm through an image depth (axial range) of 3 μm and 4 nm precision of axial localization through an image depth of 4 μm. A second test obtained a uniform axial probability distribution and Brownian dynamics of beads diffusing in solution. We also validated the MFM approach by imaging fluorescent beads immobilized in gels and comparing the 3D localizations to their "ground truth" positions obtained from a confocal microscopy z-stack of finely spaced images. Finally, we applied our MFM and image processing approach to obtain 3D trajectories of insulin granules in pseudoislets of MIN6 cells to demonstrate its compatibility with complex biological systems. Our study demonstrates that multifocal microscopy allows rapid (video rate) and simultaneous 3D tracking of many "particles" with nanoscale accuracy and precision in a wide range of systems, including over spatial scales relevant to whole live cells.

Expanding single-molecule fluorescence spectroscopy to capture complexity in biology

Fundamental biological processes are driven by diverse molecular machineries. In recent years, single-molecule fluorescence spectroscopy has matured as a unique tool in biology to study how structural dynamics of molecular complexes drive various biochemical reactions. In this review, we highlight underlying developments in single-molecule fluorescence methods that enable deep biological investigations. Recent progress in these methods points toward increasing complexity of measurements to capture biological processes in a living cell, where multiple processes often occur simultaneously and are mechanistically coupled.

A protocol for single molecule imaging and tracking of processive myosin motors

Myosin is a large family of actin-based molecular motors, which includes efficient intracellular transporters that move cargoes and material essential for cell's life. Here, we describe protocols for labelling single myosin motors with quantum dots, tracking them in an in vitro reconstituted single-molecule motility assay, acquiring image stacks and analyzing them. We describe the required steps to obtain trajectories of single myosin motors from which fundamental biophysical parameters such as the motor velocity, run length and step size can be derived. We also describe protocols for an ensemble actin gliding assay, which is valuable to test the motor viability and its ensemble properties. The protocols allow probing the effect of changes in nucleotides, ions, and buffer composition on the motor properties and are easily generalizable to track the movements of different motor proteins.

Real-Time 3D Single Particle Tracking: Towards Active Feedback Single Molecule Spectroscopy in Live Cells

Single molecule fluorescence spectroscopy has been largely implemented using methods which require tethering of molecules to a substrate in order to make high temporal resolution measurements. However, the act of tethering a molecule requires that the molecule be removed from its environment. This is especially perturbative when measuring biomolecules such as enzymes, which may rely on the non-equilibrium and crowded cellular environment for normal function. A method which may be able to un-tether single molecule fluorescence spectroscopy is real-time 3D single particle tracking (RT-3D-SPT). RT-3D-SPT uses active feedback to effectively lock-on to freely diffusing particles so they can be measured continuously with up to photon-limited temporal resolution over large axial ranges. This review gives an overview of the various active feedback 3D single particle tracking methods, highlighting specialized detection and excitation schemes which enable high-speed real-time tracking. Furthermore, the combination of these active feedback methods with simultaneous live-cell imaging is discussed. Finally, the successes in real-time 3D single molecule tracking (RT-3D-SMT) thus far and the roadmap going forward for this promising family of techniques are discussed.

Kilohertz frame-rate two-photon tomography

Point-scanning two-photon microscopy enables high-resolution imaging within scattering specimens such as the mammalian brain, but sequential acquisition of voxels fundamentally limits its speed. We developed a two-photon imaging technique that scans lines of excitation across a focal plane at multiple angles and computationally recovers high-resolution images, attaining voxel rates of over 1 billion Hz in structured samples. Using a static image as a prior for recording neural activity, we imaged visually evoked and spontaneous glutamate release across hundreds of dendritic spines in mice at depths over 250 µm and frame rates over 1 kHz. Dendritic glutamate transients in anesthetized mice are synchronized within spatially contiguous domains spanning tens of micrometers at frequencies ranging from 1-100 Hz. We demonstrate millisecond-resolved recordings of acetylcholine and voltage indicators, three-dimensional single-particle tracking and imaging in densely labeled cortex. Our method surpasses limits on the speed of raster-scanned imaging imposed by fluorescence lifetime.

Carbon dots, a powerful non-toxic support for bioimaging by fluorescence nanoscopy and eradication of bacteria by photothermia

Carbon Dots (CDs) are innovative materials which have potential applications in many fields, including nanomedicine, energy and catalysis. Here CDs were produced by the alkali-assisted ultrasonic route and characterized by several techniques to determine their composition and properties. Fluorescence nanoscopy using single-molecule localization microscopy shows that they have very good photophysical properties and a remarkable blinking behaviour at 405 nm. Moreover, these CDs are a safe material, non-toxic towards different cell lines (cancer and non-cancer cells) even at very high concentration, reflecting an excellent biocompatibility. Photothermia, i.e. their heating capacity under laser irradiation, was evaluated at two wavelengths and at several power densities. The resulting temperature increment was high (5 < ΔT < 45 °C) and appropriate for biomedical applications. Bioimaging and photothermia were then performed on E. coli, a Gram(-) bacterium, incubated with CDs. Remarkably, by photothermia at 680 nm (0.3, 1 and 1.9 W cm^-2) or 808 nm (1.9 W cm^-2), CDs are able to eradicate bacteria in their exponential and stationary phases. Images obtained by 3D super-resolution microscopy clearly show the different CD distributions in surviving bacteria after mild photothermal treatment. These results confirm that CDs are multifunctional materials with a wide range of biomedical applications.

Topologically-guided continuous protein crystallization controls bacterial surface layer self-assembly

Many bacteria and most archaea possess a crystalline protein surface layer (S-layer), which surrounds their growing and topologically complicated outer surface. Constructing a macromolecular structure of this scale generally requires localized enzymatic machinery, but a regulatory framework for S-layer assembly has not been identified. By labeling, superresolution imaging, and tracking the S-layer protein (SLP) from C. crescentus, we show that 2D protein self-assembly is sufficient to build and maintain the S-layer in living cells by efficient protein crystal nucleation and growth. We propose a model supported by single-molecule tracking whereby randomly secreted SLP monomers diffuse on the lipopolysaccharide (LPS) outer membrane until incorporated at the edges of growing 2D S-layer crystals. Surface topology creates crystal defects and boundaries, thereby guiding S-layer assembly. Unsupervised assembly poses challenges for therapeutics targeting S-layers. However, protein crystallization as an evolutionary driver rationalizes S-layer diversity and raises the potential for biologically inspired self-assembling macromolecular nanomaterials.

Bacteria assemble the surface layer (S-layer), a crystalline protein coat surrounding the curved surface, using protein self-assembly. Here authors image native and purified RsaA, the S-layer protein from C. crescentus, and show that protein crystallization alone is sufficient to assemble and maintain the S-layer in vivo.

Chasing Uptake: Super-Resolution Microscopy in Endocytosis and Phagocytosis

Since their invention about two decades ago, super-resolution microscopes have become a method of choice in cell biology. Owing to a spatial resolution below 50 nm, smaller than the size of most organelles, and an order of magnitude better than the diffraction limit of conventional light microscopes, super-resolution microscopy is a powerful technique for resolving intracellular trafficking. In this review we discuss discoveries in endocytosis and phagocytosis that have been made possible by super-resolution microscopy - from uptake at the plasma membrane, endocytic coat formation, and cytoskeletal rearrangements to endosomal maturation. The detailed visualization of the diverse molecular assemblies that mediate endocytic uptake will provide a better understanding of how cells ingest extracellular material.

Myosin V fluorescence imaging dataset for single-molecule localization and tracking

Myosin-5B is one of three members of the myosin-5 family of actin-based molecular motors fundamental in recycling endosome trafficking and collective actin network dynamics. Through single-molecule motility assays, we recently demonstrated that myosin-5B can proceed in 36-nm steps along actin filaments as single motor. By analyzing trajectories of single myosin-5B along actin filaments we showed that its velocity is dependent on ATP concentration, while its run length is independent on ATP concentration, as a landmark of processivity.

Here, we share image stacks acquired under total internal reflection fluorescence (TIRF) microscopy and representative trajectories of single myosin-5B molecules labelled with Quantum Dots (QD-myo-5B) moving along actin filaments at different ATP concentrations (0.3–1000 μM). Localization of QD-myo-5B was performed with the PROOF software, which is freely available [1]. The data can be valuable for researchers interested in molecular motors motility, both from an experimental and modeling point of view, as well as to researchers developing single particle tracking algorithms. The data is related to the research article “Dissecting myosin-5B mechanosensitivity and calcium regulation at the single molecule level” Gardini et al., 2015.

Extended-Depth 3D Super-Resolution Imaging Using Probe-Refresh STORM

Single-molecule localization microscopy methods for super-resolution fluorescence microscopy such as STORM (stochastic optical reconstruction microscopy) are generally limited to thin three-dimensional (3D) sections (≤600 nm) because of photobleaching of molecules outside the focal plane. Although multiple focal planes may be imaged before photobleaching by focusing progressively deeper within the sample, image quality is compromised in this approach because the total number of measurable localizations is divided between detection planes. Here, we solve this problem on fixed samples by developing an imaging method that we call probe-refresh STORM (prSTORM), which allows bleached fluorophores to be straightforwardly replaced with nonbleached fluorophores. We accomplish this by immunostaining the sample with DNA-conjugated antibodies and then reading out their distribution using fluorescently-labeled DNA-reporter oligonucleotides that can be fully replaced in successive rounds of imaging. We demonstrate that prSTORM can acquire 3D images over extended depths without sacrificing the density of localizations at any given plane. We also show that prSTORM can be adapted to obtain high-quality, 3D multichannel images with extended depth that would be challenging or impossible to achieve using established probe methods.

Depth-dependent PSF calibration and aberration correction for 3D single-molecule localization

Three-dimensional single molecule localization microscopy relies on the fitting of the individual molecules with a point spread function (PSF) model. The reconstructed images often show local squeezing or expansion in z. A common cause is depth-induced aberrations in conjunction with an imperfect PSF model calibrated from beads on a coverslip, resulting in a mismatch between measured PSF and real PSF. Here, we developed a strategy for accurate z-localization in which we use the imperfect PSF model for fitting, determine the fitting errors and correct for them in a post-processing step. We present an open-source software tool and a simple experimental calibration procedure that allow retrieving accurate z-positions in any PSF engineering approach or fitting modality, even at large imaging depths.

A H-bond strategy to develop acid-resistant photoswitchable rhodamine spirolactams for super-resolution single-molecule localization microscopy

Rhodamine spirolactam based photoswitches have been extensively applied in super-resolution single-molecule localization microscopy (SMLM). However, the ring-opening reactions of spirolactams are cross-sensitive to acid, limiting their photoswitch use to neutral pH conditions. In addition, the ring-closing reactions of spirolactams are environment-sensitive and slow (up to hours), virtually making rhodamine spirolactams caged fluorescent dyes instead of reversible photoswitches in SMLM. Herein, by introducing hydrogen bonds to stabilize spirolactams, we report a series of acid-resistant rhodamine spirolactams with accelerated ring-closing reactions from fluorescent xanthyliums to non-fluorescent spirolactams, endowing them with good photoswitchable properties even in acidic environments. By further substitution of 6-phenylethynyl naphthalimide on the spirolactam, we shifted the photoactivation wavelength into the visible region (>400 nm). Subsequently, we have successfully applied these dyes in labeling and imaging the cell surface of Bacillus subtilis at pH 4.5 using SMLM.

Fluorescence microscopy for visualizing single-molecule protein dynamics

BACKGROUND

Single-molecule fluorescence imaging (smFI) has evolved into a valuable method used in biophysical and biochemical studies as it can observe the real-time behavior of individual protein molecules, enabling understanding of their detailed dynamic features. smFI is also closely related to other state-of-the-art microscopic methods, optics, and nanomaterials in that smFI and these technologies have developed synergistically.

SCOPE OF REVIEW

This paper provides an overview of the recently developed single-molecule fluorescence microscopy methods, focusing on critical techniques employed in higher-precision measurements in vitro and fluorescent nanodiamond, an emerging promising fluorophore that will improve single-molecule fluorescence microscopy.

MAJOR CONCLUSIONS

smFI will continue to improve regarding the photostability of fluorophores and will develop via combination with other techniques based on nanofabrication, single-molecule manipulation, and so on.

GENERAL SIGNIFICANCE

Quantitative, high-resolution single-molecule studies will help establish an understanding of protein dynamics and complex biomolecular systems.

Toward Precision Measurement and Manipulation of Single-Molecule Reactions by a Confined Space

All chemical reactions can be divided into a series of single molecule reactions (SMRs), the elementary steps that involve only isomerization of, dissociation from, and addition to an individual molecule. Analyzing SMRs is of paramount importance to identify the intrinsic molecular mechanism of a complex chemical reaction, which is otherwise implausible to reveal in an ensemble fashion, owing to the significant static and dynamic heterogeneity of real-world chemical systems. The single-molecule measurement and manipulation methods developed recently are playing an increasingly irreplaceable role to detect and recognize short-lived intermediates, visualize their transient existence, and determinate the kinetics and dynamics of single bond breaking and formation. Notably, none of the above SMRs characterizations can be realized without the aid of a confined space. Therefore, this Review aims to highlight the recent progress in the development of confined space enabled single-molecule sensing, imaging, and tuning methods to study chemical reactions. Future prospects of SMRs research are also included, including a push toward the physical limit on transduction of information to signals and vice versa, transmission and recording of signals, computational modeling and simulation, and rational design of a confined space for precise SMRs.