Maximum-likelihood model fitting for quantitative analysis of SMLM data

AI analysis of super-resolution microscopy: Biological discovery in the absence of ground truth

Super-resolution microscopy, or nanoscopy, enables the use of fluorescent-based molecular localization tools to study molecular structure at the nanoscale level in the intact cell, bridging the mesoscale gap to classical structural biology methodologies. Analysis of super-resolution data by artificial intelligence (AI), such as machine learning, offers tremendous potential for the discovery of new biology, that, by definition, is not known and lacks ground truth. Herein, we describe the application of weakly supervised paradigms to super-resolution microscopy and its potential to enable the accelerated exploration of the nanoscale architecture of subcellular macromolecules and organelles.

Machine Learning for Single-Molecule Localization Microscopy: From Data Analysis to Quantification

Single-molecule localization microscopy (SMLM) is a versatile tool for realizing nanoscale imaging with visible light and providing unprecedented opportunities to observe bioprocesses. The integration of machine learning with SMLM enhances data analysis by improving efficiency and accuracy. This tutorial aims to provide a comprehensive overview of the data analysis process and theoretical aspects of SMLM, while also highlighting the typical applications of machine learning in this field. By leveraging advanced analytical techniques, SMLM is becoming a powerful quantitative analysis tool for biological research.

Universal inverse modeling of point spread functions for SMLM localization and microscope characterization

The point spread function (PSF) of a microscope describes the image of a point emitter. Knowing the accurate PSF model is essential for various imaging tasks, including single-molecule localization, aberration correction and deconvolution. Here we present universal inverse modeling of point spread functions (uiPSF), a toolbox to infer accurate PSF models from microscopy data, using either image stacks of fluorescent beads or directly images of blinking fluorophores, the raw data in single-molecule localization microscopy (SMLM). Our modular framework is applicable to a variety of microscope modalities and the PSF model incorporates system- or sample-specific characteristics, for example, the bead size, field- and depth- dependent aberrations, and transformations among channels. We demonstrate its application in single or multiple channels or large field-of-view SMLM systems, 4Pi-SMLM, and lattice light-sheet microscopes using either bead data or single-molecule blinking data.

Build and operation of a custom 3D, multicolor, single-molecule localization microscope

Single-molecule localization microscopy (SMLM) enables imaging scientists to visualize biological structures with unprecedented resolution. Particularly powerful implementations of SMLM are capable of three-dimensional, multicolor and high-throughput imaging and can yield key biological insights. However, widespread access to these technologies is limited, primarily by the cost of commercial options and complexity of de novo development of custom systems. Here we provide a comprehensive guide for interested researchers who wish to establish a high-end, custom-built SMLM setup in their laboratories. We detail the initial configuration and subsequent assembly of the SMLM, including the instructions for the alignment of all the optical pathways, the software and hardware integration, and the operation of the instrument. We describe the validation steps, including the preparation and imaging of test and biological samples with structures of well-defined geometries, and assist the user in troubleshooting and benchmarking the system's performance. Additionally, we provide a walkthrough of the reconstruction of a super-resolved dataset from acquired raw images using the Super-resolution Microscopy Analysis Platform. Depending on the instrument configuration, the cost of the components is in the range US$95,000-180,000, similar to other open-source advanced SMLMs, and substantially lower than the cost of a commercial instrument. A builder with some experience of optical systems is expected to require 4-8 months from the start of the system construction to attain high-quality three-dimensional and multicolor biological images.

Multiplexed and Millimeter-Scale Fluorescence Nanoscopy of Cells and Tissue Sections via Prism-Illumination and Microfluidics-Enhanced DNA-PAINT

Fluorescence nanoscopy has become increasingly powerful for biomedical research, but it has historically afforded a small field-of-view (FOV) of around 50 μm × 50 μm at once and more recently up to ∼200 μm × 200 μm. Efforts to further increase the FOV in fluorescence nanoscopy have thus far relied on the use of fabricated waveguide substrates, adding cost and sample constraints to the applications. Here we report PRism-Illumination and Microfluidics-Enhanced DNA-PAINT (PRIME-PAINT) for multiplexed fluorescence nanoscopy across millimeter-scale FOVs. Built upon the well-established prism-type total internal reflection microscopy, PRIME-PAINT achieves robust single-molecule localization with up to ∼520 μm × 520 μm single FOVs and 25-40 nm lateral resolutions. Through stitching, nanoscopic imaging over mm2 sample areas can be completed in as little as 40 min per target. An on-stage microfluidics chamber facilitates probe exchange for multiplexing and enhances image quality, particularly for formalin-fixed paraffin-embedded (FFPE) tissue sections. We demonstrate the utility of PRIME-PAINT by analyzing ∼106 caveolae structures in ∼1,000 cells and imaging entire pancreatic cancer lesions from patient tissue biopsies. By imaging from nanometers to millimeters with multiplexity and broad sample compatibility, PRIME-PAINT will be useful for building multiscale, Google-Earth-like views of biological systems.

Detecting continuous structural heterogeneity in single-molecule localization microscopy data

Fusion of multiple chemically identical complexes, so-called particles, in localization microscopy, can improve the signal-to-noise ratio and overcome under-labeling. To this end, structural homogeneity of the data must be assumed. Biological heterogeneity, however, could be present in the data originating from distinct conformational variations or (continuous) variations in particle shapes. We present a prior-knowledge-free method for detecting continuous structural variations with localization microscopy. Detecting this heterogeneity leads to more faithful fusions and reconstructions of the localization microscopy data as their heterogeneity is taken into account. In experimental datasets, we show the continuous variation of the height of DNA origami tetrahedrons imaged with 3D PAINT and of the radius of Nuclear Pore Complexes imaged in 2D with STORM. In simulation, we study the impact on the heterogeneity detection pipeline of Degree Of Labeling and of structural variations in the form of two independent modes.

Universal inverse modelling of point spread functions for SMLM localization and microscope characterization

The point spread function (PSF) of a microscope describes the image of a point emitter. Knowing the accurate PSF model is essential for various imaging tasks, including single molecule localization, aberration correction and deconvolution. Here we present uiPSF (universal inverse modelling of Point Spread Functions), a toolbox to infer accurate PSF models from microscopy data, using either image stacks of fluorescent beads or directly images of blinking fluorophores, the raw data in single molecule localization microscopy (SMLM). The resulting PSF model enables accurate 3D super-resolution imaging using SMLM. Additionally, uiPSF can be used to characterize and optimize a microscope system by quantifying the aberrations, including field-dependent aberrations, and resolutions. Our modular framework is applicable to a variety of microscope modalities and the PSF model incorporates system or sample specific characteristics, e.g., the bead size, depth dependent aberrations and transformations among channels. We demonstrate its application in single or multiple channels or large field-of-view SMLM systems, 4Pi-SMLM, and lattice light-sheet microscopes using either bead data or single molecule blinking data.

Simulating structurally variable nuclear pore complexes for microscopy

MOTIVATION

The nuclear pore complex (NPC) is the only passageway for macromolecules between nucleus and cytoplasm, and an important reference standard in microscopy: it is massive and stereotypically arranged. The average architecture of NPC proteins has been resolved with pseudoatomic precision, however observed NPC heterogeneities evidence a high degree of divergence from this average. Single-molecule localization microscopy (SMLM) images NPCs at protein-level resolution, whereupon image analysis software studies NPC variability. However, the true picture of this variability is unknown. In quantitative image analysis experiments, it is thus difficult to distinguish intrinsically high SMLM noise from variability of the underlying structure.

RESULTS

We introduce CIR4MICS ('ceramics', Configurable, Irregular Rings FOR MICroscopy Simulations), a pipeline that synthesizes ground truth datasets of structurally variable NPCs based on architectural models of the true NPC. Users can select one or more N- or C-terminally tagged NPC proteins, and simulate a wide range of geometric variations. We also represent the NPC as a spring-model such that arbitrary deforming forces, of user-defined magnitudes, simulate irregularly shaped variations. Further, we provide annotated reference datasets of simulated human NPCs, which facilitate a side-by-side comparison with real data. To demonstrate, we synthetically replicate a geometric analysis of real NPC radii and reveal that a range of simulated variability parameters can lead to observed results. Our simulator is therefore valuable to test the capabilities of image analysis methods, as well as to inform experimentalists about the requirements of hypothesis-driven imaging studies.

AVAILABILITY AND IMPLEMENTATION

Code: https://github.com/uhlmanngroup/cir4mics. Simulated data: BioStudies S-BSST1058.

Simultaneous spectral differentiation of multiple fluorophores in super-resolution imaging using a glass phase plate

By engineering the point-spread function (PSF) of single molecules, different fluorophore species can be imaged simultaneously and distinguished by their unique PSF patterns. Here, we insert a silicon-dioxide phase plate at the Fourier plane of the detection path of a wide-field fluorescence microscope to produce distinguishable PSFs (X-PSFs) at different wavelengths. We demonstrate that the resulting PSFs can be localized spatially and spectrally using a maximum-likelihood estimation algorithm and can be utilized for hyper-spectral super-resolution microscopy of biological samples. We produced superresolution images of fixed U2OS cells using X-PSFs for dSTORM imaging with simultaneous illumination of up to three fluorophore species. The species were distinguished only by the PSF pattern. We achieved ∼21-nm lateral localization precision (FWHM) and ∼17-nm axial precision (FWHM) with an average of 1,800 - 3,500 photons per PSF and a background as high as 130 - 400 photons per pixel. The modified PSF distinguished fluorescent probes with ∼80 nm separation between spectral peaks.

Particle fusion of super-resolution data reveals the unit structure of Nup96 in Nuclear Pore Complex

Single molecule localization microscopy offers resolution nearly down to the molecular level with specific molecular labelling, and is thereby a promising tool for structural biology. In practice, however, the actual value to this field is limited primarily by incomplete fluorescent labelling of the structure. This missing information can be completed by merging information from many structurally identical particles in a particle fusion approach similar to cryo-EM single-particle analysis. In this paper, we present a data analysis of particle fusion results of fluorescently labelled Nup96 nucleoporins in the Nuclear Pore Complex to show that Nup96 occurs in a spatial arrangement of two rings of 8 units with two Nup96 copies per unit giving a total of 32 Nup96 copies per pore. We use Artificial Intelligence assisted modeling in Alphafold to extend the existing cryo-EM model of Nup96 to accurately pinpoint the positions of the fluorescent labels and show the accuracy of the match between fluorescent and cryo-EM data to be better than 3 nm in-plane and 5 nm out-of-plane.

ECLiPSE: A Versatile Classification Technique for Structural and Morphological Analysis of Super-Resolution Microscopy Data

We introduce a new automated machine learning analysis pipeline to precisely classify cellular structures captured through single molecule localization microscopy, which we call ECLiPSE (Enhanced Classification of Localized Pointclouds by Shape Extraction). ECLiPSE leverages 67 comprehensive shape descriptors encompassing geometric, boundary, skeleton and other properties, the majority of which are directly extracted from the localizations to accurately characterize individual structures. We validate ECLiPSE through unsupervised and supervised classification on a dataset featuring five distinct cellular structures, achieving exceptionally high classification accuracies nearing 100%. Moreover, we demonstrate the versatility of our approach by applying it to two novel biological applications: quantifying the clearance of tau protein aggregates, a critical marker for neurodegenerative diseases, and differentiating between two distinct morphological features (morphotypes) of TAR DNA-binding protein 43 proteinopathy, potentially associated to different TDP-43 strains, each exhibiting unique seeding and spreading properties. We anticipate that this versatile approach will significantly enhance the way we study cellular structures across various biological contexts, elucidating their roles in disease development and progression.

Ångström-resolution fluorescence microscopy

Fluorescence microscopy, with its molecular specificity, is one of the major characterization methods used in the life sciences to understand complex biological systems. Super-resolution approaches1-6 can achieve resolution in cells in the range of 15 to 20 nm, but interactions between individual biomolecules occur at length scales below 10 nm and characterization of intramolecular structure requires Ångström resolution. State-of-the-art super-resolution implementations7-14 have demonstrated spatial resolutions down to 5 nm and localization precisions of 1 nm under certain in vitro conditions. However, such resolutions do not directly translate to experiments in cells, and Ångström resolution has not been demonstrated to date. Here we introdue a DNA-barcoding method, resolution enhancement by sequential imaging (RESI), that improves the resolution of fluorescence microscopy down to the Ångström scale using off-the-shelf fluorescence microscopy hardware and reagents. By sequentially imaging sparse target subsets at moderate spatial resolutions of >15 nm, we demonstrate that single-protein resolution can be achieved for biomolecules in whole intact cells. Furthermore, we experimentally resolve the DNA backbone distance of single bases in DNA origami with Ångström resolution. We use our method in a proof-of-principle demonstration to map the molecular arrangement of the immunotherapy target CD20 in situ in untreated and drug-treated cells, which opens possibilities for assessing the molecular mechanisms of targeted immunotherapy. These observations demonstrate that, by enabling intramolecular imaging under ambient conditions in whole intact cells, RESI closes the gap between super-resolution microscopy and structural biology studies and thus delivers information key to understanding complex biological systems.

Clathrin coats partially preassemble and subsequently bend during endocytosis

Eukaryotic cells use clathrin-mediated endocytosis to take up a large range of extracellular cargo. During endocytosis, a clathrin coat forms on the plasma membrane, but it remains controversial when and how it is remodeled into a spherical vesicle. Here, we use 3D superresolution microscopy to determine the precise geometry of the clathrin coat at large numbers of endocytic sites. Through pseudo-temporal sorting, we determine the average trajectory of clathrin remodeling during endocytosis. We find that clathrin coats assemble first on flat membranes to 50% of the coat area before they become rapidly and continuously bent, and this mechanism is confirmed in three cell lines. We introduce the cooperative curvature model, which is based on positive feedback for curvature generation. It accurately describes the measured shapes and dynamics of the clathrin coat and could represent a general mechanism for clathrin coat remodeling on the plasma membrane.