Deep learning enables fast and dense single-molecule localization with high accuracy

Subcellular dynamics in unicellular parasites

Bioimaging has made tremendous advances in this century. Innovations in high- and super-resolution microscopy are well established, and live-cell imaging is extensively used to gain an overview of dynamic processes. But the combination of high spatial and temporal resolution necessary to capture intracellular dynamics is rarely achieved. Further, efficient software pipelines - that can handle the recorded data and allow comprehensive analyses - are being developed but lag behind other technical innovations in applicability for broad groups of researchers. Especially in parasites, which offer great potential for studying subcellular dynamics, the possibilities have only begun to be probed. In all cases, the complete description of dynamic molecular movement in 3D space remains a challenging necessity.

Enabling Hours-Long Drift Correction with Nanometer Resolution in Optical Microscopy through Reflection Interferometry of Fiducial Beads

Optical microscopy excels at revealing the dynamics of biological systems in real time. However, focal drift limits most microscopy approaches to only several minutes in the absence of drift-mitigation strategies. Here we introduce focus readjustment for enhanced vertical resolution (FREVR), a method which uses micrometer-sized fiducial beads alongside the specimen. By tracking the interference fringes generated by these beads, FREVR can detect changes in focus position with nanometer precision. We showcase this approach on a microscope equipped with a high-speed CMOS camera used for bead tracking and a highly sensitive EMCCD camera tasked to quantify fluorescence with spectral resolution. Using this approach, we measured samples in focus for several hours on several single-molecule systems, as well as on mammalian cells having their actin filaments or membrane proteins fluorescently labeled. FREVR has the potential to dramatically increase the temporal and spatial resolution and the long-term stability of microscopy techniques.

3D Single-Molecule Super-Resolution Imaging of Microfabricated Multiscale Fractal Substrates for Calibration and Cell Imaging

Microstructures arrayed over a substrate have shown increasing interest due to their ability to provide advanced 3D cellular models, which open up new possibilities for cell culture, proliferation, and differentiation. Still, the mechanisms by which physical cues impact the cell phenotype are not fully understood, hence the necessity to interrogate cell behavior at the highest resolution. However, cell 3D high-resolution optical imaging on such microstructured substrates remains challenging due to their complexity as well as axial calibration issues. In this work, we address this issue by leveraging the geometrical characteristics of fractal-like structures, which serve as axial calibration tools and modulate cell growth. To this end, we use multiscale 3D SiO2 substrates consisting of spatially arrayed octahedral features of a few micrometers to hundreds of nanometers. Through optimizations of both the structures and optical imaging conditions, we demonstrate the potential of these 3D multiscale structures as an alternative to electron microscopy for material imaging but also as calibration tools for 3D super-resolution microscopy. We used their multiscale and known geometry to perform lateral and axial calibrations in 3D single-molecule localization microscopy (SMLM) and assess imaging resolutions. We then utilized these substrates as a platform for high-resolution bioimaging. As a proof of concept, we cultivate human mesenchymal stem cells on these substrates, revealing very different growth patterns compared to flat glass. Specifically, the spatial distribution of cytoskeleton proteins is vastly modified, as we demonstrate with a 3D SMLM assessment.

Neural network-assisted localization of clustered point spread functions in single-molecule localization microscopy

Single-molecule localization microscopy (SMLM), which has revolutionized nanoscale imaging, faces challenges in densely labelled samples due to fluorophore clustering, leading to compromised localization accuracy. In this paper, we propose a novel convolutional neural network (CNN)-assisted approach to address the issue of locating the clustered fluorophores. Our CNN is trained on a diverse data set of simulated SMLM images where it learns to predict point spread function (PSF) locations by generating Gaussian blobs as output. Through rigorous evaluation, we demonstrate significant improvements in PSF localization accuracy, especially in densely labelled samples where traditional methods struggle. In addition, we employ blob detection as a post-processing technique to refine the predicted PSF locations and enhance localization precision. Our study underscores the efficacy of CNN in addressing clustering challenges in SMLM, thereby advancing spatial resolution and enabling deeper insights into complex biological structures.

Super-resolution microscopy as a drug discovery tool

At the turn of the century a fundamental resolution barrier in fluorescence microscopy known as the diffraction limit was broken, giving rise to the field of super-resolution microscopy. Subsequent nanoscopic investigation with visible light revolutionised our understanding of how previously unknown molecular features give rise to the emergent behaviour of cells. It transpires that the devil is in these fine molecular details, and essential nanoscale processes were found everywhere researchers chose to look. Now, after nearly two decades, super-resolution microscopy has begun to address previously unmet challenges in the study of human disease and is poised to become a pivotal tool in drug discovery.

Self-Driving Microscopes: AI Meets Super-Resolution Microscopy

The integration of Machine Learning (ML) with super-resolution microscopy represents a transformative advancement in biomedical research. Recent advances in ML, particularly deep learning (DL), have significantly enhanced image processing tasks, such as denoising and reconstruction. This review explores the growing potential of automation in super-resolution microscopy, focusing on how DL can enable autonomous imaging tasks. Overcoming the challenges of automation, particularly in adapting to dynamic biological processes and minimizing manual intervention, is crucial for the future of microscopy. Whilst still in its infancy, automation in super-resolution can revolutionize drug discovery and disease phenotyping leading to similar breakthroughs as have been recognized in this year's Nobel Prizes for Physics and Chemistry.

Decoding the molecular interplay of CD20 and therapeutic antibodies with fast volumetric nanoscopy

Elucidating the interaction between membrane proteins and antibodies requires whole-cell imaging at high spatiotemporal resolution. Lattice light-sheet (LLS) microscopy offers fast volumetric imaging but suffers from limited spatial resolution. DNA-based point accumulation for imaging in nanoscale topography (DNA-PAINT) achieves molecular resolution but is restricted to two-dimensional imaging owing to long acquisition times. We have developed two-dye imager (TDI) probes that enable ~15-fold faster imaging. Combining TDI-DNA-PAINT and LLS microscopy on immunological B cells revealed the oligomeric states and interaction of endogenous CD20 with the therapeutic monoclonal antibodies (mAbs) rituximab, ofatumumab, and obinutuzumab. Our results demonstrate that CD20 is abundantly expressed on microvilli that bind mAbs, which leads to an antibody concentration-dependent B cell polarization and stabilization of microvilli protrusions. These findings could aid rational design of improved immunotherapies targeting tumor-associated antigens.

A high-throughput platform for single-molecule tracking identifies drug interaction and cellular mechanisms

The regulation of cell physiology depends largely upon interactions of functionally distinct proteins and cellular components. These interactions may be transient or long-lived, but often affect protein motion. Measurement of protein dynamics within a cellular environment, particularly while perturbing protein function with small molecules, may enable dissection of key interactions and facilitate drug discovery; however, current approaches are limited by throughput with respect to data acquisition and analysis. As a result, studies using super-resolution imaging are typically drawing conclusions from tens of cells and a few experimental conditions tested. We addressed these limitations by developing a high-throughput single-molecule tracking (htSMT) platform for pharmacologic dissection of protein dynamics in living cells at an unprecedented scale (capable of imaging >106 cells/day and screening >104 compounds). We applied htSMT to measure the cellular dynamics of fluorescently tagged estrogen receptor (ER) and screened a diverse library to identify small molecules that perturbed ER function in real time. With this one experimental modality, we determined the potency, pathway selectivity, target engagement, and mechanism of action for identified hits. Kinetic htSMT experiments were capable of distinguishing between on-target and on-pathway modulators of ER signaling. Integrated pathway analysis recapitulated the network of known ER interaction partners and suggested potentially novel, kinase-mediated regulatory mechanisms. The sensitivity of htSMT revealed a new correlation between ER dynamics and the ability of ER antagonists to suppress cancer cell growth. Therefore, measuring protein motion at scale is a powerful method to investigate dynamic interactions among proteins and may facilitate the identification and characterization of novel therapeutics.

Live-Cell Single-Molecule Imaging of Influenza A Virus-Receptor Interaction

Influenza A viruses are a major health care burden, and their biology has been intensely studied for decades. However, many details of virus infection are still elusive, requiring the development of refined and advanced technologies. Super-resolution microscopy allows the study of virus replication at the scale of an infecting virus, offering an exciting perspective on previously unseen mechanistic details of infection. Here we describe the materials and procedures required to perform single-molecule imaging of virus-receptor interaction in live cells. We further provide hints and tips on how to analyze and visualize the obtained datasets.

Single-molecule orientation-localization microscopy: Applications and approaches

Single-molecule orientation-localization microscopy (SMOLM) builds upon super-resolved localization microscopy by imaging orientations and rotational dynamics of individual molecules in addition to their positions. This added dimensionality provides unparalleled insights into nanoscale biophysical and biochemical processes, including the organization of actin networks, movement of molecular motors, conformations of DNA strands, growth and remodeling of amyloid aggregates, and composition changes within lipid membranes. In this review, we discuss recent innovations in SMOLM and cover three key aspects: (1) biophysical insights enabled by labeling strategies that endow fluorescent probes to bind to targets with orientation specificity; (2) advanced imaging techniques that leverage the physics of light-matter interactions and estimation theory to encode orientation information with high fidelity into microscope images; and (3) computational methods that ensure accurate and precise data analysis and interpretation, even in the presence of severe shot noise. Additionally, we compare labeling approaches, imaging hardware, and publicly available analysis software to aid the community in choosing the best SMOLM implementation for their specific biophysical application. Finally, we highlight future directions for SMOLM, such as the development of probes with improved photostability and specificity, the design of “smart” adaptive hardware, and the use of advanced computational approaches to handle large, complex datasets. This review underscores the significant current and potential impact of SMOLM in deepening our understanding of molecular dynamics, paving the way for future breakthroughs in the fields of biophysics, biochemistry, and materials science.

ThirdPeak is a flexible tool designed for the robust analysis of two- and three-dimensional tracking data

Biological processes, though often imaged and visualized in two dimensions, inherently occur in at least three-dimensional space. As time-resolved volumetric imaging becomes increasingly accessible, there emerges a necessity for tools that empower non-specialists to process and interpret intricate datasets. We introduce ThirdPeak, an open-source tool tailored for the comprehensive analysis of two- and three-dimensional track data across various scales. Its versatile import and export options ensure seamless integration into established workflows, while the intuitive user interface allows for swift visualization and analysis of the data. When applied to live-cell diffusion data, this software demonstrates the benefits of integrating both 2D and 3D analysis, yielding valuable insights into the understanding of biological processes.

Neural space-time model for dynamic multi-shot imaging

Computational imaging reconstructions from multiple measurements that are captured sequentially often suffer from motion artifacts if the scene is dynamic. We propose a neural space-time model (NSTM) that jointly estimates the scene and its motion dynamics, without data priors or pre-training. Hence, we can both remove motion artifacts and resolve sample dynamics from the same set of raw measurements used for the conventional reconstruction. We demonstrate NSTM in three computational imaging systems: differential phase-contrast microscopy, three-dimensional structured illumination microscopy and rolling-shutter DiffuserCam. We show that NSTM can recover subcellular motion dynamics and thus reduce the misinterpretation of living systems caused by motion artifacts.

Deep Learning in Ultrasound Localization Microscopy: Applications and Perspectives

Ultrasound localization microscopy (ULM) is a novel super-resolution imaging technique that can image the vasculature in vivo at depth with resolution far beyond the conventional limit of diffraction. By relying on the localization and tracking of clinically approved microbubbles injected in the blood stream, ULM can provide not only anatomical visualization but also hemodynamic quantification of the microvasculature. Several deep learning approaches have been proposed to address challenges in ULM including denoising, improving microbubble localization, estimating blood flow velocity, or performing aberration correction. Proposed deep learning methods often outperform their conventional counterparts by improving image quality and reducing processing time. In addition, their robustness to high concentrations of microbubbles can lead to reduced acquisition times in ULM, addressing a major hindrance to ULM clinical application. Herein, we propose a comprehensive review of the diversity of deep learning applications in ULM focusing on approaches assuming a sparse microbubble distribution. We first provide an overview of how existing studies vary in the constitution of their datasets or in the tasks targeted by the deep learning model. We also take a deeper look into the numerous approaches that have been proposed to improve the localization of microbubbles since they differ highly in their formulation of the optimization problem, their evaluation, or their network architectures. We finally discuss the current limitations and challenges of these methods, as well as the promises and potential of deep learning for ULM in the future.

Computational Methods for Image Analysis in Craniofacial Development and Disease

Observation is at the center of all biological sciences. Advances in imaging technologies are therefore essential to derive novel biological insights to better understand the complex workings of living systems. Recent high-throughput sequencing and imaging techniques are allowing researchers to simultaneously address complex molecular variations spatially and temporarily in tissues and organs. The availability of increasingly large dataset sizes has allowed for the evolution of robust deep learning models, designed to interrogate biomedical imaging data. These models are emerging as transformative tools in diagnostic medicine. Combined, these advances allow for dynamic, quantitative, and predictive observations of entire organisms and tissues. Here, we address 3 main tasks of bioimage analysis, image restoration, segmentation, and tracking and discuss new computational tools allowing for 3-dimensional spatial genomics maps. Finally, we demonstrate how these advances have been applied in studies of craniofacial development and oral disease pathogenesis.

Annotation and automated segmentation of single-molecule localisation microscopy data

Single Molecule Localisation Microscopy (SMLM) is becoming a widely used technique in cell biology. After processing the images, the molecular localisations are typically stored in a table as xy (or xyz) coordinates, with additional information, such as number of photons, etc. This set of coordinates can be used to generate an image to visualise the molecular distribution, for example, a 2D or 3D histogram of localisations. Many different methods have been devised to analyse SMLM data, among which cluster analysis of the localisations is popular. However, it can be useful to first segment the data, to extract the localisations in a specific region of a cell or in individual cells, prior to downstream analysis. Here we describe a pipeline for annotating localisations in an SMLM dataset in which we compared membrane segmentation approaches, including Otsu thresholding and machine learning models, and subsequent cell segmentation. We used an SMLM dataset derived from dSTORM images of sectioned cell pellets, stained for the membrane proteins EGFR (epidermal growth factor receptor) and EREG (epiregulin) as a test dataset. We found that a Cellpose model retrained on our data performed the best in the membrane segmentation task, allowing us to perform downstream cluster analysis of membrane versus cell interior localisations. We anticipate this will be generally useful for SMLM analysis.

Deep learning-assisted single-atom detection of copper ions by combining click chemistry and fast scan voltammetry

Cell ion channels, cell proliferation and metastasis, and many other life activities are inseparable from the regulation of trace or even single copper ion (Cu+ and/or Cu2+). In this work, an electrochemical sensor for sensitive quantitative detection of 0.4-4 amol L-1 copper ions is developed by adopting: (1) copper ions catalyzing the click-chemistry reaction to capture numerous signal units; (2) special adsorption assembly method of signal units to ensure signal generation efficiency; and (3) fast scan voltammetry at 400 V s-1 to enhance signal intensity. And then, the single-atom detection of copper ions is realized by constructing a multi-layer deep convolutional neural network model FSVNet to extract hidden features and signal information of fast scan voltammograms for 0.2 amol L-1 of copper ions. Here, we show a multiple signal amplification strategy based on functionalized nanomaterials and fast scan voltammetry, together with a deep learning method, which realizes the sensitive detection and even single-atom detection of copper ions.

Whole-cell multi-target single-molecule super-resolution imaging in 3D with microfluidics and a single-objective tilted light sheet

Multi-target single-molecule super-resolution fluorescence microscopy offers a powerful means of understanding the distributions and interplay between multiple subcellular structures at the nanoscale. However, single-molecule super-resolution imaging of whole mammalian cells is often hampered by high fluorescence background and slow acquisition speeds, especially when imaging multiple targets in 3D. In this work, we have mitigated these issues by developing a steerable, dithered, single-objective tilted light sheet for optical sectioning to reduce fluorescence background and a pipeline for 3D nanoprinting microfluidic systems for reflection of the light sheet into the sample. This easily adaptable microfluidic fabrication pipeline allows for the incorporation of reflective optics into microfluidic channels without disrupting efficient and automated solution exchange. We combine these innovations with point spread function engineering for nanoscale localization of individual molecules in 3D, deep learning for analysis of overlapping emitters, active 3D stabilization for drift correction and long-term imaging, and Exchange-PAINT for sequential multi-target imaging without chromatic offsets. We then demonstrate that this platform, termed soTILT3D, enables whole-cell multi-target 3D single-molecule super-resolution imaging with improved precision and imaging speed.

Light sheet illumination in single-molecule localization microscopy for imaging of cellular architectures and molecular dynamics

Single-molecule localization microscopy has revealed cellular architectures and molecular dynamics beyond the diffraction limit of light. However, imaging thick samples presents challenges from increased fluorescence background. Light sheet illumination, which utilizes a plane of light for optical sectioning, is effective in reducing fluorescence background, photobleaching, and photodamage. Here, we present the principles of single-molecule localization microscopy and light sheet illumination, followed by an introduction to light sheet microscopy geometries and their imaging applications. Finally, we discuss light sheet illumination approaches for high- and super-resolution imaging of biological structures and dynamics.

Long-Axial-Range Double-Helix Point Spread Functions for 3D Volumetric Super-Resolution Imaging

Single-molecule localization microscopy (SMLM) is a powerful tool for observing structures beyond the diffraction limit of light. Combining SMLM with engineered point spread functions (PSFs) enables 3D imaging over an extended axial range, as has been demonstrated for super-resolution imaging of various cellular structures. However, super-resolving structures in 3D in thick samples, such as whole mammalian cells, remains challenging as it typically requires acquisition and postprocessing stitching of multiple slices to cover the entire sample volume or more complex analysis of the data. Here, we demonstrate how the imaging and analysis workflows can be simplified by 3D single-molecule super-resolution imaging with long-axial-range double-helix (DH)-PSFs. First, we experimentally benchmark the localization precisions of short- and long-axial-range DH-PSFs at different signal-to-background ratios by imaging fluorescent beads. The performance of the DH-PSFs in terms of achievable resolution and imaging speed was then quantified for 3D single-molecule super-resolution imaging of mammalian cells by DNA-PAINT imaging of nuclear lamina protein lamin B1 in U-2 OS cells. Furthermore, we demonstrate how the use of a deep-learning-based algorithm allows the localization of dense emitters, drastically improving the achievable imaging speed and resolution. Our data demonstrate that using long-axial-range DH-PSFs offers stitching-free, 3D super-resolution imaging of whole mammalian cells, simplifying the experimental and analysis procedures for obtaining volumetric nanoscale structural information.

Three-dimensional localization and tracking of chromosomal loci throughout the Escherichia coli cell cycle

The intracellular position of genes may impact their expression, but it has not been possible to accurately measure the 3D position of chromosomal loci. In 2D, loci can be tracked using arrays of DNA-binding sites for transcription factors (TFs) fused with fluorescent proteins. However, the same 2D data can result from different 3D trajectories. Here, we have developed a deep learning method for super-resolved astigmatism-based 3D localization of chromosomal loci in live E. coli cells which enables a precision better than 61 nm at a signal-to-background ratio of ~4 on a heterogeneous cell background. Determining the spatial localization of chromosomal loci, we find that some loci are at the periphery of the nucleoid for large parts of the cell cycle. Analyses of individual trajectories reveal that these loci are subdiffusive both longitudinally (x) and radially (r), but that individual loci explore the full radial width on a minute time scale.

Visualizing DNA/RNA, Proteins, and Small Molecule Metabolites within Live Cells

Live cell imaging is essential for obtaining spatial and temporal insights into dynamic molecular events within heterogeneous individual cells, in situ intracellular networks, and in vivo organisms. Molecular tracking in live cells is also a critical and general requirement for studying dynamic physiological processes in cell biology, cancer, developmental biology, and neuroscience. Alongside this context, this review provides a comprehensive overview of recent research progress in live-cell imaging of RNAs, DNAs, proteins, and small-molecule metabolites, as well as their applications in molecular diagnosis, immunodiagnosis, and biochemical diagnosis. A series of advanced live-cell imaging techniques have been introduced and summarized, including high-precision live-cell imaging, high-resolution imaging, low-abundance imaging, multidimensional imaging, multipath imaging, rapid imaging, and computationally driven live-cell imaging methods, all of which offer valuable insights for disease prevention, diagnosis, and treatment. This review article also addresses the current challenges, potential solutions, and future development prospects in this field.

Surpassing the Diffraction Limit in Label-Free Optical Microscopy

Super-resolution optical microscopy has enhanced our ability to visualize biological structures on the nanoscale. Fluorescence-based techniques are today irreplaceable in exploring the structure and dynamics of biological matter with high specificity and resolution. However, the fluorescence labeling concept narrows the range of observed interactions and fundamentally limits the spatiotemporal resolution. In contrast, emerging label-free imaging methods are not inherently limited by speed and have the potential to capture the entirety of complex biological processes and dynamics. While pushing a complex unlabeled microscopy image beyond the diffraction limit to single-molecule resolution and capturing dynamic processes at biomolecular time scales is widely regarded as unachievable, recent experimental strides suggest that elements of this vision might be already in place. These techniques derive signals directly from the sample using inherent optical phenomena, such as elastic and inelastic scattering, thereby enabling the measurement of additional properties, such as molecular mass, orientation, or chemical composition. This perspective aims to identify the cornerstones of future label-free super-resolution imaging techniques, discuss their practical applications and theoretical challenges, and explore directions that promise to enhance our understanding of complex biological systems through innovative optical advancements. Drawing on both traditional and emerging techniques, label-free super-resolution microscopy is evolving to offer detailed and dynamic imaging of living cells, surpassing the capabilities of conventional methods for visualizing biological complexities without the use of labels.

Machine learning in microscopy - insights, opportunities and challenges

Machine learning (ML) is transforming the field of image processing and analysis, from automation of laborious tasks to open-ended exploration of visual patterns. This has striking implications for image-driven life science research, particularly microscopy. In this Review, we focus on the opportunities and challenges associated with applying ML-based pipelines for microscopy datasets from a user point of view. We investigate the significance of different data characteristics - quantity, transferability and content - and how this determines which ML model(s) to use, as well as their output(s). Within the context of cell biological questions and applications, we further discuss ML utility range, namely data curation, exploration, prediction and explanation, and what they entail and translate to in the context of microscopy. Finally, we explore the challenges, common artefacts and risks associated with ML in microscopy. Building on insights from other fields, we propose how these pitfalls might be mitigated for in microscopy.

Photonic lantern TIRF microscopy for highly efficient, uniform, artifact-free imaging

We report a method for generating uniform, artifact-free total internal reflection fluorescence (TIRF) excitation via a photonic lantern. Our tapered waveguide, consisting of a multimode input and nine few-mode outputs, enables single-shot TIRF illumination from nine azimuthal directions simultaneously without the introduction of nonstationary devices. Utilizing the photonic lantern for multi-beam excitation provides a low-loss mechanism that supports a wide range of light sources, including high-coherence lasers and various wavelengths in the visible spectrum. Our excitation system also allows tuning of the TIRF penetration depth. The high-quality excitation produced by photonic lantern TIRF (PL-TIRF) enables unbiased imaging across the entire illumination field-of-view. The simplicity and robustness of our technique provides advantages over other TIRF approaches, which often have complicated setups with scanning devices or other impracticalities. In this paper we discuss the lantern design process, characterize its performance, and demonstrate flat-field super-resolution imaging and shadowless live-cell imaging using PL-TIRF.

Whole-cell multi-target single-molecule super-resolution imaging in 3D with microfluidics and a single-objective tilted light sheet

Multi-target single-molecule super-resolution fluorescence microscopy offers a powerful means of understanding the distributions and interplay between multiple subcellular structures at the nanoscale. However, single-molecule super-resolution imaging of whole mammalian cells is often hampered by high fluorescence background and slow acquisition speeds, especially when imaging multiple targets in 3D. In this work, we have mitigated these issues by developing a steerable, dithered, single-objective tilted light sheet for optical sectioning to reduce fluorescence background and a pipeline for 3D nanoprinting microfluidic systems for reflection of the light sheet into the sample. This easily adaptable novel microfluidic fabrication pipeline allows for the incorporation of reflective optics into microfluidic channels without disrupting efficient and automated solution exchange. By combining these innovations with point spread function engineering for nanoscale localization of individual molecules in 3D, deep learning for analysis of overlapping emitters, active 3D stabilization for drift correction and long-term imaging, and Exchange-PAINT for sequential multi-target imaging without chromatic offsets, we demonstrate whole-cell multi-target 3D single-molecule super-resolution imaging with improved precision and imaging speed.

The actin-spectrin submembrane scaffold restricts endocytosis along proximal axons

Clathrin-mediated endocytosis has characteristic features in neuronal dendrites and presynapses, but how membrane proteins are internalized along the axon shaft remains unclear. We focused on clathrin-coated structures and endocytosis along the axon initial segment (AIS) and their relationship to the periodic actin-spectrin scaffold that lines the axonal plasma membrane. A combination of super-resolution microscopy and platinum-replica electron microscopy on cultured neurons revealed that AIS clathrin-coated pits form within "clearings", circular areas devoid of actin-spectrin mesh. Actin-spectrin scaffold disorganization increased clathrin-coated pit formation. Cargo uptake and live-cell imaging showed that AIS clathrin-coated pits are particularly stable. Neuronal plasticity-inducing stimulation triggered internalization of the clathrin-coated pits through polymerization of branched actin around them. Thus, spectrin and actin regulate clathrin-coated pit formation and scission to control endocytosis at the AIS.

Long axial-range double-helix point spread functions for 3D volumetric super-resolution imaging

Single-molecule localization microscopy (SMLM) is a powerful tool for observing structures beyond the diffraction limit of light. Combining SMLM with engineered point spread functions (PSFs) enables 3D imaging over an extended axial range, as has been demonstrated for super-resolution imaging of various cellular structures. However, super-resolving structures in 3D in thick samples, such as whole mammalian cells, remains challenging as it typically requires acquisition and post-processing stitching of multiple slices to cover the entire sample volume or more complex analysis of the data. Here, we demonstrate how the imaging and analysis workflows can be simplified by 3D single-molecule super-resolution imaging with long axial-range double-helix (DH)-PSFs. First, we experimentally benchmark the localization precisions of short- and long axial-range DH-PSFs at different signal-to-background ratios by imaging of fluorescent beads. The performance of the DH-PSFs in terms of achievable resolution and imaging speed was then quantified for 3D single-molecule super-resolution imaging of mammalian cells by DNA-PAINT imaging of the nuclear lamina protein lamin B1 in U-2 OS cells. Furthermore, we demonstrate how the use of a deep learning-based algorithm allows the localization of dense emitters, drastically improving the achievable imaging speed and resolution. Our data demonstrate that using long axial-range DH-PSFs offers stitching-free, 3D super-resolution imaging of whole mammalian cells, simplifying the experimental and analysis procedures for obtaining volumetric nanoscale structural information.

Highly sensitive volumetric single-molecule imaging

Volumetric subcellular imaging has long been essential for studying structures and dynamics in cells and tissues. However, due to limited imaging speed and depth of field, it has been challenging to perform live-cell imaging and single-particle tracking. Here we report a 2.5D fluorescence microscopy combined with highly inclined illumination beams, which significantly reduce not only the image acquisition time but also the out-of-focus background by ∼2-fold compared to epi-illumination. Instead of sequential z-scanning, our method projects a certain depth of volumetric information onto a 2D plane in a single shot using multi-layered glass for incoherent wavefront splitting, enabling high photon detection efficiency. We apply our method to multi-color immunofluorescence imaging and volumetric super-resolution imaging, covering ∼3-4 µm thickness of samples without z-scanning. Additionally, we demonstrate that our approach can substantially extend the observation time of single-particle tracking in living cells.

Digital-SMLM for precisely localizing emitters within the diffraction limit

Precisely pinpointing the positions of emitters within the diffraction limit is crucial for quantitative analysis or molecular mechanism investigation in biomedical research but has remained challenging unless exploiting single molecule localization microscopy (SMLM). Via integrating experimental spot dataset with deep learning, we develop a new approach, Digital-SMLM, to accurately predict emitter numbers and positions for sub-diffraction-limit spots with an accuracy of up to 98 % and a root mean square error as low as 14 nm. Digital-SMLM can accurately resolve two emitters at a close distance, e.g. 30 nm. Digital-SMLM outperforms Deep-STORM in predicting emitter numbers and positions for sub-diffraction-limited spots and recovering the ground truth distribution of molecules of interest. We have validated the generalization capability of Digital-SMLM using independent experimental data. Furthermore, Digital-SMLM complements SMLM by providing more accurate event number and precise emitter positions, enabling SMLM to closely approximate the natural state of high-density cellular structures.

Improving correlation based super-resolution microscopy images through image fusion by self-supervised deep learning

Super-resolution imaging is a powerful tool in modern biological research, allowing for the optical observation of subcellular structures with great detail. In this paper, we present a deep learning approach for image fusion of intensity and super-resolution optical fluctuation imaging (SOFI) microscopy images. We construct a network that can successfully combine the advantages of these two imaging methods, producing a fused image with a resolution comparable to that of SOFI and an SNR comparable to that of the intensity image. We also demonstrate the effectiveness of our approach experimentally, specifically on cell samples where microtubules were stained with ATTO647N and imaged using a confocal microscope with a single photon fiber bundle camera, allowing for the simultaneous acquisition of an image scanning microscopy (ISM) image and a SOFISM (ISM and SOFI) image. Our network is designed as a self-supervised network and shows the ability to train on a single pair of images and to generalize to other image pairs without the need for additional training. Our approach offers a flexible and efficient way to combine the strengths of correlation based imaging techniques along with traditional intensity based microscopy, and can be readily applied to other fluctuation based imaging modalities.

Deep 3D histology powered by tissue clearing, omics and AI

To comprehensively understand tissue and organism physiology and pathophysiology, it is essential to create complete three-dimensional (3D) cellular maps. These maps require structural data, such as the 3D configuration and positioning of tissues and cells, and molecular data on the constitution of each cell, spanning from the DNA sequence to protein expression. While single-cell transcriptomics is illuminating the cellular and molecular diversity across species and tissues, the 3D spatial context of these molecular data is often overlooked. Here, I discuss emerging 3D tissue histology techniques that add the missing third spatial dimension to biomedical research. Through innovations in tissue-clearing chemistry, labeling and volumetric imaging that enhance 3D reconstructions and their synergy with molecular techniques, these technologies will provide detailed blueprints of entire organs or organisms at the cellular level. Machine learning, especially deep learning, will be essential for extracting meaningful insights from the vast data. Further development of integrated structural, molecular and computational methods will unlock the full potential of next-generation 3D histology.

Inspiring a convergent engineering approach to measure and model the tissue microenvironment

Understanding the molecular and physical complexity of the tissue microenvironment (TiME) in the context of its spatiotemporal organization has remained an enduring challenge. Recent advances in engineering and data science are now promising the ability to study the structure, functions, and dynamics of the TiME in unprecedented detail; however, many advances still occur in silos that rarely integrate information to study the TiME in its full detail. This review provides an integrative overview of the engineering principles underlying chemical, optical, electrical, mechanical, and computational science to probe, sense, model, and fabricate the TiME. In individual sections, we first summarize the underlying principles, capabilities, and scope of emerging technologies, the breakthrough discoveries enabled by each technology and recent, promising innovations. We provide perspectives on the potential of these advances in answering critical questions about the TiME and its role in various disease and developmental processes. Finally, we present an integrative view that appreciates the major scientific and educational aspects in the study of the TiME.

Nanoscale insights into hematology: super-resolved imaging on blood cell structure, function, and pathology

Fluorescence nanoscopy, also known as super-resolution microscopy, has transcended the conventional resolution barriers and enabled visualization of biological samples at nanometric resolutions. A series of super-resolution techniques have been developed and applied to investigate the molecular distribution, organization, and interactions in blood cells, as well as the underlying mechanisms of blood-cell-associated diseases. In this review, we provide an overview of various fluorescence nanoscopy technologies, outlining their current development stage and the challenges they are facing in terms of functionality and practicality. We specifically explore how these innovations have propelled forward the analysis of thrombocytes (platelets), erythrocytes (red blood cells) and leukocytes (white blood cells), shedding light on the nanoscale arrangement of subcellular components and molecular interactions. We spotlight novel biomarkers uncovered by fluorescence nanoscopy for disease diagnosis, such as thrombocytopathies, malignancies, and infectious diseases. Furthermore, we discuss the technological hurdles and chart out prospective avenues for future research directions. This review aims to underscore the significant contributions of fluorescence nanoscopy to the field of blood cell analysis and disease diagnosis, poised to revolutionize our approach to exploring, understanding, and managing disease at the molecular level.

Advanced Design of Soft Robots with Artificial Intelligence

A comprehensive review focused on the whole systems of the soft robotics with artificial intelligence, which can feel, think, react and interact with humans, is presented. The design strategies concerning about various aspects of the soft robotics, like component materials, device structures, prepared technologies, integrated method, and potential applications, are summarized. A broad outlook on the future considerations for the soft robots is proposed.

In recent years, breakthrough has been made in the field of artificial intelligence (AI), which has also revolutionized the industry of robotics. Soft robots featured with high-level safety, less weight, lower power consumption have always been one of the research hotspots. Recently, multifunctional sensors for perception of soft robotics have been rapidly developed, while more algorithms and models of machine learning with high accuracy have been optimized and proposed. Designs of soft robots with AI have also been advanced ranging from multimodal sensing, human–machine interaction to effective actuation in robotic systems. Nonetheless, comprehensive reviews concerning the new developments and strategies for the ingenious design of the soft robotic systems equipped with AI are rare. Here, the new development is systematically reviewed in the field of soft robots with AI. First, background and mechanisms of soft robotic systems are briefed, after which development focused on how to endow the soft robots with AI, including the aspects of feeling, thought and reaction, is illustrated. Next, applications of soft robots with AI are systematically summarized and discussed together with advanced strategies proposed for performance enhancement. Design thoughts for future intelligent soft robotics are pointed out. Finally, some perspectives are put forward.

Super-resolution microscopies, technological breakthrough to decipher mitochondrial structure and dynamic

Mitochondria are complex organelles with an outer membrane enveloping a second inner membrane that creates a vast matrix space partitioned by pockets or cristae that join the peripheral inner membrane with several thin junctions. Several micrometres long, mitochondria are generally close to 300 nm in diameter, with membrane layers separated by a few tens of nanometres. Ultrastructural data from electron microscopy revealed the structure of these mitochondria, while conventional optical microscopy revealed their extraordinary dynamics through fusion, fission, and migration processes but its limited resolution power restricted the possibility to go further. By overcoming the limits of light diffraction, Super-Resolution Microscopy (SRM) now offers the potential to establish the links between the ultrastructure and remodelling of mitochondrial membranes, leading to major advances in our understanding of mitochondria's structure-function. Here we review the contributions of SRM imaging to our understanding of the relationship between mitochondrial structure and function. What are the hopes for these new imaging approaches which are particularly important for mitochondrial pathologies?

Universal inverse modeling of point spread functions for SMLM localization and microscope characterization

The point spread function (PSF) of a microscope describes the image of a point emitter. Knowing the accurate PSF model is essential for various imaging tasks, including single-molecule localization, aberration correction and deconvolution. Here we present universal inverse modeling of point spread functions (uiPSF), a toolbox to infer accurate PSF models from microscopy data, using either image stacks of fluorescent beads or directly images of blinking fluorophores, the raw data in single-molecule localization microscopy (SMLM). Our modular framework is applicable to a variety of microscope modalities and the PSF model incorporates system- or sample-specific characteristics, for example, the bead size, field- and depth- dependent aberrations, and transformations among channels. We demonstrate its application in single or multiple channels or large field-of-view SMLM systems, 4Pi-SMLM, and lattice light-sheet microscopes using either bead data or single-molecule blinking data.

Live-cell imaging powered by computation

The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preserving cell viability. Computational methods can help to address this challenge and are now shifting the boundaries of what is possible to capture in living systems. In this Review, we discuss these computational methods focusing on artificial intelligence-based approaches that can be layered on top of commonly used existing microscopies as well as hybrid methods that integrate computation and microscope hardware. We specifically discuss how computational approaches can improve the signal-to-noise ratio, spatial resolution, temporal resolution and multi-colour capacity of live-cell imaging.

Temporal analysis of relative distances (TARDIS) is a robust, parameter-free alternative to single-particle tracking

In single-particle tracking, individual particles are localized and tracked over time to probe their diffusion and molecular interactions. Temporal crossing of trajectories, blinking particles, and false-positive localizations present computational challenges that have remained difficult to overcome. Here we introduce a robust, parameter-free alternative to single-particle tracking: temporal analysis of relative distances (TARDIS). In TARDIS, an all-to-all distance analysis between localizations is performed with increasing temporal shifts. These pairwise distances represent either intraparticle distances originating from the same particle, or interparticle distances originating from unrelated particles, and are fitted analytically to obtain quantitative measures on particle dynamics. We showcase that TARDIS outperforms tracking algorithms, benchmarked on simulated and experimental data of varying complexity. We further show that TARDIS performs accurately in complex conditions characterized by high particle density, strong emitter blinking or false-positive localizations, and is in fact limited by the capabilities of localization algorithms. TARDIS' robustness enables fivefold shorter measurements without loss of information.

Deep learning-based spectroscopic single-molecule localization microscopy

Significance

Spectroscopic single-molecule localization microscopy (sSMLM) takes advantage of nanoscopy and spectroscopy, enabling sub-10 nm resolution as well as simultaneous multicolor imaging of multi-labeled samples. Reconstruction of raw sSMLM data using deep learning is a promising approach for visualizing the subcellular structures at the nanoscale.

Aim

Develop a novel computational approach leveraging deep learning to reconstruct both label-free and fluorescence-labeled sSMLM imaging data.

Approach

We developed a two-network-model based deep learning algorithm, termed DsSMLM, to reconstruct sSMLM data. The effectiveness of DsSMLM was assessed by conducting imaging experiments on diverse samples, including label-free single-stranded DNA (ssDNA) fiber, fluorescence-labeled histone markers on COS-7 and U2OS cells, and simultaneous multicolor imaging of synthetic DNA origami nanoruler.

Results

For label-free imaging, a spatial resolution of 6.22 nm was achieved on ssDNA fiber; for fluorescence-labeled imaging, DsSMLM revealed the distribution of chromatin-rich and chromatin-poor regions defined by histone markers on the cell nucleus and also offered simultaneous multicolor imaging of nanoruler samples, distinguishing two dyes labeled in three emitting points with a separation distance of 40 nm. With DsSMLM, we observed enhanced spectral profiles with 8.8% higher localization detection for single-color imaging and up to 5.05% higher localization detection for simultaneous two-color imaging.

Conclusions

We demonstrate the feasibility of deep learning-based reconstruction for sSMLM imaging applicable to label-free and fluorescence-labeled sSMLM imaging data. We anticipate our technique will be a valuable tool for high-quality super-resolution imaging for a deeper understanding of DNA molecules' photophysics and will facilitate the investigation of multiple nanoscopic cellular structures and their interactions.

Photophysical image analysis: Unsupervised probabilistic thresholding for images from electron-multiplying charge-coupled devices

We introduce the concept photophysical image analysis (PIA) and an associated pipeline for unsupervised probabilistic image thresholding for images recorded by electron-multiplying charge-coupled device (EMCCD) cameras. We base our approach on a closed-form analytic expression for the characteristic function (Fourier-transform of the probability mass function) for the image counts recorded in an EMCCD camera, which takes into account both stochasticity in the arrival of photons at the imaging camera and subsequent noise induced by the detection system of the camera. The only assumption in our method is that the background photon arrival to the imaging system is described by a stationary Poisson process (we make no assumption about the photon statistics for the signal). We estimate the background photon statistics parameter, λbg, from an image which contains both background and signal pixels by use of a novel truncated fit procedure with an automatically determined image count threshold. Prior to this, the camera noise model parameters are estimated using a calibration step. Utilizing the estimates for the camera parameters and λbg, we then introduce a probabilistic thresholding method, where, for the first time, the fraction of misclassified pixels can be determined a priori for a general image in an unsupervised way. We use synthetic images to validate our a priori estimates and to benchmark against the Otsu method, which is a popular unsupervised non-probabilistic image thresholding method (no a priori estimates for the error rates are provided). For completeness, we lastly present a simple heuristic general-purpose segmentation method based on the thresholding results, which we apply to segmentation of synthetic images and experimental images of fluorescent beads and lung cell nuclei. Our publicly available software opens up for fully automated, unsupervised, probabilistic photophysical image analysis.

Context-aware deep learning enables high-efficacy localization of high concentration microbubbles for super-resolution ultrasound localization microscopy

Ultrasound localization microscopy (ULM) enables deep tissue microvascular imaging by localizing and tracking intravenously injected microbubbles circulating in the bloodstream. However, conventional localization techniques require spatially isolated microbubbles, resulting in prolonged imaging time to obtain detailed microvascular maps. Here, we introduce LOcalization with Context Awareness (LOCA)-ULM, a deep learning-based microbubble simulation and localization pipeline designed to enhance localization performance in high microbubble concentrations. In silico, LOCA-ULM enhanced microbubble detection accuracy to 97.8% and reduced the missing rate to 23.8%, outperforming conventional and deep learning-based localization methods up to 17.4% in accuracy and 37.6% in missing rate reduction. In in vivo rat brain imaging, LOCA-ULM revealed dense cerebrovascular networks and spatially adjacent microvessels undetected by conventional ULM. We further demonstrate the superior localization performance of LOCA-ULM in functional ULM (fULM) where LOCA-ULM significantly increased the functional imaging sensitivity of fULM to hemodynamic responses invoked by whisker stimulations in the rat brain.

Large-FOV 3D localization microscopy by spatially variant point spread function generation

Accurate characterization of the microscopic point spread function (PSF) is crucial for achieving high-performance localization microscopy (LM). Traditionally, LM assumes a spatially invariant PSF to simplify the modeling of the imaging system. However, for large fields of view (FOV) imaging, it becomes important to account for the spatially variant nature of the PSF. Here, we propose an accurate and fast principal components analysis-based field-dependent 3D PSF generator (PPG3D) and localizer for LM. Through simulations and experimental three-dimensional (3D) single-molecule localization microscopy (SMLM), we demonstrate the effectiveness of PPG3D, enabling super-resolution imaging of mitochondria and microtubules with high fidelity over a large FOV. A comparison of PPG3D with a shift-variant PSF generator for 3D LM reveals a threefold improvement in accuracy. Moreover, PPG3D is approximately 100 times faster than existing PSF generators, when used in image plane-based interpolation mode. Given its user-friendliness, we believe that PPG3D holds great potential for widespread application in SMLM and other imaging modalities.

High-density volumetric super-resolution microscopy

Volumetric super-resolution microscopy typically encodes the 3D position of single-molecule fluorescence into a 2D image by changing the shape of the point spread function (PSF) as a function of depth. However, the resulting large and complex PSF spatial footprints reduce biological throughput and applicability by requiring lower labeling densities to avoid overlapping fluorescent signals. We quantitatively compare the density dependence of single-molecule light field microscopy (SMLFM) to other 3D PSFs (astigmatism, double helix and tetrapod) showing that SMLFM enables an order-of-magnitude speed improvement compared to the double helix PSF by resolving overlapping emitters through parallax. We demonstrate this optical robustness experimentally with high accuracy ( > 99.2 ± 0.1%, 0.1 locs μm-2) and sensitivity ( > 86.6 ± 0.9%, 0.1 locs μm-2) through whole-cell (scan-free) imaging and tracking of single membrane proteins in live primary B cells. We also exemplify high-density volumetric imaging (0.15 locs μm-2) in dense cytosolic tubulin datasets.

HormoNet: a deep learning approach for hormone-drug interaction prediction

Several experimental evidences have shown that the human endogenous hormones can interact with drugs in many ways and affect drug efficacy. The hormone drug interactions (HDI) are essential for drug treatment and precision medicine; therefore, it is essential to understand the hormone-drug associations. Here, we present HormoNet to predict the HDI pairs and their risk level by integrating features derived from hormone and drug target proteins. To the best of our knowledge, this is one of the first attempts to employ deep learning approach for prediction of HDI prediction. Amino acid composition and pseudo amino acid composition were applied to represent target information using 30 physicochemical and conformational properties of the proteins. To handle the imbalance problem in the data, we applied synthetic minority over-sampling technique technique. Additionally, we constructed novel datasets for HDI prediction and the risk level of their interaction. HormoNet achieved high performance on our constructed hormone-drug benchmark datasets. The results provide insights into the understanding of the relationship between hormone and a drug, and indicate the potential benefit of reducing risk levels of interactions in designing more effective therapies for patients in drug treatments. Our benchmark datasets and the source codes for HormoNet are available in: https://github.com/EmamiNeda/HormoNet .

Harnessing artificial intelligence to reduce phototoxicity in live imaging

Fluorescence microscopy is essential for studying living cells, tissues and organisms. However, the fluorescent light that switches on fluorescent molecules also harms the samples, jeopardizing the validity of results - particularly in techniques such as super-resolution microscopy, which demands extended illumination. Artificial intelligence (AI)-enabled software capable of denoising, image restoration, temporal interpolation or cross-modal style transfer has great potential to rescue live imaging data and limit photodamage. Yet we believe the focus should be on maintaining light-induced damage at levels that preserve natural cell behaviour. In this Opinion piece, we argue that a shift in role for AIs is needed - AI should be used to extract rich insights from gentle imaging rather than recover compromised data from harsh illumination. Although AI can enhance imaging, our ultimate goal should be to uncover biological truths, not just retrieve data. It is essential to prioritize minimizing photodamage over merely pushing technical limits. Our approach is aimed towards gentle acquisition and observation of undisturbed living systems, aligning with the essence of live-cell fluorescence microscopy.

Image restoration of degraded time-lapse microscopy data mediated by near-infrared imaging

Time-lapse fluorescence microscopy is key to unraveling biological development and function; however, living systems, by their nature, permit only limited interrogation and contain untapped information that can only be captured by more invasive methods. Deep-tissue live imaging presents a particular challenge owing to the spectral range of live-cell imaging probes/fluorescent proteins, which offer only modest optical penetration into scattering tissues. Herein, we employ convolutional neural networks to augment live-imaging data with deep-tissue images taken on fixed samples. We demonstrate that convolutional neural networks may be used to restore deep-tissue contrast in GFP-based time-lapse imaging using paired final-state datasets acquired using near-infrared dyes, an approach termed InfraRed-mediated Image Restoration (IR2). Notably, the networks are remarkably robust over a wide range of developmental times. We employ IR2 to enhance the information content of green fluorescent protein time-lapse images of zebrafish and Drosophila embryo/larval development and demonstrate its quantitative potential in increasing the fidelity of cell tracking/lineaging in developing pescoids. Thus, IR2 is poised to extend live imaging to depths otherwise inaccessible.

Noise learning of instruments for high-contrast, high-resolution and fast hyperspectral microscopy and nanoscopy

The low scattering efficiency of Raman scattering makes it challenging to simultaneously achieve good signal-to-noise ratio (SNR), high imaging speed, and adequate spatial and spectral resolutions. Here, we report a noise learning (NL) approach that estimates the intrinsic noise distribution of each instrument by statistically learning the noise in the pixel-spatial frequency domain. The estimated noise is then removed from the noisy spectra. This enhances the SNR by ca. 10 folds, and suppresses the mean-square error by almost 150 folds. NL allows us to improve the positioning accuracy and spatial resolution and largely eliminates the impact of thermal drift on tip-enhanced Raman spectroscopic nanoimaging. NL is also applicable to enhance SNR in fluorescence and photoluminescence imaging. Our method manages the ground truth spectra and the instrumental noise simultaneously within the training dataset, which bypasses the tedious labelling of huge dataset required in conventional deep learning, potentially shifting deep learning from sample-dependent to instrument-dependent.

Super-Resolution Microscopy of the Bacterial Cell Wall Labeled by Fluorescent D-Amino Acids

Fluorescent D-amino acids (FDAAs) enable in situ visualization of bacterial cell wall synthesis via their incorporation into peptidoglycan (PG) crosslinks. When combined with super-resolution microscopy, FDAAs allow the details of cell wall synthesis to be resolved beyond the diffraction limit of visible light. Here, we describe using the super-resolution method of single-molecule localization microscopy (SMLM) in conjunction with two newly synthesized FDAAs (sCy5DA and sCy5DL_amide) to resolve bacterial PG at the nanoscale in a variety of species, including Gram-negative, Gram-positive, and mycobacteria.

Advanced optical imaging for the rational design of nanomedicines

Despite the enormous potential of nanomedicines to shape the future of medicine, their clinical translation remains suboptimal. Translational challenges are present in every step of the development pipeline, from a lack of understanding of patient heterogeneity to insufficient insights on nanoparticle properties and their impact on material-cell interactions. Here, we discuss how the adoption of advanced optical microscopy techniques, such as super-resolution optical microscopies, correlative techniques, and high-content modalities, could aid the rational design of nanocarriers, by characterizing the cell, the nanomaterial, and their interaction with unprecedented spatial and/or temporal detail. In this nanomedicine arena, we will discuss how the implementation of these techniques, with their versatility and specificity, can yield high volumes of multi-parametric data; and how machine learning can aid the rapid advances in microscopy: from image acquisition to data interpretation.

Multiplexed and Millimeter-Scale Fluorescence Nanoscopy of Cells and Tissue Sections via Prism-Illumination and Microfluidics-Enhanced DNA-PAINT

Fluorescence nanoscopy has become increasingly powerful for biomedical research, but it has historically afforded a small field-of-view (FOV) of around 50 μm × 50 μm at once and more recently up to ∼200 μm × 200 μm. Efforts to further increase the FOV in fluorescence nanoscopy have thus far relied on the use of fabricated waveguide substrates, adding cost and sample constraints to the applications. Here we report PRism-Illumination and Microfluidics-Enhanced DNA-PAINT (PRIME-PAINT) for multiplexed fluorescence nanoscopy across millimeter-scale FOVs. Built upon the well-established prism-type total internal reflection microscopy, PRIME-PAINT achieves robust single-molecule localization with up to ∼520 μm × 520 μm single FOVs and 25-40 nm lateral resolutions. Through stitching, nanoscopic imaging over mm2 sample areas can be completed in as little as 40 min per target. An on-stage microfluidics chamber facilitates probe exchange for multiplexing and enhances image quality, particularly for formalin-fixed paraffin-embedded (FFPE) tissue sections. We demonstrate the utility of PRIME-PAINT by analyzing ∼106 caveolae structures in ∼1,000 cells and imaging entire pancreatic cancer lesions from patient tissue biopsies. By imaging from nanometers to millimeters with multiplexity and broad sample compatibility, PRIME-PAINT will be useful for building multiscale, Google-Earth-like views of biological systems.