Improving spatial precision and field-of-view in wavelength-tagged single-particle tracking using spectroscopic single-molecule localization microscopy

Deep learning-based spectroscopic single-molecule localization microscopy

Significance

Spectroscopic single-molecule localization microscopy (sSMLM) takes advantage of nanoscopy and spectroscopy, enabling sub-10 nm resolution as well as simultaneous multicolor imaging of multi-labeled samples. Reconstruction of raw sSMLM data using deep learning is a promising approach for visualizing the subcellular structures at the nanoscale.

Aim

Develop a novel computational approach leveraging deep learning to reconstruct both label-free and fluorescence-labeled sSMLM imaging data.

Approach

We developed a two-network-model based deep learning algorithm, termed DsSMLM, to reconstruct sSMLM data. The effectiveness of DsSMLM was assessed by conducting imaging experiments on diverse samples, including label-free single-stranded DNA (ssDNA) fiber, fluorescence-labeled histone markers on COS-7 and U2OS cells, and simultaneous multicolor imaging of synthetic DNA origami nanoruler.

Results

For label-free imaging, a spatial resolution of 6.22 nm was achieved on ssDNA fiber; for fluorescence-labeled imaging, DsSMLM revealed the distribution of chromatin-rich and chromatin-poor regions defined by histone markers on the cell nucleus and also offered simultaneous multicolor imaging of nanoruler samples, distinguishing two dyes labeled in three emitting points with a separation distance of 40 nm. With DsSMLM, we observed enhanced spectral profiles with 8.8% higher localization detection for single-color imaging and up to 5.05% higher localization detection for simultaneous two-color imaging.

Conclusions

We demonstrate the feasibility of deep learning-based reconstruction for sSMLM imaging applicable to label-free and fluorescence-labeled sSMLM imaging data. We anticipate our technique will be a valuable tool for high-quality super-resolution imaging for a deeper understanding of DNA molecules' photophysics and will facilitate the investigation of multiple nanoscopic cellular structures and their interactions.

Spectral precision improvement with demagnifying spectral images in spectroscopic nanoscopy

Spectroscopic nanoscopy (SN) has been recognized as a key functional imaging tool in cell biology and chemistry because it offers the unique capability to simultaneously obtain the spatial and spectral information for single molecules. However, it has an intrinsic issue in using the limited photon budget from single emitters divided into two imaging channels to concurrently acquire spatial and spectral images. Accordingly, this issue lowers the spatial localization and spectral precision. Although several techniques have been introduced to improve the spatial precision in SN, improving the spectral precision has been overlooked so far. Here we propose a method to improve the spectral precision by optically manipulating the width of the spectroscopic signatures using a demagnifier. We evaluate its performance using numerical simulations with systematic investigations of several underlying optimal parameters such as the demagnification factor and the integration width in the proposed configuration. We also present achievable spectral precision values with different signal and background levels. Compared to the existing SN system, the 3× demagnifier-based configuration shows an approximate 35% improvement, from 2.9 nm to 1.9 nm, in the spectral precision at the 1000 photons signal level.

Advancing Spectrally-Resolved Single Molecule Localization Microscopy with Deep Learning

Spectrally-resolved single molecule localization microscopy (srSMLM) is a recent technique enriching single molecule localization microscopy with the simultaneous recording of spectra of the single emitters. srSMLM resolution is limited by the number of photons collected per emitters. Sharing a photon budget to record the localization and the spectroscopic information results in a loss of spatial and spectral resolution-or forces the sacrifice of one at the expense of the other. Here, srUnet-a deep-learning Unet-based image processing routine trained to increase the spectral and spatial signals to compensate for the resolution loss inherent in additionally recording the spectral component is reported. Both localization and spectral precision are improved by srUnet-particularly for the low-emitting species. srUnet increases the fraction of localization whose signal can be both spatially and spectrally characterized. It preserves spectral shifts and the linearity of the dispersion of light. It strongly facilitates wavelength assignment in multicolor experiments. srUnet is a simple post-processing add-on boosting srSMLM performance close to conventional SMLM with the potential to turn srSMLM into the new standard for multicolor single molecule imaging.

Spectroscopic single-molecule localization microscopy: applications and prospective

Single-molecule localization microscopy (SMLM) breaks the optical diffraction limit by numerically localizing sparse fluorescence emitters to achieve super-resolution imaging. Spectroscopic SMLM or sSMLM further allows simultaneous spectroscopy and super-resolution imaging of fluorescence molecules. Hence, sSMLM can extract spectral features with single-molecule sensitivity, higher precision, and higher multiplexity than traditional multicolor microscopy modalities. These new capabilities enabled advanced multiplexed and functional cellular imaging applications. While sSMLM suffers from reduced spatial precision compared to conventional SMLM due to splitting photons to form spatial and spectral images, several methods have been reported to mitigate these weaknesses through innovative optical design and image processing techniques. This review summarizes the recent progress in sSMLM, its applications, and our perspective on future work.

Multimodal single-molecule microscopy with continuously controlled spectral resolution

Color is a fundamental contrast mechanism in fluorescence microscopy, providing the basis for numerous imaging and spectroscopy techniques. Building on spectral imaging schemes that encode color into a fixed spatial intensity distribution, here, we introduce continuously controlled spectral-resolution (CoCoS) microscopy, which allows the spectral resolution of the system to be adjusted in real-time. By optimizing the spectral resolution for each experiment, we achieve maximal sensitivity and throughput, allowing for single-frame acquisition of multiple color channels with single-molecule sensitivity and 140-fold larger fields of view compared with previous super-resolution spectral imaging techniques. Here, we demonstrate the utility of CoCoS in three experimental formats, single-molecule spectroscopy, single-molecule Förster resonance energy transfer, and multicolor single-particle tracking in live neurons, using a range of samples and 12 distinct fluorescent markers. A simple add-on allows CoCoS to be integrated into existing fluorescence microscopes, rendering spectral imaging accessible to the wider scientific community.