1
|
Gaire SK, Daneshkhah A, Flowerday E, Gong R, Frederick J, Backman V. Deep learning-based spectroscopic single-molecule localization microscopy. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:066501. [PMID: 38799979 PMCID: PMC11122423 DOI: 10.1117/1.jbo.29.6.066501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Revised: 05/03/2024] [Accepted: 05/09/2024] [Indexed: 05/29/2024]
Abstract
Significance Spectroscopic single-molecule localization microscopy (sSMLM) takes advantage of nanoscopy and spectroscopy, enabling sub-10 nm resolution as well as simultaneous multicolor imaging of multi-labeled samples. Reconstruction of raw sSMLM data using deep learning is a promising approach for visualizing the subcellular structures at the nanoscale. Aim Develop a novel computational approach leveraging deep learning to reconstruct both label-free and fluorescence-labeled sSMLM imaging data. Approach We developed a two-network-model based deep learning algorithm, termed DsSMLM, to reconstruct sSMLM data. The effectiveness of DsSMLM was assessed by conducting imaging experiments on diverse samples, including label-free single-stranded DNA (ssDNA) fiber, fluorescence-labeled histone markers on COS-7 and U2OS cells, and simultaneous multicolor imaging of synthetic DNA origami nanoruler. Results For label-free imaging, a spatial resolution of 6.22 nm was achieved on ssDNA fiber; for fluorescence-labeled imaging, DsSMLM revealed the distribution of chromatin-rich and chromatin-poor regions defined by histone markers on the cell nucleus and also offered simultaneous multicolor imaging of nanoruler samples, distinguishing two dyes labeled in three emitting points with a separation distance of 40 nm. With DsSMLM, we observed enhanced spectral profiles with 8.8% higher localization detection for single-color imaging and up to 5.05% higher localization detection for simultaneous two-color imaging. Conclusions We demonstrate the feasibility of deep learning-based reconstruction for sSMLM imaging applicable to label-free and fluorescence-labeled sSMLM imaging data. We anticipate our technique will be a valuable tool for high-quality super-resolution imaging for a deeper understanding of DNA molecules' photophysics and will facilitate the investigation of multiple nanoscopic cellular structures and their interactions.
Collapse
Affiliation(s)
- Sunil Kumar Gaire
- North Carolina Agricultural and Technical State University, Department of Electrical and Computer Engineering, Greensboro, North Carolina, United States
| | - Ali Daneshkhah
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| | - Ethan Flowerday
- University of Tulsa, Department of Computer Science and Cyber Security, Tulsa, Oklahoma, United States
| | - Ruyi Gong
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| | - Jane Frederick
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| | - Vadim Backman
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| |
Collapse
|
2
|
Seabury AG, Khodabocus AJ, Kogan IM, Hoy GR, DeSalvo GA, Wustholz KL. Blinking characteristics of organic fluorophores for blink-based multiplexing. Commun Chem 2024; 7:18. [PMID: 38280979 PMCID: PMC10821931 DOI: 10.1038/s42004-024-01106-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Accepted: 01/12/2024] [Indexed: 01/29/2024] Open
Abstract
Single-molecule fluorescence experiments have transformed our understanding of complex materials and biological systems. Whether single molecules are used to report on their nano-environment or provide for localization, understanding their blinking dynamics (i.e., stochastic fluctuations in emission intensity under continuous illumination) is paramount. We recently demonstrated another use for blinking dynamics called blink-based multiplexing (BBM), where individual emitters are classified using a single excitation laser based on blinking dynamics, rather than color. This study elucidates the structure-activity relationships governing BBM performance in a series of model rhodamine, BODIPY, and anthraquinone fluorophores that undergo different photo-physical and-chemical processes during blinking. Change point detection and multinomial logistic regression analyses show that BBM can leverage spectral fluctuations, electron and proton transfer kinetics, as well as photostability for molecular classification-even within the context of a shared blinking mechanism. In doing so, we demonstrate two- and three-color BBM with ≥ 93% accuracy using spectrally-overlapped fluorophores.
Collapse
Affiliation(s)
| | | | | | - Grayson R Hoy
- Chemistry Department, William & Mary, Williamsburg, VA, USA
| | | | | |
Collapse
|
3
|
Yeo WH, Sun C, Zhang HF. Physically informed Monte Carlo simulation of dual-wedge prism-based spectroscopic single-molecule localization microscopy. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11502. [PMID: 37795311 PMCID: PMC10546470 DOI: 10.1117/1.jbo.29.s1.s11502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Revised: 09/12/2023] [Accepted: 09/15/2023] [Indexed: 10/06/2023]
Abstract
Significance The dual-wedge prism (DWP)-based spectroscopic single-molecule localization microscopy (sSMLM) system offers improved localization precision and adjustable spectral or localization performance, but its nonlinear spectral dispersion presents a challenge. A systematic method can help understand the challenges and thereafter optimize the DWP system's performance by customizing the system parameters to maximize the spectral or localization performance for various molecular labels. Aim We developed a Monte Carlo (MC)-based model that predicts the imaging output of the DWP-based sSMLM system given different system parameters. Approach We assessed our MC model's localization and spectral precisions by comparing our simulation against theoretical equations and fluorescent microspheres. Furthermore, we simulated the DWP-based system using beamsplitters (BSs) with a reflectance (R):transmittance (T) of R50:T50 and R30:T70 and their tradeoffs. Results Our MC simulation showed average deviations of 2.5 and 2.1 nm for localization and spectral precisions against theoretical equations and 2.3 and 1.0 nm against fluorescent microspheres. An R30:T70 BS improved the spectral precision by 8% but worsened the localization precision by 35% on average compared with an R50:T50 BS. Conclusions The MC model accurately predicted the localization precision, spectral precision, spectral peaks, and spectral widths of fluorescent microspheres, as validated by experimental data. Our work enhances the theoretical understanding of DWP-based sSMLM for multiplexed imaging, enabling performance optimization.
Collapse
Affiliation(s)
- Wei-Hong Yeo
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| | - Cheng Sun
- Northwestern University, Department of Mechanical Engineering, Evanston, Illinois, United States
| | - Hao F. Zhang
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| |
Collapse
|
4
|
Liu Y, Shahid MA, Mao H, Chen J, Waddington M, Song KH, Zhang Y. Switchable and Functional Fluorophores for Multidimensional Single-Molecule Localization Microscopy. CHEMICAL & BIOMEDICAL IMAGING 2023; 1:403-413. [PMID: 37655169 PMCID: PMC10466381 DOI: 10.1021/cbmi.3c00045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 06/05/2023] [Accepted: 06/08/2023] [Indexed: 09/02/2023]
Abstract
Multidimensional single-molecule localization microscopy (mSMLM) represents a paradigm shift in the realm of super-resolution microscopy techniques. It affords the simultaneous detection of single-molecule spatial locations at the nanoscale and functional information by interrogating the emission properties of switchable fluorophores. The latter is finely tuned to report its local environment through carefully manipulated laser illumination and single-molecule detection strategies. This Perspective highlights recent strides in mSMLM with a focus on fluorophore designs and their integration into mSMLM imaging systems. Particular interests are the accomplishments in simultaneous multiplexed super-resolution imaging, nanoscale polarity and hydrophobicity mapping, and single-molecule orientational imaging. Challenges and prospects in mSMLM are also discussed, which include the development of more vibrant and functional fluorescent probes, the optimization of optical implementation to judiciously utilize the photon budget, and the advancement of imaging analysis and machine learning techniques.
Collapse
Affiliation(s)
- Yunshu Liu
- Molecular
Analytics and Photonics (MAP) Laboratory, Department of Textile Engineering,
Chemistry and Science, North Carolina State
University, Raleigh, North Carolina 27606, United States
| | - Md Abul Shahid
- Molecular
Analytics and Photonics (MAP) Laboratory, Department of Textile Engineering,
Chemistry and Science, North Carolina State
University, Raleigh, North Carolina 27606, United States
| | - Hongjing Mao
- Molecular
Analytics and Photonics (MAP) Laboratory, Department of Textile Engineering,
Chemistry and Science, North Carolina State
University, Raleigh, North Carolina 27606, United States
| | - Jiahui Chen
- Molecular
Analytics and Photonics (MAP) Laboratory, Department of Textile Engineering,
Chemistry and Science, North Carolina State
University, Raleigh, North Carolina 27606, United States
| | - Michael Waddington
- Molecular
Analytics and Photonics (MAP) Laboratory, Department of Textile Engineering,
Chemistry and Science, North Carolina State
University, Raleigh, North Carolina 27606, United States
| | - Ki-Hee Song
- Quantum
Optics Research Division, Korea Atomic Energy
Research Institute, Yuseong-gu, Daejeon 34057, Republic of Korea
| | - Yang Zhang
- Molecular
Analytics and Photonics (MAP) Laboratory, Department of Textile Engineering,
Chemistry and Science, North Carolina State
University, Raleigh, North Carolina 27606, United States
| |
Collapse
|
5
|
Manko H, Mély Y, Godet J. Advancing Spectrally-Resolved Single Molecule Localization Microscopy with Deep Learning. SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2023; 19:e2300728. [PMID: 37093225 DOI: 10.1002/smll.202300728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 03/21/2023] [Indexed: 05/03/2023]
Abstract
Spectrally-resolved single molecule localization microscopy (srSMLM) is a recent technique enriching single molecule localization microscopy with the simultaneous recording of spectra of the single emitters. srSMLM resolution is limited by the number of photons collected per emitters. Sharing a photon budget to record the localization and the spectroscopic information results in a loss of spatial and spectral resolution-or forces the sacrifice of one at the expense of the other. Here, srUnet-a deep-learning Unet-based image processing routine trained to increase the spectral and spatial signals to compensate for the resolution loss inherent in additionally recording the spectral component is reported. Both localization and spectral precision are improved by srUnet-particularly for the low-emitting species. srUnet increases the fraction of localization whose signal can be both spatially and spectrally characterized. It preserves spectral shifts and the linearity of the dispersion of light. It strongly facilitates wavelength assignment in multicolor experiments. srUnet is a simple post-processing add-on boosting srSMLM performance close to conventional SMLM with the potential to turn srSMLM into the new standard for multicolor single molecule imaging.
Collapse
Affiliation(s)
- Hanna Manko
- Laboratoire de BioImagerie et Pathologies, UMR CNRS 7021, ITI InnoVec, Université de Strasbourg, Illkirch, 67401, France
| | - Yves Mély
- Laboratoire de BioImagerie et Pathologies, UMR CNRS 7021, Université de Strasbourg, Illkirch, 67401, France
| | - Julien Godet
- Groupe Méthodes Recherche Clinique, Hôpitaux Universitaires de Strasbourg, Strasbourg, 67091, France
- Laboratoire iCube, UMR CNRS 7357, Equipe IMAGeS, Université de Strasbourg, Illkirch, 67400, France
| |
Collapse
|
6
|
Brenner B, Sun C, Raymo FM, Zhang HF. Spectroscopic single-molecule localization microscopy: applications and prospective. NANO CONVERGENCE 2023; 10:14. [PMID: 36943541 PMCID: PMC10030755 DOI: 10.1186/s40580-023-00363-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 03/05/2023] [Indexed: 05/25/2023]
Abstract
Single-molecule localization microscopy (SMLM) breaks the optical diffraction limit by numerically localizing sparse fluorescence emitters to achieve super-resolution imaging. Spectroscopic SMLM or sSMLM further allows simultaneous spectroscopy and super-resolution imaging of fluorescence molecules. Hence, sSMLM can extract spectral features with single-molecule sensitivity, higher precision, and higher multiplexity than traditional multicolor microscopy modalities. These new capabilities enabled advanced multiplexed and functional cellular imaging applications. While sSMLM suffers from reduced spatial precision compared to conventional SMLM due to splitting photons to form spatial and spectral images, several methods have been reported to mitigate these weaknesses through innovative optical design and image processing techniques. This review summarizes the recent progress in sSMLM, its applications, and our perspective on future work.
Collapse
Affiliation(s)
- Benjamin Brenner
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, 60208, USA
| | - Cheng Sun
- Department of Mechanical Engineering, Northwestern University, Evanston, IL, 60208, USA
| | - Françisco M Raymo
- Department of Chemistry, University of Miami, Coral Gables, FL, 33146, USA
| | - Hao F Zhang
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, 60208, USA.
| |
Collapse
|
7
|
Song KH, Sun C, Zhang HF. Design strategy for a dual-wedge prism imaging spectrometer in spectroscopic nanoscopy. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2023; 94:023706. [PMID: 36859048 DOI: 10.1063/5.0122692] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Accepted: 01/30/2023] [Indexed: 06/18/2023]
Abstract
Spectroscopic single-molecule localization microscopy (sSMLM, or spectroscopic nanoscopy) has been established as a key tool in functional super-resolution imaging by providing spatial and spectral information of single molecules at nanoscale resolution. A recently developed dual-wedge prism (DWP) imaging spectrometer, a monolithic optical component, has broadened the accessibility of sSMLM with an improved imaging resolution of more than 40%. It also improved the system reliability by reducing the number of discrete optical components. However, achieving its optimal performance requires the comprehensive understanding of the underlying constraints of the key system parameters, such as the refractive index of the DWP, spectral dispersion (SD), axial separation for three-dimensional (3D) biplane reconstruction, and the overall dimensional constraints. In this work, we present a generalized design principle for the DWP imaging spectrometer. Specifically, we develop the theoretical framework capturing the influence of the primary design parameters, including the achievable SD and localization performance, for different design cases. It further establishes the workflow to design and optimize the DWP imaging spectrometer for better multi-color functional imaging. This will give practical guidance for users to easily design the DWP imaging spectrometer, allowing for straightforward 3D sSMLM implementation.
Collapse
Affiliation(s)
- Ki-Hee Song
- Korea Atomic Energy Research Institute, 111, Daedeok-daero 989beon-gil, Yuseong-gu, Daejeon 34057, Republic of Korea
| | - Cheng Sun
- Department of Mechanical Engineering, Northwestern University, Evanston, Illinois 60208, USA
| | - Hao F Zhang
- Department of Biomedical Engineering, Northwestern University, Evanston, Illinois 60208, USA
| |
Collapse
|
8
|
Chen H, Wen K, Lu Y, Zhang X, Shi Y, Shi Q, Ma H, Peng Q, Huang H. White-light-driven fluorescence switch for super-resolution imaging guided photodynamic and photoacid therapy. Sci China Chem 2022. [DOI: 10.1007/s11426-022-1369-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
9
|
Zhang Y, Wang G, Huang P, Sun E, Kweon J, Li Q, Zhe J, Ying LL, Zhang HF. Minimizing Molecular Misidentification in Imaging Low-Abundance Protein Interactions Using Spectroscopic Single-Molecule Localization Microscopy. Anal Chem 2022; 94:13834-13841. [PMID: 36165784 PMCID: PMC9859736 DOI: 10.1021/acs.analchem.2c02417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
Super-resolution microscopy can capture spatiotemporal organizations of protein interactions with resolution down to 10 nm; however, the analyses of more than two proteins involving low-abundance protein are challenging because spectral crosstalk and heterogeneities of individual fluorescent labels result in molecular misidentification. Here we developed a deep learning-based imaging analysis method for spectroscopic single-molecule localization microscopy to minimize molecular misidentification in three-color super-resolution imaging. We characterized the 3-fold reduction of molecular misidentification in the new imaging method using pure samples of different photoswitchable fluorophores and visualized three distinct subcellular proteins in U2-OS cell lines. We further validated the protein counts and interactions of TOMM20, DRP1, and SUMO1 in a well-studied biological process, Staurosporine-induced apoptosis, by comparing the imaging results with Western-blot analyses of different subcellular portions.
Collapse
Affiliation(s)
- Yang Zhang
- Department of Biomedical Engineering, Northwestern University, Evanston IL, 60208, USA
| | - Gaoxiang Wang
- Department of Biomedical Engineering, Northwestern University, Evanston IL, 60208, USA
- Department of Hematology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan Hubei, 430030, China
| | - Peizhou Huang
- Department of Biomedical Engineering, The State University of New York at Buffalo, Buffalo, NY 14260, USA
| | - Edison Sun
- Department of Biomedical Engineering, Northwestern University, Evanston IL, 60208, USA
| | - Junghun Kweon
- Department of Biomedical Engineering, Northwestern University, Evanston IL, 60208, USA
| | - Qianru Li
- Department of Biomedical Engineering, Northwestern University, Evanston IL, 60208, USA
- Department of Pharmacology, Northwestern University, Chicago IL, 60611, USA
| | - Ji Zhe
- Department of Biomedical Engineering, Northwestern University, Evanston IL, 60208, USA
- Department of Pharmacology, Northwestern University, Chicago IL, 60611, USA
| | - Leslie L. Ying
- Department of Biomedical Engineering, The State University of New York at Buffalo, Buffalo, NY 14260, USA
- Department of Electrical Engineering, The State University of New York at Buffalo, Buffalo, NY 14260, USA
| | - Hao F. Zhang
- Department of Biomedical Engineering, Northwestern University, Evanston IL, 60208, USA
| |
Collapse
|
10
|
Saavedra LA, Buena-Maizón H, Barrantes FJ. Mapping the Nicotinic Acetylcholine Receptor Nanocluster Topography at the Cell Membrane with STED and STORM Nanoscopies. Int J Mol Sci 2022; 23:ijms231810435. [PMID: 36142349 PMCID: PMC9499342 DOI: 10.3390/ijms231810435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2022] [Revised: 09/01/2022] [Accepted: 09/06/2022] [Indexed: 11/16/2022] Open
Abstract
The cell-surface topography and density of nicotinic acetylcholine receptors (nAChRs) play a key functional role in the synapse. Here we employ in parallel two labeling and two super-resolution microscopy strategies to characterize the distribution of this receptor at the plasma membrane of the mammalian clonal cell line CHO-K1/A5. Cells were interrogated with two targeted techniques (confocal microscopy and stimulated emission depletion (STED) nanoscopy) and single-molecule nanoscopy (stochastic optical reconstruction microscopy, STORM) using the same fluorophore, Alexa Fluor 647, tagged onto either α-bungarotoxin (BTX) or the monoclonal antibody mAb35. Analysis of the topography of nanometer-sized aggregates (“nanoclusters”) was carried out using STORMGraph, a quantitative clustering analysis for single-molecule localization microscopy based on graph theory and community detection, and ASTRICS, an inter-cluster similarity algorithm based on computational geometry. Antibody-induced crosslinking of receptors resulted in nanoclusters with a larger number of receptor molecules and higher densities than those observed in BTX-labeled samples. STORM and STED provided complementary information, STED rendering a direct map of the mesoscale nAChR distribution at distances ~10-times larger than the nanocluster centroid distances measured in STORM samples. By applying photon threshold filtering analysis, we show that it is also possible to detect the mesoscale organization in STORM images.
Collapse
|
11
|
Jeong D, Kim D. Super‐resolution fluorescence microscopy‐based single‐molecule spectroscopy. B KOREAN CHEM SOC 2022. [DOI: 10.1002/bkcs.12471] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Dokyung Jeong
- Department of Chemistry Hanyang University Seoul Republic of Korea
| | - Doory Kim
- Department of Chemistry Hanyang University Seoul Republic of Korea
- Research Institute for Convergence of Basic Science, Institute of Nano Science and Technology, and Research Institute for Natural Sciences Hanyang University Seoul Republic of Korea
| |
Collapse
|