1
|
Preziosi A, Cirelli C, Waterhouse D, Privitera L, De Coppi P, Giuliani S. State of the art medical devices for fluorescence-guided surgery (FGS): technical review and future developments. Surg Endosc 2024:10.1007/s00464-024-11236-5. [PMID: 39294317 DOI: 10.1007/s00464-024-11236-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2024] [Accepted: 08/29/2024] [Indexed: 09/20/2024]
Abstract
BACKGROUND Medical devices for fluorescence-guided surgery (FGS) are becoming available at a fast pace. The main challenge for surgeons lies in the lack of in-depth knowledge of optical imaging, different technical specifications and poor standardisation, and the selection of the best device based on clinical application. METHODS This manuscript aims to provide an up-to-date description of the commercially available fluorescence imaging platforms by comparing their mode of use, required settings, image types, compatible fluorophores, regulatory approval, and cost. We obtained this information by performing a broad literature search on PubMed and by contacting medical companies directly. The data for this review were collected up to November 2023. RESULTS Thirty-two devices made by 19 medical companies were identified. Ten systems are surgical microscopes, 5 can be used for both open and minimally invasive surgery (MIS), 6 can only be used for open surgery, and 10 only for MIS. One is a fluorescence system available for the Da Vinci robot. Nineteen devices can provide an overlay between fluorescence and white light image. All devices are compatible with Indocyanine Green, the most common fluorescence dye used intraoperatively. There is significant variability in the hardware and software of each device, which resulted in different sensitivity, fluorescence intensity, and image quality. All devices are CE-mark regulated, and 30 were FDA-approved. CONCLUSION There is a prolific market of devices for FGS and healthcare professionals should have basic knowledge of their technical specifications to use it at best for each clinical indication. Standardisation across devices must be a priority in the field of FGS, and it will enhance external validity for future clinical trials in the field.
Collapse
Affiliation(s)
- Alessandra Preziosi
- Cancer Section, Developmental Biology and Cancer Programme, UCL Great Ormond Street Institute of Child Health, 30 Guilford Street, London, WC1N 1EH, UK
- Department of Paediatric Surgery, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico Di Milano, Milan, Italy
| | - Cecilia Cirelli
- Cancer Section, Developmental Biology and Cancer Programme, UCL Great Ormond Street Institute of Child Health, 30 Guilford Street, London, WC1N 1EH, UK
- Academic Paediatrics, Imperial College Healthcare NHS Trust, London, UK
| | - Dale Waterhouse
- University College London, Wellcome/EPSRC Centre for Interventional and Surgical Sciences, London, UK
| | - Laura Privitera
- Cancer Section, Developmental Biology and Cancer Programme, UCL Great Ormond Street Institute of Child Health, 30 Guilford Street, London, WC1N 1EH, UK
- University College London, Wellcome/EPSRC Centre for Interventional and Surgical Sciences, London, UK
| | - Paolo De Coppi
- Cancer Section, Developmental Biology and Cancer Programme, UCL Great Ormond Street Institute of Child Health, 30 Guilford Street, London, WC1N 1EH, UK
| | - Stefano Giuliani
- Cancer Section, Developmental Biology and Cancer Programme, UCL Great Ormond Street Institute of Child Health, 30 Guilford Street, London, WC1N 1EH, UK.
- University College London, Wellcome/EPSRC Centre for Interventional and Surgical Sciences, London, UK.
- Great Ormond Street Hospital for Children NHS Foundation Trust, 5th Floor Paul O'Gorman Building, Great Ormond Street, London, WC1N 3JH, UK.
| |
Collapse
|
2
|
Sgouralis I, Xu LWQ, Jalihal AP, Kilic Z, Walter NG, Pressé S. BNP-Track: a framework for superresolved tracking. Nat Methods 2024; 21:1716-1724. [PMID: 39039336 PMCID: PMC11399105 DOI: 10.1038/s41592-024-02349-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Accepted: 06/03/2024] [Indexed: 07/24/2024]
Abstract
Superresolution tools, such as PALM and STORM, provide nanoscale localization accuracy by relying on rare photophysical events, limiting these methods to static samples. By contrast, here, we extend superresolution to dynamics without relying on photodynamics by simultaneously determining emitter numbers and their tracks (localization and linking) with the same localization accuracy per frame as widefield superresolution on immobilized emitters under similar imaging conditions (≈50 nm). We demonstrate our Bayesian nonparametric track (BNP-Track) framework on both in cellulo and synthetic data. BNP-Track develops a joint (posterior) distribution that learns and quantifies uncertainty over emitter numbers and their associated tracks propagated from shot noise, camera artifacts, pixelation, background and out-of-focus motion. In doing so, we integrate spatiotemporal information into our distribution, which is otherwise compromised by modularly determining emitter numbers and localizing and linking emitter positions across frames. For this reason, BNP-Track remains accurate in crowding regimens beyond those accessible to other single-particle tracking tools.
Collapse
Affiliation(s)
- Ioannis Sgouralis
- Department of Mathematics, University of Tennessee, Knoxville, TN, USA
| | - Lance W Q Xu
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
| | - Ameya P Jalihal
- Department of Cell Biology, Duke University, Durham, NC, USA
| | - Zeliha Kilic
- Department of Structural Biology, St. Jude Children's Research Hospital, Memphis, TN, USA
| | - Nils G Walter
- Single Molecule Analysis Group and Center for RNA Biomedicine, Department of Chemistry, University of Michigan, Ann Arbor, MI, USA
| | - Steve Pressé
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA.
- Department of Physics, Arizona State University, Tempe, AZ, USA.
- School of Molecular Sciences, Arizona State University, Tempe, AZ, USA.
| |
Collapse
|
3
|
Saurabh A, Brown PT, Bryan JS, Fox ZR, Kruithoff R, Thompson C, Kural C, Shepherd DP, Pressé S. Approaching Maximum Resolution in Structured Illumination Microscopy via Accurate Noise Modeling. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.12.07.570701. [PMID: 38106139 PMCID: PMC10723446 DOI: 10.1101/2023.12.07.570701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
Biological images captured by microscopes are characterized by heterogeneous signal-to-noise ratios (SNRs) due to spatially varying photon emission across the field of view convoluted with camera noise. State-of-the-art unsupervised structured illumination microscopy (SIM) reconstruction algorithms, commonly implemented in the Fourier domain, do not accurately model this noise and suffer from high-frequency artifacts, user-dependent choices of smoothness constraints making assumptions on biological features, and unphysical negative values in the recovered fluorescence intensity map. On the other hand, supervised methods rely on large datasets for training, and often require retraining for new sample structures. Consequently, achieving high contrast near the maximum theoretical resolution in an unsupervised, physically principled, manner remains an open problem. Here, we propose Bayesian-SIM (B-SIM), an unsupervised Bayesian framework to quantitatively reconstruct SIM data, rectifying these shortcomings by accurately incorporating known noise sources in the spatial domain. To accelerate the reconstruction process, we use the finite extent of the point-spread-function to devise a parallelized Monte Carlo strategy involving chunking and restitching of the inferred fluorescence intensity. We benchmark our framework on both simulated and experimental images, and demonstrate improved contrast permitting feature recovery at up to 25% shorter length scales over state-of-the-art methods at both high- and low-SNR. B-SIM enables unsupervised, quantitative, physically accurate reconstruction without the need for labeled training data, democratizing high-quality SIM reconstruction and expands the capabilities of live-cell SIM to lower SNR, potentially revealing biological features in previously inaccessible regimes.
Collapse
Affiliation(s)
- Ayush Saurabh
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
| | - Peter T. Brown
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
| | - J. Shepard Bryan
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
| | - Zachary R. Fox
- Computational Science and Engineering Division, Oak Ridge National Laboratory, Oak Ridge, TN, USA
| | - Rory Kruithoff
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
| | | | - Comert Kural
- Department of Physics, The Ohio State University, Columbus, OH, USA
- Interdisciplinary Biophysics Graduate Program, The Ohio State University, Columbus, OH, USA
| | - Douglas P. Shepherd
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
| | - Steve Pressé
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
- School of Molecular Sciences, Arizona State University, Tempe, AZ, USA
| |
Collapse
|
4
|
Saurabh A, Xu LWQ, Pressé S. On the statistical foundation of a recent single molecule FRET benchmark. Nat Commun 2024; 15:3627. [PMID: 38688904 PMCID: PMC11061128 DOI: 10.1038/s41467-024-47733-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 04/09/2024] [Indexed: 05/02/2024] Open
Affiliation(s)
- Ayush Saurabh
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
| | - Lance W Q Xu
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA
- Department of Physics, Arizona State University, Tempe, AZ, USA
| | - Steve Pressé
- Center for Biological Physics, Arizona State University, Tempe, AZ, USA.
- Department of Physics, Arizona State University, Tempe, AZ, USA.
- School of Molecular Sciences, Arizona State University, Tempe, AZ, USA.
| |
Collapse
|
5
|
Krog J, Dvirnas A, Ström OE, Beech JP, Tegenfeldt JO, Müller V, Westerlund F, Ambjörnsson T. Photophysical image analysis: Unsupervised probabilistic thresholding for images from electron-multiplying charge-coupled devices. PLoS One 2024; 19:e0300122. [PMID: 38578724 PMCID: PMC10997106 DOI: 10.1371/journal.pone.0300122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 02/22/2024] [Indexed: 04/07/2024] Open
Abstract
We introduce the concept photophysical image analysis (PIA) and an associated pipeline for unsupervised probabilistic image thresholding for images recorded by electron-multiplying charge-coupled device (EMCCD) cameras. We base our approach on a closed-form analytic expression for the characteristic function (Fourier-transform of the probability mass function) for the image counts recorded in an EMCCD camera, which takes into account both stochasticity in the arrival of photons at the imaging camera and subsequent noise induced by the detection system of the camera. The only assumption in our method is that the background photon arrival to the imaging system is described by a stationary Poisson process (we make no assumption about the photon statistics for the signal). We estimate the background photon statistics parameter, λbg, from an image which contains both background and signal pixels by use of a novel truncated fit procedure with an automatically determined image count threshold. Prior to this, the camera noise model parameters are estimated using a calibration step. Utilizing the estimates for the camera parameters and λbg, we then introduce a probabilistic thresholding method, where, for the first time, the fraction of misclassified pixels can be determined a priori for a general image in an unsupervised way. We use synthetic images to validate our a priori estimates and to benchmark against the Otsu method, which is a popular unsupervised non-probabilistic image thresholding method (no a priori estimates for the error rates are provided). For completeness, we lastly present a simple heuristic general-purpose segmentation method based on the thresholding results, which we apply to segmentation of synthetic images and experimental images of fluorescent beads and lung cell nuclei. Our publicly available software opens up for fully automated, unsupervised, probabilistic photophysical image analysis.
Collapse
Affiliation(s)
- Jens Krog
- Centre for Environmental and Climate Science, Lund University, Lund, Sweden
| | - Albertas Dvirnas
- Centre for Environmental and Climate Science, Lund University, Lund, Sweden
| | - Oskar E. Ström
- Department of Physics and NanoLund, Lund University, Lund, Sweden
| | - Jason P. Beech
- Department of Physics and NanoLund, Lund University, Lund, Sweden
| | | | - Vilhelm Müller
- Department of Life Sciences, Chalmers University of Technology, Gothenburg, Sweden
| | - Fredrik Westerlund
- Department of Life Sciences, Chalmers University of Technology, Gothenburg, Sweden
| | - Tobias Ambjörnsson
- Centre for Environmental and Climate Science, Lund University, Lund, Sweden
| |
Collapse
|
6
|
Liu M, Lai Y, Marquez M, Vetrone F, Liang J. Short-wave Infrared Photoluminescence Lifetime Mapping of Rare-Earth Doped Nanoparticles Using All-Optical Streak Imaging. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2305284. [PMID: 38183381 PMCID: PMC10953585 DOI: 10.1002/advs.202305284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 11/06/2023] [Indexed: 01/08/2024]
Abstract
The short-wave infrared (SWIR) photoluminescence lifetimes of rare-earth doped nanoparticles (RENPs) have found diverse applications in fundamental and applied research. Despite dazzling progress in the novel design and synthesis of RENPs with attractive optical properties, existing optical systems for SWIR photoluminescence lifetime imaging are still considerably restricted by inefficient photon detection, limited imaging speed, and low sensitivity. To overcome these challenges, SWIR photoluminescence lifetime imaging microscopy using an all-optical streak camera (PLIMASC) is developed. Synergizing scanning optics and a high-sensitivity InGaAs CMOS camera, SWIR-PLIMASC has a 1D imaging speed of up to 138.9 kHz in the spectral range of 900-1700 nm, which quantifies the photoluminescence lifetime of RENPs in a single shot. A 2D photoluminescence lifetime map can be acquired by 1D scanning of the sample. To showcase the power of SWIR-PLIMASC, a series of core-shell RENPs with distinct SWIR photoluminescence lifetimes is synthesized. In particular, using Er3+ -doped RENPs, SWIR-PLIMASC enables multiplexed anti-counterfeiting. Leveraging Ho3+ -doped RENPs as temperature indicators, this system is applied to SWIR photoluminescence lifetime-based thermometry. Opening up a new avenue for efficient SWIR photoluminescence lifetime mapping, this work is envisaged to contribute to advanced materials characterization, information science, and biomedicine.
Collapse
Affiliation(s)
- Miao Liu
- Centre Énergie Matériaux Télécommunications, Institut National de la Recherche ScientifiqueUniversité du Québec1650 boulevard Lionel‐Boulet, VarennesQuébecJ3X1P7Canada
| | - Yingming Lai
- Centre Énergie Matériaux Télécommunications, Institut National de la Recherche ScientifiqueUniversité du Québec1650 boulevard Lionel‐Boulet, VarennesQuébecJ3X1P7Canada
| | - Miguel Marquez
- Centre Énergie Matériaux Télécommunications, Institut National de la Recherche ScientifiqueUniversité du Québec1650 boulevard Lionel‐Boulet, VarennesQuébecJ3X1P7Canada
| | - Fiorenzo Vetrone
- Centre Énergie Matériaux Télécommunications, Institut National de la Recherche ScientifiqueUniversité du Québec1650 boulevard Lionel‐Boulet, VarennesQuébecJ3X1P7Canada
| | - Jinyang Liang
- Centre Énergie Matériaux Télécommunications, Institut National de la Recherche ScientifiqueUniversité du Québec1650 boulevard Lionel‐Boulet, VarennesQuébecJ3X1P7Canada
| |
Collapse
|
7
|
Yeo WH, Sun C, Zhang HF. Physically informed Monte Carlo simulation of dual-wedge prism-based spectroscopic single-molecule localization microscopy. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11502. [PMID: 37795311 PMCID: PMC10546470 DOI: 10.1117/1.jbo.29.s1.s11502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Revised: 09/12/2023] [Accepted: 09/15/2023] [Indexed: 10/06/2023]
Abstract
Significance The dual-wedge prism (DWP)-based spectroscopic single-molecule localization microscopy (sSMLM) system offers improved localization precision and adjustable spectral or localization performance, but its nonlinear spectral dispersion presents a challenge. A systematic method can help understand the challenges and thereafter optimize the DWP system's performance by customizing the system parameters to maximize the spectral or localization performance for various molecular labels. Aim We developed a Monte Carlo (MC)-based model that predicts the imaging output of the DWP-based sSMLM system given different system parameters. Approach We assessed our MC model's localization and spectral precisions by comparing our simulation against theoretical equations and fluorescent microspheres. Furthermore, we simulated the DWP-based system using beamsplitters (BSs) with a reflectance (R):transmittance (T) of R50:T50 and R30:T70 and their tradeoffs. Results Our MC simulation showed average deviations of 2.5 and 2.1 nm for localization and spectral precisions against theoretical equations and 2.3 and 1.0 nm against fluorescent microspheres. An R30:T70 BS improved the spectral precision by 8% but worsened the localization precision by 35% on average compared with an R50:T50 BS. Conclusions The MC model accurately predicted the localization precision, spectral precision, spectral peaks, and spectral widths of fluorescent microspheres, as validated by experimental data. Our work enhances the theoretical understanding of DWP-based sSMLM for multiplexed imaging, enabling performance optimization.
Collapse
Affiliation(s)
- Wei-Hong Yeo
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| | - Cheng Sun
- Northwestern University, Department of Mechanical Engineering, Evanston, Illinois, United States
| | - Hao F. Zhang
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| |
Collapse
|
8
|
Fazel M, Grussmayer KS, Ferdman B, Radenovic A, Shechtman Y, Enderlein J, Pressé S. Fluorescence Microscopy: a statistics-optics perspective. ARXIV 2023:arXiv:2304.01456v3. [PMID: 37064525 PMCID: PMC10104198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 04/18/2023]
Abstract
Fundamental properties of light unavoidably impose features on images collected using fluorescence microscopes. Modeling these features is ever more important in quantitatively interpreting microscopy images collected at scales on par or smaller than light's wavelength. Here we review the optics responsible for generating fluorescent images, fluorophore properties, microscopy modalities leveraging properties of both light and fluorophores, in addition to the necessarily probabilistic modeling tools imposed by the stochastic nature of light and measurement.
Collapse
Affiliation(s)
- Mohamadreza Fazel
- Department of Physics, Arizona State University, Tempe, Arizona, USA
- Center for Biological Physics, Arizona State University, Tempe, Arizona, USA
| | - Kristin S Grussmayer
- Department of Bionanoscience, Faculty of Applied Science and Kavli Institute for Nanoscience, Delft University of Technology, Delft, Netherlands
| | - Boris Ferdman
- Russel Berrie Nanotechnology Institute and Department of Biomedical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
| | - Aleksandra Radenovic
- Laboratory of Nanoscale Biology, Institute of Bioengineering, Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, Switzerland
| | - Yoav Shechtman
- Russel Berrie Nanotechnology Institute and Department of Biomedical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
| | - Jörg Enderlein
- III. Institute of Physics - Biophysics, Georg August University, Göttingen, Germany
| | - Steve Pressé
- Department of Physics, Arizona State University, Tempe, Arizona, USA
- Center for Biological Physics, Arizona State University, Tempe, Arizona, USA
| |
Collapse
|
9
|
Jan A, Strkalj N, Nguyen XT, MacManus-Driscoll JL, Di Martino G. Comprehensive study of Raman optical response of typical substrates for thin-film growth under 633 nm and 785 nm laser excitation. OPTICS EXPRESS 2023; 31:33914-33922. [PMID: 37859160 DOI: 10.1364/oe.504002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 09/15/2023] [Indexed: 10/21/2023]
Abstract
Raman spectroscopy is one of the most efficient and non-destructive techniques for characterizing materials. However, it is challenging to analyze thin films using Raman spectroscopy since the substrates beneath the thin film often obscure its optical response. Here, we evaluate the suitability of fourteen commonly employed single-crystal substrates for Raman spectroscopy of thin films using 633 nm and 785 nm laser excitation systems. We determine the optimal wavenumber ranges for thin-film characterization by identifying the most prominent Raman peaks and their relative intensities for each substrate and across substrates. In addition, we compare the intensity of background signals across substrates, which is essential for establishing their applicability for Raman detection in thin films. The substrates LaAlO3 and Al2O3 have the largest free spectral range for both laser systems, while Al2O3 has the lowest background levels, according to our findings. In contrast, the substrates SrTiO3 and Nb:SrTiO3 have the narrowest free spectral range, while GdScO3, NGO and MgO have the highest background levels, making them unsuitable for optical investigations.
Collapse
|
10
|
Fitzgerald S, Marple E, Mahadevan-Jansen A. Performance assessment of probe-based Raman spectroscopy systems for biomedical analysis. BIOMEDICAL OPTICS EXPRESS 2023; 14:3597-3609. [PMID: 37497480 PMCID: PMC10368060 DOI: 10.1364/boe.494289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 05/28/2023] [Accepted: 05/30/2023] [Indexed: 07/28/2023]
Abstract
We present a methodology for evaluating the performance of probe-based Raman spectroscopy systems for biomedical analysis. This procedure uses a biological standard sample and data analysis approach to circumvent many of the issues related to accurately measuring and comparing the signal quality of Raman spectra between systems. Dairy milk is selected as the biological standard due to its similarity to tissue spectral properties and because its homogeneity eliminates the dependence of probe orientation on the measured spectrum. A spectral dataset is first collected from milk for each system configuration, followed by a model-based correction step to remove photobleaching artifacts and accurately calculate SNR. Results demonstrate that the proposed strategy, unlike current methods, produces an experimental SNR that agrees with the theoretical value. Four preconfigured imaging spectrographs that share similar manufacturer specifications were compared, showing that their capabilities to detect biological Raman spectra widely differ in terms of throughput and stray light rejection. While the methodology is used to compare spectrographs in this case, it can be adapted for other purposes, such as optimizing the design of a custom-built Raman spectrometer, evaluating inter-probe variability, or examining how altering system subcomponents affects signal quality.
Collapse
Affiliation(s)
- Sean Fitzgerald
- Vanderbilt Biophotonics Center, Nashville, TN 37232, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37232, USA
| | - Eric Marple
- EmVision LCC, 1471 F Road, Loxahatchee, FL 33470, USA
| | - Anita Mahadevan-Jansen
- Vanderbilt Biophotonics Center, Nashville, TN 37232, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37232, USA
| |
Collapse
|
11
|
Sgouralis I, Xu (徐伟青) LW, Jalihal AP, Walter NG, Pressé S. BNP-Track: A framework for superresolved tracking. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.03.535459. [PMID: 37066320 PMCID: PMC10104004 DOI: 10.1101/2023.04.03.535459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/25/2023]
Abstract
Assessing dynamic processes at single molecule scales is key toward capturing life at the level of its molecular actors. Widefield superresolution methods, such as STORM, PALM, and PAINT, provide nanoscale localization accuracy, even when distances between fluorescently labeled single molecules ("emitters") fall below light's diffraction limit. However, as these superresolution methods rely on rare photophysical events to distinguish emitters from both each other and background, they are largely limited to static samples. In contrast, here we leverage spatiotemporal correlations of dynamic widefield imaging data to extend superresolution to simultaneous multiple emitter tracking without relying on photodynamics even as emitter distances from one another fall below the diffraction limit. We simultaneously determine emitter numbers and their tracks (localization and linking) with the same localization accuracy per frame as widefield superresolution does for immobilized emitters under similar imaging conditions (≈50nm). We demonstrate our results for both in cellulo data and, for benchmarking purposes, on synthetic data. To this end, we avoid the existing tracking paradigm relying on completely or partially separating the tasks of emitter number determination, localization of each emitter, and linking emitter positions across frames. Instead, we develop a fully joint posterior distribution over the quantities of interest, including emitter tracks and their total, otherwise unknown, number within the Bayesian nonparametric paradigm. Our posterior quantifies the full uncertainty over emitter numbers and their associated tracks propagated from origins including shot noise and camera artefacts, pixelation, stochastic background, and out-of-focus motion. Finally, it remains accurate in more crowded regimes where alternative tracking tools cannot be applied.
Collapse
Affiliation(s)
- Ioannis Sgouralis
- Department of Mathematics, University of Tennessee, Knoxville, TN 37996, USA
| | - Lance W.Q. Xu (徐伟青)
- Center for Biological Physics, Arizona State University, Tempe, AZ 85287, USA
- Department of Physics, Arizona State University, Tempe, AZ 85287, USA
| | - Ameya P. Jalihal
- Department of Cell Biology, Duke University, Durham, NC 27710, USA
| | - Nils G. Walter
- Single Molecule Analysis Group and Center for RNA Biomedicine, Department of Chemistry, University of Michigan, Ann Arbor, MI 48109, USA
| | - Steve Pressé
- Center for Biological Physics, Arizona State University, Tempe, AZ 85287, USA
- Department of Physics, Arizona State University, Tempe, AZ 85287, USA
- School of Molecular Sciences, Arizona State University, Tempe, AZ 85287, USA
| |
Collapse
|
12
|
Singh R, Yadav V, Dhillon AK, Sharma A, Ahuja T, Siddhanta S. Emergence of Raman Spectroscopy as a Probing Tool for Theranostics. Nanotheranostics 2023; 7:216-235. [PMID: 37064614 PMCID: PMC10093420 DOI: 10.7150/ntno.81936] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Accepted: 02/21/2023] [Indexed: 03/13/2023] Open
Abstract
Although medical advances have increased our grasp of the amazing morphological, genetic, and phenotypic diversity of diseases, there are still significant technological barriers to understanding their complex and dynamic character. Specifically, the complexities of the biological systems throw a diverse set of challenges in developing efficient theranostic tools and methodologies that can probe and treat pathologies. Among several emerging theranostic techniques such as photodynamic therapy, photothermal therapy, magnetic resonance imaging, and computed tomography, Raman spectroscopy (RS) is emerging as a promising tool that is a label-free, cost-effective, and non-destructive technique. It can also provide real-time diagnostic information and can employ multimodal probes for detection and therapy. These attributes make it a perfect candidate for the analytical counterpart of the existing theranostic probes. The use of biocompatible nanomaterials for the fabrication of Raman probes provides rich structural information about the biological molecules, cells, and tissues and highly sensitive information down to single-molecule levels when integrated with advanced RS tools. This review discusses the fundamentals of Raman spectroscopic tools such as surface-enhanced Raman spectroscopy and Resonance Raman spectroscopy, their variants, and the associated theranostic applications. Besides the advantages, the current limitations, and future challenges of using RS in disease diagnosis and therapy have also been discussed.
Collapse
Affiliation(s)
| | | | | | | | | | - Soumik Siddhanta
- Department of Chemistry, Indian Institute of Technology Delhi, Hauz Khas, New Delhi - 110016, India
| |
Collapse
|
13
|
Laitenberger O, Aspelmeier T, Staudt T, Geisler C, Munk A, Egner A. Towards Unbiased Fluorophore Counting in Superresolution Fluorescence Microscopy. NANOMATERIALS (BASEL, SWITZERLAND) 2023; 13:459. [PMID: 36770420 PMCID: PMC9921631 DOI: 10.3390/nano13030459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 01/16/2023] [Accepted: 01/18/2023] [Indexed: 06/18/2023]
Abstract
With the advent of fluorescence superresolution microscopy, nano-sized structures can be imaged with a previously unprecedented accuracy. Therefore, it is rapidly gaining importance as an analytical tool in the life sciences and beyond. However, the images obtained so far lack an absolute scale in terms of fluorophore numbers. Here, we use, for the first time, a detailed statistical model of the temporal imaging process which relies on a hidden Markov model operating on two timescales. This allows us to extract this information from the raw data without additional calibration measurements. We show this on the basis of added data from experiments on single Alexa 647 molecules as well as GSDIM/dSTORM measurements on DNA origami structures with a known number of labeling positions.
Collapse
Affiliation(s)
- Oskar Laitenberger
- Department of Optical Nanoscopy, Institut für Nanophotonik e.V., 37077 Göttingen, Germany
| | - Timo Aspelmeier
- Institute for Mathematical Stochastics, Georg-August-University of Göttingen, 37073 Göttingen, Germany
| | - Thomas Staudt
- Institute for Mathematical Stochastics, Georg-August-University of Göttingen, 37073 Göttingen, Germany
- Cluster of Excellence “Multiscale Bioimaging: from Molecular Machines to Networks of Excitable Cells” (MBExC), University of Göttingen, 37075 Göttingen, Germany
| | - Claudia Geisler
- Department of Optical Nanoscopy, Institut für Nanophotonik e.V., 37077 Göttingen, Germany
| | - Axel Munk
- Institute for Mathematical Stochastics, Georg-August-University of Göttingen, 37073 Göttingen, Germany
- Cluster of Excellence “Multiscale Bioimaging: from Molecular Machines to Networks of Excitable Cells” (MBExC), University of Göttingen, 37075 Göttingen, Germany
| | - Alexander Egner
- Department of Optical Nanoscopy, Institut für Nanophotonik e.V., 37077 Göttingen, Germany
- Cluster of Excellence “Multiscale Bioimaging: from Molecular Machines to Networks of Excitable Cells” (MBExC), University of Göttingen, 37075 Göttingen, Germany
| |
Collapse
|
14
|
Dube BD, Riggs AJ, Kern BD, Cady EJ, Krist JE, Zhou H, Nemati B, Seo BJ, Steeves J, Arndt D, Mandić M, Shields J, Boussalis D, Valverde A, Rahman Z, Fathpour N. Exascale integrated modeling of low-order wavefront sensing and control for the Roman Coronagraph instrument. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2022; 39:C133-C142. [PMID: 36520751 DOI: 10.1364/josaa.472364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Accepted: 10/21/2022] [Indexed: 06/17/2023]
Abstract
Astronomical instruments to detect exoplanets require extreme wavefront stability. For these missions to succeed, comprehensive and precise modeling is required to design and analyze suitable coronagraphs and their wavefront control systems. In this paper, we describe techniques for integrated modeling at scale that is, to the best of our knowledge, 1000 times faster than previously published works. We show how this capability has been used to validate performance and perform uncertainty quantification for the Roman Coronagraph instrument. Finally, we show how this modeling capacity may be necessary to design and build the next generation of space-based coronagraph instruments.
Collapse
|
15
|
Inferring potential landscapes from noisy trajectories of particles within an optical feedback trap. iScience 2022; 25:104731. [PMID: 36034218 PMCID: PMC9400092 DOI: 10.1016/j.isci.2022.104731] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 06/27/2022] [Accepted: 07/02/2022] [Indexed: 11/22/2022] Open
Abstract
While particle trajectories encode information on their governing potentials, potentials can be challenging to robustly extract from trajectories. Measurement errors may corrupt a particle’s position, and sparse sampling of the potential limits data in higher energy regions such as barriers. We develop a Bayesian method to infer potentials from trajectories corrupted by Markovian measurement noise without assuming prior functional form on the potentials. As an alternative to Gaussian process priors over potentials, we introduce structured kernel interpolation to the Natural Sciences which allows us to extend our analysis to large datasets. Structured-Kernel-Interpolation Priors for Potential Energy Reconstruction (SKIPPER) is validated on 1D and 2D experimental trajectories for particles in a feedback trap. A feedback trap was used to generate noisy Langevin microbead trajectories The potential energy surface is recovered using a Bayesian formulation The formulation uses a structured-kernel-interpolation Gaussian process (SKI-GP) to tractably approximate Gaussian process regression for larger datasets Thanks to our adaptation of SKI-GP, we have broadened the use of Gaussian processes for natural science applications
Collapse
|
16
|
Saurabh A, Niekamp S, Sgouralis I, Pressé S. Modeling Non-additive Effects in Neighboring Chemically Identical Fluorophores. J Phys Chem B 2022; 126:10.1021/acs.jpcb.2c01889. [PMID: 35649158 PMCID: PMC9712593 DOI: 10.1021/acs.jpcb.2c01889] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Quantitative fluorescence analysis is often used to derive chemical properties, including stoichiometries, of biomolecular complexes. One fundamental underlying assumption in the analysis of fluorescence data─whether it be the determination of protein complex stoichiometry by super-resolution, or step-counting by photobleaching, or the determination of RNA counts in diffraction-limited spots in RNA fluorescence in situ hybridization (RNA-FISH) experiments─is that fluorophores behave identically and do not interact. However, recent experiments on fluorophore-labeled DNA origami structures such as fluorocubes have shed light on the nature of the interactions between identical fluorophores as these are brought closer together, thereby raising questions on the validity of the modeling assumption that fluorophores do not interact. Here, we analyze photon arrival data under pulsed illumination from fluorocubes where distances between dyes range from 2 to 10 nm. We discuss the implications of non-additivity of brightness on quantitative fluorescence analysis.
Collapse
Affiliation(s)
- Ayush Saurabh
- Center for Biological Physics, Department of Physics, Arizona State University, Tempe, Arizona 85287, United States
| | - Stefan Niekamp
- Massachusetts General Hospital, Boston, Massachusetts 02114, United States
- Department of Cellular and Molecular Pharmacology, University of California, San Francisco, California 94158, United States
| | - Ioannis Sgouralis
- Department of Mathematics, University of Tennessee, Knoxville, Tennessee 37996, United States
| | - Steve Pressé
- Center for Biological Physics, Department of Physics, Arizona State University, Tempe, Arizona 85287, United States
- School of Molecular Sciences, Arizona State University, Tempe, Arizona 85287, United States
| |
Collapse
|
17
|
van Swieten T, Meijerink A, Rabouw FT. Impact of Noise and Background on Measurement Uncertainties in Luminescence Thermometry. ACS PHOTONICS 2022; 9:1366-1374. [PMID: 35480490 PMCID: PMC9026254 DOI: 10.1021/acsphotonics.2c00039] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Indexed: 05/03/2023]
Abstract
Materials with temperature-dependent luminescence can be used as local thermometers when incorporated in, for example, a biological environment or chemical reactor. Researchers have continuously developed new materials aiming for the highest sensitivity of luminescence to temperature. Although the comparison of luminescent materials based on their temperature sensitivity is convenient, this parameter gives an incomplete description of the potential performance of the materials in applications. Here, we demonstrate how the precision of a temperature measurement with luminescent nanocrystals depends not only on the temperature sensitivity of the nanocrystals but also on their luminescence strength compared to measurement noise and background signal. After first determining the noise characteristics of our instrumentation, we show how the uncertainty of a temperature measurement can be predicted quantitatively. Our predictions match the temperature uncertainties that we extract from repeated measurements, over a wide temperature range (303-473 K), for different CCD readout settings, and for different background levels. The work presented here is the first study that incorporates all of these practical issues to accurately calculate the uncertainty of luminescent nanothermometers. This method will be important for the optimization and development of luminescent nanothermometers.
Collapse
|
18
|
Bryan JS, Sgouralis I, Pressé S. Diffraction-Limited Molecular Cluster Quantification with Bayesian Nonparametrics. NATURE COMPUTATIONAL SCIENCE 2022; 2:102-111. [PMID: 35874114 PMCID: PMC9302895 DOI: 10.1038/s43588-022-00197-1] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Accepted: 01/18/2022] [Indexed: 01/30/2023]
Abstract
Life's fundamental processes involve multiple molecules operating in close proximity within cells. To probe the composition and kinetics of molecular clusters confined within small (diffraction-limited) regions, experiments often report on the total fluorescence intensity simultaneously emitted from labeled molecules confined to such regions. Methods exist to enumerate total fluorophore numbers (e.g., step counting by photobleaching). However, methods aimed at step counting by photobleaching cannot treat photophysical dynamics in counting nor learn their associated kinetic rates. Here we propose a method to simultaneously enumerate fluorophores and determine their individual photophysical state trajectories. As the number of active (fluorescent) molecules at any given time is unknown, we rely on Bayesian nonparametrics and use specialized Monte Carlo algorithms to derive our estimates. Our formulation is benchmarked on synthetic and real data sets. While our focus here is on photophysical dynamics (in which labels transition between active and inactive states), such dynamics can also serve as a proxy for other types of dynamics such as assembly and disassembly kinetics of clusters. Similarly, while we focus on the case where all labels are initially fluorescent, other regimes, more appropriate to photoactivated localization microscopy, where fluorophores are instantiated in a non-fluorescent state, fall within the scope of the framework. As such, we provide a complete and versatile framework for the interpretation of complex time traces arising from the simultaneous activity of up to 100 fluorophores.
Collapse
Affiliation(s)
| | | | - Steve Pressé
- Center for Biological Physics, Arizona State University
- School of Molecular Sciences, Arizona State University
| |
Collapse
|
19
|
Rapid ensemble measurement of protein diffusion and probe blinking dynamics in cells. BIOPHYSICAL REPORTS 2021; 1:100015. [PMID: 36425455 PMCID: PMC9680803 DOI: 10.1016/j.bpr.2021.100015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Accepted: 08/30/2021] [Indexed: 12/25/2022]
Abstract
We present a fluorescence fluctuation image correlation analysis method that can rapidly and simultaneously measure the diffusion coefficient, photoblinking rates, and fraction of diffusing particles of fluorescent molecules in cells. Unlike other image correlation techniques, we demonstrated that our method could be applied irrespective of a nonuniformly distributed, immobile blinking fluorophore population. This allows us to measure blinking and transport dynamics in complex cell morphologies, a benefit for a range of super-resolution fluorescence imaging approaches that rely on probe emission blinking. Furthermore, we showed that our technique could be applied without directly accounting for photobleaching. We successfully employed our technique on several simulations with realistic EMCCD noise and photobleaching models, as well as on Dronpa-C12-labeled β-actin in living NIH/3T3 and HeLa cells. We found that the diffusion coefficients measured using our method were consistent with previous literature values. We further found that photoblinking rates measured in the live HeLa cells varied as expected with changing excitation power.
Collapse
|
20
|
Zhang W, Zhang Z, Bian L, Wang H, Suo J, Dai Q. High-axial-resolution single-molecule localization under dense excitation with a multi-channel deep U-Net. OPTICS LETTERS 2021; 46:5477-5480. [PMID: 34724505 DOI: 10.1364/ol.441536] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Accepted: 10/01/2021] [Indexed: 06/13/2023]
Abstract
Single-molecule localization microscopy (SMLM) can bypass the diffraction limit of optical microscopes and greatly improve the resolution in fluorescence microscopy. By introducing the point spread function (PSF) engineering technique, we can customize depth varying PSF to achieve higher axial resolution. However, most existing 3D single-molecule localization algorithms require excited fluorescent molecules to be sparse and captured at high signal-to-noise ratios, which results in a long acquisition time and precludes SMLM's further applications in many potential fields. To address this problem, we propose a novel 3D single-molecular localization method based on a multi-channel neural network based on U-Net. By leveraging the deep network's great advantages in feature extraction, the proposed network can reliably discriminate dense fluorescent molecules with overlapped PSFs and corrupted by sensor noise. Both simulated and real experiments demonstrate its superior performance in PSF engineered microscopes with short exposure and dense excitations, which holds great potential in fast 3D super-resolution microscopy.
Collapse
|
21
|
Estimating the dynamic range of quantitative single-molecule localization microscopy. Biophys J 2021; 120:3901-3910. [PMID: 34437847 DOI: 10.1016/j.bpj.2021.08.024] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Revised: 08/09/2021] [Accepted: 08/19/2021] [Indexed: 01/01/2023] Open
Abstract
In recent years, there have been significant advances in quantifying molecule copy number and protein stoichiometry with single-molecule localization microscopy (SMLM). However, as the density of fluorophores per diffraction-limited spot increases, distinguishing between detection events from different fluorophores becomes progressively more difficult, affecting the accuracy of such measurements. Although essential to the design of quantitative experiments, the dynamic range of SMLM counting techniques has not yet been studied in detail. Here, we provide a working definition of the dynamic range for quantitative SMLM in terms of the relative number of missed localizations or blinks and explore the photophysical and experimental parameters that affect it. We begin with a simple two-state model of blinking fluorophores, then extend the model to incorporate photobleaching and temporal binning by the detection camera. From these models, we first show that our estimates of the dynamic range agree with realistic simulations of the photoswitching. We find that the dynamic range scales inversely with the duty cycle when counting both blinks and localizations. Finally, we validate our theoretical approach on direct stochastic optical reconstruction microscopy (dSTORM) data sets of photoswitching Alexa Fluor 647 dyes. Our results should help guide researchers in designing and implementing SMLM-based molecular counting experiments.
Collapse
|
22
|
Ryan DP, Dunlap MK, Gelfand MP, Werner JH, Van Orden AK, Goodwin PM. A gain series method for accurate EMCCD calibration. Sci Rep 2021; 11:18348. [PMID: 34526588 PMCID: PMC8443689 DOI: 10.1038/s41598-021-97759-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 08/27/2021] [Indexed: 11/09/2022] Open
Abstract
Calibration of the gain and digital conversion factor of an EMCCD is necessary for accurate photon counting. We present a new method to quickly calibrate multiple gain settings of an EMCCD camera. Acquiring gain-series calibration data and analyzing the resulting images with the EMCCD noise model more accurately estimates the gain response of the camera. Furthermore, we develop a method to compare the results from different calibration approaches. Gain-series calibration outperforms all other methods in this self-consistency test.
Collapse
Affiliation(s)
- Duncan P Ryan
- Center for Integrated Nanotechnologies, Los Alamos National Laboratory, Los Alamos, 87545, USA.
| | - Megan K Dunlap
- Department of Chemistry, Colorado State University, Fort Collins, CO, 80523, USA
| | - Martin P Gelfand
- Department of Physics, Colorado State University, Fort Collins, CO, 80523, USA
| | - James H Werner
- Center for Integrated Nanotechnologies, Los Alamos National Laboratory, Los Alamos, 87545, USA
| | - Alan K Van Orden
- Department of Chemistry, Colorado State University, Fort Collins, CO, 80523, USA
| | - Peter M Goodwin
- Center for Integrated Nanotechnologies, Los Alamos National Laboratory, Los Alamos, 87545, USA
| |
Collapse
|
23
|
Kilic Z, Sgouralis I, Heo W, Ishii K, Tahara T, Pressé S. Extraction of rapid kinetics from smFRET measurements using integrative detectors. CELL REPORTS. PHYSICAL SCIENCE 2021; 2:100409. [PMID: 34142102 PMCID: PMC8208598 DOI: 10.1016/j.xcrp.2021.100409] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
Hidden Markov models (HMMs) are used to learn single-molecule kinetics across a range of experimental techniques. By their construction, HMMs assume that single-molecule events occur on slower timescales than those of data acquisition. To move beyond that HMM limitation and allow for single-molecule events to occur on any timescale, we must treat single-molecule events in continuous time as they occur in nature. We propose a method to learn kinetic rates from single-molecule Förster resonance energy transfer (smFRET) data collected by integrative detectors, even if those rates exceed data acquisition rates. To achieve that, we exploit our recently proposed "hidden Markov jump process" (HMJP), with which we learn transition kinetics from parallel measurements in donor and acceptor channels. HMJPs generalize the HMM paradigm in two critical ways: (1) they deal with physical smFRET systems as they switch between conformational states in continuous time, and (2) they estimate transition rates between conformational states directly without having recourse to transition probabilities or assuming slow dynamics. Our continuous-time treatment learns the transition kinetics and photon emission rates for dynamic regimes that are inaccessible to HMMs, which treat system kinetics in discrete time. We validate our framework's robustness on simulated data and demonstrate its performance on experimental data from FRET-labeled Holliday junctions.
Collapse
Affiliation(s)
- Zeliha Kilic
- Center for Biological Physics, Department of Physics, Arizona State University, Tempe, AZ 85287, USA
| | - Ioannis Sgouralis
- Department of Mathematics, University of Tennessee, Knoxville, TN 37996, USA
| | - Wooseok Heo
- Molecular Spectroscopy Laboratory, RIKEN, 2-1 Hirosawa, Wako, Saitama 351-0198, Japan
| | - Kunihiko Ishii
- Molecular Spectroscopy Laboratory, RIKEN, 2-1 Hirosawa, Wako, Saitama 351-0198, Japan
- Ultrafast Spectroscopy Research Team, RIKEN Center for Advanced Photonics (RAP), 2-1 Hirosawa, Wako, Saitama 351-0198, Japan
| | - Tahei Tahara
- Molecular Spectroscopy Laboratory, RIKEN, 2-1 Hirosawa, Wako, Saitama 351-0198, Japan
- Ultrafast Spectroscopy Research Team, RIKEN Center for Advanced Photonics (RAP), 2-1 Hirosawa, Wako, Saitama 351-0198, Japan
| | - Steve Pressé
- Center for Biological Physics, Department of Physics, Arizona State University, Tempe, AZ 85287, USA
- School of Molecular Sciences, Arizona State University, Tempe, AZ 85287, USA
- Lead contact
| |
Collapse
|
24
|
Danial JSH, Shalaby R, Cosentino K, Mahmoud MM, Medhat F, Klenerman D, Garcia Saez AJ. DeepSinse: deep learning based detection of single molecules. Bioinformatics 2021; 37:3998-4000. [PMID: 33964131 DOI: 10.1093/bioinformatics/btab352] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 04/14/2021] [Accepted: 05/06/2021] [Indexed: 11/14/2022] Open
Abstract
MOTIVATION Imaging single molecules has emerged as a powerful characterization tool in the biological sciences. The detection of these under various noise conditions requires the use of algorithms that are dependent on the end-user inputting several parameters, the choice of which can be challenging and subjective. RESULTS In this work, we propose DeepSinse, an easily-trainable and useable deep neural network that can detect single molecules with little human input and across a wide range of signal-to-noise ratios. We validate the neural network on the detection of single bursts in simulated and experimental data and compare its performance with the best-in-class, domain-specific algorithms. AVAILABILITY Ground truth ROI simulating code, neural network training, validation code, classification code, ROI picker, GUI for simulating, training and validating DeepSinse as well as pre-trained networks are all released under the MIT License on www.github.com/jdanial/DeepSinse.The dSTORM dataset processing code is released under the MIT License on www.github.com/jdanial/StormProcessor. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- John S H Danial
- Yusuf Hamied Department of Chemistry, University of Cambridge, Cambridge, United Kingdom.,UK Dementia Research Institute, University of Cambridge, Cambridge, United Kingdom
| | - Raed Shalaby
- Institute of Genetics, University of Cologne, Cologne, Germany
| | - Katia Cosentino
- Department of Biology, University of Osnabruck, Osnabruck, Germany
| | - Marwa M Mahmoud
- Department of Computer Science, University of Cambridge, Cambridge, United Kingdom
| | - Fady Medhat
- Department of Computer Science, University of York, York, United Kingdom
| | - David Klenerman
- Yusuf Hamied Department of Chemistry, University of Cambridge, Cambridge, United Kingdom.,UK Dementia Research Institute, University of Cambridge, Cambridge, United Kingdom
| | | |
Collapse
|
25
|
Martin-Fernandez ML. A brief history of the octopus imaging facility to celebrate its 10th anniversary. J Microsc 2020; 281:3-15. [PMID: 33111321 DOI: 10.1111/jmi.12974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Revised: 10/19/2020] [Accepted: 10/23/2020] [Indexed: 11/27/2022]
Abstract
Octopus (Optics Clustered to OutPut Unique Solutions) celebrated in June 2020 its 10th birthday. Based at Harwell, near Oxford, Octopus is an open access, peer reviewed, national imaging facility that offers successful U.K. applicants supported access to single molecule imaging, confocal microscopy, several flavours of superresolution imaging, light sheet microscopy, optical trapping and cryoscanning electron microscopy. Managed by a multidisciplinary team, Octopus has so far assisted >100 groups of U.K. and international researchers. Cross-fertilisation across fields proved to be a strong propeller of success underpinned by combining access to top-end instrumentation with a strong programme of imaging hardware and software developments. How Octopus was born, and highlights of the multidisciplinary output produced during its 10-year journey are reviewed below, with the aim of celebrating a myriad of collaborations with the U.K. scientific community, and reflecting on their scientific and societal impact.
Collapse
Affiliation(s)
- M L Martin-Fernandez
- Central Laser Facility, Research Complex at Harwell, Rutherford Appleton Laboratory, Harwell, Didcot, Oxford, U.K
| |
Collapse
|
26
|
Switching behaviour of dSTORM dyes in glycerol-containing buffer. Sci Rep 2020; 10:13746. [PMID: 32792515 PMCID: PMC7426933 DOI: 10.1038/s41598-020-70335-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Accepted: 07/02/2020] [Indexed: 11/08/2022] Open
Abstract
To suppress optical aberrations caused by refractive index mismatch, we employ glycerol-immersion objectives in conjunction with fused silica cover glasses and imaging buffers with a high glycerol content. Here we demonstrate that the addition of glycerol to the buffer does not degrade the switching behaviour of the dyes Alexa Fluor 647 and Alexa Fluor 568 in dSTORM measurements, which shows that this approach is suitable for dSTORM. Additionally, we report evidence that sealed sample geometries as used in our experiments reduce photobleaching due to the lower influx of oxygen into the imaging buffer.
Collapse
|
27
|
Hotaka H, O'Connor T, Ohsuka S, Javidi B. Photon-counting 3D integral imaging with less than a single photon per pixel on average using a statistical model of the EM-CCD camera. OPTICS LETTERS 2020; 45:2327-2330. [PMID: 32287225 DOI: 10.1364/ol.389776] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Accepted: 03/13/2020] [Indexed: 06/11/2023]
Abstract
We investigate photon-counting 3D integral imaging (PCII) with an electron multiplying charged-coupled device (EM-CCD) camera using dedicated statistical models. Using conventional integral imaging reconstruction methods with this camera in photon-counting conditions may result in degraded reconstructed image quality if multiple photons are detected simultaneously in a given pixel. We propose an estimation method derived from the photon detection statistical model of the EM-CCD to address the problems caused by multiple photons detected at the same pixel and provide improved 3D reconstructions. We also present a simplified version of this statistical method that can be used under the correct conditions. The imaging performance of these methods is evaluated on experimental data by the peak signal-to-noise ratio and the structural similarity index measure. The experiments demonstrate that 3D integral imaging substantially outperforms 2D imaging in degraded conditions. Furthermore, we achieve imaging in photon-counting conditions where, on average, less than a single photon per pixel is detected by the camera. To the best of our knowledge, this is the first report of PCII with the EM-CCD camera employing its statistical model in 3D reconstruction of PCII.
Collapse
|
28
|
Bouwens A, Deen J, Vitale R, D’Huys L, Goyvaerts V, Descloux A, Borrenberghs D, Grussmayer K, Lukes T, Camacho R, Su J, Ruckebusch C, Lasser T, Van De Ville D, Hofkens J, Radenovic A, Frans Janssen KP. Identifying microbial species by single-molecule DNA optical mapping and resampling statistics. NAR Genom Bioinform 2020; 2:lqz007. [PMID: 33575560 PMCID: PMC7671359 DOI: 10.1093/nargab/lqz007] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2019] [Accepted: 09/12/2019] [Indexed: 12/13/2022] Open
Abstract
Single-molecule DNA mapping has the potential to serve as a powerful complement to high-throughput sequencing in metagenomic analysis. Offering longer read lengths and forgoing the need for complex library preparation and amplification, mapping stands to provide an unbiased view into the composition of complex viromes and/or microbiomes. To fully enable mapping-based metagenomics, sensitivity and specificity of DNA map analysis and identification need to be improved. Using detailed simulations and experimental data, we first demonstrate how fluorescence imaging of surface stretched, sequence specifically labeled DNA fragments can yield highly sensitive identification of targets. Second, a new analysis technique is introduced to increase specificity of the analysis, allowing even closely related species to be resolved. Third, we show how an increase in resolution improves sensitivity. Finally, we demonstrate that these methods are capable of identifying species with long genomes such as bacteria with high sensitivity.
Collapse
Affiliation(s)
- Arno Bouwens
- Department of Chemistry, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
- Institute of Bioengineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | - Jochem Deen
- Institute of Bioengineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
- School of Engineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | - Raffaele Vitale
- Department of Chemistry, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
- LASIR CNRS, Université de Lille, 59655 Villeneuve d’Ascq, France
| | - Laurens D’Huys
- Department of Chemistry, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Vince Goyvaerts
- Department of Chemistry, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Adrien Descloux
- Institute of Bioengineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
- School of Engineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | | | - Kristin Grussmayer
- Institute of Bioengineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
- School of Engineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | - Tomas Lukes
- School of Engineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | - Rafael Camacho
- Department of Chemistry, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Jia Su
- Department of Chemistry, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Cyril Ruckebusch
- LASIR CNRS, Université de Lille, 59655 Villeneuve d’Ascq, France
| | - Theo Lasser
- School of Engineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | - Dimitri Van De Ville
- Institute of Bioengineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
- Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
- Department of Radiology and Medical Informatics, Université de Genève, 1205 Genève, Switzerland
| | - Johan Hofkens
- Department of Chemistry, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Aleksandra Radenovic
- Institute of Bioengineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
- School of Engineering, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | | |
Collapse
|
29
|
Staudt T, Aspelmeier T, Laitenberger O, Geisler C, Egner A, Munk A. Statistical Molecule Counting in Super-Resolution Fluorescence Microscopy: Towards Quantitative Nanoscopy. Stat Sci 2020. [DOI: 10.1214/19-sts753] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
30
|
Garry J, Li Y, Shew B, Gradinaru CC, Rutenberg AD. Bayesian counting of photobleaching steps with physical priors. J Chem Phys 2020; 152:024110. [DOI: 10.1063/1.5132957] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Affiliation(s)
- Jon Garry
- Department of Physics & Atmospheric Science, Dalhousie University, Halifax, Nova Scotia B3H 4R2, Canada
| | - Yuchong Li
- Department of Chemical and Physical Sciences, University of Toronto Mississauga, Mississauga, Ontario L5L 1C6, Canada
| | - Brandon Shew
- Department of Chemical and Physical Sciences, University of Toronto Mississauga, Mississauga, Ontario L5L 1C6, Canada
| | - Claudiu C. Gradinaru
- Department of Chemical and Physical Sciences, University of Toronto Mississauga, Mississauga, Ontario L5L 1C6, Canada
| | - Andrew D. Rutenberg
- Department of Physics & Atmospheric Science, Dalhousie University, Halifax, Nova Scotia B3H 4R2, Canada
| |
Collapse
|
31
|
Lacy MM, Baddeley D, Berro J. Single-molecule turnover dynamics of actin and membrane coat proteins in clathrin-mediated endocytosis. eLife 2019; 8:52355. [PMID: 31855180 PMCID: PMC6977972 DOI: 10.7554/elife.52355] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Accepted: 12/18/2019] [Indexed: 12/22/2022] Open
Abstract
Actin dynamics generate forces to deform the membrane and overcome the cell’s high turgor pressure during clathrin-mediated endocytosis (CME) in yeast, but precise molecular details are still unresolved. Our previous models predicted that actin filaments of the endocytic meshwork continually polymerize and disassemble, turning over multiple times during an endocytic event, similar to other actin systems. We applied single-molecule speckle tracking in live fission yeast to directly measure molecular turnover within CME sites for the first time. In contrast with the overall ~20 s lifetimes of actin and actin-associated proteins in endocytic patches, we detected single-molecule residence times around 1 to 2 s, and similarly high turnover rates of membrane-associated proteins in CME. Furthermore, we find heterogeneous behaviors in many proteins’ motions. These results indicate that endocytic proteins turn over up to five times during the formation of an endocytic vesicle, and suggest revising quantitative models of force production.
Collapse
Affiliation(s)
- Michael M Lacy
- Department of Molecular Biophysics and Biochemistry, Yale University, New Haven, United States.,Nanobiology Institute, Yale University, West Haven, United States.,Integrated Graduate Program in Physical and Engineering Biology, Yale University, New Haven, United States
| | - David Baddeley
- Nanobiology Institute, Yale University, West Haven, United States.,Department of Cell Biology, Yale University School of Medicine, New Haven, United States
| | - Julien Berro
- Department of Molecular Biophysics and Biochemistry, Yale University, New Haven, United States.,Nanobiology Institute, Yale University, West Haven, United States.,Department of Cell Biology, Yale University School of Medicine, New Haven, United States
| |
Collapse
|
32
|
Lacy MM, Baddeley D, Berro J. Single-molecule turnover dynamics of actin and membrane coat proteins in clathrin-mediated endocytosis. eLife 2019; 8. [PMID: 31855180 DOI: 10.1101/617746] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Accepted: 12/18/2019] [Indexed: 05/20/2023] Open
Abstract
Actin dynamics generate forces to deform the membrane and overcome the cell's high turgor pressure during clathrin-mediated endocytosis (CME) in yeast, but precise molecular details are still unresolved. Our previous models predicted that actin filaments of the endocytic meshwork continually polymerize and disassemble, turning over multiple times during an endocytic event, similar to other actin systems. We applied single-molecule speckle tracking in live fission yeast to directly measure molecular turnover within CME sites for the first time. In contrast with the overall ~20 s lifetimes of actin and actin-associated proteins in endocytic patches, we detected single-molecule residence times around 1 to 2 s, and similarly high turnover rates of membrane-associated proteins in CME. Furthermore, we find heterogeneous behaviors in many proteins' motions. These results indicate that endocytic proteins turn over up to five times during the formation of an endocytic vesicle, and suggest revising quantitative models of force production.
Collapse
Affiliation(s)
- Michael M Lacy
- Department of Molecular Biophysics and Biochemistry, Yale University, New Haven, United States
- Nanobiology Institute, Yale University, West Haven, United States
- Integrated Graduate Program in Physical and Engineering Biology, Yale University, New Haven, United States
| | - David Baddeley
- Nanobiology Institute, Yale University, West Haven, United States
- Department of Cell Biology, Yale University School of Medicine, New Haven, United States
| | - Julien Berro
- Department of Molecular Biophysics and Biochemistry, Yale University, New Haven, United States
- Nanobiology Institute, Yale University, West Haven, United States
- Department of Cell Biology, Yale University School of Medicine, New Haven, United States
| |
Collapse
|
33
|
Almasi S, Pratx G. High-Resolution Radioluminescence Microscopy Image Reconstruction via Ionization Track Analysis. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2019. [DOI: 10.1109/trpms.2019.2908219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
34
|
Sehayek S, Gidi Y, Glembockyte V, Brandão HB, François P, Cosa G, Wiseman PW. A High-Throughput Image Correlation Method for Rapid Analysis of Fluorophore Photoblinking and Photobleaching Rates. ACS NANO 2019; 13:11955-11966. [PMID: 31513377 DOI: 10.1021/acsnano.9b06033] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Super-resolution fluorescence imaging based on localization microscopy requires tuning the photoblinking properties of fluorescent dyes employed. Missing is a rapid way to analyze the blinking rates of the fluorophore probes. Herein we present an ensemble autocorrelation technique for rapidly and simultaneously measuring photoblinking and bleaching rate constants from a microscopy image time series of fluorescent probes that is significantly faster than individual single-molecule trajectory analysis approaches. Our method is accurate for probe densities typically encountered in single-molecule studies as well as for higher density systems which cannot be analyzed by standard single-molecule techniques. We also show that we can resolve characteristic blinking times that are faster than camera detector exposure times, which cannot be accessed by threshold-based single-molecule approaches due to aliasing. We confirm this through computer simulation and single-molecule imaging data of DNA-Cy5 complexes. Finally, we demonstrate that with sufficient sampling our technique can accurately recover rates from stochastic optical reconstruction microscopy super-resolution data.
Collapse
Affiliation(s)
- Simon Sehayek
- Department of Physics , McGill University , Montreal , QC , Canada H3A 2T8
| | - Yasser Gidi
- Department of Chemistry , McGill University , Montreal , QC , Canada H3A 0B8
| | | | - Hugo B Brandão
- Department of Physics , McGill University , Montreal , QC , Canada H3A 2T8
| | - Paul François
- Department of Physics , McGill University , Montreal , QC , Canada H3A 2T8
| | - Gonzalo Cosa
- Department of Chemistry , McGill University , Montreal , QC , Canada H3A 0B8
| | - Paul W Wiseman
- Department of Physics , McGill University , Montreal , QC , Canada H3A 2T8
- Department of Chemistry , McGill University , Montreal , QC , Canada H3A 0B8
| |
Collapse
|
35
|
Vandenberg W, Leutenegger M, Duwé S, Dedecker P. An extended quantitative model for super-resolution optical fluctuation imaging (SOFI). OPTICS EXPRESS 2019; 27:25749-25766. [PMID: 31510441 DOI: 10.1364/oe.27.025749] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/06/2019] [Accepted: 05/20/2019] [Indexed: 05/21/2023]
Abstract
Super-resolution optical fluctuation imaging (SOFI) provides super-resolution (SR) fluorescence imaging by analyzing fluctuations in the fluorophore emission. The technique has been used both to acquire quantitative SR images and to provide SR biosensing by monitoring changes in fluorophore blinking dynamics. Proper analysis of such data relies on a fully quantitative model of the imaging. However, previous SOFI imaging models made several assumptions that can not be realized in practice. In this work we address these limitations by developing and verifying a fully quantitative model that better approximates real-world imaging conditions. Our model shows that (i) SOFI images are free of bias, or can be made so, if the signal is stationary and fluorophores blink independently, (ii) allows a fully quantitative description of the link between SOFI imaging and probe dynamics, and (iii) paves the way for more advanced SOFI image reconstruction by offering a computationally fast way to calculate SOFI images for arbitrary probe, sample and instrumental properties.
Collapse
|
36
|
Samuylov DK, Purwar P, Szekely G, Paul G. Modeling Point Spread Function in Fluorescence Microscopy With a Sparse Gaussian Mixture: Tradeoff Between Accuracy and Efficiency. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 28:3688-3702. [PMID: 30762548 DOI: 10.1109/tip.2019.2898843] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Deblurring is a fundamental inverse problem in bioimaging. It requires modeling the point spread function (PSF), which captures the optical distortions entailed by the image formation process. The PSF limits the spatial resolution attainable for a given microscope. However, recent applications require a higher resolution and have prompted the development of super-resolution techniques to achieve sub-pixel accuracy. This requirement restricts the class of suitable PSF models to analog ones. In addition, deblurring is computationally intensive, hence further requiring computationally efficient models. A custom candidate fitting both the requirements is the Gaussian model. However, this model cannot capture the rich tail structures found in both the theoretical and empirical PSFs. In this paper, we aim at improving the reconstruction accuracy beyond the Gaussian model, while preserving its computational efficiency. We introduce a new class of analog PSF models based on the Gaussian mixtures. The number of Gaussian kernels controls both the modeling accuracy and the computational efficiency of the model: the lower the number of kernels, the lower the accuracy and the higher the efficiency. To explore the accuracy-efficiency tradeoff, we propose a variational formulation of the PSF calibration problem, where a convex sparsity-inducing penalty on the number of Gaussian kernels allows trading accuracy for efficiency. We derive an efficient algorithm based on a fully split formulation of alternating split Bregman. We assess our framework on synthetic and real data, and demonstrate a better reconstruction accuracy in both geometry and photometry in point source localization-a fundamental inverse problem in fluorescence microscopy.
Collapse
|
37
|
Sage D, Pham TA, Babcock H, Lukes T, Pengo T, Chao J, Velmurugan R, Herbert A, Agrawal A, Colabrese S, Wheeler A, Archetti A, Rieger B, Ober R, Hagen GM, Sibarita JB, Ries J, Henriques R, Unser M, Holden S. Super-resolution fight club: assessment of 2D and 3D single-molecule localization microscopy software. Nat Methods 2019; 16:387-395. [PMID: 30962624 PMCID: PMC6684258 DOI: 10.1038/s41592-019-0364-4] [Citation(s) in RCA: 154] [Impact Index Per Article: 30.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2018] [Accepted: 02/26/2019] [Indexed: 11/24/2022]
Abstract
With the widespread uptake of 2D and 3D single molecule localization microscopy, a large set of different data analysis packages have been developed to generate super-resolution images. In a large community effort we designed a competition to extensively characterise and rank the performance of 2D and 3D single molecule localization microscopy software packages. We generated realistic simulated datasets for popular imaging modalities - 2D, astigmatic 3D, biplane 3D, and double helix 3D - and evaluated 36 participant packages against these data. This provides the first broad assessment of 3D single molecule localization microscopy software and provides a holistic view of how the latest 2D and 3D single molecule localization software perform in realistic conditions. This resource allows researchers to identify optimal analytical software for their experiments, allows 3D SMLM software developers to benchmark new software against current state of the art, and provides insight into the current limits of the field. This study reports results from the second community-wide single molecule localization microscopy software challenge, which tested over thirty software packages on realistic simulated data for multiple popular 3D image acquisition modes as well as 2D localization microscopy.
Collapse
Affiliation(s)
- Daniel Sage
- Biomedical Imaging Group, School of Engineering, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
| | - Thanh-An Pham
- Biomedical Imaging Group, School of Engineering, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Hazen Babcock
- Harvard Center for Advanced Imaging, Harvard University, Cambridge, MA, USA
| | - Tomas Lukes
- Laboratory of Nanoscale Biology and Laboratoire d'Optique Biomédicale, STI - IBI, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.,Department of Radioelectronics, FEE, Czech Technical University, Prague, Czech Republic
| | - Thomas Pengo
- University of Minnesota Informatics Institute, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Jerry Chao
- Department of Biomedical Engineering, Texas A&M University, College Station, TX, USA.,Department of Molecular and Cellular Medicine, Texas A&M University Health Science Center, College Station, TX, USA
| | - Ramraj Velmurugan
- Department of Molecular and Cellular Medicine, Texas A&M University Health Science Center, College Station, TX, USA.,Department of Microbial Pathogenesis and Immunology, Texas A&M University Health Science Center, Bryan, TX, USA
| | - Alex Herbert
- MRC Genome Damage and Stability Centre, School of Life Sciences, University of Sussex, Brighton, UK
| | | | - Silvia Colabrese
- Biomedical Imaging Group, School of Engineering, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.,Istituto Italiano di Tecnologia, Genova, Italy
| | - Ann Wheeler
- Advanced Imaging Resource, Institute of Genetics and Molecular Medicine, University of Edinburgh, Edinburgh, UK
| | - Anna Archetti
- Laboratory of Experimental Biophysics, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Bernd Rieger
- Department of Imaging Physics, Delft University of Technology, Delft, the Netherlands
| | - Raimund Ober
- Department of Biomedical Engineering, Texas A&M University, College Station, TX, USA.,Department of Molecular and Cellular Medicine, Texas A&M University Health Science Center, College Station, TX, USA.,Centre for Cancer Immunology, University of Southampton, Southampton, UK
| | - Guy M Hagen
- UCCS Center for the Biofrontiers Institute, University of Colorado, Colorado Springs, CO, USA
| | - Jean-Baptiste Sibarita
- Interdisciplinary Institute for Neuroscience, University of Bordeaux, Bordeaux, France.,Interdisciplinary Institute for Neuroscience, Centre National de la Recherche Scientifique (CNRS) UMR 5297, Bordeaux, France
| | - Jonas Ries
- European Molecular Biology Laboratory, Cell Biology and Biophysics Unit, Heidelberg, Germany
| | - Ricardo Henriques
- Quantitative Imaging and Nanobiophysics Group, MRC Laboratory for Molecular Cell Biology, University College London, London, UK
| | - Michael Unser
- Biomedical Imaging Group, School of Engineering, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Seamus Holden
- Centre for Bacterial Cell Biology, Institute for Cell and Molecular Biosciences, Newcastle University, Newcastle, UK.
| |
Collapse
|
38
|
Zarrabi N, Schluesche P, Meisterernst M, Börsch M, Lamb DC. Analyzing the Dynamics of Single TBP-DNA-NC2 Complexes Using Hidden Markov Models. Biophys J 2018; 115:2310-2326. [PMID: 30527334 DOI: 10.1016/j.bpj.2018.11.015] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2018] [Revised: 11/12/2018] [Accepted: 11/12/2018] [Indexed: 10/27/2022] Open
Abstract
Single-pair Förster resonance energy transfer (spFRET) has become an important tool for investigating conformational dynamics in biological systems. To extract dynamic information from the spFRET traces measured with total internal reflection fluorescence microscopy, we extended the hidden Markov model (HMM) approach. In our extended HMM analysis, we incorporated the photon-shot noise from camera-based systems into the HMM. Thus, the variance in Förster resonance energy transfer (FRET) efficiency of the various states, which is typically a fitted parameter, is explicitly included in the analysis estimated from the number of detected photons. It is also possible to include an additional broadening of the FRET state, which would then only reflect the inherent flexibility of the dynamic biological systems. This approach is useful when comparing the dynamics of individual molecules for which the total intensities vary significantly. We used spFRET with the extended HMM analysis to investigate the dynamics of TATA-box-binding protein (TBP) on promoter DNA in the presence of negative cofactor 2 (NC2). We compared the dynamics of two promoters as well as DNAs of different length and labeling location. For the adenovirus major late promoter, four FRET states were observed; three states correspond to different conformations of the DNA in the TBP-DNA-NC2 complex and a four-state model in which the complex has shifted along the DNA. The HMM analysis revealed that the states are connected via a linear, four-well model. For the H2B promoter, more complex dynamics were observed. By clustering the FRET states detected with the HMM analysis, we could compare the general dynamics observed for the two promoter sequences. We observed that the dynamics from a stretched DNA conformation to a bent conformation for the two promoters were similar, whereas the bent conformation of the TBP-DNA-NC2 complex for the H2B promoter is approximately three times more stable than for the adenovirus major late promoter.
Collapse
Affiliation(s)
- Nawid Zarrabi
- Physikalisches Institut, University of Stuttgart, Stuttgart, Baden-Württemberg, Germany; Single-Molecule Microscopy Group, Jena University Hospital, Jena, Thuringia, Germany
| | - Peter Schluesche
- Department Chemie, Center for Nano Science, Center for Integrated Protein Science, and Nanosystems Initiative München, Ludwig-Maximilians-Universität Munich, Munich, Bavaria, Germany
| | - Michael Meisterernst
- GSF-National Research Center for Environment and Health, Gene Expression, Munich, Bavaria, Germany; Institute of Molecular Tumor Biology, Faculty of Medicine, University of Muenster, Muenster, North Rhine-Westphalia, Germany
| | - Michael Börsch
- Physikalisches Institut, University of Stuttgart, Stuttgart, Baden-Württemberg, Germany; Single-Molecule Microscopy Group, Jena University Hospital, Jena, Thuringia, Germany
| | - Don C Lamb
- Department Chemie, Center for Nano Science, Center for Integrated Protein Science, and Nanosystems Initiative München, Ludwig-Maximilians-Universität Munich, Munich, Bavaria, Germany.
| |
Collapse
|
39
|
Samuylov DK, Szekely G, Paul G. A Bayesian framework for the analog reconstruction of kymographs from fluorescence microscopy data. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2018; 28:410-425. [PMID: 30183629 DOI: 10.1109/tip.2018.2867946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Kymographs are widely used to represent and analyse spatio-temporal dynamics of fluorescence markers along curvilinear biological compartments. These objects have a singular geometry, thus kymograph reconstruction is inherently an analog image processing task. However, the existing approaches are essentially digital: the kymograph photometry is sampled directly from the time-lapse images. As a result, such kymographs rely on raw image data that suffer from the degradations entailed by the image formation process and the spatio-temporal resolution of the imaging setup. In this work, we address these limitations and introduce a well-grounded Bayesian framework for the analog reconstruction of kymographs. To handle the movement of the object, we introduce an intrinsic description of kymographs using differential geometry: a kymograph is a photometry defined on a parameter space that is embedded in physical space by a time-varying map that follows the object geometry. We model the kymograph photometry as a Lévy innovation process, a flexible class of non-parametric signal priors. We account for the image formation process using the virtual microscope framework. We formulate a computationally tractable representation of the associated maximum a posteriori problem and solve it using a class of efficient and modular algorithms based on the alternating split Bregman. We assess the performance of our Bayesian framework on synthetic data and apply it to reconstruct the fluorescence dynamics along microtubules in vivo in the budding yeast S. cerevisiae. We demonstrate that our framework allows revealing patterns from single time-lapse data that are invisible on standard digital kymographs.
Collapse
|
40
|
Hadzic MCAS, Börner R, König SLB, Kowerko D, Sigel RKO. Reliable State Identification and State Transition Detection in Fluorescence Intensity-Based Single-Molecule Förster Resonance Energy-Transfer Data. J Phys Chem B 2018; 122:6134-6147. [PMID: 29737844 DOI: 10.1021/acs.jpcb.7b12483] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Single-molecule Förster resonance energy transfer (smFRET) is a powerful technique to probe biomolecular structure and dynamics. A popular implementation of smFRET consists of recording fluorescence intensity time traces of surface-immobilized, chromophore-tagged molecules. This approach generates large and complex data sets, the analysis of which is to date not standardized. Here, we address a key challenge in smFRET data analysis: the generation of thermodynamic and kinetic models that describe with statistical rigor the behavior of FRET trajectories recorded from surface-tethered biomolecules in terms of the number of FRET states, the corresponding mean FRET values, and the kinetic rates at which they interconvert. For this purpose, we first perform Monte Carlo simulations to generate smFRET trajectories, in which a relevant space of experimental parameters is explored. Then, we provide an account on current strategies to achieve such model selection, as well as a quantitative assessment of their performances. Specifically, we evaluate the performance of each algorithm (change-point analysis, STaSI, HaMMy, vbFRET, and ebFRET) with respect to accuracy, reproducibility, and computing time, which yields a range of algorithm-specific referential benchmarks for various data qualities. Data simulation and analysis were performed with our MATLAB-based multifunctional analysis software for handling smFRET data (MASH-FRET).
Collapse
Affiliation(s)
| | | | | | - Danny Kowerko
- Department of Computer Science , Chemnitz University of Technology , 09111 Chemnitz , Germany
| | | |
Collapse
|
41
|
Scotté C, de Aguiar HB, Marguet D, Green EM, Bouzy P, Vergnole S, Winlove CP, Stone N, Rigneault H. Assessment of Compressive Raman versus Hyperspectral Raman for Microcalcification Chemical Imaging. Anal Chem 2018; 90:7197-7203. [DOI: 10.1021/acs.analchem.7b05303] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- Camille Scotté
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| | - Hilton B. de Aguiar
- Département de Physique, Ecole Normale Supérieure/PSL Research University, CNRS, 24 rue Lhomond, 75005 Paris, France
| | - Didier Marguet
- Aix-Marseille Université, INSERM, CNRS, Centre d’Immunologie de Marseille-Luminy, Marseille, France
| | - Ellen Marie Green
- School of Physics and Astronomy, University of Exeter, Exeter, United Kingdom
| | - Pascaline Bouzy
- School of Physics and Astronomy, University of Exeter, Exeter, United Kingdom
| | | | | | - Nicholas Stone
- School of Physics and Astronomy, University of Exeter, Exeter, United Kingdom
| | - Hervé Rigneault
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| |
Collapse
|
42
|
Börner R, Kowerko D, Hadzic MCAS, König SLB, Ritter M, Sigel RKO. Simulations of camera-based single-molecule fluorescence experiments. PLoS One 2018; 13:e0195277. [PMID: 29652886 PMCID: PMC5898730 DOI: 10.1371/journal.pone.0195277] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Accepted: 03/19/2018] [Indexed: 01/23/2023] Open
Abstract
Single-molecule microscopy has become a widely used technique in (bio)physics and (bio)chemistry. A popular implementation is single-molecule Förster Resonance Energy Transfer (smFRET), for which total internal reflection fluorescence microscopy is frequently combined with camera-based detection of surface-immobilized molecules. Camera-based smFRET experiments generate large and complex datasets and several methods for video processing and analysis have been reported. As these algorithms often address similar aspects in video analysis, there is a growing need for standardized comparison. Here, we present a Matlab-based software (MASH-FRET) that allows for the simulation of camera-based smFRET videos, yielding standardized data sets suitable for benchmarking video processing algorithms. The software permits to vary parameters that are relevant in cameras-based smFRET, such as video quality, and the properties of the system under study. Experimental noise is modeled taking into account photon statistics and camera noise. Finally, we survey how video test sets should be designed to evaluate currently available data analysis strategies in camera-based sm fluorescence experiments. We complement our study by pre-optimizing and evaluating spot detection algorithms using our simulated video test sets.
Collapse
Affiliation(s)
- Richard Börner
- Department of Chemistry, University of Zurich, Zurich, Switzerland
| | - Danny Kowerko
- Department of Computer Science, Chemnitz University of Technology, Chemnitz, Germany
| | | | - Sebastian L. B. König
- Department of Chemistry, University of Zurich, Zurich, Switzerland
- Department of Biochemistry, University of Zurich, Zurich, Switzerland
| | - Marc Ritter
- Department of Applied Computer and Biosciences, Mittweida University of Applied Sciences, Mittweida, Germany
| | | |
Collapse
|
43
|
Wang Q, Sengupta D, Kim TJ, Pratx G. In silico optimization of radioluminescence microscopy. JOURNAL OF BIOPHOTONICS 2018; 11:10.1002/jbio.201700138. [PMID: 28945305 PMCID: PMC5839938 DOI: 10.1002/jbio.201700138] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/27/2017] [Revised: 09/19/2017] [Accepted: 09/21/2017] [Indexed: 06/07/2023]
Abstract
Radioluminescence microscopy (RLM) is a high-resolution method for imaging radionuclide uptake in live cells within a fluorescence microscopy environment. Although RLM currently provides sufficient spatial resolution and sensitivity for cell imaging, it has not been systematically optimized. This study seeks to optimize the parameters of the system by computational simulation using a combination of numerical models for the system's various components: Monte-Carlo simulation for radiation transport, 3D optical point-spread function for the microscope, and stochastic photosensor model for the electron multiplying charge coupled device (EMCCD) camera. The relationship between key parameters and performance metrics relevant to image quality is examined. Results show that Lu2 O3 :Eu yields the best performance among 5 different scintillator materials, and a thickness: 8 μm can best balance spatial resolution and sensitivity. For this configuration, a spatial resolution of ~20 μm and sensitivity of 40% can be achieved for all 3 magnifications investigated, provided that the user adjusts pixel binning and electron multiplying (EM) gain accordingly. Hence the primary consideration for selecting the magnification should be the desired field of view and magnification for concurrent optical microscopy studies. In conclusion, this study estimates the optimal imaging performance achievable with RLM and promotes further development for more robust imaging of cellular processes using radiotracers.
Collapse
Affiliation(s)
- Qian Wang
- Department of Radiation Oncology, Stanford University, California
94305, United States
| | - Debanti Sengupta
- Department of Radiation Oncology, Stanford University, California
94305, United States
| | - Tae Jin Kim
- Department of Radiation Oncology, Stanford University, California
94305, United States
| | - Guillem Pratx
- Department of Radiation Oncology, Stanford University, California
94305, United States
| |
Collapse
|
44
|
Kwon M, Ebert MF, Walker TG, Saffman M. Parallel Low-Loss Measurement of Multiple Atomic Qubits. PHYSICAL REVIEW LETTERS 2017; 119:180504. [PMID: 29219611 DOI: 10.1103/physrevlett.119.180504] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2017] [Indexed: 06/07/2023]
Abstract
We demonstrate low-loss measurement of the hyperfine ground state of rubidium atoms by state dependent fluorescence detection in a dipole trap array of five sites. The presence of atoms and their internal states are minimally altered by utilizing circularly polarized probe light and a strictly controlled quantization axis. We achieve mean state detection fidelity of 97% without correcting for imperfect state preparation or background losses, and 98.7% when corrected. After state detection and correction for background losses, the probability of atom loss due to the state measurement is <2% and the initial hyperfine state is preserved with >98% probability.
Collapse
Affiliation(s)
- Minho Kwon
- Department of Physics, University of Wisconsin-Madison, 1150 University Avenue, Madison, Wisconsin 53706, USA
| | - Matthew F Ebert
- Department of Physics, University of Wisconsin-Madison, 1150 University Avenue, Madison, Wisconsin 53706, USA
| | - Thad G Walker
- Department of Physics, University of Wisconsin-Madison, 1150 University Avenue, Madison, Wisconsin 53706, USA
| | - M Saffman
- Department of Physics, University of Wisconsin-Madison, 1150 University Avenue, Madison, Wisconsin 53706, USA
| |
Collapse
|
45
|
Wang Q, Sengupta D, Kim TJ, Pratx G. Performance evaluation of 18 F radioluminescence microscopy using computational simulation. Med Phys 2017; 44:1782-1795. [PMID: 28273348 DOI: 10.1002/mp.12198] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2016] [Revised: 02/09/2017] [Accepted: 02/21/2017] [Indexed: 01/12/2023] Open
Abstract
PURPOSE Radioluminescence microscopy can visualize the distribution of beta-emitting radiotracers in live single cells with high resolution. Here, we perform a computational simulation of 18 F positron imaging using this modality to better understand how radioluminescence signals are formed and to assist in optimizing the experimental setup and image processing. METHODS First, the transport of charged particles through the cell and scintillator and the resulting scintillation is modeled using the GEANT4 Monte-Carlo simulation. Then, the propagation of the scintillation light through the microscope is modeled by a convolution with a depth-dependent point-spread function, which models the microscope response. Finally, the physical measurement of the scintillation light using an electron-multiplying charge-coupled device (EMCCD) camera is modeled using a stochastic numerical photosensor model, which accounts for various sources of noise. The simulated output of the EMCCD camera is further processed using our ORBIT image reconstruction methodology to evaluate the endpoint images. RESULTS The EMCCD camera model was validated against experimentally acquired images and the simulated noise, as measured by the standard deviation of a blank image, was found to be accurate within 2% of the actual detection. Furthermore, point source simulations found that a reconstructed spatial resolution of 18.5 μm can be achieved near the scintillator. As the source is moved away from the scintillator, spatial resolution degrades at a rate of 3.5 μm per μm distance. These results agree well with the experimentally measured spatial resolution of 30-40 μm (live cells). The simulation also shows that the system sensitivity is 26.5%, which is also consistent with our previous experiments. Finally, an image of a simulated sparse set of single cells is visually similar to the measured cell image. CONCLUSIONS Our simulation methodology agrees with experimental measurements taken with radioluminescence microscopy. This in silico approach can be used to guide further instrumentation developments and to provide a framework for improving image reconstruction.
Collapse
Affiliation(s)
- Qian Wang
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94304, USA
| | - Debanti Sengupta
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94304, USA
| | - Tae Jin Kim
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94304, USA
| | - Guillem Pratx
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94304, USA
| |
Collapse
|
46
|
Petrov PN, Shechtman Y, Moerner WE. Measurement-based estimation of global pupil functions in 3D localization microscopy. OPTICS EXPRESS 2017; 25:7945-7959. [PMID: 28380911 PMCID: PMC5810908 DOI: 10.1364/oe.25.007945] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
We report the use of a phase retrieval procedure based on maximum likelihood estimation (MLE) to produce an improved, experimentally calibrated model of a point spread function (PSF) for use in three-dimensional (3D) localization microscopy experiments. The method estimates a global pupil phase function (which includes both the PSF and system aberrations) over the full axial range from a simple calibration scan. The pupil function is used to refine the PSF model and hence enable superior localizations from experimental data. To demonstrate the utility of the procedure, we apply it to experimental data acquired with a microscope employing a tetrapod PSF with a 6 µm axial range. The phase-retrieved model demonstrates significant improvements in both accuracy and precision of 3D localizations relative to the model based on scalar diffraction theory. The localization precision of the phase-retrieved model is shown to be near the limits imposed by estimation theory, and the reproducibility of the procedure is characterized and discussed. Code which performs the phase retrieval algorithm is provided.
Collapse
Affiliation(s)
- Petar N. Petrov
- Department of Chemistry, Stanford University, 333 Campus Drive, Stanford, CA 94305, USA
| | - Yoav Shechtman
- Department of Chemistry, Stanford University, 333 Campus Drive, Stanford, CA 94305, USA
- Present address: Department of Biomedical Engineering, Technion−Israel Institute of Technology, Haifa 32000, Israel
| | - W. E. Moerner
- Department of Chemistry, Stanford University, 333 Campus Drive, Stanford, CA 94305, USA
| |
Collapse
|
47
|
Liu J, Davanço MI, Sapienza L, Konthasinghe K, De Miranda Cardoso JV, Song JD, Badolato A, Srinivasan K. Cryogenic photoluminescence imaging system for nanoscale positioning of single quantum emitters. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2017; 88:023116. [PMID: 28249470 PMCID: PMC5458604 DOI: 10.1063/1.4976578] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
We report a photoluminescence imaging system for locating single quantum emitters with respect to alignment features. Samples are interrogated in a 4 K closed-cycle cryostat by a high numerical aperture (NA = 0.9, 100× magnification) objective that sits within the cryostat, enabling high efficiency collection of emitted photons without image distortions due to the cryostat windows. The locations of single InAs/GaAs quantum dots within a >50 μm × 50 μm field of view are determined with ≈4.5 nm uncertainty (one standard deviation) in a 1 s long acquisition. The uncertainty is determined through a combination of a maximum likelihood estimate for localizing the quantum dot emission, and a cross correlation method for determining the alignment mark center. This location technique can be an important step in the high-throughput creation of nanophotonic devices that rely upon the interaction of highly confined optical modes with single quantum emitters.
Collapse
Affiliation(s)
- Jin Liu
- Center for Nanoscale Science and Technology, National Institute of Standards and Technology, Gaithersburg, Maryland 20899, USA
| | - Marcelo I Davanço
- Center for Nanoscale Science and Technology, National Institute of Standards and Technology, Gaithersburg, Maryland 20899, USA
| | - Luca Sapienza
- Center for Nanoscale Science and Technology, National Institute of Standards and Technology, Gaithersburg, Maryland 20899, USA
| | | | | | - Jin Dong Song
- Center for Opto-Electronic Materials and Devices Research, Korea Institute of Science and Technology, Seoul 136-791, South Korea
| | - Antonio Badolato
- Department of Physics and Astronomy, University of Rochester, Rochester, New York 14627, USA
| | - Kartik Srinivasan
- Center for Nanoscale Science and Technology, National Institute of Standards and Technology, Gaithersburg, Maryland 20899, USA
| |
Collapse
|
48
|
Bohner G, Gustafsson N, Cade NI, Maurer SP, Griffin LD, Surrey T. Important factors determining the nanoscale tracking precision of dynamic microtubule ends. J Microsc 2016; 261:67-78. [PMID: 26444439 PMCID: PMC4832305 DOI: 10.1111/jmi.12316] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2015] [Accepted: 08/04/2015] [Indexed: 01/24/2023]
Abstract
Tracking dynamic microtubule ends in fluorescence microscopy movies provides insight into the statistical properties of microtubule dynamics and is vital for further analysis that requires knowledge of the trajectories of the microtubule ends. Here we analyse the performance of a previously developed automated microtubule end tracking routine; this has been optimized for comparatively low signal-to-noise image sequences that are characteristic of microscopy movies of dynamic microtubules growing in vitro. Sequences of simulated microtubule images were generated assuming a variety of different experimental conditions. The simulated movies were then tracked and the tracking errors were characterized. We found that the growth characteristics of the microtubules within realistic ranges had a negligible effect on the tracking precision. The fluorophore labelling density, the pixel size of the images, and the exposure times were found to be important parameters limiting the tracking precision which could be explained using concepts of single molecule localization microscopy. The signal-to-noise ratio was found to be a good single predictor of the tracking precision: typical experimental signal-to-noise ratios lead to tracking precisions in the range of tens of nanometres, making the tracking program described here a useful tool for dynamic microtubule end tracking with close to molecular precision.
Collapse
Affiliation(s)
- G Bohner
- The Francis Crick Institute, Lincoln's Inn Fields Laboratory, London, U.K
- Present address: Gatsby Computational Neuroscience Unit, University College London, London, U.K
| | - N Gustafsson
- Centre for Mathematics and Physics in Life Sciences and Experimental Biology (CoMPLEX), University College London, London, U.K
- Present address: MRC Laboratory for Molecular Cell Biology, University College London, London, U.K
| | - N I Cade
- The Francis Crick Institute, Lincoln's Inn Fields Laboratory, London, U.K
| | - S P Maurer
- The Francis Crick Institute, Lincoln's Inn Fields Laboratory, London, U.K
- Present address: Centre for Genomic Regulation (CRG), Dr. Aiguader 88, 08003, Barcelona, Spain
| | - L D Griffin
- Centre for Mathematics and Physics in Life Sciences and Experimental Biology (CoMPLEX), University College London, London, U.K
| | - T Surrey
- The Francis Crick Institute, Lincoln's Inn Fields Laboratory, London, U.K
| |
Collapse
|
49
|
Imaging fluorescence (cross-) correlation spectroscopy in live cells and organisms. Nat Protoc 2015; 10:1948-74. [DOI: 10.1038/nprot.2015.100] [Citation(s) in RCA: 127] [Impact Index Per Article: 14.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
50
|
Backer AS, Moerner WE. Determining the rotational mobility of a single molecule from a single image: a numerical study. OPTICS EXPRESS 2015; 23:4255-76. [PMID: 25836463 PMCID: PMC4394761 DOI: 10.1364/oe.23.004255] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/19/2014] [Revised: 01/18/2015] [Accepted: 02/04/2015] [Indexed: 05/23/2023]
Abstract
Measurements of the orientational freedom with which a single molecule may rotate or 'wobble' about a fixed axis have provided researchers invaluable clues about the underlying behavior of a variety of biological systems. In this paper, we propose a measurement and data analysis procedure based on a widefield fluorescence microscope image for quantitatively distinguishing individual molecules that exhibit varying degrees of rotational mobility. Our proposed technique is especially applicable to cases in which the molecule undergoes rotational motions on a timescale much faster than the framerate of the camera used to record fluorescence images. Unlike currently available methods, sophisticated hardware for modulating the polarization of light illuminating the sample is not required. Additional polarization optics may be inserted in the microscope's imaging pathway to achieve superior measurement precision, but are not essential. We present a theoretical analysis, and benchmark our technique with numerical simulations using typical experimental parameters for single-molecule imaging.
Collapse
Affiliation(s)
- Adam S. Backer
- Institute for Computational and Mathematical Engineering, Stanford University, 475 Via Ortega, Stanford, CA 94305,
USA
- Department of Chemistry, Stanford University, 333 Campus Drive, Stanford, CA 94305,
USA
| | - W. E. Moerner
- Department of Chemistry, Stanford University, 333 Campus Drive, Stanford, CA 94305,
USA
| |
Collapse
|