A Bayesian method for single molecule, fluorescence burst analysis

Building Fluorescence Lifetime Maps Photon-by-Photon by Leveraging Spatial Correlations

Fluorescence lifetime imaging microscopy (FLIM) has become a standard tool in the quantitative characterization of subcellular environments. However, quantitative FLIM analyses face several challenges. First, spatial correlations between pixels are often ignored as signal from individual pixels is analyzed independently thereby limiting spatial resolution. Second, existing methods deduce photon ratios instead of absolute lifetime maps. Next, the number of fluorophore species contributing to the signal is unknown, while excited state lifetimes with <1 ns difference are difficult to discriminate. Finally, existing analyses require high photon budgets and often cannot rigorously propagate experimental uncertainty into values over lifetime maps and number of species involved. To overcome all of these challenges simultaneously and self-consistently at once, we propose the first doubly nonparametric framework. That is, we learn the number of species (using Beta-Bernoulli process priors) and absolute maps of these fluorophore species (using Gaussian process priors) by leveraging information from pulses not leading to observed photon. We benchmark our framework using a broad range of synthetic and experimental data and demonstrate its robustness across a number of scenarios including cases where we recover lifetime differences between species as small as 0.3 ns with merely 1000 photons.

High Resolution Fluorescence Lifetime Maps from Minimal Photon Counts

Fluorescence lifetime imaging microscopy (FLIM) may reveal subcellular spatial lifetime maps of key molecular species. Yet, such a quantitative picture of life necessarily demands high photon budgets at every pixel under the current analysis paradigm, thereby increasing acquisition time and photodamage to the sample. Motivated by recent developments in computational statistics, we provide a direct means to update our knowledge of the lifetime maps of species of different lifetimes from direct photon arrivals, while accounting for experimental features such as arbitrary forms of the instrument response function (IRF) and exploiting information from empty laser pulses not resulting in photon detection. Our ability to construct lifetime maps holds for arbitrary lifetimes, from short lifetimes (comparable to the IRF) to lifetimes exceeding interpulse times. As our method is highly data efficient, for the same amount of data normally used to determine lifetimes and photon ratios, working within the Bayesian paradigm, we report direct blind unmixing of lifetimes with subnanosecond resolution and subpixel spatial resolution using standard raster scan FLIM images. We demonstrate our method using a wide range of simulated and experimental data.

Complex wavelet filter improves FLIM phasors for photon starved imaging experiments

Fluorescence lifetime imaging microscopy (FLIM) with phasor analysis provides easy visualization and analysis of fluorophores' lifetimes which is valuable for multiple applications including metabolic imaging, STED imaging, FRET imaging and functional imaging. However, FLIM imaging typically suffers from low photon budgets, leading to unfavorable signal to noise ratios which in many cases prevent extraction of information from the data. Traditionally, median filters are applied in phasor analysis to tackle this problem. This unfortunately degrades high spatial frequency FLIM information in the phasor analysis. These high spatial frequency components are typically edges of features and puncta, which applies to membranes, mitochondria, granules and small organelles in a biological sample. To tackle this problem, we propose a filtering strategy with complex wavelet filtering and Anscombe transform for FLIM phasor analysis. This filtering strategy preserves fine structures and reports accurate lifetimes in photon starved FLIM imaging. Moreover, this filter outperforms median filters and makes FLIM imaging with lower laser power and faster imaging possible.

Nonparametric empirical Bayesian framework for fluorescence-lifetime imaging microscopy

Fluorescence lifetime imaging microscopy (FLIM) is a powerful imaging tool used to study the molecular environment of flurophores. In time domain FLIM, extracting lifetime from fluorophores signals entails fitting data to a decaying exponential distribution function. However, most existing techniques for this purpose need large amounts of photons at each pixel and a long computation time, thus making it difficult to obtain reliable inference in applications requiring either short acquisition or minimal computation time. In this work, we introduce a new nonparametric empirical Bayesian framework for FLIM data analysis (NEB-FLIM), leading to both improved pixel-wise lifetime estimation and a more robust and computationally efficient integral property inference. This framework is developed based on a newly proposed hierarchical statistical model for FLIM data and adopts a novel nonparametric maximum likelihood estimator to estimate the prior distribution. To demonstrate the merit of the proposed framework, we applied it on both simulated and real biological datasets and compared it with previous classical methods on these datasets.

Analysis of multivariate images in fluorescence microscopy

A multivariate image is an image stack in which each pixel contains several variables. Such images are common in many fields (medicine, imaging microscopy, satellite imaging...) and their analysis requires adapted multivariate statistical methods. In fluorescence imaging microscopy, different probes or different measurements such as intensity, fluorescence lifetime or spectral information can be observed from one view. However, this is not yet analysed as multivariate images. Here, we are presenting a full approach of multivariate analysis of fluorescence microscopy images and we are proposing a free R package (multifluo) to conduct it.

Towards unsupervised fluorescence lifetime imaging using low dimensional variable projection

Analyzing large fluorescence lifetime imaging (FLIM) data is becoming overwhelming; the latest FLIM systems easily produce massive amounts of data, making an efficient analysis more challenging than ever. In this paper we propose the combination of a custom-fit variable projection method, with a Laguerre expansion based deconvolution, to analyze bi-exponential data obtained from time-domain FLIM systems. Unlike nonlinear least squares methods, which require a suitable initial guess from an experienced researcher, the new method is free from manual interventions and hence can support automated analysis. Monte Carlo simulations are carried out on synthesized FLIM data to demonstrate the performance compared to other approaches. The performance is also illustrated on real-life FLIM data obtained from the study of autofluorescence of daisy pollen and the endocytosis of gold nanorods (GNRs) in living cells. In the latter, the fluorescence lifetimes of the GNRs are much shorter than the full width at half maximum of the instrument response function. Overall, our proposed method contains simple steps and shows great promise in realising automated FLIM analysis of large data sets.

Robust Bayesian Fluorescence Lifetime Estimation, Decay Model Selection and Instrument Response Determination for Low-Intensity FLIM Imaging

We present novel Bayesian methods for the analysis of exponential decay data that exploit the evidence carried by every detected decay event and enables robust extension to advanced processing. Our algorithms are presented in the context of fluorescence lifetime imaging microscopy (FLIM) and particular attention has been paid to model the time-domain system (based on time-correlated single photon counting) with unprecedented accuracy. We present estimates of decay parameters for mono- and bi-exponential systems, offering up to a factor of two improvement in accuracy compared to previous popular techniques. Results of the analysis of synthetic and experimental data are presented, and areas where the superior precision of our techniques can be exploited in Förster Resonance Energy Transfer (FRET) experiments are described. Furthermore, we demonstrate two advanced processing methods: decay model selection to choose between differing models such as mono- and bi-exponential, and the simultaneous estimation of instrument and decay parameters.

What Is the Best Method to Fit Time-Resolved Data? A Comparison of the Residual Minimization and the Maximum Likelihood Techniques As Applied to Experimental Time-Correlated, Single-Photon Counting Data

The need for measuring fluorescence lifetimes of species in subdiffraction-limited volumes in, for example, stimulated emission depletion (STED) microscopy, entails the dual challenge of probing a small number of fluorophores and fitting the concomitant sparse data set to the appropriate excited-state decay function. This need has stimulated a further investigation into the relative merits of two fitting techniques commonly referred to as "residual minimization" (RM) and "maximum likelihood" (ML). Fluorescence decays of the well-characterized standard, rose bengal in methanol at room temperature (530 ± 10 ps), were acquired in a set of five experiments in which the total number of "photon counts" was approximately 20, 200, 1000, 3000, and 6000 and there were about 2-200 counts at the maxima of the respective decays. Each set of experiments was repeated 50 times to generate the appropriate statistics. Each of the 250 data sets was analyzed by ML and two different RM methods (differing in the weighting of residuals) using in-house routines and compared with a frequently used commercial RM routine. Convolution with a real instrument response function was always included in the fitting. While RM using Pearson's weighting of residuals can recover the correct mean result with a total number of counts of 1000 or more, ML distinguishes itself by yielding, in all cases, the same mean lifetime within 2% of the accepted value. For 200 total counts and greater, ML always provides a standard deviation of <10% of the mean lifetime, and even at 20 total counts there is only 20% error in the mean lifetime. The robustness of ML advocates its use for sparse data sets such as those acquired in some subdiffraction-limited microscopies, such as STED, and, more importantly, provides greater motivation for exploiting the time-resolved capacities of this technique to acquire and analyze fluorescence lifetime data.

FLIM-FRET for Cancer Applications

Optical imaging assays, especially fluorescence molecular assays, are minimally invasive if not completely noninvasive, and thus an ideal technique to be applied to live specimens. These fluorescence imaging assays are a powerful tool in biomedical sciences as they allow the study of a wide range of molecular and physiological events occurring in biological systems. Furthermore, optical imaging assays bridge the gap between the in vitro cell-based analysis of subcellular processes and in vivo study of disease mechanisms in small animal models. In particular, the application of Förster resonance energy transfer (FRET) and fluorescence lifetime imaging (FLIM), well-known techniques widely used in microscopy, to the optical imaging assay toolbox, will have a significant impact in the molecular study of protein-protein interactions during cancer progression. This review article describes the application of FLIM-FRET to the field of optical imaging and addresses their various applications, both current and potential, to anti-cancer drug delivery and cancer research.

Time-domain microfluidic fluorescence lifetime flow cytometry for high-throughput Förster resonance energy transfer screening

Sensing ion or ligand concentrations, physico-chemical conditions, and molecular dimerization or conformation change is possible by assays involving fluorescent lifetime imaging. The inherent low throughput of imaging impedes rigorous statistical data analysis on large cell numbers. We address this limitation by developing a fluorescence lifetime-measuring flow cytometer for fast fluorescence lifetime quantification in living or fixed cell populations. The instrument combines a time-correlated single photon counting epifluorescent microscope with microfluidics cell-handling system. The associated computer software performs burst integrated fluorescence lifetime analysis to assign fluorescence lifetime, intensity, and burst duration to each passing cell. The maximum safe throughput of the instrument reaches 3,000 particles per minute. Living cells expressing spectroscopic rulers of varying peptide lengths were distinguishable by Förster resonant energy transfer measured by donor fluorescence lifetime. An epidermal growth factor (EGF)-stimulation assay demonstrated the technique's capacity to selectively quantify EGF receptor phosphorylation in cells, which was impossible by measuring sensitized emission on a standard flow cytometer. Dual-color fluorescence lifetime detection and cell-specific chemical environment sensing were exemplified using di-4-ANEPPDHQ, a lipophilic environmentally sensitive dye that exhibits changes in its fluorescence lifetime as a function of membrane lipid order. To our knowledge, this instrument opens new applications in flow cytometry which were unavailable due to technological limitations of previously reported fluorescent lifetime flow cytometers. The presented technique is sensitive to lifetimes of most popular fluorophores in the 0.5-5 ns range including fluorescent proteins and is capable of detecting multi-exponential fluorescence lifetime decays. This instrument vastly enhances the throughput of experiments involving fluorescence lifetime measurements, thereby providing statistically significant quantitative data for analysis of large cell populations. © 2014 International Society for Advancement of Cytometry.

Single-molecule enzymatic conformational dynamics: spilling out the product molecules

Product releasing is an essential step of an enzymatic reaction, and a mechanistic understanding primarily depends on the active-site conformational changes and molecular interactions that are involved in this step of the enzymatic reaction. Here we report our work on the enzymatic product releasing dynamics and mechanism of an enzyme, horseradish peroxidase (HRP), using combined single-molecule time-resolved fluorescence intensity, anisotropy, and lifetime measurements. Our results have shown a wide distribution of the multiple conformational states involved in active-site interacting with the product molecules during the product releasing. We have identified that there is a significant pathway in which the product molecules are spilled out from the enzymatic active site, driven by a squeezing effect from a tight active-site conformational state, although the conventional pathway of releasing a product molecule from an open active-site conformational state is still a primary pathway. Our study provides new insight into the enzymatic reaction dynamics and mechanism, and the information is uniquely obtainable from our combined time-resolved single-molecule spectroscopic measurements and analyses.

Quantitative diagnosis of cervical neoplasia using fluorescence lifetime imaging on haematoxylin and eosin stained tissue sections

The use of conventional fluorescence microscopy for characterizing tissue pathological states is limited by overlapping spectra and the dependence on excitation power and fluorophore concentration. Fluorescence lifetime imaging microscopy (FLIM) can overcome these limitations due to its insensitivity to fluorophore concentration, excitation power and spectral similarity. This study investigates the diagnosis of early cervical cancer using FLIM and a neural network extreme learning machine classifier. A concurrently high sensitivity and specificity of 92.8% and 80.2%, respectively, were achieved. The results suggest that the proposed technique can be used to supplement the traditional histopathological examination of early cervical cancer.

On-the-fly decoding luminescence lifetimes in the microsecond region for lanthanide-encoded suspension arrays

Significant multiplexing capacity of optical time-domain coding has been recently demonstrated by tuning luminescence lifetimes of the upconversion nanoparticles called 'τ-Dots'. It provides a large dynamic range of lifetimes from microseconds to milliseconds, which allows creating large libraries of nanotags/microcarriers. However, a robust approach is required to rapidly and accurately measure the luminescence lifetimes from the relatively slow-decaying signals. Here we show a fast algorithm suitable for the microsecond region with precision closely approaching the theoretical limit and compatible with the rapid scanning cytometry technique. We exploit this approach to further extend optical time-domain multiplexing to the downconversion luminescence, using luminescence microspheres wherein lifetimes are tuned through luminescence resonance energy transfer. We demonstrate real-time discrimination of these microspheres in the rapid scanning cytometry, and apply them to the multiplexed probing of pathogen DNA strands. Our results indicate that tunable luminescence lifetimes have considerable potential in high-throughput analytical sciences.

Analyzing conformational dynamics of single P-glycoprotein transporters by Förster resonance energy transfer using hidden Markov models

Single-molecule Förster resonance energy (smFRET) transfer has become a powerful tool for observing conformational dynamics of biological macromolecules. Analyzing smFRET time trajectories allows to identify the state transitions occuring on reaction pathways of molecular machines. Previously, we have developed a smFRET approach to monitor movements of the two nucleotide binding domains (NBDs) of P-glycoprotein (Pgp) during ATP hydrolysis driven drug transport in solution. One limitation of this initial work was that single-molecule photon bursts were analyzed by visual inspection with manual assignment of individual FRET levels. Here a fully automated analysis of Pgp smFRET data using hidden Markov models (HMM) for transitions up to 9 conformational states is applied. We propose new estimators for HMMs to integrate the information of fluctuating intensities in confocal smFRET measurements of freely diffusing lipid bilayer bound membrane proteins in solution. HMM analysis strongly supports that under conditions of steady state turnover, conformational states with short NBD distances and short dwell times are more populated compared to conditions without nucleotide or transport substrate present.

Generalization of the polar representation in time domain fluorescence lifetime imaging microscopy for biological applications: practical implementation

The polar representation or phasor, which provides a fast and visual indication on the number of exponentials present in the intensity decay of the fluorescence lifetime images is increasingly used in time domain fluorescence lifetime imaging microscopy experiments. The calculations of the polar coordinates in time domain fluorescence lifetime imaging microscopy experiments involve several experimental parameters (e.g. instrumental response function, background, angular frequency, number of temporal channels) whose role has not been exhaustively investigated. Here, we study theoretically, computationally and experimentally the influence of each parameter on the polar calculations and suggest parameter optimization for minimizing errors. We identify several sources of mistakes that may occur in the calculations of the polar coordinates and propose adapted corrections to compensate for them. For instance, we demonstrate that the numerical integration method employed for integrals calculations may induce errors when the number of temporal channels is low. We report theoretical generalized expressions to compensate for these deviations and conserve the semicircle integrity, facilitating the comparison between fluorescence lifetime imaging microscopy images acquired with distinct channels number. These theoretical generalized expressions were finally corroborated with both Monte Carlo simulations and experiments.

Time-domain fluorescence lifetime imaging techniques suitable for solid-state imaging sensor arrays

We have successfully demonstrated video-rate CMOS single-photon avalanche diode (SPAD)-based cameras for fluorescence lifetime imaging microscopy (FLIM) by applying innovative FLIM algorithms. We also review and compare several time-domain techniques and solid-state FLIM systems, and adapt the proposed algorithms for massive CMOS SPAD-based arrays and hardware implementations. The theoretical error equations are derived and their performances are demonstrated on the data obtained from 0.13 μm CMOS SPAD arrays and the multiple-decay data obtained from scanning PMT systems. In vivo two photon fluorescence lifetime imaging data of FITC-albumin labeled vasculature of a P22 rat carcinosarcoma (BD9 rat window chamber) are used to test how different algorithms perform on bi-decay data. The proposed techniques are capable of producing lifetime images with enough contrast.

Total variation versus wavelet-based methods for image denoising in fluorescence lifetime imaging microscopy

We report the first application of wavelet-based denoising (noise removal) methods to time-domain box-car fluorescence lifetime imaging microscopy (FLIM) images and compare the results to novel total variation (TV) denoising methods. Methods were tested first on artificial images and then applied to low-light live-cell images. Relative to undenoised images, TV methods could improve lifetime precision up to 10-fold in artificial images, while preserving the overall accuracy of lifetime and amplitude values of a single-exponential decay model and improving local lifetime fitting in live-cell images. Wavelet-based methods were at least 4-fold faster than TV methods, but could introduce significant inaccuracies in recovered lifetime values. The denoising methods discussed can potentially enhance a variety of FLIM applications, including live-cell, in vivo animal, or endoscopic imaging studies, especially under challenging imaging conditions such as low-light or fast video-rate imaging.

A multi-functional imaging approach to high-content protein interaction screening

Functional imaging can provide a level of quantification that is not possible in what might be termed traditional high-content screening. This is due to the fact that the current state-of-the-art high-content screening systems take the approach of scaling-up single cell assays, and are therefore based on essentially pictorial measures as assay indicators. Such phenotypic analyses have become extremely sophisticated, advancing screening enormously, but this approach can still be somewhat subjective. We describe the development, and validation, of a prototype high-content screening platform that combines steady-state fluorescence anisotropy imaging with fluorescence lifetime imaging (FLIM). This functional approach allows objective, quantitative screening of small molecule libraries in protein-protein interaction assays. We discuss the development of the instrumentation, the process by which information on fluorescence resonance energy transfer (FRET) can be extracted from wide-field, acceptor fluorescence anisotropy imaging and cross-checking of this modality using lifetime imaging by time-correlated single-photon counting. Imaging of cells expressing protein constructs where eGFP and mRFP1 are linked with amino-acid chains of various lengths (7, 19 and 32 amino acids) shows the two methodologies to be highly correlated. We validate our approach using a small-scale inhibitor screen of a Cdc42 FRET biosensor probe expressed in epidermoid cancer cells (A431) in a 96 microwell-plate format. We also show that acceptor fluorescence anisotropy can be used to measure variations in hetero-FRET in protein-protein interactions. We demonstrate this using a screen of inhibitors of internalization of the transmembrane receptor, CXCR4. These assays enable us to demonstrate all the capabilities of the instrument, image processing and analytical techniques that have been developed. Direct correlation between acceptor anisotropy and donor FLIM is observed for FRET assays, providing an opportunity to rapidly screen proteins, interacting on the nano-meter scale, using wide-field imaging.