A fast global fitting algorithm for fluorescence lifetime imaging microscopy based on image segmentation

Towards optical measurements of membrane potential values in Bacillus subtilis using fluorescence lifetime

Membrane potential (MP) changes can provide a simple readout of bacterial functional and metabolic state or stress levels. While several optical methods exist for measuring fast changes in MP in excitable cells, there is a dearth of such methods for absolute and precise measurements of steady-state membrane potentials (MPs) in bacterial cells. Conventional electrode-based methods for the measurement of MP are not suitable for calibrating optical methods in small bacterial cells. While optical measurement based on Nernstian indicators have been successfully used, they do not provide absolute or precise quantification of MP or its changes. We present a novel, calibrated MP recording approach to address this gap. In this study, we used a fluorescence lifetime-based approach to obtain a single-cell resolved distribution of the membrane potential and its changes upon extracellular chemical perturbation in a population of bacterial cells for the first time. Our method is based on (i) a unique VoltageFluor (VF) optical transducer, whose fluorescence lifetime varies as a function of MP via photoinduced electron transfer (PeT) and (ii) a quantitative phasor-FLIM analysis for high-throughput readout. This method allows MP changes to be easily visualized, recorded and quantified. By artificially modulating potassium concentration gradients across the membrane using an ionophore, we have obtained a Bacillus subtilis-specific MP versus VF lifetime calibration and estimated the MP for unperturbed B. subtilis cells to be -65 mV and that for chemically depolarized cells as -14 mV. We observed a population level MP heterogeneity of ~6-10 mV indicating a considerable degree of diversity of physiological and metabolic states among individual cells. Our work paves the way for deeper insights into bacterial electrophysiology and bioelectricity research.

TauSTED super-resolution imaging of labile iron in primary hippocampal neurons

Iron dyshomeostasis is involved in many neurological disorders, particularly neurodegenerative diseases where iron accumulates in various brain regions. Identifying mechanisms of iron transport in the brain is crucial for understanding the role of iron in healthy and pathological states. In neurons, it has been suggested that iron can be transported by the axon to different brain regions in the form of labile iron; a pool of reactive and exchangeable intracellular iron. Here we report a novel approach to imaging labile ferrous iron, Fe(II), in live primary hippocampal neurons using confocal and TauSTED (stimulated emission depletion) microscopy. TauSTED is based on super-resolution STED nanoscopy, which combines high spatial resolution imaging (<40 nm) with fluorescence lifetime information, thus reducing background noise and improving image quality. We applied TauSTED imaging utilizing biotracker FerroFarRed Fe(II) and found that labile iron was present as submicrometric puncta in dendrites and axons. Some of these iron-rich structures are mobile and move along neuritic pathways, arguing for a labile iron transport mechanism in neurons. This super-resolution imaging approach offers a new perspective for studying the dynamic mechanisms of axonal and dendritic transport of iron at high spatial resolution in living neurons. In addition, this methodology could be transposed to the imaging of other fluorescent metal sensors.

Review of optical methods for noninvasive imaging of skin fibroblasts-From in vitro to ex vivo and in vivo visualization

Fibroblasts are among the most common cell types in the stroma responsible for creating and maintaining the structural organization of the extracellular matrix in the dermis, skin regeneration, and a range of immune responses. Until now, the processes of fibroblast adaptation and functioning in a varying environment have not been fully understood. Modern laser microscopes are capable of studying fibroblasts in vitro and ex vivo. One-photon- and two-photon-excited fluorescence microscopy, Raman spectroscopy/microspectroscopy are well-suited noninvasive optical methods for fibroblast imaging in vitro and ex vivo. In vivo staining-free fibroblast imaging is not still implemented. The exception is fibroblast imaging in tattooed skin. Although in vivo noninvasive staining-free imaging of fibroblasts in the skin has not yet been implemented, it is expected in the future. This review summarizes the state-of-the-art in fibroblast visualization using optical methods and discusses the advantages, limitations, and prospects for future noninvasive imaging.

Building Fluorescence Lifetime Maps Photon-by-Photon by Leveraging Spatial Correlations

Fluorescence lifetime imaging microscopy (FLIM) has become a standard tool in the quantitative characterization of subcellular environments. However, quantitative FLIM analyses face several challenges. First, spatial correlations between pixels are often ignored as signal from individual pixels is analyzed independently thereby limiting spatial resolution. Second, existing methods deduce photon ratios instead of absolute lifetime maps. Next, the number of fluorophore species contributing to the signal is unknown, while excited state lifetimes with <1 ns difference are difficult to discriminate. Finally, existing analyses require high photon budgets and often cannot rigorously propagate experimental uncertainty into values over lifetime maps and number of species involved. To overcome all of these challenges simultaneously and self-consistently at once, we propose the first doubly nonparametric framework. That is, we learn the number of species (using Beta-Bernoulli process priors) and absolute maps of these fluorophore species (using Gaussian process priors) by leveraging information from pulses not leading to observed photon. We benchmark our framework using a broad range of synthetic and experimental data and demonstrate its robustness across a number of scenarios including cases where we recover lifetime differences between species as small as 0.3 ns with merely 1000 photons.

Particle-based phasor-FLIM-FRET resolves protein-protein interactions inside single viral particles

Fluorescence lifetime imaging microscopy (FLIM) is a popular modality to create additional contrast in fluorescence images. By carefully analyzing pixel-based nanosecond lifetime patterns, FLIM allows studying complex molecular populations. At the single-molecule or single-particle level, however, image series often suffer from low signal intensities per pixel, rendering it difficult to quantitatively disentangle different lifetime species, such as during Förster resonance energy transfer (FRET) analysis in the presence of a significant donor-only fraction. In this article we investigate whether an object localization strategy and the phasor approach to FLIM have beneficial effects when carrying out FRET analyses of single particles. Using simulations, we first showed that an average of ∼300 photons, spread over the different pixels encompassing single fluorescing particles and without background, is enough to determine a correct phasor signature (SD < 5% for a 4-ns lifetime). For immobilized single- or double-labeled dsDNA molecules, we next validated that particle-based phasor-FLIM-FRET readily allows estimating fluorescence lifetimes and FRET from single molecules. Thirdly, we applied particle-based phasor-FLIM-FRET to investigate protein-protein interactions in subdiffraction HIV-1 viral particles. To do this, we first quantitatively compared the fluorescence brightness, lifetime, and photostability of different popular fluorescent protein-based FRET probes when genetically fused to the HIV-1 integrase enzyme in viral particles, and conclude that eGFP, mTurquoise2, and mScarlet perform best. Finally, for viral particles coexpressing FRET-donor/acceptor-labeled IN, we determined the absolute FRET efficiency of IN oligomers. Available in a convenient open-source graphical user interface, we believe that particle-based phasor-FLIM-FRET is a promising tool to provide detailed insights in samples suffering from low overall signal intensities.

Visualising varnish removal for conservation of paintings by fluorescence lifetime imaging (FLIM)

The removal of varnish from the surface is a key step in painting conservation. Varnish removal is traditionally monitored by examining the painting surface under ultraviolet illumination. We show here that by imaging the fluorescence lifetime instead, much better contrast, sensitivity, and specificity can be achieved. For this purpose, we developed a lightweight (4.8 kg) portable instrument for macroscopic fluorescence lifetime imaging (FLIM). It is based on a time-correlated single-photon avalanche diode (SPAD) camera to acquire the FLIM images and a pulsed 440 nm diode laser to excite the varnish fluorescence. A historical model painting was examined to demonstrate the capabilities of the system. We found that the FLIM images provided information on the distribution of the varnish on the painting surface with greater sensitivity, specificity, and contrast compared to the traditional ultraviolet illumination photography. The distribution of the varnish and other painting materials was assessed using FLIM during and after varnish removal with different solvent application methods. Monitoring of the varnish removal process between successive solvent applications by a swab revealed an evolving image contrast as a function of the cleaning progress. FLIM of dammar and mastic resin varnishes identified characteristic changes to their fluorescence lifetimes depending on their ageing conditions. Thus, FLIM has a potential to become a powerful and versatile tool to visualise varnish removal from paintings.

Graphical Abstract

Fluorescence lifetime: Beating the IRF and interpulse window

Fluorescence lifetime imaging captures the spatial distribution of chemical species across cellular environments employing pulsed illumination confocal setups. However, quantitative interpretation of lifetime data continues to face critical challenges. For instance, fluorescent species with known in vitro excited-state lifetimes may split into multiple species with unique lifetimes when introduced into complex living environments. What is more, mixtures of species, which may be both endogenous and introduced into the sample, may exhibit 1) very similar lifetimes as well as 2) wide ranges of lifetimes including lifetimes shorter than the instrumental response function or whose duration may be long enough to be comparable to the interpulse window. By contrast, existing methods of analysis are optimized for well-separated and intermediate lifetimes. Here, we broaden the applicability of fluorescence lifetime analysis by simultaneously treating unknown mixtures of arbitrary lifetimes-outside the intermediate, Goldilocks, zone-for data drawn from a single confocal spot leveraging the tools of Bayesian nonparametrics (BNP). We benchmark our algorithm, termed BNP lifetime analysis, using a range of synthetic and experimental data. Moreover, we show that the BNP lifetime analysis method can distinguish and deduce lifetimes using photon counts as small as 500.

Phasor Analysis of Fluorescence Lifetime Enables Quantitative Multiplexed Molecular Imaging of Three Probes

The excited-state lifetime is an intrinsic property of fluorescent molecules that can be leveraged for multiplexed imaging. An advantage of fluorescence lifetime-based multiplexing is that signals from multiple probes can be gathered simultaneously, whereas traditional spectral fluorescence imaging typically requires multiple images at different excitation and emission wavelengths. Additionally, lifetime and spectra could both be utilized to expand the multiplexing capacity of fluorescence. However, resolving exogenous molecular probes based exclusively on the fluorescence lifetime has been limited by technical challenges in analyzing lifetime data. The phasor approach to lifetime analysis offers a simple, graphical solution that has increasingly been used to assess endogenous cellular autofluorescence to quantify metabolic factors. In this study, we employed the phasor analysis of FLIM to quantitatively resolve three exogenous, antibody-targeted fluorescent probes with similar spectral properties based on lifetime information alone. First, we demonstrated that three biomarkers that were spatially restricted to the cell membrane, cytosol, or nucleus could be accurately distinguished using FLIM and phasor analysis. Next, we successfully resolved and quantified three probes that were all targeted to cell surface biomarkers. Finally, we demonstrated that lifetime-based quantitation accuracy can be improved through intensity matching of various probe-biomarker combinations, which will expand the utility of this technique. Importantly, we reconstructed images for each individual probe, as well as an overlay of all three probes, from a single FLIM image. Our results demonstrate that FLIM and phasor analysis can be leveraged as a powerful tool for simultaneous detection of multiple biomarkers with high sensitivity and accuracy.

Experimental analysis of excited state dynamics in Anderson-type POM@porphyrin hybrids in relevance to third-order nonlinear optical properties

This work accounts for the active contribution of life time decay in the field of nonlinear optics, especially for an energetic donor acceptor couple (porphyrin and polyoxometalate (POM)). Currently, two POM free porphyrins (Di-Tris-N@Por and Di-Tris@Por) and their two hybrids with POM (Di-Tris-NPor@Di-AndPOM-1 and Di-TrisPor@Di-AndPOM-2) have been studied keenly in nanosecond time span and resulted lifetimes ([Formula: see text]1 and [Formula: see text]2) have been compared with nonlinear optical parameters. The results demonstrated that Di-Tris-NPor@Di-AndPOM-1 exhibited better third-order nonlinear optical susceptibility [Formula: see text]3, second hyperpolarizability [Formula: see text] and nonlinear absorption [Formula: see text] and Di-TrisPor@Di-AndPOM-2 than Di-TrisPor@Di-AndPOM-2. This superiority of nonlinear optical parameters was supported by lifetime decay studies and electrochemical studies. It is revealed that more relaxation time in excited states lower will be the NLO response. The lifetime decay ([Formula: see text]1) value of Di-Tris-NPor@Di-AndPOM-1 is 3.86ns which is higher than Di-TrisPor@Di-AndPOM-2 possessing lifetime decay ([Formula: see text]1) value of 2.45ns. Moreover, lower energy of charge separated state (-0.88 eV) of Di-Tris-NPor@Di-AndPOM-1 indicates the facile electron transfer in Di-Tris-NPor@Di-AndPOM-1 than Di-TrisPor@Di-AndPOM-2 which experienced more energy of charge separated state. Rapid intersystem crossing is also responsible for the electron transfer from porphyrin moiety to POM moiety.

High Resolution Fluorescence Lifetime Maps from Minimal Photon Counts

Fluorescence lifetime imaging microscopy (FLIM) may reveal subcellular spatial lifetime maps of key molecular species. Yet, such a quantitative picture of life necessarily demands high photon budgets at every pixel under the current analysis paradigm, thereby increasing acquisition time and photodamage to the sample. Motivated by recent developments in computational statistics, we provide a direct means to update our knowledge of the lifetime maps of species of different lifetimes from direct photon arrivals, while accounting for experimental features such as arbitrary forms of the instrument response function (IRF) and exploiting information from empty laser pulses not resulting in photon detection. Our ability to construct lifetime maps holds for arbitrary lifetimes, from short lifetimes (comparable to the IRF) to lifetimes exceeding interpulse times. As our method is highly data efficient, for the same amount of data normally used to determine lifetimes and photon ratios, working within the Bayesian paradigm, we report direct blind unmixing of lifetimes with subnanosecond resolution and subpixel spatial resolution using standard raster scan FLIM images. We demonstrate our method using a wide range of simulated and experimental data.

Generative adversarial network enables rapid and robust fluorescence lifetime image analysis in live cells

Fluorescence lifetime imaging microscopy (FLIM) is a powerful tool to quantify molecular compositions and study molecular states in complex cellular environment as the lifetime readings are not biased by fluorophore concentration or excitation power. However, the current methods to generate FLIM images are either computationally intensive or unreliable when the number of photons acquired at each pixel is low. Here we introduce a new deep learning-based method termed flimGANE (fluorescence lifetime imaging based on Generative Adversarial Network Estimation) that can rapidly generate accurate and high-quality FLIM images even in the photon-starved conditions. We demonstrated our model is up to 2,800 times faster than the gold standard time-domain maximum likelihood estimation (TD_MLE) and that flimGANE provides a more accurate analysis of low-photon-count histograms in barcode identification, cellular structure visualization, Förster resonance energy transfer characterization, and metabolic state analysis in live cells. With its advantages in speed and reliability, flimGANE is particularly useful in fundamental biological research and clinical applications, where high-speed analysis is critical.

Histogram clustering for rapid time-domain fluorescence lifetime image analysis

We propose a histogram clustering (HC) method to accelerate fluorescence lifetime imaging (FLIM) analysis in pixel-wise and global fitting modes. The proposed method's principle was demonstrated, and the combinations of HC with traditional FLIM analysis were explained. We assessed HC methods with both simulated and experimental datasets. The results reveal that HC not only increases analysis speed (up to 106 times) but also enhances lifetime estimation accuracy. Fast lifetime analysis strategies were suggested with execution times around or below 30 μs per histograms on MATLAB R2016a, 64-bit with the Intel Celeron CPU (2950M @ 2GHz).

Blind deconvolution estimation by multi-exponential models and alternated least squares approximations: Free-form and sparse approach

The deconvolution process is a key step for quantitative evaluation of fluorescence lifetime imaging microscopy (FLIM) samples. By this process, the fluorescence impulse responses (FluoIRs) of the sample are decoupled from the instrument response (InstR). In blind deconvolution estimation (BDE), the FluoIRs and InstR are jointly extracted from a dataset with minimal a priori information. In this work, two BDE algorithms are introduced based on linear combinations of multi-exponential functions to model each FluoIR in the sample. For both schemes, the InstR is assumed with a free-form and a sparse structure. The local perspective of the BDE methodology assumes that the characteristic parameters of the exponential functions (time constants and scaling coefficients) are estimated based on a single spatial point of the dataset. On the other hand, the same exponential functions are used in the whole dataset in the global perspective, and just the scaling coefficients are updated for each spatial point. A least squares formulation is considered for both BDE algorithms. To overcome the nonlinear interaction in the decision variables, an alternating least squares (ALS) methodology iteratively solves both estimation problems based on non-negative and constrained optimizations. The validation stage considered first synthetic datasets at different noise types and levels, and a comparison with the standard deconvolution techniques with a multi-exponential model for FLIM measurements, as well as, with two BDE methodologies in the state of the art: Laguerre basis, and exponentials library. For the experimental evaluation, fluorescent dyes and oral tissue samples were considered. Our results show that local and global perspectives are consistent with the standard deconvolution techniques, and they reached the fastest convergence responses among the BDE algorithms with the best compromise in FluoIRs and InstR estimation errors.

Theoretical investigations of a modified compressed ultrafast photography method suitable for single-shot fluorescence lifetime imaging

A single-shot fluorescence lifetime imaging (FLIM) method based on the compressed ultrafast photography (CUP) is proposed, named space-restricted CUP (srCUP). srCUP is suitable for imaging objects moving slowly (<∼150/Mmm/s, M is the magnification of the objective lens) in the field of view with the intensity changing within nanoseconds in a measurement window around 10 ns. We used synthetic datasets to explore the performances of srCUP compared with CUP and TCUP (a variant of CUP). srCUP not only provides superior reconstruction performances, but its reconstruction speed is also twofold and threefold faster than CUP and TCUP, respectively. The lifetime determination performances were assessed by estimating lifetime components, amplitude- and intensity-weighted average lifetimes (τ_A and τ_I), with the reconstructed scenes using the least squares method based on a bi-exponential model. srCUP has the best accuracy and precision for lifetime determinations with a relative bias less than 7% and a coefficient of variation less than 7% for τ_A, and a relative bias less than 10% and a coefficient of variation less than 11% for τ_I.

FLIMJ: An open-source ImageJ toolkit for fluorescence lifetime image data analysis

In the field of fluorescence microscopy, there is continued demand for dynamic technologies that can exploit the complete information from every pixel of an image. One imaging technique with proven ability for yielding additional information from fluorescence imaging is Fluorescence Lifetime Imaging Microscopy (FLIM). FLIM allows for the measurement of how long a fluorophore stays in an excited energy state, and this measurement is affected by changes in its chemical microenvironment, such as proximity to other fluorophores, pH, and hydrophobic regions. This ability to provide information about the microenvironment has made FLIM a powerful tool for cellular imaging studies ranging from metabolic measurement to measuring distances between proteins. The increased use of FLIM has necessitated the development of computational tools for integrating FLIM analysis with image and data processing. To address this need, we have created FLIMJ, an ImageJ plugin and toolkit that allows for easy use and development of extensible image analysis workflows with FLIM data. Built on the FLIMLib decay curve fitting library and the ImageJ Ops framework, FLIMJ offers FLIM fitting routines with seamless integration with many other ImageJ components, and the ability to be extended to create complex FLIM analysis workflows. Building on ImageJ Ops also enables FLIMJ's routines to be used with Jupyter notebooks and integrate naturally with science-friendly programming in, e.g., Python and Groovy. We show the extensibility of FLIMJ in two analysis scenarios: lifetime-based image segmentation and image colocalization. We also validate the fitting routines by comparing them against industry FLIM analysis standards.

Direct Photon-by-Photon Analysis of Time-Resolved Pulsed Excitation Data using Bayesian Nonparametrics

Lifetimes of chemical species are typically estimated by either fitting time-correlated single-photon counting (TCSPC) histograms or phasor analysis from time-resolved photon arrivals. While both methods yield lifetimes in a computationally efficient manner, their performance is limited by choices made on the number of distinct chemical species contributing photons. However, the number of species is encoded in the photon arrival times collected for each illuminated spot and need not be set by hand a priori. Here, we propose a direct photon-by-photon analysis of data drawn from pulsed excitation experiments to infer, simultaneously and self-consistently, the number of species and their associated lifetimes from a few thousand photons. We do so by leveraging new mathematical tools within the Bayesian nonparametric. We benchmark our method for both simulated and experimental data for 1-4 species.

Fluorescence lifetime imaging microscopy: fundamentals and advances in instrumentation, analysis, and applications

SIGNIFICANCE

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique to distinguish the unique molecular environment of fluorophores. FLIM measures the time a fluorophore remains in an excited state before emitting a photon, and detects molecular variations of fluorophores that are not apparent with spectral techniques alone. FLIM is sensitive to multiple biomedical processes including disease progression and drug efficacy.

AIM

We provide an overview of FLIM principles, instrumentation, and analysis while highlighting the latest developments and biological applications.

APPROACH

This review covers FLIM principles and theory, including advantages over intensity-based fluorescence measurements. Fundamentals of FLIM instrumentation in time- and frequency-domains are summarized, along with recent developments. Image segmentation and analysis strategies that quantify spatial and molecular features of cellular heterogeneity are reviewed. Finally, representative applications are provided including high-resolution FLIM of cell- and organelle-level molecular changes, use of exogenous and endogenous fluorophores, and imaging protein-protein interactions with Förster resonance energy transfer (FRET). Advantages and limitations of FLIM are also discussed.

CONCLUSIONS

FLIM is advantageous for probing molecular environments of fluorophores to inform on fluorophore behavior that cannot be elucidated with intensity measurements alone. Development of FLIM technologies, analysis, and applications will further advance biological research and clinical assessments.

High-throughput, multi-parametric, and correlative fluorescence lifetime imaging

In this review, we discuss methods and advancements in fluorescence lifetime imaging microscopy that permit measurements to be performed at faster speed and higher resolution than previously possible. We review fast single-photon timing technologies and the use of parallelized detection schemes to enable high-throughput and high content imaging applications. We appraise different technological implementations of fluorescence lifetime imaging, primarily in the time-domain. We also review combinations of fluorescence lifetime with other imaging modalities to capture multi-dimensional and correlative information from a single sample. Throughout the review, we focus on applications in biomedical research. We conclude with a critical outlook on current challenges and future opportunities in this rapidly developing field.

Nonparametric empirical Bayesian framework for fluorescence-lifetime imaging microscopy

Fluorescence lifetime imaging microscopy (FLIM) is a powerful imaging tool used to study the molecular environment of flurophores. In time domain FLIM, extracting lifetime from fluorophores signals entails fitting data to a decaying exponential distribution function. However, most existing techniques for this purpose need large amounts of photons at each pixel and a long computation time, thus making it difficult to obtain reliable inference in applications requiring either short acquisition or minimal computation time. In this work, we introduce a new nonparametric empirical Bayesian framework for FLIM data analysis (NEB-FLIM), leading to both improved pixel-wise lifetime estimation and a more robust and computationally efficient integral property inference. This framework is developed based on a newly proposed hierarchical statistical model for FLIM data and adopts a novel nonparametric maximum likelihood estimator to estimate the prior distribution. To demonstrate the merit of the proposed framework, we applied it on both simulated and real biological datasets and compared it with previous classical methods on these datasets.

Global analysis and Decay Associated Images (DAI) derived from Fluorescence Lifetime Imaging Microscopy (FLIM)

The extraction of fluorophore lifetimes in a biological sample provides useful information about the probe environment that is not readily available from fluorescence intensity alone. Cell membrane potential, pH, concentration of oxygen ([O₂]), calcium ([Ca²⁺]), NADH and other ions and metabolites are all regularly measured by lifetime-based techniques. These measurements provide invaluable knowledge about cell homeostasis, metabolism and communication with the cell environment. Fluorescence lifetime imaging microscopy (FLIM) produces spatial maps with time-correlated single-photon counting (TCSPC) histograms collected and analyzed at each pixel, but traditional TCSPC analysis is often hampered by the low number of photons that can reasonably be collected while maintaining high spatial resolution. More important, traditional analysis fails to employ the spatial linkages within the image. Here, we present a different approach, where we work under the assumption that mixtures of a global set of lifetimes (often only 2 or 3) can describe the entire image. We determine these lifetime components by globally fitting precise decays aggregated over large spatial regions of interest, and then we perform a pixel-by-pixel calculation of decay amplitudes (via simple linear algebra applied to coarser time-windows). This yields accurate amplitude images (Decay Associate Images, DAI) that contain stoichiometric information about the underlying mixtures while retaining single pixel resolution. We collected FLIM data of dye mixtures and bacteria expressing fluorescent proteins with a two-photon microscope system equipped with a commercial single-photon counting card, and we used these data to benchmark the gDAI program.

Heterogeneity in tumor chromatin-doxorubicin binding revealed by in vivo fluorescence lifetime imaging confocal endomicroscopy

We present an approach to quantify drug-target engagement using in vivo fluorescence endomicroscopy, validated with in vitro measurements. Doxorubicin binding to chromatin changes the fluorescence lifetime of histone-GFP fusions that we measure in vivo at single-cell resolution using a confocal laparo/endomicroscope. We measure both intra- and inter-tumor heterogeneity in doxorubicin chromatin engagement in a model of peritoneal metastasis of ovarian cancer, revealing striking variation in the efficacy of doxorubicin-chromatin binding depending on intra-peritoneal or intravenous delivery. Further, we observe significant variations in doxorubicin-chromatin binding between different metastases in the same mouse and between different regions of the same metastasis. The quantitative nature of fluorescence lifetime imaging enables direct comparison of drug-target engagement for different drug delivery routes and between in vitro and in vivo experiments. This uncovers different rates of cell killing for the same level of doxorubicin binding in vitro and in vivo.

Quantitative time domain analysis of lifetime-based Förster resonant energy transfer measurements with fluorescent proteins: Static random isotropic fluorophore orientation distributions

Förster resonant energy transfer (FRET) measurements are widely used to obtain information about molecular interactions and conformations through the dependence of FRET efficiency on the proximity of donor and acceptor fluorophores. Fluorescence lifetime measurements can provide quantitative analysis of FRET efficiency and interacting population fraction. Many FRET experiments exploit the highly specific labelling of genetically expressed fluorescent proteins, applicable in live cells and organisms. Unfortunately, the typical assumption of fast randomization of fluorophore orientations in the analysis of fluorescence lifetime-based FRET readouts is not valid for fluorescent proteins due to their slow rotational mobility compared to their upper state lifetime. Here, previous analysis of effectively static isotropic distributions of fluorophore dipoles on FRET measurements is incorporated into new software for fitting donor emission decay profiles. Calculated FRET parameters, including molar population fractions, are compared for the analysis of simulated and experimental FRET data under the assumption of static and dynamic fluorophores and the intermediate regimes between fully dynamic and static fluorophores, and mixtures within FRET pairs, is explored. Finally, a method to correct the artefact resulting from fitting the emission from static FRET pairs with isotropic angular distributions to the (incorrect) typically assumed dynamic FRET decay model is presented.

Engineering 'Golden' Fluorescence by Selective Pressure Incorporation of Non-canonical Amino Acids and Protein Analysis by Mass Spectrometry and Fluorescence

Fluorescent proteins are fundamental tools for the life sciences, in particular for fluorescence microscopy of living cells. While wild-type and engineered variants of the green fluorescent protein from Aequorea victoria (avGFP) as well as homologs from other species already cover large parts of the optical spectrum, a spectral gap remains in the near-infrared region, for which avGFP-based fluorophores are not available. Red-shifted fluorescent protein (FP) variants would substantially expand the toolkit for spectral unmixing of multiple molecular species, but the naturally occurring red-shifted FPs derived from corals or sea anemones have lower fluorescence quantum yield and inferior photo-stability compared to the avGFP variants. Further manipulation and possible expansion of the chromophore's conjugated system towards the far-red spectral region is also limited by the repertoire of 20 canonical amino acids prescribed by the genetic code. To overcome these limitations, synthetic biology can achieve further spectral red-shifting via insertion of non-canonical amino acids into the chromophore triad. We describe the application of SPI to engineer avGFP variants with novel spectral properties. Protein expression is performed in a tryptophan-auxotrophic E. coli strain and by supplementing growth media with suitable indole precursors. Inside the cells, these precursors are converted to the corresponding tryptophan analogs and incorporated into proteins by the ribosomal machinery in response to UGG codons. The replacement of Trp-66 in the enhanced "cyan" variant of avGFP (ECFP) by an electron-donating 4-aminotryptophan results in GdFP featuring a 108 nm Stokes shift and a strongly red-shifted emission maximum (574 nm), while being thermodynamically more stable than its predecessor ECFP. Residue-specific incorporation of the non-canonical amino acid is analyzed by mass spectrometry. The spectroscopic properties of GdFP are characterized by time-resolved fluorescence spectroscopy as one of the valuable applications of genetically encoded FPs in life sciences.

Fluorescence lifetime imaging ophthalmoscopy

Imaging techniques based on retinal autofluorescence have found broad applications in ophthalmology because they are extremely sensitive and noninvasive. Conventional fundus autofluorescence imaging measures fluorescence intensity of endogenous retinal fluorophores. It mainly derives its signal from lipofuscin at the level of the retinal pigment epithelium. Fundus autofluorescence, however, can not only be characterized by the spatial distribution of the fluorescence intensity or emission spectrum, but also by a characteristic fluorescence lifetime function. The fluorescence lifetime is the average amount of time a fluorophore remains in the excited state following excitation. Fluorescence lifetime imaging ophthalmoscopy (FLIO) is an emerging imaging modality for in vivo measurement of lifetimes of endogenous retinal fluorophores. Recent reports in this field have contributed to our understanding of the pathophysiology of various macular and retinal diseases. Within this review, the basic concept of fluorescence lifetime imaging is provided. It includes technical background information and correlation with in vitro measurements of individual retinal metabolites. In a second part, clinical applications of fluorescence lifetime imaging and fluorescence lifetime features of selected retinal diseases such as Stargardt disease, age-related macular degeneration, choroideremia, central serous chorioretinopathy, macular holes, diabetic retinopathy, and retinal artery occlusion are discussed. Potential areas of use for fluorescence lifetime imaging ophthalmoscopy will be outlined at the end of this review.

Open Source High Content Analysis Utilizing Automated Fluorescence Lifetime Imaging Microscopy

We present an open source high content analysis instrument utilizing automated fluorescence lifetime imaging (FLIM) for assaying protein interactions using Förster resonance energy transfer (FRET) based readouts of fixed or live cells in multiwell plates. This provides a means to screen for cell signaling processes read out using intramolecular FRET biosensors or intermolecular FRET of protein interactions such as oligomerization or heterodimerization, which can be used to identify binding partners. We describe here the functionality of this automated multiwell plate FLIM instrumentation and present exemplar data from our studies of HIV Gag protein oligomerization and a time course of a FRET biosensor in live cells. A detailed description of the practical implementation is then provided with reference to a list of hardware components and a description of the open source data acquisition software written in µManager. The application of FLIMfit, an open source MATLAB-based client for the OMERO platform, to analyze arrays of multiwell plate FLIM data is also presented. The protocols for imaging fixed and live cells are outlined and a demonstration of an automated multiwell plate FLIM experiment using cells expressing fluorescent protein-based FRET constructs is presented. This is complemented by a walk-through of the data analysis for this specific FLIM FRET data set.

Towards unsupervised fluorescence lifetime imaging using low dimensional variable projection

Analyzing large fluorescence lifetime imaging (FLIM) data is becoming overwhelming; the latest FLIM systems easily produce massive amounts of data, making an efficient analysis more challenging than ever. In this paper we propose the combination of a custom-fit variable projection method, with a Laguerre expansion based deconvolution, to analyze bi-exponential data obtained from time-domain FLIM systems. Unlike nonlinear least squares methods, which require a suitable initial guess from an experienced researcher, the new method is free from manual interventions and hence can support automated analysis. Monte Carlo simulations are carried out on synthesized FLIM data to demonstrate the performance compared to other approaches. The performance is also illustrated on real-life FLIM data obtained from the study of autofluorescence of daisy pollen and the endocytosis of gold nanorods (GNRs) in living cells. In the latter, the fluorescence lifetimes of the GNRs are much shorter than the full width at half maximum of the instrument response function. Overall, our proposed method contains simple steps and shows great promise in realising automated FLIM analysis of large data sets.

Deconvolution of fluorescence lifetime imaging microscopy by a library of exponentials

Fluorescence lifetime microscopy imaging (FLIM) is an optic technique that allows a quantitative characterization of the fluorescent components of a sample. However, for an accurate interpretation of FLIM, an initial processing step is required to deconvolve the instrument response of the system from the measured fluorescence decays. In this paper, we present a novel strategy for the deconvolution of FLIM data based on a library of exponentials. Our approach searches for the scaling coefficients of the library by non-negative least squares approximations plus Thikonov/l₂ or l₁ regularization terms. The parameters of the library are given by the lower and upper bounds in the characteristic lifetimes of the exponential functions and the size of the library, where we observe that this last variable is not a limiting factor in the resulting fitting accuracy. We compare our proposal to nonlinear least squares and global non-linear least squares estimations with a multi-exponential model, and also to constrained Laguerre-base expansions, where we visualize an advantage of our proposal based on Thikonov/l₂ regularization in terms of estimation accuracy, computational time, and tuning strategy. Our validation strategy considers synthetic datasets subject to both shot and Gaussian noise and samples with different lifetime maps, and experimental FLIM data of ex-vivo atherosclerotic plaques and human breast cancer cells.

Blind deconvolution estimation of fluorescence measurements through quadratic programming

Time-deconvolution of the instrument response from fluorescence lifetime imaging microscopy (FLIM) data is usually necessary for accurate fluorescence lifetime estimation. In many applications, however, the instrument response is not available. In such cases, a blind deconvolution approach is required. An iterative methodology is proposed to address the blind deconvolution problem departing from a dataset of FLIM measurements. A linear combination of a base conformed by Laguerre functions models the fluorescence impulse response of the sample at each spatial point in our formulation. Our blind deconvolution estimation (BDE) algorithm is formulated as a quadratic approximation problem, where the decision variables are the samples of the instrument response and the scaling coefficients of the basis functions. In the approximation cost function, there is a bilinear dependence on the decision variables. Hence, due to the nonlinear nature of the estimation process, an alternating least-squares scheme iteratively solves the approximation problem. Our proposal searches for the samples of the instrument response with a global perspective, and the scaling coefficients of the basis functions locally at each spatial point. First, the iterative methodology relies on a least-squares solution for the instrument response, and quadratic programming for the scaling coefficients applied just to a subset of the measured fluorescence decays to initially estimate the instrument response to speed up the convergence. After convergence, the final stage computes the fluorescence impulse response at all spatial points. A comprehensive validation stage considers synthetic and experimental FLIM datasets of ex vivo atherosclerotic plaques and human breast cancer cell samples that highlight the advantages of the proposed BDE algorithm under different noise and initial conditions in the iterative scheme and parameters of the proposal.

Time-domain microfluidic fluorescence lifetime flow cytometry for high-throughput Förster resonance energy transfer screening

Sensing ion or ligand concentrations, physico-chemical conditions, and molecular dimerization or conformation change is possible by assays involving fluorescent lifetime imaging. The inherent low throughput of imaging impedes rigorous statistical data analysis on large cell numbers. We address this limitation by developing a fluorescence lifetime-measuring flow cytometer for fast fluorescence lifetime quantification in living or fixed cell populations. The instrument combines a time-correlated single photon counting epifluorescent microscope with microfluidics cell-handling system. The associated computer software performs burst integrated fluorescence lifetime analysis to assign fluorescence lifetime, intensity, and burst duration to each passing cell. The maximum safe throughput of the instrument reaches 3,000 particles per minute. Living cells expressing spectroscopic rulers of varying peptide lengths were distinguishable by Förster resonant energy transfer measured by donor fluorescence lifetime. An epidermal growth factor (EGF)-stimulation assay demonstrated the technique's capacity to selectively quantify EGF receptor phosphorylation in cells, which was impossible by measuring sensitized emission on a standard flow cytometer. Dual-color fluorescence lifetime detection and cell-specific chemical environment sensing were exemplified using di-4-ANEPPDHQ, a lipophilic environmentally sensitive dye that exhibits changes in its fluorescence lifetime as a function of membrane lipid order. To our knowledge, this instrument opens new applications in flow cytometry which were unavailable due to technological limitations of previously reported fluorescent lifetime flow cytometers. The presented technique is sensitive to lifetimes of most popular fluorophores in the 0.5-5 ns range including fluorescent proteins and is capable of detecting multi-exponential fluorescence lifetime decays. This instrument vastly enhances the throughput of experiments involving fluorescence lifetime measurements, thereby providing statistically significant quantitative data for analysis of large cell populations. © 2014 International Society for Advancement of Cytometry.

Localizing protein-protein interactions in living cells using fluorescence lifetime imaging microscopy

In the past decade, advances in fluorescence lifetime imaging have extensively applied in the life sciences, from fundamental biological investigations to advanced clinical diagnosis. Fluorescence lifetime imaging microscopy (FLIM) is now routinely used in the biological sciences to monitor dynamic signaling events inside living cells, e.g., Protein-Protein interactions. In this chapter, we describe the calibration of both time-correlated single-photon counting (TCSPC) and frequency domain (FD) FLIM systems and the acquisition and analysis of FLIM-FRET data for investigating Protein-Protein interactions in living cells.

Alternating minimization of the negative Poisson likelihood function for the global analysis of fluorescence lifetime imaging microscopy data

We investigate a fast optimization method for determining the minimizer of the negative Poisson likelihood function for the global analysis of fluorescence lifetime microscopy. Using the alternating optimization strategy, we iteratively solve a non-convex optimization problem to estimate the lifetime parameters and a convex optimization problem to estimate the concentration parameters. We effectively determine the minimizer of the non-convex optimization using the Gauss-Newton method and that of the convex optimization by applying the optimization transfer strategy, which is based on the convex inequality. In the simulation studies, the proposed method was able to determine the minimizer of the objective function significantly faster than the conventional simultaneous optimization method.

Quantifying intracellular protein binding thermodynamics during mechanotransduction based on FRET spectroscopy

Mechanical force modulates myriad cellular functions including migration, alignment, proliferation, and gene transcription. Mechanotransduction, the transmission of mechanical forces and its translation into biochemical signals, may be mediated by force induced protein conformation changes, subsequently modulating protein signaling. For the paxillin and focal adhesion kinase interaction, we demonstrate that force-induced changes in protein complex conformation, dissociation constant, and binding Gibbs free energy can be quantified by lifetime-resolved fluorescence energy transfer microscopy combined with intensity imaging calibrated by fluorescence correlation spectroscopy. Comparison with in vitro data shows that this interaction is allosteric in vivo. Further, spatially resolved imaging and inhibitor assays show that this protein interaction and its mechano-sensitivity are equal in the cytosol and in the focal adhesions complexes indicating that the mechano-sensitivity of this interaction must be mediated by soluble factors but not based on protein tyrosine phosphorylation.

Penalized maximum likelihood estimation of lifetime and amplitude images from multi-exponentially decaying fluorescence signals

We investigated the penalized maximum likelihood estimation of lifetime and amplitude images for fluorescence lifetime imaging microscopy. The proposed method penalizes large variations in the lifetimes and amplitudes in the spatial domain to reduces noise in the images, which is a serious problem in the conventional maximum likelihood estimation method. For an effective optimization of the objective function, we applied an optimization transfer method that is based on a separable surrogate function. Simulations show that the proposed method outperforms the conventional MLE method in terms of the estimation accuracy, and the proposed method yielded less noisy images in real experiments.

Rapid global fitting of large fluorescence lifetime imaging microscopy datasets

Fluorescence lifetime imaging (FLIM) is widely applied to obtain quantitative information from fluorescence signals, particularly using Förster Resonant Energy Transfer (FRET) measurements to map, for example, protein-protein interactions. Extracting FRET efficiencies or population fractions typically entails fitting data to complex fluorescence decay models but such experiments are frequently photon constrained, particularly for live cell or in vivo imaging, and this leads to unacceptable errors when analysing data on a pixel-wise basis. Lifetimes and population fractions may, however, be more robustly extracted using global analysis to simultaneously fit the fluorescence decay data of all pixels in an image or dataset to a multi-exponential model under the assumption that the lifetime components are invariant across the image (dataset). This approach is often considered to be prohibitively slow and/or computationally expensive but we present here a computationally efficient global analysis algorithm for the analysis of time-correlated single photon counting (TCSPC) or time-gated FLIM data based on variable projection. It makes efficient use of both computer processor and memory resources, requiring less than a minute to analyse time series and multiwell plate datasets with hundreds of FLIM images on standard personal computers. This lifetime analysis takes account of repetitive excitation, including fluorescence photons excited by earlier pulses contributing to the fit, and is able to accommodate time-varying backgrounds and instrument response functions. We demonstrate that this global approach allows us to readily fit time-resolved fluorescence data to complex models including a four-exponential model of a FRET system, for which the FRET efficiencies of the two species of a bi-exponential donor are linked, and polarisation-resolved lifetime data, where a fluorescence intensity and bi-exponential anisotropy decay model is applied to the analysis of live cell homo-FRET data. A software package implementing this algorithm, FLIMfit, is available under an open source licence through the Open Microscopy Environment.

Automated fluorescence lifetime imaging plate reader and its application to Förster resonant energy transfer readout of Gag protein aggregation

Fluorescence lifetime measurements can provide quantitative readouts of local fluorophore environment and can be applied to biomolecular interactions via Förster resonant energy transfer (FRET). Fluorescence lifetime imaging (FLIM) can therefore provide a high content analysis (HCA) modality to map protein-protein interactions (PPIs) with applications in drug discovery, systems biology and basic research. We present here an automated multiwell plate reader able to perform rapid unsupervised optically sectioned FLIM of fixed and live biological samples and illustrate its potential to assay PPIs through application to Gag protein aggregation during the HIV life cycle. We demonstrate both hetero-FRET and homo-FRET readouts of protein aggregation and report the first quantitative evaluation of a FLIM HCA assay by generating dose response curves through addition of an inhibitor of Gag myristoylation. Z' factors exceeding 0.6 are realised for this FLIM FRET assay.

Automated fluorescence lifetime imaging plate reader and its application to Förster resonant energy transfer readout of Gag protein aggregation

Fluorescence lifetime measurements can provide quantitative readouts of local fluorophore environment and can be applied to biomolecular interactions via Förster resonant energy transfer (FRET). Fluorescence lifetime imaging (FLIM) can therefore provide a high content analysis (HCA) modality to map protein-protein interactions (PPIs) with applications in drug discovery, systems biology and basic research. We present here an automated multiwell plate reader able to perform rapid unsupervised optically sectioned FLIM of fixed and live biological samples and illustrate its potential to assay PPIs through application to Gag protein aggregation during the HIV life cycle. We demonstrate both hetero-FRET and homo-FRET readouts of protein aggregation and report the first quantitative evaluation of a FLIM HCA assay by generating dose response curves through addition of an inhibitor of Gag myristoylation. Z' factors exceeding 0.6 are realised for this FLIM FRET assay.

Statistical properties of amplitude and decay parameter estimators for fluorescence lifetime imaging

We analyze the statistical properties of the maximum likelihood estimator, least squares estimator, and Pearson's χ(2)-based and Neyman's χ(2)-based estimators for the estimation of decay constants and amplitudes for fluorescence lifetime imaging. Our analysis is based on the linearization of the gradient of the objective functions around true parameters. The analysis shows that only the maximum likelihood estimator based on the Poisson likelihood function yields unbiased and efficient estimation. All other estimators yield either biased or inefficient estimations. We validate our analysis by using simulations.

Mid-infrared lifetime imaging for viability evaluation of lettuce seeds based on time-dependent thermal decay characterization

An infrared lifetime thermal imaging technique for the measurement of lettuce seed viability was evaluated. Thermal emission signals from mid-infrared images of healthy seeds and seeds aged for 24, 48, and 72 h were obtained and reconstructed using regression analysis. The emission signals were fitted with a two-term exponential model that had two amplitudes and two time variables as lifetime parameters. The lifetime thermal decay parameters were significantly different for seeds with different aging times. Single-seed viability was visualized using thermal lifetime images constructed from the calculated lifetime parameter values. The time-dependent thermal signal decay characteristics, along with the decay amplitude and delay time images, can be used to distinguish aged lettuce seeds from normal seeds.

3D-resolved fluorescence and phosphorescence lifetime imaging using temporal focusing wide-field two-photon excitation

Fluorescence and phosphorescence lifetime imaging are powerful techniques for studying intracellular protein interactions and for diagnosing tissue pathophysiology. While lifetime-resolved microscopy has long been in the repertoire of the biophotonics community, current implementations fall short in terms of simultaneously providing 3D resolution, high throughput, and good tissue penetration. This report describes a new highly efficient lifetime-resolved imaging method that combines temporal focusing wide-field multiphoton excitation and simultaneous acquisition of lifetime information in frequency domain using a nanosecond gated imager from a 3D-resolved plane. This approach is scalable allowing fast volumetric imaging limited only by the available laser peak power. The accuracy and performance of the proposed method is demonstrated in several imaging studies important for understanding peripheral nerve regeneration processes. Most importantly, the parallelism of this approach may enhance the imaging speed of long lifetime processes such as phosphorescence by several orders of magnitude.

Methodological considerations for global analysis of cellular FLIM/FRET measurements

Global algorithms can improve the analysis of fluorescence energy transfer (FRET) measurement based on fluorescence lifetime microscopy. However, global analysis of FRET data is also susceptible to experimental artifacts. This work examines several common artifacts and suggests remedial experimental protocols. Specifically, we examined the accuracy of different methods for instrument response extraction and propose an adaptive method based on the mean lifetime of fluorescent proteins. We further examined the effects of image segmentation and a priori constraints on the accuracy of lifetime extraction. Methods to test the applicability of global analysis on cellular data are proposed and demonstrated. The accuracy of global fitting degrades with lower photon count. By systematically tracking the effect of the minimum photon count on lifetime and FRET prefactors when carrying out global analysis, we demonstrate a correction procedure to recover the correct FRET parameters, allowing us to obtain protein interaction information even in dim cellular regions with photon counts as low as 100 per decay curve.

Phasor imaging with a widefield photon-counting detector

Fluorescence lifetime can be used as a contrast mechanism to distinguish fluorophores for localization or tracking, for studying molecular interactions, binding, assembly, and aggregation, or for observing conformational changes via Förster resonance energy transfer (FRET) between donor and acceptor molecules. Fluorescence lifetime imaging microscopy (FLIM) is thus a powerful technique but its widespread use has been hampered by demanding hardware and software requirements. FLIM data is often analyzed in terms of multicomponent fluorescence lifetime decays, which requires large signals for a good signal-to-noise ratio. This confines the approach to very low frame rates and limits the number of frames which can be acquired before bleaching the sample. Recently, a computationally efficient and intuitive graphical representation, the phasor approach, has been proposed as an alternative method for FLIM data analysis at the ensemble and single-molecule level. In this article, we illustrate the advantages of combining phasor analysis with a widefield time-resolved single photon-counting detector (the H33D detector) for FLIM applications. In particular we show that phasor analysis allows real-time subsecond identification of species by their lifetimes and rapid representation of their spatial distribution, thanks to the parallel acquisition of FLIM information over a wide field of view by the H33D detector. We also discuss possible improvements of the H33D detector's performance made possible by the simplicity of phasor analysis and its relaxed timing accuracy requirements compared to standard time-correlated single-photon counting (TCSPC) methods.

Phasor approach to fluorescence lifetime microscopy distinguishes different metabolic states of germ cells in a live tissue

We describe a label-free imaging method to monitor stem-cell metabolism that discriminates different states of stem cells as they differentiate in living tissues. In this method we use intrinsic fluorescence biomarkers and the phasor approach to fluorescence lifetime imaging microscopy in conjunction with image segmentation, which we use to introduce the concept of the cell phasor. In live tissues we are able to identify intrinsic fluorophores, such as collagen, retinol, retinoic acid, porphyrin, flavins, and free and bound NADH. We have exploited the cell phasor approach to detect a trend in metabolite concentrations along the main axis of the Caenorhabditis elegans germ line. This trend is consistent with known changes in metabolic states during differentiation. The cell phasor approach to lifetime imaging provides a label-free, fit-free, and sensitive method to identify different metabolic states of cells during differentiation, to sense small changes in the redox state of cells, and may identify symmetric and asymmetric divisions and predict cell fate. Our method is a promising noninvasive optical tool for monitoring metabolic pathways during differentiation or disease progression, and for cell sorting in unlabeled tissues.