High speed multispectral fluorescence lifetime imaging

Multiplexed imaging in live cells using pulsed interleaved excitation spectral FLIM

Multiplexed fluorescence detection has become increasingly important in the fields of biosensing and bioimaging. Although a variety of excitation/detection optical designs and fluorescence unmixing schemes have been proposed to allow for multiplexed imaging, rapid and reliable differentiation and quantification of multiple fluorescent species at each imaging pixel is still challenging. Here we present a pulsed interleaved excitation spectral fluorescence lifetime microscopic (PIE-sFLIM) system that can simultaneously image six fluorescent tags in live cells in a single hyperspectral snapshot. Using an alternating pulsed laser excitation scheme at two different wavelengths and a synchronized 16-channel time-resolved spectral detector, our PIE-sFLIM system can effectively excite multiple fluorophores and collect their emission over a broad spectrum for analysis. Combining our system with the advanced live-cell labeling techniques and the lifetime/spectral phasor analysis, our PIE-sFLIM approach can well unmix the fluorescence of six fluorophores acquired in a single measurement, thus improving the imaging speed in live-specimen investigation.

Phasor S-FLIM: a new paradigm for fast and robust spectral fluorescence lifetime imaging

Fluorescence lifetime imaging microscopy (FLIM) and spectral imaging are two broadly applied methods for increasing dimensionality in microscopy. However, their combination is typically inefficient and slow in terms of acquisition and processing. By integrating technological and computational advances, we developed a robust and unbiased spectral FLIM (S-FLIM) system. Our method, Phasor S-FLIM, combines true parallel multichannel digital frequency domain electronics with a multidimensional phasor approach to extract detailed and precise information about the photophysics of fluorescent specimens at optical resolution. To show the flexibility of the Phasor S-FLIM technology and its applications to the biological and biomedical field, we address four common, yet challenging, problems: the blind unmixing of spectral and lifetime signatures from multiple unknown species, the unbiased bleedthrough- and background-free Förster resonance energy transfer analysis of biosensors, the photophysical characterization of environment-sensitive probes in living cells and parallel four-color FLIM imaging in tumor spheroids.

A Review of New High-Throughput Methods Designed for Fluorescence Lifetime Sensing From Cells and Tissues

Though much of the interest in fluorescence in the past has been on measuring spectral qualities such as wavelength and intensity, there are two other highly useful intrinsic properties of fluorescence: lifetime (or decay) and anisotropy (or polarization). Each has its own set of unique advantages, limitations, and challenges in detection when it comes to use in biological studies. This review will focus on the property of fluorescence lifetime, providing a brief background on instrumentation and theory, and examine the recent advancements and applications of measuring lifetime in the fields of high-throughput fluorescence lifetime imaging microscopy (HT-FLIM) and time-resolved flow cytometry (TRFC). In addition, the crossover of these two methods and their outlooks will be discussed.

Fluorescence lifetime imaging microscopy: fundamentals and advances in instrumentation, analysis, and applications

SIGNIFICANCE

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique to distinguish the unique molecular environment of fluorophores. FLIM measures the time a fluorophore remains in an excited state before emitting a photon, and detects molecular variations of fluorophores that are not apparent with spectral techniques alone. FLIM is sensitive to multiple biomedical processes including disease progression and drug efficacy.

AIM

We provide an overview of FLIM principles, instrumentation, and analysis while highlighting the latest developments and biological applications.

APPROACH

This review covers FLIM principles and theory, including advantages over intensity-based fluorescence measurements. Fundamentals of FLIM instrumentation in time- and frequency-domains are summarized, along with recent developments. Image segmentation and analysis strategies that quantify spatial and molecular features of cellular heterogeneity are reviewed. Finally, representative applications are provided including high-resolution FLIM of cell- and organelle-level molecular changes, use of exogenous and endogenous fluorophores, and imaging protein-protein interactions with Förster resonance energy transfer (FRET). Advantages and limitations of FLIM are also discussed.

CONCLUSIONS

FLIM is advantageous for probing molecular environments of fluorophores to inform on fluorophore behavior that cannot be elucidated with intensity measurements alone. Development of FLIM technologies, analysis, and applications will further advance biological research and clinical assessments.

Multi-target immunofluorescence by separation of antibody cross-labelling via spectral-FLIM-FRET

In biomedical research, indirect immunofluorescence labelling by use of primary and secondary antibodies is central for revealing the spatial distribution of multiple cellular antigens. However, labelling is regularly restricted to few antigens since species variation of primary and corresponding secondary antibodies is limited bearing the risk of unspecific cross-labelling. Here, we introduce a novel microscopic procedure for leveraging undesirable cross-labelling effects among secondary antibodies thereby increasing the number of fluorophore channels. Under cross-labelling conditions, commonly used fluorophores change chemical-physical properties by ‘Förster resonance energy transfer’ leading to defined changes in spectral emission and lifetime decay. By use of spectral fluorescence lifetime imaging and pattern-matching, we demonstrate precise separation of cross-labelled cellular antigens where conventional imaging completely fails. Consequently, this undesired effect serves for an innovative imaging procedure to separate critical antigens where antibody species variation is limited and allows for multi-target labelling by attribution of new fluorophore cross-labelling channels.

Wide-field time-gated SPAD imager for phasor-based FLIM applications

We describe the performance of a new wide area time-gated single-photon avalanche diode (SPAD) array for phasor-FLIM, exploring the effect of gate length, gate number and signal intensity on the measured lifetime accuracy and precision. We conclude that the detector functions essentially as an ideal shot noise limited sensor and is capable of video rate FLIM measurement. The phasor approach used in this work appears ideally suited to handle the large amount of data generated by this type of very large sensor (512 × 512 pixels), even in the case of small number of gates and limited photon budget.

Dual-mode emission and transmission microscopy for virtual histochemistry using hematoxylin- and eosin-stained tissue sections

In the clinical practice of pathology, trichrome stains are commonly used to highlight collagen and to help evaluate fibrosis. Such stains do delineate collagen deposits but are not molecularly specific and can suffer from staining inconsistencies. Moreover, performing histochemical stain evaluation requires the preparation of additional sections beyond the original hematoxylin- and eosin-stained slides, as well as additional staining steps, which together add cost, time, and workflow complications. We have developed a new microscopy approach, termed DUET (DUal-mode Emission and Transmission) that can be used to extract signals that would typically require special stains or advanced optical methods. Our preliminary analysis demonstrates the potential of using the resulting signals to generate virtual histochemical images that resemble trichrome-stained slides and can support clinical evaluation. We demonstrate advantages of this approach over images acquired from conventional trichrome-stained slides and compare them with images created using second harmonic generation microscopy.

Fast single-cell biochemistry: theory, open source microscopy and applications

Fluorescence lifetime sensing enables researchers to probe the physicochemical environment of a fluorophore providing a window through which we can observe the complex molecular make-up of the cell. Fluorescence lifetime imaging microscopy (FLIM) quantifies and maps cell biochemistry, a complex ensemble of dynamic processes. Unfortunately, typical high-resolution FLIM systems exhibit rather limited acquisition speeds, often insufficient to capture the time evolution of biochemical processes in living cells. Here, we describe the theoretical background that justifies the developments of high-speed single photon counting systems. We show that systems with low dead-times not only result in faster acquisition throughputs but also improved dynamic range and spatial resolution. We also share the implementation of hardware and software as an open platform, show applications of fast FLIM biochemical imaging on living cells and discuss strategies to balance precision and accuracy in FLIM. The recent innovations and commercialisation of fast time-domain FLIM systems are likely to popularise FLIM within the biomedical community, to impact biomedical research positively and to foster the adoption of other FLIM techniques as well. While supporting and indeed pursuing these developments, with this work we also aim to warn the community about the possible shortcomings of fast single photon counting techniques and to highlight strategies to acquire data of high quality.

Enhancing Biochemical Resolution by Hyperdimensional Imaging Microscopy

Two decades of fast-paced innovation have improved the spatial resolution of fluorescence microscopy to enable molecular resolution with low invasiveness and high specificity. Fluorescence microscopy also enables scientists and clinicians to map and quantitate the physicochemical properties (e.g., analyte concentration, enzymatic activities, and protein-protein interactions) of biological samples. But the biochemical resolving power of fluorescence microscopy is not as well optimized as its spatial resolution. Current techniques typically observe only the individual properties of fluorescence, thus limiting the opportunities for sensing and multiplexing. Here, we demonstrate a new, to our knowledge, imaging paradigm, hyperdimensional imaging microscopy, which quantifies simultaneously and efficiently all the properties of fluorescence emission (excited-state lifetime, polarization, and spectra) in biological samples, transcending existing limitations. Such simultaneous detection of fluorescence features maximizes the biochemical resolving power of fluorescence microscopy, thereby providing the means to enhance sensing capabilities and enable heavily multiplexed assays. Just as multidimensional separation in mass-spectroscopy and multidimensional spectra in NMR have empowered proteomics and structural biology, we envisage that hyperdimensional imaging microscopy spectra of unprecedented dimensionality will catalyze advances in systems biology and medical diagnostics.

Portable fluorescence lifetime spectroscopy system for in-situ interrogation of biological tissues

Fluorescence spectroscopy and lifetime techniques are potential methods for optical diagnosis and characterization of biological tissues with an in-situ, fast, and noninvasive interrogation. Several diseases may be diagnosed due to differences in the fluorescence spectra of targeted fluorophores, when, these spectra are similar, considering steady-state fluorescence, others may be detected by monitoring their fluorescence lifetime. Despite this complementarity, most of the current fluorescence lifetime systems are not robust and portable, and not being feasible for clinical applications. We describe the assembly of a fluorescence lifetime spectroscopy system in a suitcase, its characterization, and validation with clinical measurements of skin lesions. The assembled system is all encased and robust, maintaining its mechanical, electrical, and optical stability during transportation, and is feasible for clinical measurements. The instrument response function measured was about 300 ps, and the system is properly calibrated. At the clinical study, the system showed to be reliable, and the achieved spectroscopy results support its potential use as an auxiliary tool for skin diagnostics.

Rapid fluorescence lifetime estimation with modified phasor approach and Laguerre deconvolution: a comparative study

Fluorescence lifetime imaging has been shown to serve as a valuable tool for interrogating and diagnosis of biological tissue at a mesoscopic level. The ability to analyze fluorescence decay curves to extract lifetime values in real-time is crucial for clinical translation and applications such as tumor margin delineation or intracoronary imaging of atherosclerotic plaques. In this work, we compare the performance of two popular non-parametric (fit-free) methods for determining lifetime values from fluorescence decays in real-time-the Phasor approach and Laguerre deconvolution. We demonstrate results from simulated and experimental data to compare the accuracy and speed of both methods and their dependence on noise and model parameters.

A multidimensional phasor approach reveals LAURDAN photophysics in NIH-3T3 cell membranes

Mammalian cell membranes have different phospholipid composition and cholesterol content, displaying a profile of fluidity that depends on their intracellular location. Among the dyes used in membrane studies, LAURDAN has the advantage to be sensitive to the lipid composition as well as to membrane fluidity. The LAURDAN spectrum is sensitive to the lipid composition and dipolar relaxation arising from water penetration, but disentangling lipid composition from membrane fluidity can be obtained if time resolved spectra could be measured at each cell location. Here we describe a method in which spectral and lifetime information obtained in different measurements at the same plane in a cell are used in the phasor plot providing a solution to analyze multiple lifetime or spectral data through a common visualization approach. We exploit a property of phasor plots based on the reciprocal role of the phasor plot and the image. In the phasor analysis each pixel of the image is associated with a phasor and each phasor maps to pixels and features in the image. In this paper the lifetime and spectral fluorescence data are used simultaneously to determine the contribution of polarity and dipolar relaxations of LAURDAN in each pixel of an image.

Multicolor two-photon imaging of endogenous fluorophores in living tissues by wavelength mixing

Two-photon imaging of endogenous fluorescence can provide physiological and metabolic information from intact tissues. However, simultaneous imaging of multiple intrinsic fluorophores, such as nicotinamide adenine dinucleotide(phosphate) (NAD(P)H), flavin adenine dinucleotide (FAD) and retinoids in living systems is generally hampered by sequential multi-wavelength excitation resulting in motion artifacts. Here, we report on efficient and simultaneous multicolor two-photon excitation of endogenous fluorophores with absorption spectra spanning the 750-1040 nm range, using wavelength mixing. By using two synchronized pulse trains at 760 and 1041 nm, an additional equivalent two-photon excitation wavelength at 879 nm is generated, and achieves simultaneous excitation of blue, green and red intrinsic fluorophores. This method permits an efficient simultaneous imaging of the metabolic coenzymes NADH and FAD to be implemented with perfect image co-registration, overcoming the difficulties associated with differences in absorption spectra and disparity in concentration. We demonstrate ratiometric redox imaging free of motion artifacts and simultaneous two-photon fluorescence lifetime imaging (FLIM) of NADH and FAD in living tissues. The lifetime gradients of NADH and FAD associated with different cellular metabolic and differentiation states in reconstructed human skin and in the germline of live C. Elegans are thus simultaneously measured. Finally, we present multicolor imaging of endogenous fluorophores and second harmonic generation (SHG) signals during the early stages of Zebrafish embryo development, evidencing fluorescence spectral changes associated with development.

Hyperspectral phasor analysis enables multiplexed 5D in vivo imaging

Time-lapse imaging of multiple labels is challenging for biological imaging as noise, photobleaching and phototoxicity compromise signal quality, while throughput can be limited by processing time. Here, we report software called Hyper-Spectral Phasors (HySP) for denoising and unmixing multiple spectrally overlapping fluorophores in a low signal-to-noise regime with fast analysis. We show that HySP enables unmixing of seven signals in time-lapse imaging of living zebrafish embryos.

Multi-target spectrally resolved fluorescence lifetime imaging microscopy

We introduce a pattern-matching technique for efficient identification of fluorophore ratios in complex multidimensional fluorescence signals using reference fluorescence decay and spectral signature patterns of individual fluorescent probes. Alternating pulsed laser excitation at three different wavelengths and time-resolved detection on 32 spectrally separated detection channels ensures efficient excitation of fluorophores and a maximum gain of fluorescence information. Using spectrally resolved fluorescence lifetime imaging microscopy (sFLIM), we were able to visualize up to nine different target molecules simultaneously in mouse C2C12 cells. By exploiting the sensitivity of fluorescence emission spectra and the lifetime of organic fluorophores on environmental factors, we carried out fluorescence imaging of three different target molecules in human U2OS cells with the same fluorophore. Our results demonstrate that sFLIM can be used for super-resolution multi-target imaging by stimulated emission depletion (STED).

Temporal Data Set Reduction Based on D-Optimality for Quantitative FLIM-FRET Imaging

Fluorescence lifetime imaging (FLIM) when paired with Förster resonance energy transfer (FLIM-FRET) enables the monitoring of nanoscale interactions in living biological samples. FLIM-FRET model-based estimation methods allow the quantitative retrieval of parameters such as the quenched (interacting) and unquenched (non-interacting) fractional populations of the donor fluorophore and/or the distance of the interactions. The quantitative accuracy of such model-based approaches is dependent on multiple factors such as signal-to-noise ratio and number of temporal points acquired when sampling the fluorescence decays. For high-throughput or in vivo applications of FLIM-FRET, it is desirable to acquire a limited number of temporal points for fast acquisition times. Yet, it is critical to acquire temporal data sets with sufficient information content to allow for accurate FLIM-FRET parameter estimation. Herein, an optimal experimental design approach based upon sensitivity analysis is presented in order to identify the time points that provide the best quantitative estimates of the parameters for a determined number of temporal sampling points. More specifically, the D-optimality criterion is employed to identify, within a sparse temporal data set, the set of time points leading to optimal estimations of the quenched fractional population of the donor fluorophore. Overall, a reduced set of 10 time points (compared to a typical complete set of 90 time points) was identified to have minimal impact on parameter estimation accuracy (≈5%), with in silico and in vivo experiment validations. This reduction of the number of needed time points by almost an order of magnitude allows the use of FLIM-FRET for certain high-throughput applications which would be infeasible if the entire number of time sampling points were used.

Fast and simple spectral FLIM for biochemical and medical imaging

Spectrally resolved fluorescence lifetime imaging microscopy (λFLIM) has powerful potential for biochemical and medical imaging applications. However, long acquisition times, low spectral resolution and complexity of λFLIM often narrow its use to specialized laboratories. Therefore, we demonstrate here a simple spectral FLIM based on a solid-state detector array providing in-pixel histrogramming and delivering faster acquisition, larger dynamic range, and higher spectral elements than state-of-the-art λFLIM. We successfully apply this novel microscopy system to biochemical and medical imaging demonstrating that solid-state detectors are a key strategic technology to enable complex assays in biomedical laboratories and the clinic.

Few-photon imaging at 1550 nm using a low-timing-jitter superconducting nanowire single-photon detector

We demonstrated a laser depth imaging system based on the time-correlated single-photon counting technique, which was incorporated with a low-jitter superconducting nanowire single-photon detector (SNSPD), operated at the wavelength of 1550 nm. A sub-picosecond time-bin width was chosen for photon counting, resulting in a discrete noise of less than one/two counts for each time bin under indoor/outdoor daylight conditions, with a collection time of 50 ms. Because of the low-jitter SNSPD, the target signal histogram was significantly distinguishable, even for a fairly low retro-reflected photon flux. The depth information was determined directly by the highest bin counts, instead of using any data fitting combined with complex algorithms. Millimeter resolution depth imaging of a low-signature object was obtained, and more accurate data than that produced by the traditional Gaussian fitting method was generated. Combined with the intensity of the return photons, three-dimensional reconstruction overlaid with reflectivity data was realized.

Reduced temporal sampling effect on accuracy of time-domain fluorescence lifetime Förster resonance energy transfer

Fluorescence lifetime imaging (FLIM) aims at quantifying the exponential decay rate of fluorophores to yield lifetime maps over the imaged sample. When combined with Förster resonance energy transfer (FRET), the technique can be used to indirectly sense interactions at the nanoscale such as protein–protein interactions, protein–DNA interactions, and protein conformational changes. In the case of FLIM-FRET, the fluorescence intensity decays are fitted to a biexponential model in order to estimate the lifetime and fractional amplitude coefficients of each component of the population of the donor fluorophore (quenched and nonquenched). Numerous time data points, also called temporal or time gates, are typically employed for accurately estimating the model parameters, leading to lengthy acquisition times and significant computational demands. This work investigates the effect of the number and location of time gates on model parameter estimation accuracy. A detailed model of a FLIM-FRET imaging system is used for the investigation, and the simulation outcomes are validated with in vitro and in vivo experimental data. In all cases investigated, it is found that 10 equally spaced time gates allow robust estimation of model-based parameters with accuracy similar to that of full temporal datasets (90 gates).

Parallel excitation-emission multiplexed fluorescence lifetime confocal microscopy for live cell imaging

We present a novel excitation-emission multiplexed fluorescence lifetime microscopy (FLIM) method that surpasses current FLIM techniques in multiplexing capability. The method employs Fourier multiplexing to simultaneously acquire confocal fluorescence lifetime images of multiple excitation wavelength and emission color combinations at 44,000 pixels/sec. The system is built with low-cost CW laser sources and standard PMTs with versatile spectral configuration, which can be implemented as an add-on to commercial confocal microscopes. The Fourier lifetime confocal method allows fast multiplexed FLIM imaging, which makes it possible to monitor multiple biological processes in live cells. The low cost and compatibility with commercial systems could also make multiplexed FLIM more accessible to biological research community.

Efficient blind spectral unmixing of fluorescently labeled samples using multi-layer non-negative matrix factorization

The ample variety of labeling dyes and staining methods available in fluorescence microscopy has enabled biologists to advance in the understanding of living organisms at cellular and molecular level. When two or more fluorescent dyes are used in the same preparation, or one dye is used in the presence of autofluorescence, the separation of the fluorescent emissions can become problematic. Various approaches have been recently proposed to solve this problem. Among them, blind non-negative matrix factorization is gaining interest since it requires little assumptions about the spectra and concentration of the fluorochromes. In this paper, we propose a novel algorithm for blind spectral separation that addresses some of the shortcomings of existing solutions: namely, their dependency on the initialization and their slow convergence. We apply this new algorithm to two relevant problems in fluorescence microscopy: autofluorescence elimination and spectral unmixing of multi-labeled samples. Our results show that our new algorithm performs well when compared with the state-of-the-art approaches for a much faster implementation.