Optimizing frequency-domain fluorescence lifetime sensing for high-throughput applications: photon economy and acquisition speed

Development of a high-speed line-scanning fluorescence lifetime imaging microscope for biological imaging

We report the development of a novel line-scanning microscope capable of acquiring high-speed time-correlated single-photon counting (TCSPC)-based fluorescence lifetime imaging microscopy (FLIM) imaging. The system consists of a laser-line focus, which is optically conjugated to a 1024 × 8 single-photon avalanche diode (SPAD)-based line-imaging complementary metal-oxide semiconductor (CMOS), with 23.78 µm pixel pitch at 49.31% fill factor. Incorporation of on-chip histogramming on the line-sensor enables acquisition rates 33 times faster than our previously reported bespoke high-speed FLIM platforms. We demonstrate the imaging capability of the high-speed FLIM platform in a number of biological applications.

Resonant Electro-Optic Imaging for Microscopy at Nanosecond Resolution

We demonstrate an electro-optic wide-field method to enable fluorescence lifetime microscopy (FLIM) with high throughput and single-molecule sensitivity. Resonantly driven Pockels cells are used to efficiently gate images at 39 MHz, allowing fluorescence lifetime to be captured on standard camera sensors. Lifetime imaging of single molecules is enabled in wide field with exposure times of less than 100 ms. This capability allows combination of wide-field FLIM with single-molecule super-resolution localization microscopy. Fast single-molecule dynamics such as FRET and molecular binding events are captured from wide-field images without prior spatial knowledge. A lifetime sensitivity of 1.9 times the photon shot-noise limit is achieved, and high throughput is shown by acquiring wide-field FLIM images with millisecond exposure and >10⁸ photons per frame. Resonant electro-optic FLIM allows lifetime contrast in any wide-field microscopy method.

Biochemical resolving power of fluorescence lifetime imaging: untangling the roles of the instrument response function and photon-statistics

A deeper understanding of spatial resolution has led to innovations in microscopy and the disruption of biomedical research, as with super-resolution microscopy. To foster similar advances in time-resolved and spectral imaging, we have previously introduced the concept of 'biochemical resolving power' in fluorescence microscopy. Here, we apply those concepts to investigate how the instrument response function (IRF), sampling conditions, and photon-statistics limit the biochemical resolution of fluorescence lifetime microscopy. Using Fisher information analysis and Monte Carlo simulations, we reveal the complex dependencies between photon-statistics and the IRF, permitting us to quantify resolution limits that have been poorly understood (e.g., the minimum resolvable decay time for a given width of the IRF and photon-statistics) or previously underappreciated (e.g., optimization of the IRF for biochemical detection). With this work, we unravel common misunderstandings on the role of the IRF and provide theoretical insights with significant practical implications on the design and use of time-resolved instrumentation.

Direct Photon-by-Photon Analysis of Time-Resolved Pulsed Excitation Data using Bayesian Nonparametrics

Lifetimes of chemical species are typically estimated by either fitting time-correlated single-photon counting (TCSPC) histograms or phasor analysis from time-resolved photon arrivals. While both methods yield lifetimes in a computationally efficient manner, their performance is limited by choices made on the number of distinct chemical species contributing photons. However, the number of species is encoded in the photon arrival times collected for each illuminated spot and need not be set by hand a priori. Here, we propose a direct photon-by-photon analysis of data drawn from pulsed excitation experiments to infer, simultaneously and self-consistently, the number of species and their associated lifetimes from a few thousand photons. We do so by leveraging new mathematical tools within the Bayesian nonparametric. We benchmark our method for both simulated and experimental data for 1-4 species.

Lightsheet fluorescence lifetime imaging microscopy with wide-field time-correlated single photon counting

We report on wide-field time-correlated single photon counting (TCSPC)-based fluorescence lifetime imaging microscopy (FLIM) with lightsheet illumination. A pulsed diode laser is used for excitation, and a crossed delay line anode image intensifier, effectively a single-photon sensitive camera, is used to record the position and arrival time of the photons with picosecond time resolution, combining low illumination intensity of microwatts with wide-field data collection. We pair this detector with the lightsheet illumination technique, and apply it to 3D FLIM imaging of dye gradients in human cancer cell spheroids, and C. elegans.

How many photons are needed for FRET imaging?

Förster resonance energy transfer (FRET) imaging is an essential analytical method in biomedical research. The limited photon-budget experimentally available, however, imposes compromises between spatiotemporal and biochemical resolutions, photodamage and phototoxicity. The study of photon-statistics in biochemical imaging is thus important in guiding the efficient design of instrumentation and assays. Here, we show a comparative analysis of photon-statistics in FRET imaging demonstrating how the precision of FRET imaging varies vastly with imaging parameters. Therefore, we provide analytical and numerical tools for assay optimization. Fluorescence lifetime imaging microscopy (FLIM) is a very robust technique with excellent photon-efficiencies. However, we show that also intensity-based FRET imaging can reach high precision by utilizing information from both donor and acceptor fluorophores.

Wide-field time-correlated single photon counting-based fluorescence lifetime imaging microscopy

Wide-field time-correlated single photon counting detection techniques, where the position and the arrival time of the photons are recorded simultaneously using a camera, have made some advances recently. The technology and instrumentation used for this approach is employed in areas such as nuclear science, mass spectroscopy and positron emission tomography, but here, we discuss some of the wide-field TCSPC methods, for applications in fluorescence microscopy. We describe work by us and others as presented in the Ulitima fast imaging and tracking conference at the Argonne National Laboratory in September 2018, from phosphorescence lifetime imaging (PLIM) microscopy on the microsecond time scale to fluorescence lifetime imaging (FLIM) on the nanosecond time scale, and highlight some applications of these techniques.

Electro-optic imaging enables efficient wide-field fluorescence lifetime microscopy

Nanosecond temporal resolution enables new methods for wide-field imaging like time-of-flight, gated detection, and fluorescence lifetime. The optical efficiency of existing approaches, however, presents challenges for low-light applications common to fluorescence microscopy and single-molecule imaging. We demonstrate the use of Pockels cells for wide-field image gating with nanosecond temporal resolution and high photon collection efficiency. Two temporal frames are obtained by combining a Pockels cell with a pair of polarizing beam-splitters. We show multi-label fluorescence lifetime imaging microscopy (FLIM), single-molecule lifetime spectroscopy, and fast single-frame FLIM at the camera frame rate with 10³–10⁵ times higher throughput than single photon counting. Finally, we demonstrate a space-to-time image multiplexer using a re-imaging optical cavity with a tilted mirror to extend the Pockels cell technique to multiple temporal frames. These methods enable nanosecond imaging with standard optical systems and sensors, opening a new temporal dimension for wide-field low-light microscopy.

Nanosecond imaging techniques, such as fluorescence lifetime imaging microscopy (FLIM), are limited by low efficiency of current detectors. Here, the authors implement an electro-optic approach using Pockels cells for wide-field image gating and demonstrate high throughput FLIM on standard camera sensors.

Fast single-cell biochemistry: theory, open source microscopy and applications

Fluorescence lifetime sensing enables researchers to probe the physicochemical environment of a fluorophore providing a window through which we can observe the complex molecular make-up of the cell. Fluorescence lifetime imaging microscopy (FLIM) quantifies and maps cell biochemistry, a complex ensemble of dynamic processes. Unfortunately, typical high-resolution FLIM systems exhibit rather limited acquisition speeds, often insufficient to capture the time evolution of biochemical processes in living cells. Here, we describe the theoretical background that justifies the developments of high-speed single photon counting systems. We show that systems with low dead-times not only result in faster acquisition throughputs but also improved dynamic range and spatial resolution. We also share the implementation of hardware and software as an open platform, show applications of fast FLIM biochemical imaging on living cells and discuss strategies to balance precision and accuracy in FLIM. The recent innovations and commercialisation of fast time-domain FLIM systems are likely to popularise FLIM within the biomedical community, to impact biomedical research positively and to foster the adoption of other FLIM techniques as well. While supporting and indeed pursuing these developments, with this work we also aim to warn the community about the possible shortcomings of fast single photon counting techniques and to highlight strategies to acquire data of high quality.

Semi-autonomous real-time programmable fluorescence lifetime segmentation with a digital micromirror device

Time-correlated single-photon counting (TCSPC) is the gold standard for performing lifetime spectroscopy in biological assays. Traditional fluorescence lifetime imaging (FLIM) using laser scanning microscopes are inherently slow due to point scanning all pixels in the field-of-view. Wide-field implementations of TCSPC spectroscopy using microchannel plates benefit from particularly fast acquisition times at the expense of temporal resolution, and are fundamentally limited by photon counting rates. Here, we introduce programmable lifetime imaging (PLI), combining the advantages of wide-field imaging using total internal reflection excitation with state-of-the-art TCSPC detector technology for accurate lifetime determination in an object-oriented manner using a digital micromirror device (DMD). The fluorescent emission is projected onto the DMD to facilitate the sequential segmentation of fluorescence from individual objects in the field-of-view, allowing for both image acquisition and fluorescence lifetime determination of the assay. The sensitivity of PLI is demonstrated by manually segmenting fluorescence from fixed cell assays. We also demonstrate an automated implementation of PLI, using a camera as a feedback mechanism to segment fluorescence produced by emitting objects of interest in the imaging field-of-view, highlighting the advantages of measurement only in areas where valuable information exists. As a result, PLI is able to reduce acquisition time of fluorescence lifetime data by at least an order of magnitude compared to laser scanning implementations.

Quantitative Live Cell FLIM Imaging in Three Dimensions

In this chapter, the concept of fluorescence lifetime and its utility in quantitative live cell imaging will be introduced, along with methods to record and analyze FLIM data. Relevant applications in 3D tissue and live cell imaging, including multiplexed FLIM detection, will also be detailed.

Reference-independent wide field fluorescence lifetime measurements using Frequency-Domain (FD) technique based on phase and amplitude crossing point

Fluorescence lifetime imaging microscopy (FLIM) is an essential tool in many scientific fields such as biology and medicine thanks to the known advantages of the fluorescence lifetime (FLT) over the classical fluorescence intensity (FI). However, the frequency domain (FD) FLIM technique suffers from its strong dependence on the reference and its compliance to the sample. In this paper, we suggest a new way to calculate the FLT by using the crossing point (CRPO) between the modulation and phase FLTs measured over several light emitting diode (LED) DC currents values instead of either method alone. This new technique was validated by measuring homogeneous substances with known FLT, where the CRPO appears to be the optimal measuring point. Furthermore, the CRPO method was applied in heterogeneous samples. It was found that the CRPO in known mixed solutions is the weighted average of the used solutions. While measuring B16 and lymphocyte cells, the CRPO of the DAPI compound in single FLT regions was measured at 3.5 ± 0.06 ns and at 2.83 ± 0.07 ns, respectively, both of which match previous reports and multi-frequency analyses. This paper suggests the CRPO as a new method to extract the FLT in problematic cases such as high MCP gains and heterogeneous environments. In traditional FD FLIM measurements, the variation in phase angle and modulation are measured. By measuring over varying DC currents, another variation is detected in the FLT determined through the phase and modulation methods, with the CRPO indicating the true FLT.

Noise-Corrected Principal Component Analysis of fluorescence lifetime imaging data

Fluorescence Lifetime Imaging (FLIM) is an attractive microscopy method in the life sciences, yielding information on the sample otherwise unavailable through intensity-based techniques. A novel Noise-Corrected Principal Component Analysis (NC-PCA) method for time-domain FLIM data is presented here. The presence and distribution of distinct microenvironments are identified at lower photon counts than previously reported, without requiring prior knowledge of their number or of the dye's decay kinetics. A noise correction based on the Poisson statistics inherent to Time-Correlated Single Photon Counting is incorporated. The approach is validated using simulated data, and further applied to experimental FLIM data of HeLa cells stained with membrane dye di-4-ANEPPDHQ. Two distinct lipid phases were resolved in the cell membranes, and the modification of the order parameters of the plasma membrane during cholesterol depletion was also detected. Noise-corrected Principal Component Analysis of FLIM data resolves distinct microenvironments in cell membranes of live HeLa cells.

Photon counting phosphorescence lifetime imaging with TimepixCam

TimepixCam is a novel fast optical imager based on an optimized silicon pixel sensor with a thin entrance window and read out by a Timepix Application Specific Integrated Circuit. The 256 × 256 pixel sensor has a time resolution of 15 ns at a sustained frame rate of 10 Hz. We used this sensor in combination with an image intensifier for wide-field time-correlated single photon counting imaging. We have characterised the photon detection capabilities of this detector system and employed it on a wide-field epifluorescence microscope to map phosphorescence decays of various iridium complexes with lifetimes of about 1 μs in 200 μm diameter polystyrene beads.

Characterisation of new gated optical image intensifiers for fluorescence lifetime imaging

We report the characterisation of gated optical image intensifiers for fluorescence lifetime imaging, evaluating the performance of several different prototypes that culminate in a new design that provides improved spatial resolution conferred by the addition of a magnetic field to reduce the lateral spread of photoelectrons on their path between the photocathode and microchannel plate, and higher signal to noise ratio conferred by longer time gates. We also present a methodology to compare these systems and their capabilities, including the quantitative readouts of Förster resonant energy transfer.

Investigation of signal-to-noise ratio in frequency-domain multiphoton fluorescence lifetime imaging microscopy

Multiphoton microscopy (MPM) combined with fluorescence lifetime imaging microscopy (FLIM) has enabled three-dimensional quantitative molecular microscopy in vivo. The signal-to-noise ratio (SNR), and thus the imaging rate of MPM-FLIM, which is fundamentally limited by the shot noise and fluorescence saturation, has not been quantitatively studied yet. In this paper, we investigate the SNR performance of the frequency-domain (FD) MPM-FLIM with two figures of merit: the photon economy in the limit of shot noise, and the normalized SNR in the limit of saturation. The theoretical results and Monte Carlo simulations find that two-photon FD-FLIM requires 50% fewer photons to achieve the same SNR as conventional one-photon FLIM. We also analytically show that the MPM-FD-FLIM can exploit the DC and higher harmonic components generated by nonlinear optical mixing of the excitation light to improve SNR, reducing the required number of photons by an additional 50%. Finally, the effect of fluorophore saturation on the experimental SNR performance is discussed.

New high-speed centre of mass method incorporating background subtraction for accurate determination of fluorescence lifetime

We demonstrate an implementation of a centre-of-mass method (CMM) incorporating background subtraction for use in multifocal fluorescence lifetime imaging microscopy to accurately determine fluorescence lifetime in live cell imaging using the Megaframe camera. The inclusion of background subtraction solves one of the major issues associated with centre-of-mass approaches, namely the sensitivity of the algorithm to background signal. The algorithm, which is predominantly implemented in hardware, provides real-time lifetime output and allows the user to effectively condense large amounts of photon data. Instead of requiring the transfer of thousands of photon arrival times, the lifetime is simply represented by one value which allows the system to collect data up to limit of pulse pile-up without any limitations on data transfer rates. In order to evaluate the performance of this new CMM algorithm with existing techniques (i.e. rapid lifetime determination and Levenburg-Marquardt), we imaged live MCF-7 human breast carcinoma cells transiently transfected with FRET standards. We show that, it offers significant advantages in terms of lifetime accuracy and insensitivity to variability in dark count rate (DCR) between Megaframe camera pixels. Unlike other algorithms no prior knowledge of the expected lifetime is required to perform lifetime determination. The ability of this technique to provide real-time lifetime readout makes it extremely useful for a number of applications.

High-speed multifocal array scanning using refractive window tilting

Confocal microscopy has several advantages over wide-field microscopy, such as out-of-focus light suppression, 3D sectioning, and compatibility with specialized detectors. While wide-field microscopy is a faster approach, multiplexed confocal schemes can be used to make confocal microscopy more suitable for high-throughput applications, such as high-content screening (HCS) commonly used in drug discovery. An increasingly powerful modality in HCS is fluorescence lifetime imaging microscopy (FLIM), which can be used to measure protein-protein interactions through Förster resonant energy transfer (FRET). FLIM-FRET for HCS combines the requirements of high throughput, high resolution and specialized time-resolving detectors, making it difficult to implement using wide-field and spinning disk confocal approaches. We developed a novel foci array scan method that can achieve uniform multiplex confocal acquisition using stationary lenslet arrays for high resolution and high throughput FLIM. Unlike traditional mirror galvanometers, which work in Fourier space between scan lenses, this scan method uses optical flats to steer a 2-dimension foci array through refraction. After integrating this scanning scheme in a multiplexing confocal FLIM system, we demonstrate it offers clear benefits over traditional mirror galvanometer scanners in scan linearity, uniformity, cost and complexity.

FRAP, FLIM, and FRET: Detection and analysis of cellular dynamics on a molecular scale using fluorescence microscopy

The combination of fluorescent-probe technology plus modern optical microscopes allows investigators to monitor dynamic events in living cells with exquisite temporal and spatial resolution. Fluorescence recovery after photobleaching (FRAP), for example, has long been used to monitor molecular dynamics both within cells and on cellular surfaces. Although bound by the diffraction limit imposed on all optical microscopes, the combination of digital cameras and the application of fluorescence intensity information on large-pixel arrays have allowed such dynamic information to be monitored and quantified. Fluorescence lifetime imaging microscopy (FLIM), on the other hand, utilizes the information from an ensemble of fluorophores to probe changes in the local environment. Using either fluorescence-intensity or lifetime approaches, fluorescence resonance energy transfer (FRET) microscopy provides information about molecular interactions, with Ångstrom resolution. In this review, we summarize the theoretical framework underlying these methods and illustrate their utility in addressing important problems in reproductive and developmental systems.

High-speed multiparameter photophysical analyses of fluorophore libraries

There is a critical need for high-speed multiparameter photophysical measurements of large libraries of fluorescent probe variants for imaging and biosensor development. We present a microfluidic flow cytometer that rapidly assays 10(4)-10(5) member cell-based fluorophore libraries, simultaneously measuring fluorescence lifetime and photobleaching. Together, these photophysical characteristics determine imaging performance. We demonstrate the ability to resolve the diverse photophysical characteristics of different library types and the ability to identify rare populations.

A high speed multifocal multiphoton fluorescence lifetime imaging microscope for live-cell FRET imaging

We demonstrate diffraction limited multiphoton imaging in a massively parallel, fully addressable time-resolved multi-beam multiphoton microscope capable of producing fluorescence lifetime images with sub-50ps temporal resolution. This imaging platform offers a significant improvement in acquisition speed over single-beam laser scanning FLIM by a factor of 64 without compromising in either the temporal or spatial resolutions of the system. We demonstrate FLIM acquisition at 500 ms with live cells expressing green fluorescent protein. The applicability of the technique to imaging protein-protein interactions in live cells is exemplified by observation of time-dependent FRET between the epidermal growth factor receptor (EGFR) and the adapter protein Grb2 following stimulation with the receptor ligand. Furthermore, ligand-dependent association of HER2-HER3 receptor tyrosine kinases was observed on a similar timescale and involved the internalisation and accumulation or receptor heterodimers within endosomes. These data demonstrate the broad applicability of this novel FLIM technique to the spatio-temporal dynamics of protein-protein interaction.

Photon counting imaging with an electron-bombarded CCD: towards a parallel-processing photoelectronic time-to-amplitude converter

We have used an electron-bombarded CCD for optical photon counting imaging. The photon event pulse height distribution was found to be linearly dependent on the gain voltage. We propose on this basis that a gain voltage sweep during exposure in an electron-bombarded sensor would allow photon arrival time determination with sub-frame exposure time resolution. This effectively uses an electron-bombarded sensor as a parallel-processing photoelectronic time-to-amplitude converter, or a two-dimensional photon counting streak camera. Several applications that require timing of photon arrival, including Fluorescence Lifetime Imaging Microscopy, may benefit from such an approach. A simulation of a voltage sweep performed with experimental data collected with different acceleration voltages validates the principle of this approach. Moreover, photon event centroiding was performed and a hybrid 50% Gaussian/Centre of Gravity + 50% Hyperbolic cosine centroiding algorithm was found to yield the lowest fixed pattern noise. Finally, the camera was mounted on a fluorescence microscope to image F-actin filaments stained with the fluorescent dye Alexa 488 in fixed cells.

Wide-field time-correlated single-photon counting (TCSPC) lifetime microscopy with microsecond time resolution

A 1 MHz frame rate complementary metal-oxide semiconductor (CMOS) camera was used in combination with an image intensifier for wide-field time-correlated single-photon counting (TCSPC) imaging. The system combines an ultrafast frame rate with single-photon sensitivity and was employed on a fluorescence microscope to image decays of ruthenium compound Ru(dpp) with lifetimes from around 1 to 5 μs. A submicrowatt excitation power over the whole field of view is sufficient for this approach, and compatibility with live-cell imaging was demonstrated by imaging europium-containing beads with a lifetime of 570 μs in living HeLa cells. A standard two-photon excitation scanning fluorescence lifetime imaging (FLIM) system was used to independently verify the lifetime for the europium beads. This approach brings together advantageous features for time-resolved live-cell imaging such as low excitation intensity, single-photon sensitivity, ultrafast camera frame rates, and short acquisition times.

The influence of dead time related distortions on live cell fluorescence lifetime imaging (FLIM) experiments

Recent developments in the field of fluorescence lifetime imaging microscopy (FLIM) techniques allow the use of high repetition rate light sources in live cell experiments. For light sources with a repetition rate of 20-100 MHz, the time-correlated single photon counting (TCSPC) FLIM systems suffer serious dead time related distortions, known as "inter-pulse pile-up". The objective of this paper is to present a new method to quantify the level of signal distortion in TCSPC FLIM experiments, in order to determine the most efficient laser repetition rate for different FLT ranges. Optimization of the F -value, which is the relation between the relative standard deviation (RSD) in the measured FLT to the RSD in the measured fluorescence intensity (FI), allows quantification of the level of FI signal distortion, as well as determination of the correct FLT of the measurement. It is shown that by using a very high repetition rate (80 MHz) for samples characterized by high real FLT's (4-5 ns), virtual short FLT components are added to the FLT histogram while a F -value that is higher than 1 is obtained. For samples characterized with short real FLT's, virtual long FLT components are added to the FLT histogram with the lower repetition rate (20-50 MHz), while by using a higher repetition rate (80 MHz) the "inter-pulse pile-up" is eliminated as the F -value is close to 1.

Time-resolved fluorescence anisotropy imaging

Fluorescence can be characterized by its intensity, position, wavelength, lifetime, and polarization. The more of these features are acquired in a single measurement, the more can be learned about the sample, i.e., the microenvironment of the fluorescence probe. Polarization-resolved fluorescence lifetime imaging-time-resolved fluorescence anisotropy imaging, TR-FAIM-allows mapping of viscosity or binding or of homo-FRET which can indicate dimerization or generally oligomerization.

Maximizing the biochemical resolving power of fluorescence microscopy

Most recent advances in fluorescence microscopy have focused on achieving spatial resolutions below the diffraction limit. However, the inherent capability of fluorescence microscopy to non-invasively resolve different biochemical or physical environments in biological samples has not yet been formally described, because an adequate and general theoretical framework is lacking. Here, we develop a mathematical characterization of the biochemical resolution in fluorescence detection with Fisher information analysis. To improve the precision and the resolution of quantitative imaging methods, we demonstrate strategies for the optimization of fluorescence lifetime, fluorescence anisotropy and hyperspectral detection, as well as different multi-dimensional techniques. We describe optimized imaging protocols, provide optimization algorithms and describe precision and resolving power in biochemical imaging thanks to the analysis of the general properties of Fisher information in fluorescence detection. These strategies enable the optimal use of the information content available within the limited photon-budget typically available in fluorescence microscopy. This theoretical foundation leads to a generalized strategy for the optimization of multi-dimensional optical detection, and demonstrates how the parallel detection of all properties of fluorescence can maximize the biochemical resolving power of fluorescence microscopy, an approach we term Hyper Dimensional Imaging Microscopy (HDIM). Our work provides a theoretical framework for the description of the biochemical resolution in fluorescence microscopy, irrespective of spatial resolution, and for the development of a new class of microscopes that exploit multi-parametric detection systems.

Effect of noise on modulation amplitude and phase in frequency-domain diffusive imaging

We theoretically investigate the effect of noise on frequency-domain heterodyne and/or homodyne measurements of intensity-modulated beams propagating through diffusive media, such as a photon density wave. We assumed that the attenuated amplitude and delayed phase are estimated by taking the Fourier transform of the noisy, modulated output data. We show that the estimated amplitude and phase are biased when the number of output photons is small. We also show that the use of image intensifiers for photon amplification in heterodyne or homodyne measurements increases the amount of biases. Especially, it turns out that the biased estimation is independent of AC-dependent noise in sinusoidal heterodyne or homodyne outputs. Finally, the developed theory indicates that the previously known variance model of modulation amplitude and phase is not valid in low light situations. Monte-Carlo simulations with varied numbers of input photons verify our theoretical trends of the bias.

Noise characteristics of heterodyne/homodyne frequency-domain measurements

We theoretically develop and experimentally validate the noise characteristics of heterodyne and/or homodyne measurements that are widely used in frequency-domain diffusive imaging. The mean and covariance of the modulated heterodyne output are derived by adapting the random amplification of a temporal point process. A multinomial selection rule is applied to the result of the temporal noise analysis to additionally model the spatial distribution of intensified photons measured by a charge-coupled device (CCD), which shows that the photon detection efficiency of CCD pixels plays an important role in the noise property of detected photons. The approach of using a multinomial probability law is validated from experimental results. Also, experimentally measured characteristics of means and variances of homodyne outputs are in agreement with the developed theory. The developed noise model can be applied to all photon amplification processes.

Precision and accuracy of the analog mean-delay method for high-speed fluorescence lifetime measurement

The analog mean-delay (AMD) method is a new alternative method to measure the lifetime of a fluorescence molecule. Because of its powerful advantages of accurate lifetime determination, good photon economy, and a high photon detection rate, the AMD method is considered to be very suitable for high-speed confocal fluorescence lifetime imaging microscopy (FLIM). For the practical usage of the AMD method in FLIM (AMD-FLIM), detailed study on various experimental conditions and parameters that affect the precision and the accuracy of the AMD method is required. In this paper, we present the relation between the precision and accuracy of the lifetime versus iteration number in the AMD method, the best cutoff frequency of a low-pass filter used in the AMD-FLIM system for a given fluorophore, and the optimum position and width of the integration window by using Monte Carlo simulations and a series of AMD-FLIM experiments.

Photon budget analysis for fluorescence lifetime imaging microscopy

We have constructed a mathematical model to analyze the photon efficiency of frequency-domain fluorescence lifetime imaging microscopy (FLIM). The power of the light source needed for illumination in a FLIM system and the signal-to-noise ratio of the detector have led us to a photon "budget." These measures are relevant to many fluorescence microscope users and the results are not restricted to FLIM but applicable to widefield fluorescence microscopy in general. Limitations in photon numbers, however, are more of an issue with FLIM compared to other less quantitative types of imaging. By modeling a typical experimental configuration, examples are given for fluorophores whose absorption peaks span the visible spectrum from Fura-2 to Cy5. We have performed experiments to validate the assumptions and parameters used in our mathematical model. The influence of fluorophore concentration on the intensity of the fluorescence emission light and the Poisson distribution assumption of the detected fluorescence emission light have been validated. The experimental results agree well with the mathematical model. This photon budget is important in order to characterize the constraints involved in current fluorescent microscope systems that are used for lifetime as well as intensity measurements and to design and fabricate new systems.

High-speed confocal fluorescence lifetime imaging microscopy (FLIM) with the analog mean delay (AMD) method

We demonstrate a high-speed confocal fluorescence lifetime imaging microscopy (FLIM) whose accuracy and photon economy are as good as that of a time-correlated single photon counting (TCSPC). It is based on a new lifetime determination scheme, the analog mean delay (AMD) method. Due to the technical advantages of multiple fluorescence photon detection capability, accurate lifetime determination scheme and high photon detection efficiency, the AMD method can be the most effective method for high-speed confocal FLIM. The feasibility of real-time confocal FLIM with the AMD method has been demonstrated by observing the dynamic reaction of calcium channels in a RBL-2H3 cell with respect to 4αPDD stimulus. We have achieved the photon detection rate of 125 times faster than a conventional TCSPC based system in this experiment.

Fluorescence lifetime biosensing with DNA microarrays and a CMOS-SPAD imager

Fluorescence lifetime of dye molecules is a sensitive reporter on local microenvironment which is generally independent of fluorophores concentration and can be used as a means of discrimination between molecules with spectrally overlapping emission. It is therefore a potentially powerful multiplexed detection modality in biosensing but requires extremely low light level operation typical of biological analyte concentrations, long data acquisition periods and on-chip processing capability to realize these advantages. We report here fluorescence lifetime data obtained using a CMOS-SPAD imager in conjunction with DNA microarrays and TIRF excitation geometry. This enables acquisition of single photon arrival time histograms for a 320 pixel FLIM map within less than 26 seconds exposure time. From this, we resolve distinct lifetime signatures corresponding to dye-labelled HCV and quantum-dot-labelled HCMV nucleic acid targets at concentrations as low as 10 nM.

Advances in cellular, subcellular, and nanoscale imaging in vitro and in vivo

This review focuses on technical advances in fluorescence microscopy techniques including laser scanning techniques, fluorescence-resonance energy transfer (FRET) microscopy, fluorescence lifetime imaging (FLIM), stimulated emission depletion (STED)-based super-resolution microscopy, scanning confocal endomicroscopes, thin-sheet laser imaging microscopy (TSLIM), and tomographic techniques such as early photon tomography (EPT) as well as on clinical laser-based endoscopic and microscopic techniques. We will also discuss the new developments in the field of fluorescent dyes and fluorescent genetic reporters that enable new possibilities in high-resolution and molecular imaging both in in vitro and in vivo. Small animal and tissue imaging benefit from the development of new fluorescent proteins, dyes, and sensing constructs that operate in the far red and near-infrared spectrum.

Enhancing precision in time-domain fluorescence lifetime imaging

In biological applications of fluorescence lifetime imaging, low signals from samples can be a challenge, causing poor lifetime precision. We demonstrate how optimal signal gating (a method applied to the temporal dimension of a lifetime image) and novel total variation denoising models (a method applied to the spatial dimension of a lifetime image) can be used in time-domain fluorescence lifetime imaging microscopy (FLIM) to improve lifetime precision. In time-gated FLIM, notable fourfold precision improvements were observed in a low-light example. This approach can be employed to improve FLIM data while minimizing sample light exposure and increasing imaging speed.

Improved sensitivity for two-photon frequency-domain lifetime measurement

We demonstrate a method to improve the measurement sensitivity of two-photon frequency-domain lifetime measurements in poor signal to background conditions. This technique uses sinusoidal modulation of the two-photon excitation source and detection of the second harmonic of the modulation frequency that appears in the emission. Additionally, we present the mathematical model which describes how the observed phase shift and amplitude demodulation factor of two-photon phosphorescence emission are related to the phosphorescence lifetime and modulation frequency. We demonstrate the validity of the model by showing the existence of new frequency terms in the phosphorescence emission generated from the quadratic nature of two-photon absorption and by showing that the phase shift and demodulation match theory for all frequency components.

Statistical analysis and optimization of frequency-domain fluorescence lifetime imaging microscopy using homodyne lock-in detection

Fluorescence lifetime imaging microscopy is used widely in biological research, but the accuracy and precision of lifetime measurements are limited. Photon noise is an inherent error source that cannot be eliminated. In this paper, we present a general approach to compute the probability density of the estimated lifetime for frequency-domain fluorescence lifetime imaging microscopy using homodyne lock-in detection. The analysis for commonly used excitation methods, including sinusoidal modulation, square-wave modulation, and a periodically pulsed light source, are given and compared to the results of Monte Carlo simulations. The optimum parameters of the excitation waveforms to minimize the variance of the estimated lifetimes are also derived and compared to previously published results.

Wide-field photon counting fluorescence lifetime imaging microscopy: application to photosynthesizing systems

Fluorescence lifetime imaging microscopy (FLIM) is a technique that visualizes the excited state kinetics of fluorescence molecules with the spatial resolution of a fluorescence microscope. We present a scanningless implementation of FLIM based on a time- and spacecorrelated single photon counting (TSCSPC) method employing a position-sensitive quadrant anode detector and wide-field illumination. The standard time-correlated photon counting approach leads to picosecond temporal resolution, making it possible to resolve complex fluorescence decays. This allows parallel acquisition of time-resolved images of biological samples under minimally invasive low-excitation conditions (<10 mW/cm(2)). In this way unwanted photochemical reactions induced by high excitation intensities and distorting the decay kinetics are avoided. Comparably low excitation intensities are practically impossible to achieve with a conventional laser scanning microscope, where focusing of the excitation beam into a tight spot is required. Therefore, wide-field FLIM permits to study Photosystem II (PS II) in a way so far not possible with a laser scanning microscope. The potential of the wide-field TSCSPC method is demonstrated by presenting FLIM measurements of the fluorescence dynamics of photosynthetic systems in living cells of the chlorophyll d-containing cyanobacterium Acaryochloris marina.

mhFLIM: resolution of heterogeneous fluorescence decays in widefield lifetime microscopy

Frequency-domain fluorescence lifetime imaging microscopy (FD-FLIM) is a fast and accurate way of measuring fluorescence lifetimes in widefield microscopy. However, the resolution of multiple exponential fluorescence decays has remained beyond the reach of most practical FD-FLIM systems. In this paper we describe the implementation of FD-FLIM using a 40 MHz pulse train derived from a supercontinuum source for excitation. The technique, which we term multi-harmonic FLIM (mhFLIM), makes it possible to accurately resolve biexponential decays of fluorophores without any a priori information. The system's performance is demonstrated using a mixture of spectrally similar dyes of known composition and also on a multiply-labeled biological sample. The results are compared to those obtained from time correlated single photon counting (TCSPC) microscopy and a good level of agreement is achieved. We also demonstrate the first practical application of an algorithm derived by G. Weber [1] for analysing mhFLIM data. Because it does not require nonlinear minimisation, it offers potential for realtime analysis during acquisition.

Quantitative analysis of fluorescence lifetime imaging made easy

Fluorescence lifetime imaging is a valuable and versatile tool for the investigation of the molecular environment of fluorophores in living cells. It is ideally suited-and is therefore increasingly used-for the quantification of the occurrence of Förster Resonance Energy Transfer, a powerful microscopy method for the detection of subnanometer conformational changes, protein-protein interactions, and protein biochemical status. However, careful quantitative analysis is required for the correct and meaningful interpretation of fluorescence lifetime data. This can be a daunting task to the nonexpert user, and is the source for many avoidable errors and unsound interpretations. Digman and colleagues (Digman et al., 2007, Biophys. J. 94, L14-6) present an analysis technique that avoids data fitting in favor of a simple graphical polar data representation. In this "phasor" space, the physics of lifetime imaging becomes more intuitive and accessible also to the inexperienced user. The cumulated information from image pixels, even over different cells, describes patterns and trajectories that can be visually interpreted in physically meaningful ways. Its usefulness is demonstrated in the study of the dimerization of the uPAR receptor (Caiolfa et al., 2007, J. Cell Biol. 179, 1067-1082).