Fast and simple spectral FLIM for biochemical and medical imaging

Overcoming photon and spatiotemporal sparsity in fluorescence lifetime imaging with SparseFLIM

Fluorescence lifetime imaging microscopy (FLIM) provides quantitative readouts of biochemical microenvironments, holding great promise for biomedical imaging. However, conventional FLIM relies on slow photon counting routines to accumulate sufficient photon statistics, restricting acquisition speeds. Here we demonstrate SparseFLIM, an intelligent paradigm for achieving high-fidelity FLIM reconstruction from sparse photon measurements. We develop a coupled bidirectional propagation network that enriches photon counts and recovers hidden spatial-temporal information. Quantitative analysis shows over tenfold photon enrichment, dramatically improving signal-to-noise ratio, lifetime accuracy, and correlation compared to the original sparse data. SparseFLIM enables reconstructing spatially and temporally undersampled FLIM at full resolution and channel count. The model exhibits strong generalization across experimental modalities including multispectral FLIM and in vivo endoscopic FLIM. This work establishes deep learning as a promising approach to enhance fluorescence lifetime imaging and transcend limitations imposed by the inherent codependence between measurement duration and information content.

Simultaneous assessment of NAD(P)H and flavins with multispectral fluorescence lifetime imaging microscopy at a single excitation wavelength of 750 nm

Significance

Autofluorescence characteristics of the reduced nicotinamide adenine dinucleotide and oxidized flavin cofactors are important for the evaluation of the metabolic status of the cells. The approaches that involve a detailed analysis of both spectral and time characteristics of the autofluorescence signals may provide additional insights into the biochemical processes in the cells and biological tissues and facilitate the transition of spectral fluorescence lifetime imaging into clinical applications.

Aim

We present the experiments on multispectral fluorescence lifetime imaging with a detailed analysis of the fluorescence decays and spectral profiles of the reduced nicotinamide adenine dinucleotide and oxidized flavin under a single excitation wavelength aimed at understanding whether the use of multispectral detection is helpful for metabolic imaging of cancer cells.

Approach

We use two-photon spectral fluorescence lifetime imaging microscopy. Starting from model solutions, we switched to cell cultures treated by metabolic inhibitors and then studied the metabolism of cells within tumor spheroids.

Results

The use of a multispectral detector in combination with an excitation at a single wavelength of 750 nm allows the identification of fluorescence signals from three components: free and bound NAD(P)H, and flavins based on the global fitting procedure. Multispectral data make it possible to assess not only the lifetime but also the spectral shifts of emission of flavins caused by chemical perturbations. Altogether, the informative parameters of the developed approach are the ratio of free and bound NAD(P)H amplitudes, the decay time of bound NAD(P)H, the amplitude of flavin fluorescence signal, the fluorescence decay time of flavins, and the spectral shift of the emission signal of flavins. Hence, with multispectral fluorescence lifetime imaging, we get five independent parameters, of which three are related to flavins.

Conclusions

The approach to probe the metabolic state of cells in culture and spheroids using excitation at a single wavelength of 750 nm and a fluorescence time-resolved spectral detection with the consequent global analysis of the data not only simplifies image acquisition protocol but also allows to disentangle the impacts of free and bound NAD(P)H, and flavin components evaluate changes in their fluorescence parameters (emission spectra and fluorescence lifetime) upon treating cells with metabolic inhibitors and sense metabolic heterogeneity within 3D tumor spheroids.

Interferometric excitation fluorescence lifetime imaging microscopy

Fluorescence lifetime imaging microscopy (FLIM) is a well-established technique with numerous imaging applications. Yet, one of the limitations of FLIM is that it only provides information about the emitting state. Here, we present an extension of FLIM by interferometric measurement of fluorescence excitation spectra. Interferometric Excitation Fluorescence Lifetime Imaging Microscopy (ixFLIM) reports on the correlation of the excitation spectra and emission lifetime, providing the correlation between the ground-state absorption and excited-state emission. As such, it extends the applicability of FLIM and removes some of its limitations. We introduce ixFLIM on progressively more complex systems, directly compare it to standard FLIM, and apply it to quantitative resonance energy transfer imaging from a single measurement.

High throughput compressive fluorescence lifetime imaging with a silicon photomultiplier detector

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique for studying biological processes. There exists a growing interest in developing strategies to enhance throughput and reduce acquisition time of FLIM systems, which commonly employ laser scanning excitation and time-correlated single-photon counting (TCSPC) detection. In this work, we propose a wide-field FLIM microscope based on compressive sensing and high photon rate detection (beyond pile-up limit) based on a high-efficiency silicon photomultiplier detector as a single-pixel camera. We experimentally validate the capabilities of this design achieving 20 frames per second FLIM images on free-moving green algae sample.

Quantitative multiphoton imaging of cell metabolism, stromal fibers, and keratinization enables label-free discrimination of esophageal squamous cell carcinoma

Esophageal squamous cell carcinoma (ESCC) features atypical clinical manifestations and a low 5-year survival rate (< 5% in many developing countries where most of the disease occurs). Precise ESCC detection and grading toward timely and effective intervention are therefore crucial. In this study, we propose a multidimensional, slicing-free, and label-free histopathological evaluation method based on multispectral multiphoton fluorescence lifetime imaging microscopy (MM-FLIM) for precise ESCC identification. To assess the feasibility of this method, comparative imaging on fresh human biopsy specimens of different ESCC grades is performed. By constructing fluorescence spectrum- and lifetime-coded images, ESCC-induced morphological variations are unveiled. Further quantification of cell metabolism and stromal fibers reveals potential indicators for ESCC detection and grading. The specific identification of keratin pearls provides additional support for the early detection of ESCC. These findings demonstrate the viability of using MM-FLIM and the series of derived indicators for histopathological evaluation of ESCC. As there is an increasing interest in developing multiphoton endoscopes and multiphoton FLIM systems for clinical use, the proposed method would probably allow noninvasive, label-free, and multidimensional histological detection and grading of ESCC in the future.

A method for the fast and photon-efficient analysis of time-domain fluorescence lifetime image data over large dynamic ranges

Fluorescence lifetime imaging (FLIM) allows the quantification of sub-cellular processes in situ, in living cells. A number of approaches have been developed to extract the lifetime from time-domain FLIM data, but they are often limited in terms of speed, photon efficiency, precision or the dynamic range of lifetimes they can measure. Here, we focus on one of the best performing methods in the field, the centre-of-mass method (CMM), that conveys advantages in terms of speed and photon efficiency over others. In this paper, however, we identify a loss of photon efficiency of CMM for short lifetimes when background noise is present. We subsequently present a new development and generalization of CMM that provides for the rapid and accurate extraction of fluorescence lifetime over a large lifetime dynamic range. We provide software tools to simulate, validate and analyse FLIM data sets and compare the performance of our approach against the standard CMM and the commonly employed least-square minimization (LSM) methods. Our method features a better photon efficiency than standard CMM and LSM and is robust in the presence of background noise. The algorithm is applicable to any time-domain FLIM data set.

Full spectrum fluorescence lifetime imaging with 0.5 nm spectral and 50 ps temporal resolution

The use of optical techniques to interrogate wide ranging samples from semiconductors to biological tissue for rapid analysis and diagnostics has gained wide adoption over the past decades. The desire to collect ever more spatially, spectrally and temporally detailed optical signatures for sample characterization has specifically driven a sharp rise in new optical microscopy technologies. Here we present a high-speed optical scanning microscope capable of capturing time resolved images across 512 spectral and 32 time channels in a single acquisition with the potential for ~0.2 frames per second (256 × 256 image pixels). Each pixel in the resulting images contains a detailed data cube for the study of diverse time resolved light driven phenomena. This is enabled by integration of system control electronics and on-chip processing which overcomes the challenges presented by high data volume and low imaging speed, often bottlenecks in previous systems.

High data volumes from multidimensional imaging techniques can lead to slow collection and processing times. Here, the authors implement multispectral fluorescence lifetime imaging microscopy (FLIM) that uses time-correlated photon counting technology to reach simultaneously high imaging rates combined with high spectral and temporal resolution.

Resonant Electro-Optic Imaging for Microscopy at Nanosecond Resolution

We demonstrate an electro-optic wide-field method to enable fluorescence lifetime microscopy (FLIM) with high throughput and single-molecule sensitivity. Resonantly driven Pockels cells are used to efficiently gate images at 39 MHz, allowing fluorescence lifetime to be captured on standard camera sensors. Lifetime imaging of single molecules is enabled in wide field with exposure times of less than 100 ms. This capability allows combination of wide-field FLIM with single-molecule super-resolution localization microscopy. Fast single-molecule dynamics such as FRET and molecular binding events are captured from wide-field images without prior spatial knowledge. A lifetime sensitivity of 1.9 times the photon shot-noise limit is achieved, and high throughput is shown by acquiring wide-field FLIM images with millisecond exposure and >10⁸ photons per frame. Resonant electro-optic FLIM allows lifetime contrast in any wide-field microscopy method.

Biochemical resolving power of fluorescence lifetime imaging: untangling the roles of the instrument response function and photon-statistics

A deeper understanding of spatial resolution has led to innovations in microscopy and the disruption of biomedical research, as with super-resolution microscopy. To foster similar advances in time-resolved and spectral imaging, we have previously introduced the concept of 'biochemical resolving power' in fluorescence microscopy. Here, we apply those concepts to investigate how the instrument response function (IRF), sampling conditions, and photon-statistics limit the biochemical resolution of fluorescence lifetime microscopy. Using Fisher information analysis and Monte Carlo simulations, we reveal the complex dependencies between photon-statistics and the IRF, permitting us to quantify resolution limits that have been poorly understood (e.g., the minimum resolvable decay time for a given width of the IRF and photon-statistics) or previously underappreciated (e.g., optimization of the IRF for biochemical detection). With this work, we unravel common misunderstandings on the role of the IRF and provide theoretical insights with significant practical implications on the design and use of time-resolved instrumentation.

Time-resolved spectral-domain optical coherence tomography with CMOS SPAD sensors

We present a first spectral-domain optical coherence tomography (SD-OCT) system deploying a complementary metal-oxide-semiconductor (CMOS) single-photon avalanche diode (SPAD) based, time-resolved line sensor. The sensor with 1024 pixels achieves a sensitivity of 87 dB at an A-scan rate of 1 kHz using a supercontinuum laser source with a repetition rate of 20 MHz, 38 nm bandwidth, and 2 mW power at 850 nm centre wavelength. In the time-resolved mode of the sensor, the system combines low-coherence interferometry (LCI) and massively parallel time-resolved single-photon counting to control the detection of interference spectra on the single-photon level based on the time-of-arrival of photons. For proof of concept demonstration of the combined detection scheme we show the acquisition of time-resolved interference spectra and the reconstruction of OCT images from selected time bins. Then, we exemplify the temporal discrimination feature with 50 ps time resolution and 249 ps timing uncertainty by removing unwanted reflections from along the optical path at a 30 mm distance from the sample. The current limitations of the proposed technique in terms of sensor parameters are analysed and potential improvements are identified for advanced photonic applications.

Real-time multispectral fluorescence lifetime imaging using Single Photon Avalanche Diode arrays

Autofluorescence spectroscopy has emerged in recent years as a powerful tool to report label-free contrast between normal and diseased tissues, both in vivo and ex vivo. We report the development of an instrument employing Single Photon Avalanche Diode (SPAD) arrays to realize real-time multispectral autofluorescence lifetime imaging at a macroscopic scale using handheld single-point fibre optic probes, under bright background conditions. At the detection end, the fluorescence signal is passed through a transmission grating and both spectral and temporal information are encoded in the SPAD array. This configuration allows interrogation in the spectral range of interest in real time. Spatial information is provided by an external camera together with a guiding beam that provides a visual reference that is tracked in real-time. Through fast image processing and data analysis, fluorescence lifetime maps are augmented on white light images to provide feedback of the measurements in real-time. We validate and demonstrate the practicality of this technique in the reference fluorophores and in articular cartilage samples mimicking the degradation that occurs in osteoarthritis. Our results demonstrate that SPADs together with fibre probes can offer means to report autofluorescence spectral and lifetime contrast in real-time and thus are suitable candidates for in situ tissue diagnostics.

Fluorescence lifetime imaging microscopy: fundamentals and advances in instrumentation, analysis, and applications

SIGNIFICANCE

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique to distinguish the unique molecular environment of fluorophores. FLIM measures the time a fluorophore remains in an excited state before emitting a photon, and detects molecular variations of fluorophores that are not apparent with spectral techniques alone. FLIM is sensitive to multiple biomedical processes including disease progression and drug efficacy.

AIM

We provide an overview of FLIM principles, instrumentation, and analysis while highlighting the latest developments and biological applications.

APPROACH

This review covers FLIM principles and theory, including advantages over intensity-based fluorescence measurements. Fundamentals of FLIM instrumentation in time- and frequency-domains are summarized, along with recent developments. Image segmentation and analysis strategies that quantify spatial and molecular features of cellular heterogeneity are reviewed. Finally, representative applications are provided including high-resolution FLIM of cell- and organelle-level molecular changes, use of exogenous and endogenous fluorophores, and imaging protein-protein interactions with Förster resonance energy transfer (FRET). Advantages and limitations of FLIM are also discussed.

CONCLUSIONS

FLIM is advantageous for probing molecular environments of fluorophores to inform on fluorophore behavior that cannot be elucidated with intensity measurements alone. Development of FLIM technologies, analysis, and applications will further advance biological research and clinical assessments.

Multi-target immunofluorescence by separation of antibody cross-labelling via spectral-FLIM-FRET

In biomedical research, indirect immunofluorescence labelling by use of primary and secondary antibodies is central for revealing the spatial distribution of multiple cellular antigens. However, labelling is regularly restricted to few antigens since species variation of primary and corresponding secondary antibodies is limited bearing the risk of unspecific cross-labelling. Here, we introduce a novel microscopic procedure for leveraging undesirable cross-labelling effects among secondary antibodies thereby increasing the number of fluorophore channels. Under cross-labelling conditions, commonly used fluorophores change chemical-physical properties by ‘Förster resonance energy transfer’ leading to defined changes in spectral emission and lifetime decay. By use of spectral fluorescence lifetime imaging and pattern-matching, we demonstrate precise separation of cross-labelled cellular antigens where conventional imaging completely fails. Consequently, this undesired effect serves for an innovative imaging procedure to separate critical antigens where antibody species variation is limited and allows for multi-target labelling by attribution of new fluorophore cross-labelling channels.

High-throughput, multi-parametric, and correlative fluorescence lifetime imaging

In this review, we discuss methods and advancements in fluorescence lifetime imaging microscopy that permit measurements to be performed at faster speed and higher resolution than previously possible. We review fast single-photon timing technologies and the use of parallelized detection schemes to enable high-throughput and high content imaging applications. We appraise different technological implementations of fluorescence lifetime imaging, primarily in the time-domain. We also review combinations of fluorescence lifetime with other imaging modalities to capture multi-dimensional and correlative information from a single sample. Throughout the review, we focus on applications in biomedical research. We conclude with a critical outlook on current challenges and future opportunities in this rapidly developing field.

How many photons are needed for FRET imaging?

Förster resonance energy transfer (FRET) imaging is an essential analytical method in biomedical research. The limited photon-budget experimentally available, however, imposes compromises between spatiotemporal and biochemical resolutions, photodamage and phototoxicity. The study of photon-statistics in biochemical imaging is thus important in guiding the efficient design of instrumentation and assays. Here, we show a comparative analysis of photon-statistics in FRET imaging demonstrating how the precision of FRET imaging varies vastly with imaging parameters. Therefore, we provide analytical and numerical tools for assay optimization. Fluorescence lifetime imaging microscopy (FLIM) is a very robust technique with excellent photon-efficiencies. However, we show that also intensity-based FRET imaging can reach high precision by utilizing information from both donor and acceptor fluorophores.

Single-photon avalanche diode imagers in biophotonics: review and outlook

Single-photon avalanche diode (SPAD) arrays are solid-state detectors that offer imaging capabilities at the level of individual photons, with unparalleled photon counting and time-resolved performance. This fascinating technology has progressed at a very fast pace in the past 15 years, since its inception in standard CMOS technology in 2003. A host of architectures have been investigated, ranging from simpler implementations, based solely on off-chip data processing, to progressively "smarter" sensors including on-chip, or even pixel level, time-stamping and processing capabilities. As the technology has matured, a range of biophotonics applications have been explored, including (endoscopic) FLIM, (multibeam multiphoton) FLIM-FRET, SPIM-FCS, super-resolution microscopy, time-resolved Raman spectroscopy, NIROT and PET. We will review some representative sensors and their corresponding applications, including the most relevant challenges faced by chip designers and end-users. Finally, we will provide an outlook on the future of this fascinating technology.

Fast single-cell biochemistry: theory, open source microscopy and applications

Fluorescence lifetime sensing enables researchers to probe the physicochemical environment of a fluorophore providing a window through which we can observe the complex molecular make-up of the cell. Fluorescence lifetime imaging microscopy (FLIM) quantifies and maps cell biochemistry, a complex ensemble of dynamic processes. Unfortunately, typical high-resolution FLIM systems exhibit rather limited acquisition speeds, often insufficient to capture the time evolution of biochemical processes in living cells. Here, we describe the theoretical background that justifies the developments of high-speed single photon counting systems. We show that systems with low dead-times not only result in faster acquisition throughputs but also improved dynamic range and spatial resolution. We also share the implementation of hardware and software as an open platform, show applications of fast FLIM biochemical imaging on living cells and discuss strategies to balance precision and accuracy in FLIM. The recent innovations and commercialisation of fast time-domain FLIM systems are likely to popularise FLIM within the biomedical community, to impact biomedical research positively and to foster the adoption of other FLIM techniques as well. While supporting and indeed pursuing these developments, with this work we also aim to warn the community about the possible shortcomings of fast single photon counting techniques and to highlight strategies to acquire data of high quality.

Multispectral Depth-Resolved Fluorescence Lifetime Spectroscopy Using SPAD Array Detectors and Fiber Probes

Single Photon Avalanche Diode (SPAD) arrays are increasingly exploited and have demonstrated potential in biochemical and biomedical research, both for imaging and single-point spectroscopy applications. In this study, we explore the application of SPADs together with fiber-optic-based delivery and collection geometry to realize fast and simultaneous single-point time-, spectral-, and depth-resolved fluorescence measurements at 375 nm excitation light. Spectral information is encoded across the columns of the array through grating-based dispersion, while depth information is encoded across the rows thanks to a linear arrangement of probe collecting fibers. The initial characterization and validation were realized against layered fluorescent agarose-based phantoms. To verify the practicality and feasibility of this approach in biological specimens, we measured the fluorescence signature of formalin-fixed rabbit aorta samples derived from an animal model of atherosclerosis. The initial results demonstrate that this detection configuration can report fluorescence spectral and lifetime contrast originating at different depths within the specimens. We believe that our optical scheme, based on SPAD array detectors and fiber-optic probes, constitute a powerful and versatile approach for the deployment of multidimensional fluorescence spectroscopy in clinical applications where information from deeper tissue layers is important for diagnosis.

Enhancing Biochemical Resolution by Hyperdimensional Imaging Microscopy

Two decades of fast-paced innovation have improved the spatial resolution of fluorescence microscopy to enable molecular resolution with low invasiveness and high specificity. Fluorescence microscopy also enables scientists and clinicians to map and quantitate the physicochemical properties (e.g., analyte concentration, enzymatic activities, and protein-protein interactions) of biological samples. But the biochemical resolving power of fluorescence microscopy is not as well optimized as its spatial resolution. Current techniques typically observe only the individual properties of fluorescence, thus limiting the opportunities for sensing and multiplexing. Here, we demonstrate a new, to our knowledge, imaging paradigm, hyperdimensional imaging microscopy, which quantifies simultaneously and efficiently all the properties of fluorescence emission (excited-state lifetime, polarization, and spectra) in biological samples, transcending existing limitations. Such simultaneous detection of fluorescence features maximizes the biochemical resolving power of fluorescence microscopy, thereby providing the means to enhance sensing capabilities and enable heavily multiplexed assays. Just as multidimensional separation in mass-spectroscopy and multidimensional spectra in NMR have empowered proteomics and structural biology, we envisage that hyperdimensional imaging microscopy spectra of unprecedented dimensionality will catalyze advances in systems biology and medical diagnostics.

Quantitative Live Cell FLIM Imaging in Three Dimensions

In this chapter, the concept of fluorescence lifetime and its utility in quantitative live cell imaging will be introduced, along with methods to record and analyze FLIM data. Relevant applications in 3D tissue and live cell imaging, including multiplexed FLIM detection, will also be detailed.

A metabolic interpretation for the response of cellular autofluorescence to chemical perturbations assessed using spectral phasor analysis

Analytical approaches for sensing cellular NADH conformation from autofluorescence signals have significance because NADH is a metabolic indicator and endogenous biomarker. Recently, spectral detection of multiple cellular NADH forms during chemically-induced metabolic response was reported, however because NADH is solvatochromic and the spectral change is small, the possibility of a non-metabolic interpretation needs to be considered. Here we investigate the response of UV-excited autofluorescence to a range of well-known chemicals affecting fermentation, respiration, and oxidative-stress pathways in Saccharomyces cerevisiae. The two-component nature of the spectral response is assessed using phasor analysis. By considering a series of physically similar and dissimilar chemicals acting on multiple pathways, we show how the two-component nature of a spectral response is of metabolic origin, indicative of whether a single or several pathways have been affected.

The two-component nature of the autofluorescence response is indicative of whether a single or several pathways are affected.

Time-resolved spectroscopy at 19,000 lines per second using a CMOS SPAD line array enables advanced biophotonics applications

A SPAD-based line sensor fabricated in 130 nm CMOS technology capable of acquiring time-resolved fluorescence spectra (TRFS) in 8.3 milliseconds is presented. To the best of our knowledge, this is the fastest time correlated single photon counting (TCSPC) TRFS acquisition reported to date. The line sensor is an upgrade to our prior work and incorporates: i) parallelized interface from sensor to surrounding circuitry enabling high line rate to the PC (19,000 lines/s) and ii) novel time-gating architecture where detected photons in the OFF region are rejected digitally after the output stage of the SPAD. The time-gating architecture was chosen to avoid electrical transients on the SPAD high voltage supplies when gating is achieved by excess bias modulation. The time-gate has an adjustable location and time window width allowing the user to focus on time-events of interest. On-chip integrated center-of-mass (CMM) calculations provide efficient acquisition of photon arrivals and direct lifetime estimation of fluorescence decays. Furthermore, any of the SPC, TCSPC and on-chip CMM modes can be used in conjunction with the time-gating. The higher readout rate and versatile architecture greatly empower the user and will allow widespread applications across many techniques and disciplines. Here we focused on 3 examples of TRFS and time-gated Raman spectroscopy: i) kinetics of chlorophyll A fluorescence from an intact leaf; ii) kinetics of a thrombin biosensor FRET probe from quenched to fluorescence states; iii) ex vivo mouse lung tissue autofluorescence TRFS; iv) time-gated Raman spectroscopy of toluene at 3056 cm^-1 peak. To the best of our knowledge, we detect spectrally for the first time the fast rise in fluorescence lifetime of chlorophyll A in a measurement over single fluorescent transient.

Quantitative Affinity Determination by Fluorescence Anisotropy Measurements of Individual Nanoliter Droplets

Fluorescence anisotropy measurements of reagents compartmentalized into individual nanoliter droplets are shown to yield high-resolution binding curves from which precise dissociation constants (K_d) for protein-peptide interactions can be inferred. With the current platform, four titrations can be obtained per minute (based on ∼100 data points each), with stoichiometries spanning more than 2 orders of magnitude and requiring only tens of microliters of reagents. In addition to affinity measurements with purified components, K_d values for unpurified proteins in crude cell lysates can be obtained without prior knowledge of the concentration of the expressed protein, so that protein purification can be avoided. Finally, we show how a competition assay can be set up to perform focused library screens, so that compound labeling is not required anymore. These data demonstrate the utility of droplet compartments for the quantitative characterization of biomolecular interactions and establish fluorescence anisotropy imaging as a quantitative technique in a miniaturized droplet format, which is shown to be as reliable as its macroscopic test tube equivalent.