Complex wavelet filter improves FLIM phasors for photon starved imaging experiments

More than double the fun with two-photon excitation microscopy

For generations researchers have been observing the dynamic processes of life through the lens of a microscope. This has offered tremendous insights into biological phenomena that span multiple orders of time- and length-scales ranging from the pure magic of molecular reorganization at the membrane of immune cells, to cell migration and differentiation during development or wound healing. Standard fluorescence microscopy techniques offer glimpses at such processes in vitro, however, when applied in intact systems, they are challenged by reduced signal strengths and signal-to-noise ratios that result from deeper imaging. As a remedy, two-photon excitation (TPE) microscopy takes a special place, because it allows us to investigate processes in vivo, in their natural environment, even in a living animal. Here, we review the fundamental principles underlying TPE aimed at basic and advanced microscopy users interested in adopting TPE for intravital imaging. We focus on applications in neurobiology, present current trends towards faster, wider and deeper imaging, discuss the combination with photon counting technologies for metabolic imaging and spectroscopy, as well as highlight outstanding issues and drawbacks in development and application of these methodologies.

Comparison of Retinal Metabolic Activity and Structural Development between rd10 Mice and Normal Mice Using Multiphoton Fluorescence Lifetime Imaging Microscopy

Fluorescence lifetime imaging microscopy (FLIM) is a technique that analyzes the metabolic state of tissues based on the spatial distribution of fluorescence lifetimes of certain interacting molecules. We used multiphoton FLIM to study the metabolic state of developing C57BL6/J and rd10 retinas based on the fluorescence lifetimes of free versus bound nicotinamide adenine dinucleotide and nicotinamide adenine dinucleotide phosphate (NAD(P)H), with free NAD(P)H percentages suggesting increased glycolysis and bound NAD(P)H percentages indicating oxidative phosphorylation. The mice were sacrificed and enucleated at various time points throughout their first 3 months of life. The isolated eyecups were fixed, sectioned using a polyacrylamide gel embedding technique, and then analyzed with FLIM. The results suggested that in both C57BL6/J mice and rd10 mice, oxidative phosphorylation initially decreased and then increased, plateauing over time. This trend, however, was accelerated in rd10 mice, with its turning point occurring at p10 versus the p30 turning point in C57BL6/J mice. There was also a noticeable difference in oxidative phosphorylation rates between the outer and inner retinas in both strains, with greater oxidative phosphorylation present in the latter. A greater understanding of rd10 and WT metabolic changes during retinal development may provide deeper insights into retinal degeneration and facilitate the development of future treatments.

Brandt J, Smith CJ, Yuan X, Howard S. Improving fluorescence lifetime imaging microscopy phasor accuracy using convolutional neural networks

Introduction: Although a powerful biological imaging technique, fluorescence lifetime imaging microscopy (FLIM) faces challenges such as a slow acquisition rate, a low signal-to-noise ratio (SNR), and high cost and complexity. To address the fundamental problem of low SNR in FLIM images, we demonstrate how to use pre-trained convolutional neural networks (CNNs) to reduce noise in FLIM measurements. Methods: Our approach uses pre-learned models that have been previously validated on large datasets with different distributions than the training datasets, such as sample structures, noise distributions, and microscopy modalities in fluorescence microscopy, to eliminate the need to train a neural network from scratch or to acquire a large training dataset to denoise FLIM data. In addition, we are using the pre-trained networks in the inference stage, where the computation time is in milliseconds and accuracy is better than traditional denoising methods. To separate different fluorophores in lifetime images, the denoised images are then run through an unsupervised machine learning technique named "K-means clustering". Results and Discussion: The results of the experiments carried out on in vivo mouse kidney tissue, Bovine pulmonary artery endothelial (BPAE) fixed cells that have been fluorescently labeled, and mouse kidney fixed samples that have been fluorescently labeled show that our demonstrated method can effectively remove noise from FLIM images and improve segmentation accuracy. Additionally, the performance of our method on out-of-distribution highly scattering in vivo plant samples shows that it can also improve SNR in challenging imaging conditions. Our proposed method provides a fast and accurate way to segment fluorescence lifetime images captured using any FLIM system. It is especially effective for separating fluorophores in noisy FLIM images, which is common in in vivo imaging where averaging is not applicable. Our approach significantly improves the identification of vital biologically relevant structures in biomedical imaging applications.

FLUTE: A Python GUI for interactive phasor analysis of FLIM data

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique used to probe the local environment of fluorophores. The fit-free phasor approach to FLIM data is increasingly being used due to its ease of interpretation. To date, no open-source graphical user interface (GUI) for phasor analysis of FLIM data is available in Python, thus limiting the widespread use of phasor analysis in biomedical research. Here, we present Fluorescence Lifetime Ultimate Explorer (FLUTE), a Python GUI that is designed to fill this gap. FLUTE simplifies and automates many aspects of the analysis of FLIM data acquired in the time domain, such as calibrating the FLIM data, performing interactive exploration of the phasor plot, displaying phasor plots and FLIM images with different lifetime contrasts simultaneously, and calculating the distance from known molecular species. After applying desired filters and thresholds, the final edited datasets can be exported for further user-specific analysis. FLUTE has been tested using several FLIM datasets including autofluorescence of zebrafish embryos and in vitro cells. In summary, our user-friendly GUI extends the advantages of phasor plotting by making the data visualization and analysis easy and interactive, allows for analysis of large FLIM datasets, and accelerates FLIM analysis for non-specialized labs.

Probing organoid metabolism using fluorescence lifetime imaging microscopy (FLIM): The next frontier of drug discovery and disease understanding

Organoid models have been used to address important questions in developmental and cancer biology, tissue repair, advanced modelling of disease and therapies, among other bioengineering applications. Such 3D microenvironmental models can investigate the regulation of cell metabolism, and provide key insights into the mechanisms at the basis of cell growth, differentiation, communication, interactions with the environment and cell death. Their accessibility and complexity, based on 3D spatial and temporal heterogeneity, make organoids suitable for the application of novel, dynamic imaging microscopy methods, such as fluorescence lifetime imaging microscopy (FLIM) and related decay time-assessing readouts. Several biomarkers and assays have been proposed to study cell metabolism by FLIM in various organoid models. Herein, we present an expert-opinion discussion on the principles of FLIM and PLIM, instrumentation and data collection and analysis protocols, and general and emerging biosensor-based approaches, to highlight the pioneering work being performed in this field.

Spatial resolution enhancement in photon-starved STED imaging using deep learning-based fluorescence lifetime analysis

As a super-resolution imaging method, stimulated emission depletion (STED) microscopy has unraveled fine intracellular structures and provided insights into nanoscale organizations in cells. Although image resolution can be further enhanced by continuously increasing the STED-beam power, the resulting photodamage and phototoxicity are major issues for real-world applications of STED microscopy. Here we demonstrate that, with 50% less STED-beam power, the STED image resolution can be improved up to 1.45-fold using the separation of photons by a lifetime tuning (SPLIT) scheme combined with a deep learning-based phasor analysis algorithm termed flimGANE (fluorescence lifetime imaging based on a generative adversarial network). This work offers a new approach for STED imaging in situations where only a limited photon budget is available.

Stimulated emission depletion microscopy with a single depletion laser using five fluorochromes and fluorescence lifetime phasor separation

Stimulated emission depletion (STED) microscopy achieves super-resolution by exciting a diffraction-limited volume and then suppressing fluorescence in its outer parts by depletion. Multiple depletion lasers may introduce misalignment and bleaching. Hence, a single depletion wavelength is preferable for multi-color analyses. However, this limits the number of usable spectral channels. Using cultured cells, common staining protocols, and commercially available fluorochromes and microscopes we exploit that the number of fluorochromes in STED or confocal microscopy can be increased by phasor based fluorescence lifetime separation of two dyes with similar emission spectra but different fluorescent lifetimes. In our multi-color FLIM-STED approach two fluorochromes in the near red (exc. 594 nm, em. 600–630) and two in the far red channel (633/641–680), supplemented by a single further redshifted fluorochrome (670/701–750) were all depleted with a single laser at 775 nm thus avoiding potential alignment issues. Generally, this approach doubles the number of fully distinguishable colors in laser scanning microscopy. We provide evidence that eight color FLIM-STED with a single depletion laser would be possible if suitable fluorochromes were identified and we confirm that a fluorochrome may have different lifetimes depending on the molecules to which it is coupled.

Live-Cell Fluorescence Lifetime Multiplexing Using Synthetic Fluorescent Probes

Fluorescence lifetime multiplexing requires fluorescent probes with distinct fluorescence lifetimes but similar spectral properties. Even though synthetic probes for many cellular targets are available for multicolor live-cell fluorescence microscopy, few of them have been characterized for their use in fluorescence lifetime multiplexing. Here, we demonstrate that, from a panel of 18 synthetic probes, eight pairwise combinations are suitable for fluorescence lifetime multiplexing in living mammalian cell lines. Moreover, combining multiple pairs in different spectral channels enables us to image four and with the help of self-labeling protein tags up to eight different biological targets, effectively doubling the number of observable targets. The combination of synthetic probes with fluorescence lifetime multiplexing is thus a powerful approach for live-cell imaging.

Bladder cancer cells shift rapidly and spontaneously to cisplatin-resistant oxidative phosphorylation that is trackable in real time

Genetic mutations have long been recognized as drivers of cancer drug resistance, but recent work has defined additional non-genetic mechanisms of plasticity, wherein cancer cells assume a drug resistant phenotype marked by altered epigenetic and transcriptional states. Currently, little is known about the real-time, dynamic nature of this phenotypic shift. Using a bladder cancer model of nongenetic plasticity, we discovered that rapid transition to drug resistance entails upregulation of mitochondrial gene expression and a corresponding metabolic shift towards the tricarboxylic acid cycle and oxidative phosphorylation. Based on this distinction, we were able to track cancer cell metabolic profiles in real time using fluorescence lifetime microscopy (FLIM). We observed single cells transitioning spontaneously to an oxidative phosphorylation state over hours to days, a trend that intensified with exposure to cisplatin chemotherapy. Conversely, pharmacological inhibition of oxidative phosphorylation significantly reversed the FLIM metabolic signature and reduced cisplatin resistance. These rapid, spontaneous metabolic shifts offer a new means of tracking nongenetic cancer plasticity and forestalling the emergence of drug resistance.

Engineered HaloTag variants for fluorescence lifetime multiplexing

Self-labeling protein tags such as HaloTag are powerful tools that can label fusion proteins with synthetic fluorophores for use in fluorescence microscopy. Here we introduce HaloTag variants with either increased or decreased brightness and fluorescence lifetime compared with HaloTag7 when labeled with rhodamines. Combining these HaloTag variants enabled live-cell fluorescence lifetime multiplexing of three cellular targets in one spectral channel using a single fluorophore and the generation of a fluorescence lifetime-based biosensor. Additionally, the brightest HaloTag variant showed up to 40% higher brightness in live-cell imaging applications.

Optimization of Advanced Live-Cell Imaging through Red/Near-Infrared Dye Labeling and Fluorescence Lifetime-Based Strategies

Fluorescence microscopy is essential for a detailed understanding of cellular processes; however, live-cell preservation during imaging is a matter of debate. In this study, we proposed a guide to optimize advanced light microscopy approaches by reducing light exposure through fluorescence lifetime (τ) exploitation of red/near-infrared dyes. Firstly, we characterized key instrumental elements which revealed that red/near-infrared laser lines with an 86x (Numerical Aperture (NA) = 1.2, water immersion) objective allowed high transmission of fluorescence signals, low irradiance and super-resolution. As a combination of two technologies, i.e., vacuum tubes (e.g., photomultiplier) and semiconductor microelectronics (e.g., avalanche photodiode), type S, X and R of hybrid detectors (HyD-S, HyD-X and HyD-R) were particularly adapted for red/near-infrared photon counting and τ separation. Secondly, we tested and compared lifetime-based imaging including coarse τ separation for confocal microscopy, fitting and phasor plot analysis for fluorescence lifetime microscopy (FLIM), and lifetimes weighting for enhanced stimulated emission depletion (STED) nanoscopy, in light of red/near-infrared multiplexing. Mainly, we showed that the choice of appropriate imaging approach may depend on fluorochrome number, together with their spectral/lifetime characteristics and STED compatibility. Photon-counting mode and sensitivity of HyDs together with phasor plot analysis of fluorescence lifetimes enabled the flexible and fast imaging of multi-labeled living H28 cells. Therefore, a combination of red/near-infrared dyes labeling with lifetime-based strategies offers new perspectives for live-cell imaging by enhancing sample preservation through acquisition time and light exposure reduction.