Fluorescence lifetime imaging (FLIM): Basic concepts and some recent developments

Fluorescence lifetime imaging microscopy of flexible and rigid dyes probes the biophysical properties of synthetic and biological membranes

Sensing of the biophysical properties of membranes using molecular reporters has recently regained widespread attention. This was elicited by the development of new probes of exquisite optical properties and increased performance, combined with developments in fluorescence detection. Here, we report on fluorescence lifetime imaging of various rigid and flexible fluorescent dyes to probe the biophysical properties of synthetic and biological membranes at steady state as well as upon the action of external membrane-modifying agents. We tested the solvatochromic dyes Nile red and 1,2-dimyristoyl-sn-glycero-3-phosphoethanolamine-N-(7-nitro-2-1,3-benzoxadiazol-4-yl) (ammonium salt) (NBD), the viscosity sensor Bodipy C12, the flipper dye FliptR, as well as the dyes 3,3'-dioctadecyloxacarbocyanine perchlorate (DiO), Bodipy C16, lissamine-rhodamine, and Atto647, which are dyes with no previous reported environmental sensitivity. The performance of the fluorescent probes, many of which are commercially available, was benchmarked with well-known environmental reporters, with Nile red and Bodipy C12 being specific reporters of medium hydration and viscosity, respectively. We show that some widely used ordinary dyes with no previous report of sensing capabilities can exhibit competing performance compared to highly sensitive commercially available or custom-based solvatochromic dyes, molecular rotors, or flipper in a wide range of biophysics experiments. Compared to other methods, fluorescence lifetime imaging is a minimally invasive and nondestructive method with optical resolution. It enables biophysical mapping at steady state or assessment of the changes induced by membrane-active molecules at subcellular level in both synthetic and biological membranes when intensity measurements fail to do so. The results have important consequences for the specific choice of the sensor and take into consideration factors such as probe sensitivity, response to environmental changes, ease and speed of data analysis, and the probe's intracellular distribution, as well as potential side effects induced by labeling and imaging.

Chemical Control of Fluorescence Lifetime towards Multiplexing Imaging

Fluorescence lifetime imaging has been a powerful tool for biomedical research. Recently, fluorescence lifetime-based multiplexing imaging has expanded imaging channels by using probes that harbor the same spectral channels and distinct excited state lifetime. While it is desirable to control the excited state lifetime of any given fluorescent probes, the rational control of fluorescence lifetimes remains a challenge. Herein, we chose boron dipyrromethene (BODIPY) as a model system and provided chemical strategies to regulate the fluorescence lifetime of its derivatives with varying spectral features. We find electronegativity of structural substituents at the 8' and 5' positions is important to control the lifetime for the green-emitting and red-emitting BODIPY scaffolds. Mechanistically, such influences are exerted via the photo-induced electron transfer and the intramolecular charge transfer processes for the 8' and 5' positions of BODIPY, respectively. Based on these principles, we have generated a group of BODIPY probes that enable imaging experiments to separate multiple targets using fluorescence lifetime as a signal. In addition to BODIPY, we envision modulation of electronegativity of chemical substituents could serve as a feasible strategy to achieve rational control of fluorescence lifetime for a variety of small molecule fluorophores.

A Novel Fit-Flexible Fluorescence Soft Imager: Tri-Sensing of Intensity, Fall-Time, and Life Profile

Time-resolved fluorescence imaging techniques, like confocal fluorescence lifetime imaging microscopy, are powerful photonic instrumentation tools of modern science with diverse applications, including: biology, medicine, and chemistry. However, complexities of the systems, both at specimen and device levels, cause difficulties in quantifying soft biomarkers. To address the problems, we first aim to understand and model the underlying photophysics of fluorescence decay curves. For this purpose, we provide a set of mathematical functions, called "life models", fittable with the real temporal recordings of histogram of photon counts. For each model, an equivalent electrical circuit, called a "life circuit", is derived for explaining the whole process. In confocal endomicroscopy, the components of excitation laser, specimen, and fluorescence-emission signal as the histogram of photon counts are modelled by a power source, network of resistor-inductor-capacitor circuitry, and multimetre, respectively. We then design a novel pixel-level temporal classification algorithm, called a "fit-flexible approach", where qualities of "intensity", "fall-time", and "life profile" are identified for each point. A model selection mechanism is used at each pixel to flexibly choose the best representative life model based on a proposed Misfit-percent metric. A two-dimensional arrangement of the quantified information detects some kind of structural information. This approach showed a potential of separating microbeads from lung tissue, distinguishing the tri-sensing from conventional methods. We alleviated by 7% the error of the Misfit-percent for recovering the histograms on real samples than the best state-of-the-art competitor. Codes are available online.

Single-sample image-fusion upsampling of fluorescence lifetime images

Fluorescence lifetime imaging microscopy (FLIM) provides detailed information about molecular interactions and biological processes. A major bottleneck for FLIM is image resolution at high acquisition speeds due to the engineering and signal-processing limitations of time-resolved imaging technology. Here, we present single-sample image-fusion upsampling, a data-fusion approach to computational FLIM super-resolution that combines measurements from a low-resolution time-resolved detector (that measures photon arrival time) and a high-resolution camera (that measures intensity only). To solve this otherwise ill-posed inverse retrieval problem, we introduce statistically informed priors that encode local and global correlations between the two "single-sample" measurements. This bypasses the risk of out-of-distribution hallucination as in traditional data-driven approaches and delivers enhanced images compared, for example, to standard bilinear interpolation. The general approach laid out by single-sample image-fusion upsampling can be applied to other image super-resolution problems where two different datasets are available.

Two-photon autofluorescence lifetime assay of rabbit photoreceptors and retinal pigment epithelium during light-dark visual cycles in rabbit retina

Two-photon excited fluorescence (TPEF) is a powerful technique that enables the examination of intrinsic retinal fluorophores involved in cellular metabolism and the visual cycle. Although previous intensity-based TPEF studies in non-human primates have successfully imaged several classes of retinal cells and elucidated aspects of both rod and cone photoreceptor function, fluorescence lifetime imaging (FLIM) of the retinal cells under light-dark visual cycle has yet to be fully exploited. Here we demonstrate a FLIM assay of photoreceptors and retinal pigment epithelium (RPE) that reveals key insights into retinal physiology and adaptation. We found that photoreceptor fluorescence lifetimes increase and decrease in sync with light and dark exposure, respectively. This is likely due to changes in all-trans-retinol and all-trans-retinal levels in the outer segments, mediated by phototransduction and visual cycle activity. During light exposure, RPE fluorescence lifetime was observed to increase steadily over time, as a result of all-trans-retinol accumulation during the visual cycle and decreasing metabolism caused by the lack of normal perfusion of the sample. Our system can measure the fluorescence lifetime of intrinsic retinal fluorophores on a cellular scale, revealing differences in lifetime between retinal cell classes under different conditions of light and dark exposure.

A Method to Correct the Temporal Drift of Single-Photon Detectors Based on Asynchronous Quantum Ghost Imaging

Single-photon detection and timing has attracted increasing interest in recent years due to their necessity in the field of quantum sensing and the advantages of single-quanta detection in the field of low-level light imaging. While simple bucket detectors are mature enough for commercial applications, more complex imaging detectors are still a field of research comprising mostly prototype-level detectors. A major problem in these detectors is the implementation of in-pixel timing circuitry, especially for two-dimensional imagers. One of the most promising approaches is the use of voltage-controlled ring resonators in every pixel. Each of these runs independently based on a voltage supplied by a global reference. However, this yields the problem that the supply voltage can change across the chip which, in turn, changes the period of the ring resonator. Due to additional parasitic effects, this problem can worsen with increasing measurement time, leading to drift in the timing information. We present here a method to identify and correct such temporal drifts in single-photon detectors based on asynchronous quantum ghost imaging. We also show the effect of this correction on recent quantum ghost imaging (QGI) measurement from our group.

Reversible Dual Fluorescence-Lifetime Imaging of Mitochondrial GSH and Microviscosity: Real-Time Evaluation of Ferroptosis Status

Ferroptosis, as a new form of regulated cell death, is implicated in various physiological and pathological processes. Developing a single probe for an independent analysis of multiple analytes related to ferroptosis can provide more accurate information and simplify the detection procedures, but it faces great challenges. In this work, we develop a fluorescent probe for the simultaneous detection of GSH through ratiometric fluorescence response and microviscosity via a fluorescence lifetime model. Based on the reversible Michael addition reaction between GSH and unsaturated C═C bond, the probe responds reversibly to GSH with a ratiometric fluorescence variation and a fast response time (t1/2 = 4.7 s). At the same time, the probe is sensitive to environmental viscosity by changing its fluorescence lifetimes. The probe was applied to monitor the drug-induced ferroptosis process through both the classical Xc-/GSH/GPX4- and DHODH-mediated defense mechanisms. We hope that the probe will provide a useful molecular tool for the real-time live-cell imaging of GSH dynamics, which is benefit to unveiling related physiological and pathological processes.

Visualization of latent fingerprints using fluorescence lifetime imaging on paper emitting strong fluorescence

Latent fingerprints were successfully visualized using fluorescence lifetime imaging (FLIM) on paper which emits strong fluorescence with a lifetime close to that of fingerprints and thus from which it is difficult for time-resolved spectroscopy to visualize fingerprints. Latent fingerprint samples on paper were excited using a 450 nm or 532 nm nanosecond pulsed-laser, and time-resolved fluorescence images were obtained at a delay time of 6-16 ns in intervals of 1 ns, to the excitation pulse. The excitation beam was expanded using a lens, and the fluorescence from the fingerprints was captured using an intensified CCD camera. Because of the large fluorescence intensity of the background paper of approximately two to four orders of magnitude larger than that of the fingerprint, the fingerprint was not visualized on each fluorescence image by time-resolved spectroscopy. However, the fingerprint was visualized in a FLIM image constructed using a series of the fluorescence images for the case with the fluorescence intensity of the background paper being four orders of magnitude larger than that of the fingerprint. The difference in fluorescence lifetime in the FLIM image of the visualized fingerprint and background paper was in the order of 0.1 ns, which was an order of magnitude smaller than the inherent fluorescence lifetime of a few nanoseconds for the fingerprints and paper. It was demonstrated that, at a background fluorescence intensity with a certain order of magnitude larger than that of fingerprints, FLIM has the potential to visualize latent fingerprints which cannot be visualized by time-resolved spectroscopy.

Phasor-FLIM analysis of cellulose paper ageing mechanism with carbotrace 680 dye

Ageing of paper is a complex process of great relevance for application purposes because of its widespread use as support for information storage in books and documents, and as common low-cost and green packaging material, to name a few. A key factor in paper ageing is the oxidation of cellulose, a macromolecule of natural origin that constitutes the main chemical component of paper. Such a complex process results in changes in the cellulose polymeric chains in chemical and structural properties. The scope of this work is to explore the effects of oxidation of cellulose as one of the principal mechanisms of ageing of paper using a fluorescence-based approach. To this aim, fluorescence-lifetime imaging microscopy (FLIM) measurements on pure cellulose samples stained using Carbotrace 680 dye were performed, and data were analyzed by phasor approach. The comparison with results from conventional techniques allowed to map paper microstructure as a function of the sample oxidation degree correlating the fluorescence-lifetime changes to cellulose oxidation. A two-step oxidation kinetics that produced specific modification in paper organization was highlighted indicating that FLIM measurements using Carbotrace 680 dye may provide a simple tool to obtain information on the oxidation process also adding spatial information at sub-micrometric scale.

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Fluorescence lifetime imaging (FLI) has been receiving increased attention in recent years as a powerful diagnostic technique in biological and medical research. However, existing FLI systems often suffer from a tradeoff between processing speed, accuracy, and robustness. Inspired by the concept of Edge Artificial Intelligence (Edge AI), we propose a robust approach that enables fast FLI with no degradation of accuracy. This approach couples a recurrent neural network (RNN), which is trained to estimate the fluorescence lifetime directly from raw timestamps without building histograms, to SPAD TCSPC systems, thereby drastically reducing transfer data volumes and hardware resource utilization, and enabling real-time FLI acquisition. We train two variants of the RNN on a synthetic dataset and compare the results to those obtained using center-of-mass method (CMM) and least squares fitting (LS fitting). Results demonstrate that two RNN variants, gated recurrent unit (GRU) and long short-term memory (LSTM), are comparable to CMM and LS fitting in terms of accuracy, while outperforming them in the presence of background noise by a large margin. To explore the ultimate limits of the approach, we derive the Cramer-Rao lower bound of the measurement, showing that RNN yields lifetime estimations with near-optimal precision. To demonstrate real-time operation, we build a FLI microscope based on an existing SPAD TCSPC system comprising a 32[Formula: see text]32 SPAD sensor named Piccolo. Four quantized GRU cores, capable of processing up to 4 million photons per second, are deployed on the Xilinx Kintex-7 FPGA that controls the Piccolo. Powered by the GRU, the FLI setup can retrieve real-time fluorescence lifetime images at up to 10 frames per second. The proposed FLI system is promising and ideally suited for biomedical applications, including biological imaging, biomedical diagnostics, and fluorescence-assisted surgery, etc.

Applications of machine learning in time-domain fluorescence lifetime imaging: a review

Many medical imaging modalities have benefited from recent advances in Machine Learning (ML), specifically in deep learning, such as neural networks. Computers can be trained to investigate and enhance medical imaging methods without using valuable human resources. In recent years, Fluorescence Lifetime Imaging (FLIm) has received increasing attention from the ML community. FLIm goes beyond conventional spectral imaging, providing additional lifetime information, and could lead to optical histopathology supporting real-time diagnostics. However, most current studies do not use the full potential of machine/deep learning models. As a developing image modality, FLIm data are not easily obtainable, which, coupled with an absence of standardisation, is pushing back the research to develop models which could advance automated diagnosis and help promote FLIm. In this paper, we describe recent developments that improve FLIm image quality, specifically time-domain systems, and we summarise sensing, signal-to-noise analysis and the advances in registration and low-level tracking. We review the two main applications of ML for FLIm: lifetime estimation and image analysis through classification and segmentation. We suggest a course of action to improve the quality of ML studies applied to FLIm. Our final goal is to promote FLIm and attract more ML practitioners to explore the potential of lifetime imaging.

Evaluating Riboglow-FLIM probes for RNA sensing

We recently developed Riboglow-FLIM, where we genetically tag and track RNA molecules in live cells through measuring the fluorescence lifetime of a small molecule probe that binds the RNA tag. Here, we systematically and quantitatively evaluated key elements of Riboglow-FLIM that may serve as the foundation for Riboglow-FLIM applications and further tool development efforts. Our investigation focused on measuring changes in fluorescence lifetime of representative Riboglow-FLIM probes with different linkers and fluorophores in different environments. In vitro measurements revealed distinct lifetime differences among the probe variants as a result of different linker designs and fluorophore selections. To expand on the platform's versatility, probes in a wide variety of mammalian cell types were examined using fluorescence lifetime imaging microscopy (FLIM), and possible effects on cell physiology were evaluated by metabolomics. The results demonstrated that variations in lifetime were dependent on both probe and cell type. Interestingly, distinct differences in lifetime values were observed between cell lines, while no overall change in cell health was measured. These findings underscore the importance of probe selection and cellular environment when employing Riboglow-FLIM for RNA detection, serving as a foundation for future tool development and applications across diverse fields and biological systems.

Multiplexed imaging in live cells using pulsed interleaved excitation spectral FLIM

Multiplexed fluorescence detection has become increasingly important in the fields of biosensing and bioimaging. Although a variety of excitation/detection optical designs and fluorescence unmixing schemes have been proposed to allow for multiplexed imaging, rapid and reliable differentiation and quantification of multiple fluorescent species at each imaging pixel is still challenging. Here we present a pulsed interleaved excitation spectral fluorescence lifetime microscopic (PIE-sFLIM) system that can simultaneously image six fluorescent tags in live cells in a single hyperspectral snapshot. Using an alternating pulsed laser excitation scheme at two different wavelengths and a synchronized 16-channel time-resolved spectral detector, our PIE-sFLIM system can effectively excite multiple fluorophores and collect their emission over a broad spectrum for analysis. Combining our system with the advanced live-cell labeling techniques and the lifetime/spectral phasor analysis, our PIE-sFLIM approach can well unmix the fluorescence of six fluorophores acquired in a single measurement, thus improving the imaging speed in live-specimen investigation.

Molecularly Engineered Room-Temperature Phosphorescence for Biomedical Application: From the Visible toward Second Near-Infrared Window

Phosphorescence, characterized by luminescent lifetimes significantly longer than that of biological autofluorescence under ambient environment, is of great value for biomedical applications. Academic evidence of fluorescence imaging indicates that virtually all imaging metrics (sensitivity, resolution, and penetration depths) are improved when progressing into longer wavelength regions, especially the recently reported second near-infrared (NIR-II, 1000-1700 nm) window. Although the emission wavelength of probes does matter, it is not clear whether the guideline of "the longer the wavelength, the better the imaging effect" is still suitable for developing phosphorescent probes. For tissue-specific bioimaging, long-lived probes, even if they emit visible phosphorescence, enable accurate visualization of large deep tissues. For studies dealing with bioimaging of tiny biological architectures or dynamic physiopathological activities, the prerequisite is rigorous planning of long-wavelength phosphorescence, being aware of the cooperative contribution of long wavelengths and long lifetimes for improving the spatiotemporal resolution, penetration depth, and sensitivity of bioimaging. In this Review, emerging molecular engineering methods of room-temperature phosphorescence are discussed through the lens of photophysical mechanisms. We highlight the roles of phosphorescence with emission from visible to NIR-II windows toward bioapplications. To appreciate such advances, challenges and prospects in rapidly growing studies of room-temperature phosphorescence are described.

Fluorescent naphthalimide boronates as theranostics: structural investigations, confocal fluorescence and multiphoton fluorescence lifetime imaging microscopy in living cells

New design and synthetic strategies were developed to generate functional phenyl boronic acid (BA)-based fluorescent probes incorporating the 1,8-naphthalimide (NI) tag. This fluorescent core was anchored onto the BA unit through small organic linkers consisting of nitrogen groups which can arrest, and internally stabilise the phenyl-boronate units. The newly synthesised fluorophores were characterised spectroscopically by NMR spectroscopy and mass spectrometry and evaluated for their ability to bind to a naturally occurring polysaccharide, β-d-glucan in DMSO and simultaneously as act as in vitro cell imaging reagents. The uptake of these new NI-boronic acid derivatives was studied living cancer cells (HeLa, PC-3) in the presence, and absence, of β-d-glucan. Time-correlated single-photon counting (TCSPC) of DMSO solutions and two-photon fluorescence-lifetime imaging microscopy (FLIM) techniques allowed an insight into the probes' interaction with their environment. Their cellular uptake and distributions were imaged using laser scanning confocal fluorescence microscopy under single- and two-photon excitation regimes (λmax 910 nm). FLIM facilitated the estimation of the impact of the probe's cellular surroundings using the fluorophore lifetime. The extent to which this was mediated by the β-d-glucan was visualised by 2-photon FLIM in living cells. The fluorescence lifetime observed under a range of temperatures varied appreciably, indicating that changes in the environment can be sensed by these probes. In all cases, the cellular membrane penetration of these new probes was remarkable even under variable temperature conditions and localisation was widely concentrated in the cellular cytoplasm, without specific organelle trapping: we conclude that these new probes show promise for cellular imaging in living cancer cells.

Modular Nanotransporters Delivering Biologically Active Molecules to the Surface of Mitochondria

Treatment of various diseases, in particular cancer, usually requires the targeting of biologically active molecules at a selected subcellular compartment. We modified our previously developed modular nanotransporters (MNTs) for targeting mitochondria. The new MNTs are capable of binding to the protein predominantly localized on the outer mitochondrial membrane, Keap1. These MNTs possessing antiKeap1 monobody co-localize with mitochondria upon addition to the cells. They efficiently interact with Keap1 both in solution and within living cells. A conjugate of the MNT with a photosensitizer, chlorin e6, demonstrated significantly higher photocytotoxicity than chlorin e6 alone. We assume that MNTs of this kind can improve efficiency of therapeutic photosensitizers and radionuclides emitting short-range particles.

FLUTE: A Python GUI for interactive phasor analysis of FLIM data

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique used to probe the local environment of fluorophores. The fit-free phasor approach to FLIM data is increasingly being used due to its ease of interpretation. To date, no open-source graphical user interface (GUI) for phasor analysis of FLIM data is available in Python, thus limiting the widespread use of phasor analysis in biomedical research. Here, we present Fluorescence Lifetime Ultimate Explorer (FLUTE), a Python GUI that is designed to fill this gap. FLUTE simplifies and automates many aspects of the analysis of FLIM data acquired in the time domain, such as calibrating the FLIM data, performing interactive exploration of the phasor plot, displaying phasor plots and FLIM images with different lifetime contrasts simultaneously, and calculating the distance from known molecular species. After applying desired filters and thresholds, the final edited datasets can be exported for further user-specific analysis. FLUTE has been tested using several FLIM datasets including autofluorescence of zebrafish embryos and in vitro cells. In summary, our user-friendly GUI extends the advantages of phasor plotting by making the data visualization and analysis easy and interactive, allows for analysis of large FLIM datasets, and accelerates FLIM analysis for non-specialized labs.

Building Fluorescence Lifetime Maps Photon-by-Photon by Leveraging Spatial Correlations

Fluorescence lifetime imaging microscopy (FLIM) has become a standard tool in the quantitative characterization of subcellular environments. However, quantitative FLIM analyses face several challenges. First, spatial correlations between pixels are often ignored as signal from individual pixels is analyzed independently thereby limiting spatial resolution. Second, existing methods deduce photon ratios instead of absolute lifetime maps. Next, the number of fluorophore species contributing to the signal is unknown, while excited state lifetimes with <1 ns difference are difficult to discriminate. Finally, existing analyses require high photon budgets and often cannot rigorously propagate experimental uncertainty into values over lifetime maps and number of species involved. To overcome all of these challenges simultaneously and self-consistently at once, we propose the first doubly nonparametric framework. That is, we learn the number of species (using Beta-Bernoulli process priors) and absolute maps of these fluorophore species (using Gaussian process priors) by leveraging information from pulses not leading to observed photon. We benchmark our framework using a broad range of synthetic and experimental data and demonstrate its robustness across a number of scenarios including cases where we recover lifetime differences between species as small as 0.3 ns with merely 1000 photons.

Genetically encoded fluorescence lifetime biosensors: overview, advances, and opportunities

Genetically encoded biosensors based on fluorescent proteins (FPs) are powerful tools for tracking analytes and cellular events with high spatial and temporal resolution in living cells and organisms. Compared with intensiometric readout and ratiometric readout, fluorescence lifetime readout provides absolute measurements, independent of the biosensor expression level and instruments. Thus, genetically encoded fluorescence lifetime biosensors play a vital role in facilitating accurate quantitative assessments within intricate biological systems. In this review, we first provide a concise description of the categorization and working mechanism of genetically encoded fluorescence lifetime biosensors. Subsequently, we elaborate on the combination of the fluorescence lifetime imaging technique and lifetime analysis methods with fluorescence lifetime biosensors, followed by their application in monitoring the dynamics of environment parameters, analytes and cellular events. Finally, we discuss worthwhile considerations for the design, optimization and development of fluorescence lifetime-based biosensors from three representative cases.

Spectroscopic techniques for monitoring stem cell and organoid proliferation in 3D environments for therapeutic development

Spectroscopic techniques for monitoring stem cell and organoid proliferation have gained significant attention in therapeutic development. Spectroscopic techniques such as fluorescence, Raman spectroscopy, and infrared spectroscopy offer noninvasive and real-time monitoring of biochemical and biophysical changes that occur during stem cell and organoid proliferation. These techniques provide valuable insight into the underlying mechanisms of action of potential therapeutic agents, allowing for improved drug discovery and screening. This review highlights the importance of spectroscopic monitoring of stem cell and organoid proliferation and its potential impact on therapeutic development. Furthermore, this review discusses recent advances in spectroscopic techniques and their applications in stem cell and organoid research. Overall, this review emphasizes the importance of spectroscopic techniques as valuable tools for studying stem cell and organoid proliferation and their potential to revolutionize therapeutic development in the future.

Optical Methods for Non-Invasive Determination of Skin Penetration: Current Trends, Advances, Possibilities, Prospects, and Translation into In Vivo Human Studies

Information on the penetration depth, pathways, metabolization, storage of vehicles, active pharmaceutical ingredients (APIs), and functional cosmetic ingredients (FCIs) of topically applied formulations or contaminants (substances) in skin is of great importance for understanding their interaction with skin targets, treatment efficacy, and risk assessment-a challenging task in dermatology, cosmetology, and pharmacy. Non-invasive methods for the qualitative and quantitative visualization of substances in skin in vivo are favored and limited to optical imaging and spectroscopic methods such as fluorescence/reflectance confocal laser scanning microscopy (CLSM); two-photon tomography (2PT) combined with autofluorescence (2PT-AF), fluorescence lifetime imaging (2PT-FLIM), second-harmonic generation (SHG), coherent anti-Stokes Raman scattering (CARS), and reflectance confocal microscopy (2PT-RCM); three-photon tomography (3PT); confocal Raman micro-spectroscopy (CRM); surface-enhanced Raman scattering (SERS) micro-spectroscopy; stimulated Raman scattering (SRS) microscopy; and optical coherence tomography (OCT). This review summarizes the state of the art in the use of the CLSM, 2PT, 3PT, CRM, SERS, SRS, and OCT optical methods to study skin penetration in vivo non-invasively (302 references). The advantages, limitations, possibilities, and prospects of the reviewed optical methods are comprehensively discussed. The ex vivo studies discussed are potentially translatable into in vivo measurements. The requirements for the optical properties of substances to determine their penetration into skin by certain methods are highlighted.

Probing Polarity and pH Sensitivity of Carbon Dots in Escherichia coli through Time-Resolved Fluorescence Analyses

Intracellular monitoring of pH and polarity is crucial for understanding cellular processes and functions. This study employed pH- and polarity-sensitive nanomaterials such as carbon dots (CDs) for the intracellular sensing of pH, polarity, and viscosity using integrated time-resolved fluorescence anisotropy (FA) imaging (TR-FAIM) and fluorescence lifetime (FLT) imaging microscopy (FLIM), thereby enabling comprehensive characterization. The functional groups on the surface of CDs exhibit sensitivity to changes in the microenvironment, leading to variations in fluorescence intensity (FI) and FLT according to pH and polarity. The FLT of CDs in aqueous solution changed gradually from 6.38 ± 0.05 ns to 8.03 ± 0.21 ns within a pH range of 2-8. Interestingly, a complex relationship of FI and FLT was observed during measurements of CDs with decreasing polarity. However, the FA and rotational correlation time (θ) increased from 0.062 ± 0.019 to 0.112 ± 0.023 and from 0.49 ± 0.03 ns to 2.01 ± 0.27 ns, respectively. This increase in FA and θ was attributed to the higher viscosity accompanying the decrease in polarity. Furthermore, CDs were found to bind to three locations in Escherichia coli: the cell wall, inner membrane, and cytoplasm, enabling intracellular characterization using FI and FA decay imaging. FLT provided insights into cytoplasmic pH (7.67 ± 0.48), which agreed with previous works, as well as the decrease in polarity in the cell wall and inner membrane. The CD aggregation was suspected in certain areas based on FA, and the θ provided information on cytoplasmic heterogeneity due to the aggregation and/or interactions with biomolecules. The combined TR-FAIM/FLIM system allowed for simultaneous monitoring of pH and polarity changes through FLIM and viscosity variations through TR-FAIM.

Visualising varnish removal for conservation of paintings by fluorescence lifetime imaging (FLIM)

The removal of varnish from the surface is a key step in painting conservation. Varnish removal is traditionally monitored by examining the painting surface under ultraviolet illumination. We show here that by imaging the fluorescence lifetime instead, much better contrast, sensitivity, and specificity can be achieved. For this purpose, we developed a lightweight (4.8 kg) portable instrument for macroscopic fluorescence lifetime imaging (FLIM). It is based on a time-correlated single-photon avalanche diode (SPAD) camera to acquire the FLIM images and a pulsed 440 nm diode laser to excite the varnish fluorescence. A historical model painting was examined to demonstrate the capabilities of the system. We found that the FLIM images provided information on the distribution of the varnish on the painting surface with greater sensitivity, specificity, and contrast compared to the traditional ultraviolet illumination photography. The distribution of the varnish and other painting materials was assessed using FLIM during and after varnish removal with different solvent application methods. Monitoring of the varnish removal process between successive solvent applications by a swab revealed an evolving image contrast as a function of the cleaning progress. FLIM of dammar and mastic resin varnishes identified characteristic changes to their fluorescence lifetimes depending on their ageing conditions. Thus, FLIM has a potential to become a powerful and versatile tool to visualise varnish removal from paintings.

Graphical Abstract

A molecular rotor FLIM probe reveals dynamic coupling between mitochondrial inner membrane fluidity and cellular respiration

The inner mitochondrial membrane (IMM), housing components of the electron transport chain (ETC), is the site for respiration. The ETC relies on mobile carriers; therefore, it has long been argued that the fluidity of the densely packed IMM can potentially influence ETC flux and cell physiology. However, it is unclear if cells temporally modulate IMM fluidity upon metabolic or other stimulation. Using a photostable, red-shifted, cell-permeable molecular-rotor, Mitorotor-1, we present a multiplexed approach for quantitatively mapping IMM fluidity in living cells. This reveals IMM fluidity to be linked to cellular-respiration and responsive to stimuli. Multiple approaches combining in vitro experiments and live-cell fluorescence (FLIM) lifetime imaging microscopy (FLIM) show Mitorotor-1 to robustly report IMM 'microviscosity'/fluidity through changes in molecular free volume. Interestingly, external osmotic stimuli cause controlled swelling/compaction of mitochondria, thereby revealing a graded Mitorotor-1 response to IMM microviscosity. Lateral diffusion measurements of IMM correlate with microviscosity reported via Mitorotor-1 FLIM-lifetime, showing convergence of independent approaches for measuring IMM local-order. Mitorotor-1 FLIM reveals mitochondrial heterogeneity in IMM fluidity; between-and-within cells and across single mitochondrion. Multiplexed FLIM lifetime imaging of Mitorotor-1 and NADH autofluorescence reveals that IMM fluidity positively correlates with respiration, across individual cells. Remarkably, we find that stimulating respiration, through nutrient deprivation or chemically, also leads to increase in IMM fluidity. These data suggest that modulating IMM fluidity supports enhanced respiratory flux. Our study presents a robust method for measuring IMM fluidity and suggests a dynamic regulatory paradigm of modulating IMM local order on changing metabolic demand.

Fluorescence lifetime tracking and imaging of single moving particles assisted by a low-photon-count analysis algorithm

Fluorescence lifetime imaging microscopy (FLIM) has been widely used in the field of biological research because of its high specificity, sensitivity, and quantitative ability in the sensing cellular microenvironment. The most commonly used FLIM technology is based on time-correlated single photon counting (TCSPC). Although the TCSPC method has the highest temporal resolution, the data acquisition time is usually long, and the imaging speed is slow. In this work, we proposed a fast FLIM technology for fluorescence lifetime tracking and imaging of single moving particles, named single particle tracking FLIM (SPT-FLIM). We used feedback-controlled addressing scanning and Mosaic FLIM mode imaging to reduce the number of scanned pixels and the data readout time, respectively. Moreover, we developed a compressed sensing analysis algorithm based on alternating descent conditional gradient (ADCG) for low-photon-count data. We applied the ADCG-FLIM algorithm on both simulated and experimental datasets to evaluate its performance. The results showed that ADCG-FLIM could achieve reliable lifetime estimation with high accuracy and precision in the case of a photon count less than 100. By reducing the photon count requirement for each pixel from, typically, 1000 to 100, the acquisition time for a single frame lifetime image could be significantly shortened, and the imaging speed could be improved to a great extent. On this basis, we obtained lifetime trajectories of moving fluorescent beads using the SPT-FLIM technique. Overall, our work offers a powerful tool for fluorescence lifetime tracking and imaging of single moving particles, which will promote the application of TCSPC-FLIM in biological research.

Fluorescence lifetime imaging through scattering media

Fluorescence lifetime determination has proven to be useful, e.g. identification of molecules, quantitative estimation of species concentration and determination of temperatures. Lifetime determination of exponentially decaying signals is challenging if signals of different decay rates are being mixed, resulting in erroneous results. Such issues occur when the contrast of the measurement object is low, which can be limiting in applied measurements due to spurious light scattering. A solution is presented here where structured illumination is used to enhance image contrast in fluorescence lifetime wide-field imaging. Lifetime imaging determination was carried out using Dual Imaging Modeling Evaluation (DIME), and spatial lock-in analysis was used for removing spurious scattered signal to enable fluorescence lifetime imaging through scattering media.

Specific in situ immuno-imaging of pulmonary-resident memory lymphocytes in human lungs

Introduction

Pulmonary-resident memory T cells (T_RM) and B cells (B_RM) orchestrate protective immunity to reinfection with respiratory pathogens. Developing methods for the in situ detection of these populations would benefit both research and clinical settings.

Methods

To address this need, we developed a novel in situ immunolabelling approach combined with clinic-ready fibre-based optical endomicroscopy (OEM) to detect canonical markers of lymphocyte tissue residency in situ in human lungs undergoing ex vivo lung ventilation (EVLV).

Results

Initially, cells from human lung digests (confirmed to contain T_RM/B_RM populations using flow cytometry) were stained with CD69 and CD103/CD20 fluorescent antibodies and imaged in vitro using KronoScan, demonstrating it's ability to detect antibody labelled cells. We next instilled these pre-labelled cells into human lungs undergoing EVLV and confirmed they could still be visualised using both fluorescence intensity and lifetime imaging against background lung architecture. Finally, we instilled fluorescent CD69 and CD103/CD20 antibodies directly into the lung and were able to detect T_RM/B_RM following in situ labelling within seconds of direct intra-alveolar delivery of microdoses of fluorescently labelled antibodies.

Discussion

In situ, no wash, immunolabelling with intra-alveolar OEM imaging is a novel methodology with the potential to expand the experimental utility of EVLV and pre-clinical models.

FLIM-FRET Investigation of Heterogeneous Huntingtin Aggregation in HeLa Cells

Fluorescence lifetime imaging microscopy-fluorescence resonance energy transfer (FLIM-FRET) technique is a novel tool to study protein-protein interaction combining FRET detection, lifetime measurements, and high-resolution imaging. This chapter describes a FLIM-FRET protocol for the detection and quantification of heterogeneous huntingtin aggregates in HeLa cells co-transfected with huntingtin variants containing polyglutamine tracts of different lengths.

Measurement of focal light spot at single-photon level with silicon photomultipliers

Focal spot (light spot) at single-photon level have important applications in many fields. This report demonstrates a method for measuring focal spot size at the single-photon level indirectly. This method utilizes Silicon Photomultiplier (SiPM) as the single-photon sensitive detectors, combined with a nano-positioning stage. The approach involves one- or two-dimensional space scanning and a deconvolution operation, which enable evaluations of the size and spatial distribution of the focal spot formed by a single-photon-level pulsed laser. The results indicate that the average full width at half maximum of the focal spot is about 0.657 μm, which is close to the nominal resolution of the objective lens of the microscope (i.e. 0.42 μm). The proposed method has two key advantages: (1) it can measure focal spot at the single-photon level, and (2) the focal spot can easily be aligned with the detector because the array area of the Geiger mode avalanche photodiode (Gm-APD) cells in SiPM is usually on the order of square millimeter, and there is no need to put an optical slit, knife edge, or pinhole in front of the detector. The method described herein is applicable in weak focal spot detection related fields.

Penetration Depth of Propylene Glycol, Sodium Fluorescein and Nile Red into the Skin Using Non-Invasive Two-Photon Excited FLIM

The stratum corneum (SC) forms a strong barrier against topical drug delivery. Therefore, understanding the penetration depth and pathways into the SC is important for the efficiency of drug delivery and cosmetic safety. In this study, TPT-FLIM (two-photon tomography combined with fluorescence lifetime imaging) was applied as a non-invasive optical method for the visualization of skin structure and components to study penetration depths of exemplary substances, like hydrophilic propylene glycol (PG), sodium fluorescein (NaFl) and lipophilic Nile red (NR) into porcine ear skin ex vivo. Non-fluorescent PG was detected indirectly based on the pH-dependent increase in the fluorescence lifetime of SC components. The pH similarity between PG and viable epidermis limited the detection of PG. NaFl reached the viable epidermis, which was also proved by laser scanning microscopy. Tape stripping and confocal Raman micro-spectroscopy were performed additionally to study NaFl, which revealed penetration depths of ≈5 and ≈8 μm, respectively. Lastly, NR did not permeate the SC. We concluded that the amplitude-weighted mean fluorescence lifetime is the most appropriate FLIM parameter to build up penetration profiles. This work is anticipated to provide a non-invasive TPT-FLIM method for studying the penetration of topically applied drugs and cosmetics into the skin.

Solution structure of recombinant Pvfp-5β reveals insights into mussel adhesion

Some marine organisms can resist to aqueous tidal environments and adhere tightly on wet surface. This behavior has raised increasing attention for potential applications in medicine, biomaterials, and tissue engineering. In mussels, adhesive forces to the rock are the resultant of proteinic fibrous formations called byssus. We present the solution structure of Pvfp-5β, one of the three byssal plaque proteins secreted by the Asian green mussel Perna viridis, and the component responsible for initiating interactions with the substrate. We demonstrate that Pvfp-5β has a stably folded structure in agreement with the presence in the sequence of two EGF motifs. The structure is highly rigid except for a few residues affected by slow local motions in the µs-ms time scale, and differs from the model calculated by artificial intelligence methods for the relative orientation of the EGF modules, which is something where computational methods still underperform. We also show that Pvfp-5β is able to coacervate even with no DOPA modification, giving thus insights both for understanding the adhesion mechanism of adhesive mussel proteins, and developing of biomaterials.

Management of fluorescent organic/inorganic nanohybrids for biomedical applications in the NIR-II region

Biomedical fluorescence imaging in the second near-infrared (NIR-II, 100-1700 nm) window provides great potential for visualizing physiological and pathological processes, owing to the reduced tissue absorption, scattering, and autofluorescence. Various types of NIR-II probes have been reported in the past decade. Among them, NIR-II organic/inorganic nanohybrids have attracted widespread attention due to their unique properties by integrating the advantages of both organic and inorganic species. Versatile organic/inorganic nanohybrids provide the possibility of realizing a combination of functions, controllable size, and multiple optical features. This tutorial review summarizes the reported organic and inorganic species in nanohybrids, and their biomedical applications in NIR-II fluorescence and lifetime imaging. Finally, the challenges and outlook of organic/inorganic nanohybrids in biomedical applications are discussed.

FRET as the tool for in vivo nanomedicine tracking

Advanced drug delivery system utilizing a nanocarrier is the major application of nanotechnology on pharmacotherapeutics. However, despite the promising benefits and a leading trend in pharmaceutical research, nanomedicine development suffers from a poor clinical translation problem as only a handful of nanomedicine products reach the market yearly. The conventional pharmacokinetic study generally focuses only on monitoring the level of a free drug but ignores the nanocarrier's role in pharmacokinetics. One hurdle is that it is difficult to directly track intact nanocarriers in vivo to explore their pharmacokinetics. Although several imaging techniques such as radiolabeling, nuclear imaging, fluorescence imaging, etc., have been developed over the past few years, currently, one method that can successfully track the intact nanocarriers in vivo directly is by Förster resonance energy transfer (FRET). This review summarizes the application of FRET as the in vivo nanoparticle tracker for studying the in vivo pharmacokinetics of the organic nanocarriers and gives elaborative details on the techniques utilized.

Smart Wide-field Fluorescence Lifetime Imaging System with CMOS Single-photon Avalanche Diode Arrays

Wide-field fluorescence lifetime imaging (FLIM) is a promising technique for biomedical and clinic applications. Integrating with CMOS single-photon avalanche diode (SPAD) sensor arrays can lead to cheaper and portable real-time FLIM systems. However, the FLIM data obtained by such sensor systems often have sophisticated noise features. There is still a lack of fast tools to recover lifetime parameters from highly noise-corrupted fluorescence signals efficiently. This paper proposes a smart wide-field FLIM system containing a 192×128 COMS SPAD sensor and a field-programmable gate array (FPGA) embedded deep learning (DL) FLIM processor. The processor adopts a hardware-friendly and light-weighted neural network for fluorescence lifetime analysis, showing the advantages of high accuracy against noise, fast speed, and low power consumption. Experimental results demonstrate the proposed system's superior and robust performances, promising for many FLIM applications such as FLIM-guided clinical surgeries, cancer diagnosis, and biomedical imaging.

A layer-level multi-scale architecture for lung cancer classification with fluorescence lifetime imaging endomicroscopy

In this paper, we introduce our unique dataset of fluorescence lifetime imaging endo/microscopy (FLIM), containing over 100,000 different FLIM images collected from 18 pairs of cancer/non-cancer human lung tissues of 18 patients by our custom fibre-based FLIM system. The aim of providing this dataset is that more researchers from relevant fields can push forward this particular area of research. Afterwards, we describe the best practice of image post-processing suitable per the dataset. In addition, we propose a novel hierarchically aggregated multi-scale architecture to improve the binary classification performance of classic CNNs. The proposed model integrates the advantages of multi-scale feature extraction at different levels, where layer-wise global information is aggregated with branch-wise local information. We integrate the proposal, namely ResNetZ, into ResNet, and appraise it on the FLIM dataset. Since ResNetZ can be configured with a shortcut connection and the aggregations by Addition or Concatenation, we first evaluate the impact of different configurations on the performance. We thoroughly examine various ResNetZ variants to demonstrate the superiority. We also compare our model with a feature-level multi-scale model to illustrate the advantages and disadvantages of multi-scale architectures at different levels.

Data-Driven Identification of Biomarkers for In Situ Monitoring of Drug Treatment in Bladder Cancer Organoids

Three-dimensional (3D) organoid culture recapitulating patient-specific histopathological and molecular diversity offers great promise for precision medicine in cancer. In this study, we established label-free imaging procedures, including Raman microspectroscopy (RMS) and fluorescence lifetime imaging microscopy (FLIM), for in situ cellular analysis and metabolic monitoring of drug treatment efficacy. Primary tumor and urine specimens were utilized to generate bladder cancer organoids, which were further treated with various concentrations of pharmaceutical agents relevant for the treatment of bladder cancer (i.e., cisplatin, venetoclax). Direct cellular response upon drug treatment was monitored by RMS. Raman spectra of treated and untreated bladder cancer organoids were compared using multivariate data analysis to monitor the impact of drugs on subcellular structures such as nuclei and mitochondria based on shifts and intensity changes of specific molecular vibrations. The effects of different drugs on cell metabolism were assessed by the local autofluorophore environment of NADH and FAD, determined by multiexponential fitting of lifetime decays. Data-driven neural network and data validation analyses (k-means clustering) were performed to retrieve additional and non-biased biomarkers for the classification of drug-specific responsiveness. Together, FLIM and RMS allowed for non-invasive and molecular-sensitive monitoring of tumor-drug interactions, providing the potential to determine and optimize patient-specific treatment efficacy.

Environmentally sensitive fluorescent nucleoside analogues as probes for nucleic acid - protein interactions: molecular design and biosensing applications

Fluorescent nucleoside analogues (FNAs) are indispensable in studying the interactions of nucleic acids with nucleic acid-binding proteins. By replacing one of the poorly emissive natural nucleosides, FNAs enable real-time optical monitoring of the binding interactions in solutions, under physiologically relevant conditions, with high sensitivity. Besides that, FNAs are widely used to probe conformational dynamics of biomolecular complexes using time-resolved fluorescence methods. Because of that, FNAs are tools of high utility for fundamental biological research, with potential applications in molecular diagnostics and drug discovery. Here I review the structural and physical factors that can be used for the conversion of the molecular binding events into a detectable fluorescence output. Typical environmentally sensitive FNAs, their properties and applications, and future challenges in the field are discussed.

Spatial resolution improved fluorescence lifetime imaging via deep learning

We present a deep learning approach to obtain high-resolution (HR) fluorescence lifetime images from low-resolution (LR) images acquired from fluorescence lifetime imaging (FLIM) systems. We first proposed a theoretical method for training neural networks to generate massive semi-synthetic FLIM data with various cellular morphologies, a sizeable dynamic lifetime range, and complex decay components. We then developed a degrading model to obtain LR-HR pairs and created a hybrid neural network, the spatial resolution improved FLIM net (SRI-FLIMnet) to simultaneously estimate fluorescence lifetimes and realize the nonlinear transformation from LR to HR images. The evaluative results demonstrate SRI-FLIMnet's superior performance in reconstructing spatial information from limited pixel resolution. We also verified SRI-FLIMnet using experimental images of bacterial infected mouse raw macrophage cells. Results show that the proposed data generation method and SRI-FLIMnet efficiently achieve superior spatial resolution for FLIM applications. Our study provides a solution for fast obtaining HR FLIM images.

A near-infrared plasma membrane-specific AIE probe for fluorescence lifetime imaging of phagocytosis

Phagocytosis is a biological process that plays a key role in host defense and tissue homeostasis. Efficient approaches for realtime imaging of phagocytosis are highly desired but limited. Herein, an AIE-active near-infrared fluorescent probe, named TBTCP, was developed for fluorescence lifetime imaging of phagocytosis. TBTCP could selectively label the cell plasma membrane with fast staining, wash-free process, high signal-to-background ratio, and excellent photostability. Cellular membrane statuses under different osmolarities as well as macrophage phagocytosis of bacteria or large silica particles in early stages could be reported by the fluorescence lifetime changes of TBTCP. Compared with current fluorescence imaging methods, which target the bioenvironmental changes in the late phagocytosis stage, this approach detects the changes in the cell membrane, thus giving a faster response to phagocytosis. This article provides a functional tool to report the phagocytic dynamics of macrophages which may greatly contribute to the studies of phagocytic function-related diseases.

High Resolution Fluorescence Lifetime Maps from Minimal Photon Counts

Fluorescence lifetime imaging microscopy (FLIM) may reveal subcellular spatial lifetime maps of key molecular species. Yet, such a quantitative picture of life necessarily demands high photon budgets at every pixel under the current analysis paradigm, thereby increasing acquisition time and photodamage to the sample. Motivated by recent developments in computational statistics, we provide a direct means to update our knowledge of the lifetime maps of species of different lifetimes from direct photon arrivals, while accounting for experimental features such as arbitrary forms of the instrument response function (IRF) and exploiting information from empty laser pulses not resulting in photon detection. Our ability to construct lifetime maps holds for arbitrary lifetimes, from short lifetimes (comparable to the IRF) to lifetimes exceeding interpulse times. As our method is highly data efficient, for the same amount of data normally used to determine lifetimes and photon ratios, working within the Bayesian paradigm, we report direct blind unmixing of lifetimes with subnanosecond resolution and subpixel spatial resolution using standard raster scan FLIM images. We demonstrate our method using a wide range of simulated and experimental data.

A Novel Quantum Dot-Based pH Probe for Long-Term Fluorescence Lifetime Imaging Microscopy Experiments in Living Cells

The use of two nanoparticles for quantitative pH measurements in live cells by means of fluorescence lifetime imaging microscopy (FLIM) is investigated here. These nanoparticles are based on CdSe/ZnS quantum dots (QDs), functionalized with N-acetylcysteine (CdSe/ZnS-A) and with a small peptide containing D-penicillamine and histidine (CdSe/ZnS-PH). CdSe/ZnS-A has tendency to aggregate and nonlinear pH sensitivity in a complex medium containing salts and macromolecules. On the contrary, CdSe/ZnS-PH shows chemical stability, low toxicity, efficient uptake in C3H10T1/2 cells, and good performance as an FLIM probe. CdSe/ZnS-PH also has key advantages over a recently reported probe based on a CdSe/ZnS QD functionalized with D-penicillamine (longer lifetimes and higher pH-sensitivity). A pH(±2σ) of 6.97 ± 0.14 was determined for C3H10T1/2 cells by FLIM employing this nanoprobe. In addition, the fluorescence lifetime signal remains nearly constant for C3H10T1/2 cells treated with CdSe/ZnS-PH for 24 h. These results show the promising applications of this nanoprobe to monitor the intracellular pH and cell state employing the FLIM technique.

Generative adversarial network enables rapid and robust fluorescence lifetime image analysis in live cells

Fluorescence lifetime imaging microscopy (FLIM) is a powerful tool to quantify molecular compositions and study molecular states in complex cellular environment as the lifetime readings are not biased by fluorophore concentration or excitation power. However, the current methods to generate FLIM images are either computationally intensive or unreliable when the number of photons acquired at each pixel is low. Here we introduce a new deep learning-based method termed flimGANE (fluorescence lifetime imaging based on Generative Adversarial Network Estimation) that can rapidly generate accurate and high-quality FLIM images even in the photon-starved conditions. We demonstrated our model is up to 2,800 times faster than the gold standard time-domain maximum likelihood estimation (TD_MLE) and that flimGANE provides a more accurate analysis of low-photon-count histograms in barcode identification, cellular structure visualization, Förster resonance energy transfer characterization, and metabolic state analysis in live cells. With its advantages in speed and reliability, flimGANE is particularly useful in fundamental biological research and clinical applications, where high-speed analysis is critical.

Above pile-up fluorescence microscopy with a 32 Mc/s single-channel time-resolved SPAD system

One of the major drawbacks of time-correlated single-photon counting (TCSPC) is generally represented by pile-up distortion, which strongly bounds the maximum acquisition speed to a few percent of the laser excitation rate. Based on a previous theoretical analysis, recently we presented the first, to the best of our knowledge, low-distortion and high-speed TCSPC system capable of overcoming the pile-up limitation by perfectly matching the single-photon avalanche diode (SPAD) dead time to the laser period. In this work, we validate the proposed system in a standard fluorescence measurement by comparing experimental data with the reference theoretical framework. As a result, a count rate of 32 Mc/s was achieved with a single-channel system still observing a negligible lifetime distortion.

High-resolution fluorescence-guided transcranial ultrasound mapping in the live mouse brain

Understanding the physiological impact of transcranial ultrasound in rodent brains may offer an important preclinical model for human scale magnetic resonance–guided focused ultrasound methods. However, precision tools for high-resolution transcranial ultrasound targeting and real-time in vivo tracking of its effects at the mouse brain scale are currently lacking. We report a versatile bidirectional hybrid fluorescence-ultrasound (FLUS) system incorporating a 0.35-mm precision spherical-phased array ultrasound emission with a fiberscope-based wide-field fluorescence imaging. We show how the marriage between cortex-wide functional imaging and targeted ultrasound delivery can be used to transcranially map previously undocumented localized fluorescence events caused by reversible thermal processes and perform high-speed large-scale recording of neural activity induced by focused ultrasound. FLUS thus naturally harnesses the extensive toolbox of fluorescent tags and ultrasound’s localized bioeffects toward visualizing and causally perturbing a plethora of normal and pathophysiological processes in the living murine brain.

Improved temporal contrast of streak camera measurements with periodic shadowing

Periodic shadowing, a concept used in spectroscopy for stray light reduction, has been implemented to improve the temporal contrast of streak camera imaging. The capabilities of this technique are first proven by imaging elastically scattered picosecond laser pulses and are further applied to fluorescence lifetime imaging, where more accurate descriptions of fluorescence decay curves were observed. This all-optical approach can be adapted to various streak camera imaging systems, resulting in a robust technique to minimize space-charge induced temporal dispersion in streak cameras while maintaining temporal coverage and spatial information.

Single-photon peak event detection (SPEED): a computational method for fast photon counting in fluorescence lifetime imaging microscopy

Fluorescence lifetime imaging microscopy (FLIM) characterizes samples by examining the temporal properties of fluorescence emission, providing useful contrast within samples based on the local physical and biochemical environment of fluorophores. Despite this, FLIM applications have been limited in scope by either poor accuracy or long acquisition times. Here, we present a method for computational single-photon counting of directly sampled time-domain FLIM data that is capable of accurate fluorescence lifetime and intensity measurements while acquiring over 160 Mega-counts-per-second with sub-nanosecond time resolution between consecutive photon counts. We demonstrate that our novel method of Single-photon PEak Event Detection (SPEED) is more accurate than direct pulse sampling and faster than established photon counting FLIM methods. We further show that SPEED can be implemented for imaging and quantifying samples that benefit from higher -throughput and -dynamic range imaging with real-time GPU-accelerated processing and use this capability to examine the NAD(P)H-related metabolic dynamics of apoptosis in human breast cancer cells. Computational methods for photon counting such as SPEED open up more opportunities for fast and accurate FLIM imaging and additionally provide a basis for future innovation into alternative FLIM techniques.

Fast wide-field upconversion luminescence lifetime thermometry enabled by single-shot compressed ultrahigh-speed imaging

Photoluminescence lifetime imaging of upconverting nanoparticles is increasingly featured in recent progress in optical thermometry. Despite remarkable advances in photoluminescent temperature indicators, existing optical instruments lack the ability of wide-field photoluminescence lifetime imaging in real time, thus falling short in dynamic temperature mapping. Here, we report video-rate upconversion temperature sensing in wide field using single-shot photoluminescence lifetime imaging thermometry (SPLIT). Developed from a compressed-sensing ultrahigh-speed imaging paradigm, SPLIT first records wide-field luminescence intensity decay compressively in two views in a single exposure. Then, an algorithm, built upon the plug-and-play alternating direction method of multipliers, is used to reconstruct the video, from which the extracted lifetime distribution is converted to a temperature map. Using the core/shell NaGdF4:Er3+,Yb3+/NaGdF4 upconverting nanoparticles as the lifetime-based temperature indicators, we apply SPLIT in longitudinal wide-field temperature monitoring beneath a thin scattering medium. SPLIT also enables video-rate temperature mapping of a moving biological sample at single-cell resolution.

Multi-Scale Aggregated-Dilation Network for ex-vivo Lung Cancer Detection with Fluorescence Lifetime Imaging Endomicroscopy

Multi-scale architectures at a granular level are characterised by separating input features into groups and applying multi-scale feature extractions to the split input features, and thus the correlations among the input features as global information are no longer retained. Moreover, they usually require more input features due to the separation, and therefore, more complexity is introduced. To retain the global information while utilising the advantages of feature-level hierarchical multi-scale architectures, we propose a multi-scale aggregated-dilation architecture (MSAD) to perform hierarchical fusion of features at a layer level, with the integration of dilated convolutions to overcome these issues. To evaluate the model, we integrate it into ResNet, and apply it to a unique dataset, containing over 60,000 fluorescence lifetime endomicroscopic images (FLIM) collected on ex-vivo lung normal/cancerous tissues from 14 patients, by a custom fibre-based FLIM system. To evaluate the performance of our proposal, we use accuracy, precision, recall, and AUC. We first compare our MSAD model with eight networks achieving a superiority over 6%. To illustrate the advantages and disadvantages of multi-scale architectures at layer and feature-level, we thoroughly compare our MSAD model with the state-of-the-art feature-level multiscale network, namely Res2Net, in terms of parameters, scales, and effective convolutions.

Antioxidant assessment of agricultural produce using fluorescence techniques: a review

The study of bioactive compounds like food antioxidants is getting huge attention and curiosity by researchers and other relevant stakeholders (e.g., food and pharmaceutical industries) due to their health benefits. However, the currently available protocols to estimate the antioxidant activity of foods are time-consuming, destructive, require complex procedures for sample preparation, need technical persons, and not possible for real-time application, which are very important for large-scale or industrial applications. On the other hand, fluorescence spectroscopy and imaging techniques are relatively new, fast, mostly nondestructive, and possible to apply real-time to detect the antioxidants of foods. However, there is no review article on fluorescence techniques for estimating antioxidants in agricultural produces. Therefore, the present review comprehensively summarizes the overview of fluorescence phenomena, techniques (i.e., spectroscopy and computer vision), and their potential to monitor antioxidants in fruits and vegetables. Finally, opportunities and challenges of fluorescence techniques are described toward developing next-generation protocols for antioxidants measurement. Fluorescence techniques (both spectroscopy and imaging) are simpler and faster than available traditional methods of antioxidants measurement. Moreover, the fluorescence imaging technique has the potential to apply in real-time antioxidant identification in agricultural produce such as fruits and vegetables. Therefore, this technique might be used as a next-generation protocol for qualitative and quantitative antioxidants measurement after improvements like new material technologies for sensor (detector) and light sources for higher sensitivity and reduce the cost of implementing real-world applications.