High-speed imaging of transient metabolic dynamics using two-photon fluorescence lifetime imaging microscopy

From Cell Populations to Molecular Complexes: Multiplexed Multimodal Microscopy to Explore p53-53BP1 Molecular Interaction

Surpassing the diffraction barrier revolutionized modern fluorescence microscopy. However, intrinsic limitations in statistical sampling, the number of simultaneously analyzable channels, hardware requirements, and sample preparation procedures still represent an obstacle to its widespread diffusion in applicative biomedical research. Here, we present a novel pipeline based on automated multimodal microscopy and super-resolution techniques employing easily available materials and instruments and completed with open-source image-analysis software developed in our laboratory. The results show the potential impact of single-molecule localization microscopy (SMLM) on the study of biomolecules' interactions and the localization of macromolecular complexes. As a demonstrative application, we explored the basis of p53-53BP1 interactions, showing the formation of a putative macromolecular complex between the two proteins and the basal transcription machinery in situ, thus providing visual proof of the direct role of 53BP1 in sustaining p53 transactivation function. Moreover, high-content SMLM provided evidence of the presence of a 53BP1 complex on the cell cytoskeleton and in the mitochondrial space, thus suggesting the existence of novel alternative 53BP1 functions to support p53 activity.

Analog multiplexing of a laser clock and computational photon counting for fast fluorescence lifetime imaging microscopy

The dynamic range and fluctuations of fluorescence intensities and lifetimes in biological samples are large, demanding fast, precise, and versatile techniques. Among the high-speed fluorescence lifetime imaging microscopy (FLIM) techniques, directly sampling the output of analog single-photon detectors at GHz rates combined with computational photon counting can handle a larger range of photon rates. Traditionally, the laser clock is not sampled explicitly in fast FLIM; rather the detection is synchronized to the laser clock so that the excitation pulse train can be inferred from the cumulative photon statistics of several pixels. This has two disadvantages for sparse or weakly fluorescent samples: inconsistencies in inferring the laser clock within a frame and inaccuracies in aligning the decay curves from different frames for averaging. The data throughput is also very inefficient in systems with repetition rates much larger than the fluorescence lifetime due to significant silent regions where no photons are expected. We present a method for registering the photon arrival times to the excitation using time-domain multiplexing for fast FLIM. The laser clock is multiplexed with photocurrents into the silent region. Our technique does not add to the existing data bottleneck, has the sub-nanosecond dead time of computational photon counting based fast FLIM, works with various detectors, lasers, and electronics, and eliminates the errors in lifetime estimation in photon-starved conditions. We demonstrate this concept on two multiphoton setups of different laser repetition rates for single and multichannel FLIM multiplexed into a single digitizer channel for real-time imaging of biological samples.

Supercontinuum intrinsic fluorescence imaging heralds free view of living systems

Optimal imaging strategies remain underdeveloped to maximize information for fluorescence microscopy while minimizing the harm to fragile living systems. Taking hint from the supercontinuum generation in ultrafast laser physics, we generated supercontinuum fluorescence from untreated unlabeled live samples before nonlinear photodamage onset. Our imaging achieved high-content cell phenotyping and tissue histology, identified bovine embryo polarization, quantified aging-related stress across cell types and species, demystified embryogenesis before and after implantation, sensed drug cytotoxicity in real-time, scanned brain area for targeted patching, optimized machine learning to track small moving organisms, induced two-photon phototropism of leaf chloroplasts under two-photon photosynthesis, unraveled microscopic origin of autumn colors, and interrogated intestinal microbiome. The results enable a facility-type microscope to freely explore vital molecular biology across life sciences.

Large Fluorescence Enhancement via Lossless All-Dielectric Spherical Mesocavities

Nano- and microparticles are popular media to enhance optical signals, including fluorescence from a dye proximal to the particle. Here we show that homogeneous, lossless, all-dielectric spheres with diameters in the mesoscale range, between nano- (≲100 nm) and micro- (≳1 μm) scales, can offer surprisingly large fluorescence enhancements, up to F ∼ 104. With the absence of nonradiative Ohmic losses inherent to plasmonic particles, we show that F can increase, decrease or even stay the same with increasing intrinsic quantum yield q0, for suppressed, enhanced or intact radiative decay rates of a fluorophore, respectively. Further, the fluorophore may be located inside or outside the particle, providing additional flexibility and opportunities to design fit for purpose particles. The presented analysis with simple dielectric spheres should spur further interest in this less-explored scale of particles and experimental investigations to realize their potential for applications in imaging, molecular sensing, light coupling, and quantum information processing.

Fluorescence Lifetime Measurements and Analyses: Protocols Using Flow Cytometry and High-Throughput Microscopy

This chapter focuses on applications and protocols that involve the measurement of the fluorescence lifetime as an informative cytometric parameter. The timing of fluorescence decay has been well-studied for cell counting, sorting, and imaging. Therefore, provided herein is an overview of the techniques used, how they enhance cytometry protocols, and the modern techniques used for lifetime analysis. The background and theory behind fluorescence decay kinetic measurements in cells is first discussed followed by the history of the development of time-resolved flow cytometry. These sections are followed by a review of applications that benefit from the quantitative nature of fluorescence lifetimes as a photophysical trait. Lastly, perspectives on the modern ways in which the fluorescence lifetime is scanned at high throughputs which include high-speed microscopy and machine learning are provided.

Label-free biomedical optical imaging

Label-free optical imaging employs natural and nondestructive approaches for the visualisation of biomedical samples for both biological assays and clinical diagnosis. Currently, this field revolves around multiple broad technology-oriented communities, each with a specific focus on a particular modality despite the existence of shared challenges and applications. As a result, biologists or clinical researchers who require label-free imaging are often not aware of the most appropriate modality to use. This manuscript presents a comprehensive review of and comparison among different label-free imaging modalities and discusses common challenges and applications. We expect this review to facilitate collaborative interactions between imaging communities, push the field forward and foster technological advancements, biophysical discoveries, as well as clinical detection, diagnosis, and monitoring of disease.

Near-Infrared Fluorescence Imaging in Preclinical Models of Glioblastoma

Cancer is a public health problem requiring ongoing research to improve current treatments and discover novel therapies. More accurate imaging would facilitate such research. Near-infrared fluorescence has been developed as a non-invasive imaging technique capable of visualizing and measuring biological processes at the molecular level in living subjects. In this work, we evaluate the tumor activity in two preclinical glioblastoma models by using fluorochrome (IRDye 800CW) coupled to different molecules: tripeptide Arg-Gly-Asp (RGD), 2-amino-2-deoxy-D-glucose (2-DG), and polyethylene glycol (PEG). These molecules interact with pathological conditions of tumors, including their overexpression of αvβ3 integrins (RGD), elevated glucose uptake (2-DG), and enhanced permeability and retention effect (PEG). IRDye 800CW RGD gave the best in vivo fluorescence signal from the tumor area, which contrasted well with the low fluorescence intensity of healthy tissue. In the ex vivo imaging (dissected tumor), the accumulation of IRDye 800CW RGD could be appreciated at the tumor site. Glioblastoma tumors were presently detected with specificity and sensitivity by utilizing IRDye 800CW RGD, a near-infrared fluorophore combined with a marker of αvβ3 integrin expression. Further research is needed on its capacity to monitor tumor growth in glioblastoma after chemotherapy.

In vivo label-free optical signatures of chemotherapy response in human pancreatic ductal adenocarcinoma patient-derived xenografts

Pancreatic cancer is a devastating disease often detected at later stages, necessitating swift and effective chemotherapy treatment. However, chemoresistance is common and its mechanisms are poorly understood. Here, label-free multi-modal nonlinear optical microscopy was applied to study microstructural and functional features of pancreatic tumors in vivo to monitor inter- and intra-tumor heterogeneity and treatment response. Patient-derived xenografts with human pancreatic ductal adenocarcinoma were implanted into mice and characterized over five weeks of intraperitoneal chemotherapy (FIRINOX or Gem/NabP) with known responsiveness/resistance. Resistant and responsive tumors exhibited a similar initial metabolic response, but by week 5 the resistant tumor deviated significantly from the responsive tumor, indicating that a representative response may take up to five weeks to appear. This biphasic metabolic response in a chemoresistant tumor reveals the possibility of intra-tumor spatiotemporal heterogeneity of drug responsiveness. These results, though limited by small sample size, suggest the possibility for further work characterizing chemoresistance mechanisms using nonlinear optical microscopy.

A deep learning-based stripe self-correction method for stitched microscopic images

Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correction method, so-called SSCOR. Specifically, we propose a proximity sampling scheme and adversarial reciprocal self-training paradigm that enable SSCOR to utilize stripe-free patches sampled from the stitched microscope image itself to correct their adjacent stripe patches. Comparing to off-the-shelf approaches, SSCOR can not only adaptively correct non-uniform, oblique, and grid stripes, but also remove scanning, bubble, and out-of-focus artifacts, achieving the state-of-the-art performance across different imaging conditions and modalities. Moreover, SSCOR does not require any physical parameter estimation, patch-wise manual annotation, or raw stitched information in the correction process. This provides an intelligent prior-free image restoration solution for microscopists or even microscope companies, thus ensuring more precise biomedical applications for researchers.

SNR enhanced high-speed two-photon microscopy using a pulse picker and time gating detection

Two-photon microscopy (TPM) is an attractive biomedical imaging method due to its large penetration depth and optical sectioning capability. In particular, label-free autofluorescence imaging offers various advantages for imaging biological samples. However, relatively low intensity of autofluorescence leads to low signal-to-noise ratio (SNR), causing practical challenges for imaging biological samples. In this study, we present TPM using a pulse picker to utilize low pulse repetition rate of femtosecond pulsed laser to increase the pulse peak power of the excitation source leading to higher emission of two-photon fluorescence with the same average illumination power. Stronger autofluorescence emission allowed us to obtain higher SNR images of arterial and liver tissues. In addition, by applying the time gating detection method to the pulse signals obtained by TPM, we were able to significantly reduce the background noise of two-photon images. As a result, our TPM system using the pulsed light source with a 19 times lower repetition rate allowed us to obtain the same SNR image more than 19 times faster with the same average power. Although high pulse energy can increase the photobleaching, we also observed that high-speed imaging with low total illumination energy can mitigate the photobleaching effect to a level similar to that of conventional illumination with a high repetition rate. We anticipate that this simple approach will provide guidance for SNR enhancement with high-speed imaging in TPM as well as other nonlinear microscopy.

Fluorescence lifetime tracking and imaging of single moving particles assisted by a low-photon-count analysis algorithm

Fluorescence lifetime imaging microscopy (FLIM) has been widely used in the field of biological research because of its high specificity, sensitivity, and quantitative ability in the sensing cellular microenvironment. The most commonly used FLIM technology is based on time-correlated single photon counting (TCSPC). Although the TCSPC method has the highest temporal resolution, the data acquisition time is usually long, and the imaging speed is slow. In this work, we proposed a fast FLIM technology for fluorescence lifetime tracking and imaging of single moving particles, named single particle tracking FLIM (SPT-FLIM). We used feedback-controlled addressing scanning and Mosaic FLIM mode imaging to reduce the number of scanned pixels and the data readout time, respectively. Moreover, we developed a compressed sensing analysis algorithm based on alternating descent conditional gradient (ADCG) for low-photon-count data. We applied the ADCG-FLIM algorithm on both simulated and experimental datasets to evaluate its performance. The results showed that ADCG-FLIM could achieve reliable lifetime estimation with high accuracy and precision in the case of a photon count less than 100. By reducing the photon count requirement for each pixel from, typically, 1000 to 100, the acquisition time for a single frame lifetime image could be significantly shortened, and the imaging speed could be improved to a great extent. On this basis, we obtained lifetime trajectories of moving fluorescent beads using the SPT-FLIM technique. Overall, our work offers a powerful tool for fluorescence lifetime tracking and imaging of single moving particles, which will promote the application of TCSPC-FLIM in biological research.

Single cell metabolic imaging of tumor and immune cells in vivo in melanoma bearing mice

Introduction

Metabolic reprogramming of cancer and immune cells occurs during tumorigenesis and has a significant impact on cancer progression. Unfortunately, current techniques to measure tumor and immune cell metabolism require sample destruction and/or cell isolations that remove the spatial context. Two-photon fluorescence lifetime imaging microscopy (FLIM) of the autofluorescent metabolic coenzymes nicotinamide adenine dinucleotide (phosphate) (NAD(P)H) and flavin adenine dinucleotide (FAD) provides in vivo images of cell metabolism at a single cell level.

Methods

Here, we report an immunocompetent mCherry reporter mouse model for immune cells that express CD4 either during differentiation or CD4 and/or CD8 in their mature state and perform in vivo imaging of immune and cancer cells within a syngeneic B78 melanoma model. We also report an algorithm for single cell segmentation of mCherry-expressing immune cells within in vivo images.

Results

We found that immune cells within B78 tumors exhibited decreased FAD mean lifetime and an increased proportion of bound FAD compared to immune cells within spleens. Tumor infiltrating immune cell size also increased compared to immune cells from spleens. These changes are consistent with a shift towards increased activation and proliferation in tumor infiltrating immune cells compared to immune cells from spleens. Tumor infiltrating immune cells exhibited increased FAD mean lifetime and increased protein-bound FAD lifetime compared to B78 tumor cells within the same tumor. Single cell metabolic heterogeneity was observed in both immune and tumor cells in vivo.

Discussion

This approach can be used to monitor single cell metabolic heterogeneity in tumor cells and immune cells to study promising treatments for cancer in the native in vivo context.

Visualizing the Nucleome Using the CRISPR–Cas9 System: From in vitro to in vivo

One of the latest methods in modern molecular biology is labeling genomic loci in living cells using fluorescently labeled Cas protein. The NIH Foundation has made the mapping of the 4D nucleome (the three-dimensional nucleome on a timescale) a priority in the studies aimed to improve our understanding of chromatin organization. Fluorescent methods based on CRISPR-Cas are a significant step forward in visualization of genomic loci in living cells. This approach can be used for studying epigenetics, cell cycle, cellular response to external stimuli, rearrangements during malignant cell transformation, such as chromosomal translocations or damage, as well as for genome editing. In this review, we focused on the application of CRISPR-Cas fluorescence technologies as components of multimodal imaging methods for in vivo mapping of chromosomal loci, in particular, attribution of fluorescence signal to morphological and anatomical structures in a living organism. The review discusses the approaches to the highly sensitive, high-precision labeling of CRISPR-Cas components, delivery of genetically engineered constructs into cells and tissues, and promising methods for molecular imaging.

Computational Photon Counting Using Multithreshold Peak Detection for Fast Fluorescence Lifetime Imaging Microscopy

Time-resolved photon counting methods have a finite bandwidth that restricts the acquisition speed of techniques like fluorescence lifetime imaging microscopy (FLIM). To enable faster imaging, computational methods can be employed to count photons when the output of a detector is directly digitized at a high sampling rate. Here, we present computational photon counting using a hybrid photodetector in conjunction with multithreshold peak detection to count instances where one or more photons arrive at the detector within the detector response time. This method can be used to distinguish up to five photon counts per digitized point, whereas previous demonstrations of computational photon counting on data acquired with photomultiplier tubes have only counted one photon at a time. We demonstrate in both freely moving C. elegans and a human breast cancer cell line undergoing apoptosis that this novel multithreshold peak detection method can accurately characterize the intensity and fluorescence lifetime of samples producing photon rates up to 223%, higher than previously demonstrated photon counting FLIM systems.

Receptor for activated C kinase 1 promotes cervical cancer lymph node metastasis via the glycolysis‑dependent AKT/mTOR signaling

Cervical cancer (CC), an aggressive form of squamous cell carcinoma, is characterized by early-stage lymph node metastasis and an extremely poor prognosis. The authors have previously demonstrated that patients with CC have aberrant glycolysis. The upregulation of receptor for activated C kinase 1 (RACK1) is associated with CC lymph node metastasis (LNM). However, its role in mediating aerobic glycolysis in CC LNM remains unclear. In the present study, ¹H nuclear magnetic resonance analysis revealed a significant association between RACK1 expression and the glycolysis/gluconeogenesis pathway. Additionally, RACK1 knockdown inhibited aerobic glycolysis and lymphangiogenesis in vitro and suppressed CC LNM in vivo. Furthermore, protein kinase B (AKT)/mammalian target of rapamycin (mTOR) signaling was identified as a critical RACK1-regulated pathway that increased lymphangiogenesis in CC. Co-immunoprecipitation, immunofluorescence and western blot analysis revealed that RACK1 activated AKT/mTOR signaling by interacting with insulin-like growth factor 1 receptor (IGF1R). POU class 2 homeobox 2 (POU2F2) bound to the RACK1 promoter and regulated its transcription, thereby functionally contributing to glycolysis and lymphangiogenesis in CC. Of note, the admin-istration of 2-deoxy-D-glucose, which attenuates glycolysis, inhibited RACK1-induced lymphangiogenesis in CC. The correlations between RACK1, IGF1R, POU2F2 and hexokinase 2 were further confirmed in CC tissues. Thus, RACK1 plays a crucial role in CC tumor LNM by regulating glycolysis via IGF1R/AKT/mTOR signaling. Thus, the targeting of the POU2F2/RACK1/IGF1R/AKT/mTOR signaling pathway may provide a novel treatment strategy for CC.

Label-free metabolic and structural profiling of dynamic biological samples using multimodal optical microscopy with sensorless adaptive optics

Label-free optical microscopy has matured as a noninvasive tool for biological imaging; yet, it is criticized for its lack of specificity, slow acquisition and processing times, and weak and noisy optical signals that lead to inaccuracies in quantification. We introduce FOCALS (Fast Optical Coherence, Autofluorescence Lifetime imaging, and Second harmonic generation) microscopy capable of generating NAD(P)H fluorescence lifetime, second harmonic generation (SHG), and polarization-sensitive optical coherence microscopy (OCM) images simultaneously. Multimodal imaging generates quantitative metabolic and morphological profiles of biological samples in vitro, ex vivo, and in vivo. Fast analog detection of fluorescence lifetime and real-time processing on a graphical processing unit enables longitudinal imaging of biological dynamics. We detail the effect of optical aberrations on the accuracy of FLIM beyond the context of undistorting image features. To compensate for the sample-induced aberrations, we implemented a closed-loop single-shot sensorless adaptive optics solution, which uses computational adaptive optics of OCM for wavefront estimation within 2 s and improves the quality of quantitative fluorescence imaging in thick tissues. Multimodal imaging with complementary contrasts improves the specificity and enables multidimensional quantification of the optical signatures in vitro, ex vivo, and in vivo, fast acquisition and real-time processing improve imaging speed by 4-40 × while maintaining enough signal for quantitative nonlinear microscopy, and adaptive optics improves the overall versatility, which enable FOCALS microscopy to overcome the limits of traditional label-free imaging techniques.

Intravital two-photon imaging and quantification of hepatic steatosis and fibrosis in a live small animal model

Nonalcoholic fatty liver disease (NAFLD) is one of the most common chronic liver diseases closely associated with the metabolic system, including obesity and type 2 diabetes. The progression of NAFLD with advanced fibrosis is associated with an increased risk of liver cirrhosis and cancer as well as various extra-hepatic diseases. Yet, the underlying mechanism is not fully understood partly due to the absence of effective high-resolution in vivo imaging methods and the appropriate animal models recapitulating the pathology of NAFLD. To improve our understanding about complex pathophysiology of NAFLD, the need for an advanced imaging methodology to visualize and quantify subcellular-level features of NAFLD in vivo over time is ever-increasing. In this study, we established an advanced in vivo two-photon imaging technique to visualize and quantify subcellular-level pathological features of NAFLD in a live mouse animal developing hepatic steatosis, fibrosis, and disrupted microvasculature.

Single-photon peak event detection (SPEED): a computational method for fast photon counting in fluorescence lifetime imaging microscopy

Fluorescence lifetime imaging microscopy (FLIM) characterizes samples by examining the temporal properties of fluorescence emission, providing useful contrast within samples based on the local physical and biochemical environment of fluorophores. Despite this, FLIM applications have been limited in scope by either poor accuracy or long acquisition times. Here, we present a method for computational single-photon counting of directly sampled time-domain FLIM data that is capable of accurate fluorescence lifetime and intensity measurements while acquiring over 160 Mega-counts-per-second with sub-nanosecond time resolution between consecutive photon counts. We demonstrate that our novel method of Single-photon PEak Event Detection (SPEED) is more accurate than direct pulse sampling and faster than established photon counting FLIM methods. We further show that SPEED can be implemented for imaging and quantifying samples that benefit from higher -throughput and -dynamic range imaging with real-time GPU-accelerated processing and use this capability to examine the NAD(P)H-related metabolic dynamics of apoptosis in human breast cancer cells. Computational methods for photon counting such as SPEED open up more opportunities for fast and accurate FLIM imaging and additionally provide a basis for future innovation into alternative FLIM techniques.

Real-time pixelwise phasor analysis for video-rate two-photon fluorescence lifetime imaging microscopy

Two-photon fluorescence lifetime imaging microscopy (FLIM) is a widely used technique in biomedical optical imaging. Presently, many two-photon time-domain FLIM setups are limited by long acquisition and postprocessing times that decrease data throughput and inhibit the ability to image fast sub-second processes. Here, we present a versatile two-photon FLIM setup capable of video-rate (up to 25 fps) imaging with graphics processing unit (GPU)-accelerated pixelwise phasor analysis displayed and saved simultaneously with acquisition. The system uses an analog output photomultiplier tube in conjunction with 12-bit digitization at 3.2 GHz to overcome the limited maximum acceptable photon rate associated with the photon counting electronics in many FLIM systems. This allows for higher throughput FLIM acquisition and analysis, and additionally enables the user to assess sample fluorescence lifetime in real-time. We further explore the capabilities of the system to examine the kinetics of Rhodamine B uptake by human breast cancer cells and characterize the effect of pixel dwell time on the reduced nicotinamide adenine dinucleotide and reduced nicotinamide adenine dinucleotide phosphate (NAD(P)H) autofluorescence lifetime estimation accuracy.

FLIM as a Promising Tool for Cancer Diagnosis and Treatment Monitoring

Fluorescence lifetime imaging microscopy (FLIM) has been rapidly developed over the past 30 years and widely applied in biomedical engineering. Recent progress in fluorophore-dyed probe design has widened the application prospects of fluorescence. Because fluorescence lifetime is sensitive to microenvironments and molecule alterations, FLIM is promising for the detection of pathological conditions. Current cancer-related FLIM applications can be divided into three main categories: (i) FLIM with autofluorescence molecules in or out of a cell, especially with reduced form of nicotinamide adenine dinucleotide, and flavin adenine dinucleotide for cellular metabolism research; (ii) FLIM with Förster resonance energy transfer for monitoring protein interactions; and (iii) FLIM with fluorophore-dyed probes for specific aberration detection. Advancements in nanomaterial production and efficient calculation systems, as well as novel cancer biomarker discoveries, have promoted FLIM optimization, offering more opportunities for medical research and applications to cancer diagnosis and treatment monitoring. This review summarizes cutting-edge researches from 2015 to 2020 on cancer-related FLIM applications and the potential of FLIM for future cancer diagnosis methods and anti-cancer therapy development. We also highlight current challenges and provide perspectives for further investigation.

High-speed compressed-sensing fluorescence lifetime imaging microscopy of live cells

We present high-resolution, high-speed fluorescence lifetime imaging microscopy (FLIM) of live cells based on a compressed sensing scheme. By leveraging the compressibility of biological scenes in a specific domain, we simultaneously record the time-lapse fluorescence decay upon pulsed laser excitation within a large field of view. The resultant system, referred to as compressed FLIM, can acquire a widefield fluorescence lifetime image within a single camera exposure, eliminating the motion artifact and minimizing the photobleaching and phototoxicity. The imaging speed, limited only by the readout speed of the camera, is up to 100 Hz. We demonstrated the utility of compressed FLIM in imaging various transient dynamics at the microscopic scale.

Time-domain single photon-excited autofluorescence lifetime for label-free detection of T cell activation

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique, capable of label-free assessment of the metabolic state and function within single cells. The FLIM measurements of autofluorescence were recently shown to be sensitive to the functional state and subtype of T cells. Therefore, autofluorescence FLIM could improve cell manufacturing technologies for adoptive immunotherapy, which currently require a time-intensive process of cell labeling with fluorescent antibodies. However, current autofluorescence FLIM implementations are typically too slow, bulky, and prohibitively expensive for use in cell manufacturing pipelines. Here we report a single photon-excited confocal whole-cell autofluorescence system that uses fast field-programmable gate array-based time tagging electronics to achieve time-correlated single photon counting (TCSPC) of single-cell autofluorescence. The system includes simultaneous near-infrared bright-field imaging and is sensitive to variations in the fluorescence decay profile of the metabolic coenzyme NAD(P)H in human T cells due to the activation state. The classification of activated and quiescent T cells achieved high accuracy and precision (area under the receiver operating characteristic curve, AUC = 0.92). The lower-cost, higher acquisition speed, and resistance to pile-up effects at high photon flux compared to traditional multiphoton-excited FLIM and TCSPC implementations with similar SNR make this system attractive for integration into flow cytometry, sorting, and quality control in cell manufacturing.

High-speed label-free two-photon fluorescence microscopy of metabolic transients during neuronal activity

The brain is an especially active metabolic system, requiring a large supply of energy following neuronal activation. However, direct observation of cellular metabolic dynamics associated with neuronal activation is challenging with currently available imaging tools. In this study, an optical imaging approach combining imaging of calcium transients and the metabolic co-enzyme nicotinamide adenine dinucleotide (phosphate) (NAD(P)H) is utilized to track the metabolic dynamics in hippocampal neuron cultures. Results show distinct cellular components for the NAD(P)H response following neuronal activity, where notable differences in the NAD(P)H dynamics between neurons and astrocytes can be directly observed. Additionally, tracking of these responses across a large field of view is demonstrated for metabolic profiling of neuronal activation. Observation of neuronal dynamics using these methods allows for closer examination of the complex metabolic machinery of the brain, and may lead to a better understanding of the cellular metabolism of neuronal activation.

Label-free characterization of single extracellular vesicles using two-photon fluorescence lifetime imaging microscopy of NAD(P)H

The heterogeneous nature of extracellular vesicles (EVs) creates the need for single EV characterization techniques. However, many common biochemical and functional EV analysis techniques lack single EV resolution. Two-photon fluorescence lifetime imaging microscopy (FLIM) is widely used to functionally characterize the reduced form of nicotinamide adenine dinucleotide and nicotinamide adenine dinucleotide phosphate (NAD(P)H) in cells and tissues. Here, we demonstrate that FLIM can also be used to image and characterize NAD(P)H in single isolated EVs. EVs were isolated using standard differential ultracentrifugation techniques from multiple cell lines and imaged using a custom two-photon FLIM system. The presented data show that the NAD(P)H fluorescence lifetimes in isolated cell-derived EVs follow a wide Gaussian distribution, indicating the presence of a range of different protein-bound and free NAD(P)H species. EV NAD(P)H fluorescence lifetime distribution has a larger standard deviation than that of cells and a significantly different fluorescence lifetime distribution than the nuclei, mitochondria, and cytosol of cells. Additionally, changes in the metabolic conditions of cells were reflected in changes in the mean fluorescence lifetime of NAD(P)H in the produced EVs. These data suggest that FLIM of NAD(P)H could be a valuable tool for EV research.

Recent advances in the use of stimulated Raman scattering in histopathology

Stimulated Raman histopathology (SRH) utilises the intrinsic vibrational properties of lipids, proteins and nucleic acids to generate contrast providing rapid image acquisition that allows visualisation of histopathological features. It is currently being trialled in the intraoperative setting, where the ability to image unprocessed samples rapidly and with high resolution offers several potential advantages over the use of conventional haematoxylin and eosin stained images. Here we review recent advances in the field including new updates in instrumentation and computer aided diagnosis. We also discuss how other non-linear modalities can be used to provide additional diagnostic contrast which together pave the way for enhanced histopathology and open up possibilities for in vivo pathology.

Real-time three-dimensional histology-like imaging by label-free nonlinear optical microscopy

Background

The current gold-standard formalin-fixed and paraffin-embedded (FFPE) histology typically requires several days for tissue fixing, embedding, sectioning, and staining to provide depth-resolved tissue feature visualization. During these time- and labor- intense processes, the in vivo tissue dynamics and three-dimensional structures undergo inevitable loss and distortion.

Methods

A simultaneous label-free autofluorescence multiharmonic (SLAM) microscope is used to conduct ex vivo and in vivo imaging of fresh human and rat tissues. Four nonlinear optical imaging modalities are integrated into this SLAM microscope, including second harmonic generation (SHG), two-photon fluorescence (2PF), third harmonic generation (THG), and three-photon fluorescence (3PF). By imaging fresh human and rat tissues without any tissue processing or staining, various biological tissue features are effectively visualized by one or multiple imaging modalities of the SLAM microscope. In particular, some of the most essential features in hematoxylin and eosin (H&E)-stained histology, such as collagen fibers and nuclei, are also present in the SLAM microscopy images with good contrast. Because nuclei are evident from negative contrast, the nuclei are segmented from the SLAM images using deep learning. Finally, a color-transforming algorithm is developed to convert the grey-scale images acquired by the SLAM microscope to the virtually H&E-stained histology-like images. The converted histology-like images are later compared with the FFPE histology at the same tissue site. In addition, the nuclear-to-cytoplasmic ratios (N/C ratios) of the cells in the SLAM image are quantified, which has diagnostic relevance for cancer.

Results

Various histological correlations are identified with high similarities for the color-converted histology-like SLAM microscopy images. By applying the color transforming algorithm on real-time SLAM image sequences and 3D SLAM image stacks, we report, for the first time and to the best our knowledge, real-time 3D histology-like imaging. Furthermore, the quantified N/C ratio of the cells in the SLAM image are overlaid on the converted histology-like image as a new image contrast.

Conclusions

We demonstrated real-time 3D histology-like imaging and its future potential using SLAM microscopy aided by color remapping and deep-learning-based feature segmentation.

Simultaneous two-photon activation and imaging of neural activity based on spectral-temporal modulation of supercontinuum light

SIGNIFICANCE

Recent advances in nonlinear optics in neuroscience have focused on using two ultrafast lasers for activity imaging and optogenetic stimulation. Broadband femtosecond light sources can obviate the need for multiple lasers by spectral separation for chromatically targeted excitation.

AIM

We present a photonic crystal fiber (PCF)-based supercontinuum source for spectrally resolved two-photon (2P) imaging and excitation of GCaMP6s and C1V1-mCherry, respectively.

APPROACH

A PCF is pumped using a 20-MHz repetition rate femtosecond laser to generate a supercontinuum of light, which is spectrally separated, compressed, and recombined to image GCaMP6s (930 nm excitation) and stimulate the optogenetic protein, C1V1-mCherry (1060 nm excitation). Galvanometric spiral scanning is employed on a single-cell level for multiphoton excitation and high-speed resonant scanning is employed for imaging of calcium activity.

RESULTS

Continuous wave lasers were used to verify functionality of optogenetic activation followed by directed 2P excitation. Results from these experiments demonstrate the utility of a supercontinuum light source for simultaneous, single-cell excitation and calcium imaging.

CONCLUSIONS

A PCF-based supercontinuum light source was employed for simultaneous imaging and excitation of calcium dynamics in brain tissue. Pumped PCFs can serve as powerful light sources for imaging and activation of neural activity, and overcome the limited spectra and space associated with multilaser approaches.

Analysis of signal detection configurations in optical time-stretch imaging

Optical time-stretch (OTS) imaging is effective for observing ultra-fast dynamic events in real time by virtue of its capability of acquiring images with high spatial resolution at high speed. In different implementations of OTS imaging, different configurations of its signal detection, i.e. fiber-coupled and free-space detection schemes, are employed. In this research, we quantitatively analyze and compare the two detection configurations of OTS imaging in terms of sensitivity and image quality with the USAF-1951 resolution chart and diamond films, respectively, providing a valuable guidance for the system design of OTS imaging in diverse fields.

Fluorescence lifetime imaging microscopy: fundamentals and advances in instrumentation, analysis, and applications

SIGNIFICANCE

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique to distinguish the unique molecular environment of fluorophores. FLIM measures the time a fluorophore remains in an excited state before emitting a photon, and detects molecular variations of fluorophores that are not apparent with spectral techniques alone. FLIM is sensitive to multiple biomedical processes including disease progression and drug efficacy.

AIM

We provide an overview of FLIM principles, instrumentation, and analysis while highlighting the latest developments and biological applications.

APPROACH

This review covers FLIM principles and theory, including advantages over intensity-based fluorescence measurements. Fundamentals of FLIM instrumentation in time- and frequency-domains are summarized, along with recent developments. Image segmentation and analysis strategies that quantify spatial and molecular features of cellular heterogeneity are reviewed. Finally, representative applications are provided including high-resolution FLIM of cell- and organelle-level molecular changes, use of exogenous and endogenous fluorophores, and imaging protein-protein interactions with Förster resonance energy transfer (FRET). Advantages and limitations of FLIM are also discussed.

CONCLUSIONS

FLIM is advantageous for probing molecular environments of fluorophores to inform on fluorophore behavior that cannot be elucidated with intensity measurements alone. Development of FLIM technologies, analysis, and applications will further advance biological research and clinical assessments.

Video-rate multimodal multiphoton imaging and three-dimensional characterization of cellular dynamics in wounded skin

To date, numerous studies have been performed to elucidate the complex cellular dynamics in skin diseases, but few have attempted to characterize these cellular events under conditions similar to the native environment. To address this challenge, a three-dimensional (3D) multimodal analysis platform was developed for characterizing in vivo cellular dynamics in skin, which was then utilized to process in vivo wound healing data to demonstrate its applicability. Special attention is focused on in vivo biological parameters that are difficult to study with ex vivo analysis, including 3D cell tracking and techniques to connect biological information obtained from different imaging modalities. These results here open new possibilities for evaluating 3D cellular dynamics in vivo, and can potentially provide new tools for characterizing the skin microenvironment and pathologies in the future.

Non-invasive Imaging Techniques: From Histology to In Vivo Imaging : Chapter of Imaging in Oncology

In this chapter, we will introduce and review molecular-sensitive imaging techniques, which close the gap between ex vivo and in vivo analysis. In detail, we will introduce spontaneous Raman spectral imaging, coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS), second-harmonic generation (SHG) and third-harmonic generation (THG), two-photon excited fluorescence (TPEF), and fluorescence lifetime imaging (FLIM). After reviewing these imaging techniques, we shortly introduce chemometric methods and machine learning techniques, which are needed to use these imaging techniques in diagnostic applications.

FRET efficiency measurement in a molecular tension probe with a low-cost frequency-domain fluorescence lifetime imaging microscope

We demonstrate the possibility of measuring FRET efficiency with a low-cost frequency-domain fluorescence lifetime imaging microscope (FD-FLIM). The system utilizes single-frequency-modulated excitation, which enables the use of cost-effective laser sources and electronics, simplification of data acquisition and analysis, and a dual-channel detection capability. Following calibration with coumarin 6, we measured the apparent donor lifetime in mTFP1-mVenus FRET standards expressed in living cells. We evaluated the system's sensitivity by differentiating the short and long lifetimes of mTFP1 corresponding to the known standards' high and low FRET efficiency, respectively. Furthermore, we show that the lifetime of the vinculin tension sensor, VinTS, at focal adhesions (2.30  ±  0.16  ns) is significantly (p  &lt;  ^{10  -  6}) longer than the lifetime of the unloaded TSMod probe (2.02  ±  0.16  ns). The pixel dwell time was 6.8  μs for samples expressing the FRET standards, with signal typically an order of magnitude higher than VinTS. The apparent FRET efficiency (<inline-formula>EFRETapp</inline-formula>) of the standards, calculated from the measured apparent lifetime, was linearly related to their known FRET efficiency by a factor of 0.92 to 0.99 (R²  =  0.98). This relationship serves as a calibration curve to convert apparent FRET to true FRET and circumvent the need to measure multiexponential lifetime decays. This approach yielded a FRET efficiency of 18% to 19.5%, for VinTS, in agreement with published values. Taken together, our results demonstrate a cost-effective, fast, and sensitive FD-FLIM approach with the potential to facilitate applications of FLIM in mechanobiology and FRET-based biosensing.

Tracking metabolic dynamics of apoptosis with high-speed two-photon fluorescence lifetime imaging microscopy

Programmed cell death, or apoptosis, is an essential process in development and homeostasis, and disruptions in associated pathways are responsible for a wide variety of diseases such as cancer, developmental abnormalities, and Alzheimer's disease. On the other hand, cell death, in many cases, is the desired outcome of therapeutic treatments targeting diseases such as cancer. Recently, metabolic imaging based on two-photon fluorescence microscopy has been developed and shown to be highly sensitive to certain cell death processes, most notably apoptosis, thus having the potential as an advanced label-free screening tool. However, the typically low acquisition rates of this imaging technique have resulted in a limited throughput approach, allowing only a small population of cells to be tracked at well-separated time points. To address this limitation, a high-speed two-photon fluorescence lifetime imaging microscopy (2P-FLIM) platform capable of video-rate imaging is applied to study and further characterize the metabolic dynamics associated with cell death. Building upon previous work demonstrating the capabilities of this system, this microscope is utilized to study rapid metabolic changes during cell death induction, such as dose-dependency of metabolic response, response in invasive vs. noninvasive cancer cells, and response in an apoptosis-resistant cell line, which is further shown to undergo autophagy in response to toxic stimuli. Results from these experiments show that the early apoptosis-related metabolic dynamics are strongly correlated with important cellular parameters including responsiveness to apoptosis-inducing stimuli. The high speed and sensitivity of the presented imaging approach enables new investigations into this highly dynamic and complex process.

Simultaneous label-free autofluorescence-multiharmonic microscopy and beyond

Without sophisticated data inversion algorithms, nonlinear optical microscopy can acquire images at subcellular resolution and relatively large depth, with plausible endogenous contrasts indicative of authentic biological and pathological states. Although independent contrasts have been derived by sequentially imaging the same sample plane or volume under different and often optimized excitation conditions, new laser source engineering with inputs from key biomolecules surprisingly enable real-time simultaneous acquisition of multiple endogenous molecular contrasts to segment a rich set of cellular and extracellular components. Since this development allows simple single-beam single-shot excitation and simultaneous multicontrast epidirected signal detection, the resulting platform avoids perturbative sample pretreatments such as fluorescent labeling, mechanical sectioning, scarce or interdependent contrast generation, constraints to the sample or imaging geometry, and intraimaging motion artifacts that have limited in vivo nonlinear optical molecular imaging.

Simultaneous label-free autofluorescence and multi-harmonic imaging reveals in vivo structural and metabolic changes in murine skin

Simultaneous quantification of multifarious cellular metabolites and the extracellular matrix in vivo has been long sought. Simultaneous label-free autofluorescence and multi-harmonic (SLAM) microscopy has achieved simultaneous four-channel nonlinear imaging to study tissue structure and metabolism. In this study, we implemented two laser systems and directly compared SLAM microscopy with conventional two-photon microscopy for in vivo imaging. We found that three-photon imaging of adenine dinucleotide (phosphate) (NAD(P)H) in SLAM microscopy using our tailored laser source provided better resolution, contrast, and background suppression than conventional two-photon imaging of NAD(P)H. We also integrated fluorescence lifetime imaging with SLAM microscopy, and enabled differentiation of free and bound NAD(P)H. We imaged murine skin in vivo and showed that changes in tissue structure, cell dynamics, and metabolism can be monitored simultaneously in real-time. We also discovered an increase in metabolism and protein-bound NAD(P)H in skin cells during the early stages of wound healing.