Frequency Multiplexed In Vivo Multiphoton Phosphorescence Lifetime Microscopy

Ultra-Small Air-Stable Triplet-Triplet Annihilation Upconversion Nanoparticles for Anti-Stokes Time-Resolved Imaging

Image contrast is often limited by background autofluorescence in steady-state bioimaging microscopy. Upconversion bioimaging can overcome this by shifting the emission lifetime and wavelength beyond the autofluorescence window. Here we demonstrate the first example of triplet-triplet annihilation upconversion (TTA-UC) based lifetime imaging microscopy. A new class of ultra-small nanoparticle (NP) probes based on TTA-UC chromophores encapsulated in an organic-inorganic host has been synthesised. The NPs exhibit bright UC emission (400-500 nm) in aerated aqueous media with a UC lifetime of ≈1 μs, excellent colloidal stability and little cytotoxicity. Proof-of-concept demonstration of TTA-UC lifetime imaging using these NPs shows that the long-lived anti-Stokes emission is easily discriminable from typical autofluorescence. Moreover, fluctuations in the UC lifetime can be used to map local oxygen diffusion across the subcellular structure. Our TTA-UC NPs are highly promising stains for lifetime imaging microscopy, affording excellent image contrast and potential for oxygen mapping that is ripe for further exploitation.

Cascaded domain multiphoton spatial frequency modulation imaging

Significance

Multiphoton microscopy is a powerful imaging tool for biomedical applications. A variety of techniques and respective benefits exist for multiphoton microscopy, but an enhanced resolution is especially desired. Additionally multiphoton microscopy requires ultrafast pulses for excitation, so optimization of the pulse duration at the sample is critical for strong signals.

Aim

We aim to perform enhanced resolution imaging that is robust to scattering using a structured illumination technique while also providing a rapid and easily repeatable means to optimize group delay dispersion (GDD) compensation through to the sample.

Approach

Spatial frequency modulation imaging (SPIFI) is used in two domains: the spatial domain (SD) and the wavelength domain (WD). The WD-SPIFI system is an in-line tool enabling GDD optimization that considers all material through to the sample. The SD-SPIFI system follows and enables enhanced resolution imaging.

Results

The WD-SPIFI dispersion optimization performance is confirmed with independent pulse characterization, enabling rapid optimization of pulses for imaging with the SD-SPIFI system. The SD-SPIFI system demonstrates enhanced resolution imaging without the use of photon counting enabled by signal to noise improvements due to the WD-SPIFI system.

Conclusions

Implementing SPIFI in-line in two domains enables full-path dispersion compensation optimization through to the sample for enhanced resolution multiphoton microscopy.

Large-scale capture of hidden fluorescent labels for training generalizable markerless motion capture models

Deep learning-based markerless tracking has revolutionized studies of animal behavior. Yet the generalizability of trained models tends to be limited, as new training data typically needs to be generated manually for each setup or visual environment. With each model trained from scratch, researchers track distinct landmarks and analyze the resulting kinematic data in idiosyncratic ways. Moreover, due to inherent limitations in manual annotation, only a sparse set of landmarks are typically labeled. To address these issues, we developed an approach, which we term GlowTrack, for generating orders of magnitude more training data, enabling models that generalize across experimental contexts. We describe: a) a high-throughput approach for producing hidden labels using fluorescent markers; b) a multi-camera, multi-light setup for simulating diverse visual conditions; and c) a technique for labeling many landmarks in parallel, enabling dense tracking. These advances lay a foundation for standardized behavioral pipelines and more complete scrutiny of movement.

Design and analysis of polygonal mirror-based scan engines for improved spatial frequency modulation imaging

Spatial frequency modulation imaging (SPIFI) is a structured illumination single pixel imaging technique that is most often achieved via a rotating modulation disk. This implementation produces line images with exposure times on the order of tens of milliseconds. Here, we present a new architecture for SPIFI using a polygonal scan mirror with the following advances: (1) reducing SPIFI line image exposure times by 2 orders of magnitude, (2) facet-to-facet measurement and correction for polygonal scan design, and (3) a new anamorphic magnification scheme that improves resolution for long working distance optics.

TDI-based continuous window compressed spatio-temporal imaging capable of flexible voxels post-interpretation

To achieve high frame rates and continuous streaming simultaneously, we propose a compressed spatio-temporal imaging framework implemented by combining time-delay-integration sensors and coded exposure. Without additional optical coding elements and subsequent calibration required, this electronic-domain modulation enables a more compact and robust hardware structure, compared to the existing imaging modalities. By exploiting the intra-line charge transfer mechanism, we achieve a super-resolution in both temporal and spatial domains, thus multiplying the frame rate to millions of frames-per-second. In addition, the forward model with post-tunable coefficients, and two reconstruction strategies proposed therefrom, facilitate a flexible voxels post-interpretation. Finally, the effectiveness of the proposed framework is demonstrated by both numerical simulations and proof-of-concept experiments. With the prominent advantages of prolonged time window and flexible voxels post-interpretation, the proposed system will be suitable for imaging random, non-repetitive, or long-term events.

Fast wide-field upconversion luminescence lifetime thermometry enabled by single-shot compressed ultrahigh-speed imaging

Photoluminescence lifetime imaging of upconverting nanoparticles is increasingly featured in recent progress in optical thermometry. Despite remarkable advances in photoluminescent temperature indicators, existing optical instruments lack the ability of wide-field photoluminescence lifetime imaging in real time, thus falling short in dynamic temperature mapping. Here, we report video-rate upconversion temperature sensing in wide field using single-shot photoluminescence lifetime imaging thermometry (SPLIT). Developed from a compressed-sensing ultrahigh-speed imaging paradigm, SPLIT first records wide-field luminescence intensity decay compressively in two views in a single exposure. Then, an algorithm, built upon the plug-and-play alternating direction method of multipliers, is used to reconstruct the video, from which the extracted lifetime distribution is converted to a temperature map. Using the core/shell NaGdF4:Er3+,Yb3+/NaGdF4 upconverting nanoparticles as the lifetime-based temperature indicators, we apply SPLIT in longitudinal wide-field temperature monitoring beneath a thin scattering medium. SPLIT also enables video-rate temperature mapping of a moving biological sample at single-cell resolution.

Full-field fluorescence lifetime dual-comb microscopy using spectral mapping and frequency multiplexing of dual-comb optical beats

Fluorescence lifetime imaging microscopy (FLIM) is a powerful tool for quantitative fluorescence imaging because fluorescence lifetime is independent of concentration of fluorescent molecules or excitation/detection efficiency and is robust to photobleaching. However, since most FLIMs are based on point-to-point measurements, mechanical scanning of a focal spot is needed for forming an image, which hampers rapid imaging. Here, we demonstrate scan-less full-field FLIM based on a one-to-one correspondence between two-dimensional (2D) image pixels and frequency-multiplexed radio frequency (RF) signals. A vast number of dual-comb optical beats between dual optical frequency combs are effectively adopted for 2D spectral mapping and high-density frequency multiplexing in the RF region. Bimodal images of fluorescence amplitude and lifetime are obtained with high quantitativeness from amplitude and phase spectra of fluorescence RF comb modes without the need for mechanical scanning. The parallelized FLIM will be useful for rapid quantitative fluorescence imaging in life science.

Mapping O2 concentration in ex-vivo tissue samples on a fast PLIM macro-imager

O2 PLIM microscopy was employed in various studies, however current platforms have limitations in sensitivity, image acquisition speed, accuracy and general usability. We describe a new PLIM imager based on the Timepix3 camera (Tpx3cam) and its application for imaging of O2 concentration in various tissue samples stained with a nanoparticle based probe, NanO2-IR. Upon passive staining of mouse brain, lung or intestinal tissue surface with minute quantities of NanO2-IR or by microinjecting the probe into the lumen of small or large intestine fragments, robust phosphorescence intensity and lifetime signals were produced, which allow mapping of O2 in the tissue within 20 s. Inhibition of tissue respiration or limitation of O2 diffusion to tissue produced the anticipated increases or decreases in O2 levels, respectively. The difference in O2 concentration between the colonic lumen and air-exposed serosal surface was around 140 µM. Furthermore, subcutaneous injection of 5 µg of the probe in intact organs (a paw or tail of sacrificed mice) enabled efficient O2 imaging at tissue depths of up to 0.5 mm. Overall, the PLIM imager holds promise for metabolic imaging studies with various ex vivo models of animal tissue, and also for use in live animals.

Line scanning mechanical streak camera for phosphorescence lifetime imaging

Phosphorescence lifetime measurement holds great importance in life sciences and material sciences. Due to the long lifetime of phosphorescence emission, conventional approaches based on point scanning time-domain recording suffer from long recording time and low signal-to-noise ratio (SNR). To overcome these difficulties, we developed a line scanning mechanical streak camera for parallel and high SNR imaging. This design offers three key advantages. First, hundreds to thousands of pixels can be recorded simultaneously at high throughput. Second, hundreds of excitation can be accumulated on a single camera frame and read out at once with high quantum efficiency (QE) and low read noise. Third, the system is very simple, only requiring a camera and a scanner. Using a confocal line scanning configuration, we imaged samples of various lifetime ranging from tens of nanoseconds to hundreds of microseconds, which demonstrated the versatility and advantages of this method.

Quantitative Mapping of Liver Hypoxia in Living Mice Using Time-Resolved Wide-Field Phosphorescence Lifetime Imaging

Hypoxia has been identified to contribute the pathogenesis of a wide range of liver diseases, and therefore, quantitative mapping of liver hypoxia is important for providing critical information in the diagnosis and treatment of hepatic diseases. However, the existing imaging methods are unsuitable to quantitatively assess liver hypoxia due to the need of liver-specific contrast agents and be easily affected by other imaging factors. Here, a time-resolved lifetime-based imaging method is established for quantitative mapping of the distribution of hypoxia in the livers of mice by combining a wide-field luminescence lifetime imaging system with an oxygen-sensitive nanoprobe. It is shown that the method is suitable for real-time quantification of the change of oxygen pressure in the process of hepatic ischemia-reperfusion of the mouse. Moreover, the developed lifetime imaging methodology is used to quantitatively map liver hypoxia regions in the mouse model of orthotopic liver tumor, where the average oxygen pressure in tumorous liver is far below the normal liver.

Spatial frequency modulated imaging in coherent anti-Stokes Raman microscopy

For sparse samples or in the presence of ambient light, the signal-to-noise ratio (SNR) performance of single-point-scanning coherent anti-Stokes Raman scattering (CARS) images is not optimized. As an improvement, we propose replacing the conventional CARS focus-point illumination with a periodically structured focus line while continuing to collect the transmitted CARS intensity on a single detector. The object information along the illuminated line is obtained by numerically processing the CARS signal recorded for various periods of the structured focus line. We demonstrate experimentally the feasibility of this spatial frequency modulated imaging (SPIFI) in CARS (SPIFI-CARS) and SHG (SPIFI-SHG) and identify situations where its SNR is better than that of the single-point-scanning approach.

Parallelized volumetric fluorescence microscopy with a reconfigurable coded incoherent light-sheet array

Parallelized fluorescence imaging has been a long-standing pursuit that can address the unmet need for a comprehensive three-dimensional (3D) visualization of dynamical biological processes with minimal photodamage. However, the available approaches are limited to incomplete parallelization in only two dimensions or sparse sampling in three dimensions. We hereby develop a novel fluorescence imaging approach, called coded light-sheet array microscopy (CLAM), which allows complete parallelized 3D imaging without mechanical scanning. Harnessing the concept of an "infinity mirror", CLAM generates a light-sheet array with controllable sheet density and degree of coherence. Thus, CLAM circumvents the common complications of multiple coherent light-sheet generation in terms of dedicated wavefront engineering and mechanical dithering/scanning. Moreover, the encoding of multiplexed optical sections in CLAM allows the synchronous capture of all sectioned images within the imaged volume. We demonstrate the utility of CLAM in different imaging scenarios, including a light-scattering medium, an optically cleared tissue, and microparticles in fluidic flow. CLAM can maximize the signal-to-noise ratio and the spatial duty cycle, and also provides a further reduction in photobleaching compared to the major scanning-based 3D imaging systems. The flexible implementation of CLAM regarding both hardware and software ensures compatibility with any light-sheet imaging modality and could thus be instrumental in a multitude of areas in biological research.

Cellular Metabolic Heterogeneity In Vivo Is Recapitulated in Tumor Organoids

Heterogeneous populations within a tumor have varying metabolic profiles, which can muddle the interpretation of bulk tumor imaging studies of treatment response. Although methods to study tumor metabolism at the cellular level are emerging, these methods provide a single time point “snapshot” of tumor metabolism and require a significant time and animal burden while failing to capture the longitudinal metabolic response of a single tumor to treatment. Here, we investigated a novel method for longitudinal, single-cell tracking of metabolism across heterogeneous tumor cell populations using optical metabolic imaging (OMI), which measures autofluorescence of metabolic coenzymes as a report of metabolic activity. We also investigated whether in vivo cellular metabolic heterogeneity can be accurately captured using tumor-derived three-dimensional organoids in a genetically engineered mouse model of breast cancer. OMI measurements of response to paclitaxel and the phosphatidylinositol-3-kinase inhibitor XL147 in tumors and organoids taken at single cell resolution revealed parallel shifts in metaboltruic heterogeneity. Interestingly, these previously unappreciated heterogeneous metabolic responses in tumors and organoids could not be attributed to tumor cell fate or varying leukocyte content within the microenvironment, suggesting that heightened metabolic heterogeneity upon treatment is largely due to heterogeneous metabolic shifts within tumor cells. Together, these studies show that OMI revealed remarkable heterogeneity in response to treatment, which could provide a novel approach to predict the presence of potentially unresponsive tumor cell subpopulations lurking within a largely responsive bulk tumor population, which might otherwise be overlooked by traditional measurements.

Merger of dynamic two-photon and phosphorescence lifetime microscopy reveals dependence of lymphocyte motility on oxygen in solid and hematological tumors

Background

Low availability of oxygen in tumors contributes to the hostility of the tumor microenvironment toward the immune system. However, the dynamic relationship between local oxygen levels and the immune surveillance of tumors by tumor infiltrating T-lymphocytes (TIL) remains unclear. This situation reflects a methodological difficulty in visualizing oxygen gradients in living tissue in a manner that is suitable for spatiotemporal quantification and contextual correlation with individual cell dynamics tracked by typical fluorescence reporter systems.

Methods

Here, we devise a regimen for intravital oxygen and cell dynamics co-imaging, termed ‘Fast’ Scanning Two-photon Phosphorescence Lifetime Imaging Microscopy (FaST-PLIM). Using FaST-PLIM, we image the cellular motility of T-lymphocytes in relation to the microscopic distribution of oxygen in mouse models of hematological and solid tumors, namely in bone marrow with or without B-cell acute lymphocytic leukemia (ALL), and in lungs with sarcoma tumors.

Results

Both in bone marrow leukemia and solid tumor models, TILs encountered regions of varying oxygen concentrations, including regions of hypoxia (defined as pO₂ below 5 mmHg), especially in advanced-stage ALL and within solid tumor cores. T cell motility was sustained and weakly correlated with local pO₂ above 5 mmHg but it was very slow in pO₂ below this level. In solid tumors, this relationship was reflected in slow migration of TIL in tumor cores compared to that in tumor margins. Remarkably, breathing 100% oxygen alleviated tumor core hypoxia and rapidly invigorated the motility of otherwise stalled tumor core TILs.

Conclusions

This study demonstrates a versatile and highly contextual FaST-PLIM method for phosphorescence lifetime-based oxygen imaging in living animal tumor immunology models. The initial results of this method application to ALL and solid lung tumor models highlight the importance of oxygen supply for the maintenance of intratumoral T cell migration, define a 5 mmHg local oxygen concentration threshold for TIL motility, and demonstrate efficacy of supplementary oxygen breathing in TIL motility enhancement coincident with reduction of tumor hypoxia.

Electronic supplementary material

The online version of this article (10.1186/s40425-019-0543-y) contains supplementary material, which is available to authorized users.

Single-shot compressed optical-streaking ultra-high-speed photography

Single-shot ultra-high-speed imaging is of great significance to capture transient phenomena in physics, biology, and chemistry in real time. Existing techniques, however, have a restricted application scope, a low sequence depth, or a limited pixel count. To overcome these limitations, we developed single-shot compressed optical-streaking ultra-high-speed photography (COSUP) with an imaging speed of 1.5 million frames per second, a sequence depth of 500 frames, and an (x,y) pixel count of 0.5 megapixels per frame. COSUP's single-shot ultra-high-speed imaging ability was demonstrated by recording single laser pulses illuminating through transmissive targets and by tracing a fast-moving object. As a universal imaging platform, COSUP is capable of increasing imaging speeds of a wide range of CCD and complementary metal-oxide-semiconductor cameras by four orders of magnitude. We envision COSUP to be applied in widespread applications in biomedicine and materials science.

Deep-tissue optical imaging of near cellular-sized features

Detection of biological features at the cellular level with sufficient sensitivity in complex tissue remains a major challenge. To appreciate this challenge, this would require finding tens to hundreds of cells (a 0.1 mm tumor has ~125 cells), out of ~37 trillion cells in the human body. Near-infrared optical imaging holds promise for high-resolution, deep-tissue imaging, but is limited by autofluorescence and scattering. To date, the maximum reported depth using second-window near-infrared (NIR-II: 1000–1700 nm) fluorophores is 3.2 cm through tissue. Here, we design an NIR-II imaging system, “Detection of Optically Luminescent Probes using Hyperspectral and diffuse Imaging in Near-infrared” (DOLPHIN), that resolves these challenges. DOLPHIN achieves the following: (i) resolution of probes through up to 8 cm of tissue phantom; (ii) identification of spectral and scattering signatures of tissues without apriori knowledge of background or autofluorescence; and (iii) 3D reconstruction of live whole animals. Notably, we demonstrate noninvasive real-time tracking of a 0.1 mm-sized fluorophore through the gastrointestinal tract of a living mouse, which is beyond the detection limit of current imaging modalities.

Oxyphor 2P: A High-Performance Probe for Deep-Tissue Longitudinal Oxygen Imaging

Quantitative imaging of oxygen distributions in tissue can provide invaluable information about metabolism in normal and diseased states. Two-photon phosphorescence lifetime microscopy (2PLM) has been developed to perform measurements of oxygen in vivo with micron-scale resolution in 3D; however, the method's potential has not yet been fully realized due to the limitations of current phosphorescent probe technology. Here, we report a new sensor, Oxyphor 2P, that enables oxygen microscopy twice as deep (up to 600 μm below the tissue surface) and with ∼60 times higher speed than previously possible. Oxyphor 2P allows longitudinal oxygen measurements without having to inject the probe directly into the imaged region. As proof of principle, we monitored oxygen dynamics for days following micro-stroke induced by occlusion of a single capillary in the mouse brain. Oxyphor 2P opens up new possibilities for studies of tissue metabolic states using 2PLM in a wide range of biomedical research areas.

Two-photon frequency division multiplexing for functional in vivo imaging: a feasibility study

Recently, we presented a new approach to create high-speed amplitude modulation of femtosecond laser pulses and tag multiple excitation beams with specific modulation frequencies. In this work, we discuss the utility of this method to record calcium signals in brain tissue with two-photon frequency-division multiplexing (2P-FDM) microscopy. While frequency-multiplexed imaging appears slightly inferior in terms of image quality as compared to conventional two-photon laser scanning microscopy due to shot noise-induced cross-talk between frequency channels, applying this technique to record average signals from regions of interest (ROI) such as neuronal cell bodies was found to be promising. We use phase information associated with each pixel or waveform within a selected ROI to phase-align and recombine the signals into one extended amplitude-modulated waveform. This procedure narrows the frequency detection window, effectively decreasing noise contributions from other frequency channels. Using theoretical analysis, numerical simulations, and in vitro imaging, we demonstrate a reduction of cross-talk by more than an order of magnitude and predict the usefulness of 2P-FDM for functional studies of brain activity.

Interferometric spatial frequency modulation imaging

Interferometric spatial frequency modulation for imaging (I-SPIFI) is demonstrated for the first time, to our knowledge. Significantly, this imaging modality can be seamlessly combined with nonlinear SPIFI imaging and operates through single-element detection, making it compatible for use in scattering specimens. Imaging dynamic processes with submicrometer axial resolution through long working distance optics is shown, and high contrast images compared to traditional wide-field microscopy images. Finally, enhanced lateral resolution is achieved in I-SPIFI. To our knowledge, this is the first single platform that enables multimodal linear and nonlinear imaging, with enhanced resolution, all of which can be performed simultaneously.

Line excitation array detection fluorescence microscopy at 0.8 million frames per second

Three-dimensional, fluorescence imaging methods with ~1 MHz frame rates are needed for high-speed, blur-free flow cytometry and capturing volumetric neuronal activity. The frame rates of current imaging methods are limited to kHz by the photon budget, slow camera readout, and/or slow laser beam scanners. Here, we present line excitation array detection (LEAD) fluorescence microscopy, a high-speed imaging method capable of providing 0.8 million frames per second. The method performs 0.8 MHz line-scanning of an excitation laser beam using a chirped signal-driven longitudinal acousto-optic deflector to create a virtual light-sheet, and images the field-of-view with a linear photomultiplier tube array to generate a 66 × 14 pixel frame each scan cycle. We implement LEAD microscopy as a blur-free flow cytometer for Caenorhabditis elegans moving at 1 m s-1 with 3.5-µm resolution and signal-to-background ratios >200. Signal-to-noise measurements indicate future LEAD fluorescence microscopes can reach higher resolutions and pixels per frame without compromising frame rates.

Fiber-bundle illumination: realizing high-degree time-multiplexed multifocal multiphoton microscopy with simplicity

High-degree time-multiplexed multifocal multiphoton microscopy was expected to provide a facile path to scanningless optical-sectioning and the fast imaging of dynamic three-dimensional biological systems. However, physical constraints on typical time multiplexing devices, arising from diffraction in the free-space propagation of light waves, lead to significant manufacturing difficulties and have prevented the experimental realization of high-degree time multiplexing. To resolve this issue, we have developed a novel method using optical fiber bundles of various lengths to confine the diffraction of propagating light waves and to create a time multiplexing effect. Through this method, we experimentally demonstrate the highest degree of time multiplexing ever achieved in multifocal multiphoton microscopy (~50 times larger than conventional approaches), and hence the potential of using simply-manufactured devices for scanningless optical sectioning of biological systems.

Three-dimensional single-pixel imaging of incoherent light with spatiotemporally modulated illumination

We derive analytic expressions for the three-dimensional coherent transfer function (CTF) and coherent spread function (CSF) for coherent holographic image reconstruction by phase transfer (CHIRPT) microscopy with monochromatic and broadband illumination sources. The 3D CSF and CTF were used to simulate CHIRPT images, and the results show excellent agreement with experimental data. Finally, we show that the formalism presented here for computing the CSF/CTF pair in CHIRPT microscopy can be readily extended to other forms of single-pixel imaging, such as spatial-frequency-modulated imaging.

Imaging of oxygen and hypoxia in cell and tissue samples

Molecular oxygen (O2) is a key player in cell mitochondrial function, redox balance and oxidative stress, normal tissue function and many common disease states. Various chemical, physical and biological methods have been proposed for measurement, real-time monitoring and imaging of O2 concentration, state of decreased O2 (hypoxia) and related parameters in cells and tissue. Here, we review the established and emerging optical microscopy techniques allowing to visualize O2 levels in cells and tissue samples, mostly under in vitro and ex vivo, but also under in vivo settings. Particular examples include fluorescent hypoxia stains, fluorescent protein reporter systems, phosphorescent probes and nanosensors of different types. These techniques allow high-resolution mapping of O2 gradients in live or post-mortem tissue, in 2D or 3D, qualitatively or quantitatively. They enable control and monitoring of oxygenation conditions and their correlation with other biomarkers of cell and tissue function. Comparison of these techniques and corresponding imaging setups, their analytical capabilities and typical applications are given.

Luminescent gold nanocluster-based sensing platform for accurate H2S detection in vitro and in vivo with improved anti-interference

Gold nanoclusters (Au NCs) are promising luminescent nanomaterials due to their outstanding optical properties. However, their relatively low quantum yields and environment-dependent photoluminescence properties have limited their biological applications. To address these problems, we developed a novel strategy to prepare chitosan oligosaccharide lactate (Chi)-functionalized Au NCs (Au NCs@Chi), which exhibited emission with enhanced quantum yield and elongated emission lifetime as compared to the Au NCs, as well as exhibited environment-independent photoluminescence properties. In addition, utilizing the free amino groups of Chi onto Au NCs@Chi, we designed a FRET-based sensing platform for the detection of hydrogen sulfide (H₂S). The Au NCs and the specific H₂S-sensitive merocyanine compound were respectively employed as an energy donor and acceptor in the platform. The addition of H₂S induced changes in the emission profile and luminescence lifetime of the platform with high sensitivity and selectivity. Utilization of the platform was demonstrated to detect exogenous and endogenous H₂S in vitro and in vivo through wavelength-ratiometric and time-resolved luminescence imaging (TLI). Compared to previously reported luminescent molecules, the platform was less affected by experimental conditions and showed minimized autofluorescence interference and improved accuracy of detection.

Ultrafast Delivery of Aggregation-Induced Emission Nanoparticles and Pure Organic Phosphorescent Nanocrystals by Saponin Encapsulation

Saponins are a class of naturally occurring bioactive and biocompatible amphiphilic glycosides produced by plants. Some saponins, such as α-hederin, exhibit unique cell membrane interactions. At concentrations above their critical micelle concentration, they will interact and aggregate with membrane cholesterol to form transient pores in the cell membrane. In this project, we utilized the unique permeabilization and amphiphilic properties of saponins for the intracellular delivery of deep-red-emitting aggregation-induced emission nanoparticles (AIE NPs) and pure organic room-temperature phosphorescent nanocrystals (NCs). We found this method to be biocompatible, inexpensive, ultrafast, and applicable to deliver a wide variety of AIE NPs and NCs into cancer cells.

Photonic Needles for Light Delivery in Deep Tissue-like Media

We demonstrate a new platform for minimally invasive, light delivery probes leveraging the maturing field of silicon photonics, enabling massively parallel fabrication of photonic structures. These Photonic Needles probes have sub-10 μm cross-sectional dimensions, lengths greater than 3 mm–surpassing 1000 to 1 aspect ratio, and are released completely into air without a substrate below. We show the Photonic Needles to be mechanically robust when inserted into 2% agarose. The propagation loss of these waveguides is low–on the order of 4 dB/cm.

On-chip coherent detection with quantum limited sensitivity

While single photon detectors provide superior intensity sensitivity, spectral resolution is usually lost after the detection event. Yet for applications in low signal infrared spectroscopy recovering information about the photon's frequency contributions is essential. Here we use highly efficient waveguide integrated superconducting single-photon detectors for on-chip coherent detection. In a single nanophotonic device, we demonstrate both single-photon counting with up to 86% on-chip detection efficiency, as well as heterodyne coherent detection with spectral resolution f/∆f exceeding 1011. By mixing a local oscillator with the single photon signal field, we observe frequency modulation at the intermediate frequency with ultra-low local oscillator power in the femto-Watt range. By optimizing the nanowire geometry and the working parameters of the detection scheme, we reach quantum-limited sensitivity. Our approach enables to realize matrix integrated heterodyne nanophotonic devices in the C-band wavelength range, for classical and quantum optics applications where single-photon counting as well as high spectral resolution are required simultaneously.

Description of deep saturated excitation multiphoton microscopy for super-resolution imaging

Here we recount the standard two-level model that describes saturated excitation (SAX) in multiphoton microscopy (MPM), a new technique for super-resolution fluorescence microscopy in scattering tissue, which requires no special chemistry and only simple modifications to a commercial MPM microscope. We use the model to study conditions required for improvements in MPM SAX resolution and experimental implementation strategies. Simulation results find zeros, or nodes, in the frequency response, which generate highly irregular point-spread functions (PSFs), such as rings and ripples, that contain spatial frequency content >3× larger than allowed by diffraction. These PSFs are a direct result of zeros in the frequency response of saturated fluorophores under specific excitation conditions. The impact on image quality is discussed using simulations of targets imaged with SAX PSFs. Further, we explore engineering sets of irregular PSFs by varying the excitation power and reconstructing super-resolution images from the set of captured images.

Amplitude modulation of femtosecond laser pulses in the megahertz range for frequency-multiplexed two-photon imaging

We present a frequency-multiplexed multi-site two-photon imaging method utilizing amplitude modulation of femtosecond laser pulses in the MHz range to tag each excitation beam and the corresponding fluorescence signals with specific frequencies. The frequency tags are generated with an interferometric scheme employing acousto-optic deflectors (AODs) to achieve precise spatial overlap of femtosecond laser pulses with periodically varying phase shift. Creating matching excitation beam patterns in each interferometer arm using multiple AOD driving frequencies, and subsequently overlapping these matching patterns, results in multiple encoded excitation beams with unique beat frequencies available for scanning. As a proof-of-concept, we demonstrate multiplexed two-photon image acquisition using test samples, and compare the performance of this approach to conventional two-photon laser scanning microscopy.

Saturation-compensated measurements for fluorescence lifetime imaging microscopy

Fluorophore saturation is the key factor limiting the speed and excitation range of fluorescence lifetime imaging microscopy (FLIM). For example, fluorophore saturation causes incorrect lifetime measurements when using conventional frequency-domain FLIM at high excitation powers. In this Letter, we present an analytical theoretical description of this error and present a method for compensating for this error in order to extract correct lifetime measurements in the limit of fluorophore saturation. We perform a series of simulations and experiments to validate our methods. The simulations and experiments show a 13.2× and a 2.6× increase in excitation range, respectively. The presented method is based on algorithms that can be easily applied to existing FLIM setups.

Super-sensitivity multiphoton frequency-domain fluorescence lifetime imaging microscopy

We present a series of experiments that demonstrate a super-sensitive chemical imaging technique based on multiphoton frequency-domain fluorescence lifetime imaging microscopy (MPM-FD-FLIM) that shows a 2× improvement in imaging speed compared to the theoretical limit of conventional MPM-FD-FLIM. Additionally, this technique produces unprecedented sensitivity over a large range of fluorescence lifetimes. These results are achieved through simple modifications to data analysis in a conventional MPM-FD-FLIM microscope and are based on an analytical model describing the signal-to-noise ratio (SNR) of a MPM-FD-FLIM system [J. Opt. Soc. Am. A33, B1 (2016)]. Here we experimentally validate this model.

Correlative NAD(P)H-FLIM and oxygen sensing-PLIM for metabolic mapping

Cellular responses to oxygen tension have been studied extensively. Oxygen tension can be determined by considering the phosphorescence lifetime of a phosphorescence sensor. The simultaneous usage of FLIM of coenzymes as NAD(P)H and FAD(+) and PLIM of oxygen sensors could provide information about correlation of metabolic pathways and oxygen tension. We investigated correlative NAD(P)H-FLIM and oxygen sensing-PLIM for simultaneously analyzing cell metabolism and oxygen tension. Cell metabolism and pO2 were observed under different hypoxic conditions in squamous carcinoma cell cultures and in complex ex vivo systems. Increased hypoxia induced an increase of the phosphorescence lifetime of Ru(BPY)3 and in most cases a decrease in the lifetime of NAD(P)H which is in agreement to the expected decrease of the protein-bound NAD(P)H during hypoxia. Oxygen was modulated directly in the mitochondrial membrane. Blocking of complex III and accumulation of oxygen could be observed by both the decrease of the phosphorescence lifetime of Ru(BPY)3 and a reduction of the lifetime of NAD(P)H which was a clear indication of acute changes in the redox state of the cells. For the first time simultaneous FLIM/PLIM has been shown to be able to visualize intracellular oxygen tension together with a change from oxidative to glycolytic phenotype.

Investigation of signal-to-noise ratio in frequency-domain multiphoton fluorescence lifetime imaging microscopy

Multiphoton microscopy (MPM) combined with fluorescence lifetime imaging microscopy (FLIM) has enabled three-dimensional quantitative molecular microscopy in vivo. The signal-to-noise ratio (SNR), and thus the imaging rate of MPM-FLIM, which is fundamentally limited by the shot noise and fluorescence saturation, has not been quantitatively studied yet. In this paper, we investigate the SNR performance of the frequency-domain (FD) MPM-FLIM with two figures of merit: the photon economy in the limit of shot noise, and the normalized SNR in the limit of saturation. The theoretical results and Monte Carlo simulations find that two-photon FD-FLIM requires 50% fewer photons to achieve the same SNR as conventional one-photon FLIM. We also analytically show that the MPM-FD-FLIM can exploit the DC and higher harmonic components generated by nonlinear optical mixing of the excitation light to improve SNR, reducing the required number of photons by an additional 50%. Finally, the effect of fluorophore saturation on the experimental SNR performance is discussed.

Heteronuclear Ir(III)-Ln(III) Luminescent Complexes: Small-Molecule Probes for Dual Modal Imaging and Oxygen Sensing

Luminescent, mixed metal d-f complexes have the potential to be used for dual (magnetic resonance imaging (MRI) and luminescence) in vivo imaging. Here, we present dinuclear and trinuclear d-f complexes, comprising a rigid framework linking a luminescent Ir center to one (Ir·Ln) or two (Ir·Ln2) lanthanide metal centers (where Ln = Eu(III) and Gd(III), respectively). A range of physical, spectroscopic, and imaging-based properties including relaxivity arising from the Gd(III) units and the occurrence of Ir(III) → Eu(III) photoinduced energy-transfer are presented. The rigidity imposed by the ligand facilitates high relaxivities for the Gd(III) complexes, while the luminescence from the Ir(III) and Eu(III) centers provide luminescence imaging capabilities. Dinuclear (Ir·Ln) complexes performed best in cellular studies, exhibiting good solubility in aqueous solutions, low toxicity after 4 and 18 h, respectively, and punctate lysosomal staining. We also demonstrate the first example of oxygen sensing in fixed cells using the dyad Ir·Gd, via two-photon phosphorescence lifetime imaging (PLIM).

Simultaneous spatial frequency modulation imaging and micromachining with a femtosecond laser

A Ti:Al2O3 chirped-pulse amplification system is used to simultaneously image and machine. By combining simultaneous spatial and temporal focusing (SSTF) with spatial frequency modulation for imaging (SPIFI), we are able to decouple the imaging and cutting beams to attain a resolution and a field-of-view that is independent of the cutting beam, while maintaining single-element detection. This setup allows for real-time feedback with the potential for simultaneous nonlinear imaging and imaging through scattering media. The novel SSTF machining platform uses refractive optics that, in general, are prohibitive for energetic, amplified pulses that might otherwise compromise the integrity of the focus as a result of nonlinear effects.

Plane wave analysis of coherent holographic image reconstruction by phase transfer (CHIRPT)

Fluorescent imaging plays a critical role in a myriad of scientific endeavors, particularly in the biological sciences. Three-dimensional imaging of fluorescent intensity often requires serial data acquisition, that is, voxel-by-voxel collection of fluorescent light emitted throughout the specimen with a nonimaging single-element detector. While nonimaging fluorescence detection offers some measure of scattering robustness, the rate at which dynamic specimens can be imaged is severely limited. Other fluorescent imaging techniques utilize imaging detection to enhance collection rates. A notable example is light-sheet fluorescence microscopy, also known as selective-plane illumination microscopy, which illuminates a large region within the specimen and collects emitted fluorescent light at an angle either perpendicular or oblique to the illumination light sheet. Unfortunately, scattering of the emitted fluorescent light can cause blurring of the collected images in highly turbid biological media. We recently introduced an imaging technique called coherent holographic image reconstruction by phase transfer (CHIRPT) that combines light-sheet-like illumination with nonimaging fluorescent light detection. By combining the speed of light-sheet illumination with the scattering robustness of nonimaging detection, CHIRPT is poised to have a dramatic impact on biological imaging, particularly for in vivo preparations. Here we present the mathematical formalism for CHIRPT imaging under spatially coherent illumination and present experimental data that verifies the theoretical model.

Spectrometer-free vibrational imaging by retrieving stimulated Raman signal from highly scattered photons

In vivo vibrational spectroscopic imaging is inhibited by relatively slow spectral acquisition on the second scale and low photon collection efficiency for a highly scattering system. Recently developed multiplex coherent anti-Stokes Raman scattering and stimulated Raman scattering techniques have improved the spectral acquisition time down to microsecond scale. These methods using a spectrometer setting are not suitable for turbid systems in which nearly all photons are scattered. We demonstrate vibrational imaging by spatial frequency multiplexing of incident photons and single photodiode detection of a stimulated Raman spectrum within 60 μs. Compared to the spectrometer setting, our method improved the photon collection efficiency by two orders of magnitude for highly scattering specimens. We demonstrated in vivo imaging of vitamin E distribution on mouse skin and in situ imaging of human breast cancerous tissues. The reported work opens new opportunities for spectroscopic imaging in a surgical room and for development of deep-tissue Raman spectroscopy toward molecular level diagnosis.

Two-dimensional single-pixel imaging by cascaded orthogonal line spatial modulation

Two-dimensional (2D) images are taken using a single-pixel detector by temporally multiplexing spatial frequency projections from orthogonal, time varying spatial line modulation gratings. Unique temporal frequencies are applied to each point in 2D space, applying a continuous spread of frequencies to one dimension, and an offset frequency applied to each line in the orthogonal dimension. The object contrast information can then be recovered from the electronic spectrum of the single pixel, and through simple processing be reformed into a spatial image.

Label-free and depth resolved optical sectioning of iron-complex deposits in sickle cell disease splenic tissue by multiphoton microscopy

Multiphoton microscopy (MPM) imaging of intrinsic two-photon excited fluorescence (TPEF) is performed on humanized sickle cell disease (SCD) mouse model splenic tissue. Distinct morphological and spectral features associated with SCD are identified and discussed in terms of diagnostic relevance. Specifically, spectrally unique splenic iron-complex deposits are identified by MPM; this finding is supported by TPEF spectroscopy and object size to standard histopathological methods. Further, iron deposits are found at higher concentrations in diseased tissue than in healthy tissue by all imaging methods employed here including MPM, and therefore, may provide a useful biomarker related to the disease state. These newly characterized biomarkers allow for further investigations of SCD in live animals as a means to gain insight into the mechanisms impacting immune dysregulation and organ malfunction, which are currently not well understood.

Easily prepared ruthenium-complex nanomicelle probes for two-photon quantitative imaging of oxygen in aqueous media

Easily prepared, biocompatible, and oxygen-sensitive optical probes with a large two-photon cross-section: towards inexpensive quantitative oxygen imaging in vivo.

Functional cardiac imaging by random access microscopy

Advances in the development of voltage sensitive dyes and Ca²⁺ sensors in combination with innovative microscopy techniques allowed researchers to perform functional measurements with an unprecedented spatial and temporal resolution. At the moment, one of the shortcomings of available technologies is their incapability of imaging multiple fast phenomena while controlling the biological determinants involved. In the near future, ultrafast deflectors can be used to rapidly scan laser beams across the sample, performing optical measurements of action potential and Ca²⁺ release from multiple sites within cardiac cells and tissues. The same scanning modality could also be used to control local Ca²⁺ release and membrane electrical activity by activation of caged compounds and light-gated ion channels. With this approach, local Ca²⁺ or voltage perturbations could be induced, simulating arrhythmogenic events, and their impact on physiological cell activity could be explored. The development of this optical methodology will provide fundamental insights in cardiac disease, boosting new therapeutic strategies, and, more generally, it will represent a new approach for the investigation of the physiology of excitable cells.

Combined two-photon excitation and d→f energy transfer in a water-soluble Ir(III)/Eu(III) dyad: two luminescence components from one molecule for cellular imaging

The first example of cell imaging using two independent emission components from a dinuclear d/f complex is reported. A water-stable, cell-permeable Ir(III) /Eu(III) dyad undergoes partial Ir→Eu energy transfer following two-photon excitation of the Ir unit at 780 nm. Excitation in the near-IR region generated simultaneously green Ir-based emission and red Eu-based emission from the same probe. The orders-of-magnitude difference in their timescales (Ir ca. μs; Eu ca. 0.5 ms) allowed them to be identified by time-gated detection. Phosphorescence lifetime imaging microscopy (PLIM) allowed the lifetime of the Ir-based emission to be measured in different parts of the cell. At the same time, the cells are simultaneously imaged by using the Eu-based emission component at longer timescales. This new approach to cellular imaging by using dual d/f emitters should therefore enable autofluorescence-free sensing of two different analytes, independently, simultaneously and in the same regions of a cell.

Dinuclear ruthenium(II) complexes as two-photon, time-resolved emission microscopy probes for cellular DNA

The first transition-metal complex-based two-photon absorbing luminescence lifetime probes for cellular DNA are presented. This allows cell imaging of DNA free from endogenous fluorophores and potentially facilitates deep tissue imaging. In this initial study, ruthenium(II) luminophores are used as phosphorescent lifetime imaging microscopy (PLIM) probes for nuclear DNA in both live and fixed cells. The DNA-bound probes display characteristic emission lifetimes of more than 160 ns, while shorter-lived cytoplasmic emission is also observed. These timescales are orders of magnitude longer than conventional FLIM, leading to previously unattainable levels of sensitivity, and autofluorescence-free imaging.