Adaptive wide-field optical tomography

In vivo active-targeting fluorescence molecular imaging with adaptive background fluorescence subtraction

Using active tumor-targeting nanoparticles, fluorescence imaging can provide highly sensitive and specific tumor detection, and precisely guide radiation in translational radiotherapy study. However, the inevitable presence of non-specific nanoparticle uptake throughout the body can result in high levels of heterogeneous background fluorescence, which limits the detection sensitivity of fluorescence imaging and further complicates the early detection of small cancers. In this study, background fluorescence emanating from the baseline fluorophores was estimated from the distribution of excitation light transmitting through tissues, by using linear mean square error estimation. An adaptive masked-based background subtraction strategy was then implemented to selectively refine the background fluorescence subtraction. First, an in vivo experiment was performed on a mouse intratumorally injected with passively targeted fluorescent nanoparticles, to validate the reliability and robustness of the proposed method in a stringent situation wherein the target fluorescence was overlapped with the strong background. Then, we conducted in vivo studies on 10 mice which were inoculated with orthotopic breast tumors and intravenously injected with actively targeted fluorescent nanoparticles. Results demonstrated that active targeting combined with the proposed background subtraction method synergistically increased the accuracy of fluorescence molecular imaging, affording sensitive tumor detection.

Macroscopic Fluorescence Lifetime Imaging for Monitoring of Drug-Target Engagement

Precision medicine promises to improve therapeutic efficacy while reducing adverse effects, especially in oncology. However, despite great progresses in recent years, precision medicine for cancer treatment is not always part of routine care. Indeed, the ability to specifically tailor therapies to distinct patient profiles requires still significant improvements in targeted therapy development as well as decreases in drug treatment failures. In this regard, preclinical animal research is fundamental to advance our understanding of tumor biology, and diagnostic and therapeutic response. Most importantly, the ability to measure drug-target engagement accurately in live and intact animals is critical in guiding the development and optimization of targeted therapy. However, a major limitation of preclinical molecular imaging modalities is their lack of capability to directly and quantitatively discriminate between drug accumulation and drug-target engagement at the pathological site. Recently, we have developed Macroscopic Fluorescence Lifetime Imaging (MFLI) as a unique feature of optical imaging to quantitate in vivo drug-target engagement. MFLI quantitatively reports on nanoscale interactions via lifetime-sensing of Förster Resonance Energy Transfer (FRET) in live, intact animals. Hence, MFLI FRET acts as a direct reporter of receptor dimerization and target engagement via the measurement of the fraction of labeled-donor entity undergoing binding to its respective receptor. MFLI is expected to greatly impact preclinical imaging and also adjacent fields such as image-guided surgery and drug development.

Hyperspectral wide-field time domain single-pixel diffuse optical tomography platform

We present the design and comprehensive instrumental characterization of a time domain diffuse optical tomography (TD-DOT) platform based on wide-field illumination and wide-field hyperspectral time-resolved single-pixel detection for functional and molecular imaging in turbid media. The proposed platform combines two digital micro-mirror devices (DMDs) to generate structured light and a spectrally resolved multi-anode photomultiplier tube (PMT) detector in time domain for hyperspectral data acquisition over 16 wavelength channels based on the time-correlated single-photon counting (TCSPC) technique. The design of the proposed platform is described in detail and its characteristics in spatial, temporal and spectral dimensions are calibrated and presented. The performance of the system is further validated through a phantom study where two absorbers in glass tubes with spectral contrast are mapped in a turbid medium of ~20 mm thickness. The method presented here offers the potential of accelerating the imaging process and improving reconstruction results in TD-DOT and thus facilitates its wide spread use in preclinical and clinical in vivo imaging scenarios.

Direct approach to compute Jacobians for diffuse optical tomography using perturbation Monte Carlo-based photon "replay"

Perturbation Monte Carlo (pMC) has been previously proposed to rapidly recompute optical measurements when small perturbations of optical properties are considered, but it was largely restricted to changes associated with prior tissue segments or regions-of-interest. In this work, we expand pMC to compute spatially and temporally resolved sensitivity profiles, i.e. the Jacobians, for diffuse optical tomography (DOT) applications. By recording the pseudo random number generator (PRNG) seeds of each detected photon, we are able to "replay" all detected photons to directly create the 3D sensitivity profiles for both absorption and scattering coefficients. We validate the replay-based Jacobians against the traditional adjoint Monte Carlo (aMC) method, and demonstrate the feasibility of using this approach for efficient 3D image reconstructions using in vitro hyperspectral wide-field DOT measurements. The strengths and limitations of the replay approach regarding its computational efficiency and accuracy are discussed, in comparison with aMC, for point-detector systems as well as wide-field pattern-based and hyperspectral imaging systems. The replay approach has been implemented in both of our open-source MC simulators - MCX and MMC (http://mcx.space).

Review of structured light in diffuse optical imaging

Diffuse optical imaging probes deep living tissue enabling structural, functional, metabolic, and molecular imaging. Recently, due to the availability of spatial light modulators, wide-field quantitative diffuse optical techniques have been implemented, which benefit greatly from structured light methodologies. Such implementations facilitate the quantification and characterization of depth-resolved optical and physiological properties of thick and deep tissue at fast acquisition speeds. We summarize the current state of work and applications in the three main techniques leveraging structured light: spatial frequency-domain imaging, optical tomography, and single-pixel imaging. The theory, measurement, and analysis of spatial frequency-domain imaging are described. Then, advanced theories, processing, and imaging systems are summarized. Preclinical and clinical applications on physiological measurements for guidance and diagnosis are summarized. General theory and method development of tomographic approaches as well as applications including fluorescence molecular tomography are introduced. Lastly, recent developments of single-pixel imaging methodologies and applications are reviewed.

Tomographic phosphorescence lifetime multiplexing

We present a tomographic reconstruction algorithm for recovering distributions of multiple phosphorescent dyes within turbid media from time-resolved measurements, using either point or spatially patterned sources and detectors. The algorithm employs a multi-exponential analysis of time-resolved data, followed by tomographic inversion of the decay amplitudes to recover independent yield distributions for each lifetime present in the medium. Using Monte Carlo simulations, we computationally demonstrate that this two-step inversion approach provides several-fold improvement in quantitative and localization accuracy compared to a direct inversion of the time domain phosphorescence. We also demonstrate the tomographic reconstruction of up to three phosphorescent lifetimes embedded in thick tissue. The proposed algorithm can allow quantitative multiplexed tomography of luminescent and phosphorescent dyes for a wide range of in vivo applications.

Tomographic fluorescence lifetime multiplexing in the spatial frequency domain

The ability to simultaneously recover multiple fluorophores within biological tissue (multiplexing) can have important applications for tracking parallel disease processes in vivo. Here we present a novel method for rapid and quantitative multiplexing within a scattering medium, such as biological tissue, based on fluorescence lifetime contrast. This method employs a tomographic inversion of the asymptotic (late) portion of time-resolved spatial frequency (SF) domain measurements. Using Monte Carlo simulations and phantom experiments, we show that the SF-asymptotic time domain (SF-ATD) approach provides a several-fold improvement in relative quantitation and localization accuracy over conventional SF-time domain inversion. We also show that the SF-ATD approach can exploit selective filtering of high spatial frequencies to dramatically improve reconstruction accuracy for fluorophores with subnanosecond lifetimes, which is typical of most near-infrared fluorophores. These results suggest that the SF-ATD approach will serve as a powerful new tool for whole-body lifetime multiplexing.

Multiple-view diffuse optical tomography system based on time-domain compressive measurements

Compressive sensing is a powerful tool to efficiently acquire and reconstruct an image even in diffuse optical tomography (DOT) applications. In this work, a time-resolved DOT system based on structured light illumination, compressive detection, and multiple view acquisition has been proposed and experimentally validated on a biological tissue-mimicking phantom. The experimental scheme is based on two digital micromirror devices for illumination and detection modulation, in combination with a time-resolved single element detector. We fully validated the method and demonstrated both the imaging and tomographic capabilities of the system, providing state-of-the-art reconstruction quality.

Generalized mesh-based Monte Carlo for wide-field illumination and detection via mesh retessellation

Monte Carlo methods are commonly used as the gold standard in modeling photon transport through turbid media. With the rapid development of structured light applications, an accurate and efficient method capable of simulating arbitrary illumination patterns and complex detection schemes over large surface area is in great need. Here we report a generalized mesh-based Monte Carlo algorithm to support a variety of wide-field illumination methods, including spatial-frequency-domain imaging (SFDI) patterns and arbitrary 2-D patterns. The extended algorithm can also model wide-field detectors such as a free-space CCD camera. The significantly enhanced flexibility of source and detector modeling is achieved via a fast mesh retessellation process that combines the target domain and the source/detector space in a single tetrahedral mesh. Both simulations of complex domains and comparisons with phantom measurements are included to demonstrate the flexibility, efficiency and accuracy of the extended algorithm. Our updated open-source software is provided at http://mcx.space/mmc.

Assessment of Gate Width Size on Lifetime-Based Förster Resonance Energy Transfer Parameter Estimation

Förster Resonance Energy Transfer (FRET) enables the observation of interactions at the nanoscale level through the use of fluorescence optical imaging techniques. In FRET, fluorescence lifetime imaging can be used to quantify the fluorescence lifetime changes of the donor molecule, which are associated with proximity between acceptor and donor molecules. Among the FRET parameters derived from fluorescence lifetime imaging, the percentage of donor that interacts with the acceptor (in proximity) can be estimated via model-based fitting. However, estimation of the lifetime parameters can be affected by the acquisition parameters such as the temporal characteristics of the imaging system. Herein, we investigate the effect of various gate widths on the accuracy of estimation of FRET parameters with focus on the near-infrared spectral window. Experiments were performed in silico, in vitro, and in vivo with gate width sizes ranging from 300 ps to 1000 ps in intervals of 100 ps. For all cases, the FRET parameters were retrieved accurately and the imaging acquisition time was decreased three-fold. These results indicate that increasing the gate width up to 1000 ps still allows for accurate quantification of FRET interactions even in the case of short lifetimes such as those encountered with near-infrared FRET pairs.

Full time-resolved diffuse fluorescence tomography accelerated with parallelized Fourier-series truncated diffusion approximation

Of the three measurement schemes established for diffuse fluorescence tomography (DFT), the time-domain scheme is well known to provide the richest information about the distribution of the targeting fluorophore in living tissues. However, the explicit use of the full time-resolved data usually leads to a considerably lengthy time for image reconstruction, limiting its applications to three-dimensional or small-volume imaging. To cope with the adversity, we propose herein a computationally efficient scheme for DFT image reconstruction where the time-dependent photon density is expanded to a Fourier-series and calculated by solving the independent frequency-domain diffusion equations at multiple sampling frequencies with the support of a combined multicore CPU-based coarse-grain and multithread GPU-based fine-grain parallelization strategy. With such a parallelized Fourier-series truncated diffusion approximation, both the time- and frequency-domain inversion procedures are developed and validated for their effectiveness and accuracy using simulative and phantom experiments. The results show that the proposed method can generate reconstructions comparable to the explicit time-domain scheme, with significantly reduced computational time.

Hyperspectral time-resolved wide-field fluorescence molecular tomography based on structured light and single-pixel detection

We present a time-resolved fluorescence diffuse optical tomography platform that is based on wide-field structured illumination, single-pixel detection, and hyperspectral acquisition. Two spatial light modulators (digital micro-mirror devices) are employed to generate independently wide-field illumination and detection patterns, coupled with a 16-channel spectrophotometer detection module to capture hyperspectral time-resolved tomographic data sets. The main system characteristics are reported, and we demonstrate the feasibility of acquiring dense 4D tomographic data sets (space, time, spectra) for time domain 3D quantitative multiplexed fluorophore concentration mapping in turbid media.

Reduced temporal sampling effect on accuracy of time-domain fluorescence lifetime Förster resonance energy transfer

Fluorescence lifetime imaging (FLIM) aims at quantifying the exponential decay rate of fluorophores to yield lifetime maps over the imaged sample. When combined with Förster resonance energy transfer (FRET), the technique can be used to indirectly sense interactions at the nanoscale such as protein–protein interactions, protein–DNA interactions, and protein conformational changes. In the case of FLIM-FRET, the fluorescence intensity decays are fitted to a biexponential model in order to estimate the lifetime and fractional amplitude coefficients of each component of the population of the donor fluorophore (quenched and nonquenched). Numerous time data points, also called temporal or time gates, are typically employed for accurately estimating the model parameters, leading to lengthy acquisition times and significant computational demands. This work investigates the effect of the number and location of time gates on model parameter estimation accuracy. A detailed model of a FLIM-FRET imaging system is used for the investigation, and the simulation outcomes are validated with in vitro and in vivo experimental data. In all cases investigated, it is found that 10 equally spaced time gates allow robust estimation of model-based parameters with accuracy similar to that of full temporal datasets (90 gates).

Hadamard multiplexed fluorescence tomography

Depth-resolved three-dimensional (3D) reconstruction of fluorophore-tagged inclusions in fluorescence tomography (FT) poses a highly ill-conditioned problem as depth information must be extracted from boundary data. Due to the ill-posed nature of the FT inverse problem, noise and errors in the data can severely impair the accuracy of the 3D reconstructions. The signal-to-noise ratio (SNR) of the FT data strongly affects the quality of the reconstructions. Additionally, in FT scenarios where the fluorescent signal is weak, data acquisition requires lengthy integration times that result in excessive FT scan periods. Enhancing the SNR of FT data contributes to the robustness of the 3D reconstructions as well as the speed of FT scans. A major deciding factor in the SNR of the FT data is the power of the radiation illuminating the subject to excite the administered fluorescent reagents. In existing single-point illumination FT systems, the source power level is limited by the skin maximum radiation exposure levels. In this paper, we introduce and study the performance of a multiplexed fluorescence tomography system with orders-of-magnitude enhanced data SNR over existing systems. The proposed system allows for multi-point illumination of the subject without jeopardizing the information content of the FT measurements and results in highly robust reconstructions of fluorescent inclusions from noisy FT data. Improvements offered by the proposed system are validated by numerical and experimental studies.

Spatial light modulator based active wide-field illumination for ex vivo and in vivo quantitative NIR FRET imaging

Fluorescence lifetime imaging is playing an increasing role in drug development by providing a sensitive method to monitor drug delivery and receptor-ligand interactions. However, the wide dynamic range of fluorescence intensity emitted by ex vivo and in vivo samples presents challenges in retrieving information over the whole subject accurately and quantitatively. To overcome this challenge, we developed an active wide-field illumination (AWFI) strategy based on a spatial light modulator that acquires optimal fluorescence signals by enhancing the dynamic range, signal to noise ratio, and estimation of lifetime-based parameters. We demonstrate the ability of AWFI to estimate Förster resonance energy transfer (FRET) donor fraction from dissected organs with high accuracy (standard deviation <6%) over the whole field of view, in contrast with the homogenous wide-field illumination. We further report its successful application to quantitative FRET imaging in a live mouse. AWFI allows improved detection of weak signals and enhanced quantitative accuracy in ex vivo and in vivo molecular fluorescence quantitative imaging. The technique allows for robust quantitative estimation of the bio-distribution of molecular probes and lifetime-based parameters over an extended imaging field exhibiting a large range of fluorescence intensities and at a high acquisition speed (less than 1 min).

Active wide-field illumination for high-throughput fluorescence lifetime imaging

Wide-field fluorescence lifetime imaging allows for fast imaging of large sample areas at the cost of low sensitivity to weak fluorescence signals. To overcome this challenge, we developed an active wide-field illumination (AWFI) strategy to optimize the impinging spatial intensity for acquiring optimal fluorescence signals over the whole sample. We demonstrated the ability of AWFI to accurately estimate lifetimes from a multiwell plate sample with concentrations ranging over two orders of magnitude. We further reported its successful application to a quantitative Förster resonance energy transfer lifetime cell-based assay. Overall, this method allows for enhanced accuracy in lifetime-based imaging at high acquisition speed over samples with large fluorescence intensity distributions.

Multi-modal molecular diffuse optical tomography system for small animal imaging

A multi-modal optical imaging system for quantitative 3D bioluminescence and functional diffuse imaging is presented, which has no moving parts and uses mirrors to provide multi-view tomographic data for image reconstruction. It is demonstrated that through the use of trans-illuminated spectral near infrared measurements and spectrally constrained tomographic reconstruction, recovered concentrations of absorbing agents can be used as prior knowledge for bioluminescence imaging within the visible spectrum. Additionally, the first use of a recently developed multi-view optical surface capture technique is shown and its application to model-based image reconstruction and free-space light modelling is demonstrated. The benefits of model-based tomographic image recovery as compared to 2D planar imaging are highlighted in a number of scenarios where the internal luminescence source is not visible or is confounding in 2D images. The results presented show that the luminescence tomographic imaging method produces 3D reconstructions of individual light sources within a mouse-sized solid phantom that are accurately localised to within 1.5mm for a range of target locations and depths indicating sensitivity and accurate imaging throughout the phantom volume. Additionally the total reconstructed luminescence source intensity is consistent to within 15% which is a dramatic improvement upon standard bioluminescence imaging. Finally, results from a heterogeneous phantom with an absorbing anomaly are presented demonstrating the use and benefits of a multi-view, spectrally constrained coupled imaging system that provides accurate 3D luminescence images.