Monte Carlo based method for fluorescence tomographic imaging with lifetime multiplexing using time gates

In vivo quantification of programmed death-ligand-1 expression heterogeneity in tumors using fluorescence lifetime imaging

Cancer patient selection for immunotherapy is often based on programmed death-ligand-1 (PD-L1) expression as a biomarker. PD-L1 expression is currently quantified using immunohistochemistry, which can only provide snapshots of PD-L1 expression status in microscopic regions of ex vivo specimens. In vivo imaging using targeted agents can capture dynamic variations of PD-L1 expression in entire tumors within and across multiple subjects. Towards this goal, several PD-L1 targeted molecular imaging probes have been evaluated in murine models and humans. However, clinical translation of these probes has been limited due to a significant non-specific accumulation of the imaging probes and the inability of conventional imaging modalities to provide quantitative readouts that can be compared across multiple subjects. Here we report that in vivo time-domain (TD) fluorescence imaging can provide quantitative estimates of baseline tumor PD-L1 heterogeneity across untreated mice and variations in PD-L1 expression across mice undergoing clinically relevant anti-PD1 treatment. This approach relies on a significantly longer fluorescence lifetime (FLT) of PD-L1 specific anti-PD-L1 antibody tagged to IRDye 800CW (αPDL1-800) compared to nonspecific αPDL1-800. Leveraging this unique FLT contrast, we show that PD-L1 expression can be quantified across mice both in superficial breast tumors using planar FLT imaging, and in deep-seated liver tumors (>5 mm depth) using the asymptotic TD algorithm for fluorescence tomography. Our results suggest that FLT contrast can accelerate the preclinical investigation and clinical translation of novel molecular imaging probes by providing robust quantitative readouts of receptor expression that can be readily compared across subjects.

Reconstruction of fluorophore absorption and fluorescence lifetime using early photon mesoscopic fluorescence molecular tomography: a phantom study

SIGNIFICANCE

Fluorescence molecular lifetime tomography (FMLT) plays an increasingly important role in experimental oncology. The article presents and experimentally verifies an original method of mesoscopic time domain FMLT, based on an asymptotic approximation to the fluorescence source function, which is valid for early arriving photons.

AIM

The aim was to justify the efficiency of the method by experimental scanning and reconstruction of a phantom with a fluorophore. The experimental facility included the TCSPC system, the pulsed supercontinuum Fianium laser, and a three-channel fiber probe. Phantom scanning was done in mesoscopic regime for three-dimensional (3D) reflectance geometry.

APPROACH

The sensitivity functions were simulated with a Monte Carlo method. A compressed-sensing-like reconstruction algorithm was used to solve the inverse problem for the fluorescence parameter distribution function, which included the fluorophore absorption coefficient and fluorescence lifetime distributions. The distributions were separated directly in the time domain with the QR-factorization least square method.

RESULTS

3D tomograms of fluorescence parameters were obtained and analyzed using two strategies for the formation of measurement data arrays and sensitivity matrices. An algorithm is developed for the flexible choice of optimal strategy in view of attaining better reconstruction quality. Variants on how to improve the method are proposed, specifically, through stepped extraction and further use of a posteriori information about the object.

CONCLUSIONS

Even if measurement data are limited, the proposed method is capable of giving adequate reconstructions but their quality depends on available a priori (or a posteriori) information. Further research aims to improve the method by implementing the variants proposed.

Design and characterization of a time-domain optical tomography platform for mesoscopic lifetime imaging

We report on the system design and instrumental characteristics of a novel time-domain mesoscopic fluorescence molecular tomography (TD-MFMT) system for multiplexed molecular imaging in turbid media. The system is equipped with a supercontinuum pulsed laser for broad spectral excitation, based on a high-density descanned raster scanning intensity-based acquisition for 2D and 3D imaging and augmented with a high-dynamical range linear time-resolved single-photon avalanche diode (SPAD) array for lifetime quantification. We report on the system's spatio-temporal and spectral characteristics and its sensitivity and specificity in controlled experimental settings. Also, a phantom study is undertaken to test the performance of the system to image deeply-seated fluorescence inclusions in tissue-like media. In addition, ex vivo tumor xenograft imaging is performed to validate the system's applicability to the biological sample. The characterization results manifest the capability to sense small fluorescence concentrations (on the order of nanomolar) while quantifying fluorescence lifetimes and lifetime-based parameters at high resolution. The phantom results demonstrate the system's potential to perform 3D multiplexed imaging thanks to spectral and lifetime contrast in the mesoscopic range (at millimeters depth). The ex vivo imaging exhibits the prospect of TD-MFMT to resolve intra-tumoral heterogeneity in a depth-dependent manner.

High Resolution, Deep Imaging Using Confocal Time-of-Flight Diffuse Optical Tomography

Light scattering by tissue severely limits how deep beneath the surface one can image, and the spatial resolution one can obtain from these images. Diffuse optical tomography (DOT) is one of the most powerful techniques for imaging deep within tissue - well beyond the conventional  ∼ 10-15 mean scattering lengths tolerated by ballistic imaging techniques such as confocal and two-photon microscopy. Unfortunately, existing DOT systems are limited, achieving only centimeter-scale resolution. Furthermore, they suffer from slow acquisition times and slow reconstruction speeds making real-time imaging infeasible. We show that time-of-flight diffuse optical tomography (ToF-DOT) and its confocal variant (CToF-DOT), by exploiting the photon travel time information, allow us to achieve millimeter spatial resolution in the highly scattered diffusion regime ( mean free paths). In addition, we demonstrate two additional innovations: focusing on confocal measurements, and multiplexing the illumination sources allow us to significantly reduce the measurement acquisition time. Finally, we rely on a novel convolutional approximation that allows us to develop a fast reconstruction algorithm, achieving a 100× speedup in reconstruction time compared to traditional DOT reconstruction techniques. Together, we believe that these technical advances serve as the first step towards real-time, millimeter resolution, deep tissue imaging using DOT.

Early-photon reflectance fluorescence molecular tomography for small animal imaging: Mathematical model and numerical experiment

The paper presents an original approach to time-domain reflectance fluorescence molecular tomography (FMT) of small animals. It is based on the use of early arriving photons and state-of-the-art compressed-sensing-like reconstruction algorithms and aims to improve the spatial resolution of fluorescent images. We deduce the fundamental equation that models the imaging operator and derive analytical representations for the sensitivity functions which are responsible for the reconstruction of the fluorophore absorption coefficient. The idea of fluorescence lifetime tomography with our approach is also discussed. We conduct a numerical experiment on 3D reconstruction of box phantoms with spherical fluorescent inclusions of small diameters. For modeling measurement data and constructing the sensitivity matrix we assume a virtual fluorescence tomograph with a scanning fiber probe that illuminates and collects light in reflectance geometry. It provides for large source-receiver separations which correspond to the macroscopic regime. Two compressed-sensing-like reconstruction algorithms are used to solve the inverse problem. These are the algebraic reconstruction technique with total variation regularization and our modification of the fast iterative shrinkage-thresholding algorithm. Results of our numerical experiment show that our approach is capable of achieving as good spatial resolution as 0.2 mm and even better at depths to 9 mm inclusive.

Macroscopic fluorescence lifetime topography enhanced via spatial frequency domain imaging

We report on a macroscopic fluorescence lifetime imaging (MFLI) topography computational framework based around machine learning with the main goal of retrieving the depth of fluorescent inclusions deeply seated in bio-tissues. This approach leverages the depth-resolved information inherent to time-resolved fluorescence data sets coupled with the retrieval of in situ optical properties as obtained via spatial frequency domain imaging (SFDI). Specifically, a Siamese network architecture is proposed with optical properties (OPs) and time-resolved fluorescence decays as input followed by simultaneous retrieval of lifetime maps and depth profiles. We validate our approach using comprehensive in silico data sets as well as with a phantom experiment. Overall, our results demonstrate that our approach can retrieve the depth of fluorescence inclusions, especially when coupled with optical properties estimation, with high accuracy. We expect the presented computational approach to find great utility in applications such as optical-guided surgery.

Time-Domain Near-Infrared Spectroscopy and Imaging: A Review

This article reviews the past and current statuses of time-domain near-infrared spectroscopy (TD-NIRS) and imaging. Although time-domain technology is not yet widely employed due to its drawbacks of being cumbersome, bulky, and very expensive compared to commercial continuous wave (CW) and frequency-domain (FD) fNIRS systems, TD-NIRS has great advantages over CW and FD systems because time-resolved data measured by TD systems contain the richest information about optical properties inside measured objects. This article focuses on reviewing the theoretical background, advanced theories and methods, instruments, and studies on clinical applications for TD-NIRS including some clinical studies which used TD-NIRS systems. Major events in the development of TD-NIRS and imaging are identified and summarized in chronological tables and figures. Finally, prospects for TD-NIRS in the near future are briefly described.

Hyperspectral wide-field time domain single-pixel diffuse optical tomography platform

We present the design and comprehensive instrumental characterization of a time domain diffuse optical tomography (TD-DOT) platform based on wide-field illumination and wide-field hyperspectral time-resolved single-pixel detection for functional and molecular imaging in turbid media. The proposed platform combines two digital micro-mirror devices (DMDs) to generate structured light and a spectrally resolved multi-anode photomultiplier tube (PMT) detector in time domain for hyperspectral data acquisition over 16 wavelength channels based on the time-correlated single-photon counting (TCSPC) technique. The design of the proposed platform is described in detail and its characteristics in spatial, temporal and spectral dimensions are calibrated and presented. The performance of the system is further validated through a phantom study where two absorbers in glass tubes with spectral contrast are mapped in a turbid medium of ~20 mm thickness. The method presented here offers the potential of accelerating the imaging process and improving reconstruction results in TD-DOT and thus facilitates its wide spread use in preclinical and clinical in vivo imaging scenarios.

Direct approach to compute Jacobians for diffuse optical tomography using perturbation Monte Carlo-based photon "replay"

Perturbation Monte Carlo (pMC) has been previously proposed to rapidly recompute optical measurements when small perturbations of optical properties are considered, but it was largely restricted to changes associated with prior tissue segments or regions-of-interest. In this work, we expand pMC to compute spatially and temporally resolved sensitivity profiles, i.e. the Jacobians, for diffuse optical tomography (DOT) applications. By recording the pseudo random number generator (PRNG) seeds of each detected photon, we are able to "replay" all detected photons to directly create the 3D sensitivity profiles for both absorption and scattering coefficients. We validate the replay-based Jacobians against the traditional adjoint Monte Carlo (aMC) method, and demonstrate the feasibility of using this approach for efficient 3D image reconstructions using in vitro hyperspectral wide-field DOT measurements. The strengths and limitations of the replay approach regarding its computational efficiency and accuracy are discussed, in comparison with aMC, for point-detector systems as well as wide-field pattern-based and hyperspectral imaging systems. The replay approach has been implemented in both of our open-source MC simulators - MCX and MMC (http://mcx.space).

Review of structured light in diffuse optical imaging

Diffuse optical imaging probes deep living tissue enabling structural, functional, metabolic, and molecular imaging. Recently, due to the availability of spatial light modulators, wide-field quantitative diffuse optical techniques have been implemented, which benefit greatly from structured light methodologies. Such implementations facilitate the quantification and characterization of depth-resolved optical and physiological properties of thick and deep tissue at fast acquisition speeds. We summarize the current state of work and applications in the three main techniques leveraging structured light: spatial frequency-domain imaging, optical tomography, and single-pixel imaging. The theory, measurement, and analysis of spatial frequency-domain imaging are described. Then, advanced theories, processing, and imaging systems are summarized. Preclinical and clinical applications on physiological measurements for guidance and diagnosis are summarized. General theory and method development of tomographic approaches as well as applications including fluorescence molecular tomography are introduced. Lastly, recent developments of single-pixel imaging methodologies and applications are reviewed.

Improving mesoscopic fluorescence molecular tomography via preconditioning and regularization

Mesoscopic fluorescence molecular tomography (MFMT) is a novel imaging technique capable of obtaining 3-D distribution of molecular probes inside biological tissues at depths of a few millimeters with a resolution up to ~100 μm. However, the ill-conditioned nature of the MFMT inverse problem severely deteriorates its reconstruction performances. Furthermore, dense spatial sampling and fine discretization of the imaging volume required for high resolution reconstructions make the sensitivity matrix (Jacobian) highly correlated, which prevents even advanced algorithms from achieving optimal solutions. In this work, we propose two computational methods to respectively increase the incoherence of the sensitivity matrix and improve the convergence rate of the inverse solver. We first apply a compressed sensing (CS) based preconditioner on either the whole sensitivity matrix or sub sensitivity matrices to reduce the coherence between columns of the sensitivity matrix. Then we employed a regularization method based on the weight iterative improvement method (WIIM) to mitigate the ill-condition of the sensitivity matrix and to drive the iterative optimization process towards convergence at a faster rate. We performed numerical simulations and phantom experiments to validate the effectiveness of the proposed strategies. In both in silico and in vitro cases, we were able to improve the quality of MFMT reconstructions significantly.

Selective plane illumination microscopy (SPIM) with time-domain fluorescence lifetime imaging microscopy (FLIM) for volumetric measurement of cleared mouse brain samples

We have developed an imaging technique which combines selective plane illumination microscopy with time-domain fluorescence lifetime imaging microscopy (SPIM-FLIM) for three-dimensional volumetric imaging of cleared mouse brains with micro- to mesoscopic resolution. The main features of the microscope include a wavelength-adjustable pulsed laser source (Ti:sapphire) (near-infrared) laser, a BiBO frequency-doubling photonic crystal, a liquid chamber, an electrically focus-tunable lens, a cuvette based sample holder, and an air (dry) objective lens. The performance of the system was evaluated with a lifetime reference dye and micro-bead phantom measurements. Intensity and lifetime maps of three-dimensional human embryonic kidney (HEK) cell culture samples and cleared mouse brain samples expressing green fluorescent protein (GFP) (donor only) and green and red fluorescent protein [positive Förster (fluorescence) resonance energy transfer] were acquired. The results show that the SPIM-FLIM system can be used for sample sizes ranging from single cells to whole mouse organs and can serve as a powerful tool for medical and biological research.

Dental optical tomography with upconversion nanoparticles-a feasibility study

Upconversion nanoparticles (UCNPs) have the unique ability to emit multiple colors upon excitation by near-infrared (NIR) light. Herein, we investigate the potential use of UCNPs as contrast agents for dental optical tomography, with a focus on monitoring the status of fillings after dental restoration. The potential of performing tomographic imaging using UCNP emission of visible or NIR light is established. This in silico and ex vivo study paves the way toward employing UCNPs as theranostic agents for dental applications.

A radiative transfer equation-based image-reconstruction method incorporating boundary conditions for diffuse optical imaging

Developing reconstruction methods for diffuse optical imaging requires accurate modeling of photon propagation, including boundary conditions arising due to refractive index mismatch as photons propagate from the tissue to air. For this purpose, we developed an analytical Neumann-series radiative transport equation (RTE)-based approach. Each Neumann series term models different scattering, absorption, and boundary-reflection events. The reflection is modeled using the Fresnel equation. We use this approach to design a gradient-descent-based analytical reconstruction algorithm for a three-dimensional (3D) setup of a diffuse optical imaging (DOI) system. The algorithm was implemented for a three-dimensional DOI system consisting of a laser source, cuboidal scattering medium (refractive index > 1), and a pixelated detector at one cuboid face. In simulation experiments, the refractive index of the scattering medium was varied to test the robustness of the reconstruction algorithm over a wide range of refractive index mismatches. The experiments were repeated over multiple noise realizations. Results showed that by using the proposed algorithm, the photon propagation was modeled more accurately. These results demonstrated the importance of modeling boundary conditions in the photon-propagation model.

Development of computational small animal models and their applications in preclinical imaging and therapy research

The development of multimodality preclinical imaging techniques and the rapid growth of realistic computer simulation tools have promoted the construction and application of computational laboratory animal models in preclinical research. Since the early 1990s, over 120 realistic computational animal models have been reported in the literature and used as surrogates to characterize the anatomy of actual animals for the simulation of preclinical studies involving the use of bioluminescence tomography, fluorescence molecular tomography, positron emission tomography, single-photon emission computed tomography, microcomputed tomography, magnetic resonance imaging, and optical imaging. Other applications include electromagnetic field simulation, ionizing and nonionizing radiation dosimetry, and the development and evaluation of new methodologies for multimodality image coregistration, segmentation, and reconstruction of small animal images. This paper provides a comprehensive review of the history and fundamental technologies used for the development of computational small animal models with a particular focus on their application in preclinical imaging as well as nonionizing and ionizing radiation dosimetry calculations. An overview of the overall process involved in the design of these models, including the fundamental elements used for the construction of different types of computational models, the identification of original anatomical data, the simulation tools used for solving various computational problems, and the applications of computational animal models in preclinical research. The authors also analyze the characteristics of categories of computational models (stylized, voxel-based, and boundary representation) and discuss the technical challenges faced at the present time as well as research needs in the future.

Multiplexed fluorescence mediated tomography with temporal and spectral data

We recently developed an algorithm for multiplexed fluorescence tomographic imaging of at least four fluorophores concurrently in the red and near-infrared wavelength region by jointly using spectral and temporal data. We report the design of a fluorescence tomography instrument that acquires spectral and temporal data, and validate its use in tissue-mimicking phantoms with four embedded fluorescent targets with highly overlapped spectral signatures. Critically, this requires measurement or computation of extended fluorophore signature libraries, which capture the variability in the measured signal due to the unknown position of the targets in the media. We demonstrate that we can demix and tomographically image all four fluorophores with zero image cross-talk, and 1 mm or better spatial resolution.

Optical methods for quantitative and label-free sensing in living human tissues: principles, techniques, and applications

We present an overview of quantitative and label-free optical methods used to characterize living biological tissues, with an emphasis on emerging applications in clinical tissue diagnostics. Specifically, this review focuses on diffuse optical spectroscopy, imaging, and tomography, optical coherence-based techniques, and non-linear optical methods for molecular imaging. The potential for non- or minimally-invasive assessment, quantitative diagnostics, and continuous monitoring enabled by these tissue-optics technologies provides significant promise for continued clinical translation.

Generalized mesh-based Monte Carlo for wide-field illumination and detection via mesh retessellation

Monte Carlo methods are commonly used as the gold standard in modeling photon transport through turbid media. With the rapid development of structured light applications, an accurate and efficient method capable of simulating arbitrary illumination patterns and complex detection schemes over large surface area is in great need. Here we report a generalized mesh-based Monte Carlo algorithm to support a variety of wide-field illumination methods, including spatial-frequency-domain imaging (SFDI) patterns and arbitrary 2-D patterns. The extended algorithm can also model wide-field detectors such as a free-space CCD camera. The significantly enhanced flexibility of source and detector modeling is achieved via a fast mesh retessellation process that combines the target domain and the source/detector space in a single tetrahedral mesh. Both simulations of complex domains and comparisons with phantom measurements are included to demonstrate the flexibility, efficiency and accuracy of the extended algorithm. Our updated open-source software is provided at http://mcx.space/mmc.

Multiplexed fluorescence tomography with spectral and temporal data: demixing with intrinsic regularization

We consider the joint use of spectral and temporal data for multiplexed fluorescence molecular tomography to enable high-throughput imaging of multiple fluorescent targets in bulk tissue. This is a challenging problem due to the narrow near-infrared diagnostic window and relatively broad emission spectra of common fluorophores, and the distortion ("redshift") that the fluorophore signals undergo as they propagate through tissue. We show through a Cramér-Rao lower bound analysis that demixing with spectral-temporal data could result in an order of magnitude improvement in performance over either modality alone. To cope with the resulting large data set, we propose a novel two-stage algorithm that decouples the demixing and tomographic reconstruction operations. In this work we concentrate on the demixing stage. We introduce an approach which incorporates ideas from sparse subspace clustering and compressed sensing and does not require a regularization parameter. We report on simulations in which we simultaneously demixed four fluorophores with closely overlapping spectral and temporal profiles in a 25 mm diameter cross-sectional area with a root-mean-square error of less than 3% per fluorophore, as well as on studies of sensitivity of the method to model mismatch.

Temporal Data Set Reduction Based on D-Optimality for Quantitative FLIM-FRET Imaging

Fluorescence lifetime imaging (FLIM) when paired with Förster resonance energy transfer (FLIM-FRET) enables the monitoring of nanoscale interactions in living biological samples. FLIM-FRET model-based estimation methods allow the quantitative retrieval of parameters such as the quenched (interacting) and unquenched (non-interacting) fractional populations of the donor fluorophore and/or the distance of the interactions. The quantitative accuracy of such model-based approaches is dependent on multiple factors such as signal-to-noise ratio and number of temporal points acquired when sampling the fluorescence decays. For high-throughput or in vivo applications of FLIM-FRET, it is desirable to acquire a limited number of temporal points for fast acquisition times. Yet, it is critical to acquire temporal data sets with sufficient information content to allow for accurate FLIM-FRET parameter estimation. Herein, an optimal experimental design approach based upon sensitivity analysis is presented in order to identify the time points that provide the best quantitative estimates of the parameters for a determined number of temporal sampling points. More specifically, the D-optimality criterion is employed to identify, within a sparse temporal data set, the set of time points leading to optimal estimations of the quenched fractional population of the donor fluorophore. Overall, a reduced set of 10 time points (compared to a typical complete set of 90 time points) was identified to have minimal impact on parameter estimation accuracy (≈5%), with in silico and in vivo experiment validations. This reduction of the number of needed time points by almost an order of magnitude allows the use of FLIM-FRET for certain high-throughput applications which would be infeasible if the entire number of time sampling points were used.

Mesoscopic Fluorescence Molecular Tomography for Evaluating Engineered Tissues

Optimization of regenerative medicine strategies includes the design of biomaterials, development of cell-seeding methods, and control of cell-biomaterial interactions within the engineered tissues. Among these steps, one paramount challenge is to non-destructively image the engineered tissues in their entirety to assess structure, function, and molecular expression. It is especially important to be able to enable cell phenotyping and monitor the distribution and migration of cells throughout the bulk scaffold. Advanced fluorescence microscopic techniques are commonly employed to perform such tasks; however, they are limited to superficial examination of tissue constructs. Therefore, the field of tissue engineering and regenerative medicine would greatly benefit from the development of molecular imaging techniques which are capable of non-destructive imaging of three-dimensional cellular distribution and maturation within a tissue-engineered scaffold beyond the limited depth of current microscopic techniques. In this review, we focus on an emerging depth-resolved optical mesoscopic imaging technique, termed laminar optical tomography (LOT) or mesoscopic fluorescence molecular tomography (MFMT), which enables longitudinal imaging of cellular distribution in thick tissue engineering constructs at depths of a few millimeters and with relatively high resolution. The physical principle, image formation, and instrumentation of LOT/MFMT systems are introduced. Representative applications in tissue engineering include imaging the distribution of human mesenchymal stem cells embedded in hydrogels, imaging of bio-printed tissues, and in vivo applications.

Wide-field fluorescence molecular tomography with compressive sensing based preconditioning

Wide-field optical tomography based on structured light illumination and detection strategies enables efficient tomographic imaging of large tissues at very fast acquisition speeds. However, the optical inverse problem based on such instrumental approach is still ill-conditioned. Herein, we investigate the benefit of employing compressive sensing-based preconditioning to wide-field structured illumination and detection approaches. We assess the performances of Fluorescence Molecular Tomography (FMT) when using such preconditioning methods both in silico and with experimental data. Additionally, we demonstrate that such methodology could be used to select the subset of patterns that provides optimal reconstruction performances. Lastly, we compare preconditioning data collected using a normal base that offers good experimental SNR against that directly acquired with optimal designed base. An experimental phantom study is provided to validate the proposed technique.

A fast SPAD-based small animal imager for early-photon diffuse optical tomography

Photon scatter is the dominant light transport process in biological tissue and is well understood to degrade imaging performance in near-infrared diffuse optical tomography. Measurement of photons arriving at early times following a short laser pulse is considered to be an effective method to improve this limitation, i.e. by systematically selecting photons that have experienced fewer scattering events. Previously, we tested the performance of single photon avalanche photodiode (SPAD) in measurement of early transmitted photons through diffusive media and showed that it outperformed photo-multiplier tube (PMT) systems in similar configurations, principally due to its faster temporal response. In this paper, we extended this work and developed a fast SPAD-based time-resolved diffuse optical tomography system. As a first validation of the instrument, we scanned an optical phantom with multiple absorbing inclusions and measured full time-resolved data at 3240 scan points per axial slice. We performed image reconstruction with very early-arriving photon data and showed significant improvements compared to time-integrated data. Extension of this work to mice in vivo and measurement of time-resolved fluorescence data is the subject of ongoing research.

Accelerating fDOT image reconstruction based on path-history fluorescence Monte Carlo model by using three-level parallel architecture

The excessive time required by fluorescence diffuse optical tomography (fDOT) image reconstruction based on path-history fluorescence Monte Carlo model is its primary limiting factor. Herein, we present a method that accelerates fDOT image reconstruction. We employ three-level parallel architecture including multiple nodes in cluster, multiple cores in central processing unit (CPU), and multiple streaming multiprocessors in graphics processing unit (GPU). Different GPU memories are selectively used, the data-writing time is effectively eliminated, and the data transport per iteration is minimized. Simulation experiments demonstrated that this method can utilize general-purpose computing platforms to efficiently implement and accelerate fDOT image reconstruction, thus providing a practical means of using path-history-based fluorescence Monte Carlo model for fDOT imaging.

Assessment of Gate Width Size on Lifetime-Based Förster Resonance Energy Transfer Parameter Estimation

Förster Resonance Energy Transfer (FRET) enables the observation of interactions at the nanoscale level through the use of fluorescence optical imaging techniques. In FRET, fluorescence lifetime imaging can be used to quantify the fluorescence lifetime changes of the donor molecule, which are associated with proximity between acceptor and donor molecules. Among the FRET parameters derived from fluorescence lifetime imaging, the percentage of donor that interacts with the acceptor (in proximity) can be estimated via model-based fitting. However, estimation of the lifetime parameters can be affected by the acquisition parameters such as the temporal characteristics of the imaging system. Herein, we investigate the effect of various gate widths on the accuracy of estimation of FRET parameters with focus on the near-infrared spectral window. Experiments were performed in silico, in vitro, and in vivo with gate width sizes ranging from 300 ps to 1000 ps in intervals of 100 ps. For all cases, the FRET parameters were retrieved accurately and the imaging acquisition time was decreased three-fold. These results indicate that increasing the gate width up to 1000 ps still allows for accurate quantification of FRET interactions even in the case of short lifetimes such as those encountered with near-infrared FRET pairs.

Fast single photon avalanche photodiode-based time-resolved diffuse optical tomography scanner

Resolution in diffuse optical tomography (DOT) is a persistent problem and is primarily limited by high degree of light scatter in biological tissue. We showed previously that the reduction in photon scatter between a source and detector pair at early time points following a laser pulse in time-resolved DOT is highly dependent on the temporal response of the instrument. To this end, we developed a new single-photon avalanche photodiode (SPAD) based time-resolved DOT scanner. This instrument uses an array of fast SPADs, a femto-second Titanium Sapphire laser and single photon counting electronics. In combination, the overall instrument temporal impulse response function width was 59 ps. In this paper, we report the design of this instrument and validate its operation in symmetrical and irregularly shaped optical phantoms of approximately small animal size. We were able to accurately reconstruct the size and position of up to 4 absorbing inclusions, with increasing image quality at earlier time windows. We attribute these results primarily to the rapid response time of our instrument. These data illustrate the potential utility of fast SPAD detectors in time-resolved DOT.

Video-rate two-photon excited fluorescence lifetime imaging system with interleaved digitization

A fast (up to video rate) two-photon excited fluorescence lifetime imaging system based on interleaved digitization is demonstrated. The system is compatible with existing beam-scanning microscopes with minor electronics and software modification. Proof-of-concept demonstrations were performed using laser dyes and biological tissue.

Mesh Optimization for Monte Carlo-Based Optical Tomography

Mesh-based Monte Carlo techniques for optical imaging allow for accurate modeling of light propagation in complex biological tissues. Recently, they have been developed within an efficient computational framework to be used as a forward model in optical tomography. However, commonly employed adaptive mesh discretization techniques have not yet been implemented for Monte Carlo based tomography. Herein, we propose a methodology to optimize the mesh discretization and analytically rescale the associated Jacobian based on the characteristics of the forward model. We demonstrate that this method maintains the accuracy of the forward model even in the case of temporal data sets while allowing for significant coarsening or refinement of the mesh.

Hyperspectral time-resolved wide-field fluorescence molecular tomography based on structured light and single-pixel detection

We present a time-resolved fluorescence diffuse optical tomography platform that is based on wide-field structured illumination, single-pixel detection, and hyperspectral acquisition. Two spatial light modulators (digital micro-mirror devices) are employed to generate independently wide-field illumination and detection patterns, coupled with a 16-channel spectrophotometer detection module to capture hyperspectral time-resolved tomographic data sets. The main system characteristics are reported, and we demonstrate the feasibility of acquiring dense 4D tomographic data sets (space, time, spectra) for time domain 3D quantitative multiplexed fluorophore concentration mapping in turbid media.

Evaluation of path-history-based fluorescence Monte Carlo method for photon migration in heterogeneous media

The path-history-based fluorescence Monte Carlo method used for fluorescence tomography imaging reconstruction has attracted increasing attention. In this paper, we first validate the standard fluorescence Monte Carlo (sfMC) method by experimenting with a cylindrical phantom. Then, we describe a path-history-based decoupled fluorescence Monte Carlo (dfMC) method, analyze different perturbation fluorescence Monte Carlo (pfMC) methods, and compare the calculation accuracy and computational efficiency of the dfMC and pfMC methods using the sfMC method as a reference. The results show that the dfMC method is more accurate and efficient than the pfMC method in heterogeneous medium.

High-resolution mesoscopic fluorescence molecular tomography based on compressive sensing

Mesoscopic fluorescence molecular tomography (MFMT) is new imaging modality aiming at 3-D imaging of molecular probes in a few millimeter thick biological samples with high-spatial resolution. In this paper, we develop a compressive sensing-based reconstruction method with l1-norm regularization for MFMT with the goal of improving spatial resolution and stability of the optical inverse problem. Three-dimensional numerical simulations of anatomically accurate microvasculature and real data obtained from phantom experiments are employed to evaluate the merits of the proposed method. Experimental results show that the proposed method can achieve 80 μm spatial resolution for a biological sample of 3 mm thickness and more accurate quantifications of concentrations and locations for the fluorophore distribution than those of the conventional methods.

L(p) regularization for early gate fluorescence molecular tomography

Time domain fluorescence molecular tomography (TD-FMT) provides a unique dataset for enhanced quantification and spatial resolution. The time-gate dataset can be divided into two temporal groups around the maximum counts gate, which are early gates and late gates. It is well established that early gates allow for improved spatial resolution and late gates are essential for fluorophore unmixing and concentration quantification. However, the inverse problem of FMT is ill-posed and typically underdetermined, which makes image reconstruction highly susceptible to data noise. More specifically, photon counts are inherently very low at early gates due to high absorption and scattering of tissue, resulting in a low signal-to-noise ratio and unstable reconstructions. In this work, an L(p) regularization-based reconstruction algorithm was developed and tested with our wide-field mesh-based Monte Carlo simulation strategy. We compared the early time-gate reconstructions obtained with the different p (p∈{1/16,1/8,1/4,1/3,1/2,1,2}) from a synthetic murine model simulating the fluorophore uptake in the kidneys and preclinical data. The results from a 3D mouse atlas and a mouse experiment show that our L(1/4) regularization methods give the best performance for early time gates reconstructions.

Instrumentation in Diffuse Optical Imaging

Diffuse optical imaging is highly versatile and has a very broad range of applications in biology and medicine. It covers diffuse optical tomography, fluorescence diffuse optical tomography, bioluminescence, and a number of other new imaging methods. These methods of diffuse optical imaging have diversified instrument configurations but share the same core physical principle – light propagation in highly diffusive media, i.e., the biological tissue. In this review, the author summarizes the latest development in instrumentation and methodology available to diffuse optical imaging in terms of system architecture, light source, photo-detection, spectral separation, signal modulation, and lastly imaging contrast.

Tomographic lifetime imaging using combined early- and late-arriving photons

We present a novel, hybrid approach for time domain fluorescence tomography that efficiently combines lifetime multiplexing using late-arriving or asymptotic photons, with the high spatial resolution capability of early photon tomography. We also show that a decay amplitude-based asymptotic approach is superior to direct inversion of late-arriving photons for tomographic lifetime imaging within turbid media. The hybrid reconstruction approach is experimentally shown to recover fluorescent inclusions separated as close as 1.4 mm, with improved resolution and reduced cross talk compared to just using early photons or the asymptotic approach alone.

Extension of the GATE Monte-Carlo simulation package to model bioluminescence and fluorescence imaging

The Geant4 Application for Emission Tomography (GATE) is an advanced open-source software dedicated to Monte-Carlo (MC) simulations in medical imaging involving photon transportation (Positron emission tomography, single photon emission computed tomography, computed tomography) and in particle therapy. In this work, we extend the GATE to support simulations of optical imaging, such as bioluminescence or fluorescence imaging, and validate it against the MC for multilayered media standard simulation tool for biomedical optics in simple geometries. A full simulation set-up for molecular optical imaging (bioluminescence and fluorescence) is implemented in GATE, and images of the light distribution emitted from a phantom demonstrate the relevance of using GATE for optical imaging simulations.

Non-invasive in vivo imaging of near infrared-labeled transferrin in breast cancer cells and tumors using fluorescence lifetime FRET

The conjugation of anti-cancer drugs to endogenous ligands has proven to be an effective strategy to enhance their pharmacological selectivity and delivery towards neoplasic tissues. Since cell proliferation has a strong requirement for iron, cancer cells express high levels of transferrin receptors (TfnR), making its ligand, transferrin (Tfn), of great interest as a delivery agent for therapeutics. However, a critical gap exists in the ability to non-invasively determine whether drugs conjugated to Tfn are internalized into target cells in vivo. Due to the enhanced permeability and retention (EPR) effect, it remains unknown whether these Tfn-conjugated drugs are specifically internalized into cancer cells or are localized non-specifically as a result of a generalized accumulation of macromolecules near tumors. By exploiting the dimeric nature of the TfnR that binds two molecules of Tfn in close proximity, we utilized a Förster Resonance Energy Transfer (FRET) based technique that can discriminate bound and internalized Tfn from free, soluble Tfn. In order to non-invasively visualize intracellular amounts of Tfn in tumors through live animal tissues, we developed a novel near infrared (NIR) fluorescence lifetime FRET imaging technique that uses an active wide-field time gated illumination platform. In summary, we report that the NIR fluorescence lifetime FRET technique is capable of non-invasively detecting bound and internalized forms of Tfn in cancer cells and tumors within a live small animal model, and that our results are quantitatively consistent when compared to well-established intensity-based FRET microscopy methods used in in vitro experiments.

Time-domain geometrical localization of point-like fluorescence inclusions in turbid media with early photon arrival times

We introduce a novel approach for localizing a plurality of discrete point-like fluorescent inclusions embedded in a thick turbid medium using time-domain measurements. The approach uses early photon information contained in measured time-of-flight distributions originating from fluorescence emission. Fluorescence time point-spread functions (FTPSFs) are acquired with ultrafast time-correlated single photon counting after short pulse laser excitation. Early photon arrival times are extracted from the FTPSFs obtained from several source-detector positions. Each source-detector measurement allows defining a geometrical locus where an inclusion is to be found. These loci take the form of ovals in 2D or ovoids in 3D. From these loci a map can be built, with the maxima thereof corresponding to positions of inclusions. This geometrical approach is supported by Monte Carlo simulations performed for biological tissue-like media with embedded fluorescent inclusions. To validate the approach, several experiments are conducted with a homogeneous phantom mimicking tissue optical properties. In the experiments, inclusions filled with indocyanine green are embedded in the phantom and the fluorescence response to a short pulse of excitation laser is recorded. With our approach, several inclusions can be localized with low millimeter positional error. Our results support the approach as an accurate, efficient, and fast method for localizing fluorescent inclusions embedded in highly turbid media mimicking biological tissues. Further Monte Carlo simulations on a realistic mouse model show the feasibility of the technique for small animal imaging.

Resolution below the point spread function for diffuse optical imaging using fluorescence lifetime multiplexing

We show that asymptotic lifetime-based fluorescence tomography can localize multiple-lifetime targets separated well below the diffuse point spread function of a turbid medium. This is made possible due to a complete diagonalization of the time domain forward problem in the asymptotic limit. We also show that continuous wave or direct time gate approaches to fluorescence tomography are unable to achieve this separation, indicating the unique advantage of a decay-amplitude-based approach for tomographic lifetime multiplexing with time domain data.

Molecular Optical Simulation Environment (MOSE): a platform for the simulation of light propagation in turbid media

The study of light propagation in turbid media has attracted extensive attention in the field of biomedical optical molecular imaging. In this paper, we present a software platform for the simulation of light propagation in turbid media named the “Molecular Optical Simulation Environment (MOSE)”. Based on the gold standard of the Monte Carlo method, MOSE simulates light propagation both in tissues with complicated structures and through free-space. In particular, MOSE synthesizes realistic data for bioluminescence tomography (BLT), fluorescence molecular tomography (FMT), and diffuse optical tomography (DOT). The user-friendly interface and powerful visualization tools facilitate data analysis and system evaluation. As a major measure for resource sharing and reproducible research, MOSE aims to provide freeware for research and educational institutions, which can be downloaded at http://www.mosetm.net.

Adaptive wide-field optical tomography

We describe a wide-field optical tomography technique, which allows the measurement-guided optimization of illumination patterns for enhanced reconstruction performances. The iterative optimization of the excitation pattern aims at reducing the dynamic range in photons transmitted through biological tissue. It increases the number of measurements collected with high photon counts resulting in a dataset with improved tomographic information. Herein, this imaging technique is applied to time-resolved fluorescence molecular tomography for preclinical studies. First, the merit of this approach is tested by in silico studies in a synthetic small animal model for typical illumination patterns. Second, the applicability of this approach in tomographic imaging is validated in vitro using a small animal phantom with two fluorescent capillaries occluded by a highly absorbing inclusion. The simulation study demonstrates an improvement of signal transmitted (∼2 orders of magnitude) through the central portion of the small animal model for all patterns considered. A corresponding improvement in the signal at the emission wavelength by 1.6 orders of magnitude demonstrates the applicability of this technique for fluorescence molecular tomography. The successful discrimination and localization (∼1  mm error) of the two objects with higher resolution using the optimized patterns compared with nonoptimized illumination establishes the improvement in reconstruction performance when using this technique.

Quantitative tomographic imaging of intermolecular FRET in small animals

Forster resonance energy transfer (FRET) is a nonradiative transfer of energy between two fluorescent molecules (a donor and an acceptor) in nanometer range proximity. FRET imaging methods have been applied to proteomic studies and drug discovery applications based on intermolecular FRET efficiency measurements and stoichiometric measurements of FRET interaction as quantitative parameters of interest. Importantly, FRET provides information about biomolecular interactions at a molecular level, well beyond the diffraction limits of standard microscopy techniques. The application of FRET to small animal imaging will allow biomedical researchers to investigate physiological processes occurring at nanometer range in vivo as well as in situ. In this work a new method for the quantitative reconstruction of FRET measurements in small animals, incorporating a full-field tomographic acquisition system with a Monte Carlo based hierarchical reconstruction scheme, is described and validated in murine models. Our main objective is to estimate the relative concentration of two forms of donor species, i.e., a donor molecule involved in FRETing to an acceptor close by and a nonFRETing donor molecule.

In vivo validation of quantitative frequency domain fluorescence tomography

We have developed a hybrid frequency domain fluorescence tomography and magnetic resonance imaging system (MRI) for small animal imaging. The main purpose of this system is to obtain quantitatively accurate fluorescence concentration and lifetime images using a multi-modality approach. In vivo experiments are undertaken to evaluate the system. We compare the recovered fluorescence parameters with and without MRI structural a priori information. In addition, we compare two optical background heterogeneity correction methods: Born normalization and utilizing diffuse optical tomography (DOT) functional a priori information. The results show that the concentration and lifetime of a 4.2-mm diameter indocyanine green inclusion located 15 mm deep inside a rat can be recovered with less than a 5% error when functional a priori information from DOT and structural a priori information from MRI are utilized.

Direct Monte Carlo computation of time-resolved fluorescence in heterogeneous turbid media

We show that a multiexponential model for time-resolved fluorescence allows the use of an absorption-perturbation Monte Carlo (MC) approach based on stored photon path histories. This enables the rapid fitting of fluorescence yield, lifetimes, and background tissue absorptions in complex heterogeneous media within a few seconds, without the need for temporal convolutions or MC recalculation of photon path lengths. We validate this method using simulations with both a slab and a heterogeneous model of the mouse head.

Ex vivo fluorescence molecular tomography of the spine

We investigated the potential of fluorescence molecular tomography to image ex vivo samples collected from a large animal model, in this case, a dog spine. Wide-field time-gated fluorescence tomography was employed to assess the impact of multiview acquisition, data type, and intrinsic optical properties on the localization and quantification accuracy in imaging a fluorescent inclusion in the intervertebral disk. As expected, the TG data sets, when combining early and late gates, provide significantly better performances than the CW data sets in terms of localization and quantification. Moreover, the use of multiview imaging protocols led to more accurate localization. Additionally, the incorporation of the heterogeneous nature of the tissue in the model to compute the Jacobians led to improved imaging performances. This preliminary imaging study provides a proof of concept of the feasibility of quantitatively imaging complex ex vivo samples nondestructively and with short acquisition times. This work is the first step towards employing optical molecular imaging of the spine to detect and characterize disc degeneration based on targeted fluorescent probes.

Mesh-based Monte Carlo method in time-domain widefield fluorescence molecular tomography

We evaluated the potential of mesh-based Monte Carlo (MC) method for widefield time-gated fluorescence molecular tomography, aiming to improve accuracy in both shape discretization and photon transport modeling in preclinical settings. An optimized software platform was developed utilizing multithreading and distributed parallel computing to achieve efficient calculation. We validated the proposed algorithm and software by both simulations and in vivo studies. The results establish that the optimized mesh-based Monte Carlo (mMC) method is a computationally efficient solution for optical tomography studies in terms of both calculation time and memory utilization. The open source code, as part of a new release of mMC, is publicly available at http://mcx.sourceforge.net/mmc/.

Micro-computed tomography-guided, non-equal voxel Monte Carlo method for reconstruction of fluorescence molecular tomography

The study of dual-modality technology which combines microcomputed tomography (micro-CT) and fluorescence molecular tomography (FMT) has become one of the main focuses in FMT. However, because of the diversity of the optical properties and irregular geometry for small animals, a reconstruction method that can effectively utilize the high-resolution structural information of micro-CT for tissue with arbitrary optical properties is still one of the most challenging problems in FMT. We develop a micro-CT-guided non-equal voxel Monte Carlo method for FMT reconstruction. With the guidance of micro-CT, precise voxel binning can be conducted on the irregular boundary or region of interest. A modified Laplacian regularization method is also proposed to accurately reconstruct the distribution of the fluorescent yield for non-equal space voxels. Simulations and phantom experiments show that this method not only effectively reduces the loss of high-resolution structural information of micro-CT in irregular boundaries and increases the accuracy of the FMT algorithm in both forward and inverse problems, but the method also has a small Jacobian matrix and a short reconstruction time. At last, we performed small animal imaging to validate our method.

Simulating photon-transport in uniform media using the radiative transport equation: a study using the Neumann-series approach

We present the implementation, validation, and performance of a Neumann-series approach for simulating light propagation at optical wavelengths in uniform media using the radiative transport equation (RTE). The RTE is solved for an anisotropic-scattering medium in a spherical harmonic basis for a diffuse-optical-imaging setup. The main objectives of this paper are threefold: to present the theory behind the Neumann-series form for the RTE, to design and develop the mathematical methods and the software to implement the Neumann series for a diffuse-optical-imaging setup, and, finally, to perform an exhaustive study of the accuracy, practical limitations, and computational efficiency of the Neumann-series method. Through our results, we demonstrate that the Neumann-series approach can be used to model light propagation in uniform media with small geometries at optical wavelengths.

Imaging a photodynamic therapy photosensitizer in vivo with a time-gated fluorescence tomography system

We report the tomographic imaging of a photodynamic therapy (PDT) photosensitizer, 2-(1-hexyloxyethyl)-2-devinyl pyropheophorbide-a (HPPH) in vivo with time-domain fluorescence diffuse optical tomography (TD-FDOT). Simultaneous reconstruction of fluorescence yield and lifetime of HPPH was performed before and after PDT. The methodology was validated in phantom experiments, and depth-resolved in vivo imaging was achieved through simultaneous three-dimensional (3-D) mappings of fluorescence yield and lifetime contrasts. The tomographic images of a human head-and-neck xenograft in a mouse confirmed the preferential uptake and retention of HPPH by the tumor 24-h post-injection. HPPH-mediated PDT induced significant changes in fluorescence yield and lifetime. This pilot study demonstrates that TD-FDOT may be a good imaging modality for assessing photosensitizer distributions in deep tissue during PDT monitoring.

Construction of the Jacobian matrix for fluorescence diffuse optical tomography using a perturbation Monte Carlo method

Image formation in fluorescence diffuse optical tomography is critically dependent on construction of the Jacobian matrix. For clinical and preclinical applications, because of the highly heterogeneous characteristics of the medium, Monte Carlo methods are frequently adopted to construct the Jacobian. Conventional adjoint Monte Carlo method typically compute the Jacobian by multiplying the photon density fields radiated from the source at the excitation wavelength and from the detector at the emission wavelength. Nonetheless, this approach assumes that the source and the detector in Green's function are reciprocal, which is invalid in general. This assumption is particularly questionable in small animal imaging, where the mean free path length of photons is typically only one order of magnitude smaller than the representative dimension of the medium. We propose a new method that does not rely on the reciprocity of the source and the detector by tracing photon propagation entirely from the source to the detector. This method relies on the perturbation Monte Carlo theory to account for the differences in optical properties of the medium at the excitation and the emission wavelengths. Compared to the adjoint methods, the proposed method is more valid in reflecting the physical process of photon transport in diffusive media and is more efficient in constructing the Jacobian matrix for densely sampled configurations.