Total variation regularization for 3D reconstruction in fluorescence tomography: experimental phantom studies

Fluorescence molecular tomography for quantum yield and lifetime

Fluorescence molecular tomography (FMT) is a promising modality for noninvasive imaging of internal fluorescence agents in biological tissues, especially in small animal models, with applications in diagnosis, therapy, and drug design. In this paper, we present a fluorescent reconstruction algorithm that combines time-resolved fluorescence imaging data with photon-counting microcomputed tomography (PCMCT) images to estimate the quantum yield and lifetime of fluorescent markers in a mouse model. By incorporating PCMCT images, a permissible region of interest of fluorescence yield and lifetime can be roughly estimated as prior knowledge, reducing the number of unknown variables in the inverse problem and improving the image reconstruction stability. Our numerical experiments demonstrate the accuracy and stability of the proposed reconstruction method in the presence of data noise, achieving a reconstruction error of 0.02 ns for the fluorescence lifetime and an average relative error of 18% for quantum yield reconstruction.

D2-RecST: Dual-domain joint reconstruction strategy for fluorescence molecular tomography based on image domain and perception domain

BACKGROUND AND OBJECTIVE

Fluorescence molecular tomography (FMT) is a promising molecular imaging modality for quantifying the three-dimensional (3D) distribution of fluorescent probes in small animals. Over the past few years, learning-based FMT reconstruction methods have achieved promising results. However, these methods typically attempt to minimize the mean-squared error (MSE) between the reconstructed image and the ground truth. Although signal-to-noise ratios (SNRs) are improved, they are susceptible to non-uniform artifacts and loss of structural detail, making it extremely challenging to obtain accurate and robust FMT reconstructions under noisy measurements.

METHODS

We propose a novel dual-domain joint strategy based on the image domain and perception domain for accurate and robust FMT reconstruction. First, we formulate an explicit adversarial learning strategy in the image domain, which greatly facilitates training and optimization through two enhanced networks to improve anti-noise ability. Besides, we introduce a novel transfer learning strategy in the perceptual domain to optimize edge details by providing perceptual priors for fluorescent targets. Collectively, the proposed dual-domain joint reconstruction strategy can significantly eliminate the non-uniform artifacts and effectively preserve the structural edge details.

RESULTS

Both numerical simulations and in vivo mouse experiments demonstrate that the proposed method markedly outperforms traditional and cutting-edge methods in terms of positioning accuracy, image contrast, robustness, and target morphological recovery.

CONCLUSIONS

The proposed method achieves the best reconstruction performance and has great potential to facilitate precise localization and 3D visualization of tumors in in vivo animal experiments.

Reconstruction of fluorophore absorption and fluorescence lifetime using early photon mesoscopic fluorescence molecular tomography: a phantom study

SIGNIFICANCE

Fluorescence molecular lifetime tomography (FMLT) plays an increasingly important role in experimental oncology. The article presents and experimentally verifies an original method of mesoscopic time domain FMLT, based on an asymptotic approximation to the fluorescence source function, which is valid for early arriving photons.

AIM

The aim was to justify the efficiency of the method by experimental scanning and reconstruction of a phantom with a fluorophore. The experimental facility included the TCSPC system, the pulsed supercontinuum Fianium laser, and a three-channel fiber probe. Phantom scanning was done in mesoscopic regime for three-dimensional (3D) reflectance geometry.

APPROACH

The sensitivity functions were simulated with a Monte Carlo method. A compressed-sensing-like reconstruction algorithm was used to solve the inverse problem for the fluorescence parameter distribution function, which included the fluorophore absorption coefficient and fluorescence lifetime distributions. The distributions were separated directly in the time domain with the QR-factorization least square method.

RESULTS

3D tomograms of fluorescence parameters were obtained and analyzed using two strategies for the formation of measurement data arrays and sensitivity matrices. An algorithm is developed for the flexible choice of optimal strategy in view of attaining better reconstruction quality. Variants on how to improve the method are proposed, specifically, through stepped extraction and further use of a posteriori information about the object.

CONCLUSIONS

Even if measurement data are limited, the proposed method is capable of giving adequate reconstructions but their quality depends on available a priori (or a posteriori) information. Further research aims to improve the method by implementing the variants proposed.

A review of advances in imaging methodology in fluorescence molecular tomography

Objective. Fluorescence molecular tomography (FMT) is a promising non-invasive optical molecular imaging technology with strong specificity and sensitivity that has great potential for preclinical and clinical studies in tumor diagnosis, drug development and therapeutic evaluation. However, the strong scattering of photons and insufficient surface measurements make it very challenging to improve the quality of FMT image reconstruction and its practical application for early tumor detection. Therefore, continuous efforts have been made to explore more effective approaches or solutions in the pursuit of high-quality FMT reconstructions. Approach. This review takes a comprehensive overview of advances in imaging methodology for FMT, mainly focusing on two critical issues in FMT reconstructions: improving the accuracy of solving the forward physical model and mitigating the ill-posed nature of the inverse problem from a methodological point of view. More importantly, numerous impressive and practical strategies and methods for improving the quality of FMT reconstruction are summarized. Notably, deep learning methods are discussed in detail to illustrate their advantages in promoting the imaging performance of FMT thanks to large datasets, the emergence of optimized algorithms and the application of innovative networks. Main results. The results demonstrate that the imaging quality of FMT can be effectively promoted by improving the accuracy of optical parameter modeling, combined with prior knowledge, and reducing dimensionality. In addition, the traditional regularization-based methods and deep neural network-based methods, especially end-to-end deep networks, can enormously alleviate the ill-posedness of the inverse problem and improve the quality of FMT image reconstruction. Significance. This review aims to illustrate a variety of effective and practical methods for the reconstruction of FMT images that may benefit future research. Furthermore, it may provide some valuable research ideas and directions for FMT in the future, and could promote, to a certain extent, the development of FMT and other methods of optical tomography.

Nonconvex Laplacian Manifold Joint Method for Morphological Reconstruction of Fluorescence Molecular Tomography

PURPOSE

Fluorescence molecular tomography (FMT) is a promising technique for three-dimensional (3D) visualization of biomarkers in small animals. Morphological reconstruction is valuable and necessary for further applications of FMT owing to its innate requirement for knowledge of the molecular probe distributions.

PROCEDURES

In this study, a Laplacian manifold regularization joint ℓ_1/2-norm model is proposed for morphological reconstruction and solved by a nonconvex algorithm commonly referred to as the half-threshold algorithm. The model is combined with the structural and sparsity priors to achieve the location and structure of the target. In addition, two improvement forms (truncated and hybrid truncated forms) are proposed for better morphological reconstruction. The truncated form is proposed for balancing the sharpness and smoothness of the boundary of reconstruction. A hybrid truncated form is proposed for more structural priors. To evaluate the proposed methods, three simulation studies (morphological, robust, and double target analyses) and an in vivo experiment were performed.

RESULTS

The proposed methods demonstrated morphological accuracy, location accuracy, and reconstruction robustness in glioma simulation studies. An in vivo experiment with an orthotopic glioma mouse model confirmed the advantages of the proposed methods. The proposed methods always yielded the best intersection of union (IoU) in simulations and in vivo experiments (mean of 0.80 IoU).

CONCLUSIONS

Simulation studies and in vivo experiments demonstrate that the proposed half-threshold hybrid truncated Laplacian algorithm had an improved performance compared with the comparative algorithm in terms of morphology.

Early-photon reflectance fluorescence molecular tomography for small animal imaging: Mathematical model and numerical experiment

The paper presents an original approach to time-domain reflectance fluorescence molecular tomography (FMT) of small animals. It is based on the use of early arriving photons and state-of-the-art compressed-sensing-like reconstruction algorithms and aims to improve the spatial resolution of fluorescent images. We deduce the fundamental equation that models the imaging operator and derive analytical representations for the sensitivity functions which are responsible for the reconstruction of the fluorophore absorption coefficient. The idea of fluorescence lifetime tomography with our approach is also discussed. We conduct a numerical experiment on 3D reconstruction of box phantoms with spherical fluorescent inclusions of small diameters. For modeling measurement data and constructing the sensitivity matrix we assume a virtual fluorescence tomograph with a scanning fiber probe that illuminates and collects light in reflectance geometry. It provides for large source-receiver separations which correspond to the macroscopic regime. Two compressed-sensing-like reconstruction algorithms are used to solve the inverse problem. These are the algebraic reconstruction technique with total variation regularization and our modification of the fast iterative shrinkage-thresholding algorithm. Results of our numerical experiment show that our approach is capable of achieving as good spatial resolution as 0.2 mm and even better at depths to 9 mm inclusive.

K-Nearest Neighbor Based Locally Connected Network for Fast Morphological Reconstruction in Fluorescence Molecular Tomography

Fluorescence molecular tomography (FMT) is a highly sensitive and noninvasive imaging modality for three-dimensional visualization of fluorescence probe distribution in small animals. However, the simplified photon propagation model and ill-posed inverse problem limit the improvement of FMT reconstruction. In this work, we proposed a novel K-nearest neighbor based locally connected (KNN-LC) network to improve the performance of morphological reconstruction in FMT. It directly builds the inverse process of photon transmission by learning the mapping relation between the surface photon intensity and the distribution of fluorescent source. KNN-LC network cascades a fully connected (FC) sub-network with a locally connected (LC) sub-network, where the FC part provides a coarse reconstruction result and LC part fine-tunes the morphological quality of reconstructed result. To assess the performance of our proposed network, we implemented both numerical simulation and in vivo studies. Furthermore, split Bregman-resolved total variation (SBRTV) regularization method and inverse problem simulation (IPS) method were utilized as baselines in all comparisons. The results demonstrated that KNN-LC network achieved accurate reconstruction in both source localization and morphology recovery in a short time. This promoted the in vivo application of FMT for visualizing the distribution of biomarkers inside biological tissue.

Fast and robust reconstruction algorithm for fluorescence diffuse optical tomography assuming a cuboid target

A fast algorithm for fluorescence diffuse optical tomography is proposed. The algorithm is robust against the choice of initial guesses. We estimate the position of a fluorescent target by assuming a cuboid (rectangular parallelepiped) for the fluorophore target. The proposed numerical algorithm is verified by a numerical experiment and an experiment with a meat phantom. The target position is reconstructed with a cuboid from measurements in the time domain. Moreover, the long-time behavior of the emission light is investigated making use of the analytical solution to the diffusion equation.

Adaptive Gaussian Weighted Laplace Prior Regularization Enables Accurate Morphological Reconstruction in Fluorescence Molecular Tomography

Fluorescence molecular tomography (FMT), as a powerful imaging technique in preclinical research, can offer the three-dimensional distribution of biomarkers by detecting the fluorescently labelled probe noninvasively. However, because of the light scattering effect and the ill-pose of inverse problem, it is challenging to develop an efficient reconstruction method, which can provide accurate location and morphology of the fluorescence distribution. In this research, we proposed a novel adaptive Gaussian weighted Laplace prior (AGWLP) regularization method, which assumed the variance of fluorescence intensity between any two voxels had a non-linear correlation with their Gaussian distance. It utilized an adaptive Gaussian kernel parameter strategy to achieve accurate morphological reconstructions in FMT. To evaluate the performance of the AGWLP method, we conducted numerical simulation and in vivo experiments. The results were compared with fast iterative shrinkage (FIS) thresholding method, split Bregman-resolved TV (SBRTV) regularization method, and Gaussian weighted Laplace prior (GWLP) regularization method. We validated in vivo imaging results against planar fluorescence images of frozen sections. The results demonstrated that the AGWLP method achieved superior performance in both location and shape recovery of fluorescence distribution. This enabled FMT more suitable and practical for in vivo visualization of biomarkers.

Fast-time consecutive confocal image deblurring using spatiotemporal fused regularization

Confocal fluorescence microscopy has become a cardinal workhorse instrument in biological research due to its high imaging speed and tissue penetration depth. Unfortunately, the sampled fluorescence signals are intrinsically distorted by optical blurs and photon-counting noise, and the deconvolution method has been introduced to attenuate these degradations. In this paper, we focus mainly on scenarios suffering from severe noise due to low exposure time in a fast-imaging system. To begin with, a Hessian penalty was adopted to depress the artificial staircase effects that were caused by the first-order model (e.g., total variation). Then, to compensate for the weak ability to remove blurring and the produced white-point artifacts of the second-order penalty, we additionally proposed a consistent constraint along the temporal axis based on structural continuity. A remarkable merit of the spatiotemporal fused regularization is retaining the ability of the Hessian matrix to keep details smooth while effectively removing blurring. We employed an alternating-direction-method-of-multipliers algorithm for the corresponding optimization problem. Finally, we conducted experimental comparisons of both the simulated and practical confocal platform, and the excellent performance of the proposed approach reflects the efficiency of the confocal deconvolution work.

Sparse view cone beam X-ray luminescence tomography based on truncated singular value decomposition

Cone beam X-ray luminescence computed tomography (CB-XLCT) has been proposed as a promising hybrid imaging technique. Though it has the advantage of fast imaging, the inverse problem of CB-XLCT is seriously ill-conditioned, making the image quality quite poor, especially for imaging multi-targets. To achieve fast imaging of multi-targets, which is essential for in vivo applications, a truncated singular value decomposition (TSVD) based sparse view CB-XLCT reconstruction method is proposed in this study. With the weight matrix of the CB-XLCT system being converted to orthogonal by TSVD, the compressed sensing (CS) based L₁-norm method could be applied for fast reconstruction from fewer projection views. Numerical simulations and phantom experiments demonstrate that by using the proposed method, two targets with different edge-to-edge distances (EEDs) could be resolved effectively. It indicates that the proposed method could improve the imaging quality of multi-targets significantly in terms of localization accuracy, target shape, image contrast, and spatial resolution, when compared with conventional methods.

A three-step reconstruction method for fluorescence molecular tomography based on compressive sensing

Fluorescence molecular tomography (FMT) is a promising tool for real time in vivo quantification of neurotransmission (NT) as we pursue in our BRAIN initiative effort. However, the acquired image data are noisy and the reconstruction problem is ill-posed. Further, while spatial sparsity of the NT effects could be exploited, traditional compressive-sensing methods cannot be directly applied as the system matrix in FMT is highly coherent. To overcome these issues, we propose and assess a three-step reconstruction method. First, truncated singular value decomposition is applied on the data to reduce matrix coherence. The resultant image data are input to a homotopy-based reconstruction strategy that exploits sparsity via ℓ₁ regularization. The reconstructed image is then input to a maximum-likelihood expectation maximization (MLEM) algorithm that retains the sparseness of the input estimate and improves upon the quantitation by accurate Poisson noise modeling. The proposed reconstruction method was evaluated in a three-dimensional simulated setup with fluorescent sources in a cuboidal scattering medium with optical properties simulating human brain cortex (reduced scattering coefficient: 9.2 cm^-1, absorption coefficient: 0.1 cm^-1) and tomographic measurements made using pixelated detectors. In different experiments, fluorescent sources of varying size and intensity were simulated. The proposed reconstruction method provided accurate estimates of the fluorescent source intensity, with a 20% lower root mean square error on average compared to the pure-homotopy method for all considered source intensities and sizes. Further, compared with conventional ℓ₂ regularized algorithm, overall, the proposed method reconstructed substantially more accurate fluorescence distribution. The proposed method shows considerable promise and will be tested using more realistic simulations and experimental setups.

ODTbrain: a Python library for full-view, dense diffraction tomography

BACKGROUND

Analyzing the three-dimensional (3D) refractive index distribution of a single cell makes it possible to describe and characterize its inner structure in a marker-free manner. A dense, full-view tomographic data set is a set of images of a cell acquired for multiple rotational positions, densely distributed from 0 to 360 degrees. The reconstruction is commonly realized by projection tomography, which is based on the inversion of the Radon transform. The reconstruction quality of projection tomography is greatly improved when first order scattering, which becomes relevant when the imaging wavelength is comparable to the characteristic object size, is taken into account. This advanced reconstruction technique is called diffraction tomography. While many implementations of projection tomography are available today, there is no publicly available implementation of diffraction tomography so far.

RESULTS

We present a Python library that implements the backpropagation algorithm for diffraction tomography in 3D. By establishing benchmarks based on finite-difference time-domain (FDTD) simulations, we showcase the superiority of the backpropagation algorithm over the backprojection algorithm. Furthermore, we discuss how measurment parameters influence the reconstructed refractive index distribution and we also give insights into the applicability of diffraction tomography to biological cells.

CONCLUSION

The present software library contains a robust implementation of the backpropagation algorithm. The algorithm is ideally suited for the application to biological cells. Furthermore, the implementation is a drop-in replacement for the classical backprojection algorithm and is made available to the large user community of the Python programming language.

Improved sparse reconstruction for fluorescence molecular tomography with L1/2 regularization

Fluorescence molecular tomography (FMT) is a promising imaging technique that allows in vivo visualization of molecular-level events associated with disease progression and treatment response. Accurate and efficient 3D reconstruction algorithms will facilitate the wide-use of FMT in preclinical research. Here, we utilize L1/2-norm regularization for improving FMT reconstruction. To efficiently solve the nonconvex L1/2-norm penalized problem, we transform it into a weighted L1-norm minimization problem and employ a homotopy-based iterative reweighting algorithm to recover small fluorescent targets. Both simulations on heterogeneous mouse model and in vivo experiments demonstrated that the proposed L1/2-norm method outperformed the comparative L1-norm reconstruction methods in terms of location accuracy, spatial resolution and quantitation of fluorescent yield. Furthermore, simulation analysis showed the robustness of the proposed method, under different levels of measurement noise and number of excitation sources.

Fluorescence molecular tomography reconstruction via discrete cosine transform-based regularization

Fluorescence molecular tomography (FMT) as a noninvasive imaging modality has been widely used for biomedical preclinical applications. However, FMT reconstruction suffers from severe ill-posedness, especially when a limited number of projections are used. In order to improve the quality of FMT reconstruction results, a discrete cosine transform (DCT) based reweighted L1-norm regularization algorithm is proposed. In each iteration of the reconstruction process, different reweighted regularization parameters are adaptively assigned according to the values of DCT coefficients to suppress the reconstruction noise. In addition, the permission region of the reconstructed fluorophores is adaptively constructed to increase the convergence speed. In order to evaluate the performance of the proposed algorithm, physical phantom and in vivo mouse experiments with a limited number of projections are carried out. For comparison, different L1-norm regularization strategies are employed. By quantifying the signal-to-noise ratio (SNR) of the reconstruction results in the phantom and in vivo mouse experiments with four projections, the proposed DCT-based reweighted L1-norm regularization shows higher SNR than other L1-norm regularizations employed in this work.

An adaptive support driven reweighted L1-regularization algorithm for fluorescence molecular tomography

Fluorescence molecular tomography (FMT) is a promising in vivo functional imaging modality in preclinical study. When solving the ill-posed FMT inverse problem, L1 regularization can preserve the details and reduce the noise in the reconstruction results effectively. Moreover, compared with the regular L1 regularization, reweighted L1 regularization is recently reported to improve the performance. In order to realize the reweighted L1 regularization for FMT, an adaptive support driven reweighted L1-regularization (ASDR-L1) algorithm is proposed in this work. This algorithm has two integral parts: an adaptive support estimate and the iteratively updated weights. In the iteratively reweighted L1-minimization sub-problem, different weights are equivalent to different regularization parameters at different locations. Thus, ASDR-L1 can be considered as a kind of spatially variant regularization methods for FMT. Physical phantom and in vivo mouse experiments were performed to validate the proposed algorithm. The results demonstrate that the proposed reweighted L1-reguarization algorithm can significantly improve the performance in terms of relative quantitation and spatial resolution.

An adaptive support driven reweighted L1-regularization algorithm for fluorescence molecular tomography

Fluorescence molecular tomography (FMT) is a promising in vivo functional imaging modality in preclinical study. When solving the ill-posed FMT inverse problem, L1 regularization can preserve the details and reduce the noise in the reconstruction results effectively. Moreover, compared with the regular L1 regularization, reweighted L1 regularization is recently reported to improve the performance. In order to realize the reweighted L1 regularization for FMT, an adaptive support driven reweighted L1-regularization (ASDR-L1) algorithm is proposed in this work. This algorithm has two integral parts: an adaptive support estimate and the iteratively updated weights. In the iteratively reweighted L1-minimization sub-problem, different weights are equivalent to different regularization parameters at different locations. Thus, ASDR-L1 can be considered as a kind of spatially variant regularization methods for FMT. Physical phantom and in vivo mouse experiments were performed to validate the proposed algorithm. The results demonstrate that the proposed reweighted L1-reguarization algorithm can significantly improve the performance in terms of relative quantitation and spatial resolution.

High-performance fluorescence molecular tomography through shape-based reconstruction using spherical harmonics parameterization

Fluorescence molecular tomography in the near-infrared region is becoming a powerful modality for mapping the three-dimensional quantitative distributions of fluorochromes in live small animals. However, wider application of fluorescence molecular tomography still requires more accurate and stable reconstruction tools. We propose a shape-based reconstruction method that uses spherical harmonics parameterization, where fluorophores are assumed to be distributed as piecewise constants inside disjointed subdomains and the remaining background. The inverse problem is then formulated as a constrained nonlinear least-squares problem with respect to shape parameters, which decreases ill-posedness because of the significantly reduced number of unknowns. Since different shape parameters contribute differently to the boundary measurements, a two-step and modified block coordinate descent optimization algorithm is introduced to stabilize the reconstruction. We first evaluated our method using numerical simulations under various conditions for the noise level and fluorescent background; it showed significant superiority over conventional voxel-based methods in terms of the spatial resolution, reconstruction accuracy with regard to the morphology and intensity, and robustness against the initial estimated distribution. In our phantom experiment, our method again showed better spatial resolution and more accurate intensity reconstruction. Finally, the results of an in vivo experiment demonstrated its applicability to the imaging of mice.

Hadamard multiplexed fluorescence tomography

Depth-resolved three-dimensional (3D) reconstruction of fluorophore-tagged inclusions in fluorescence tomography (FT) poses a highly ill-conditioned problem as depth information must be extracted from boundary data. Due to the ill-posed nature of the FT inverse problem, noise and errors in the data can severely impair the accuracy of the 3D reconstructions. The signal-to-noise ratio (SNR) of the FT data strongly affects the quality of the reconstructions. Additionally, in FT scenarios where the fluorescent signal is weak, data acquisition requires lengthy integration times that result in excessive FT scan periods. Enhancing the SNR of FT data contributes to the robustness of the 3D reconstructions as well as the speed of FT scans. A major deciding factor in the SNR of the FT data is the power of the radiation illuminating the subject to excite the administered fluorescent reagents. In existing single-point illumination FT systems, the source power level is limited by the skin maximum radiation exposure levels. In this paper, we introduce and study the performance of a multiplexed fluorescence tomography system with orders-of-magnitude enhanced data SNR over existing systems. The proposed system allows for multi-point illumination of the subject without jeopardizing the information content of the FT measurements and results in highly robust reconstructions of fluorescent inclusions from noisy FT data. Improvements offered by the proposed system are validated by numerical and experimental studies.