1
|
Sun W, Zhang L, Xing L, He Z, Zhang Y, Gao F. Projected algebraic reconstruction technique-network for high-fidelity diffuse fluorescence tomography reconstruction. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:988-999. [PMID: 38856406 DOI: 10.1364/josaa.517742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 04/01/2024] [Indexed: 06/11/2024]
Abstract
We propose a model-driven projected algebraic reconstruction technique (PART)-network (PART-Net) that leverages the advantages of the traditional model-based method and the neural network to improve the imaging quality of diffuse fluorescence tomography. In this algorithm, nonnegative prior information is incorporated into the ART iteration process to better guide the optimization process, and thereby improve imaging quality. On this basis, PART in conjunction with a residual convolutional neural network is further proposed to obtain high-fidelity image reconstruction. The numerical simulation results demonstrate that the PART-Net algorithm effectively improves noise robustness and reconstruction accuracy by at least 1-2 times and exhibits superiority in spatial resolution and quantification, especially for a small-sized target (r=2m m), compared with the traditional ART algorithm. Furthermore, the phantom and in vivo experiments verify the effectiveness of the PART-Net, suggesting strong generalization capability and a great potential for practical applications.
Collapse
|
2
|
Chen X, Meng Y, Wang L, Zhou W, Chen D, Xie H, Ren S. Highly robust reconstruction framework for three-dimensional optical imaging based on physical model constrained neural networks. Phys Med Biol 2024; 69:075020. [PMID: 38394682 DOI: 10.1088/1361-6560/ad2ca3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 02/23/2024] [Indexed: 02/25/2024]
Abstract
Objective. The reconstruction of three-dimensional optical imaging that can quantitatively acquire the target distribution from surface measurements is a serious ill-posed problem. Traditional regularization-based reconstruction can solve such ill-posed problem to a certain extent, but its accuracy is highly dependent ona priorinformation, resulting in a less stable and adaptable method. Data-driven deep learning-based reconstruction avoids the errors of light propagation models and the reliance on experience and a prior by learning the mapping relationship between the surface light distribution and the target directly from the dataset. However, the acquisition of the training dataset and the training of the network itself are time consuming, and the high dependence of the network performance on the training dataset results in a low generalization ability. The objective of this work is to develop a highly robust reconstruction framework to solve the existing problems.Approach. This paper proposes a physical model constrained neural networks-based reconstruction framework. In the framework, the neural networks are to generate a target distribution from surface measurements, while the physical model is used to calculate the surface light distribution based on this target distribution. The mean square error between the calculated surface light distribution and the surface measurements is then used as a loss function to optimize the neural network. To further reduce the dependence ona prioriinformation, a movable region is randomly selected and then traverses the entire solution interval. We reconstruct the target distribution in this movable region and the results are used as the basis for its next movement.Main Results. The performance of the proposed framework is evaluated with a series of simulations andin vivoexperiment, including accuracy robustness of different target distributions, noise immunity, depth robustness, and spatial resolution. The results collectively demonstrate that the framework can reconstruct targets with a high accuracy, stability and versatility.Significance. The proposed framework has high accuracy and robustness, as well as good generalizability. Compared with traditional regularization-based reconstruction methods, it eliminates the need to manually delineate feasible regions and adjust regularization parameters. Compared with emerging deep learning assisted methods, it does not require any training dataset, thus saving a lot of time and resources and solving the problem of poor generalization and robustness of deep learning methods. Thus, the framework opens up a new perspective for the reconstruction of three-dimension optical imaging.
Collapse
Affiliation(s)
- Xueli Chen
- Center for Biomedical-photonics and Molecular Imaging, Advanced Diagnostic-Therapy Technology and Equipment Key Laboratory of Higher Education Institutions in Shaanxi Province, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education & Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
- Innovation Center for Advanced Medical Imaging and Intelligent Medicine, Guangzhou Institute of Technology, Xidian University, Guangzhou, Guangdong 510555, People's Republic of China
| | - Yu Meng
- Center for Biomedical-photonics and Molecular Imaging, Advanced Diagnostic-Therapy Technology and Equipment Key Laboratory of Higher Education Institutions in Shaanxi Province, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education & Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
| | - Lin Wang
- School of Computer Science and Engineering, Xi'an University of Technology, Xi'an, Shaanxi 710048, People's Republic of China
| | - Wangting Zhou
- Center for Biomedical-photonics and Molecular Imaging, Advanced Diagnostic-Therapy Technology and Equipment Key Laboratory of Higher Education Institutions in Shaanxi Province, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education & Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
| | - Duofang Chen
- Center for Biomedical-photonics and Molecular Imaging, Advanced Diagnostic-Therapy Technology and Equipment Key Laboratory of Higher Education Institutions in Shaanxi Province, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education & Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
| | - Hui Xie
- Center for Biomedical-photonics and Molecular Imaging, Advanced Diagnostic-Therapy Technology and Equipment Key Laboratory of Higher Education Institutions in Shaanxi Province, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education & Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
| | - Shenghan Ren
- Center for Biomedical-photonics and Molecular Imaging, Advanced Diagnostic-Therapy Technology and Equipment Key Laboratory of Higher Education Institutions in Shaanxi Province, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education & Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710126, People's Republic of China
| |
Collapse
|
3
|
Li S, Wang B, Yu J, He X, Guo H, He X. FSMN-Net: a free space matching network based on manifold convolution for optical molecular tomography. OPTICS LETTERS 2024; 49:1161-1164. [PMID: 38426963 DOI: 10.1364/ol.512235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 01/22/2024] [Indexed: 03/02/2024]
Abstract
Optical molecular tomography (OMT) can monitor glioblastomas in small animals non-invasively. Although deep learning (DL) methods have made remarkable achievements in this field, improving its generalization against diverse reconstruction systems remains a formidable challenge. In this Letter, a free space matching network (FSMN-Net) was presented to overcome the parameter mismatch problem in different reconstruction systems. Specifically, a novel, to the best of our knowledge, manifold convolution operator was designed by considering the mathematical model of OMT as a space matching process. Based on the dynamic domain expansion concept, an end-to-end fully convolutional codec further integrates this operator to realize robust reconstruction with voxel-level accuracy. The results of numerical simulations and in vivo experiments demonstrate that the FSMN-Net can stably generate high-resolution reconstruction volumetric images under different reconstruction systems.
Collapse
|
4
|
Su SP, Yang YZ, Chiang HK. Development of an integrated dual-modality 3D bioluminescence tomography and ultrasound imaging system for small animal tumor imaging. OPTICS EXPRESS 2024; 32:5607-5620. [PMID: 38439282 DOI: 10.1364/oe.507659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 01/16/2024] [Indexed: 03/06/2024]
Abstract
Ultrasound (US) is a valuable tool for imaging soft tissue and visualizing tumor contours. Taking the benefits of US, we presented an integrated dual-modality imaging system in this paper that achieves three-dimensional (3D) bioluminescence tomography (BLT) with multi-view bioluminescence images and 3D US imaging. The purpose of this system is to perform non-invasive, long-term monitoring of tumor growth in 3D images. US images can enhance the accuracy of the 3D BLT reconstruction and the bioluminescence dose within an object. Furthermore, an integrated co-registered scanning geometry was used to capture the fused BLT and US images. We validated the system with an in vivo experiment involving tumor-bearing mice. The results demonstrated the feasibility of reconstructing 3D BLT images in the tumor region using 3D US images. We used the dice coefficient and locational error to evaluate the similarity between the reconstructed source region and the actual source region. The dice coefficient was 88.5%, and the locational error was 0.4 mm when comparing the BLT and 3D US images. The hybrid BLT/US system could provide significant benefits for reconstructing the source of tumor location and conducting quantitative analysis of tumor size.
Collapse
|
5
|
Ren W, Ni R. Noninvasive Visualization of Amyloid-Beta Deposits in Alzheimer's Amyloidosis Mice via Fluorescence Molecular Tomography Using Contrast Agent. Methods Mol Biol 2024; 2785:271-285. [PMID: 38427199 DOI: 10.1007/978-1-0716-3774-6_16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/02/2024]
Abstract
Alzheimer's disease is pathologically featured by the accumulation of amyloid-beta (Aβ) plaque and neurofibrillary tangles. Compared to small animal positron emission tomography, optical imaging features nonionizing radiation, low cost, and logistic convenience. Optical detection of Aβ deposits is typically implemented by 2D macroscopic imaging and various microscopic techniques assisted with Aβ-targeted contrast agents. Here, we introduce fluorescence molecular tomography (FMT), a macroscopic 3D fluorescence imaging technique, convenient for in vivo longitudinal monitoring of the animal brain without the involvement of cranial window opening operation. This chapter aims to provide the protocols for FMT in vivo imaging of Aβ deposits in the brain of rodent model of Alzheimer's disease. The materials, stepwise method, notes, limitations of FMT, and emerging opportunities for FMT techniques are presented.
Collapse
Affiliation(s)
- Wuwei Ren
- School of Information Science and Technology, ShanghaiTech University, Shanghai, China.
| | - Ruiqing Ni
- Institute for Regenerative Medicine, University of Zurich, Zurich, Switzerland
- Institute for Biomedical Engineering, ETH Zurich & University of Zurich, Zurich, Switzerland
| |
Collapse
|
6
|
Zhang J, Zhang G, Chen Y, Li K, Zhao F, Yi H, Su L, Cao X. Regularized reconstruction based on joint smoothly clipped absolute deviation regularization and graph manifold learning for fluorescence molecular tomography. Phys Med Biol 2023; 68:195004. [PMID: 37647921 DOI: 10.1088/1361-6560/acf55a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 08/30/2023] [Indexed: 09/01/2023]
Abstract
Objective.Fluorescence molecular tomography (FMT) is an optical imaging modality that provides high sensitivity and low cost, which can offer the three-dimensional distribution of biomarkers by detecting the fluorescently labeled probe noninvasively. In the field of preclinical cancer diagnosis and treatment, FMT has gained significant traction. Nonetheless, the current FMT reconstruction results suffer from unsatisfactory morphology and location accuracy of the fluorescence distribution, primarily due to the light scattering effect and the ill-posed nature of the inverse problem.Approach.To address these challenges, a regularized reconstruction method based on joint smoothly clipped absolute deviation regularization and graph manifold learning (SCAD-GML) for FMT is presented in this paper. The SCAD-GML approach combines the sparsity of the fluorescent sources with the latent manifold structure of fluorescent source distribution to achieve more accurate and sparse reconstruction results. To obtain the reconstruction results efficiently, the non-convex gradient descent iterative method is employed to solve the established objective function. To assess the performance of the proposed SCAD-GML method, a comprehensive evaluation is conducted through numerical simulation experiments as well asin vivoexperiments.Main results.The results demonstrate that the SCAD-GML method outperforms other methods in terms of both location and shape recovery of fluorescence biomarkers distribution.Siginificance.These findings indicate that the SCAD-GML method has the potential to advance the application of FMT inin vivobiological research.
Collapse
Affiliation(s)
- Jun Zhang
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Gege Zhang
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Yi Chen
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Kang Li
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Fengjun Zhao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
| | - Huangjian Yi
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
| | - Linzhi Su
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Xin Cao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| |
Collapse
|
7
|
Li S, Wang B, Yu J, Kang D, He X, Guo H, He X. 3D-deep optical learning: a multimodal and multitask reconstruction framework for optical molecular tomography. OPTICS EXPRESS 2023; 31:23768-23789. [PMID: 37475220 DOI: 10.1364/oe.490139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 06/16/2023] [Indexed: 07/22/2023]
Abstract
Optical molecular tomography (OMT) is an emerging imaging technique. To date, the poor universality of reconstruction algorithms based on deep learning for various imaged objects and optical probes limits the development and application of OMT. In this study, based on a new mapping representation, a multimodal and multitask reconstruction framework-3D deep optical learning (3DOL), was presented to overcome the limitations of OMT in universality by decomposing it into two tasks, optical field recovery and luminous source reconstruction. Specifically, slices of the original anatomy (provided by computed tomography) and boundary optical measurement of imaged objects serve as inputs of a recurrent convolutional neural network encoded parallel to extract multimodal features, and 2D information from a few axial planes within the samples is explicitly incorporated, which enables 3DOL to recognize different imaged objects. Subsequently, the optical field is recovered under the constraint of the object geometry, and then the luminous source is segmented by a learnable Laplace operator from the recovered optical field, which obtains stable and high-quality reconstruction results with extremely few parameters. This strategy enable 3DOL to better understand the relationship between the boundary optical measurement, optical field, and luminous source to improve 3DOL's ability to work in a wide range of spectra. The results of numerical simulations, physical phantoms, and in vivo experiments demonstrate that 3DOL is a compatible deep-learning approach to tomographic imaging diverse objects. Moreover, the fully trained 3DOL under specific wavelengths can be generalized to other spectra in the 620-900 nm NIR-I window.
Collapse
|
8
|
Wang B, Li S, He X, Zhao Y, Zhang H, He X, Yu J, Guo H. Structure-fused deep 3D hierarchical network: A bioluminescence tomography scheme for different imaging objects. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38083149 DOI: 10.1109/embc40787.2023.10340967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Monte Carlo eXtreme (MCX) method has a unique advantage for deep neural network based bioluminescence tomography (BLT) reconstruction. However, this method ignores the distribution of sources energy and relies on the determined tissue structure. In this paper, a deep 3D hierarchical reconstruction network for BLT was proposed where the inputs were divided into two parts -- bioluminescence image (BLI) and anatomy of the imaged object by CT. Firstly, a parallel encoder is used to feature the original BLI & CT slices and integrate their features to distinguish the different tissue structure of imaging objects; Secondly, GRU is used to fit the spatial information of different slices and convert it into 3D features; Finally, the 3D features are decoded to the spacial and energy information of source by a symmetrical decoding structure. Our research suggested that this method can effectively compute the radiation intensity and the spatial distribution of the source for different imaging object.
Collapse
|
9
|
Yi H, Tang Z, Yang R, Zhao F, Cao X, Zhang L, He X, Hou Y. Regularization parameter based on incomplete variables for X-ray luminescence computed tomography. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38082877 DOI: 10.1109/embc40787.2023.10340812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
X-ray luminescence computed tomography (XLCT) is an emerging molecular imaging technique for biological application. However, it is still a challenge to get a stable and accurate solution of the reconstruction of XLCT. This paper presents a regularization parameter selection strategy based on incomplete variables frame for XLCT. A residual information, which is derived from Karush-Kuhn-Tucker (KKT) equivalent condition, is employed to determine the regularization parameter. This residual contains the relevant information about the solution norm and gradient norm, which improved the recovered results. Simulation and phantom experiments are designed to test the performance of the algorithm.Clinical Relevance- The results have not yet been used in clinical relevance currently, we believed that this strategy will facilitate the development of the preclinical applications in FMT.
Collapse
|
10
|
Konovalov AB, Vlasov VV, Samarin SI, Soloviev ID, Savitsky AP, Tuchin VV. Reconstruction of fluorophore absorption and fluorescence lifetime using early photon mesoscopic fluorescence molecular tomography: a phantom study. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:126001. [PMID: 36519075 PMCID: PMC9743783 DOI: 10.1117/1.jbo.27.12.126001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Accepted: 11/18/2022] [Indexed: 06/17/2023]
Abstract
SIGNIFICANCE Fluorescence molecular lifetime tomography (FMLT) plays an increasingly important role in experimental oncology. The article presents and experimentally verifies an original method of mesoscopic time domain FMLT, based on an asymptotic approximation to the fluorescence source function, which is valid for early arriving photons. AIM The aim was to justify the efficiency of the method by experimental scanning and reconstruction of a phantom with a fluorophore. The experimental facility included the TCSPC system, the pulsed supercontinuum Fianium laser, and a three-channel fiber probe. Phantom scanning was done in mesoscopic regime for three-dimensional (3D) reflectance geometry. APPROACH The sensitivity functions were simulated with a Monte Carlo method. A compressed-sensing-like reconstruction algorithm was used to solve the inverse problem for the fluorescence parameter distribution function, which included the fluorophore absorption coefficient and fluorescence lifetime distributions. The distributions were separated directly in the time domain with the QR-factorization least square method. RESULTS 3D tomograms of fluorescence parameters were obtained and analyzed using two strategies for the formation of measurement data arrays and sensitivity matrices. An algorithm is developed for the flexible choice of optimal strategy in view of attaining better reconstruction quality. Variants on how to improve the method are proposed, specifically, through stepped extraction and further use of a posteriori information about the object. CONCLUSIONS Even if measurement data are limited, the proposed method is capable of giving adequate reconstructions but their quality depends on available a priori (or a posteriori) information. Further research aims to improve the method by implementing the variants proposed.
Collapse
Affiliation(s)
- Alexander B. Konovalov
- Federal State Unitary Enterprise “Russian Federal Nuclear Center – Zababakhin All-Russia Research Institute of Technical Physics,” Snezhinsk, Russia
- Bach Institute of Biochemistry, Research Center of Biotechnology of the Russian Academy of Sciences, Moscow, Russia
| | - Vitaly V. Vlasov
- Federal State Unitary Enterprise “Russian Federal Nuclear Center – Zababakhin All-Russia Research Institute of Technical Physics,” Snezhinsk, Russia
- Bach Institute of Biochemistry, Research Center of Biotechnology of the Russian Academy of Sciences, Moscow, Russia
| | - Sergei I. Samarin
- Federal State Unitary Enterprise “Russian Federal Nuclear Center – Zababakhin All-Russia Research Institute of Technical Physics,” Snezhinsk, Russia
| | - Ilya D. Soloviev
- Bach Institute of Biochemistry, Research Center of Biotechnology of the Russian Academy of Sciences, Moscow, Russia
| | - Alexander P. Savitsky
- Bach Institute of Biochemistry, Research Center of Biotechnology of the Russian Academy of Sciences, Moscow, Russia
| | - Valery V. Tuchin
- Bach Institute of Biochemistry, Research Center of Biotechnology of the Russian Academy of Sciences, Moscow, Russia
- Saratov State University, Saratov, Russia
| |
Collapse
|
11
|
Nouizi F, Brooks J, Zuro DM, Hui SK, Gulsen G. Development of a theranostic preclinical fluorescence molecular tomography/cone beam CT-guided irradiator platform. BIOMEDICAL OPTICS EXPRESS 2022; 13:6100-6112. [PMID: 36733750 PMCID: PMC9872876 DOI: 10.1364/boe.469559] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 09/21/2022] [Accepted: 09/22/2022] [Indexed: 05/11/2023]
Abstract
Image-guided small animal radiation research platforms allow more precise radiation treatment. Commercially available small animal X-ray irradiators are often equipped with a CT/cone-beam CT (CBCT) component for target guidance. Besides having poor soft-tissue contrast, CBCT unfortunately cannot provide molecular information due to its low sensitivity. Hence, there are extensive efforts to incorporate a molecular imaging component besides CBCT on these radiation therapy platforms. As an extension of these efforts, here we present a theranostic fluorescence tomography/CBCT-guided irradiator platform that provides both anatomical and molecular guidance, which can overcome the limitations of stand-alone CBCT. The performance of our hybrid system is validated using both tissue-like phantoms and mice ex vivo. Both studies show that fluorescence tomography can provide much more accurate quantitative results when CBCT-derived structural information is used to constrain the inverse problem. The error in the recovered fluorescence absorbance reduces nearly 10-fold for all cases, from approximately 60% down to 6%. This is very significant since high quantitative accuracy in molecular information is crucial to the correct assessment of the changes in tumor microenvironment related to radiation therapy.
Collapse
Affiliation(s)
- Farouk Nouizi
- Tu and Yuen Center for Functional Onco-Imaging, Department of Radiological Sciences, University of California Irvine, CA 92697, USA
- Chao Family Comprehensive Cancer Center, University of California Irvine, CA 92697, USA
| | - Jamison Brooks
- Department of Radiation Oncology, Beckman Research Institute, City of Hope National Medical Center, Duarte, CA 91010, USA
| | - Darren M. Zuro
- Department of Radiation Oncology, Beckman Research Institute, City of Hope National Medical Center, Duarte, CA 91010, USA
| | - Susanta K. Hui
- Department of Radiation Oncology, Beckman Research Institute, City of Hope National Medical Center, Duarte, CA 91010, USA
| | - Gultekin Gulsen
- Tu and Yuen Center for Functional Onco-Imaging, Department of Radiological Sciences, University of California Irvine, CA 92697, USA
- Chao Family Comprehensive Cancer Center, University of California Irvine, CA 92697, USA
| |
Collapse
|
12
|
Chen Y, Du M, Li W, Su L, Yi H, Zhao F, Li K, Wang L, Cao X. ABPO-TVSCAD: alternating Bregman proximity operators approach based on TVSCAD regularization for bioluminescence tomography. Phys Med Biol 2022; 67:215013. [PMID: 36220011 DOI: 10.1088/1361-6560/ac994c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 10/11/2022] [Indexed: 06/16/2023]
Abstract
Objective.Bioluminescence tomography (BLT) is a promising non-invasive optical medical imaging technique, which can visualize and quantitatively analyze the distribution of tumor cells in living tissues. However, due to the influence of photon scattering effect and ill-conditioned inverse problem, the reconstruction result is unsatisfactory. The purpose of this study is to improve the reconstruction performance of BLT.Approach.An alternating Bregman proximity operators (ABPO) method based on TVSCAD regularization is proposed for BLT reconstruction. TVSCAD combines the anisotropic total variation (TV) regularization constraints and the non-convex smoothly clipped absolute deviation (SCAD) penalty constraints, to make a trade-off between the sparsity and edge preservation of the source. ABPO approach is used to solve the TVSCAD model (ABPO-TVSCAD for short). In addition, to accelerate the convergence speed of the ABPO, we adapt the strategy of shrinking the permission source region, which further improves the performance of ABPO-TVSCAD.Main results.The results of numerical simulations andin vivoxenograft mouse experiment show that our proposed method achieved superior accuracy in spatial localization and morphological reconstruction of bioluminescent source.Significance.ABPO-TVSCAD is an effective and robust reconstruction method for BLT, and we hope that this method can promote the development of optical molecular tomography.
Collapse
Affiliation(s)
- Yi Chen
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Mengfei Du
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Weitong Li
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Linzhi Su
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Huangjian Yi
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Fengjun Zhao
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Kang Li
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Lin Wang
- School of Computer Science and Engineering, Xi'an University of Technology, Xi'an 710048, People's Republic of China
| | - Xin Cao
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| |
Collapse
|
13
|
Merle N, Elmshäuser S, Strassheimer F, Wanzel M, König AM, Funk J, Neumann M, Kochhan K, Helmprobst F, Pagenstecher A, Nist A, Mernberger M, Schneider A, Braun T, Borggrefe T, Savai R, Timofeev O, Stiewe T. Monitoring autochthonous lung tumors induced by somatic CRISPR gene editing in mice using a secreted luciferase. Mol Cancer 2022; 21:191. [PMID: 36192757 PMCID: PMC9531476 DOI: 10.1186/s12943-022-01661-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 09/22/2022] [Indexed: 12/04/2022] Open
Abstract
Background In vivo gene editing of somatic cells with CRISPR nucleases has facilitated the generation of autochthonous mouse tumors, which are initiated by genetic alterations relevant to the human disease and progress along a natural timeline as in patients. However, the long and variable, orthotopic tumor growth in inner organs requires sophisticated, time-consuming and resource-intensive imaging for longitudinal disease monitoring and impedes the use of autochthonous tumor models for preclinical studies. Methods To facilitate a more widespread use, we have generated a reporter mouse that expresses a Cre-inducible luciferase from Gaussia princeps (GLuc), which is secreted by cells in an energy-consuming process and can be measured quantitatively in the blood as a marker for the viable tumor load. In addition, we have developed a flexible, complementary toolkit to rapidly assemble recombinant adenoviruses (AVs) for delivering Cre recombinase together with CRISPR nucleases targeting cancer driver genes. Results We demonstrate that intratracheal infection of GLuc reporter mice with CRISPR-AVs efficiently induces lung tumors driven by mutations in the targeted cancer genes and simultaneously activates the GLuc transgene, resulting in GLuc secretion into the blood by the growing tumor. GLuc blood levels are easily and robustly quantified in small-volume blood samples with inexpensive equipment, enable tumor detection already several months before the humane study endpoint and precisely mirror the kinetics of tumor development specified by the inducing gene combination. Conclusions Our study establishes blood-based GLuc monitoring as an inexpensive, rapid, high-throughput and animal-friendly method to longitudinally monitor autochthonous tumor growth in preclinical studies. Supplementary Information The online version contains supplementary material available at 10.1186/s12943-022-01661-2.
Collapse
Affiliation(s)
- Nastasja Merle
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - Sabrina Elmshäuser
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - Florian Strassheimer
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - Michael Wanzel
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - Alexander M König
- Clinic of Diagnostic and Interventional Radiology, Philipps-University, Core Facility 7T-small animal MRI, Marburg, Germany
| | - Julianne Funk
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - Michelle Neumann
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - Katharina Kochhan
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - Frederik Helmprobst
- Mouse Pathology and Electron Microscopy Core Facility, Department of Neuropathology, Philipps-University, Marburg, Germany
| | - Axel Pagenstecher
- Mouse Pathology and Electron Microscopy Core Facility, Department of Neuropathology, Philipps-University, Marburg, Germany
| | - Andrea Nist
- Genomics Core Facility, Philipps-University, Marburg, Germany
| | - Marco Mernberger
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - André Schneider
- Department of Cardiac Development and Remodeling, Member of the German Center for Lung Research (DZL), Max-Planck-Institute for Heart and Lung Research, Bad Nauheim, Germany
| | - Thomas Braun
- Department of Cardiac Development and Remodeling, Member of the German Center for Lung Research (DZL), Max-Planck-Institute for Heart and Lung Research, Bad Nauheim, Germany
| | - Tilman Borggrefe
- Department of Biochemistry, Justus Liebig University, Giessen, Germany
| | - Rajkumar Savai
- Max-Planck Institute for Heart and Lung Research, Member of the German Center for Lung Research (DZL), Member of the Cardio-Pulmonary Institute (CPI), Bad Nauheim, Germany.,Institute for Lung Health (ILH), Justus Liebig University, Giessen, Germany
| | - Oleg Timofeev
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany
| | - Thorsten Stiewe
- Institute of Molecular Oncology, Universities of Giessen and Marburg Lung Center (UGMLC), Member of the German Center for Lung Research (DZL), Philipps-University, Marburg, Germany. .,Genomics Core Facility, Philipps-University, Marburg, Germany. .,Institute for Lung Health (ILH), Justus Liebig University, Giessen, Germany.
| |
Collapse
|
14
|
Li M, Beaumont N, Ma C, Rojas J, Vu T, Harlacher M, O'Connell G, Gessner RC, Kilian H, Kasatkina L, Chen Y, Huang Q, Shen X, Lovell JF, Verkhusha VV, Czernuszewicz T, Yao J. Three-Dimensional Deep-Tissue Functional and Molecular Imaging by Integrated Photoacoustic, Ultrasound, and Angiographic Tomography (PAUSAT). IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:2704-2714. [PMID: 35442884 PMCID: PMC9563100 DOI: 10.1109/tmi.2022.3168859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Non-invasive small-animal imaging technologies, such as optical imaging, magnetic resonance imaging and x -ray computed tomography, have enabled researchers to study normal biological phenomena or disease progression in their native conditions. However, existing small-animal imaging technologies often lack either the penetration capability for interrogating deep tissues (e.g., optical microscopy), or the functional and molecular sensitivity for tracking specific activities (e.g., magnetic resonance imaging). To achieve functional and molecular imaging in deep tissues, we have developed an integrated photoacoustic, ultrasound and acoustic angiographic tomography (PAUSAT) system by seamlessly combining light and ultrasound. PAUSAT can perform three imaging modes simultaneously with complementary contrast: high-frequency B-mode ultrasound imaging of tissue morphology, microbubble-enabled acoustic angiography of tissue vasculature, and multi-spectral photoacoustic imaging of molecular probes. PAUSAT can provide three-dimensional (3D) multi-contrast images that are co-registered, with high spatial resolutions at large depths. Using PAUSAT, we performed proof-of-concept in vivo experiments on various small animal models: monitoring longitudinal development of placenta and embryo during mouse pregnancy, tracking biodistribution and metabolism of near-infrared organic dye on the whole-body scale, and detecting breast tumor expressing genetically-encoded photoswitchable phytochromes. These results have collectively demonstrated that PAUSAT has broad applicability in biomedical research, providing comprehensive structural, functional, and molecular imaging of small animal models.
Collapse
|
15
|
Zhang X, Cao X, Zhang P, Song F, Zhang J, Zhang L, Zhang G. Self-Training Strategy Based on Finite Element Method for Adaptive Bioluminescence Tomography Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:2629-2643. [PMID: 35436185 DOI: 10.1109/tmi.2022.3167809] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Bioluminescence tomography (BLT) is a promising pre-clinical imaging technique for a wide variety of biomedical applications, which can non-invasively reveal functional activities inside living animal bodies through the detection of visible or near-infrared light produced by bioluminescent reactions. Recently, reconstruction approaches based on deep learning have shown great potential in optical tomography modalities. However, these reports only generate data with stationary patterns of constant target number, shape, and size. The neural networks trained by these data sets are difficult to reconstruct the patterns outside the data sets. This will tremendously restrict the applications of deep learning in optical tomography reconstruction. To address this problem, a self-training strategy is proposed for BLT reconstruction in this paper. The proposed strategy can fast generate large-scale BLT data sets with random target numbers, shapes, and sizes through an algorithm named random seed growth algorithm and the neural network is automatically self-trained. In addition, the proposed strategy uses the neural network to build a map between photon densities on surface and inside the imaged object rather than an end-to-end neural network that directly infers the distribution of sources from the photon density on surface. The map of photon density is further converted into the distribution of sources through the multiplication with stiffness matrix. Simulation, phantom, and mouse studies are carried out. Results show the availability of the proposed self-training strategy.
Collapse
|
16
|
Zhang P, Ma C, Song F, Liu Z, Feng Y, Sun Y, He Y, Liu F, Wang D, Zhang G. Multi-branch attention prior based parameterized generative adversarial network for fast and accurate limited-projection reconstruction in fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2022; 13:5327-5343. [PMID: 36425627 PMCID: PMC9664898 DOI: 10.1364/boe.469505] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 09/05/2022] [Accepted: 09/06/2022] [Indexed: 06/16/2023]
Abstract
Limited-projection fluorescence molecular tomography (FMT) allows rapid reconstruction of the three-dimensional (3D) distribution of fluorescent targets within a shorter data acquisition time. However, the limited-projection FMT is severely ill-posed and ill-conditioned due to insufficient fluorescence measurements and the strong scattering properties of photons in biological tissues. Previously, regularization-based methods, combined with the sparse distribution of fluorescent sources, have been commonly used to alleviate the severe ill-posed nature of the limited-projection FMT. Due to the complex iterative computations, time-consuming solution procedures, and less stable reconstruction results, the limited-projection FMT remains an intractable challenge for achieving fast and accurate reconstructions. In this work, we completely discard the previous iterative solving-based reconstruction themes and propose multi-branch attention prior based parameterized generative adversarial network (MAP-PGAN) to achieve fast and accurate limited-projection FMT reconstruction. Firstly, the multi-branch attention can provide parameterized weighted sparse prior information for fluorescent sources, enabling MAP-PGAN to effectively mitigate the ill-posedness and significantly improve the reconstruction accuracy of limited-projection FMT. Secondly, since the end-to-end direct reconstruction strategy is adopted, the complex iterative computation process in traditional regularization algorithms can be avoided, thus greatly accelerating the 3D visualization process. The numerical simulation results show that the proposed MAP-PGAN method outperforms the state-of-the-art methods in terms of localization accuracy and morphological recovery. Meanwhile, the reconstruction time is only about 0.18s, which is about 100 to 1000 times faster than the conventional iteration-based regularization algorithms. The reconstruction results from the physical phantoms and in vivo experiments further demonstrate the feasibility and practicality of the MAP-PGAN method in achieving fast and accurate limited-projection FMT reconstruction.
Collapse
Affiliation(s)
- Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
- These authors contributed equally to this work
| | - Chenbin Ma
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
- Shenyuan Honors College, Beihang University, 100191, Beijing, China
- These authors contributed equally to this work
| | - Fan Song
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Zeyu Liu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Youdan Feng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Yangyang Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Yufang He
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Fei Liu
- Advanced Information & Industrial Technology Research Institute, Beijing Information Science & Technology University, Beijing, 100192, China
| | - Daifa Wang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Guanglei Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| |
Collapse
|
17
|
Rezaeifar B, Wolfs CJA, Lieuwes NG, Biemans R, Reniers B, Dubois LJ, Verhaegen F. A deep learning and Monte Carlo based framework for bioluminescence imaging center of mass-guided glioblastoma targeting. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac79f8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 06/17/2022] [Indexed: 11/11/2022]
Abstract
Abstract
Objective. Bioluminescence imaging (BLI) is a valuable tool for non-invasive monitoring of glioblastoma multiforme (GBM) tumor-bearing small animals without incurring x-ray radiation burden. However, the use of this imaging modality is limited due to photon scattering and lack of spatial information. Attempts at reconstructing bioluminescence tomography (BLT) using mathematical models of light propagation show limited progress. Approach. This paper employed a different approach by using a deep convolutional neural network (CNN) to predict the tumor’s center of mass (CoM). Transfer-learning with a sizeable artificial database is employed to facilitate the training process for, the much smaller, target database including Monte Carlo (MC) simulations of real orthotopic glioblastoma models. Predicted CoM was then used to estimate a BLI-based planning target volume (bPTV), by using the CoM as the center of a sphere, encompassing the tumor. The volume of the encompassing target sphere was estimated based on the total number of photons reaching the skin surface. Main results. Results show sub-millimeter accuracy for CoM prediction with a median error of 0.59 mm. The proposed method also provides promising performance for BLI-based tumor targeting with on average 94% of the tumor inside the bPTV while keeping the average healthy tissue coverage below 10%. Significance. This work introduced a framework for developing and using a CNN for targeted radiation studies for GBM based on BLI. The framework will enable biologists to use BLI as their main image-guidance tool to target GBM tumors in rat models, avoiding delivery of high x-ray imaging dose to the animals.
Collapse
|
18
|
Ren W, Li L, Zhang J, Vaas M, Klohs J, Ripoll J, Wolf M, Ni R, Rudin M. Non-invasive visualization of amyloid-beta deposits in Alzheimer amyloidosis mice using magnetic resonance imaging and fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2022; 13:3809-3822. [PMID: 35991935 PMCID: PMC9352276 DOI: 10.1364/boe.458290] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 05/16/2022] [Accepted: 05/19/2022] [Indexed: 06/15/2023]
Abstract
Abnormal cerebral accumulation of amyloid-beta peptide (Aβ) is a major hallmark of Alzheimer's disease. Non-invasive monitoring of Aβ deposits enables assessing the disease burden in patients and animal models mimicking aspects of the human disease as well as evaluating the efficacy of Aβ-modulating therapies. Previous in vivo assessments of plaque load have been predominantly based on macroscopic fluorescence reflectance imaging (FRI) and confocal or two-photon microscopy using Aβ-specific imaging agents. However, the former method lacks depth resolution, whereas the latter is restricted by the limited field of view preventing a full coverage of the large brain region. Here, we utilized a fluorescence molecular tomography (FMT)-magnetic resonance imaging (MRI) pipeline with the curcumin derivative fluorescent probe CRANAD-2 to achieve full 3D brain coverage for detecting Aβ accumulation in the arcAβ mouse model of cerebral amyloidosis. A homebuilt FMT system was used for data acquisition, whereas a customized software platform enabled the integration of MRI-derived anatomical information as prior information for FMT image reconstruction. The results obtained from the FMT-MRI study were compared to those from conventional planar FRI recorded under similar physiological conditions, yielding comparable time courses of the fluorescence intensity following intravenous injection of CRANAD-2 in a region-of-interest comprising the brain. In conclusion, we have demonstrated the feasibility of visualizing Aβ deposition in 3D using a multimodal FMT-MRI strategy. This hybrid imaging method provides complementary anatomical, physiological and molecular information, thereby enabling the detailed characterization of the disease status in arcAβ mouse models, which can also facilitate monitoring the efficacy of putative treatments targeting Aβ.
Collapse
Affiliation(s)
- Wuwei Ren
- Institute for Biomedical Engineering, ETH and University of Zurich, Zurich 8006, Switzerland
- School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China
| | - Linlin Li
- School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China
| | - Jianru Zhang
- School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China
| | - Markus Vaas
- Institute for Biomedical Engineering, ETH and University of Zurich, Zurich 8006, Switzerland
| | - Jan Klohs
- Institute for Biomedical Engineering, ETH and University of Zurich, Zurich 8006, Switzerland
| | - Jorge Ripoll
- Department of Bioengineering and Aerospace Engineering, Universidad Carlos III de Madrid, Madrid 28005, Spain
| | - Martin Wolf
- Biomedical Optics Research Laboratory, University of Zurich and University Hospital Zurich, Zurich 8091, Switzerland
| | - Ruiqing Ni
- Institute for Biomedical Engineering, ETH and University of Zurich, Zurich 8006, Switzerland
- Institute for Regenerative Medicine, University of Zurich, Zurich 8952, Switzerland
| | - Markus Rudin
- Institute for Biomedical Engineering, ETH and University of Zurich, Zurich 8006, Switzerland
- The LOOP Zurich, Translational Research Center, Zurich 8044, Switzerland
| |
Collapse
|
19
|
Grasso V, Willumeit-Rӧmer R, Jose J. Superpixel spectral unmixing framework for the volumetric assessment of tissue chromophores: A photoacoustic data-driven approach. PHOTOACOUSTICS 2022; 26:100367. [PMID: 35601933 PMCID: PMC9120071 DOI: 10.1016/j.pacs.2022.100367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Revised: 05/04/2022] [Accepted: 05/06/2022] [Indexed: 06/15/2023]
Abstract
The assessment of tissue chromophores at a volumetric scale is vital for an improved diagnosis and treatment of a large number of diseases. Spectral photoacoustic imaging (sPAI) co-registered with high-resolution ultrasound (US) is an innovative technology that has a great potential for clinical translation as it can assess the volumetric distribution of the tissue components. Conventionally, to detect and separate the chromophores from sPAI, an input of the expected tissue absorption spectra is required. However, in pathological conditions, the prediction of the absorption spectra is difficult as it can change with respect to the physiological state. Besides, this conventional approach can also be hampered due to spectral coloring, which is a prominent distortion effect that induces spectral changes at depth. Here, we are proposing a novel data-driven framework that can overcome all these limitations and provide an improved assessment of the tissue chromophores. We have developed a superpixel spectral unmixing (SPAX) approach that can detect the most and less prominent absorber spectra and their volumetric distribution without any user interactions. Within the SPAX framework, we have also implemented an advanced spectral coloring compensation approach by utilizing US image segmentation and Monte Carlo simulations, based on a predefined library of optical properties. The framework has been tested on tissue-mimicking phantoms and also on healthy animals. The obtained results show enhanced specificity and sensitivity for the detection of tissue chromophores. To our knowledge, this is a unique framework that accounts for the spectral coloring and provides automated detection of tissue spectral signatures at a volumetric scale, which can open many possibilities for translational research.
Collapse
Affiliation(s)
- Valeria Grasso
- FUJIFILM VisualSonics, Amsterdam, the Netherlands
- Faculty of Engineering, Institute for Materials Science, Christian-Albrecht University of Kiel, Kiel, Germany
| | - Regine Willumeit-Rӧmer
- Faculty of Engineering, Institute for Materials Science, Christian-Albrecht University of Kiel, Kiel, Germany
- Division Metallic Biomaterials, Institute of Materials Research, Helmholtz-Zentrum Hereon GmbH, Geesthacht, Germany
| | - Jithin Jose
- FUJIFILM VisualSonics, Amsterdam, the Netherlands
| |
Collapse
|
20
|
Zhang P, Ma C, Song F, Fan G, Sun Y, Feng Y, Ma X, Liu F, Zhang G. A review of advances in imaging methodology in fluorescence molecular tomography. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac5ce7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Accepted: 03/11/2022] [Indexed: 01/03/2023]
Abstract
Abstract
Objective. Fluorescence molecular tomography (FMT) is a promising non-invasive optical molecular imaging technology with strong specificity and sensitivity that has great potential for preclinical and clinical studies in tumor diagnosis, drug development and therapeutic evaluation. However, the strong scattering of photons and insufficient surface measurements make it very challenging to improve the quality of FMT image reconstruction and its practical application for early tumor detection. Therefore, continuous efforts have been made to explore more effective approaches or solutions in the pursuit of high-quality FMT reconstructions. Approach. This review takes a comprehensive overview of advances in imaging methodology for FMT, mainly focusing on two critical issues in FMT reconstructions: improving the accuracy of solving the forward physical model and mitigating the ill-posed nature of the inverse problem from a methodological point of view. More importantly, numerous impressive and practical strategies and methods for improving the quality of FMT reconstruction are summarized. Notably, deep learning methods are discussed in detail to illustrate their advantages in promoting the imaging performance of FMT thanks to large datasets, the emergence of optimized algorithms and the application of innovative networks. Main results. The results demonstrate that the imaging quality of FMT can be effectively promoted by improving the accuracy of optical parameter modeling, combined with prior knowledge, and reducing dimensionality. In addition, the traditional regularization-based methods and deep neural network-based methods, especially end-to-end deep networks, can enormously alleviate the ill-posedness of the inverse problem and improve the quality of FMT image reconstruction. Significance. This review aims to illustrate a variety of effective and practical methods for the reconstruction of FMT images that may benefit future research. Furthermore, it may provide some valuable research ideas and directions for FMT in the future, and could promote, to a certain extent, the development of FMT and other methods of optical tomography.
Collapse
|
21
|
Vervaeke P, Borgos SE, Sanders NN, Combes F. Regulatory guidelines and preclinical tools to study the biodistribution of RNA therapeutics. Adv Drug Deliv Rev 2022; 184:114236. [PMID: 35351470 PMCID: PMC8957368 DOI: 10.1016/j.addr.2022.114236] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Revised: 02/09/2022] [Accepted: 03/23/2022] [Indexed: 12/27/2022]
Abstract
The success of the messenger RNA-based COVID-19 vaccines of Moderna and Pfizer/BioNTech marks the beginning of a new chapter in modern medicine. However, the rapid rise of mRNA therapeutics has resulted in a regulatory framework that is somewhat lagging. The current guidelines either do not apply, do not mention RNA therapeutics, or do not have widely accepted definitions. This review describes the guidelines for preclinical biodistribution studies of mRNA/siRNA therapeutics and highlights the relevant differences for mRNA vaccines. We also discuss the role of in vivo RNA imaging techniques and other assays to fulfill and/or complement the regulatory requirements. Specifically, quantitative whole-body autoradiography, microautoradiography, mass spectrometry-based assays, hybridization techniques (FISH, bDNA), PCR-based methods, in vivo fluorescence imaging, and in vivo bioluminescence imaging, are discussed. We conclude that this new and rapidly evolving class of medicines demands a multi-layered approach to fully understand its biodistribution and in vivo characteristics.
Collapse
Affiliation(s)
- P Vervaeke
- Laboratory of Gene Therapy, Department of Veterinary and Biosciences, Faculty of Veterinary Medicine, Ghent University, Heidestraat 19, B-9820 Merelbeke, Belgium
| | - S E Borgos
- SINTEF Industry, Dept. of Biotechnology and Nanomedicine, Research Group Mass Spectrometry, Sem Sælands v. 2A, N-7034 Trondheim, Norway
| | - N N Sanders
- Laboratory of Gene Therapy, Department of Veterinary and Biosciences, Faculty of Veterinary Medicine, Ghent University, Heidestraat 19, B-9820 Merelbeke, Belgium.
| | - F Combes
- SINTEF Industry, Dept. of Biotechnology and Nanomedicine, Research Group Mass Spectrometry, Sem Sælands v. 2A, N-7034 Trondheim, Norway.
| |
Collapse
|
22
|
Wang H, Feng T, Dong X, Zhao Z, Han G, Wang J, Ma W, Wang R, Liu M, Miao J. Method for improving the accuracy of fluorescence molecular tomography based on multi-wavelength concurrent reconstruction. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2022; 93:044102. [PMID: 35489912 DOI: 10.1063/5.0056883] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Accepted: 02/28/2022] [Indexed: 06/14/2023]
Abstract
A Concurrent-wavelength Reconstruction Algorithm (CRA) based on multi-wavelength information fusion is proposed in this paper that aims to further improve the accuracy of Fluorescence Molecular Tomography (FMT) reconstruction. Combining multi-spectral data with FMT technology, the information of 650 and 750 nm wavelengths near-infrared was used to increase the feature information of the dominant 850 nm wavelength near-infrared effectively. Principal component analysis, which can remove redundant information and achieve data dimensionality reduction, was then utilized to extract the feature information. Finally, tomographic reconstruction of the anomalies was performed based on the stacked auto-encoder neural network model. The comparison results of numerical experiments showed that the reconstruction effect of CRA was superior to the performance of the single wavelength model. The correlation coefficient between CRA reconstructed anomalies' fluorescence yield values and the real fluorescence yield values remained at 0.95 or more under the noise of different levels of signal-to-noise ratios. Therefore, the CRA proposed in this paper could effectively improve on the ill-posedness of the inverse problem, which could further enhance the accuracy of FMT reconstruction.
Collapse
Affiliation(s)
- Huiquan Wang
- School of Life Sciences, Tiangong University, Tianjin 300387, China
| | - Tianzi Feng
- School of Electronic and Information Engineering, Tiangong University, Tianjin 300387, China
| | - Xinming Dong
- The Center of Tianjin Rehabilitation and Sanatorium, Tianjin 300387, China
| | - Zhe Zhao
- School of Life Sciences, Tiangong University, Tianjin 300387, China
| | - Guang Han
- School of Life Sciences, Tiangong University, Tianjin 300387, China
| | - Jinhai Wang
- School of Life Sciences, Tiangong University, Tianjin 300387, China
| | - Wenjuan Ma
- Department of Breast Imaging, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin 300060, China
| | - Rong Wang
- School of Life Sciences, Tiangong University, Tianjin 300387, China
| | - Minghu Liu
- School of Life Sciences, Tiangong University, Tianjin 300387, China
| | - Jinghong Miao
- School of Life Sciences, Tiangong University, Tianjin 300387, China
| |
Collapse
|
23
|
Yin W, Li X, Cao Q, Wang H, Zhang B. Bioluminescence tomography reconstruction in conjunction with an organ probability map as an anatomical reference. BIOMEDICAL OPTICS EXPRESS 2022; 13:1275-1291. [PMID: 35414991 PMCID: PMC8973175 DOI: 10.1364/boe.448862] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2021] [Revised: 01/15/2022] [Accepted: 01/23/2022] [Indexed: 06/14/2023]
Abstract
To alleviate the ill-posedness of bioluminescence tomography (BLT) reconstruction, anatomical information from computed tomography (CT) or magnetic resonance imaging (MRI) is usually adopted to improve the reconstruction quality. With the anatomical information, different organs could be segmented and assigned with appropriate optical parameters, and the reconstruction could be confined into certain organs. However, image segmentation is a time-consuming and challenging work, especially for the low-contrast organs. In this paper, we present a BLT reconstruction method in conjunction with an organ probability map to effectively incorporate the anatomical information. Instead of using a segmentation with a fixed organ map, an organ probability map is established by registering the CT image of the mouse to the statistical mouse atlas with the constraints of the mouse surface and high-contrast organs (bone and lung). Then the organ probability map of the low-contrast organs, such as the liver and kidney, is determined automatically. After discretization of the mouse torso, a heterogeneous model is established as the input for reconstruction, in which the optical parameter of each node is calculated according to the organ probability map. To take the advantage of the sparse Bayesian Learning (SBL) method in recovering block sparse signals in inverse problems, which is common in BLT applications where the target distribution has the characteristic of sparsity and block structure, a two-step method in conjunction with the organ probability map is presented. In the first step, a fast sparse algorithm, L1-LS, is used to reveal the source distribution on the organ level. In the second step, the bioluminescent source is reconstructed on the pixel level based on the SBL method. Both simulation and in vivo experiments are conducted, and the results demonstrate that the organ probability map in conjunction with the proposed two-step BLT reconstruction method is feasible to accurately reconstruct the localization of the bioluminescent light source.
Collapse
Affiliation(s)
- Wanzhou Yin
- School of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
- Contributed equally
| | - Xiang Li
- Department of Radiology, the Second Hospital of Dalian Medial University, Dalian, Liaoning 116023, China
- Contributed equally
| | - Qian Cao
- Department of Radiology, the Second Hospital of Dalian Medial University, Dalian, Liaoning 116023, China
- Contributed equally
| | - Hongkai Wang
- School of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
| | - Bin Zhang
- School of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
| |
Collapse
|
24
|
Zhang H, Hai L, Kou J, Hou Y, He X, Zhou M, Geng G. OPK_SNCA: Optimized prior knowledge via sparse non-convex approach for cone-beam X-ray luminescence computed tomography imaging. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 215:106645. [PMID: 35091228 DOI: 10.1016/j.cmpb.2022.106645] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 12/24/2021] [Accepted: 01/16/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND The development of Cone-beam X-ray luminescence computed tomography (CB-XLCT) has allowed the quantitative in-depth biological imaging, but with a greatly ill-posed and ill-conditioned inverse problem. Although the predefined permissible source region (PSR) is a widely used way to alleviate the problem for CB-XLCT imaging, how to obtain the accurate PSR is still a challenge for the process of inverse reconstruction. METHODS We proposed an optimized prior knowledge via a sparse non-convex approach (OPK_SNCA) for CB-XLCT imaging. Firstly, non-convex Lp-norm optimization model was employed for copying with the inverse problem, and an iteratively reweighted split augmented lagrangian shrinkage algorithm was developed to obtain a group of sparse solutions based on different non-convex p values. Secondly, a series of permissible regions (PRs) with different discretized mesh was further achieved, and the intersection operation was implemented on the group of PRs to get a reasonable PSR. After that, the final PSR was adopted as an optimized prior knowledge to enhance the reconstruction quality of inverse reconstruction. RESULTS Both simulation experiments and in vivo experiment were performed to evaluate the efficiency and robustness of the proposed method. CONCLUSIONS The experimental results demonstrated that our proposed method could significantly improve the imaging quality of the distribution of X-ray-excitable nanophosphors for CB-XLCT.
Collapse
Affiliation(s)
- Haibo Zhang
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China.
| | - Linqi Hai
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| | - Jiaojiao Kou
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| | - Yuqing Hou
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| | - Xiaowei He
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| | - Mingquan Zhou
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| | - Guohua Geng
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| |
Collapse
|
25
|
Cáceres MO. Localization of plane waves in the stochastic telegrapher's equation. Phys Rev E 2022; 105:014110. [PMID: 35193308 DOI: 10.1103/physreve.105.014110] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Accepted: 12/10/2021] [Indexed: 11/07/2022]
Abstract
From the exact solution of the stochastic telegrapher's equation, Fourier plane-wave-like modes are introduced. Then the time evolution of the plane-wave modes are analyzed when the absorption of energy in the telegrapher's equation has strong time fluctuations. We demonstrate that fluctuations in the loss of energy introduce a localized gap with a size that depends on the correlation timescale of the fluctuations. We prove that for a large time correlation the gap is strongly reduced, which means that there is delocalization in the plane-wave modes with respect to the plane waves in the ordinary telegrapher's equation. This result is of relevance in the study of the transport of electromagnetic waves in a conducting medium, and sheds light on the functional role of the fluctuations in the loss of energy in the telegrapher's dynamics.
Collapse
Affiliation(s)
- Manuel O Cáceres
- Comision Nacional de Energía Atómica, Avenida E. Bustillo 9500, CP 8400 Bariloche, Argentina and CONICET, Centro Atómico Bariloche and Instituto Balseiro, Universidad Nacional de Cuyo, Avenida E. Bustillo 9500, CP 8400 Bariloche, Argentina
| |
Collapse
|
26
|
Coppola A, Zorzetto G, Piacentino F, Bettoni V, Pastore I, Marra P, Perani L, Esposito A, De Cobelli F, Carcano G, Fontana F, Fiorina P, Venturini M. Imaging in experimental models of diabetes. Acta Diabetol 2022; 59:147-161. [PMID: 34779949 DOI: 10.1007/s00592-021-01826-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Accepted: 10/30/2021] [Indexed: 12/01/2022]
Abstract
Translational medicine, experimental medicine and experimental animal models, in particular mice and rats, represent a multidisciplinary field that has made it possible to achieve, in the last decades, important scientific progress. In this review, we have summarized the most frequently used imaging animal models, such as ultrasound (US), micro-CT, MRI and the optical imaging methods, and their main implications in diagnostic and therapeutic fields, with a particular focus on diabetes mellitus, a multifactorial disease extremely widespread among the general population.
Collapse
Affiliation(s)
- Andrea Coppola
- Diagnostic and Interventional Radiology Unit, ASST Settelaghi, Varese, Italy.
| | | | - Filippo Piacentino
- Diagnostic and Interventional Radiology Unit, ASST Settelaghi, Varese, Italy
- Insubria University, Varese, Italy
| | - Valeria Bettoni
- Diagnostic and Interventional Radiology Unit, ASST Settelaghi, Varese, Italy
| | - Ida Pastore
- Division of Endocrinology, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Paolo Marra
- Department of Diagnostic Radiology, Giovanni XXIII Hospital, Milano-Bicocca University, Bergamo, Italy
| | - Laura Perani
- Experimental Imaging Center, San Raffaele Scientific Institute, Milan, Italy
| | - Antonio Esposito
- Experimental Imaging Center, San Raffaele Scientific Institute, Milan, Italy
- Radiology Unit, San Raffaele Scientific Institute, San Raffaele Vita-Salute University, Milan, Italy
| | - Francesco De Cobelli
- Radiology Unit, San Raffaele Scientific Institute, San Raffaele Vita-Salute University, Milan, Italy
| | - Giulio Carcano
- Insubria University, Varese, Italy
- General, Emergency, and Transplant Surgery Unit, ASST Settelaghi, Varese, Italy
| | - Federico Fontana
- Diagnostic and Interventional Radiology Unit, ASST Settelaghi, Varese, Italy
- Insubria University, Varese, Italy
| | - Paolo Fiorina
- International Center for T1D, Centro di Ricerca Pediatrica Romeo ed Enrica Invernizzi, Dipartimento di Scienze Biomediche e Cliniche "L. Sacco", Università di Milano, Milan, Italy
- Nephrology Division, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
- Endocrinology Division, ASST Fatebenefratelli Sacco, Milan, Italy
| | - Massimo Venturini
- Diagnostic and Interventional Radiology Unit, ASST Settelaghi, Varese, Italy
- Insubria University, Varese, Italy
| |
Collapse
|
27
|
Compressed sensing in fluorescence microscopy. PROGRESS IN BIOPHYSICS AND MOLECULAR BIOLOGY 2022; 168:66-80. [PMID: 34153330 DOI: 10.1016/j.pbiomolbio.2021.06.004] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 05/29/2021] [Accepted: 06/07/2021] [Indexed: 12/30/2022]
Abstract
Compressed sensing (CS) is a signal processing approach that solves ill-posed inverse problems, from under-sampled data with respect to the Nyquist criterium. CS exploits sparsity constraints based on the knowledge of prior information, relative to the structure of the object in the spatial or other domains. It is commonly used in image and video compression as well as in scientific and medical applications, including computed tomography and magnetic resonance imaging. In the field of fluorescence microscopy, it has been demonstrated to be valuable for fast and high-resolution imaging, from single-molecule localization, super-resolution to light-sheet microscopy. Furthermore, CS has found remarkable applications in the field of mesoscopic imaging, facilitating the study of small animals' organs and entire organisms. This review article illustrates the working principles of CS, its implementations in optical imaging and discusses several relevant uses of CS in the field of fluorescence imaging from super-resolution microscopy to mesoscopy.
Collapse
|
28
|
Ochoa M, Rudkouskaya A, Smith JT, Intes X, Barroso M. Macroscopic Fluorescence Lifetime Imaging for Monitoring of Drug-Target Engagement. Methods Mol Biol 2022; 2394:837-856. [PMID: 35094361 PMCID: PMC8941982 DOI: 10.1007/978-1-0716-1811-0_44] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Precision medicine promises to improve therapeutic efficacy while reducing adverse effects, especially in oncology. However, despite great progresses in recent years, precision medicine for cancer treatment is not always part of routine care. Indeed, the ability to specifically tailor therapies to distinct patient profiles requires still significant improvements in targeted therapy development as well as decreases in drug treatment failures. In this regard, preclinical animal research is fundamental to advance our understanding of tumor biology, and diagnostic and therapeutic response. Most importantly, the ability to measure drug-target engagement accurately in live and intact animals is critical in guiding the development and optimization of targeted therapy. However, a major limitation of preclinical molecular imaging modalities is their lack of capability to directly and quantitatively discriminate between drug accumulation and drug-target engagement at the pathological site. Recently, we have developed Macroscopic Fluorescence Lifetime Imaging (MFLI) as a unique feature of optical imaging to quantitate in vivo drug-target engagement. MFLI quantitatively reports on nanoscale interactions via lifetime-sensing of Förster Resonance Energy Transfer (FRET) in live, intact animals. Hence, MFLI FRET acts as a direct reporter of receptor dimerization and target engagement via the measurement of the fraction of labeled-donor entity undergoing binding to its respective receptor. MFLI is expected to greatly impact preclinical imaging and also adjacent fields such as image-guided surgery and drug development.
Collapse
Affiliation(s)
- Marien Ochoa
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY, USA
| | - Alena Rudkouskaya
- Department of Cellular and Molecular Physiology, Albany Medical College, Albany, NY, USA
| | - Jason T Smith
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY, USA
| | - Xavier Intes
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY, USA
| | - Margarida Barroso
- Department of Cellular and Molecular Physiology, Albany Medical College, Albany, NY, USA.
| |
Collapse
|
29
|
Yuan Y, Guo H, Yi H, Yu J, He X, He X. Correntropy-induced metric with Laplacian kernel for robust fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:5991-6012. [PMID: 34745717 PMCID: PMC8547984 DOI: 10.1364/boe.434679] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 08/08/2021] [Accepted: 08/22/2021] [Indexed: 06/13/2023]
Abstract
Fluorescence molecular tomography (FMT), which is used to visualize the three-dimensional distribution of fluorescence probe in small animals via the reconstruction method, has become a promising imaging technique in preclinical research. However, the classical reconstruction criterion is formulated based on the squared l 2-norm distance metric, leaving it prone to being influenced by the presence of outliers. In this study, we propose a robust distance based on the correntropy-induced metric with a Laplacian kernel (CIML). The proposed metric satisfies the conditions of distance metric function and contains first and higher order moments of samples. Moreover, we demonstrate important properties of the proposed metric such as nonnegativity, nonconvexity, and boundedness, and analyze its robustness from the perspective of M-estimation. The proposed metric includes and extends the traditional metrics such as l 0-norm and l 1-norm metrics by setting an appropriate parameter. We show that, in reconstruction, the metric is a sparsity-promoting penalty. To reduce the negative effects of noise and outliers, a novel robust reconstruction framework is presented with the proposed correntropy-based metric. The proposed CIML model retains the advantages of the traditional model and promotes robustness. However, the nonconvexity of the proposed metric renders the CIML model difficult to optimize. Furthermore, an effective iterative algorithm for the CIML model is designed, and we present a theoretical analysis of its ability to converge. Numerical simulation and in vivo mouse experiments were conducted to evaluate the CIML method's performance. The experimental results show that the proposed method achieved more accurate fluorescent target reconstruction than the state-of-the-art methods in most cases, which illustrates the feasibility and robustness of the CIML method.
Collapse
Affiliation(s)
- Yating Yuan
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| | - Hongbo Guo
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| | - Huangjian Yi
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi’an, 710119, China
| | - Xuelei He
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| | - Xiaowei He
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| |
Collapse
|
30
|
Tian L, Hunt B, Bell MAL, Yi J, Smith JT, Ochoa M, Intes X, Durr NJ. Deep Learning in Biomedical Optics. Lasers Surg Med 2021; 53:748-775. [PMID: 34015146 PMCID: PMC8273152 DOI: 10.1002/lsm.23414] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 04/02/2021] [Accepted: 04/15/2021] [Indexed: 01/02/2023]
Abstract
This article reviews deep learning applications in biomedical optics with a particular emphasis on image formation. The review is organized by imaging domains within biomedical optics and includes microscopy, fluorescence lifetime imaging, in vivo microscopy, widefield endoscopy, optical coherence tomography, photoacoustic imaging, diffuse tomography, and functional optical brain imaging. For each of these domains, we summarize how deep learning has been applied and highlight methods by which deep learning can enable new capabilities for optics in medicine. Challenges and opportunities to improve translation and adoption of deep learning in biomedical optics are also summarized. Lasers Surg. Med. © 2021 Wiley Periodicals LLC.
Collapse
Affiliation(s)
- L. Tian
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, USA
| | - B. Hunt
- Thayer School of Engineering, Dartmouth College, Hanover, NH, USA
| | - M. A. L. Bell
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, USA
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA
- Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA
| | - J. Yi
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA
- Department of Ophthalmology, Johns Hopkins University, Baltimore, MD, USA
| | - J. T. Smith
- Center for Modeling, Simulation, and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, New York NY 12180
| | - M. Ochoa
- Center for Modeling, Simulation, and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, New York NY 12180
| | - X. Intes
- Center for Modeling, Simulation, and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, New York NY 12180
| | - N. J. Durr
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, USA
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
31
|
Chen Y. Recent progress in natural product-based inhibitor screening with enzymatic fluorescent probes. ANALYTICAL METHODS : ADVANCING METHODS AND APPLICATIONS 2021; 13:1778-1787. [PMID: 33885636 DOI: 10.1039/d1ay00245g] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Drug discovery is a complex process in which many challenges need to be overcome, from the discovery of a drug candidate to ensuring the efficacy and safety of the candidate in humans. Modern analytical methods allow tens of thousands of drug candidates to be screened for their inhibition of specific enzymes or receptors. In recent years, fluorescent probes have been used for the detection and diagnosis of human pathogens as well as high-throughput screening. This review focuses on recent progress in organic small-molecule based enzyme-activated fluorescent probes for screening of inhibitors from natural products. The contents include the construction of fluorescent probes, working mechanism and the process of inhibitor screening. The progress suggests that fluorescent probes are a vital and rapidly growing technology for inhibitor screening of enzymes, in particular, inhibitor screening in situ.
Collapse
Affiliation(s)
- Yi Chen
- Key Laboratory of Photochemical Conversion and Optoelectronic Materials, Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, Beijing, 100190, China. and University of Chinese Academy of Sciences, Beijing, 100049, China
| |
Collapse
|
32
|
Zou W, Wang J, Hu D, Pan X. Bayesian reconstruction of fluorescent molecular tomography via iteration of measurements. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2021; 38:174-180. [PMID: 33690527 DOI: 10.1364/josaa.398996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2020] [Accepted: 12/03/2020] [Indexed: 06/12/2023]
Abstract
Fluorescent molecular tomography (FMT) is an important molecular imaging technique for medical diagnosis and treatment. In FMT, a typical forward model is the diffusion approximation. However, this approximation is not valid in biological tissues with low-scattering regions. To overcome this problem, a Bayesian method in combination with the model error is proposed. Further, an iteration method of boundary measurements is incorporated into the reconstruction process to improve the efficiency of reconstruction for FMT. Simulation results obtained demonstrate that the proposed approach can effectively improve the quality of the reconstructed results and speed up the reconstruction process.
Collapse
|
33
|
Alsawaftah N, Farooq A, Dhou S, Majdalawieh AF. Bioluminescence Imaging Applications in Cancer: A Comprehensive Review. IEEE Rev Biomed Eng 2021; 14:307-326. [PMID: 32746363 DOI: 10.1109/rbme.2020.2995124] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/09/2022]
Abstract
Bioluminescence imaging (BLI), an optical preclinical imaging modality, is an invaluable imaging modality due to its low-cost, high throughput, fast acquisition times, and functional imaging capabilities. BLI is being extensively used in the field of cancer imaging, especially with the recent developments in genetic-engineering, stem cell, and gene therapy treatments. The purpose of this paper is to provide a comprehensive review of the principles, developments, and current status of BLI in cancer research. This paper covers the fundamental BLI concepts including BLI reporters and enzyme-substrate systems, data acquisition, and image characteristics. It reviews the studies discussing the use of BLI in cancer research such as imaging tumor-characteristic phenomena including tumorigenesis, metastasis, cancer metabolism, apoptosis, hypoxia, and angiogenesis, and response to cancer therapy treatments including chemotherapy, radiotherapy, immunotherapy, gene therapy, and stem cell therapy. The key advantages and disadvantages of BLI compared to other common imaging modalities are also discussed.
Collapse
|
34
|
Konovalov AB, Vlasov VV, Uglov AS. Early-photon reflectance fluorescence molecular tomography for small animal imaging: Mathematical model and numerical experiment. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2021; 37:e03408. [PMID: 33094558 DOI: 10.1002/cnm.3408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Revised: 10/04/2020] [Accepted: 10/17/2020] [Indexed: 06/11/2023]
Abstract
The paper presents an original approach to time-domain reflectance fluorescence molecular tomography (FMT) of small animals. It is based on the use of early arriving photons and state-of-the-art compressed-sensing-like reconstruction algorithms and aims to improve the spatial resolution of fluorescent images. We deduce the fundamental equation that models the imaging operator and derive analytical representations for the sensitivity functions which are responsible for the reconstruction of the fluorophore absorption coefficient. The idea of fluorescence lifetime tomography with our approach is also discussed. We conduct a numerical experiment on 3D reconstruction of box phantoms with spherical fluorescent inclusions of small diameters. For modeling measurement data and constructing the sensitivity matrix we assume a virtual fluorescence tomograph with a scanning fiber probe that illuminates and collects light in reflectance geometry. It provides for large source-receiver separations which correspond to the macroscopic regime. Two compressed-sensing-like reconstruction algorithms are used to solve the inverse problem. These are the algebraic reconstruction technique with total variation regularization and our modification of the fast iterative shrinkage-thresholding algorithm. Results of our numerical experiment show that our approach is capable of achieving as good spatial resolution as 0.2 mm and even better at depths to 9 mm inclusive.
Collapse
Affiliation(s)
- Alexander B Konovalov
- Computational Center, Federal State Unitary Enterprise "Russian Federal Nuclear Center - Zababakhin All-Russia Research Institute of Technical Physics,", Snezhinsk, Russia
- Laboratory of Molecular Imaging, Bach Institute of Biochemistry, Research Center of Biotechnology of the Russian Academy of Sciences, Moscow, Russia
| | - Vitaly V Vlasov
- Computational Center, Federal State Unitary Enterprise "Russian Federal Nuclear Center - Zababakhin All-Russia Research Institute of Technical Physics,", Snezhinsk, Russia
- Laboratory of Molecular Imaging, Bach Institute of Biochemistry, Research Center of Biotechnology of the Russian Academy of Sciences, Moscow, Russia
| | - Alexander S Uglov
- Computational Center, Federal State Unitary Enterprise "Russian Federal Nuclear Center - Zababakhin All-Russia Research Institute of Technical Physics,", Snezhinsk, Russia
| |
Collapse
|
35
|
Mozumder M, Tarvainen T. Evaluation of temporal moments and Fourier transformed data in time-domain diffuse optical tomography. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2020; 37:1845-1856. [PMID: 33362126 DOI: 10.1364/josaa.405541] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Accepted: 10/03/2020] [Indexed: 06/12/2023]
Abstract
Time-domain diffuse optical tomography (TD-DOT) uses near-infrared pulsed lasers as light sources to measure time-varying exitance on the boundary of the target. These are used to estimate optical properties of the imaged target. Several integral-transform-based moments of the time-resolved data have been utilized in TD-DOT, the most common being the mean time of flight and variance. Recently, it has been shown that Fourier transforming the time-domain data to frequency domain enables utilization of these data at one or several frequencies, producing equally as good estimates as the whole time-domain data. In this work, we present a systematic comparison of the usage of the temporal moments and Fourier transformed data in TD-DOT. Both absolute and difference imaging are evaluated using numerical simulations. The simulations show that utilizing temporal moments and Fourier transformed data in TD-DOT provides good quality reconstructions with a good estimation accuracy. These estimates are improved if more than one data type is used. Furthermore, the simulations show that the frequency-domain computations enable computationally cheaper and straightforward implementation of the inverse solver when compared to the temporal moments.
Collapse
|
36
|
Zhang H, Huang X, Zhou M, Geng G, He X. Adaptive shrinking reconstruction framework for cone-beam X-ray luminescence computed tomography. BIOMEDICAL OPTICS EXPRESS 2020; 11:3717-3732. [PMID: 33014562 PMCID: PMC7510911 DOI: 10.1364/boe.393970] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2020] [Revised: 05/19/2020] [Accepted: 06/05/2020] [Indexed: 06/11/2023]
Abstract
Cone-beam X-ray luminescence computed tomography (CB-XLCT) emerged as a novel hybrid technique for early detection of small tumors in vivo. However, severe ill-posedness is still a challenge for CB-XLCT imaging. In this study, an adaptive shrinking reconstruction framework without a prior information is proposed for CB-XLCT. In reconstruction processing, the mesh nodes are automatically selected with higher probability to contribute to the distribution of target for imaging. Specially, an adaptive shrinking function is designed to automatically control the permissible source region at a multi-scale rate. Both 3D digital mouse and in vivo experiments were carried out to test the performance of our method. The results indicate that the proposed framework can dramatically improve the imaging quality of CB-XLCT.
Collapse
Affiliation(s)
- Haibo Zhang
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| | | | - Mingquan Zhou
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| | - Guohua Geng
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| | - Xiaowei He
- School of Information Sciences and Technology, Northwest University, Xi'an, Shannxi 710027, China
| |
Collapse
|
37
|
Chen XL, Yan TY, Wang N, von Deneen KM. Rising role of artificial intelligence in image reconstruction for biomedical imaging. Artif Intell Med Imaging 2020; 1:1-5. [DOI: 10.35711/aimi.v1.i1.1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/07/2020] [Revised: 06/09/2020] [Accepted: 06/16/2020] [Indexed: 02/06/2023] Open
Abstract
In this editorial, we review recent progress on the applications of artificial intelligence (AI) in image reconstruction for biomedical imaging. Because it abandons prior information of traditional artificial design and adopts a completely data-driven mode to obtain deeper prior information via learning, AI technology plays an increasingly important role in biomedical image reconstruction. The combination of AI technology and the biomedical image reconstruction method has become a hotspot in the field. Favoring AI, the performance of biomedical image reconstruction has been improved in terms of accuracy, resolution, imaging speed, etc. We specifically focus on how to use AI technology to improve the performance of biomedical image reconstruction, and propose possible future directions in this field.
Collapse
Affiliation(s)
- Xue-Li Chen
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi’an 710126, Shaanxi Province, China
| | - Tian-Yu Yan
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi’an 710126, Shaanxi Province, China
| | - Nan Wang
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi’an 710126, Shaanxi Province, China
| | - Karen M von Deneen
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi’an 710126, Shaanxi Province, China
| |
Collapse
|
38
|
Ren W, Jiang J, Costanzo Mata AD, Kalyanov A, Ripoll J, Lindner S, Charbon E, Zhang C, Rudin M, Wolf M. Multimodal imaging combining time-domain near-infrared optical tomography and continuous-wave fluorescence molecular tomography. OPTICS EXPRESS 2020; 28:9860-9874. [PMID: 32225585 DOI: 10.1364/oe.385392] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/16/2019] [Accepted: 03/02/2020] [Indexed: 06/10/2023]
Abstract
Fluorescence molecular tomography (FMT) emerges as a powerful non-invasive imaging tool with the ability to resolve fluorescence signals from sources located deep in living tissues. Yet, the accuracy of FMT reconstruction depends on the deviation of the assumed optical properties from the actual values. In this work, we improved the accuracy of the initial optical properties required for FMT using a new-generation time-domain (TD) near-infrared optical tomography (NIROT) system, which effectively decouples scattering and absorption coefficients. We proposed a multimodal paradigm combining TD-NIROT and continuous-wave (CW) FMT. Both numerical simulation and experiments were performed on a heterogeneous phantom containing a fluorescent inclusion. The results demonstrate significant improvement in the FMT reconstruction by taking the NIROT-derived optical properties as prior information. The multimodal method is attractive for preclinical studies and tumor diagnostics since both functional and molecular information can be obtained.
Collapse
|
39
|
Gallo E. Fluorogen-Activating Proteins: Next-Generation Fluorescence Probes for Biological Research. Bioconjug Chem 2019; 31:16-27. [DOI: 10.1021/acs.bioconjchem.9b00710] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Affiliation(s)
- Eugenio Gallo
- Department of Molecular Genetics, University of Toronto, Charles Best Institute, 112 College Street, Toronto, Ontario M5G 1L6, Canada
| |
Collapse
|
40
|
Ren W, Isler H, Wolf M, Ripoll J, Rudin M. Smart Toolkit for Fluorescence Tomography: Simulation, Reconstruction, and Validation. IEEE Trans Biomed Eng 2019; 67:16-26. [PMID: 30990170 DOI: 10.1109/tbme.2019.2907460] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Fluorescence molecular tomography (FMT) can provide valuable molecular information by mapping the bio-distribution of fluorescent reporter molecules in the intact organism. Various prototype FMT systems have been introduced during the past decade. However, none of them has evolved as a standard tool for routine biomedical research. The goal of this paper is to develop a software package that can automate the complete FMT reconstruction procedure. METHODS We present smart toolkit for fluorescence tomography (STIFT), a comprehensive platform comprising three major protocols: 1) virtual FMT, i.e., forward modeling and reconstruction of simulated data; 2) control of actual FMT data acquisition; and 3) reconstruction of experimental FMT data. RESULTS Both simulation and phantom experiments have shown robust reconstruction results for homogeneous and heterogeneous tissue-mimicking phantoms containing fluorescent inclusions. CONCLUSION STIFT can be used for optimization of FMT experiments, in particular for optimizing illumination patterns. SIGNIFICANCE This paper facilitates FMT experiments by bridging the gaps between simulation, actual experiments, and data reconstruction.
Collapse
|
41
|
Nouizi F, Kwong TC, Ruiz J, Cho J, Chan YW, Ikemura K, Erkol H, Sampathkumaran U, Gulsen G. A thermo-sensitive fluorescent agent based method for excitation light leakage rejection for fluorescence molecular tomography. Phys Med Biol 2019; 64:035007. [PMID: 30561380 DOI: 10.1088/1361-6560/aaf96d] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
Fluorescence molecular tomography (FMT) is widely used in preclinical oncology research. FMT is the only imaging technique able to provide 3D distribution of fluorescent probes within thick highly scattering media. However, its integration into clinical medicine has been hampered by its low spatial resolution caused by the undetermined and ill-posed nature of its reconstruction algorithm. Another major factor degrading the quality of FMT images is the large backscattered excitation light component leaking through the rejection filters and coinciding with the weak fluorescent signal arising from a low tissue fluorescence concentration. In this paper, we present a new method based on the use of a novel thermo-sensitive fluorescence probe. In fact, the excitation light leakage is accurately estimated from a set of measurements performed at different temperatures and then is corrected for in the tomographic data. The obtained results show a considerable improvement in both spatial resolution and quantitative accuracy of FMT images due to the proper correction of fluorescent signals.
Collapse
Affiliation(s)
- Farouk Nouizi
- Department of Radiological Sciences, Tu and Yuen Center for Functional Onco-Imaging, University of California, Irvine, CA 92697, United States of America
| | | | | | | | | | | | | | | | | |
Collapse
|
42
|
Liu T, Rong J, Gao P, Pu H, Zhang W, Zhang X, Liang Z, Lu H. Regularized reconstruction based on joint L 1 and total variation for sparse-view cone-beam X-ray luminescence computed tomography. BIOMEDICAL OPTICS EXPRESS 2019; 10:1-17. [PMID: 30775079 PMCID: PMC6363206 DOI: 10.1364/boe.10.000001] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/17/2018] [Revised: 11/22/2018] [Accepted: 11/22/2018] [Indexed: 05/22/2023]
Abstract
As an emerging hybrid imaging modality, cone-beam X-ray luminescence computed tomography (CB-XLCT) has been proposed based on the development of X-ray excitable nanoparticles. Owing to the high degree of absorption and scattering of light through tissues, the CB-XLCT inverse problem is inherently ill-conditioned. Appropriate priors or regularizations are needed to facilitate reconstruction and to restrict the search space to a specific solution set. Typically, the goal of CB-XLCT reconstruction is to get the distributions of nanophosphors in the imaging object. Considering that the distributions of nanophosphors inside bodies preferentially accumulate in specific areas of interest, the reconstruction of XLCT images is usually sparse with some locally smoothed high-intensity regions. Therefore, a combination of the L1 and total variation regularization is designed to improve the imaging quality of CB-XLCT in this study. The L1 regularization is used for enforcing the sparsity of the reconstructed images and the total variation regularization is used for maintaining the local smoothness of the reconstructed image. The implementation of this method can be divided into two parts. First, the reconstruction image was reconstructed based on the fast iterative shrinkage-thresholding (FISTA) algorithm, then the reconstruction image was minimized by the gradient descent method. Numerical simulations and phantom experiments indicate that compared with the traditional ART, ADAPTIK and FISTA methods, the proposed method demonstrates its advantage in improving spatial resolution and reducing imaging time.
Collapse
Affiliation(s)
- Tianshuai Liu
- Department of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, China
| | - Junyan Rong
- Department of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, China
| | - Peng Gao
- Department of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, China
| | - Huangsheng Pu
- Department of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, China
| | - Wenli Zhang
- Department of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, China
| | - Xiaofeng Zhang
- Department of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, China
| | - Zhengrong Liang
- Department of Radiology and Biomedical Engineering, State University of New York at Stony Brook, Stony Brook, NY 11794, USA
| | - Hongbing Lu
- Department of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, China
| |
Collapse
|
43
|
Pian Q, Yao R, Intes X. Hyperspectral wide-field time domain single-pixel diffuse optical tomography platform. BIOMEDICAL OPTICS EXPRESS 2018; 9:6258-6272. [PMID: 31065427 PMCID: PMC6491017 DOI: 10.1364/boe.9.006258] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Revised: 08/27/2018] [Accepted: 09/09/2018] [Indexed: 05/18/2023]
Abstract
We present the design and comprehensive instrumental characterization of a time domain diffuse optical tomography (TD-DOT) platform based on wide-field illumination and wide-field hyperspectral time-resolved single-pixel detection for functional and molecular imaging in turbid media. The proposed platform combines two digital micro-mirror devices (DMDs) to generate structured light and a spectrally resolved multi-anode photomultiplier tube (PMT) detector in time domain for hyperspectral data acquisition over 16 wavelength channels based on the time-correlated single-photon counting (TCSPC) technique. The design of the proposed platform is described in detail and its characteristics in spatial, temporal and spectral dimensions are calibrated and presented. The performance of the system is further validated through a phantom study where two absorbers in glass tubes with spectral contrast are mapped in a turbid medium of ~20 mm thickness. The method presented here offers the potential of accelerating the imaging process and improving reconstruction results in TD-DOT and thus facilitates its wide spread use in preclinical and clinical in vivo imaging scenarios.
Collapse
Affiliation(s)
- Qi Pian
- Biomedical Engineering Department, Rensselaer Polytechnic Institute, Troy, NY 12180, USA
- Currently with Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA 02129, USA
| | - Ruoyang Yao
- Biomedical Engineering Department, Rensselaer Polytechnic Institute, Troy, NY 12180, USA
| | - Xavier Intes
- Biomedical Engineering Department, Rensselaer Polytechnic Institute, Troy, NY 12180, USA
| |
Collapse
|
44
|
Bioluminescence Tomography Guided Small-Animal Radiation Therapy and Tumor Response Assessment. Int J Radiat Oncol Biol Phys 2018. [DOI: 10.1016/j.ijrobp.2018.01.068] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
45
|
Yi H, Jiao P, Li X, Peng J, He X. Three-way decision based reconstruction frame for fluorescence molecular tomography. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2018; 35:1814-1822. [PMID: 30461839 DOI: 10.1364/josaa.35.001814] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2018] [Accepted: 09/18/2018] [Indexed: 06/09/2023]
Abstract
Fluorescence molecular tomography (FMT) has been a promising imaging tool because it allows an accurate localizaton and quantitative analysis of the fluorophore distribution in animals. It, however, is still a challenge since its reconstruction suffers from severe ill-posedness. This paper introduces a reconstruction frame based on three-way decisions (TWD) for the inverse problem of FMT. On the first stage, a reconstruction result on the whole region is obtained by a certain reconstruction algorithm. With TWD, the recovered result has been divided into three regions: fluorescent target region, boundary region, and background region. On the second stage, the boundary region and fluorescent target region have been combined into the permissible region of the target. Then a new reconstruction on the permissible region has been carried out and a new recovered result is obtained. With TWD again, the new result has been classified into three pairwise disjoint regions. And the new fluorescent target region is the final reconstructed result. Both numerical simulation experiments and a real mouse experiment are carried out to validate the feasibility and potential of the presented reconstruction frame. The results indicate that the proposed reconstuction strategy based on TWD can provide a good performance in FMT reconstruction.
Collapse
|
46
|
Klose AD, Paragas N. Automated quantification of bioluminescence images. Nat Commun 2018; 9:4262. [PMID: 30323260 PMCID: PMC6189049 DOI: 10.1038/s41467-018-06288-w] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2017] [Accepted: 08/24/2018] [Indexed: 02/03/2023] Open
Abstract
We developed a computer-aided analysis tool for quantitatively determining bioluminescent reporter distributions inside small animals. The core innovations are a body-fitting animal shuttle and a statistical mouse atlas, both of which are spatially aligned and scaled according to the animal’s weight, and hence provide data congruency across animals of varying size and pose. In conjunction with a multispectral bioluminescence tomography technique capitalizing on the spatial framework of the shuttle, the in vivo biodistribution of luminescent reporters can rapidly be calculated and, thus, enables operator-independent and computer-driven data analysis. We demonstrate its functionality by quantitatively monitoring a bacterial infection, where the bacterial organ burden was determined and validated with the established serial-plating method. In addition, the statistical mouse atlas was validated and compared to existing techniques providing an anatomical reference. The proposed data analysis tool promises to increase data throughput and data reproducibility and accelerate human disease modeling in mice. Analysis of bioluminescence images of bacterial distributions in living animals is mostly manual and semiquantitative. Here, the authors present an analysis platform featuring an animal mold, a probabilistic organ atlas, and a mirror gantry to perform automatic in vivo bioluminescence quantification.
Collapse
Affiliation(s)
| | - Neal Paragas
- InVivo Analytics, New York, NY, USA. .,University of Washington, Seattle, WA, USA.
| |
Collapse
|
47
|
An Y, Wang K, Tian J. Recent methodology advances in fluorescence molecular tomography. Vis Comput Ind Biomed Art 2018; 1:1. [PMID: 32240398 PMCID: PMC7098398 DOI: 10.1186/s42492-018-0001-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2018] [Accepted: 06/30/2018] [Indexed: 12/26/2022] Open
Abstract
Molecular imaging (MI) is a novel imaging discipline that has been continuously developed in recent years. It combines biochemistry, multimodal imaging, biomathematics, bioinformatics, cell & molecular physiology, biophysics, and pharmacology, and it provides a new technology platform for the early diagnosis and quantitative analysis of diseases, treatment monitoring and evaluation, and the development of comprehensive physiology. Fluorescence Molecular Tomography (FMT) is a type of optical imaging modality in MI that captures the three-dimensional distribution of fluorescence within a biological tissue generated by a specific molecule of fluorescent material within a biological tissue. Compared with other optical molecular imaging methods, FMT has the characteristics of high sensitivity, low cost, and safety and reliability. It has become the research frontier and research hotspot of optical molecular imaging technology. This paper took an overview of the recent methodology advances in FMT, mainly focused on the photon propagation model of FMT based on the radiative transfer equation (RTE), and the reconstruction problem solution consist of forward problem and inverse problem. We introduce the detailed technologies utilized in reconstruction of FMT. Finally, the challenges in FMT were discussed. This survey aims at summarizing current research hotspots in methodology of FMT, from which future research may benefit.
Collapse
Affiliation(s)
- Yu An
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Kun Wang
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Jie Tian
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
48
|
Dehghani H, Guggenheim JA, Taylor SL, Xu X, Wang KKH. Quantitative bioluminescence tomography using spectral derivative data. BIOMEDICAL OPTICS EXPRESS 2018; 9:4163-4174. [PMID: 30615705 PMCID: PMC6157772 DOI: 10.1364/boe.9.004163] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/11/2018] [Revised: 07/23/2018] [Accepted: 07/31/2018] [Indexed: 05/15/2023]
Abstract
Bioluminescence imaging (BLI) is a non-contact, optical imaging technique based on measurement of emitted light due to an internal source, which is then often directly related to cellular activity. It is widely used in pre-clinical small animal imaging studies to assess the progression of diseases such as cancer, aiding in the development of new treatments and therapies. For many applications, the quantitative assessment of accurate cellular activity and spatial distribution is desirable as it would enable direct monitoring for prognostic evaluation. This requires quantitative spatially-resolved measurements of bioluminescence source strength inside the animal to be obtained from BLI images. This is the goal of bioluminescence tomography (BLT) in which a model of light propagation through tissue is combined with an optimization algorithm to reconstruct a map of the underlying source distribution. As most models consider only the propagation of light from internal sources to the animal skin surface, an additional challenge is accounting for the light propagation from the skin to the optical detector (e.g. camera). Existing approaches typically use a model of the imaging system optics (e.g. ray-tracing, analytical optical models) or approximate corrections derived from calibration measurements. However, these approaches are typically computationally intensive or of limited accuracy. In this work, a new approach is presented in which, rather than directly using BLI images acquired at several wavelengths, the spectral derivative of that data (difference of BLI images at adjacent wavelengths) is used in BLT. As light at similar wavelengths encounters a near-identical system response (path through the optics etc.) this eliminates the need for additional corrections or system models. This approach is applied to BLT with simulated and experimental phantom data and shown that the error in reconstructed source intensity is reduced from 49% to 4%. Qualitatively, the accuracy of source localization is improved in both simulated and experimental data, as compared to reconstruction using the standard approach. The outlined algorithm can widely be adapted to all commercial systems without any further technological modifications.
Collapse
Affiliation(s)
- Hamid Dehghani
- School of Computer Science, University of Birmingham, Birmingham, B15 2TT, UK
| | - James A. Guggenheim
- Department of Medical Physics & Biomedical Engineering, University College London, London, UK
| | - Shelley L. Taylor
- School of Computer Science, University of Birmingham, Birmingham, B15 2TT, UK
| | - Xiangkun Xu
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Ken Kang-Hsin Wang
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
49
|
Zhang B, Yin W, Liu H, Cao X, Wang H. Bioluminescence tomography with structural information estimated via statistical mouse atlas registration. BIOMEDICAL OPTICS EXPRESS 2018; 9:3544-3558. [PMID: 30338139 PMCID: PMC6191626 DOI: 10.1364/boe.9.003544] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/14/2018] [Revised: 06/27/2018] [Accepted: 07/02/2018] [Indexed: 05/10/2023]
Abstract
Due to an ill-posed and underestimated characteristic of bioluminescence tomography (BLT) reconstruction, a priori anatomical information obtained from computed tomography (CT) or magnetic resonance imaging (MRI), is usually incorporated to improve the reconstruction accuracy. The organs need to be segmented, which is time-consuming and challenging, especially for the low-contrast CT images. In this paper, we present a BLT reconstruction method based on a statistical mouse atlas to improve the efficiency of heterogeneous model generation and the accuracy of target localization. The low-contrast CT image of the mouse was first registered to the statistical mouse atlas model with the constraints of mouse surface and high-contrast organs (bone and lung). Then the other organs, such as the liver and kidney, were determined automatically through the statistical mouse atlas model. The estimated organs were then discretized into tetrahedral meshes for BLT reconstruction. The linearized Bregman method was used to solve the sparse inverse problem of BLT by minimizing the regularization function (L1 norm plus L2 norm with smooth factor). Both numerical simulations and in vivo experiments were conducted, and the results demonstrate that even though the localization of the estimated organs may not be exactly accurate, the proposed method is feasible to reconstruct the bioluminescent source effectively and accurately with the estimated organs. This method would greatly benefit the bioluminescent light source localization for hybrid BLT/CT systems.
Collapse
Affiliation(s)
- Bin Zhang
- School of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
| | - Wanzhou Yin
- School of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
| | - Hao Liu
- School of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
| | - Xu Cao
- Engineering Research Center of Molecular and Neuro Imaging of the Ministry of Education & School of Life Science and Technology, Xidian University, Xi'an, Shaanxi 710071, China
| | - Hongkai Wang
- School of Biomedical Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
| |
Collapse
|
50
|
Perrin DM. Organotrifluoroborates as prosthetic groups for Single-Step F18-Labeling of Complex Molecules. Curr Opin Chem Biol 2018; 45:86-94. [DOI: 10.1016/j.cbpa.2018.03.001] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2018] [Revised: 02/23/2018] [Accepted: 03/07/2018] [Indexed: 12/11/2022]
|