1
|
Zhao Y, Li S, Zhang L, Tang Z, Wei D, Zhang H, Xie Q, Yi H, He X. Two-step reconstruction framework of fluorescence molecular tomography based on energy statistical probability. JOURNAL OF BIOPHOTONICS 2024; 17:e202300480. [PMID: 38351740 DOI: 10.1002/jbio.202300480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 01/17/2024] [Accepted: 01/28/2024] [Indexed: 05/04/2024]
Abstract
Fluorescence molecular tomography (FMT), as a promising technique for early tumor detection, can non-invasively visualize the distribution of fluorescent marker probe three-dimensionally. However, FMT reconstruction is a severely ill-posed problem, which remains an obstacle to wider application of FMT. In this paper, a two-step reconstruction framework was proposed for FMT based on the energy statistical probability. First, the tissue structural information obtained from computed tomography (CT) is employed to associate the tissue optical parameters for rough solution in the global region. Then, according to the global-region reconstruction results, the probability that the target belongs to each region can be calculated. The region with the highest probability is delineated as region of interest to realize accurate and fast source reconstruction. Numerical simulations and in vivo experiments were carried out to evaluate the effectiveness of the proposed framework. The encouraging results demonstrate the significant effectiveness and potential of our method for practical FMT applications.
Collapse
Affiliation(s)
- Yizhe Zhao
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Shuangchen Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Lizhi Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Zijian Tang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - De Wei
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Qiong Xie
- The First Hospital of Hunan University of Chinese Medicine, Changsha, Hunan, China
| | - Huangjian Yi
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| |
Collapse
|
2
|
Hu Y, Wu Y, Li L, Gu L, Zhu X, Jiang J, Ren W. Simultaneous reconstruction of 3D fluorescence distribution and object surface using structured light illumination and dual-camera detection. OPTICS EXPRESS 2024; 32:15760-15773. [PMID: 38859218 DOI: 10.1364/oe.517189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 02/26/2024] [Indexed: 06/12/2024]
Abstract
Fluorescence molecular tomography (FMT) serves as a noninvasive modality for visualizing volumetric fluorescence distribution within biological tissues, thereby proving to be an invaluable imaging tool for preclinical animal studies. The conventional FMT relies upon a point-by-point raster scan strategy, enhancing the dataset for subsequent reconstruction but concurrently elongating the data acquisition process. The resultant diminished temporal resolution has persistently posed a bottleneck, constraining its utility in dynamic imaging studies. We introduce a novel system capable of simultaneous FMT and surface extraction, which is attributed to the implementation of a rapid line scanning approach and dual-camera detection. The system performance was characterized through phantom experiments, while the influence of scanning line density on reconstruction outcomes has been systematically investigated via both simulation and experiments. In a proof-of-concept study, our approach successfully captures a moving fluorescence bolus in three dimensions with an elevated frame rate of approximately 2.5 seconds per frame, employing an optimized scan interval of 5 mm. The notable enhancement in the spatio-temporal resolution of FMT holds the potential to broaden its applications in dynamic imaging tasks, such as surgical navigation.
Collapse
|
3
|
Xing L, Zhang L, Sun W, He Z, Zhang Y, Gao F. Performance enhancement of diffuse fluorescence tomography based on an extended Kalman filtering-long short term memory neural network correction model. BIOMEDICAL OPTICS EXPRESS 2024; 15:2078-2093. [PMID: 38633070 PMCID: PMC11019700 DOI: 10.1364/boe.514041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 12/29/2023] [Accepted: 01/31/2024] [Indexed: 04/19/2024]
Abstract
To alleviate the ill-posedness of diffuse fluorescence tomography (DFT) reconstruction and improve imaging quality and speed, a model-derived deep-learning method is proposed by combining extended Kalman filtering (EKF) with a long short term memory (LSTM) neural network, where the iterative process parameters acquired by implementing semi-iteration EKF (SEKF) served as inputs to the LSTM neural network correction model for predicting the optimal fluorescence distributions. To verify the effectiveness of the SEKF-LSTM algorithm, a series of numerical simulations, phantom and in vivo experiments are conducted, and the experimental results are quantitatively evaluated and compared with the traditional EKF algorithm. The simulation experimental results show that the proposed new algorithm can effectively improve the reconstructed image quality and reconstruction speed. Importantly, the LSTM correction model trained by the simulation data also obtains satisfactory results in the experimental data, suggesting that the SEKF-LSTM algorithm possesses strong generalization ability and great potential for practical applications.
Collapse
Affiliation(s)
- Lingxiu Xing
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Limin Zhang
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin, China
| | - Wenjing Sun
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Zhuanxia He
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Yanqi Zhang
- Tianjin Medical University, School of Medical Imaging, Tianjin, China
| | - Feng Gao
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin, China
| |
Collapse
|
4
|
Gao P, Pu H, Liu T, Cao Y, Li W, Huang S, Li R, Lu H, Rong J. Automated Restarting Fast Proximal Gradient Descent Method for Single-View Cone-Beam X-ray Luminescence Computed Tomography Based on Depth Compensation. Bioengineering (Basel) 2024; 11:123. [PMID: 38391609 PMCID: PMC10885960 DOI: 10.3390/bioengineering11020123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 01/23/2024] [Accepted: 01/25/2024] [Indexed: 02/24/2024] Open
Abstract
Single-view cone-beam X-ray luminescence computed tomography (CB-XLCT) has recently gained attention as a highly promising imaging technique that allows for the efficient and rapid three-dimensional visualization of nanophosphor (NP) distributions in small animals. However, the reconstruction performance is hindered by the ill-posed nature of the inverse problem and the effects of depth variation as only a single view is acquired. To tackle this issue, we present a methodology that integrates an automated restarting strategy with depth compensation to achieve reconstruction. The present study employs a fast proximal gradient descent (FPGD) method, incorporating L0 norm regularization, to achieve efficient reconstruction with accelerated convergence. The proposed approach offers the benefit of retrieving neighboring multitarget distributions without the need for CT priors. Additionally, the automated restarting strategy ensures reliable reconstructions without the need for manual intervention. Numerical simulations and physical phantom experiments were conducted using a custom CB-XLCT system to demonstrate the accuracy of the proposed method in resolving adjacent NPs. The results showed that this method had the lowest relative error compared to other few-view techniques. This study signifies a significant progression in the development of practical single-view CB-XLCT for high-resolution 3-D biomedical imaging.
Collapse
Affiliation(s)
- Peng Gao
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China
| | - Huangsheng Pu
- College of Advanced Interdisciplinary Studies & Hunan Provincial Key Laboratory of Novel NanoOptoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
- Nanhu Laser Laboratory, National University of Defense Technology, Changsha 410073, China
| | - Tianshuai Liu
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China
| | - Yilin Cao
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China
| | - Wangyang Li
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China
| | - Shien Huang
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China
| | - Ruijing Li
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China
| | - Hongbing Lu
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China
| | - Junyan Rong
- School of Biomedical Engineering, Air Force Medical University, Xi'an 710032, China
| |
Collapse
|
5
|
Zhao Y, Li S, He X, Yu J, Zhang L, Zhang H, Wei D, Wang B, Li J, Guo H, He X. Liver injury monitoring using dynamic fluorescence molecular tomography based on a time-energy difference strategy. BIOMEDICAL OPTICS EXPRESS 2023; 14:5298-5315. [PMID: 37854546 PMCID: PMC10581805 DOI: 10.1364/boe.498092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 09/03/2023] [Accepted: 09/05/2023] [Indexed: 10/20/2023]
Abstract
Dynamic fluorescence molecular tomography (DFMT) is a promising molecular imaging technique that offers the potential to monitor fast kinetic behaviors within small animals in three dimensions. Early monitoring of liver disease requires the ability to distinguish and analyze normal and injured liver tissues. However, the inherent ill-posed nature of the problem and energy signal interference between the normal and injured liver regions limit the practical application of liver injury monitoring. In this study, we propose a novel strategy based on time and energy, leveraging the temporal correlation in fluorescence molecular imaging (FMI) sequences and the metabolic differences between normal and injured liver tissue. Additionally, considering fluorescence signal distribution disparity between the injured and normal regions, we designed a universal Golden Ratio Primal-Dual Algorithm (GRPDA) to reconstruct both the normal and injured liver regions. Numerical simulation and in vivo experiment results demonstrate that the proposed strategy can effectively avoid signal interference between liver and liver injury energy and lead to significant improvements in morphology recovery and positioning accuracy compared to existing approaches. Our research presents a new perspective on distinguishing normal and injured liver tissues for early liver injury monitoring.
Collapse
Affiliation(s)
- Yizhe Zhao
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Shuangchen Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Xuelei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, 710062, China
| | - Lizhi Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - De Wei
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Beilei Wang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Jintao Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| |
Collapse
|
6
|
Zhang J, Zhang G, Chen Y, Li K, Zhao F, Yi H, Su L, Cao X. Regularized reconstruction based on joint smoothly clipped absolute deviation regularization and graph manifold learning for fluorescence molecular tomography. Phys Med Biol 2023; 68:195004. [PMID: 37647921 DOI: 10.1088/1361-6560/acf55a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 08/30/2023] [Indexed: 09/01/2023]
Abstract
Objective.Fluorescence molecular tomography (FMT) is an optical imaging modality that provides high sensitivity and low cost, which can offer the three-dimensional distribution of biomarkers by detecting the fluorescently labeled probe noninvasively. In the field of preclinical cancer diagnosis and treatment, FMT has gained significant traction. Nonetheless, the current FMT reconstruction results suffer from unsatisfactory morphology and location accuracy of the fluorescence distribution, primarily due to the light scattering effect and the ill-posed nature of the inverse problem.Approach.To address these challenges, a regularized reconstruction method based on joint smoothly clipped absolute deviation regularization and graph manifold learning (SCAD-GML) for FMT is presented in this paper. The SCAD-GML approach combines the sparsity of the fluorescent sources with the latent manifold structure of fluorescent source distribution to achieve more accurate and sparse reconstruction results. To obtain the reconstruction results efficiently, the non-convex gradient descent iterative method is employed to solve the established objective function. To assess the performance of the proposed SCAD-GML method, a comprehensive evaluation is conducted through numerical simulation experiments as well asin vivoexperiments.Main results.The results demonstrate that the SCAD-GML method outperforms other methods in terms of both location and shape recovery of fluorescence biomarkers distribution.Siginificance.These findings indicate that the SCAD-GML method has the potential to advance the application of FMT inin vivobiological research.
Collapse
Affiliation(s)
- Jun Zhang
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Gege Zhang
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Yi Chen
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Kang Li
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Fengjun Zhao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
| | - Huangjian Yi
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
| | - Linzhi Su
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Xin Cao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| |
Collapse
|
7
|
An Y, Wang H, Li J, Li G, Ma X, Du Y, Tian J. Reconstruction based on adaptive group least angle regression for fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2023; 14:2225-2239. [PMID: 37206151 PMCID: PMC10191665 DOI: 10.1364/boe.486451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 03/17/2023] [Accepted: 03/27/2023] [Indexed: 05/21/2023]
Abstract
Fluorescence molecular tomography can combine two-dimensional fluorescence imaging with anatomical information to reconstruct three-dimensional images of tumors. Reconstruction based on traditional regularization with tumor sparsity priors does not take into account that tumor cells form clusters, so it performs poorly when multiple light sources are used. Here we describe reconstruction based on an "adaptive group least angle regression elastic net" (AGLEN) method, in which local spatial structure correlation and group sparsity are integrated with elastic net regularization, followed by least angle regression. The AGLEN method works iteratively using the residual vector and a median smoothing strategy in order to adaptively obtain a robust local optimum. The method was verified using numerical simulations as well as imaging of mice bearing liver or melanoma tumors. AGLEN reconstruction performed better than state-of-the-art methods with different sizes of light sources at different distances from the sample and in the presence of Gaussian noise at 5-25%. In addition, AGLEN-based reconstruction accurately imaged tumor expression of cell death ligand-1, which can guide immunotherapy.
Collapse
Affiliation(s)
- Yu An
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Hanfan Wang
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Jiaqian Li
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Guanghui Li
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Xiaopeng Ma
- School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, China
| | - Yang Du
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Jie Tian
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| |
Collapse
|
8
|
Zhang L, Guo H, Li J, Kang D, Zhang D, He X, Zhao Y, Wei D, Yu J. Multi-target reconstruction strategy based on blind source separation of surface measurement signals in FMT. BIOMEDICAL OPTICS EXPRESS 2023; 14:1159-1177. [PMID: 36950247 PMCID: PMC10026579 DOI: 10.1364/boe.481348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Revised: 01/30/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
Fluorescence molecular tomography (FMT) is a promising molecular imaging technique for tumor detection in the early stage. High-precision multi-target reconstructions are necessary for quantitative analysis in practical FMT applications. The existing reconstruction methods perform well in retrieving a single fluorescent target but may fail in reconstructing a multi-target, which remains an obstacle to the wider application of FMT. In this paper, a novel multi-target reconstruction strategy based on blind source separation (BSS) of surface measurement signals was proposed, which transformed the multi-target reconstruction problem into multiple single-target reconstruction problems. Firstly, by multiple points excitation, multiple groups of superimposed measurement signals conforming to the conditions of BSS were constructed. Secondly, an efficient nonnegative least-correlated component analysis with iterative volume maximization (nLCA-IVM) algorithm was applied to construct the separation matrix, and the superimposed measurement signals were separated into the measurements of each target. Thirdly, the least squares fitting method was combined with BSS to determine the number of fluorophores indirectly. Lastly, each target was reconstructed based on the extracted surface measurement signals. Numerical simulations and in vivo experiments proved that it has the ability of multi-target resolution for FMT. The encouraging results demonstrate the significant effectiveness and potential of our method for practical FMT applications.
Collapse
Affiliation(s)
- Lizhi Zhang
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Hongbo Guo
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Jintao Li
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Dizhen Kang
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Diya Zhang
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Xiaowei He
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Yizhe Zhao
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - De Wei
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi’an 710062, China
| |
Collapse
|
9
|
Zhang P, Ma C, Song F, Liu Z, Feng Y, Sun Y, He Y, Liu F, Wang D, Zhang G. Multi-branch attention prior based parameterized generative adversarial network for fast and accurate limited-projection reconstruction in fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2022; 13:5327-5343. [PMID: 36425627 PMCID: PMC9664898 DOI: 10.1364/boe.469505] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 09/05/2022] [Accepted: 09/06/2022] [Indexed: 06/16/2023]
Abstract
Limited-projection fluorescence molecular tomography (FMT) allows rapid reconstruction of the three-dimensional (3D) distribution of fluorescent targets within a shorter data acquisition time. However, the limited-projection FMT is severely ill-posed and ill-conditioned due to insufficient fluorescence measurements and the strong scattering properties of photons in biological tissues. Previously, regularization-based methods, combined with the sparse distribution of fluorescent sources, have been commonly used to alleviate the severe ill-posed nature of the limited-projection FMT. Due to the complex iterative computations, time-consuming solution procedures, and less stable reconstruction results, the limited-projection FMT remains an intractable challenge for achieving fast and accurate reconstructions. In this work, we completely discard the previous iterative solving-based reconstruction themes and propose multi-branch attention prior based parameterized generative adversarial network (MAP-PGAN) to achieve fast and accurate limited-projection FMT reconstruction. Firstly, the multi-branch attention can provide parameterized weighted sparse prior information for fluorescent sources, enabling MAP-PGAN to effectively mitigate the ill-posedness and significantly improve the reconstruction accuracy of limited-projection FMT. Secondly, since the end-to-end direct reconstruction strategy is adopted, the complex iterative computation process in traditional regularization algorithms can be avoided, thus greatly accelerating the 3D visualization process. The numerical simulation results show that the proposed MAP-PGAN method outperforms the state-of-the-art methods in terms of localization accuracy and morphological recovery. Meanwhile, the reconstruction time is only about 0.18s, which is about 100 to 1000 times faster than the conventional iteration-based regularization algorithms. The reconstruction results from the physical phantoms and in vivo experiments further demonstrate the feasibility and practicality of the MAP-PGAN method in achieving fast and accurate limited-projection FMT reconstruction.
Collapse
Affiliation(s)
- Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
- These authors contributed equally to this work
| | - Chenbin Ma
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
- Shenyuan Honors College, Beihang University, 100191, Beijing, China
- These authors contributed equally to this work
| | - Fan Song
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Zeyu Liu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Youdan Feng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Yangyang Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Yufang He
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Fei Liu
- Advanced Information & Industrial Technology Research Institute, Beijing Information Science & Technology University, Beijing, 100192, China
| | - Daifa Wang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Guanglei Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| |
Collapse
|
10
|
Chen Y, Li W, Du M, Su L, Yi H, Zhao F, Li K, Wang L, Cao X. Elastic net-based non-negative iterative three-operator splitting strategy for Cerenkov luminescence tomography. OPTICS EXPRESS 2022; 30:35282-35299. [PMID: 36258483 DOI: 10.1364/oe.465501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 08/18/2022] [Indexed: 06/16/2023]
Abstract
Cerenkov luminescence tomography (CLT) provides a powerful optical molecular imaging technique for non-invasive detection and visualization of radiopharmaceuticals in living objects. However, the severe photon scattering effect causes ill-posedness of the inverse problem, and the location accuracy and shape recovery of CLT reconstruction results are unsatisfactory for clinical application. Here, to improve the reconstruction spatial location accuracy and shape recovery ability, a non-negative iterative three operator splitting (NNITOS) strategy based on elastic net (EN) regularization was proposed. NNITOS formalizes the CLT reconstruction as a non-convex optimization problem and splits it into three operators, the least square, L1/2-norm regularization, and adaptive grouping manifold learning, then iteratively solved them. After stepwise iterations, the result of NNITOS converged progressively. Meanwhile, to speed up the convergence and ensure the sparsity of the solution, shrinking the region of interest was utilized in this strategy. To verify the effectiveness of the method, numerical simulations and in vivo experiments were performed. The result of these experiments demonstrated that, compared to several methods, NNITOS can achieve superior performance in terms of location accuracy, shape recovery capability, and robustness. We hope this work can accelerate the clinical application of CLT in the future.
Collapse
|
11
|
Zhang P, Liu J, Yin L, An Y, Zhang S, Tong W, Hui H, Tian J. Adaptive permissible region based random Kaczmarz reconstruction method for localization of carotid atherosclerotic plaques in fluorescence molecular tomography. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac8718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 08/04/2022] [Indexed: 11/12/2022]
Abstract
Abstract
Objective. In this study, we propose the adaptive permissible region based random Kaczmarz method as an improved reconstruction method to recover small carotid atherosclerotic plaque targets in rodents with high resolution in fluorescence molecular tomography (FMT). Approach. We introduce the random Kaczmarz method as an advanced minimization method to solve the FMT inverse problem. To satisfy the special condition of this method, we proposed an adaptive permissible region strategy based on traditional permissible region methods to flexibly compress the dimension of the solution space. Main results. Monte Carlo simulations, phantom experiments, and in vivo experiments demonstrate that the proposed method can recover the small carotid atherosclerotic plaque targets with high resolution and accuracy, and can achieve lower root mean squared error and distance error (DE) than other traditional methods. For targets with 1.5 mm diameter and 0.5 mm separation, the DE indicators can be improved by up to 40%. Moreover, the proposed method can be utilized for in vivo locating atherosclerotic plaques with high accuracy and robustness. Significance. We applied the random Kaczmarz method to solve the inverse problem in FMT and improve the reconstruction result via this advanced minimization method. We verified that the FMT technology has a great potential to locate and quantify atherosclerotic plaques with higher accuracy, and can be expanded to more preclinical research.
Collapse
|
12
|
Zhang P, Ma C, Song F, Fan G, Sun Y, Feng Y, Ma X, Liu F, Zhang G. A review of advances in imaging methodology in fluorescence molecular tomography. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac5ce7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Accepted: 03/11/2022] [Indexed: 01/03/2023]
Abstract
Abstract
Objective. Fluorescence molecular tomography (FMT) is a promising non-invasive optical molecular imaging technology with strong specificity and sensitivity that has great potential for preclinical and clinical studies in tumor diagnosis, drug development and therapeutic evaluation. However, the strong scattering of photons and insufficient surface measurements make it very challenging to improve the quality of FMT image reconstruction and its practical application for early tumor detection. Therefore, continuous efforts have been made to explore more effective approaches or solutions in the pursuit of high-quality FMT reconstructions. Approach. This review takes a comprehensive overview of advances in imaging methodology for FMT, mainly focusing on two critical issues in FMT reconstructions: improving the accuracy of solving the forward physical model and mitigating the ill-posed nature of the inverse problem from a methodological point of view. More importantly, numerous impressive and practical strategies and methods for improving the quality of FMT reconstruction are summarized. Notably, deep learning methods are discussed in detail to illustrate their advantages in promoting the imaging performance of FMT thanks to large datasets, the emergence of optimized algorithms and the application of innovative networks. Main results. The results demonstrate that the imaging quality of FMT can be effectively promoted by improving the accuracy of optical parameter modeling, combined with prior knowledge, and reducing dimensionality. In addition, the traditional regularization-based methods and deep neural network-based methods, especially end-to-end deep networks, can enormously alleviate the ill-posedness of the inverse problem and improve the quality of FMT image reconstruction. Significance. This review aims to illustrate a variety of effective and practical methods for the reconstruction of FMT images that may benefit future research. Furthermore, it may provide some valuable research ideas and directions for FMT in the future, and could promote, to a certain extent, the development of FMT and other methods of optical tomography.
Collapse
|
13
|
An Y, Bian C, Yan D, Wang H, Wang Y, Du Y, Tian J. A Fast and Automated FMT/XCT Reconstruction Strategy Based on Standardized Imaging Space. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:657-666. [PMID: 34648436 DOI: 10.1109/tmi.2021.3120011] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
The traditional finite element method-based fluorescence molecular tomography (FMT)/ X-ray computed tomography (XCT) imaging reconstruction suffers from complicated mesh generation and dual-modality image data fusion, which limits the application of in vivo imaging. To solve this problem, a novel standardized imaging space reconstruction (SISR) method for the quantitative determination of fluorescent probe distributions inside small animals was developed. In conjunction with a standardized dual-modality image data fusion technology, and novel reconstruction strategy based on Laplace regularization and L1-fused Lasso method, the in vivo distribution can be calculated rapidly and accurately, which enables standardized and algorithm-driven data process. We demonstrated the method's feasibility through numerical simulations and quantitatively monitored in vivo programmed death ligand 1 (PD-L1) expression in mouse tumor xenografts, and the results demonstrate that our proposed SISR can increase data throughput and reproducibility, which helps to realize the dynamically and accurately in vivo imaging.
Collapse
|
14
|
Wang X, Hu R, Wang Y, Yan Q, Wang Y, Kang F, Zhu S. A Data Self-Calibration Method Based on High-Density Parallel Plate Diffuse Optical Tomography for Breast Cancer Imaging. Front Oncol 2021; 11:786289. [PMID: 34993144 PMCID: PMC8724432 DOI: 10.3389/fonc.2021.786289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 12/03/2021] [Indexed: 11/13/2022] Open
Abstract
When performing the diffuse optical tomography (DOT) of the breast, the mismatch between the forward model and the experimental conditions will significantly hinder the reconstruction accuracy. Therefore, the reference measurement is commonly used to calibrate the measured data before the reconstruction. However, it is complicated to customize corresponding reference phantoms based on the breast shape and background optical parameters of different subjects in clinical trials. Furthermore, although high-density (HD) DOT configuration has been proven to improve imaging quality, a large number of source-detector (SD) pairs also increase the difficulty of multi-channel correction. To enhance the applicability of the breast DOT, a data self-calibration method based on an HD parallel-plate DOT system is proposed in this paper to replace the conventional relative measurement on a reference phantom. The reference predicted data can be constructed directly from the measurement data with the support of the HD-DOT system, which has nearly a hundred sets of measurements at each SD distance. The proposed scheme has been validated by Monte Carlo (MC) simulation, breast-size phantom experiments, and clinical trials, exhibiting the feasibility in ensuring the quality of the DOT reconstruction while effectively reducing the complexity associated with relative measurements on reference phantoms.
Collapse
Affiliation(s)
- Xin Wang
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
| | - Rui Hu
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
| | - Yirong Wang
- Department of Nuclear Medicine, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Qiang Yan
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
| | - Yihan Wang
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
- *Correspondence: Yihan Wang, ; Shouping Zhu,
| | - Fei Kang
- Department of Nuclear Medicine, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Shouping Zhu
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
- *Correspondence: Yihan Wang, ; Shouping Zhu,
| |
Collapse
|
15
|
Zhang H, He X, Yu J, He X, Guo H, Hou Y. L1-L2 norm regularization via forward-backward splitting for fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:7807-7825. [PMID: 35003868 PMCID: PMC8713696 DOI: 10.1364/boe.435932] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 11/08/2021] [Accepted: 11/08/2021] [Indexed: 05/07/2023]
Abstract
Fluorescent molecular tomography (FMT) is a highly sensitive and noninvasive imaging approach for providing three-dimensional distribution of fluorescent marker probes. However, owing to its light scattering effect and the ill-posedness of inverse problems, it is challenging to develop an efficient reconstruction algorithm that can achieve the exact location and morphology of the fluorescence source. In this study, therefore, in order to satisfy the need for early tumor detection and improve the sparsity of solution, we proposed a novel L 1-L 2 norm regularization via the forward-backward splitting method for enhancing the FMT reconstruction accuracy and the robustness. By fully considering the highly coherent nature of the system matrix of FMT, it operates by splitting the objective to be minimized into simpler functions, which are dealt with individually to obtain a sparser solution. An analytic solution of L 1-L 2 norm proximal operators and a forward-backward splitting algorithm were employed to efficiently solve the nonconvex L 1-L 2 norm minimization problem. Numerical simulations and an in-vivo glioma mouse model experiment were conducted to evaluate the performance of our algorithm. The comparative results of these experiments demonstrated that the proposed algorithm obtained superior reconstruction performance in terms of spatial location, dual-source resolution, and in-vivo practicability. It was believed that this study would promote the preclinical and clinical applications of FMT in early tumor detection.
Collapse
Affiliation(s)
- Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, 710062, China
| | - Xuelei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Yuqing Hou
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| |
Collapse
|
16
|
Zhang X, Cai M, Guo L, Zhang Z, Shen B, Zhang X, Hu Z, Tian J. Attention mechanism-based locally connected network for accurate and stable reconstruction in Cerenkov luminescence tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:7703-7716. [PMID: 35003861 PMCID: PMC8713679 DOI: 10.1364/boe.443517] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 10/28/2021] [Accepted: 11/09/2021] [Indexed: 06/14/2023]
Abstract
Cerenkov luminescence tomography (CLT) is a novel and highly sensitive imaging technique, which could obtain the three-dimensional distribution of radioactive probes to achieve accurate tumor detection. However, the simplified radiative transfer equation and ill-conditioned inverse problem cause a reconstruction error. In this study, a novel attention mechanism based locally connected (AMLC) network was proposed to reduce barycenter error and improve morphological restorability. The proposed AMLC network consisted of two main parts: a fully connected sub-network for providing a coarse reconstruction result, and a locally connected sub-network based on an attention matrix for refinement. Both numerical simulations and in vivo experiments were conducted to show the superiority of the AMLC network in accuracy and stability over existing methods (MFCNN, KNN-LC network). This method improved CLT reconstruction performance and promoted the application of machine learning in optical imaging research.
Collapse
Affiliation(s)
- Xiaoning Zhang
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, China
- CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
- Equal contribution
| | - Meishan Cai
- CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
- Equal contribution
| | - Lishuang Guo
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, China
- CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Zeyu Zhang
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, China
- CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Biluo Shen
- CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Xiaojun Zhang
- Department of Nuclear Medicine, Chinese PLA General Hospital, Beijing, 100853, China
| | - Zhenhua Hu
- CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Jie Tian
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, China
- CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
17
|
Zhang P, Fan G, Xing T, Song F, Zhang G. UHR-DeepFMT: Ultra-High Spatial Resolution Reconstruction of Fluorescence Molecular Tomography Based on 3-D Fusion Dual-Sampling Deep Neural Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3217-3228. [PMID: 33826514 DOI: 10.1109/tmi.2021.3071556] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Fluorescence molecular tomography (FMT) is a promising and high sensitivity imaging modality that can reconstruct the three-dimensional (3D) distribution of interior fluorescent sources. However, the spatial resolution of FMT has encountered an insurmountable bottleneck and cannot be substantially improved, due to the simplified forward model and the severely ill-posed inverse problem. In this work, a 3D fusion dual-sampling convolutional neural network, namely UHR-DeepFMT, was proposed to achieve ultra-high spatial resolution reconstruction of FMT. Under this framework, the UHR-DeepFMT does not need to explicitly solve the FMT forward and inverse problems. Instead, it directly establishes an end-to-end mapping model to reconstruct the fluorescent sources, which can enormously eliminate the modeling errors. Besides, a novel fusion mechanism that integrates the dual-sampling strategy and the squeeze-and-excitation (SE) module is introduced into the skip connection of UHR-DeepFMT, which can significantly improve the spatial resolution by greatly alleviating the ill-posedness of the inverse problem. To evaluate the performance of UHR-DeepFMT network model, numerical simulations, physical phantom and in vivo experiments were conducted. The results demonstrated that the proposed UHR-DeepFMT can outperform the cutting-edge methods and achieve ultra-high spatial resolution reconstruction of FMT with the powerful ability to distinguish adjacent targets with a minimal edge-to-edge distance (EED) of 0.5 mm. It is assumed that this research is a significant improvement for FMT in terms of spatial resolution and overall imaging quality, which could promote the precise diagnosis and preclinical application of small animals in the future.
Collapse
|
18
|
Yin L, Wang K, Tong T, Wang Q, An Y, Yang X, Tian J. Adaptive Grouping Block Sparse Bayesian Learning Method for Accurate and Robust Reconstruction in Bioluminescence Tomography. IEEE Trans Biomed Eng 2021; 68:3388-3398. [PMID: 33830917 DOI: 10.1109/tbme.2021.3071823] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Bioluminescence tomography (BLT) is a promising modality that is designed to provide non-invasive quantitative three-dimensional information regarding the tumor distribution in living animals. However, BLT suffers from inferior reconstructions due to its ill-posedness. This study aims to improve the reconstruction performance of BLT. METHODS We propose an adaptive grouping block sparse Bayesian learning (AGBSBL) method, which incorporates the sparsity prior, correlation of neighboring mesh nodes, and anatomical structure prior to balance the sparsity and morphology in BLT. Specifically, an adaptive grouping prior model is proposed to adjust the grouping according to the intensity of the mesh nodes during the optimization process. RESULTS Numerical simulations and in vivo experiments demonstrate that AGBSBL yields a high position and morphology recovery accuracy, stability, and practicality. CONCLUSION The proposed method is a robust and effective reconstruction algorithm for BLT. Moreover, the proposed adaptive grouping strategy can further increase the practicality of BLT in biomedical applications.
Collapse
|
19
|
Meng H, Gao Y, Yang X, Wang K, Tian J. K-Nearest Neighbor Based Locally Connected Network for Fast Morphological Reconstruction in Fluorescence Molecular Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:3019-3028. [PMID: 32286961 DOI: 10.1109/tmi.2020.2984557] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Fluorescence molecular tomography (FMT) is a highly sensitive and noninvasive imaging modality for three-dimensional visualization of fluorescence probe distribution in small animals. However, the simplified photon propagation model and ill-posed inverse problem limit the improvement of FMT reconstruction. In this work, we proposed a novel K-nearest neighbor based locally connected (KNN-LC) network to improve the performance of morphological reconstruction in FMT. It directly builds the inverse process of photon transmission by learning the mapping relation between the surface photon intensity and the distribution of fluorescent source. KNN-LC network cascades a fully connected (FC) sub-network with a locally connected (LC) sub-network, where the FC part provides a coarse reconstruction result and LC part fine-tunes the morphological quality of reconstructed result. To assess the performance of our proposed network, we implemented both numerical simulation and in vivo studies. Furthermore, split Bregman-resolved total variation (SBRTV) regularization method and inverse problem simulation (IPS) method were utilized as baselines in all comparisons. The results demonstrated that KNN-LC network achieved accurate reconstruction in both source localization and morphology recovery in a short time. This promoted the in vivo application of FMT for visualizing the distribution of biomarkers inside biological tissue.
Collapse
|
20
|
Cai M, Zhang Z, Shi X, Yang J, Hu Z, Tian J. Non-Negative Iterative Convex Refinement Approach for Accurate and Robust Reconstruction in Cerenkov Luminescence Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:3207-3217. [PMID: 32324543 DOI: 10.1109/tmi.2020.2987640] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Cerenkov luminescence tomography (CLT) is a promising imaging tool for obtaining three-dimensional (3D) non-invasive visualization of the in vivo distribution of radiopharmaceuticals. However, the reconstruction performance remains unsatisfactory for biomedical applications because the inverse problem of CLT is severely ill-conditioned and intractable. In this study, therefore, a novel non-negative iterative convex refinement (NNICR) approach was utilized to improve the CLT reconstruction accuracy, robustness as well as the shape recovery capability. The spike and slab prior information was employed to capture the sparsity of Cerenkov source, which could be formalized as a non-convex optimization problem. The NNICR approach solved this non-convex problem by refining the solutions of the convex sub-problems. To evaluate the performance of the NNICR approach, numerical simulations and in vivo tumor-bearing mice models experiments were conducted. Conjugated gradient based Tikhonov regularization approach (CG-Tikhonov), fast iterative shrinkage-thresholding algorithm based Lasso approach (Fista-Lasso) and Elastic-Net regularization approach were used for the comparison of the reconstruction performance. The results of these experiments demonstrated that the NNICR approach obtained superior reconstruction performance in terms of location accuracy, shape recovery capability, robustness and in vivo practicability. It was believed that this study would facilitate the preclinical and clinical applications of CLT in the future.
Collapse
|
21
|
Cao X, Li K, Xu XL, Deneen KMV, Geng GH, Chen XL. Development of tomographic reconstruction for three-dimensional optical imaging: From the inversion of light propagation to artificial intelligence. Artif Intell Med Imaging 2020; 1:78-86. [DOI: 10.35711/aimi.v1.i2.78] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Revised: 08/01/2020] [Accepted: 08/21/2020] [Indexed: 02/06/2023] Open
Abstract
Optical molecular tomography (OMT) is an imaging modality which uses an optical signal, especially near-infrared light, to reconstruct the three-dimensional information of the light source in biological tissue. With the advantages of being low-cost, noninvasive and having high sensitivity, OMT has been applied in preclinical and clinical research. However, due to its serious ill-posedness and ill-condition, the solution of OMT requires heavy data analysis and the reconstruction quality is limited. Recently, the artificial intelligence (commonly known as AI)-based methods have been proposed to provide a different tool to solve the OMT problem. In this paper, we review the progress on OMT algorithms, from conventional methods to AI-based methods, and we also give a prospective towards future developments in this domain.
Collapse
Affiliation(s)
- Xin Cao
- School of Information Science and Technology, Northwest University, Xi’an 710069, Shaanxi Province, China
| | - Kang Li
- School of Information Science and Technology, Northwest University, Xi’an 710069, Shaanxi Province, China
| | - Xue-Li Xu
- School of Information Science and Technology, Northwest University, Xi’an 710069, Shaanxi Province, China
| | - Karen M von Deneen
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, and School of Life Science and Technology, Xidian University, Xi’an 710126, Shaanxi Province, China
| | - Guo-Hua Geng
- School of Information Science and Technology, Northwest University, Xi’an 710069, Shaanxi Province, China
| | - Xue-Li Chen
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, and School of Life Science and Technology, Xidian University, Xi’an 710126, Shaanxi Province, China
| |
Collapse
|
22
|
Gao P, Cheng K, Schüler E, Jia M, Zhao W, Xing L. Restarted primal-dual Newton conjugate gradient method for enhanced spatial resolution of reconstructed cone-beam x-ray luminescence computed tomography images. Phys Med Biol 2020; 65:135008. [PMID: 32268318 PMCID: PMC7594591 DOI: 10.1088/1361-6560/ab87fb] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Cone-beam x-ray luminescence computed tomography (CB-XLCT) has been proposed as a promising imaging tool, which enables three-dimensional imaging of the distribution of nanophosphors (NPs) in small animals. However, the reconstruction performance is usually unsatisfactory in terms of spatial resolution due to the ill-posedness of the CB-XLCT inverse problem. To alleviate this problem and to achieve high spatial resolution, a reconstruction method consisting of inner and outer iterations based on a restarted strategy is proposed. In this method, the primal-dual Newton conjugate gradient method (pdNCG) is adopted in the inner iterations to get fast reconstruction, which is used for resetting the permission region and increasing the convergence speed of the outer iteration. To assess the performance of the method, both numerical simulation and physical phantom experiments were conducted with a CB-XLCT system. The results demonstrate that compared with conventional reconstruction methods, the proposed re-pdNCG method can accurately and efficiently resolve the adjacent NPs with the least relative error.
Collapse
Affiliation(s)
- Peng Gao
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
- School of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, People’s Republic of China
- These authors contributed to this work equally
| | - Kai Cheng
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
- These authors contributed to this work equally
| | - Emil Schüler
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| | - Mengyu Jia
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| | - Wei Zhao
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| | - Lei Xing
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| |
Collapse
|
23
|
Kong L, An Y, Liang Q, Yin L, Du Y, Tian J. Reconstruction for Fluorescence Molecular Tomography via Adaptive Group Orthogonal Matching Pursuit. IEEE Trans Biomed Eng 2020; 67:2518-2529. [PMID: 31905129 DOI: 10.1109/tbme.2019.2963815] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Fluorescence molecular tomography (FMT) is a promising medical imaging technology aimed at the non-invasive, specific, and sensitive detection of the distribution of fluorophore. Conventional sparsity prior-based methods of FMT commonly face problems such as over-sparseness, spatial discontinuity, and poor robustness, due to the neglect of the interrelation within the local subspace. To address this, we propose an adaptive group orthogonal matching pursuit (AGOMP) method. METHODS AGOMP is based on a novel local spatial-structured sparse regularization, which leverages local spatial interrelations as group sparsity without the hard prior of the tumor region. The adaptive grouped subspace matching pursuit method was adopted to enhance the interrelatedness of elements within a group, which alleviates the over-sparsity problem to some extent and improves the accuracy, robustness, and morphological similarity of FMT reconstruction. A series of numerical simulation experiments, based on digital mouse with both one and several tumors, were conducted, as well as in vivo mouse experiments. RESULTS The results demonstrated that the proposed AGOMP method achieved better location accuracy, fluorescent yield reconstruction, relative sparsity, and morphology than state-of-the-art methods under complex conditions for levels of Gaussian noise ranging from 5-25%. Furthermore, the in vivo mouse experiments demonstrated the practical application of FMT with AGOMP. CONCLUSION The proposed AGOMP can improve the accuracy and robustness for FMT reconstruction in biomedical application.
Collapse
|
24
|
Huang W, Wang K, An Y, Meng H, Gao Y, Xiong Z, Yan H, Wang Q, Cai X, Yang X, Zhang B, Chen Q, Yang X, Tian J, Zhang S. In vivo three-dimensional evaluation of tumour hypoxia in nasopharyngeal carcinomas using FMT-CT and MSOT. Eur J Nucl Med Mol Imaging 2019; 47:1027-1038. [PMID: 31705175 PMCID: PMC7101302 DOI: 10.1007/s00259-019-04526-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Accepted: 09/05/2019] [Indexed: 11/26/2022]
Abstract
Purpose Accurate evaluation of hypoxia is particularly important in patients with nasopharyngeal carcinoma (NPC) undergoing radiotherapy. The aim of this study was to propose a novel imaging strategy for quantitative three-dimensional (3D) evaluation of hypoxia in a small animal model of NPC. Methods A carbonic anhydrase IX (CAIX)-specific molecular probe (CAIX-800) was developed for imaging of hypoxia. Mouse models of subcutaneous, orthotopic, and spontaneous lymph node metastasis from NPC (5 mice per group) were established to assess the imaging strategy. A multi-modality imaging method that consisted of a hybrid combination of fluorescence molecular tomography-computed tomography (FMT-CT) and multispectral optoacoustic tomography (MSOT) was used for 3D quantitative evaluation of tumour hypoxia. Magnetic resonance imaging, histological examination, and immunohistochemical analysis were used as references for comparison and validation. Results In the early stage of NPC (2 weeks after implantation), FMT-CT enabled precise 3D localisation of the hypoxia biomarker with high sensitivity. At the advanced stage (6 weeks after implantation), MSOT allowed multispectral analysis of the biomarker and haemoglobin molecules with high resolution. The combination of high sensitivity and high resolution from FMT-CT and MSOT could not only detect hypoxia in small-sized NPCs but also visualise the heterogeneity of hypoxia in 3D. Conclusions Integration of FMT-CT and MSOT could allow comprehensive and quantifiable evaluation of hypoxia in NPC. These findings may potentially benefit patients with NPC undergoing radiotherapy in the future. A novel multimodality imaging strategy for three-dimensional evaluation of tumour hypoxia in an orthotopic model of nasopharyngeal carcinoma. ![]()
Electronic supplementary material The online version of this article (10.1007/s00259-019-04526-x) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Wenhui Huang
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China.,CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Kun Wang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Yu An
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Hui Meng
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Yuan Gao
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Zhiyuan Xiong
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China.,Department of Chemical and Bio-molecular Engineering, The university of Melbourne, Melbourne, Victoria, 3010, Australia
| | - Hao Yan
- Engineering Laboratory for Functionalized Carbon Materials, Graduate School at Shenzhen, Tsinghua University, Shenzhen, 518055, China
| | - Qian Wang
- Department of Diagnostic Imaging, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Xuekang Cai
- Department of Nuclear Medicine, Peking University First Hospital, No. 8 Xishiku Road, Xicheng District, Beijing, 100034, China
| | - Xin Yang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Bin Zhang
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China
| | - Qiuying Chen
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China
| | - Xing Yang
- Department of Nuclear Medicine, Peking University First Hospital, No. 8 Xishiku Road, Xicheng District, Beijing, 100034, China.
| | - Jie Tian
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China. .,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing, 100191, China.
| | - Shuixing Zhang
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China.
| |
Collapse
|