1
|
Sun W, Zhang L, Xing L, He Z, Zhang Y, Gao F. Projected algebraic reconstruction technique-network for high-fidelity diffuse fluorescence tomography reconstruction. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:988-999. [PMID: 38856406 DOI: 10.1364/josaa.517742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 04/01/2024] [Indexed: 06/11/2024]
Abstract
We propose a model-driven projected algebraic reconstruction technique (PART)-network (PART-Net) that leverages the advantages of the traditional model-based method and the neural network to improve the imaging quality of diffuse fluorescence tomography. In this algorithm, nonnegative prior information is incorporated into the ART iteration process to better guide the optimization process, and thereby improve imaging quality. On this basis, PART in conjunction with a residual convolutional neural network is further proposed to obtain high-fidelity image reconstruction. The numerical simulation results demonstrate that the PART-Net algorithm effectively improves noise robustness and reconstruction accuracy by at least 1-2 times and exhibits superiority in spatial resolution and quantification, especially for a small-sized target (r=2m m), compared with the traditional ART algorithm. Furthermore, the phantom and in vivo experiments verify the effectiveness of the PART-Net, suggesting strong generalization capability and a great potential for practical applications.
Collapse
|
2
|
Cheng X, Sun S, Xiao Y, Li W, Li J, Yu J, Guo H. Fluorescence molecular tomography based on an online maximum a posteriori estimation algorithm. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:844-851. [PMID: 38856571 DOI: 10.1364/josaa.519667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 03/25/2024] [Indexed: 06/11/2024]
Abstract
Fluorescence molecular tomography (FMT) is a non-invasive, radiation-free, and highly sensitive optical molecular imaging technique for early tumor detection. However, inadequate measurement information along with significant scattering of near-infrared light within the tissue leads to high ill-posedness in the inverse problem of FMT. To improve the quality and efficiency of FMT reconstruction, we build a reconstruction model based on log-sum regularization and introduce an online maximum a posteriori estimation (OPE) algorithm to solve the non-convex optimization problem. The OPE algorithm approximates a stationary point by evaluating the gradient of the objective function at each iteration, and its notable strength lies in the remarkable speed of convergence. The results of simulations and experiments demonstrate that the OPE algorithm ensures good reconstruction quality and exhibits outstanding performance in terms of reconstruction efficiency.
Collapse
|
3
|
Zhao Y, Li S, Zhang L, Tang Z, Wei D, Zhang H, Xie Q, Yi H, He X. Two-step reconstruction framework of fluorescence molecular tomography based on energy statistical probability. JOURNAL OF BIOPHOTONICS 2024; 17:e202300480. [PMID: 38351740 DOI: 10.1002/jbio.202300480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 01/17/2024] [Accepted: 01/28/2024] [Indexed: 05/04/2024]
Abstract
Fluorescence molecular tomography (FMT), as a promising technique for early tumor detection, can non-invasively visualize the distribution of fluorescent marker probe three-dimensionally. However, FMT reconstruction is a severely ill-posed problem, which remains an obstacle to wider application of FMT. In this paper, a two-step reconstruction framework was proposed for FMT based on the energy statistical probability. First, the tissue structural information obtained from computed tomography (CT) is employed to associate the tissue optical parameters for rough solution in the global region. Then, according to the global-region reconstruction results, the probability that the target belongs to each region can be calculated. The region with the highest probability is delineated as region of interest to realize accurate and fast source reconstruction. Numerical simulations and in vivo experiments were carried out to evaluate the effectiveness of the proposed framework. The encouraging results demonstrate the significant effectiveness and potential of our method for practical FMT applications.
Collapse
Affiliation(s)
- Yizhe Zhao
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Shuangchen Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Lizhi Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Zijian Tang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - De Wei
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Qiong Xie
- The First Hospital of Hunan University of Chinese Medicine, Changsha, Hunan, China
| | - Huangjian Yi
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| |
Collapse
|
4
|
Hu Y, Wu Y, Li L, Gu L, Zhu X, Jiang J, Ren W. Simultaneous reconstruction of 3D fluorescence distribution and object surface using structured light illumination and dual-camera detection. OPTICS EXPRESS 2024; 32:15760-15773. [PMID: 38859218 DOI: 10.1364/oe.517189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 02/26/2024] [Indexed: 06/12/2024]
Abstract
Fluorescence molecular tomography (FMT) serves as a noninvasive modality for visualizing volumetric fluorescence distribution within biological tissues, thereby proving to be an invaluable imaging tool for preclinical animal studies. The conventional FMT relies upon a point-by-point raster scan strategy, enhancing the dataset for subsequent reconstruction but concurrently elongating the data acquisition process. The resultant diminished temporal resolution has persistently posed a bottleneck, constraining its utility in dynamic imaging studies. We introduce a novel system capable of simultaneous FMT and surface extraction, which is attributed to the implementation of a rapid line scanning approach and dual-camera detection. The system performance was characterized through phantom experiments, while the influence of scanning line density on reconstruction outcomes has been systematically investigated via both simulation and experiments. In a proof-of-concept study, our approach successfully captures a moving fluorescence bolus in three dimensions with an elevated frame rate of approximately 2.5 seconds per frame, employing an optimized scan interval of 5 mm. The notable enhancement in the spatio-temporal resolution of FMT holds the potential to broaden its applications in dynamic imaging tasks, such as surgical navigation.
Collapse
|
5
|
Xing L, Zhang L, Sun W, He Z, Zhang Y, Gao F. Performance enhancement of diffuse fluorescence tomography based on an extended Kalman filtering-long short term memory neural network correction model. BIOMEDICAL OPTICS EXPRESS 2024; 15:2078-2093. [PMID: 38633070 PMCID: PMC11019700 DOI: 10.1364/boe.514041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 12/29/2023] [Accepted: 01/31/2024] [Indexed: 04/19/2024]
Abstract
To alleviate the ill-posedness of diffuse fluorescence tomography (DFT) reconstruction and improve imaging quality and speed, a model-derived deep-learning method is proposed by combining extended Kalman filtering (EKF) with a long short term memory (LSTM) neural network, where the iterative process parameters acquired by implementing semi-iteration EKF (SEKF) served as inputs to the LSTM neural network correction model for predicting the optimal fluorescence distributions. To verify the effectiveness of the SEKF-LSTM algorithm, a series of numerical simulations, phantom and in vivo experiments are conducted, and the experimental results are quantitatively evaluated and compared with the traditional EKF algorithm. The simulation experimental results show that the proposed new algorithm can effectively improve the reconstructed image quality and reconstruction speed. Importantly, the LSTM correction model trained by the simulation data also obtains satisfactory results in the experimental data, suggesting that the SEKF-LSTM algorithm possesses strong generalization ability and great potential for practical applications.
Collapse
Affiliation(s)
- Lingxiu Xing
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Limin Zhang
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin, China
| | - Wenjing Sun
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Zhuanxia He
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Yanqi Zhang
- Tianjin Medical University, School of Medical Imaging, Tianjin, China
| | - Feng Gao
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin, China
| |
Collapse
|
6
|
Li S, Wang B, Yu J, He X, Guo H, He X. FSMN-Net: a free space matching network based on manifold convolution for optical molecular tomography. OPTICS LETTERS 2024; 49:1161-1164. [PMID: 38426963 DOI: 10.1364/ol.512235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 01/22/2024] [Indexed: 03/02/2024]
Abstract
Optical molecular tomography (OMT) can monitor glioblastomas in small animals non-invasively. Although deep learning (DL) methods have made remarkable achievements in this field, improving its generalization against diverse reconstruction systems remains a formidable challenge. In this Letter, a free space matching network (FSMN-Net) was presented to overcome the parameter mismatch problem in different reconstruction systems. Specifically, a novel, to the best of our knowledge, manifold convolution operator was designed by considering the mathematical model of OMT as a space matching process. Based on the dynamic domain expansion concept, an end-to-end fully convolutional codec further integrates this operator to realize robust reconstruction with voxel-level accuracy. The results of numerical simulations and in vivo experiments demonstrate that the FSMN-Net can stably generate high-resolution reconstruction volumetric images under different reconstruction systems.
Collapse
|
7
|
Chang Z, Sun S, Wei L, Wang G. Application of the Powell algorithm for estimating optical properties of a semitransparent medium based on time-domain information. APPLIED OPTICS 2023; 62:9493-9501. [PMID: 38108774 DOI: 10.1364/ao.504903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 11/20/2023] [Indexed: 12/19/2023]
Abstract
Accurate estimation of the optical properties of a semitransparent medium is crucial in various engineering applications. This study introduces the Powell algorithm to estimate the optical properties of a 2D semitransparent slab. The time-domain radiative transfer equation is solved using the discrete ordinate method. The radiative intensity on the medium's surface serves as the measurement signal for the inverse analysis. The results demonstrate that the Powell algorithm accurately estimates the absorption coefficient, scattering coefficient, and scattering asymmetry factor. For simultaneous reconstruction of these three parameters, it is recommended to use eight signal detectors on both the left and right sides of the medium. Even when the standard measurement error is increased to 15%, the relative errors for these three parameters remain low, at 1.87%, 1.379%, and 0.194%.
Collapse
|
8
|
Zhang J, Wickizer C, Ding W, Van R, Yang L, Zhu B, Yang J, Wang Y, Wang Y, Xu Y, Zhang C, Shen S, Wang C, Shao Y, Ran C. In vivo three-dimensional brain imaging with chemiluminescence probes in Alzheimer's disease models. Proc Natl Acad Sci U S A 2023; 120:e2310131120. [PMID: 38048460 PMCID: PMC10723133 DOI: 10.1073/pnas.2310131120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 11/13/2023] [Indexed: 12/06/2023] Open
Abstract
Optical three-dimensional (3D) molecular imaging is highly desirable for providing precise distribution of the target-of-interest in disease models. However, such 3D imaging is still far from wide applications in biomedical research; 3D brain optical molecular imaging, in particular, has rarely been reported. In this report, we designed chemiluminescence probes with high quantum yields, relatively long emission wavelengths, and high signal-to-noise ratios to fulfill the requirements for 3D brain imaging in vivo. With assistance from density-function theory (DFT) computation, we designed ADLumin-Xs by locking up the rotation of the double bond via fusing the furan ring to the phenyl ring. Our results showed that ADLumin-5 had a high quantum yield of chemiluminescence and could bind to amyloid beta (Aβ). Remarkably, ADLumin-5's radiance intensity in brain areas could reach 4 × 107 photon/s/cm2/sr, which is probably 100-fold higher than most chemiluminescence probes for in vivo imaging. Because of its strong emission, we demonstrated that ADLumin-5 could be used for in vivo 3D brain imaging in transgenic mouse models of Alzheimer's disease.
Collapse
Affiliation(s)
- Jing Zhang
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Boston, MA02129
| | - Carly Wickizer
- Department of Chemistry and Biochemistry, Stephenson Life Sciences Research Center, University of Oklahoma, Norman, OK73019
| | - Weihua Ding
- Department of Anesthesia Critical Care and Pain Medicine, MGH Center for Translational Pain Research, Massachusetts General Hospital Harvard Medical School, Boston, MA02114
| | - Richard Van
- Department of Chemistry and Biochemistry, Stephenson Life Sciences Research Center, University of Oklahoma, Norman, OK73019
| | - Liuyue Yang
- Department of Anesthesia Critical Care and Pain Medicine, MGH Center for Translational Pain Research, Massachusetts General Hospital Harvard Medical School, Boston, MA02114
| | - Biyue Zhu
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Boston, MA02129
| | - Jun Yang
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Boston, MA02129
| | - Yanli Wang
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Boston, MA02129
| | - Yongle Wang
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Boston, MA02129
| | - Yulong Xu
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Boston, MA02129
| | - Can Zhang
- Genetics and Aging Research Unit, Department of Neurology, McCance Center for Brain Health Mass General Institute for Neurodegenerative Disease, Massachusetts General Hospital Harvard Medical School, Charlestown, MA02129
| | - Shiqian Shen
- Department of Anesthesia Critical Care and Pain Medicine, MGH Center for Translational Pain Research, Massachusetts General Hospital Harvard Medical School, Boston, MA02114
| | - Changning Wang
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Boston, MA02129
| | - Yihan Shao
- Department of Chemistry and Biochemistry, Stephenson Life Sciences Research Center, University of Oklahoma, Norman, OK73019
| | - Chongzhao Ran
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Boston, MA02129
| |
Collapse
|
9
|
Zhao Y, Li S, He X, Yu J, Zhang L, Zhang H, Wei D, Wang B, Li J, Guo H, He X. Liver injury monitoring using dynamic fluorescence molecular tomography based on a time-energy difference strategy. BIOMEDICAL OPTICS EXPRESS 2023; 14:5298-5315. [PMID: 37854546 PMCID: PMC10581805 DOI: 10.1364/boe.498092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 09/03/2023] [Accepted: 09/05/2023] [Indexed: 10/20/2023]
Abstract
Dynamic fluorescence molecular tomography (DFMT) is a promising molecular imaging technique that offers the potential to monitor fast kinetic behaviors within small animals in three dimensions. Early monitoring of liver disease requires the ability to distinguish and analyze normal and injured liver tissues. However, the inherent ill-posed nature of the problem and energy signal interference between the normal and injured liver regions limit the practical application of liver injury monitoring. In this study, we propose a novel strategy based on time and energy, leveraging the temporal correlation in fluorescence molecular imaging (FMI) sequences and the metabolic differences between normal and injured liver tissue. Additionally, considering fluorescence signal distribution disparity between the injured and normal regions, we designed a universal Golden Ratio Primal-Dual Algorithm (GRPDA) to reconstruct both the normal and injured liver regions. Numerical simulation and in vivo experiment results demonstrate that the proposed strategy can effectively avoid signal interference between liver and liver injury energy and lead to significant improvements in morphology recovery and positioning accuracy compared to existing approaches. Our research presents a new perspective on distinguishing normal and injured liver tissues for early liver injury monitoring.
Collapse
Affiliation(s)
- Yizhe Zhao
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Shuangchen Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Xuelei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, 710062, China
| | - Lizhi Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - De Wei
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Beilei Wang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Jintao Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| |
Collapse
|
10
|
Li S, Wang B, Yu J, Kang D, He X, Guo H, He X. 3D-deep optical learning: a multimodal and multitask reconstruction framework for optical molecular tomography. OPTICS EXPRESS 2023; 31:23768-23789. [PMID: 37475220 DOI: 10.1364/oe.490139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 06/16/2023] [Indexed: 07/22/2023]
Abstract
Optical molecular tomography (OMT) is an emerging imaging technique. To date, the poor universality of reconstruction algorithms based on deep learning for various imaged objects and optical probes limits the development and application of OMT. In this study, based on a new mapping representation, a multimodal and multitask reconstruction framework-3D deep optical learning (3DOL), was presented to overcome the limitations of OMT in universality by decomposing it into two tasks, optical field recovery and luminous source reconstruction. Specifically, slices of the original anatomy (provided by computed tomography) and boundary optical measurement of imaged objects serve as inputs of a recurrent convolutional neural network encoded parallel to extract multimodal features, and 2D information from a few axial planes within the samples is explicitly incorporated, which enables 3DOL to recognize different imaged objects. Subsequently, the optical field is recovered under the constraint of the object geometry, and then the luminous source is segmented by a learnable Laplace operator from the recovered optical field, which obtains stable and high-quality reconstruction results with extremely few parameters. This strategy enable 3DOL to better understand the relationship between the boundary optical measurement, optical field, and luminous source to improve 3DOL's ability to work in a wide range of spectra. The results of numerical simulations, physical phantoms, and in vivo experiments demonstrate that 3DOL is a compatible deep-learning approach to tomographic imaging diverse objects. Moreover, the fully trained 3DOL under specific wavelengths can be generalized to other spectra in the 620-900 nm NIR-I window.
Collapse
|
11
|
Zhang J, Wickizer C, Ding W, Van R, Yang L, Zhu B, Yang J, Zhang C, Shen S, Shao Y, Ran C. In Vivo Three-dimensional Brain Imaging with Chemiluminescence Probes in Alzheimer's Disease Models. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.02.547411. [PMID: 37461700 PMCID: PMC10350002 DOI: 10.1101/2023.07.02.547411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/24/2023]
Abstract
Optical three-dimensional (3D) molecular imaging is highly desirable for providing precise distribution of the target-of-interest in disease models. However, such 3D imaging is still far from wide applications in biomedical research; 3D brain optical molecular imaging, in particular, has rarely been reported. In this report, we designed chemiluminescence probes with high quantum yields (QY), relatively long emission wavelengths, and high signal-to-noise ratios (SNRs) to fulfill the requirements for 3D brain imaging in vivo. With assistance from density-function theory (DFT) computation, we designed ADLumin-Xs by locking up the rotation of the double-bond via fusing the furan ring to the phenyl ring. Our results showed that ADLumin-5 had a high quantum yield of chemiluminescence and could bind to amyloid beta (Aβ). Remarkably, ADLumin-5's radiance intensity in brain areas could reach 4×107 photon/s/cm2/sr, which is probably 100-fold higher than most chemiluminescence probes for in vivo imaging. Because of its strong emission, we demonstrated that ADLumin-5 could be used for in vivo 3D brain imaging in transgenic mouse models of Alzheimer's disease (AD).
Collapse
Affiliation(s)
- Jing Zhang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Room 2301, Building 149, Charlestown, Boston, MA 02129, USA
| | - Carly Wickizer
- Department of Chemistry and Biochemistry, Stephenson Life Sciences Research Center, University of Oklahoma, Norman, Oklahoma 73019, United States
| | - Weihua Ding
- MGH Center for Translational Pain Research, Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, USA
| | - Richard Van
- Department of Chemistry and Biochemistry, Stephenson Life Sciences Research Center, University of Oklahoma, Norman, Oklahoma 73019, United States
| | - Liuyue Yang
- MGH Center for Translational Pain Research, Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, USA
| | - Biyue Zhu
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Room 2301, Building 149, Charlestown, Boston, MA 02129, USA
| | - Jun Yang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Room 2301, Building 149, Charlestown, Boston, MA 02129, USA
| | - Can Zhang
- Genetics and Aging Research Unit, McCance Center for Brain Health, Mass General Institute for Neurodegenerative Disease, Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Shiqian Shen
- MGH Center for Translational Pain Research, Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, USA
| | - Yihan Shao
- Department of Chemistry and Biochemistry, Stephenson Life Sciences Research Center, University of Oklahoma, Norman, Oklahoma 73019, United States
| | - Chongzhao Ran
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Room 2301, Building 149, Charlestown, Boston, MA 02129, USA
| |
Collapse
|
12
|
Wang B, Li S, He X, Zhao Y, Zhang H, He X, Yu J, Guo H. Structure-fused deep 3D hierarchical network: A bioluminescence tomography scheme for different imaging objects. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38083149 DOI: 10.1109/embc40787.2023.10340967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Monte Carlo eXtreme (MCX) method has a unique advantage for deep neural network based bioluminescence tomography (BLT) reconstruction. However, this method ignores the distribution of sources energy and relies on the determined tissue structure. In this paper, a deep 3D hierarchical reconstruction network for BLT was proposed where the inputs were divided into two parts -- bioluminescence image (BLI) and anatomy of the imaged object by CT. Firstly, a parallel encoder is used to feature the original BLI & CT slices and integrate their features to distinguish the different tissue structure of imaging objects; Secondly, GRU is used to fit the spatial information of different slices and convert it into 3D features; Finally, the 3D features are decoded to the spacial and energy information of source by a symmetrical decoding structure. Our research suggested that this method can effectively compute the radiation intensity and the spatial distribution of the source for different imaging object.
Collapse
|
13
|
Kalva SK, Deán-Ben XL, Reiss M, Razansky D. Spiral volumetric optoacoustic tomography for imaging whole-body biodynamics in small animals. Nat Protoc 2023; 18:2124-2142. [PMID: 37208409 DOI: 10.1038/s41596-023-00834-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2022] [Accepted: 03/20/2023] [Indexed: 05/21/2023]
Abstract
Fast tracking of biological dynamics across multiple murine organs using the currently commercially available whole-body preclinical imaging systems is hindered by their limited contrast, sensitivity and spatial or temporal resolution. Spiral volumetric optoacoustic tomography (SVOT) provides optical contrast, with an unprecedented level of spatial and temporal resolution, by rapidly scanning a mouse using spherical arrays, thus overcoming the current limitations in whole-body imaging. The method enables the visualization of deep-seated structures in living mammalian tissues in the near-infrared spectral window, while further providing unrivalled image quality and rich spectroscopic optical contrast. Here, we describe the detailed procedures for SVOT imaging of mice and provide specific details on how to implement a SVOT system, including component selection, system arrangement and alignment, as well as the image processing methods. The step-by-step guide for the rapid panoramic (360°) head-to-tail whole-body imaging of a mouse includes the rapid visualization of contrast agent perfusion and biodistribution. The isotropic spatial resolution possible with SVOT can reach 90 µm in 3D, while alternative steps enable whole-body scans in less than 2 s, unattainable with other preclinical imaging modalities. The method further allows the real-time (100 frames per second) imaging of biodynamics at the whole-organ level. The multiscale imaging capacity provided by SVOT can be used for visualizing rapid biodynamics, monitoring responses to treatments and stimuli, tracking perfusion, and quantifying total body accumulation and clearance dynamics of molecular agents and drugs. Depending on the imaging procedure, the protocol requires 1-2 h to complete by users trained in animal handling and biomedical imaging.
Collapse
Affiliation(s)
- Sandeep Kumar Kalva
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| | - Xosé Luís Deán-Ben
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| | - Michael Reiss
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| | - Daniel Razansky
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich, Switzerland.
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland.
| |
Collapse
|
14
|
Zhang X, Jia Y, Cui J, Zhang J, Cao X, Zhang L, Zhang G. Two-stage deep learning method for sparse-view fluorescence molecular tomography reconstruction. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2023; 40:1359-1371. [PMID: 37706737 DOI: 10.1364/josaa.489702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 05/23/2023] [Indexed: 09/15/2023]
Abstract
Fluorescence molecular tomography (FMT) is a preclinical optical tomographic imaging technique that can trace various physiological and pathological processes at the cellular or even molecular level. Reducing the number of FMT projection views can improve the data acquisition speed, which is significant in applications such as dynamic problems. However, a reduction in the number of projection views will dramatically aggravate the ill-posedness of the FMT inverse problem and lead to significant degradation of the reconstructed images. To deal with this problem, we have proposed a deep-learning-based reconstruction method for sparse-view FMT that only uses four perpendicular projection views and divides the image reconstruction into two stages: image restoration and inverse Radon transform. In the first stage, the projection views of the surface fluorescence are restored to eliminate the blur derived from photon diffusion through a fully convolutional neural network. In the second stage, another convolutional neural network is used to implement the inverse Radon transform between the restored projections from the first stage and the reconstructed transverse slices. Numerical simulation and phantom and mouse experiments are carried out. The results show that the proposed method can effectively deal with the image reconstruction problem of sparse-view FMT.
Collapse
|
15
|
Yi H, Ma S, Yang R, Zhang L, Guo H, He X, Hou Y. Adaptive Sparsity Orthogonal Least Square with Neighbor Strategy for Fluorescence Molecular Tomography. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083170 DOI: 10.1109/embc40787.2023.10340086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Fluorescence molecular tomography (FMT) is a highly sensitive and noninvasive optical imaging technique which has been widely applied to disease diagnosis and drug discovery. However, FMT reconstruction is a highly ill-posed problem. In this work, L0-norm regularization is employed to construct the mathematical model of the inverse problem of FMT. And an adaptive sparsity orthogonal least square with a neighbor strategy (ASOLS-NS) is proposed to solve this model. This algorithm can provide an adaptive sparsity and can establish the candidate sets by a novel neighbor expansion strategy for the orthogonal least square (OLS) algorithm. Numerical simulation experiments have shown that the ASOLS-NS improves the reconstruction of images, especially for the double targets reconstruction.Clinical relevance- The purpose of this work is to improve the reconstruction results of FMT. Current experiments are focused on simulation experiments, and the proposed algorithm will be applied to the clinical tumor detection in the future.
Collapse
|
16
|
Chen Y, Du M, Zhang J, Zhang G, Su L, Li K, Zhao F, Yi H, Wang L, Cao X. Generalized conditional gradient method with adaptive regularization parameters for fluorescence molecular tomography. OPTICS EXPRESS 2023; 31:18128-18146. [PMID: 37381530 DOI: 10.1364/oe.486339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 04/08/2023] [Indexed: 06/30/2023]
Abstract
Fluorescence molecular tomography (FMT) is an optical imaging technology with the ability of visualizing the three-dimensional distribution of fluorescently labelled probes in vivo. However, due to the light scattering effect and ill-posed inverse problems, obtaining satisfactory FMT reconstruction is still a challenging problem. In this work, to improve the performance of FMT reconstruction, we proposed a generalized conditional gradient method with adaptive regularization parameters (GCGM-ARP). In order to make a tradeoff between the sparsity and shape preservation of the reconstruction source, and to maintain its robustness, elastic-net (EN) regularization is introduced. EN regularization combines the advantages of L1-norm and L2-norm, and overcomes the shortcomings of traditional Lp-norm regularization, such as over-sparsity, over-smoothness, and non-robustness. Thus, the equivalent optimization formulation of the original problem can be obtained. To further improve the performance of the reconstruction, the L-curve is adopted to adaptively adjust the regularization parameters. Then, the generalized conditional gradient method (GCGM) is used to split the minimization problem based on EN regularization into two simpler sub-problems, which are determining the direction of the gradient and the step size. These sub-problems are addressed efficiently to obtain more sparse solutions. To assess the performance of our proposed method, a series of numerical simulation experiments and in vivo experiments were implemented. The experimental results show that, compared with other mathematical reconstruction methods, GCGM-ARP method has the minimum location error (LE) and relative intensity error (RIE), and the maximum dice coefficient (Dice) in the case of different sources number or shape, or Gaussian noise of 5%-25%. This indicates that GCGM-ARP has superior reconstruction performance in source localization, dual-source resolution, morphology recovery, and robustness. In conclusion, the proposed GCGM-ARP is an effective and robust strategy for FMT reconstruction in biomedical application.
Collapse
|
17
|
An Y, Wang H, Li J, Li G, Ma X, Du Y, Tian J. Reconstruction based on adaptive group least angle regression for fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2023; 14:2225-2239. [PMID: 37206151 PMCID: PMC10191665 DOI: 10.1364/boe.486451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 03/17/2023] [Accepted: 03/27/2023] [Indexed: 05/21/2023]
Abstract
Fluorescence molecular tomography can combine two-dimensional fluorescence imaging with anatomical information to reconstruct three-dimensional images of tumors. Reconstruction based on traditional regularization with tumor sparsity priors does not take into account that tumor cells form clusters, so it performs poorly when multiple light sources are used. Here we describe reconstruction based on an "adaptive group least angle regression elastic net" (AGLEN) method, in which local spatial structure correlation and group sparsity are integrated with elastic net regularization, followed by least angle regression. The AGLEN method works iteratively using the residual vector and a median smoothing strategy in order to adaptively obtain a robust local optimum. The method was verified using numerical simulations as well as imaging of mice bearing liver or melanoma tumors. AGLEN reconstruction performed better than state-of-the-art methods with different sizes of light sources at different distances from the sample and in the presence of Gaussian noise at 5-25%. In addition, AGLEN-based reconstruction accurately imaged tumor expression of cell death ligand-1, which can guide immunotherapy.
Collapse
Affiliation(s)
- Yu An
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Hanfan Wang
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Jiaqian Li
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Guanghui Li
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Xiaopeng Ma
- School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, China
| | - Yang Du
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Jie Tian
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| |
Collapse
|
18
|
Li J, Zhang L, Liu J, Zhang D, Kang D, Wang B, He X, Zhang H, Zhao Y, Guo H, Hou Y. An adaptive parameter selection strategy based on maximizing the probability of data for robust fluorescence molecular tomography reconstruction. JOURNAL OF BIOPHOTONICS 2023:e202300031. [PMID: 37074336 DOI: 10.1002/jbio.202300031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 03/20/2023] [Accepted: 04/14/2023] [Indexed: 05/03/2023]
Abstract
To alleviate the ill-posed of the inverse problem in fluorescent molecular tomography (FMT), many regularization methods based on L2 or L1 norm have been proposed. Whereas, the quality of regularization parameters affects the performance of the reconstruction algorithm. Some classical parameter selection strategies usually need initialization of parameter range and high computing costs, which is not universal in the practical application of FMT. In this paper, an universally applicable adaptive parameter selection method based on maximizing the probability of data (MPD) strategy was proposed. This strategy used maximum a posteriori (MAP) estimation and maximum likelihood (ML) estimation to establish a regularization parameters model. The stable optimal regularization parameters can be determined by multiple iterative estimates. Numerical simulations and in vivo experiments show that MPD strategy can obtain stable regularization parameters for both regularization algorithms based on L2 or L1 norm and achieve good reconstruction performance.
Collapse
Affiliation(s)
- Jintao Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Lizhi Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Jia Liu
- Xi'an Company of Shaanxi Tobacco Company, The Information Center, Xi'an, China
| | - Diya Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Dizhen Kang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Beilei Wang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Yizhe Zhao
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Yuqing Hou
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| |
Collapse
|
19
|
Zhang L, Guo H, Li J, Kang D, Zhang D, He X, Zhao Y, Wei D, Yu J. Multi-target reconstruction strategy based on blind source separation of surface measurement signals in FMT. BIOMEDICAL OPTICS EXPRESS 2023; 14:1159-1177. [PMID: 36950247 PMCID: PMC10026579 DOI: 10.1364/boe.481348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Revised: 01/30/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
Fluorescence molecular tomography (FMT) is a promising molecular imaging technique for tumor detection in the early stage. High-precision multi-target reconstructions are necessary for quantitative analysis in practical FMT applications. The existing reconstruction methods perform well in retrieving a single fluorescent target but may fail in reconstructing a multi-target, which remains an obstacle to the wider application of FMT. In this paper, a novel multi-target reconstruction strategy based on blind source separation (BSS) of surface measurement signals was proposed, which transformed the multi-target reconstruction problem into multiple single-target reconstruction problems. Firstly, by multiple points excitation, multiple groups of superimposed measurement signals conforming to the conditions of BSS were constructed. Secondly, an efficient nonnegative least-correlated component analysis with iterative volume maximization (nLCA-IVM) algorithm was applied to construct the separation matrix, and the superimposed measurement signals were separated into the measurements of each target. Thirdly, the least squares fitting method was combined with BSS to determine the number of fluorophores indirectly. Lastly, each target was reconstructed based on the extracted surface measurement signals. Numerical simulations and in vivo experiments proved that it has the ability of multi-target resolution for FMT. The encouraging results demonstrate the significant effectiveness and potential of our method for practical FMT applications.
Collapse
Affiliation(s)
- Lizhi Zhang
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Hongbo Guo
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Jintao Li
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Dizhen Kang
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Diya Zhang
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Xiaowei He
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Yizhe Zhao
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - De Wei
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi’an 710062, China
| |
Collapse
|
20
|
Zhang P, Song F, Ma C, Liu Z, Wu H, Sun Y, Feng Y, He Y, Zhang G. Robust reconstruction of fluorescence molecular tomography based on adaptive adversarial learning strategy. Phys Med Biol 2023; 68. [PMID: 36696695 DOI: 10.1088/1361-6560/acb638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 01/25/2023] [Indexed: 01/26/2023]
Abstract
Objective.Fluorescence molecular tomography (FMT) is a promising molecular imaging modality for quantifying the three-dimensional (3D) distribution of tumor probes in small animals. However, traditional deep learning reconstruction methods that aim to minimize the mean squared error (MSE) and iterative regularization algorithms that rely on optimal parameters are typically influenced by strong noise, resulting in poor FMT reconstruction robustness.Approach.In this letter, we propose an adaptive adversarial learning strategy (3D-UR-WGAN) to achieve robust FMT reconstructions. Unlike the pixel-based MSE criterion in traditional CNNs or the regularization strategy in iterative solving schemes, the reconstruction strategy can greatly facilitate the performance of the network models through alternating loop training of the generator and the discriminator. Second, the reconstruction strategy combines the adversarial loss in GANs with the L1 loss to significantly enhance the robustness and preserve image details and textual information.Main results.Both numerical simulations and physical phantom experiments demonstrate that the 3D-UR-WGAN method can adaptively eliminate the effects of different noise levels on the reconstruction results, resulting in robust reconstructed images with reduced artifacts and enhanced image contrast. Compared with the state-of-the-art methods, the proposed method achieves better reconstruction performance in terms of target shape recovery and localization accuracy.Significance.This adaptive adversarial learning reconstruction strategy can provide a possible paradigm for robust reconstruction in complex environments, and also has great potential to provide an alternative solution for solving the problem of poor robustness encountered in other optical imaging modalities such as diffuse optical tomography, bioluminescence imaging, and Cherenkov luminescence imaging.
Collapse
Affiliation(s)
- Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Fan Song
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Chenbin Ma
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Zeyu Liu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Huijie Wu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Yangyang Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Youdan Feng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Yufang He
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Guanglei Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| |
Collapse
|
21
|
Zhang P, Ma C, Song F, Zhang T, Sun Y, Feng Y, He Y, Liu F, Wang D, Zhang G. D2-RecST: Dual-domain joint reconstruction strategy for fluorescence molecular tomography based on image domain and perception domain. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 229:107293. [PMID: 36481532 DOI: 10.1016/j.cmpb.2022.107293] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Revised: 10/05/2022] [Accepted: 10/10/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND AND OBJECTIVE Fluorescence molecular tomography (FMT) is a promising molecular imaging modality for quantifying the three-dimensional (3D) distribution of fluorescent probes in small animals. Over the past few years, learning-based FMT reconstruction methods have achieved promising results. However, these methods typically attempt to minimize the mean-squared error (MSE) between the reconstructed image and the ground truth. Although signal-to-noise ratios (SNRs) are improved, they are susceptible to non-uniform artifacts and loss of structural detail, making it extremely challenging to obtain accurate and robust FMT reconstructions under noisy measurements. METHODS We propose a novel dual-domain joint strategy based on the image domain and perception domain for accurate and robust FMT reconstruction. First, we formulate an explicit adversarial learning strategy in the image domain, which greatly facilitates training and optimization through two enhanced networks to improve anti-noise ability. Besides, we introduce a novel transfer learning strategy in the perceptual domain to optimize edge details by providing perceptual priors for fluorescent targets. Collectively, the proposed dual-domain joint reconstruction strategy can significantly eliminate the non-uniform artifacts and effectively preserve the structural edge details. RESULTS Both numerical simulations and in vivo mouse experiments demonstrate that the proposed method markedly outperforms traditional and cutting-edge methods in terms of positioning accuracy, image contrast, robustness, and target morphological recovery. CONCLUSIONS The proposed method achieves the best reconstruction performance and has great potential to facilitate precise localization and 3D visualization of tumors in in vivo animal experiments.
Collapse
Affiliation(s)
- Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Chenbin Ma
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Fan Song
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Tianyi Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Yangyang Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Youdan Feng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Yufang He
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Fei Liu
- Advanced information & Industrial Technology Research Institute, Beijing Information Science & Technology University, Beijing, 100192, China
| | - Daifa Wang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Guanglei Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China.
| |
Collapse
|
22
|
Liu F, Zhang P, Liu Z, Song F, Ma C, Sun Y, Feng Y, He Y, Zhang G. In vivo accurate detection of the liver tumor with pharmacokinetic parametric images from dynamic fluorescence molecular tomography. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:070501. [PMID: 35810324 PMCID: PMC9270690 DOI: 10.1117/1.jbo.27.7.070501] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Accepted: 06/28/2022] [Indexed: 06/15/2023]
Abstract
SIGNIFICANCE Pharmacokinetic parametric images in dynamic fluorescence molecular tomography (FMT) can describe three-dimensional (3D) physiological and pathological information inside biological tissues, potentially providing quantitative assessment tools for biological research and drug development. AIM In vivo imaging of the liver tumor with pharmacokinetic parametric images from dynamic FMT based on the differences in metabolic properties of indocyanine green (ICG) between normal liver cells and tumor liver cells inside biological tissues. APPROACH First, an orthotopic liver tumor mouse model was constructed. Then, with the help of the FMT/computer tomography (CT) dual-modality imaging system and the direct reconstruction algorithm, 3D imaging of liver metabolic parameters in nude mice was achieved to distinguish liver tumors from normal tissues. Finally, pharmacokinetic parametric imaging results were validated against in vitro anatomical results. RESULTS This letter demonstrates the ability of dynamic FMT to monitor the pharmacokinetic delivery of the fluorescent dye ICG in vivo, thus, enabling the distinction between normal and tumor tissues based on the pharmacokinetic parametric images derived from dynamic FMT. CONCLUSIONS Compared with CT structural imaging technology, dynamic FMT combined with compartmental modeling as an analytical method can obtain quantitative images of pharmacokinetic parameters, thus providing a more powerful research tool for organ function assessment, disease diagnosis and new drug development.
Collapse
Affiliation(s)
- Fei Liu
- Beijing Information Science & Technology University, Advanced Information and Industrial Technology Research Institute, Beijing, China
| | - Peng Zhang
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Zeyu Liu
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Fan Song
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Chenbin Ma
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Yangyang Sun
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Youdan Feng
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Yufang He
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Guanglei Zhang
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| |
Collapse
|