1
|
Zhao Y, Raghuram A, Wang F, Kim SH, Hielscher A, Robinson JT, Veeraraghavan A. Unrolled-DOT: an interpretable deep network for diffuse optical tomography. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:036002. [PMID: 36908760 PMCID: PMC9995139 DOI: 10.1117/1.jbo.28.3.036002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Accepted: 02/09/2023] [Indexed: 06/18/2023]
Abstract
SIGNIFICANCE Imaging through scattering media is critical in many biomedical imaging applications, such as breast tumor detection and functional neuroimaging. Time-of-flight diffuse optical tomography (ToF-DOT) is one of the most promising methods for high-resolution imaging through scattering media. ToF-DOT and many traditional DOT methods require an image reconstruction algorithm. Unfortunately, this algorithm often requires long computational runtimes and may produce lower quality reconstructions in the presence of model mismatch or improper hyperparameter tuning. AIM We used a data-driven unrolled network as our ToF-DOT inverse solver. The unrolled network is faster than traditional inverse solvers and achieves higher reconstruction quality by accounting for model mismatch. APPROACH Our model "Unrolled-DOT" uses the learned iterative shrinkage thresholding algorithm. In addition, we incorporate a refinement U-Net and Visual Geometry Group (VGG) perceptual loss to further increase the reconstruction quality. We trained and tested our model on simulated and real-world data and benchmarked against physics-based and learning-based inverse solvers. RESULTS In experiments on real-world data, Unrolled-DOT outperformed learning-based algorithms and achieved over 10× reduction in runtime and mean-squared error, compared to traditional physics-based solvers. CONCLUSION We demonstrated a learning-based ToF-DOT inverse solver that achieves state-of-the-art performance in speed and reconstruction quality, which can aid in future applications for noninvasive biomedical imaging.
Collapse
Affiliation(s)
- Yongyi Zhao
- Rice University, Department of Electrical and Computer Engineering, Houston, Texas, United States
| | - Ankit Raghuram
- Rice University, Department of Electrical and Computer Engineering, Houston, Texas, United States
| | - Fay Wang
- Columbia University, Department of Biomedical Engineering, New York, New York, United States
| | - Stephen Hyunkeol Kim
- Columbia University Irvine Medical Center, Department of Radiology, New York, New York, United States
- New York University - Tandon School of Engineering, Department of Biomedical Engineering, New York, New York, United States
| | - Andreas Hielscher
- New York University - Tandon School of Engineering, Department of Biomedical Engineering, New York, New York, United States
| | - Jacob T. Robinson
- Rice University, Department of Electrical and Computer Engineering, Houston, Texas, United States
| | - Ashok Veeraraghavan
- Rice University, Department of Electrical and Computer Engineering, Houston, Texas, United States
| |
Collapse
|
2
|
Liu Y, Hu X, Chu M, Guo H, Yu J, He X. A Finite Element Mesh Regrouping Strategy-Based Hybrid Light Transport Model for Enhancing the Efficiency and Accuracy of XLCT. Front Oncol 2022; 11:751139. [PMID: 35111664 PMCID: PMC8801618 DOI: 10.3389/fonc.2021.751139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2021] [Accepted: 12/10/2021] [Indexed: 11/19/2022] Open
Abstract
X-ray luminescence computed tomography (XLCT) is an emerging hybrid imaging modality in optical molecular imaging, which has attracted more attention and has been widely studied. In XLCT, the accuracy and operational efficiency of an optical transmission model play a decisive role in the rapid and accurate reconstruction of light sources. For simulation of optical transmission characteristics in XLCT, considering the limitations of the diffusion equation (DE) and the time and memory costs of simplified spherical harmonic approximation equation (SPN), a hybrid light transport model needs to be built. DE and SPN models are first-order and higher-order approximations of RTE, respectively. Due to the discontinuity of the regions using the DE and SPN models and the inconsistencies of the system matrix dimensions constructed by the two models in the solving process, the system matrix construction of a hybrid light transmission model is a problem to be solved. We provided a new finite element mesh regrouping strategy-based hybrid light transport model for XLCT. Firstly, based on the finite element mesh regrouping strategy, two separate meshes can be obtained. Thus, for DE and SPN models, the system matrixes and source weight matrixes can be calculated separately in two respective mesh systems. Meanwhile, some parallel computation strategy can be combined with finite element mesh regrouping strategy to further save the system matrix calculation time. Then, the two system matrixes with different dimensions were coupled though repeated nodes were processed according to the hybrid boundary conditions, the two meshes were combined into a regrouping mesh, and the hybrid optical transmission model was established. In addition, the proposed method can reduce the computational memory consumption than the previously proposed hybrid light transport model achieving good balance between computational accuracy and efficiency. The forward numerical simulation results showed that the proposed method had better transmission accuracy and achieved a balance between efficiency and accuracy. The reverse simulation results showed that the proposed method had superior location accuracy, morphological recovery capability, and image contrast capability in source reconstruction. In-vivo experiments verified the practicability and effectiveness of the proposed method.
Collapse
Affiliation(s)
- Yanqiu Liu
- Key Laboratory for Radiomics and Intelligent Sense of Xi'an, Northwest University, Xi'an, China.,School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Xiangong Hu
- Key Laboratory for Radiomics and Intelligent Sense of Xi'an, Northwest University, Xi'an, China.,Network and Data Center, Northwest University, Xi'an, China
| | - Mengxiang Chu
- Key Laboratory for Radiomics and Intelligent Sense of Xi'an, Northwest University, Xi'an, China.,Network and Data Center, Northwest University, Xi'an, China
| | - Hongbo Guo
- Key Laboratory for Radiomics and Intelligent Sense of Xi'an, Northwest University, Xi'an, China.,School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Xiaowei He
- Key Laboratory for Radiomics and Intelligent Sense of Xi'an, Northwest University, Xi'an, China.,School of Information Sciences and Technology, Northwest University, Xi'an, China.,Network and Data Center, Northwest University, Xi'an, China
| |
Collapse
|
3
|
Wang L, Zhu W, Zhang Y, Chen S, Yang D. Harnessing the Power of Hybrid Light Propagation Model for Three-Dimensional Optical Imaging in Cancer Detection. Front Oncol 2021; 11:750764. [PMID: 34804938 PMCID: PMC8601256 DOI: 10.3389/fonc.2021.750764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2021] [Accepted: 08/30/2021] [Indexed: 12/04/2022] Open
Abstract
Optical imaging is an emerging technology capable of qualitatively and quantitatively observing life processes at the cellular or molecular level and plays a significant role in cancer detection. In particular, to overcome the disadvantages of traditional optical imaging that only two-dimensionally and qualitatively detect biomedical information, the corresponding three-dimensional (3D) imaging technology is intensively explored to provide 3D quantitative information, such as localization and distribution and tumor cell volume. To retrieve these information, light propagation models that reflect the interaction between light and biological tissues are an important prerequisite and basis for 3D optical imaging. This review concentrates on the recent advances in hybrid light propagation models, with particular emphasis on their powerful use for 3D optical imaging in cancer detection. Finally, we prospect the wider application of the hybrid light propagation model and future potential of 3D optical imaging in cancer detection.
Collapse
Affiliation(s)
- Lin Wang
- School of Computer Science and Engineering, Xi'an University of Technology, Xi'an, China
| | - Wentao Zhu
- Zhejiang Lab, Research Center for Healthcare Data Science, Hangzhou, China
| | - Ying Zhang
- Zhejiang Lab, Research Center for Healthcare Data Science, Hangzhou, China
| | - Shangdong Chen
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Defu Yang
- Intelligent Information Processing Laboratory, Hangzhou Dianzi University, Hangzhou, China
| |
Collapse
|
4
|
Yu J, Dai C, He X, Guo H, Sun S, Liu Y. Bioluminescence Tomography Based on One-Dimensional Convolutional Neural Networks. Front Oncol 2021; 11:760689. [PMID: 34733793 PMCID: PMC8558399 DOI: 10.3389/fonc.2021.760689] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Accepted: 09/24/2021] [Indexed: 12/31/2022] Open
Abstract
Bioluminescent tomography (BLT) has increasingly important applications in preclinical studies. However, the simplified photon propagation model and the inherent ill-posedness of the inverse problem limit the quality of BLT reconstruction. In order to improve the reconstruction accuracy of positioning and reconstruction efficiency, this paper presents a deep-learning optical reconstruction method based on one-dimensional convolutional neural networks (1DCNN). The nonlinear mapping relationship between the surface photon flux density and the distribution of the internal bioluminescence sources is directly established, which fundamentally avoids solving the ill-posed inverse problem iteratively. Compared with the previous reconstruction method based on multilayer perceptron, the training parameters in the 1DCNN are greatly reduced and the learning efficiency of the model is improved. Simulations verify the superiority and stability of the 1DCNN method, and the in vivo experimental results further show the potential of the proposed method in practical applications.
Collapse
Affiliation(s)
- Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Chenyang Dai
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Xuelei He
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Hongbo Guo
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Siyu Sun
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Ying Liu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| |
Collapse
|
5
|
Patil N, Naik N. δ-SP N approximation for numerical modeling of directional sources and scattering. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2021; 38:1681-1695. [PMID: 34807030 DOI: 10.1364/josaa.436141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Accepted: 09/26/2021] [Indexed: 06/13/2023]
Abstract
We propose the δ-SPN approximation for the frequency domain coupled radiative transfer equations modeling fluorescence with collimated incident beams and present its numerical implementation using the finite element method. The performance of the proposed model is investigated with respect to Monte Carlo simulations and the standard SPN approximation over sub-centimeter domains for various optical properties. We find that the δ-SPN approximation is more accurate than the SPN in the near-source region, and provides improved estimates of phase and partial currents, at both excitation and emission wavelengths, over a wider range of optical properties. The accuracy of the δ-SPN model improves with increase in approximation order for normally incident beams.
Collapse
|
6
|
Guo H, Zhao H, Yu J, He X, He X, Song X. X-ray luminescence computed tomography using a hybrid proton propagation model and Lasso-LSQR algorithm. JOURNAL OF BIOPHOTONICS 2021; 14:e202100089. [PMID: 34176239 DOI: 10.1002/jbio.202100089] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Revised: 06/17/2021] [Accepted: 06/18/2021] [Indexed: 06/13/2023]
Abstract
X-ray luminescence computed tomography (XLCT) uses external X-rays for luminescence excitation, which is becoming a promising molecular imaging technique with superb penetration depth and spatial resolution. To achieve the tomographic mapping of luminescence distribution, accurate optical propagation model and suitable reconstruction method are two keys for XLCT, but not satisfied. To overcome the limitation of the single proton propagation model (e.g., DE, SP3 ), we adopted a hybrid diffusion equation with third order simplified spherical harmonics (DE-SP3 ) model for XLCT. To enable fast iteration and accurate sparse reconstruction, we also integrated in the inversion optimization, with a novel Least Square QR-factorization based on the Lasso (Lasso-LSQR) algorithm. We first simulated the light propagation in various kinds of organs under DE model and SP3 model, respectively. By comparison with the Monte Carlo, these tissues can be categorized into two types, namely DE-fitted tissues that include muscle and lung, and SP3 -fitted tissues including heart, kidney, liver, and stomach. According to the above classification results, we built a hybrid DE-SP3 model to more accurately describing light transport. Numerical simulations and in vivo experiments illustrated that hybrid DE-SP3 model achieves superior reconstruction performance in terms of location accuracy, and spatial resolution than DE, and less computational cost than SP3 . The hybrid DE-SP3 model materializes a balance between accuracy and efficiency for XLCT.
Collapse
Affiliation(s)
- Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Hengna Zhao
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Jingjing Yu
- The School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Xuelei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Xiaolei Song
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
| |
Collapse
|
7
|
Cao X, Li K, Xu XL, Deneen KMV, Geng GH, Chen XL. Development of tomographic reconstruction for three-dimensional optical imaging: From the inversion of light propagation to artificial intelligence. Artif Intell Med Imaging 2020; 1:78-86. [DOI: 10.35711/aimi.v1.i2.78] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Revised: 08/01/2020] [Accepted: 08/21/2020] [Indexed: 02/06/2023] Open
Abstract
Optical molecular tomography (OMT) is an imaging modality which uses an optical signal, especially near-infrared light, to reconstruct the three-dimensional information of the light source in biological tissue. With the advantages of being low-cost, noninvasive and having high sensitivity, OMT has been applied in preclinical and clinical research. However, due to its serious ill-posedness and ill-condition, the solution of OMT requires heavy data analysis and the reconstruction quality is limited. Recently, the artificial intelligence (commonly known as AI)-based methods have been proposed to provide a different tool to solve the OMT problem. In this paper, we review the progress on OMT algorithms, from conventional methods to AI-based methods, and we also give a prospective towards future developments in this domain.
Collapse
Affiliation(s)
- Xin Cao
- School of Information Science and Technology, Northwest University, Xi’an 710069, Shaanxi Province, China
| | - Kang Li
- School of Information Science and Technology, Northwest University, Xi’an 710069, Shaanxi Province, China
| | - Xue-Li Xu
- School of Information Science and Technology, Northwest University, Xi’an 710069, Shaanxi Province, China
| | - Karen M von Deneen
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, and School of Life Science and Technology, Xidian University, Xi’an 710126, Shaanxi Province, China
| | - Guo-Hua Geng
- School of Information Science and Technology, Northwest University, Xi’an 710069, Shaanxi Province, China
| | - Xue-Li Chen
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, and School of Life Science and Technology, Xidian University, Xi’an 710126, Shaanxi Province, China
| |
Collapse
|
8
|
Yang D, Wang L, Chen D, Yan C, He X, Liang J, Chen X. Filtered maximum likelihood expectation maximization based global reconstruction for bioluminescence tomography. Med Biol Eng Comput 2018; 56:2067-2081. [PMID: 29770920 DOI: 10.1007/s11517-018-1842-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2017] [Accepted: 05/04/2018] [Indexed: 12/17/2022]
Abstract
The reconstruction of bioluminescence tomography (BLT) is severely ill-posed due to the insufficient measurements and diffuses nature of the light propagation. Predefined permissible source region (PSR) combined with regularization terms is one common strategy to reduce such ill-posedness. However, the region of PSR is usually hard to determine and can be easily affected by subjective consciousness. Hence, we theoretically developed a filtered maximum likelihood expectation maximization (fMLEM) method for BLT. Our method can avoid predefining the PSR and provide a robust and accurate result for global reconstruction. In the method, the simplified spherical harmonics approximation (SPN) was applied to characterize diffuse light propagation in medium, and the statistical estimation-based MLEM algorithm combined with a filter function was used to solve the inverse problem. We systematically demonstrated the performance of our method by the regular geometry- and digital mouse-based simulations and a liver cancer-based in vivo experiment. Graphical abstract The filtered MLEM-based global reconstruction method for BLT.
Collapse
Affiliation(s)
- Defu Yang
- Institute of Information and Control, Hangzhou Dianzi University, Hangzhou, 310018, China
| | - Lin Wang
- School of Information Sciences and Technology, Northwest University, Xi'an, 710126, China
| | - Dongmei Chen
- College of Life Information Science and Instrument Engineering, Hangzhou Dianzi University, Hangzhou, 310018, China
| | - Chenggang Yan
- Institute of Information and Control, Hangzhou Dianzi University, Hangzhou, 310018, China
| | - Xiaowei He
- School of Information Sciences and Technology, Northwest University, Xi'an, 710126, China
| | - Jimin Liang
- Engineering Research Center of Molecular and Neuro Imaging of the Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, 710127, China
| | - Xueli Chen
- Engineering Research Center of Molecular and Neuro Imaging of the Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, 710127, China.
| |
Collapse
|
9
|
Periyasamy V, Pramanik M. Advances in Monte Carlo Simulation for Light Propagation in Tissue. IEEE Rev Biomed Eng 2017; 10:122-135. [PMID: 28816674 DOI: 10.1109/rbme.2017.2739801] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Monte Carlo (MC) simulation for light propagation in tissue is the gold standard for studying the light propagation in biological tissue and has been used for years. Interaction of photons with a medium is simulated based on its optical properties. New simulation geometries, tissue-light interaction methods, and recording techniques recently have been designed. Applications, such as whole mouse body simulations for fluorescence imaging, eye modeling for blood vessel imaging, skin modeling for terahertz imaging, and human head modeling for sinus imaging, have emerged. Here, we review the technical advances and recent applications of MC simulation.
Collapse
|
10
|
Chen X, Sun F, Yang D, Ren S, Zhang Q, Liang J. Hybrid simplified spherical harmonics with diffusion equation for light propagation in tissues. Phys Med Biol 2015; 60:6305-22. [DOI: 10.1088/0031-9155/60/16/6305] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
|
11
|
Chen X, Sun F, Yang D, Liang J. Coupled third-order simplified spherical harmonics and diffusion equation-based fluorescence tomographic imaging of liver cancer. JOURNAL OF BIOMEDICAL OPTICS 2015; 20:090502. [PMID: 26385654 DOI: 10.1117/1.jbo.20.9.090502] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2015] [Accepted: 08/17/2015] [Indexed: 06/05/2023]
Abstract
For fluorescence tomographic imaging of small animals, the liver is usually regarded as a low-scattering tissue and is surrounded by adipose, kidneys, and heart, all of which have a high scattering property. This leads to a breakdown of the diffusion equation (DE)–based reconstruction method as well as a heavy computational burden for the simplified spherical harmonics equation (SP(N)). Coupling the SP(N) and DE provides a perfect balance between the imaging accuracy and computational burden. The coupled third-order SPN and DE (CSDE)-based reconstruction method is developed for fluorescence tomographic imaging. This is achieved by doubly using the CSDE for the excitation and emission processes of the fluorescence propagation. At the same time, the finite-element method and hybrid multilevel regularization strategy are incorporated in inverse reconstruction. The CSDE-based reconstruction method is first demonstrated with a digital mouse-based liver cancer simulation, which reveals superior performance compared with the SPN and DE-based methods. It is more accurate than the DE-based method and has lesser computational burden than the SPN-based method. The feasibility of the proposed approach in applications of in vivo studies is also illustrated with a liver cancer mouse-based in situ experiment, revealing its potential application in whole-body imaging of small animals.
Collapse
|