1
|
Song X, Zou X, Zeng K, Li J, Hou S, Wu Y, Li Z, Ma C, Zheng Z, Guo K, Liu Q. Multiple diffusion models-enhanced extremely limited-view reconstruction strategy for photoacoustic tomography boosted by multi-scale priors. PHOTOACOUSTICS 2024; 40:100646. [PMID: 39351140 PMCID: PMC11440308 DOI: 10.1016/j.pacs.2024.100646] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/08/2024] [Revised: 08/05/2024] [Accepted: 09/10/2024] [Indexed: 10/04/2024]
Abstract
Photoacoustic tomography (PAT) is an innovative biomedical imaging technology, which has the capacity to obtain high-resolution images of biological tissue. In the extremely limited-view cases, traditional reconstruction methods for photoacoustic tomography frequently result in severe artifacts and distortion. Therefore, multiple diffusion models-enhanced reconstruction strategy for PAT is proposed in this study. Boosted by the multi-scale priors of the sinograms obtained in the full view and the limited-view case of 240°, the alternating iteration method is adopted to generate data for missing views in the sinogram domain. The strategy refines the image information from global to local, which improves the stability of the reconstruction process and promotes high-quality PAT reconstruction. The blood vessel simulation dataset and the in vivo experimental dataset were utilized to assess the performance of the proposed method. When applied to the in vivo experimental dataset in the limited-view case of 60°, the proposed method demonstrates a significant enhancement in peak signal-to-noise ratio and structural similarity by 23.08 % and 7.14 %, respectively, concurrently reducing mean squared error by 108.91 % compared to the traditional method. The results indicate that the proposed approach achieves superior reconstruction quality in extremely limited-view cases, when compared to other methods. This innovative approach offers a promising pathway for extremely limited-view PAT reconstruction, with potential implications for expanding its utility in clinical diagnostics.
Collapse
Affiliation(s)
- Xianlin Song
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Xueyang Zou
- Ji luan Academy, Nanchang University, Nanchang 330031, China
| | - Kaixin Zeng
- School of Mathematics and Computer Science, Nanchang University, Nanchang 330031, China
| | - Jiahong Li
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Shangkun Hou
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Yuhua Wu
- Ji luan Academy, Nanchang University, Nanchang 330031, China
| | - Zilong Li
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Cheng Ma
- Department of Electronic Engineering, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Zhiyuan Zheng
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Kangjun Guo
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Qiegen Liu
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| |
Collapse
|
2
|
Guo K, Zheng Z, Zhong W, Li Z, Wang G, Li J, Cao Y, Wang Y, Lin J, Liu Q, Song X. Score-based generative model-assisted information compensation for high-quality limited-view reconstruction in photoacoustic tomography. PHOTOACOUSTICS 2024; 38:100623. [PMID: 38832333 PMCID: PMC11144813 DOI: 10.1016/j.pacs.2024.100623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 05/11/2024] [Accepted: 05/17/2024] [Indexed: 06/05/2024]
Abstract
Photoacoustic tomography (PAT) regularly operates in limited-view cases owing to data acquisition limitations. The results using traditional methods in limited-view PAT exhibit distortions and numerous artifacts. Here, a novel limited-view PAT reconstruction strategy that combines model-based iteration with score-based generative model was proposed. By incrementally adding noise to the training samples, prior knowledge can be learned from the complex probability distribution. The acquired prior is then utilized as constraint in model-based iteration. The information of missing views can be gradually compensated by cyclic iteration to achieve high-quality reconstruction. The performance of the proposed method was evaluated with the circular phantom and in vivo experimental data. Experimental results demonstrate the outstanding effectiveness of the proposed method in limited-view cases. Notably, the proposed method exhibits excellent performance in limited-view case of 70° compared with traditional method. It achieves a remarkable improvement of 203% in PSNR and 48% in SSIM for the circular phantom experimental data, and an enhancement of 81% in PSNR and 65% in SSIM for in vivo experimental data, respectively. The proposed method has capability of reconstructing PAT images in extremely limited-view cases, which will further expand the application in clinical scenarios.
Collapse
Affiliation(s)
| | | | | | | | - Guijun Wang
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Jiahong Li
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Yubin Cao
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Yiguang Wang
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Jiabin Lin
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Qiegen Liu
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| | - Xianlin Song
- School of Information Engineering, Nanchang University, Nanchang 330031, China
| |
Collapse
|
3
|
Ge J, Mo Z, Zhang S, Zhang X, Zhong Y, Liang Z, Hu C, Chen W, Qi L. Image reconstruction of multispectral sparse sampling photoacoustic tomography based on deep algorithm unrolling. PHOTOACOUSTICS 2024; 38:100618. [PMID: 38957484 PMCID: PMC11217744 DOI: 10.1016/j.pacs.2024.100618] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Revised: 05/07/2024] [Accepted: 05/10/2024] [Indexed: 07/04/2024]
Abstract
Photoacoustic tomography (PAT), as a novel medical imaging technology, provides structural, functional, and metabolism information of biological tissue in vivo. Sparse Sampling PAT, or SS-PAT, generates images with a smaller number of detectors, yet its image reconstruction is inherently ill-posed. Model-based methods are the state-of-the-art method for SS-PAT image reconstruction, but they require design of complex handcrafted prior. Owing to their ability to derive robust prior from labeled datasets, deep-learning-based methods have achieved great success in solving inverse problems, yet their interpretability is poor. Herein, we propose a novel SS-PAT image reconstruction method based on deep algorithm unrolling (DAU), which integrates the advantages of model-based and deep-learning-based methods. We firstly provide a thorough analysis of DAU for PAT reconstruction. Then, in order to incorporate the structural prior constraint, we propose a nested DAU framework based on plug-and-play Alternating Direction Method of Multipliers (PnP-ADMM) to deal with the sparse sampling problem. Experimental results on numerical simulation, in vivo animal imaging, and multispectral un-mixing demonstrate that the proposed DAU image reconstruction framework outperforms state-of-the-art model-based and deep-learning-based methods.
Collapse
Affiliation(s)
- Jia Ge
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Zongxin Mo
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Shuangyang Zhang
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Xiaoming Zhang
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Yutian Zhong
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Zhaoyong Liang
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Chaobin Hu
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Wufan Chen
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Li Qi
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| |
Collapse
|
4
|
Paul B, Patra R. Photoacoustic image reconstruction with an objective function using TGV and ESTGV as a regularization functional. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:29-38. [PMID: 38175127 DOI: 10.1364/josaa.499443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 11/10/2023] [Indexed: 01/05/2024]
Abstract
Photoacoustic tomographic imaging is a non-invasive medical diagnostic technology for visualizing biological tissue. However, the inverse problem and noise in photoacoustic signals often cause blurred images. Existing regularization methods struggle with staircasing artifacts and edge preservation. To overcome this, an objective function incorporating total generalized variation (TGV) is proposed. However, it failed with high-density Gaussian noise. To address this, an extended version called edge-guided second-order TGV (ESTGV) is introduced. For sparsification, wavelet transform and discrete cosine transform are introduced, while the fast-composite-splitting algorithm is employed for the inverse problem solution. Experimental validation demonstrates the potential of these approaches.
Collapse
|
5
|
Gadallah MT, Mohamed AEA, Hefnawy A, Zidan H, El-banby G, Badawy SM. A Mathematical Model for Simulating Photoacoustic Signal Generation Process in Biological Tissues.. [DOI: 10.21203/rs.3.rs-2928563/v2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
Abstract
Background: Biomedical photoacoustic imaging (PAI) is a hybrid imaging modality based on the laser-generated ultrasound waves due to the photoacoustic (PA) effect physical phenomenon that has been reported firstly by A. G. Bell in 1880. Numerical modeling-based simulation for the PA signal generation process in biological tissues helps researchers for decreasing error trials in-vitro and hence decreasing error rates for in-vivo experiments. Numerical modeling methods help in obtaining a rapid modeling procedure comparable to pure mathematics. However, if a proper simplified mathematical model can be founded before applying numerical modeling techniques, it will be a great advantage for the overall numerical model. Most scientific theories, equations, and assumptions, been proposed to mathematically model the complete PA signal generation and propagation process in biological tissues, are so complicated. Hence, the researchers, especially the beginners, will find a hard difficulty to explore and obtain a proper simplified mathematical model describing the process. That’s why this paper is introduced.
Methods: In this paper we have tried to simplify understanding for the biomedical PA wave’s generation and propagation process, deducing a simplified mathematical model for the whole process. The proposed deduced model is based on three steps: a- pulsed laser irradiance, b- diffusion of light through biological tissue, and c- acoustic pressure wave generation and propagation from the target tissue to the ultrasound transducer surface. COMSOL Multiphysics, which is founded due to the finite element method (FEM) numerical modeling principle, has been utilized to validate the proposed deduced mathematical model on a simulated biological tissue including a tumor inside.
Results and Conclusion: The time-dependent study been applied by COMSOL has assured that the proposed deduced mathematical model may be considered as a simplified, easy, and fast startup base for scientific researchers to numerically model and simulate biomedical PA signals’ generation and propagation process utilizing any proper software like COMSOL.
Collapse
|
6
|
Gadallah MT, Mohamed AEA, Hefnawy A, Zidan H, El-banby G, Badawy SM. A Mathematical Model for Simulating Photoacoustic Signal Generation Process in Biological Tissues.. [DOI: 10.21203/rs.3.rs-2928563/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
Abstract
Background
Biomedical photoacoustic imaging (PAI) is a hybrid imaging modality based on the laser-generated ultrasound waves due to the photoacoustic (PA) effect physical phenomenon that has been reported firstly by A. G. Bell in 1880. Numerical modeling based simulation for PA signal generation process in biological tissues helps researchers for decreasing error trials in-vitro and hence decreasing error rates for in-vivo experiments. Numerical modeling methods help in obtaining a rapid modeling procedure comparable to pure mathematics. However, if a proper simplified mathematical model can be founded before applying numerical modeling techniques, it will be a great advantage for the overall numerical model. More scientific theories, equations, and assumptions through the biomedical PA imaging research literature have been proposed trying to mathematically model the complete PA signal generation and propagation process in biological tissues. However, most of them have so complicated details. Hence, the researchers, especially the beginners, will find a hard difficulty to explore and obtain a proper simplified mathematical model describing the process. That’s why this paper is introduced.
Methods
In this paper we have tried to simplify understanding for the biomedical PA wave’s generation and propagation process, deducing a simplified mathematical model for the whole process. The proposed deduced model is based on three steps: a- pulsed laser irradiance, b- diffusion of light through biological tissue, and c- acoustic pressure wave generation and propagation from the target tissue to the ultrasound transducer surface.
Collapse
|
7
|
Li X, Ge J, Zhang S, Wu J, Qi L, Chen W. Multispectral interlaced sparse sampling photoacoustic tomography based on directional total variation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 214:106562. [PMID: 34906784 DOI: 10.1016/j.cmpb.2021.106562] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Revised: 11/11/2021] [Accepted: 11/26/2021] [Indexed: 06/14/2023]
Abstract
BACKGROUND AND OBJECTIVE Photoacoustic tomography (PAT) is capable of obtaining cross-sectional images of small animals that represent the optical absorption of biological tissues. The multispectral Interlaced Sparse Sampling PAT, or ISS-PAT, is a previously proposed PAT imaging method that offered high quality images with much sparser transducer angular coverage. Although it provides superior imaging performance, the original ISS-PAT method suffered from a heavy computation burden, which hinders its practical application. METHODS Here, we propose a new regularization scheme based on the directional total variation (dTV) for ISS-PAT. This method efficiently imposes the structural information by considering both the edge position and direction information of the anatomical prior image in ISS-PAT. It does not require image segmentation, and can be conveniently solved by a modified alternating direction of multipliers (ADMM) algorithm. RESULTS We perform simulation, tissue mimicking phantom and in vivo small animal experiments to evaluate the proposed scheme. The reconstructed PAT images showed image quality and spectral un-mixing accuracy close to those obtained by non-local means based ISS-PAT, but with much shorter image reconstruction time. For a 1/6 sparse sampling rate, the average efficiency improvement is nearly 16-folds. CONCLUSIONS The experimental results demonstrate the feasibility of the dTV regularization scheme for ISS-PAT. Its efficient image reconstruction performance facilitates the potential of the hardware realization and practical applications of the ISS-PAT.
Collapse
Affiliation(s)
- Xipan Li
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, 510515, China; Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Zhengzhou, Henan, 450008, China
| | - Jia Ge
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, 510515, China
| | - Shuangyang Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, 510515, China
| | - Jian Wu
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, 510515, China
| | - Li Qi
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, 510515, China.
| | - Wufan Chen
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, 510515, China.
| |
Collapse
|