1
|
Lv J, Lan H, Qin A, Sun T, Shao D, Gao F, Yao J, Avanaki K, Nie L. Dynamic synthetic-scanning photoacoustic tracking monitors hepatic and renal clearance pathway of exogeneous probes in vivo. LIGHT, SCIENCE & APPLICATIONS 2024; 13:304. [PMID: 39482292 PMCID: PMC11528052 DOI: 10.1038/s41377-024-01644-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Revised: 08/29/2024] [Accepted: 09/16/2024] [Indexed: 11/03/2024]
Abstract
Advancements in precision medicine necessitate understanding drug clearance pathways, especially in organs like the liver and kidneys. Traditional techniques such as PET/CT pose radiation hazards, whereas optical imaging poses challenges in maintaining both depth penetration and high resolution. Moreover, very few longitudinal studies have been performed for drug candidates for different symptoms. Leveraging non-ionizing photoacoustic tomography for deep tissue imaging, we developed a spatiotemporally resolved clearance pathway tracking (SRCPT) method, providing unprecedented insights into drug clearance dynamics within vital organs. SRCPT addresses challenges like laser fluence attenuation, enabling dynamic visualization of drug clearance pathways and essential parameter extraction. We employed a novel frequency component selection based synthetic aperture focusing technique (FCS-SAFT) with respiratory-artifacts-free weighting factors to enhance three-dimensional imaging resolutions. Inspired by this, we investigated the clearance pathway of a clinical drug, mitoxantrone, revealing reduced liver clearance when hepatic function is impaired. Furthermore, immunoglobulin G clearance analysis revealed significant differences among mice with varying renal injury degrees. The accuracy of our method was validated using a double-labeled probe [68Ga]DFO-IRDye800CW, showing a strong positive correlation between SRCPT and PET. We believe that this powerful SRCPT promises precise mapping of drug clearance pathways and enhances diagnosis and treatment of liver and kidney-related diseases.
Collapse
Affiliation(s)
- Jing Lv
- Guangdong Cardiovascular Institute, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, 510080, China
- Medical Research Institute, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Southern Medical University, Guangzhou, 510080, China
| | - Hengrong Lan
- Medical Research Institute, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Southern Medical University, Guangzhou, 510080, China
- School of Biomedical Engineering, Tsinghua University, Beijing, 100084, China
| | - Aoji Qin
- Medical Research Institute, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Southern Medical University, Guangzhou, 510080, China
| | - Tong Sun
- Medical Research Institute, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Southern Medical University, Guangzhou, 510080, China
| | - Dan Shao
- Department of PET Center, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Southern Medical University, Guangzhou, 510080, China
| | - Fei Gao
- Hybrid Imaging System Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, 201210, China
| | - Junjie Yao
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Kamran Avanaki
- Richard and Loan Hill Department of Biomedical Engineering, University of Illinois at Chicago, Chicago, IL, 60607, USA
| | - Liming Nie
- Medical Research Institute, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Southern Medical University, Guangzhou, 510080, China.
| |
Collapse
|
2
|
Wang Z, Tao W, Zhao H. Extractor-attention-predictor network for quantitative photoacoustic tomography. PHOTOACOUSTICS 2024; 38:100609. [PMID: 38745884 PMCID: PMC11091525 DOI: 10.1016/j.pacs.2024.100609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 04/18/2024] [Accepted: 04/20/2024] [Indexed: 05/16/2024]
Abstract
Quantitative photoacoustic tomography (qPAT) holds great potential in estimating chromophore concentrations, whereas the involved optical inverse problem, aiming to recover absorption coefficient distributions from photoacoustic images, remains challenging. To address this problem, we propose an extractor-attention-predictor network architecture (EAPNet), which employs a contracting-expanding structure to capture contextual information alongside a multilayer perceptron to enhance nonlinear modeling capability. A spatial attention module is introduced to facilitate the utilization of important information. We also use a balanced loss function to prevent network parameter updates from being biased towards specific regions. Our method obtains satisfactory quantitative metrics in simulated and real-world validations. Moreover, it demonstrates superior robustness to target properties and yields reliable results for targets with small size, deep location, or relatively low absorption intensity, indicating its broader applicability. The EAPNet, compared to the conventional UNet, exhibits improved efficiency, which significantly enhances performance while maintaining similar network size and computational complexity.
Collapse
Affiliation(s)
- Zeqi Wang
- School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Wei Tao
- School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Hui Zhao
- School of Sensing Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| |
Collapse
|
3
|
Liu J, Qi L, Feng Y, Hu Q, Zhang S. Model-based quantitative photoacoustic tomography with directional total variation. JOURNAL OF BIOPHOTONICS 2024; 17:e202400128. [PMID: 38863275 DOI: 10.1002/jbio.202400128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Revised: 04/30/2024] [Accepted: 05/11/2024] [Indexed: 06/13/2024]
Abstract
In photoacoustic tomography (PAT), acoustic inversion aims to recover the spatial distribution of light energy deposition within the imaging object from the signals captured by detectors. To achieve quantitative imaging, optical inversion is further employed to derive absorption coefficient (AC) images. However, limitations such as restricted detection angles and inherent noise lead to substantial artifacts and degradation in the quality of PAT images, consequently affecting the accuracy of optical inversion results. In this study, we propose a directional total variation constrained optical inversion model to reconstruct the AC image. By incorporating anatomy prior information into the optical inversion process, our method can effectively suppress artifacts in AC images while maintaining structural integrity. Simulation, phantom, and in vivo experimental results demonstrate that our method significantly improves the reconstructed AC image quality. Our method provides a reliable foundation for achieving high-quality quantitative PAT imaging.
Collapse
Affiliation(s)
- Jiaming Liu
- Department of Radiology, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde), Foshan, China
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Li Qi
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Yanqiu Feng
- Department of Radiology, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde), Foshan, China
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Qiugen Hu
- Department of Radiology, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde), Foshan, China
| | - Shuangyang Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| |
Collapse
|
4
|
Liang Z, Zhang S, Liang Z, Mo Z, Zhang X, Zhong Y, Chen W, Qi L. Deep learning acceleration of iterative model-based light fluence correction for photoacoustic tomography. PHOTOACOUSTICS 2024; 37:100601. [PMID: 38516295 PMCID: PMC10955667 DOI: 10.1016/j.pacs.2024.100601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 03/23/2024]
Abstract
Photoacoustic tomography (PAT) is a promising imaging technique that can visualize the distribution of chromophores within biological tissue. However, the accuracy of PAT imaging is compromised by light fluence (LF), which hinders the quantification of light absorbers. Currently, model-based iterative methods are used for LF correction, but they require extensive computational resources due to repeated LF estimation based on differential light transport models. To improve LF correction efficiency, we propose to use Fourier neural operator (FNO), a neural network specially designed for estimating partial differential equations, to learn the forward projection of light transport in PAT. Trained using paired finite-element-based LF simulation data, our FNO model replaces the traditional computational heavy LF estimator during iterative correction, such that the correction procedure is considerably accelerated. Simulation and experimental results demonstrate that our method achieves comparable LF correction quality to traditional iterative methods while reducing the correction time by over 30 times.
Collapse
Affiliation(s)
- Zhaoyong Liang
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Shuangyang Zhang
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Zhichao Liang
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Zongxin Mo
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Xiaoming Zhang
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Yutian Zhong
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Wufan Chen
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| | - Li Qi
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Rd., Baiyun District, Guangzhou, Guangdong 510515, China
| |
Collapse
|
5
|
Rix T, Dreher KK, Nölke JH, Schellenberg M, Tizabi MD, Seitel A, Maier-Hein L. Efficient Photoacoustic Image Synthesis with Deep Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:7085. [PMID: 37631628 PMCID: PMC10457787 DOI: 10.3390/s23167085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 07/25/2023] [Accepted: 08/07/2023] [Indexed: 08/27/2023]
Abstract
Photoacoustic imaging potentially allows for the real-time visualization of functional human tissue parameters such as oxygenation but is subject to a challenging underlying quantification problem. While in silico studies have revealed the great potential of deep learning (DL) methodology in solving this problem, the inherent lack of an efficient gold standard method for model training and validation remains a grand challenge. This work investigates whether DL can be leveraged to accurately and efficiently simulate photon propagation in biological tissue, enabling photoacoustic image synthesis. Our approach is based on estimating the initial pressure distribution of the photoacoustic waves from the underlying optical properties using a back-propagatable neural network trained on synthetic data. In proof-of-concept studies, we validated the performance of two complementary neural network architectures, namely a conventional U-Net-like model and a Fourier Neural Operator (FNO) network. Our in silico validation on multispectral human forearm images shows that DL methods can speed up image generation by a factor of 100 when compared to Monte Carlo simulations with 5×108 photons. While the FNO is slightly more accurate than the U-Net, when compared to Monte Carlo simulations performed with a reduced number of photons (5×106), both neural network architectures achieve equivalent accuracy. In contrast to Monte Carlo simulations, the proposed DL models can be used as inherently differentiable surrogate models in the photoacoustic image synthesis pipeline, allowing for back-propagation of the synthesis error and gradient-based optimization over the entire pipeline. Due to their efficiency, they have the potential to enable large-scale training data generation that can expedite the clinical application of photoacoustic imaging.
Collapse
Affiliation(s)
- Tom Rix
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 223, 69120 Heidelberg, Germany
- Faculty of Mathematics and Computer Sciences, Heidelberg University, 69120 Heidelberg, Germany
| | - Kris K. Dreher
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 223, 69120 Heidelberg, Germany
- Faculty of Physics and Astronomy, Heidelberg University, 69120 Heidelberg, Germany
| | - Jan-Hinrich Nölke
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 223, 69120 Heidelberg, Germany
- Faculty of Mathematics and Computer Sciences, Heidelberg University, 69120 Heidelberg, Germany
| | - Melanie Schellenberg
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 223, 69120 Heidelberg, Germany
- Faculty of Mathematics and Computer Sciences, Heidelberg University, 69120 Heidelberg, Germany
- HIDSS4Health—Helmholtz Information and Data Science School for Health, 69120 Heidelberg, Germany
- National Center for Tumor Diseases (NCT), NCT Heidelberg, a partnership between DKFZ and University Medical Center Heidelberg, 69120 Heidelberg, Germany
| | - Minu D. Tizabi
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 223, 69120 Heidelberg, Germany
- National Center for Tumor Diseases (NCT), NCT Heidelberg, a partnership between DKFZ and University Medical Center Heidelberg, 69120 Heidelberg, Germany
| | - Alexander Seitel
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 223, 69120 Heidelberg, Germany
- National Center for Tumor Diseases (NCT), NCT Heidelberg, a partnership between DKFZ and University Medical Center Heidelberg, 69120 Heidelberg, Germany
| | - Lena Maier-Hein
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 223, 69120 Heidelberg, Germany
- Faculty of Mathematics and Computer Sciences, Heidelberg University, 69120 Heidelberg, Germany
- HIDSS4Health—Helmholtz Information and Data Science School for Health, 69120 Heidelberg, Germany
- National Center for Tumor Diseases (NCT), NCT Heidelberg, a partnership between DKFZ and University Medical Center Heidelberg, 69120 Heidelberg, Germany
- Medical Faculty, Heidelberg University, 69120 Heidelberg, Germany
| |
Collapse
|
6
|
Ni R, Straumann N, Fazio S, Dean-Ben XL, Louloudis G, Keller C, Razansky D, Ametamey S, Mu L, Nombela-Arrieta C, Klohs J. Imaging increased metabolism in the spinal cord in mice after middle cerebral artery occlusion. PHOTOACOUSTICS 2023; 32:100532. [PMID: 37645255 PMCID: PMC10461215 DOI: 10.1016/j.pacs.2023.100532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 07/13/2023] [Accepted: 07/13/2023] [Indexed: 08/31/2023]
Abstract
Emerging evidence indicates crosstalk between the brain and hematopoietic system following cerebral ischemia. Here, we investigated metabolism and oxygenation in the spleen and spinal cord in a transient middle cerebral artery occlusion (tMCAO) model. Sham-operated and tMCAO mice underwent [18F]fluorodeoxyglucose (FDG)-positron emission tomography (PET) to assess glucose metabolism. Naïve, sham-operated and tMCAO mice underwent multispectral optoacoustic tomography (MSOT) assisted by quantitative model-based reconstruction and unmixing algorithms for accurate mapping of oxygenation patterns in peripheral tissues at 24 h after reperfusion. We found increased [18F]FDG uptake and reduced MSOT oxygen saturation, indicating hypoxia in the thoracic spinal cord of tMCAO mice compared with sham-operated mice but not in the spleen. Reduced spleen size was observed in tMCAO mice compared with sham-operated mice ex vivo. tMCAO led to an increase in the numbers of mature T cells in femoral bone marrow tissues, concomitant with a stark reduction in these cell subsets in the spleen and peripheral blood. The combination of quantitative PET and MSOT thus enabled observation of hypoxia and increased metabolic activity in the spinal cord of tMCAO mice at 24 h after occlusion compared to sham-operated mice.
Collapse
Affiliation(s)
- Ruiqing Ni
- Institute for Regenerative Medicine, University of Zurich, Zurich, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, University of Zurich & ETH Zurich, Zurich, Switzerland
- Zentrum für Neurowissenschaften Zurich, Zurich, Switzerland
| | - Nadja Straumann
- Institute for Regenerative Medicine, University of Zurich, Zurich, Switzerland
| | - Serana Fazio
- Department of Medical Oncology and Hematology, University and University Hospital Zurich, Zurich, Switzerland
| | - Xose Luis Dean-Ben
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, University of Zurich & ETH Zurich, Zurich, Switzerland
| | - Georgios Louloudis
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, University of Zurich & ETH Zurich, Zurich, Switzerland
| | - Claudia Keller
- Center for Radiopharmaceutical Sciences ETH, PSI and USZ, Institute of Pharmaceutical Sciences, Department of Chemistry and Applied Biosciences, ETH Zurich, Zurich, Switzerland
| | - Daniel Razansky
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, University of Zurich & ETH Zurich, Zurich, Switzerland
- Zentrum für Neurowissenschaften Zurich, Zurich, Switzerland
| | - Simon Ametamey
- Center for Radiopharmaceutical Sciences ETH, PSI and USZ, Institute of Pharmaceutical Sciences, Department of Chemistry and Applied Biosciences, ETH Zurich, Zurich, Switzerland
| | - Linjing Mu
- Center for Radiopharmaceutical Sciences ETH, PSI and USZ, Institute of Pharmaceutical Sciences, Department of Chemistry and Applied Biosciences, ETH Zurich, Zurich, Switzerland
| | - César Nombela-Arrieta
- Department of Medical Oncology and Hematology, University and University Hospital Zurich, Zurich, Switzerland
| | - Jan Klohs
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, University of Zurich & ETH Zurich, Zurich, Switzerland
| |
Collapse
|
7
|
Zheng S, Yingsa H, Meichen S, Qi M. Quantitative photoacoustic tomography with light fluence compensation based on radiance Monte Carlo model. Phys Med Biol 2023; 68. [PMID: 36821863 DOI: 10.1088/1361-6560/acbe90] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Accepted: 02/23/2023] [Indexed: 02/25/2023]
Abstract
Objective. Photoacoustic tomography (PAT) is a rapidly evolving imaging modality that provides images with high contrast and spatial resolution showing the optical properties of biological tissues. The photoacoustic pressure is proportional to the product of the optical absorption coefficient and the local light fluence. The essential challenge in reconstructing quantitative images representing spatially varying absorption coefficients is the unknown light fluence. In addition, optical attenuation induces spatial variations in the light fluence, and the heterogeneity of the fluence determines the limits of reconstruction quality and depth.Approach.In this work, a reconstruction enhancement scheme is proposed to compensate for the variation in the light fluence in the absorption coefficient recovery. The inverse problem of the radiance Monte Carlo model describing light transport through the tissue is solved by using an alternating optimization strategy. In the iteration, the absorption coefficients and photon weights are alternately updated.Main results.The method provides highly accurate quantitative images of absorption coefficients in simulations, phantoms, andin vivostudies. The results show that the method has great potential for improving the accuracy of absorption coefficient recovery compared to conventional reconstruction methods that ignore light fluence variations. Comparison with state-of-the-art fluence compensation methods shows significant improvements in root mean square error, normalized mean square absolute distance, and structural similarity metrics.Significance.This method achieves high precision quantitative imaging by compensating for nonuniform light fluence without increasing the complexity and operation of the imaging system.
Collapse
Affiliation(s)
- Sun Zheng
- Department of Electronic and Communication Engineering, North China Electric Power University, Baoding 071003, Hebei, People's Republic of China
- Hebei Key Laboratory of Power Internet of Things Technology, North China Electric Power University, Baoding 071003, Hebei, People's Republic of China
| | - Hou Yingsa
- Department of Electronic and Communication Engineering, North China Electric Power University, Baoding 071003, Hebei, People's Republic of China
| | - Sun Meichen
- Department of Electronic and Communication Engineering, North China Electric Power University, Baoding 071003, Hebei, People's Republic of China
| | - Meng Qi
- Department of Electronic and Communication Engineering, North China Electric Power University, Baoding 071003, Hebei, People's Republic of China
| |
Collapse
|
8
|
Schellenberg M, Gröhl J, Dreher KK, Nölke JH, Holzwarth N, Tizabi MD, Seitel A, Maier-Hein L. Photoacoustic image synthesis with generative adversarial networks. PHOTOACOUSTICS 2022; 28:100402. [PMID: 36281320 PMCID: PMC9587371 DOI: 10.1016/j.pacs.2022.100402] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 09/03/2022] [Accepted: 09/08/2022] [Indexed: 06/16/2023]
Abstract
Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties with high spatial resolution. However, previous attempts to solve the optical inverse problem with supervised machine learning were hampered by the absence of labeled reference data. While this bottleneck has been tackled by simulating training data, the domain gap between real and simulated images remains an unsolved challenge. We propose a novel approach to PAT image synthesis that involves subdividing the challenge of generating plausible simulations into two disjoint problems: (1) Probabilistic generation of realistic tissue morphology, and (2) pixel-wise assignment of corresponding optical and acoustic properties. The former is achieved with Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data. According to a validation study on a downstream task our approach yields more realistic synthetic images than the traditional model-based approach and could therefore become a fundamental step for deep learning-based quantitative PAT (qPAT).
Collapse
Affiliation(s)
- Melanie Schellenberg
- Intelligent Medical Systems (IMSY), German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Heidelberg, Germany
| | - Janek Gröhl
- Intelligent Medical Systems (IMSY), German Cancer Research Center (DKFZ), Heidelberg, Germany
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge, CB2 0RE, UK
| | - Kris K. Dreher
- Intelligent Medical Systems (IMSY), German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Physics and Astronomy, Heidelberg University, Heidelberg, Germany
| | - Jan-Hinrich Nölke
- Intelligent Medical Systems (IMSY), German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
| | - Niklas Holzwarth
- Intelligent Medical Systems (IMSY), German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
| | - Minu D. Tizabi
- Intelligent Medical Systems (IMSY), German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Alexander Seitel
- Intelligent Medical Systems (IMSY), German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Lena Maier-Hein
- Intelligent Medical Systems (IMSY), German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Heidelberg, Germany
- Medical Faculty, Heidelberg University, Heidelberg, Germany
- HIP Applied Computer Vision Lab, Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
| |
Collapse
|
9
|
Zhang S, Liu J, Liang Z, Ge J, Feng Y, Chen W, Qi L. Pixel-wise reconstruction of tissue absorption coefficients in photoacoustic tomography using a non-segmentation iterative method. PHOTOACOUSTICS 2022; 28:100390. [PMID: 36051488 PMCID: PMC9424605 DOI: 10.1016/j.pacs.2022.100390] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2022] [Revised: 06/30/2022] [Accepted: 08/14/2022] [Indexed: 06/15/2023]
Abstract
In Photoacoustic Tomography (PAT), the acquired image represents a light energy deposition map of the imaging object. For quantitative imaging, the PAT image is converted into an absorption coefficient (μ a ) map by dividing the light fluence (LF). Previous methods usually assume a uniform tissueμ a distribution, and consequently degrade the LF correction results. Here, we propose a simple method to reconstruct the pixel-wiseμ a map. Our method is based on a non-segmentation-based iterative algorithm, which alternately optimizes the LF distribution and theμ a map. Using simulation data, as well as phantom and animal data, we implemented our algorithm and compared it to segmentation-based correction methods. The results show that our method can obtain accurate estimation of the LF distribution and therefore improve the image quality and feature visibility of theμ a map. Our method may facilitate efficient calculation of the concentration distributions of endogenous and exogenous agents in vivo.
Collapse
Affiliation(s)
- Shuangyang Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Jiaming Liu
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Zhichao Liang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Jia Ge
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Yanqiu Feng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Wufan Chen
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| | - Li Qi
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, Guangdong, China
| |
Collapse
|
10
|
Ganzleben I, Klett D, Hartz W, Götzfried L, Vitali F, Neurath MF, Waldner MJ. Multispectral optoacoustic tomography for the non-invasive identification of patients with severe anemia in vivo. PHOTOACOUSTICS 2022; 28:100414. [PMID: 36276233 PMCID: PMC9583176 DOI: 10.1016/j.pacs.2022.100414] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 09/29/2022] [Accepted: 10/10/2022] [Indexed: 06/16/2023]
Abstract
The immediate diagnosis of severe anemia is crucial for patient outcome. However, reliable non-invasive point-of-care diagnostic tools for e.g., ICU monitoring are currently lacking. Using an advanced Multispectral Optoacoustic Tomography (MSOT) research device, we first substantiated a strong positive correlation of MSOT-signal and absolute hemoglobin concentration ex vivo in blood samples. In a clinical exploratory proof-of-concept study, we then evaluated 19 patients with different severities of anemia and controls by non-invasive in vivo measurement of hemoglobin in the radial artery. Our approach proved excellent in identifying patients with severe anemia triggering RBC transfusion based on a strong positive correlation of MSOT-signal intensity and hemoglobin concentration for 700 nm single wavelength and HbR unmixed MSOT-parameter analysis. In conclusion, our study lays the foundation to further develop MSOT-based real-time quantitative perfusion analyses in follow-up preclinical and clinical imaging studies and as a promising diagnostic tool to improve patient care in the future. DRKS00021442.
Collapse
Affiliation(s)
- Ingo Ganzleben
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Daniel Klett
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Wiebke Hartz
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Lisa Götzfried
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Francesco Vitali
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Markus F. Neurath
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
- Erlangen Graduate School in Advanced Optical Technologies (SAOT), Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| | - Maximilian J. Waldner
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
- Erlangen Graduate School in Advanced Optical Technologies (SAOT), Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| |
Collapse
|
11
|
Mantri Y, Mishra A, Anderson CA, Jokerst JV. Photoacoustic imaging to monitor outcomes during hyperbaric oxygen therapy: validation in a small cohort and case study in a bilateral chronic ischemic wound. BIOMEDICAL OPTICS EXPRESS 2022; 13:5683-5694. [PMID: 36733747 PMCID: PMC9872873 DOI: 10.1364/boe.472568] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Revised: 09/19/2022] [Accepted: 09/19/2022] [Indexed: 06/18/2023]
Abstract
Hyperbaric oxygen therapy (HBO2) is a common therapeutic modality that drives oxygen into hypoxic tissue to promote healing. Here, ten patients undergoing HBO2 underwent PA oximetry of the left radial artery and forearm pre- and post-HBO2; this cohort validated the use of PA imaging in HBO2. There was a significant increase in radial artery oxygenation after HBO2 (p = 0.002) in the validation cohort. We also include a case study: a non-diabetic male in his 50s (HB 010) presenting with bilateral ischemic and gangrenous wounds. HB 010 showed higher perfusion and oxygen saturation on the right foot than the left after HBO2 which correlated with independent surgical observations. Imaging assisted with limb salvage treatment. Hence, this work shows that PA imaging can measure changes in arterial oxygen saturation due to HBO2; it can also produce 3D maps of tissue oxygenation and evaluate response to therapy during HBO2.
Collapse
Affiliation(s)
- Yash Mantri
- Department of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Aditya Mishra
- Materials Science Program, University of California San Diego, La Jolla, CA, USA
| | - Caesar A. Anderson
- Department of Emergency Medicine, Hyperbaric and Wound Healing Center, University of California San Diego, Encinitas, CA, USA
| | - Jesse V. Jokerst
- Materials Science Program, University of California San Diego, La Jolla, CA, USA
- Department of Nanoengineering, University of California San Diego, La Jolla, CA, USA
- Department of Radiology, University of California San Diego, La Jolla, CA, USA
| |
Collapse
|
12
|
Madasamy A, Gujrati V, Ntziachristos V, Prakash J. Deep learning methods hold promise for light fluence compensation in three-dimensional optoacoustic imaging. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:106004. [PMID: 36209354 PMCID: PMC9547608 DOI: 10.1117/1.jbo.27.10.106004] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Accepted: 08/30/2022] [Indexed: 06/16/2023]
Abstract
SIGNIFICANCE Quantitative optoacoustic imaging (QOAI) continues to be a challenge due to the influence of nonlinear optical fluence distribution, which distorts the optoacoustic image representation. Nonlinear optical fluence correction in OA imaging is highly ill-posed, leading to the inaccurate recovery of optical absorption maps. This work aims to recover the optical absorption maps using deep learning (DL) approach by correcting for the fluence effect. AIM Different DL models were compared and investigated to enable optical absorption coefficient recovery at a particular wavelength in a nonhomogeneous foreground and background medium. APPROACH Data-driven models were trained with two-dimensional (2D) Blood vessel and three-dimensional (3D) numerical breast phantom with highly heterogeneous/realistic structures to correct for the nonlinear optical fluence distribution. The trained DL models such as U-Net, Fully Dense (FD) U-Net, Y-Net, FD Y-Net, Deep residual U-Net (Deep ResU-Net), and generative adversarial network (GAN) were tested to evaluate the performance of optical absorption coefficient recovery (or fluence compensation) with in-silico and in-vivo datasets. RESULTS The results indicated that FD U-Net-based deconvolution improves by about 10% over reconstructed optoacoustic images in terms of peak-signal-to-noise ratio. Further, it was observed that DL models can indeed highlight deep-seated structures with higher contrast due to fluence compensation. Importantly, the DL models were found to be about 17 times faster than solving diffusion equation for fluence correction. CONCLUSIONS The DL methods were able to compensate for nonlinear optical fluence distribution more effectively and improve the optoacoustic image quality.
Collapse
Affiliation(s)
- Arumugaraj Madasamy
- Indian Institute of Science, Department of Instrumentation and Applied Physics, Bengaluru, Karnataka, India
| | - Vipul Gujrati
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München (GmbH), Neuherberg, Germany
- Technical University of Munich, School of Medicine, Chair of Biological Imaging, Munich, Germany
| | - Vasilis Ntziachristos
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München (GmbH), Neuherberg, Germany
- Technical University of Munich, School of Medicine, Chair of Biological Imaging, Munich, Germany
- Technical University of Munich, Munich Institute of Robotics and Machine Intelligence (MIRMI), Munich, Germany
| | - Jaya Prakash
- Indian Institute of Science, Department of Instrumentation and Applied Physics, Bengaluru, Karnataka, India
| |
Collapse
|
13
|
Fujii H, Terabayashi I, Kobayashi K, Watanabe M. Modeling photoacoustic pressure generation in colloidal suspensions at different volume fractions based on a multi-scale approach. PHOTOACOUSTICS 2022; 27:100368. [PMID: 35646589 PMCID: PMC9130529 DOI: 10.1016/j.pacs.2022.100368] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/19/2022] [Revised: 05/03/2022] [Accepted: 05/06/2022] [Indexed: 06/15/2023]
Abstract
Further development of quantitative photoacoustic tomography requires understanding the photoacoustic pressure generation by modeling the generation process. This study modeled the initial photoacoustic pressure in colloidal suspensions, used as tissue phantoms, at different volume fractions on a multi-scale approach. We modeled the thermodynamic and light scattering properties on a microscopic scale with/without treating the hard-sphere interaction between colloidal particles. Meanwhile, we did the light energy density on a macroscopic scale. We showed that the hard-sphere interaction significantly influences the initial pressure and related quantities at a high volume fraction except for the thermodynamic properties. We also showed the initial pressure at the absorber inside the medium logarithmically decreases with increasing the volume fractions. This result is mainly due to the decay of the light energy density with light scattering. Our numerical results suggest that modeling light scattering and propagation is crucial over modeling thermal expansion.
Collapse
|
14
|
Zhang S, Qi L, Li X, Liang Z, Sun X, Liu J, Lu L, Feng Y, Chen W. MRI Information-Based Correction and Restoration of Photoacoustic Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:2543-2555. [PMID: 35394906 DOI: 10.1109/tmi.2022.3165839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
As an emerging molecular imaging modality, Photoacoustic Tomography (PAT) is capable of mapping tissue physiological metabolism and exogenous contrast agent information with high specificity. Due to its ultrasonic detection mechanism, the precise localization of targeted lesions has long been a challenge for PAT imaging. The poor soft-tissue contrast of the PAT image makes this process difficult and inaccurate. To meet this challenge, in this study, we first make use of the rich and clear structural information brought about by another advanced imaging modality, Magnetic Resonance Imaging (MRI), to assist organ segmentation and correct for the light fluence attenuation of PAT. We demonstrate improved feature visibility and enhanced localization of endogenous and exogenous agents in the fluence corrected PAT images. Compared with PAT-based methods, the contrast-to-noise ratio (CNR) of our MRI-assisted method increases by 29.1% in live animal experiments. Furthermore, we show that the co-registered MRI image can also be incorporated into PAT image restoration, and achieves improved anatomical landscape and soft-tissue contrast (CNR increased by 25.36%) while preserving similar spatial resolution. This PAT-MRI combination provides excellent structural, functional and molecular images of the subject, and may enable more comprehensive analysis of various preclinical research applications.
Collapse
|
15
|
Grasso V, Willumeit-Rӧmer R, Jose J. Superpixel spectral unmixing framework for the volumetric assessment of tissue chromophores: A photoacoustic data-driven approach. PHOTOACOUSTICS 2022; 26:100367. [PMID: 35601933 PMCID: PMC9120071 DOI: 10.1016/j.pacs.2022.100367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Revised: 05/04/2022] [Accepted: 05/06/2022] [Indexed: 06/15/2023]
Abstract
The assessment of tissue chromophores at a volumetric scale is vital for an improved diagnosis and treatment of a large number of diseases. Spectral photoacoustic imaging (sPAI) co-registered with high-resolution ultrasound (US) is an innovative technology that has a great potential for clinical translation as it can assess the volumetric distribution of the tissue components. Conventionally, to detect and separate the chromophores from sPAI, an input of the expected tissue absorption spectra is required. However, in pathological conditions, the prediction of the absorption spectra is difficult as it can change with respect to the physiological state. Besides, this conventional approach can also be hampered due to spectral coloring, which is a prominent distortion effect that induces spectral changes at depth. Here, we are proposing a novel data-driven framework that can overcome all these limitations and provide an improved assessment of the tissue chromophores. We have developed a superpixel spectral unmixing (SPAX) approach that can detect the most and less prominent absorber spectra and their volumetric distribution without any user interactions. Within the SPAX framework, we have also implemented an advanced spectral coloring compensation approach by utilizing US image segmentation and Monte Carlo simulations, based on a predefined library of optical properties. The framework has been tested on tissue-mimicking phantoms and also on healthy animals. The obtained results show enhanced specificity and sensitivity for the detection of tissue chromophores. To our knowledge, this is a unique framework that accounts for the spectral coloring and provides automated detection of tissue spectral signatures at a volumetric scale, which can open many possibilities for translational research.
Collapse
Affiliation(s)
- Valeria Grasso
- FUJIFILM VisualSonics, Amsterdam, the Netherlands
- Faculty of Engineering, Institute for Materials Science, Christian-Albrecht University of Kiel, Kiel, Germany
| | - Regine Willumeit-Rӧmer
- Faculty of Engineering, Institute for Materials Science, Christian-Albrecht University of Kiel, Kiel, Germany
- Division Metallic Biomaterials, Institute of Materials Research, Helmholtz-Zentrum Hereon GmbH, Geesthacht, Germany
| | - Jithin Jose
- FUJIFILM VisualSonics, Amsterdam, the Netherlands
| |
Collapse
|
16
|
Gröhl J, Hacker L, Cox BT, Dreher KK, Morscher S, Rakotondrainibe A, Varray F, Yip LC, Vogt WC, Bohndiek SE. The IPASC data format: A consensus data format for photoacoustic imaging. PHOTOACOUSTICS 2022; 26:100339. [PMID: 35287304 PMCID: PMC8917284 DOI: 10.1016/j.pacs.2022.100339] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Revised: 02/15/2022] [Accepted: 02/17/2022] [Indexed: 06/14/2023]
Abstract
Photoacoustic imaging (PAI) is an emerging modality that has shown promise for improving patient management in a range of applications. Unfortunately, the current lack of uniformity in PAI data formats compromises inter-user data exchange and comparison, which impedes: technological progress; effective research collaboration; and efforts to deliver multi-centre clinical trials. To overcome this challenge, the International Photoacoustic Standardisation Consortium (IPASC) has established a data format with a defined consensus metadata structure and developed an open-source software application programming interface (API) to enable conversion from proprietary file formats into the IPASC format. The format is based on Hierarchical Data Format 5 (HDF5) and designed to store photoacoustic raw time series data. Internal quality control mechanisms are included to ensure completeness and consistency of the converted data. By unifying the variety of proprietary data and metadata definitions into a consensus format, IPASC hopes to facilitate the exchange and comparison of PAI data.
Collapse
Affiliation(s)
- Janek Gröhl
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, United Kingdom
- Department of Physics, University of Cambridge, Cambridge, United Kingdom
| | - Lina Hacker
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, United Kingdom
- Department of Physics, University of Cambridge, Cambridge, United Kingdom
| | - Ben T. Cox
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Kris K. Dreher
- German Cancer Research Center, Division of Computer Assisted Medical Interventions, Heidelberg, Germany
- Heidelberg University, Faculty of Physics and Astronomy, Heidelberg, Germany
| | | | | | - François Varray
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, CREATIS UMR 5220, U1294, F-69621, Lyon, France
| | - Lawrence C.M. Yip
- Department of Medical Biophysics, Schulich School of Medicine and Dentistry, Western University, London, Canada
- Imaging Program, Lawson Health Research Institute, London, Canada
| | - William C. Vogt
- Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, MD, United States
| | - Sarah E. Bohndiek
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, United Kingdom
- Department of Physics, University of Cambridge, Cambridge, United Kingdom
| | | |
Collapse
|
17
|
Zhu J, Liu C, Liu Y, Chen J, Zhang Y, Yao K, Wang L. Self-Fluence-Compensated Functional Photoacoustic Microscopy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3856-3866. [PMID: 34310295 DOI: 10.1109/tmi.2021.3099820] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Optical-resolution photoacoustic microscopy (OR-PAM) can image blood oxygen saturation (sO2) in vivo with high resolution and excellent sensitivity and offers a great tool for neurovascular study and early cancer diagnosis. OR-PAM ignores the wavelength-dependent optical attenuation in superficial tissue, which cause errors in sO2 imaging. Monte Carlo simulation shows that variations in imaging depth, vessel diameter, and focal position can cause up to ∼ 60 % decrease in sO2 imaging. Here, we develop a self-fluence-compensated OR-PAM to compensate for the wavelength-dependent fluence attenuation. We propose a linearized model to estimate the fluence attenuations and use three optical wavelengths to compensate for them in sO2 calculation. We validate the model in both numerical and physical phantoms and show that the compensation method can effectively reduce the sO2 errors. In functional brain imaging, we demonstrate that the compensation method can effectively improve sO2 accuracy, especially in small vessels. Compared with uncompensated ones, the sO2 values are improved by 10~30% in the brain. We monitor ischemic-stroke-induced brain injury which demonstrates great potential for the pre-clinical study of vascular diseases.
Collapse
|
18
|
Liang Z, Zhang S, Wu J, Li X, Zhuang Z, Feng Q, Chen W, Qi L. Automatic 3-D segmentation and volumetric light fluence correction for photoacoustic tomography based on optimal 3-D graph search. Med Image Anal 2021; 75:102275. [PMID: 34800786 DOI: 10.1016/j.media.2021.102275] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 10/11/2021] [Accepted: 10/15/2021] [Indexed: 01/29/2023]
Abstract
Preclinical imaging with photoacoustic tomography (PAT) has attracted wide attention in recent years since it is capable of providing molecular contrast with deep imaging depth. The automatic extraction and segmentation of the animal in PAT images is crucial for improving image analysis efficiency and enabling advanced image post-processing, such as light fluence (LF) correction for quantitative PAT imaging. Previous automatic segmentation methods are mostly two-dimensional approaches, which failed to conserve the 3-D surface continuity because the image slices were processed separately. This discontinuity problem further hampers LF correction, which, ideally, should be carried out in 3-D due to spatially diffused illumination. Here, to solve these problems, we propose a volumetric auto-segmentation method for small animal PAT imaging based on the 3-D optimal graph search (3-D GS) algorithm. The 3-D GS algorithm takes into account the relation among image slices by constructing a 3-D node-weighted directed graph, and thus ensures surface continuity. In view of the characteristics of PAT images, we improve the original 3-D GS algorithm on graph construction, solution guidance and cost assignment, such that the accuracy and smoothness of the segmented animal surface were guaranteed. We tested the performance of the proposed method by conducting in vivo nude mice imaging experiments with a commercial preclinical cross-sectional PAT system. The results showed that our method successfully retained the continuous global surface structure of the whole 3-D animal body, as well as smooth local subcutaneous tumor boundaries at different development stages. Moreover, based on the 3-D segmentation result, we were able to simulate volumetric LF distribution of the entire animal body and obtained LF corrected PAT images with enhanced structural visibility and uniform image intensity.
Collapse
Affiliation(s)
- Zhichao Liang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Shuangyang Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Jian Wu
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Xipan Li
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Zhijian Zhuang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Qianjin Feng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Wufan Chen
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
| | - Li Qi
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China.
| |
Collapse
|
19
|
Wang Y, Xu M, Gao F, Kang F, Zhu S. Nonlinear iterative perturbation scheme with simplified spherical harmonics (SP 3 ) light propagation model for quantitative photoacoustic tomography. JOURNAL OF BIOPHOTONICS 2021; 14:e202000446. [PMID: 33576563 DOI: 10.1002/jbio.202000446] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 01/31/2021] [Accepted: 02/06/2021] [Indexed: 06/12/2023]
Abstract
When using quantitative photoacoustic tomography (q-PAT) reconstruction to recover the optical absorption coefficients of tissue, the commonly used diffusion equation has several limitations in the case of the objects that have small geometries and high-absorption or low-scattering areas. Furthermore, the conventional perturbation reconstruction strategy is unsatisfactory when the target tissue containing large heterogeneous features. We herein present a modified q-PAT implementation that employs the higher-order photon migration model achieving the tradeoff between mathematical rigidity and computational efficiency. Besides, a nonlinear iterative method is proposed to obtain the perturbations of optical absorption considering the updating of the sensitivity matrix in calculating the fluence perturbations. Consequently, the distribution of tissue optical properties can be recovered in a robust way even if the targets with high absorption are included. The proposed approach has been validated by simulation, phantom and in vivo experiments, exhibiting promising performances in image fidelity and quantitative feasibility for practical applications.
Collapse
Affiliation(s)
- Yihan Wang
- School of Life Science and Technology, Xidian University, Xi'an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi'an, China
| | - Menglu Xu
- School of Life Science and Technology, Xidian University, Xi'an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi'an, China
| | - Feng Gao
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China
| | - Fei Kang
- Department of Nuclear Medicine, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Shouping Zhu
- School of Life Science and Technology, Xidian University, Xi'an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi'an, China
| |
Collapse
|
20
|
Gröhl J, Schellenberg M, Dreher K, Maier-Hein L. Deep learning for biomedical photoacoustic imaging: A review. PHOTOACOUSTICS 2021; 22:100241. [PMID: 33717977 PMCID: PMC7932894 DOI: 10.1016/j.pacs.2021.100241] [Citation(s) in RCA: 100] [Impact Index Per Article: 33.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Revised: 01/18/2021] [Accepted: 01/20/2021] [Indexed: 05/04/2023]
Abstract
Photoacoustic imaging (PAI) is a promising emerging imaging modality that enables spatially resolved imaging of optical tissue properties up to several centimeters deep in tissue, creating the potential for numerous exciting clinical applications. However, extraction of relevant tissue parameters from the raw data requires the solving of inverse image reconstruction problems, which have proven extremely difficult to solve. The application of deep learning methods has recently exploded in popularity, leading to impressive successes in the context of medical imaging and also finding first use in the field of PAI. Deep learning methods possess unique advantages that can facilitate the clinical translation of PAI, such as extremely fast computation times and the fact that they can be adapted to any given problem. In this review, we examine the current state of the art regarding deep learning in PAI and identify potential directions of research that will help to reach the goal of clinical applicability.
Collapse
Affiliation(s)
- Janek Gröhl
- German Cancer Research Center, Computer Assisted Medical Interventions, Heidelberg, Germany
- Heidelberg University, Medical Faculty, Heidelberg, Germany
| | - Melanie Schellenberg
- German Cancer Research Center, Computer Assisted Medical Interventions, Heidelberg, Germany
| | - Kris Dreher
- German Cancer Research Center, Computer Assisted Medical Interventions, Heidelberg, Germany
- Heidelberg University, Faculty of Physics and Astronomy, Heidelberg, Germany
| | - Lena Maier-Hein
- German Cancer Research Center, Computer Assisted Medical Interventions, Heidelberg, Germany
- Heidelberg University, Medical Faculty, Heidelberg, Germany
- Heidelberg University, Faculty of Mathematics and Computer Science, Heidelberg, Germany
| |
Collapse
|
21
|
Regensburger AP, Brown E, Krönke G, Waldner MJ, Knieling F. Optoacoustic Imaging in Inflammation. Biomedicines 2021; 9:483. [PMID: 33924983 PMCID: PMC8145174 DOI: 10.3390/biomedicines9050483] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 04/20/2021] [Accepted: 04/21/2021] [Indexed: 12/11/2022] Open
Abstract
Optoacoustic or photoacoustic imaging (OAI/PAI) is a technology which enables non-invasive visualization of laser-illuminated tissue by the detection of acoustic signals. The combination of "light in" and "sound out" offers unprecedented scalability with a high penetration depth and resolution. The wide range of biomedical applications makes this technology a versatile tool for preclinical and clinical research. Particularly when imaging inflammation, the technology offers advantages over current clinical methods to diagnose, stage, and monitor physiological and pathophysiological processes. This review discusses the clinical perspective of using OAI in the context of imaging inflammation as well as in current and emerging translational applications.
Collapse
Affiliation(s)
- Adrian P. Regensburger
- Department of Pediatrics and Adolescent Medicine, University Hospital Erlangen, Friedrich-Alexander-Universität (FAU) Erlangen-Nürnberg, Loschgestr. 15, D-91054 Erlangen, Germany;
| | - Emma Brown
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK;
- Cancer Research UK Cambridge Institute, University of Cambridge, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, UK
| | - Gerhard Krönke
- Department of Medicine 3, University Hospital Erlangen, Friedrich-Alexander-Universität (FAU) Erlangen-Nürnberg, Ulmenweg 18, D-91054 Erlangen, Germany;
| | - Maximilian J. Waldner
- Department of Medicine 1, University Hospital Erlangen, Friedrich-Alexander-Universität (FAU) Erlangen-Nürnberg, Ulmenweg 18, D-91054 Erlangen, Germany;
| | - Ferdinand Knieling
- Department of Pediatrics and Adolescent Medicine, University Hospital Erlangen, Friedrich-Alexander-Universität (FAU) Erlangen-Nürnberg, Loschgestr. 15, D-91054 Erlangen, Germany;
| |
Collapse
|
22
|
Lafci B, Mercep E, Morscher S, Dean-Ben XL, Razansky D. Deep Learning for Automatic Segmentation of Hybrid Optoacoustic Ultrasound (OPUS) Images. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2021; 68:688-696. [PMID: 32894712 DOI: 10.1109/tuffc.2020.3022324] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
The highly complementary information provided by multispectral optoacoustics and pulse-echo ultrasound have recently prompted development of hybrid imaging instruments bringing together the unique contrast advantages of both modalities. In the hybrid optoacoustic ultrasound (OPUS) combination, images retrieved by one modality may further be used to improve the reconstruction accuracy of the other. In this regard, image segmentation plays a major role as it can aid improving the image quality and quantification abilities by facilitating modeling of light and sound propagation through the imaged tissues and surrounding coupling medium. Here, we propose an automated approach for surface segmentation in whole-body mouse OPUS imaging using a deep convolutional neural network (CNN). The method has shown robust performance, attaining accurate segmentation of the animal boundary in both optoacoustic and pulse-echo ultrasound images, as evinced by quantitative performance evaluation using Dice coefficient metrics.
Collapse
|
23
|
Razansky D, Klohs J, Ni R. Multi-scale optoacoustic molecular imaging of brain diseases. Eur J Nucl Med Mol Imaging 2021; 48:4152-4170. [PMID: 33594473 PMCID: PMC8566397 DOI: 10.1007/s00259-021-05207-4] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 01/17/2021] [Indexed: 02/07/2023]
Abstract
The ability to non-invasively visualize endogenous chromophores and exogenous probes and sensors across the entire rodent brain with the high spatial and temporal resolution has empowered optoacoustic imaging modalities with unprecedented capacities for interrogating the brain under physiological and diseased conditions. This has rapidly transformed optoacoustic microscopy (OAM) and multi-spectral optoacoustic tomography (MSOT) into emerging research tools to study animal models of brain diseases. In this review, we describe the principles of optoacoustic imaging and showcase recent technical advances that enable high-resolution real-time brain observations in preclinical models. In addition, advanced molecular probe designs allow for efficient visualization of pathophysiological processes playing a central role in a variety of neurodegenerative diseases, brain tumors, and stroke. We describe outstanding challenges in optoacoustic imaging methodologies and propose a future outlook.
Collapse
Affiliation(s)
- Daniel Razansky
- Institute for Biomedical Engineering, University of Zurich & ETH Zurich, Wolfgang-Pauli-Strasse 27, HIT E42.1, 8093, Zurich, Switzerland
- Zurich Neuroscience Center (ZNZ), Zurich, Switzerland
- Faculty of Medicine and Institute of Pharmacology and Toxicology, University of Zurich, Zurich, Switzerland
| | - Jan Klohs
- Institute for Biomedical Engineering, University of Zurich & ETH Zurich, Wolfgang-Pauli-Strasse 27, HIT E42.1, 8093, Zurich, Switzerland
- Zurich Neuroscience Center (ZNZ), Zurich, Switzerland
| | - Ruiqing Ni
- Institute for Biomedical Engineering, University of Zurich & ETH Zurich, Wolfgang-Pauli-Strasse 27, HIT E42.1, 8093, Zurich, Switzerland.
- Zurich Neuroscience Center (ZNZ), Zurich, Switzerland.
- Institute for Regenerative Medicine, Uiversity of Zurich, Zurich, Switzerland.
| |
Collapse
|
24
|
Kratkiewicz K, Manwar R, Zhou Y, Mozaffarzadeh M, Avanaki K. Technical considerations in the Verasonics research ultrasound platform for developing a photoacoustic imaging system. BIOMEDICAL OPTICS EXPRESS 2021; 12:1050-1084. [PMID: 33680559 PMCID: PMC7901326 DOI: 10.1364/boe.415481] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/24/2020] [Revised: 12/23/2020] [Accepted: 12/23/2020] [Indexed: 05/20/2023]
Abstract
Photoacoustic imaging (PAI) is an emerging functional and molecular imaging technology that has attracted much attention in the past decade. Recently, many researchers have used the vantage system from Verasonics for simultaneous ultrasound (US) and photoacoustic (PA) imaging. This was the motivation to write on the details of US/PA imaging system implementation and characterization using Verasonics platform. We have discussed the experimental considerations for linear array based PAI due to its popularity, simple setup, and high potential for clinical translatability. Specifically, we describe the strategies of US/PA imaging system setup, signal generation, amplification, data processing and study the system performance.
Collapse
Affiliation(s)
- Karl Kratkiewicz
- Wayne State University, Department of
Biomedical Engineering, Detroit, MI 48201, USA
- These authors have contributed
equally
| | - Rayyan Manwar
- Richard and Loan Hill Department of
Bioengineering, University of Illinois at Chicago, IL 60607, USA
- These authors have contributed
equally
| | - Yang Zhou
- Wayne State University, Department of
Biomedical Engineering, Detroit, MI 48201, USA
| | - Moein Mozaffarzadeh
- Laboratory of Medical Imaging, Department
of Imaging Physics, Delft University of Technology, The Netherlands
| | - Kamran Avanaki
- Richard and Loan Hill Department of
Bioengineering, University of Illinois at Chicago, IL 60607, USA
| |
Collapse
|
25
|
Jeng GS, Li ML, Kim M, Yoon SJ, Pitre JJ, Li DS, Pelivanov I, O’Donnell M. Real-time interleaved spectroscopic photoacoustic and ultrasound (PAUS) scanning with simultaneous fluence compensation and motion correction. Nat Commun 2021; 12:716. [PMID: 33514737 PMCID: PMC7846772 DOI: 10.1038/s41467-021-20947-5] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2019] [Accepted: 12/22/2020] [Indexed: 02/06/2023] Open
Abstract
For over two decades photoacoustic imaging has been tested clinically, but successful human trials have been limited. To enable quantitative clinical spectroscopy, the fundamental issues of wavelength-dependent fluence variations and inter-wavelength motion must be overcome. Here we propose a real-time, spectroscopic photoacoustic/ultrasound (PAUS) imaging approach using a compact, 1-kHz rate wavelength-tunable laser. Instead of illuminating tissue over a large area, the fiber-optic delivery system surrounding an US array sequentially scans a narrow laser beam, with partial PA image reconstruction for each laser pulse. The final image is then formed by coherently summing partial images. This scheme enables (i) automatic compensation for wavelength-dependent fluence variations in spectroscopic PA imaging and (ii) motion correction of spectroscopic PA frames using US speckle tracking in real-time systems. The 50-Hz video rate PAUS system is demonstrated in vivo using a murine model of labelled drug delivery.
Collapse
Affiliation(s)
- Geng-Shi Jeng
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA ,grid.260539.b0000 0001 2059 7017Institute of Electronics, National Chiao Tung University, Hsinchu, Taiwan
| | - Meng-Lin Li
- grid.38348.340000 0004 0532 0580Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan ,grid.38348.340000 0004 0532 0580Institute of Photonics Technologies, National Tsing Hua University, Hsinchu, Taiwan
| | - MinWoo Kim
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| | - Soon Joon Yoon
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| | - John J. Pitre
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| | - David S. Li
- grid.34477.330000000122986657Department of Chemical Engineering, University of Washington, Seattle, WA USA
| | - Ivan Pelivanov
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| | - Matthew O’Donnell
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| |
Collapse
|
26
|
Li X, Zhang S, Wu J, Huang S, Feng Q, Qi L, Chen W. Multispectral Interlaced Sparse Sampling Photoacoustic Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:3463-3474. [PMID: 32746097 DOI: 10.1109/tmi.2020.2996240] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Multispectral photoacoustic tomography (PAT) is capable of resolving tissue chromophore distribution based on spectral un-mixing. It works by identifying the absorption spectrum variations from a sequence of photoacoustic images acquired at multiple illumination wavelengths. Due to multispectral acquisition, this inevitably creates a large dataset. To cut down the data volume, sparse sampling methods that reduce the number of detectors have been developed. However, image reconstruction of sparse sampling PAT is challenging because of insufficient angular coverage. During spectral un-mixing, these inaccurate reconstructions will further amplify imaging artefacts and contaminate the results. To solve this problem, we present the interlaced sparse sampling (ISS) PAT, a method that involved: 1) a novel scanning-based image acquisition scheme in which the sparse detector array rotates while switching illumination wavelength, such that a dense angular coverage could be achieved by using only a few detectors; and 2) a corresponding image reconstruction algorithm that makes use of an anatomical prior image created from the ISS strategy to guide PAT image computation. Reconstructed from the signals acquired at different wavelengths (angles), this self-generated prior image fuses multispectral and angular information, and thus has rich anatomical features and minimum artefacts. A specialized iterative imaging model that effectively incorporates this anatomical prior image into the reconstruction process is also developed. Simulation, phantom, and in vivo animal experiments showed that even under 1/6 or 1/8 sparse sampling rate, our method achieved comparable image reconstruction and spectral un-mixing results to those obtained by conventional dense sampling method.
Collapse
|
27
|
O’Kelly D, Guo Y, Mason RP. Evaluating online filtering algorithms to enhance dynamic multispectral optoacoustic tomography. PHOTOACOUSTICS 2020; 19:100184. [PMID: 32509522 PMCID: PMC7264082 DOI: 10.1016/j.pacs.2020.100184] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/24/2020] [Revised: 04/16/2020] [Accepted: 04/17/2020] [Indexed: 06/11/2023]
Abstract
Multispectral optoacoustic tomography (MSOT) is an emerging imaging modality, which is able to capture data at high spatiotemporal resolution using rapid tuning of the excitation laser wavelength. However, owing to the necessity of imaging one wavelength at a time to the exclusion of others, forming a complete multispectral image requires multiple excitations over time, which may introduce aliasing due to underlying spectral dynamics or noise in the data. In order to mitigate this limitation, we have applied kinematic α and α β filters to multispectral time series, providing an estimate of the underlying multispectral image at every point in time throughout data acquisition. We demonstrate the efficacy of these methods in suppressing the inter-frame noise present in dynamic multispectral image time courses using a multispectral Shepp-Logan phantom and mice bearing distinct renal cell carcinoma tumors. The gains in signal to noise ratio provided by these filters enable higher-fidelity downstream analysis such as spectral unmixing and improved hypothesis testing in quantifying the onset of signal changes during an oxygen gas challenge.
Collapse
Affiliation(s)
- Devin O’Kelly
- Department of Radiology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390-9058, USA
| | - Yihang Guo
- Department of Radiology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390-9058, USA
- Department of Gastrointestinal Surgery, The Third XiangYa Hospital of Central South University, Changsha, Hunan, 410013, China
| | - Ralph P. Mason
- Department of Radiology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390-9058, USA
| |
Collapse
|
28
|
Fadhel MN, Hysi E, Assi H, Kolios MC. Fluence-matching technique using photoacoustic radiofrequency spectra for improving estimates of oxygen saturation. PHOTOACOUSTICS 2020; 19:100182. [PMID: 32547922 PMCID: PMC7284135 DOI: 10.1016/j.pacs.2020.100182] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2019] [Revised: 03/30/2020] [Accepted: 04/07/2020] [Indexed: 05/24/2023]
Abstract
Photoacoustic (PA) signals encode information about the optical absorption and spatial distribution of absorbing chromophores as well as the light distribution in the medium. The wavelength dependence of the latter affects the accuracy in chromophore quantification, including estimations of oxygen saturation (sO2) with depth. We propose the use of the ratio of the PA radiofrequency (RF) spectral slopes (SS) at different optical wavelengths to generate frequency filters which can be used to match the fluence profiles across separate images generated with different optical wavelengths. Proof-of-principle experiments were carried on a plastic tube with blood of a known oxygenation inserted into a porcine tissue. The algorithm was tested in-vivo in the hind leg of six CD1 mice, each under three different breathing conditions (100 % O2, room air and 100 % CO2). Imaging was done using the VevoLAZR system at the wavelengths 720 and 870 nm. The SS was calculated from the linear fit of the ratio of the photoacoustic RF power spectra at the two wavelengths. An ultrasound frequency filter was designed and applied to each segmented PA signal in the frequency domain and inversely transformed into the time domain to correct for the differences in the fluence profiles at both wavelengths. Linear spectral unmixing was used to estimate sO2 before and after applying the ultrasound frequency filter. The estimated blood sO2 in the plastic tube for the porcine tissue experiment improved by 10.3% after applying the frequency filter when compared to the sO2 measured by a blood gas analyzer. For the in-vivo mouse experiments, the applied sO2 correction was 2.67, 1.33 and -3.33% for every mm of muscle tissue for mice breathing 100% O2, room air and 100% CO2, respectively. The approach presented here provides a new approach for fluence matching that can potentially improve the accuracy of sO2 estimates by removing the fluence depth dependence at different optical wavelengths.
Collapse
Affiliation(s)
- Muhannad N. Fadhel
- Ryerson University, Department of Physics, Toronto, Canada
- Institute for Biomedical Engineering, Science and Technology, Keenan Research Center, St. Michael’s Hospital, Toronto, Canada
| | - Eno Hysi
- Ryerson University, Department of Physics, Toronto, Canada
- Institute for Biomedical Engineering, Science and Technology, Keenan Research Center, St. Michael’s Hospital, Toronto, Canada
| | - Hisham Assi
- Ryerson University, Department of Physics, Toronto, Canada
- Institute for Biomedical Engineering, Science and Technology, Keenan Research Center, St. Michael’s Hospital, Toronto, Canada
| | - Michael C. Kolios
- Ryerson University, Department of Physics, Toronto, Canada
- Institute for Biomedical Engineering, Science and Technology, Keenan Research Center, St. Michael’s Hospital, Toronto, Canada
| |
Collapse
|
29
|
Kim M, Jeng GS, O’Donnell M, Pelivanov I. Correction of wavelength-dependent laser fluence in swept-beam spectroscopic photoacoustic imaging with a hand-held probe. PHOTOACOUSTICS 2020; 19:100192. [PMID: 32670789 PMCID: PMC7339128 DOI: 10.1016/j.pacs.2020.100192] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Revised: 05/16/2020] [Accepted: 05/16/2020] [Indexed: 05/11/2023]
Abstract
Recently, we demonstrated an integrated photoacoustic (PA) and ultrasound (PAUS) system using a kHz-rate wavelength-tunable laser and a swept-beam delivery approach. It irradiates a medium using a narrow laser beam swept at high repetition rate (∼1 kHz) over the desired imaging area, in contrast to the conventional PA approach using broad-beam illumination at a low repetition rate (10-50 Hz). Here, we present a method to correct the wavelength-dependent fluence distribution and demonstrate its performance in phantom studies using a conventional limited view/bandwidth hand-held US probe. We adopted analytic fluence models, extending diffusion theory for the case of a pencil beam obliquely incident on an optically homogenous turbid medium, and developed a robust method to estimate fluence attenuation in the medium using PA measurements acquired from multiple fiber-irradiation positions swept at a kHz rate. We conducted comprehensive simulation tests and phantom studies using well-known contrast-agents to validate the reliability of the fluence model and its spectral corrections.
Collapse
Affiliation(s)
- MinWoo Kim
- Department of Bioengineering, University of Washington, Seattle, WA, 98105, USA
| | - Geng-Shi Jeng
- Department of Electronics Engineering, National Chiao Tung University, Hsinchu 30010, Taiwan
| | - Matthew O’Donnell
- Department of Bioengineering, University of Washington, Seattle, WA, 98105, USA
| | - Ivan Pelivanov
- Department of Bioengineering, University of Washington, Seattle, WA, 98105, USA
| |
Collapse
|
30
|
Zhou X, Akhlaghi N, Wear KA, Garra BS, Pfefer TJ, Vogt WC. Evaluation of Fluence Correction Algorithms in Multispectral Photoacoustic Imaging. PHOTOACOUSTICS 2020; 19:100181. [PMID: 32405456 PMCID: PMC7210453 DOI: 10.1016/j.pacs.2020.100181] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/10/2020] [Revised: 04/03/2020] [Accepted: 04/07/2020] [Indexed: 05/07/2023]
Abstract
Multispectral photoacoustic imaging (MPAI) is a promising emerging diagnostic technology, but fluence artifacts can degrade device performance. Our goal was to develop well-validated phantom-based test methods for evaluating and comparing MPAI fluence correction algorithms, including a heuristic diffusion approximation, Monte Carlo simulations, and an algorithm we developed based on novel application of the diffusion dipole model (DDM). Phantoms simulated a range of breast-mimicking optical properties and contained channels filled with chromophore solutions (ink, hemoglobin, or copper sulfate) or connected to a previously developed blood flow circuit providing tunable oxygen saturation (SO2). The DDM algorithm achieved similar spectral recovery and SO2 measurement accuracy to Monte Carlo-based corrections with lower computational cost, potentially providing an accurate, real-time correction approach. Algorithms were sensitive to optical property uncertainty, but error was minimized by matching phantom albedo. The developed test methods may provide a foundation for standardized assessment of MPAI fluence correction algorithm performance.
Collapse
Affiliation(s)
- Xuewen Zhou
- Fischell Department of Bioengineering, University of Maryland, College Park, MD, 02742, United States
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States
| | - Nima Akhlaghi
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States
| | - Keith A. Wear
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States
| | - Brian S. Garra
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States
| | - T. Joshua Pfefer
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States
| | - William C. Vogt
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, United States
- Corresponding author.
| |
Collapse
|
31
|
Gehrung M, Tomaszewski M, McIntyre D, Disselhorst J, Bohndiek S. Co-registration of optoacoustic tomography and magnetic resonance imaging data from murine tumour models. PHOTOACOUSTICS 2020; 18:100147. [PMID: 32042588 PMCID: PMC6997898 DOI: 10.1016/j.pacs.2019.100147] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2019] [Revised: 09/26/2019] [Accepted: 11/08/2019] [Indexed: 05/11/2023]
Abstract
As optoacoustic tomography (OT) emerges as a mainstream pre-clinical imaging modality, understanding the relationship between optoacoustic and other imaging biomarkers in the context of the underlying tissue biology becomes vitally important. Complementary insight into tumour vasculature and hypoxia can be gained using OT alongside magnetic resonance imaging (MRI)-based techniques. To evaluate the relationship between these metrics and the relative performance of the two modalities in assessment of tumour physiology, co-registration of their output imaging data is required. Unfortunately, this poses a significant challenge due to differences in animal positioning during imaging. Here, we present an integrated framework for registration of OT and MR image data in mice. Our framework combines a novel MR animal holder, to improve animal positioning during imaging, and a landmark-based software co-registration algorithm. We demonstrate that our protocol significantly improves registration of both body and tumour contours between these modalities, enabling more precise multi-modal tumour characterisation.
Collapse
Affiliation(s)
- Marcel Gehrung
- Department of Physics, University of Cambridge, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, UK
- Werner Siemens Imaging Center, Preclinical Imaging and Radiopharmacy, University of Tuebingen, Germany
| | - Michal Tomaszewski
- Department of Physics, University of Cambridge, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, UK
| | | | - Jonathan Disselhorst
- Werner Siemens Imaging Center, Preclinical Imaging and Radiopharmacy, University of Tuebingen, Germany
| | - Sarah Bohndiek
- Department of Physics, University of Cambridge, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, UK
| |
Collapse
|
32
|
Buchmann J, Kaplan B, Powell S, Prohaska S, Laufer J. Quantitative PA tomography of high resolution 3-D images: Experimental validation in a tissue phantom. PHOTOACOUSTICS 2020; 17:100157. [PMID: 31956487 PMCID: PMC6961715 DOI: 10.1016/j.pacs.2019.100157] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Revised: 11/29/2019] [Accepted: 12/05/2019] [Indexed: 05/18/2023]
Abstract
Quantitative photoacoustic tomography aims to recover the spatial distribution of absolute chromophore concentrations and their ratios from deep tissue, high-resolution images. In this study, a model-based inversion scheme based on a Monte-Carlo light transport model is experimentally validated on 3-D multispectral images of a tissue phantom acquired using an all-optical scanner with a planar detection geometry. A calibrated absorber allowed scaling of the measured data during the inversion, while an acoustic correction method was employed to compensate the effects of limited view detection. Chromophore- and fluence-dependent step sizes and Adam optimization were implemented to achieve rapid convergence. High resolution 3-D maps of absolute concentrations and their ratios were recovered with high accuracy. Potential applications of this method include quantitative functional and molecular photoacoustic tomography of deep tissue in preclinical and clinical studies.
Collapse
Affiliation(s)
- Jens Buchmann
- Institut für Physik, Martin-Luther-Universität Halle-Wittenberg, von-Danckelmann-Platz 3, 06120 Halle (Saale), Germany
- Institut für Optik und Atomare Physik, Technische Universität Berlin, Straße des 17, Juni 135, 10623 Berlin, Germany
| | - Bernhard Kaplan
- Visual Data Analysis, Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany
| | - Samuel Powell
- Optics and Photonics Group, Faculty of Engineering, University of Nottingham, University Park, Nottingham NG7 2RD, United Kingdom
| | - Steffen Prohaska
- Visual Data Analysis, Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany
| | - Jan Laufer
- Institut für Physik, Martin-Luther-Universität Halle-Wittenberg, von-Danckelmann-Platz 3, 06120 Halle (Saale), Germany
- Corresponding author.
| |
Collapse
|
33
|
Rich LJ, Chamberlain SR, Falcone DR, Bruce R, Heinmiller A, Xia J, Seshadri M. Performance Characteristics of Photoacoustic Imaging Probes with Varying Frequencies and Light-delivery Schemes. ULTRASONIC IMAGING 2019; 41:319-335. [PMID: 31570083 PMCID: PMC7042667 DOI: 10.1177/0161734619879043] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
Photoacoustic imaging (PAI) is an emerging biomedical imaging technique that utilizes a combination of light and ultrasound to detect photoabsorbers embedded within tissues. While the clinical utility of PAI has been widely explored for several applications, limitations in light penetration and detector sensitivity have restricted these studies to mostly superficial sites. Given the importance of PA signal generation and detection on light delivery and ultrasound detector frequency, there is an ongoing effort to optimize these parameters to enhance photoabsorber detection at increased depths. With this in mind, in this study we examined performance benchmarks of a commercially available PAI/ultrasound linear array system when using different imaging frequencies and light delivery schemes. A modified light fiber jacket providing focused light delivery (FLD) at the center of the probe was compared with the built-in fiber optics lining the length of the probe. Studies were performed in vitro to compare performance characteristics such as imaging resolution, maximum imaging depth, and sensitivity to varying hematocrit concentration for each frequency and light delivery method. Monte Carlo simulations of each light delivery method revealed increased light penetration with FLD. In tissue-mimicking phantoms, vascular channels used to simulate blood vessels could be visualized at a depth of 2.4 cm when lowering imaging frequency and utilizing FLD. Imaging at lower frequencies with FLD also enabled enhanced detection of varying hematocrit concentration levels at increased depths, although lateral imaging resolution was reduced. Finally, a proof of concept in vivo probe comparison study in a mouse tumor model provided supportive evidence of our in vitro results. Collectively, our findings show that adjusting imaging frequency and applying FLD can be a straightforward approach for improving PAI performance.
Collapse
Affiliation(s)
- Laurie J Rich
- Laboratory for Translational Imaging, Department of Molecular and Cellular Biophysics and Biochemistry, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA
- Department of Oral Oncology, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA
| | - Sarah R Chamberlain
- Laboratory for Translational Imaging, Department of Molecular and Cellular Biophysics and Biochemistry, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA
| | - Daniela R Falcone
- Department of Oral Oncology, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA
| | - Robert Bruce
- Department of Oral Oncology, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA
- Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, State University of New York, NY, USA
| | | | - Jun Xia
- Department of Biomedical Engineering, Jacobs School of Medicine & Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
| | - Mukund Seshadri
- Laboratory for Translational Imaging, Department of Molecular and Cellular Biophysics and Biochemistry, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA
- Department of Oral Oncology, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA
| |
Collapse
|
34
|
Gehrung M, Bohndiek SE, Brunker J. Development of a blood oxygenation phantom for photoacoustic tomography combined with online pO2 detection and flow spectrometry. JOURNAL OF BIOMEDICAL OPTICS 2019; 24:1-11. [PMID: 31625321 PMCID: PMC7005535 DOI: 10.1117/1.jbo.24.12.121908] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/03/2019] [Accepted: 09/09/2019] [Indexed: 05/07/2023]
Abstract
Photoacoustic tomography (PAT) is intrinsically sensitive to blood oxygen saturation (sO2) in vivo. However, making accurate sO2 measurements without knowledge of tissue- and instrumentation-related correction factors is extremely challenging. We have developed a low-cost flow phantom to facilitate validation of PAT systems. The phantom is composed of a flow circuit of tubing partially embedded within a tissue-mimicking material, with independent sensors providing online monitoring of the optical absorption spectrum and partial pressure of oxygen in the tube. We first test the flow phantom using two small molecule dyes that are frequently used for photoacoustic imaging: methylene blue and indocyanine green. We then demonstrate the potential of the phantom for evaluating sO2 using chemical oxygenation and deoxygenation of blood in the circuit. Using this dynamic assessment of the photoacoustic sO2 measurement in phantoms in relation to a ground truth, we explore the influence of multispectral processing and spectral coloring on accurate assessment of sO2. Future studies could exploit this low-cost dynamic flow phantom to validate fluence correction algorithms and explore additional blood parameters such as pH and also absorptive and other properties of different fluids.
Collapse
Affiliation(s)
- Marcel Gehrung
- Cancer Research UK Cambridge Institute, Li Ka-Shing Centre, Cambridge, United Kingdom
- University of Cambridge, Department of Physics, Cambridge, United Kingdom
| | - Sarah E. Bohndiek
- Cancer Research UK Cambridge Institute, Li Ka-Shing Centre, Cambridge, United Kingdom
- University of Cambridge, Department of Physics, Cambridge, United Kingdom
| | - Joanna Brunker
- Cancer Research UK Cambridge Institute, Li Ka-Shing Centre, Cambridge, United Kingdom
- University of Cambridge, Department of Physics, Cambridge, United Kingdom
| |
Collapse
|
35
|
Deán-Ben XL, Razansky D. Optoacoustic image formation approaches-a clinical perspective. Phys Med Biol 2019; 64:18TR01. [PMID: 31342913 DOI: 10.1088/1361-6560/ab3522] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
Clinical translation of optoacoustic imaging is fostered by the rapid technical advances in imaging performance as well as the growing number of clinicians recognizing the immense diagnostic potential of this technology. Clinical optoacoustic systems are available in multiple configurations, including hand-held and endoscopic probes as well as raster-scan approaches. The hardware design must be adapted to the accessible portion of the imaged region and other application-specific requirements pertaining the achievable depth, field of view or spatio-temporal resolution. Equally important is the adequate choice of the signal and image processing approach, which is largely responsible for the resulting imaging performance. Thus, new image reconstruction algorithms are constantly evolving in parallel to the newly-developed set-ups. This review focuses on recent progress on optoacoustic image formation algorithms and processing methods in the clinical setting. Major reconstruction challenges include real-time image rendering in two and three dimensions, efficient hybridization with other imaging modalitites as well as accurate interpretation and quantification of bio-markers, herein discussed in the context of ongoing progress in clinical translation.
Collapse
Affiliation(s)
- Xosé Luís Deán-Ben
- Faculty of Medicine and Institute of Pharmacology and Toxicology, University of Zurich, Zurich, Switzerland. Department of Information Technology and Electrical Engineering and Institute for Biomedical Engineering, ETH Zurich, Zurich, Switzerland
| | | |
Collapse
|
36
|
Iskander-Rizk S, van der Steen AFW, van Soest G. Photoacoustic imaging for guidance of interventions in cardiovascular medicine. Phys Med Biol 2019; 64:16TR01. [PMID: 31048573 DOI: 10.1088/1361-6560/ab1ede] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Imaging guidance is paramount to procedural success in minimally invasive interventions. Catheter-based therapies are the standard of care in the treatment of many cardiac disorders, including coronary artery disease, structural heart disease and electrophysiological conditions. Many of these diseases are caused by, or effect, a change in vasculature or cardiac tissue composition, which can potentially be detected by photoacoustic imaging. This review summarizes the state of the art in photoacoustic imaging approaches that have been proposed for intervention guidance in cardiovascular care. All of these techniques are currently in the preclinical phase. We will conclude with an outlook towards clinical applications.
Collapse
Affiliation(s)
- Sophinese Iskander-Rizk
- Department of Cardiology, Biomedical Engineering, Erasmus MC University Medical Center Rotterdam, Wytemaweg 80, 3015 CN Rotterdam, The Netherlands
| | | | | |
Collapse
|
37
|
Brown E, Brunker J, Bohndiek SE. Photoacoustic imaging as a tool to probe the tumour microenvironment. Dis Model Mech 2019; 12:12/7/dmm039636. [PMID: 31337635 PMCID: PMC6679374 DOI: 10.1242/dmm.039636] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
The tumour microenvironment (TME) is a complex cellular ecosystem subjected to chemical and physical signals that play a role in shaping tumour heterogeneity, invasion and metastasis. Studying the roles of the TME in cancer progression would strongly benefit from non-invasive visualisation of the tumour as a whole organ in vivo, both preclinically in mouse models of the disease, as well as in patient tumours. Although imaging techniques exist that can probe different facets of the TME, they face several limitations, including limited spatial resolution, extended scan times and poor specificity from confounding signals. Photoacoustic imaging (PAI) is an emerging modality, currently in clinical trials, that has the potential to overcome these limitations. Here, we review the biological properties of the TME and potential of existing imaging methods that have been developed to analyse these properties non-invasively. We then introduce PAI and explore the preclinical and clinical evidence that support its use in probing multiple features of the TME simultaneously, including blood vessel architecture, blood oxygenation, acidity, extracellular matrix deposition, lipid concentration and immune cell infiltration. Finally, we highlight the future prospects and outstanding challenges in the application of PAI as a tool in cancer research and as part of a clinical oncologist's arsenal. Summary: This Review details the potential of photoacoustic imaging to visualise features of the tumour microenvironment such as blood vessels, hypoxia, fibrosis and immune infiltrate to provide unprecedented insight into tumour biology.
Collapse
Affiliation(s)
- Emma Brown
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK.,Cancer Research UK Cambridge Institute, University of Cambridge, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, UK
| | - Joanna Brunker
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK.,Cancer Research UK Cambridge Institute, University of Cambridge, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, UK
| | - Sarah E Bohndiek
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK .,Cancer Research UK Cambridge Institute, University of Cambridge, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, UK
| |
Collapse
|
38
|
Prakash J, Mandal S, Razansky D, Ntziachristos V. Maximum Entropy Based Non-Negative Optoacoustic Tomographic Image Reconstruction. IEEE Trans Biomed Eng 2019; 66:2604-2616. [PMID: 30640596 DOI: 10.1109/tbme.2019.2892842] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Optoacoustic (photoacoustic) tomography is aimed at reconstructing maps of the initial pressure rise induced by the absorption of light pulses in tissue. In practice, due to inaccurate assumptions in the forward model, noise, and other experimental factors, the images are often afflicted by artifacts, occasionally manifested as negative values. The aim of this work is to develop an inversion method which reduces the occurrence of negative values and improves the quantitative performance of optoacoustic imaging. METHODS We present a novel method for optoacoustic tomography based on an entropy maximization algorithm, which uses logarithmic regularization for attaining non-negative reconstructions. The reconstruction image quality is further improved using structural prior-based fluence correction. RESULTS We report the performance achieved by the entropy maximization scheme on numerical simulation, experimental phantoms, and in-vivo samples. CONCLUSION The proposed algorithm demonstrates superior reconstruction performance by delivering non-negative pixel values with no visible distortion of anatomical structures. SIGNIFICANCE Our method can enable quantitative optoacoustic imaging, and has the potential to improve preclinical and translational imaging applications.
Collapse
|
39
|
Cherkashin MN, Brenner C, Hofmann MR. High-resolution 3D light fluence mapping for heterogeneous scattering media by localized sampling. APPLIED OPTICS 2018; 57:10441-10448. [PMID: 30645387 DOI: 10.1364/ao.57.010441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2018] [Accepted: 11/13/2018] [Indexed: 06/09/2023]
Abstract
We demonstrate an innovative concept for three-dimensional optical fluence mapping in heterogeneous highly scattering media as, e.g., biomedical tissues. We propose to use the relative light extinction analysis principle together with a miniaturized collection fiber in a direct fluence measurement setup as a method to obtain the spatially resolved light intensity distribution under transversally inhomogeneous light propagation conditions and provide local characterization of the transport medium. System performance is validated in two extreme conditions: an optically thin scattering medium and an absorption-dominated light transport. Both extremes demonstrate good agreement to theoretical expectations. Finally, we successfully prove the ability of the system to deliver high-resolution fluence maps through a model study of the light distribution induced in a scattering medium by a vertical diode laser stack with individual bars pitched only 500 μm apart.
Collapse
|
40
|
Stammes MA, Bugby SL, Porta T, Pierzchalski K, Devling T, Otto C, Dijkstra J, Vahrmeijer AL, de Geus-Oei LF, Mieog JSD. Modalities for image- and molecular-guided cancer surgery. Br J Surg 2018; 105:e69-e83. [PMID: 29341161 DOI: 10.1002/bjs.10789] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2017] [Revised: 10/25/2017] [Accepted: 11/05/2017] [Indexed: 12/19/2022]
Abstract
BACKGROUND Surgery is the cornerstone of treatment for many solid tumours. A wide variety of imaging modalities are available before surgery for staging, although surgeons still rely primarily on visual and haptic cues in the operating environment. Image and molecular guidance might improve the adequacy of resection through enhanced tumour definition and detection of aberrant deposits. Intraoperative modalities available for image- and molecular-guided cancer surgery are reviewed here. METHODS Intraoperative cancer detection techniques were identified through a systematic literature search, with selection of peer-reviewed publications from January 2012 to January 2017. Modalities were reviewed, described and compared according to 25 predefined characteristics. To summarize the data in a comparable way, a three-point rating scale was applied to quantitative characteristics. RESULTS The search identified ten image- and molecular-guided surgery techniques, which can be divided into four groups: conventional, optical, nuclear and endogenous reflectance modalities. Conventional techniques are the most well known imaging modalities, but unfortunately have the drawback of a defined resolution and long acquisition time. Optical imaging is a real-time modality; however, the penetration depth is limited. Nuclear modalities have excellent penetration depth, but their intraoperative use is limited by the use of radioactivity. Endogenous reflectance modalities provide high resolution, although with a narrow field of view. CONCLUSION Each modality has its strengths and weaknesses; no single technique will be suitable for all surgical procedures. Strict selection of modalities per cancer type and surgical requirements is required as well as combining techniques to find the optimal balance.
Collapse
Affiliation(s)
- M A Stammes
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands.,Percuros, Enschede, The Netherlands
| | - S L Bugby
- Space Research Centre, Department of Physics and Astronomy, University of Leicester, Leicester, UK
| | - T Porta
- Maastricht MultiModal Molecular Imaging Institute (M4I), Division of Imaging Mass Spectrometry, Maastricht University, Maastricht, The Netherlands
| | - K Pierzchalski
- Maastricht MultiModal Molecular Imaging Institute (M4I), Division of Imaging Mass Spectrometry, Maastricht University, Maastricht, The Netherlands
| | | | - C Otto
- Medical Cell Bio Physics, University of Twente, Enschede, The Netherlands
| | - J Dijkstra
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands
| | - A L Vahrmeijer
- Department of Surgery, Leiden University Medical Centre, Leiden, The Netherlands
| | - L-F de Geus-Oei
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands.,Biomedical Photonic Imaging Group, MIRA Institute, University of Twente, Enschede, The Netherlands
| | - J S D Mieog
- Department of Surgery, Leiden University Medical Centre, Leiden, The Netherlands
| |
Collapse
|
41
|
Yoon H, Luke GP, Emelianov SY. Impact of depth-dependent optical attenuation on wavelength selection for spectroscopic photoacoustic imaging. PHOTOACOUSTICS 2018; 12:46-54. [PMID: 30364441 PMCID: PMC6197329 DOI: 10.1016/j.pacs.2018.10.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2017] [Revised: 10/02/2018] [Accepted: 10/05/2018] [Indexed: 05/02/2023]
Abstract
An optical wavelength selection method based on the stability of the absorption cross-section matrix to improve spectroscopic photoacoustic (sPA) imaging was recently introduced. However, spatially-varying chromophore concentrations cause the wavelength- and depth-dependent variations of the optical fluence, which degrades the accuracy of quantitative sPA imaging. This study introduces a depth-optimized method that determines an optimal wavelength set minimizing an inverse of the multiplication of absorption cross-section matrix and fluence matrix to minimize the errors in concentration estimation. This method assumes that the optical fluence distribution is known or can be attained otherwise. We used a Monte Carlo simulation of light propagation in tissue with various depths and concentrations of deoxy-/oxy-hemoglobin. We quantitatively compared the developed and current approaches, indicating that the choice of wavelength is critical and our approach is effective especially when quantifying deeper imaging targets.
Collapse
Affiliation(s)
- Heechul Yoon
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, United States
| | - Geoffrey P. Luke
- Thayer School of Engineering, Dartmouth College, Hanover, NH, 03755, United States
| | - Stanislav Y. Emelianov
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, United States
- The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University School of Medicine, Atlanta, GA, 30332, United States
| |
Collapse
|
42
|
Tomaszewski MR, Gehrung M, Joseph J, Quiros-Gonzalez I, Disselhorst JA, Bohndiek SE. Oxygen-Enhanced and Dynamic Contrast-Enhanced Optoacoustic Tomography Provide Surrogate Biomarkers of Tumor Vascular Function, Hypoxia, and Necrosis. Cancer Res 2018; 78:5980-5991. [PMID: 30115696 DOI: 10.1158/0008-5472.can-18-1033] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Revised: 05/22/2018] [Accepted: 08/13/2018] [Indexed: 11/16/2022]
Abstract
Measuring the functional status of tumor vasculature, including blood flow fluctuations and changes in oxygenation, is important in cancer staging and therapy monitoring. Current clinically approved imaging modalities suffer long procedure times and limited spatiotemporal resolution. Optoacoustic tomography (OT) is an emerging clinical imaging modality that may overcome these challenges. By acquiring data at multiple wavelengths, OT can interrogate hemoglobin concentration and oxygenation directly and resolve contributions from injected contrast agents. In this study, we tested whether two dynamic OT techniques, oxygen-enhanced (OE) and dynamic contrast-enhanced (DCE)-OT, could provide surrogate biomarkers of tumor vascular function, hypoxia, and necrosis. We found that vascular maturity led to changes in vascular function that affected tumor perfusion, modulating the DCE-OT signal. Perfusion in turn regulated oxygen availability, driving the OE-OT signal. In particular, we demonstrate for the first time a strong per-tumor and spatial correlation between imaging biomarkers derived from these in vivo techniques and tumor hypoxia quantified ex vivo Our findings indicate that OT may offer a significant advantage for localized imaging of tumor response to vascular-targeted therapies when compared with existing clinical DCE methods.Significance: Imaging biomarkers derived from optoacoustic tomography can be used as surrogate measures of tumor perfusion and hypoxia, potentially yielding rapid, multiparametric, and noninvasive cancer staging and therapeutic response monitoring in the clinic.Graphical Abstract: http://cancerres.aacrjournals.org/content/canres/78/20/5980/F1.large.jpg Cancer Res; 78(20); 5980-91. ©2018 AACR.
Collapse
Affiliation(s)
- Michal R Tomaszewski
- Department of Physics, University of Cambridge, Cambridge, United Kingdom
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, United Kingdom
| | - Marcel Gehrung
- Department of Physics, University of Cambridge, Cambridge, United Kingdom
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, United Kingdom
- Werner Siemens Imaging Center, Preclinical Imaging and Radiopharmacy, University of Tuebingen, Tuebingen, Germany
| | - James Joseph
- Department of Physics, University of Cambridge, Cambridge, United Kingdom
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, United Kingdom
| | - Isabel Quiros-Gonzalez
- Department of Physics, University of Cambridge, Cambridge, United Kingdom
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, United Kingdom
| | - Jonathan A Disselhorst
- Werner Siemens Imaging Center, Preclinical Imaging and Radiopharmacy, University of Tuebingen, Tuebingen, Germany
| | - Sarah E Bohndiek
- Department of Physics, University of Cambridge, Cambridge, United Kingdom.
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, United Kingdom
| |
Collapse
|
43
|
The Progress in Photoacoustic and Laser Ultrasonic Tomographic Imaging for Biomedicine and Industry: A Review. APPLIED SCIENCES-BASEL 2018. [DOI: 10.3390/app8101931] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The current paper reviews a set of principles and applications of photoacoustic and laser ultrasonic imaging, developed in the Laser Optoacoustic Laboratories of ILIT RAS, NUST MISiS, and ILC MSU. These applications include combined photoacoustic and laser ultrasonic imaging for biological objects, and tomographic laser ultrasonic imaging of solids. Principles, algorithms, resolution of the developed methods, and related problems are discussed. The review is written in context of the current state-of-art of photoacoustic and laser ultrasonic imaging.
Collapse
|
44
|
Newton AD, Predina JD, Nie S, Low PS, Singhal S. Intraoperative fluorescence imaging in thoracic surgery. J Surg Oncol 2018; 118:344-355. [PMID: 30098293 DOI: 10.1002/jso.25149] [Citation(s) in RCA: 45] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2018] [Accepted: 06/04/2018] [Indexed: 12/19/2022]
Abstract
Intraoperative fluorescence imaging (IFI) can improve real-time identification of cancer cells during an operation. Phase I clinical trials in thoracic surgery have demonstrated that IFI with second window indocyanine green (TumorGlow® ) can identify subcentimeter pulmonary nodules, anterior mediastinal masses, and mesothelioma, while the use of a folate receptor-targeted near-infrared agent, OTL38, can improve the specificity for diagnosing tumors with folate receptor expression. Here, we review the existing preclinical and clinical data on IFI in thoracic surgery.
Collapse
Affiliation(s)
- Andrew D Newton
- Department of Surgery, University of Pennsylvania, Perelman School of Medicine, Philadelphia, Pennsylvania
| | - Jarrod D Predina
- Department of Surgery, University of Pennsylvania, Perelman School of Medicine, Philadelphia, Pennsylvania
| | - Shuming Nie
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, Illinois
| | - Philip S Low
- Department of Chemistry, Purdue University, West Lafayette, Indiana
| | - Sunil Singhal
- Department of Surgery, University of Pennsylvania, Perelman School of Medicine, Philadelphia, Pennsylvania
| |
Collapse
|
45
|
Yao J, Wang LV. Recent progress in photoacoustic molecular imaging. Curr Opin Chem Biol 2018; 45:104-112. [PMID: 29631120 PMCID: PMC6076847 DOI: 10.1016/j.cbpa.2018.03.016] [Citation(s) in RCA: 59] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2018] [Revised: 03/24/2018] [Accepted: 03/27/2018] [Indexed: 01/08/2023]
Abstract
By acoustically detecting the optical absorption contrast, photoacoustic (PA) tomography (PAT) has broken the penetration limits of traditional high-resolution optical imaging. Through spectroscopic analysis of the target's optical absorption, PAT can identify a wealth of endogenous and exogenous molecules and thus is inherently capable of molecular imaging with high sensitivity. PAT's molecular sensitivity is uniquely accompanied by non-ionizing radiation, high spatial resolution, and deep penetration in biological tissues, which other optical imaging modalities cannot achieve yet. In this concise review, we summarize the most recent technological advancements in PA molecular imaging and highlight the novel molecular probes specifically made for PAT in deep tissues. We conclude with a brief discussion of the opportunities for future advancements.
Collapse
Affiliation(s)
- Junjie Yao
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA.
| | - Lihong V Wang
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA.
| |
Collapse
|
46
|
Cai C, Deng K, Ma C, Luo J. End-to-end deep neural network for optical inversion in quantitative photoacoustic imaging. OPTICS LETTERS 2018; 43:2752-2755. [PMID: 29905680 DOI: 10.1364/ol.43.002752] [Citation(s) in RCA: 67] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
An end-to-end deep neural network, ResU-net, is developed for quantitative photoacoustic imaging. A residual learning framework is used to facilitate optimization and to gain better accuracy from considerably increased network depth. The contracting and expanding paths enable ResU-net to extract comprehensive context information from multispectral initial pressure images and, subsequently, to infer a quantitative image of chromophore concentration or oxygen saturation (sO2). According to our numerical experiments, the estimations of sO2 and indocyanine green concentration are accurate and robust against variations in both optical property and object geometry. An extremely short reconstruction time of 22 ms is achieved.
Collapse
|
47
|
Napp J, Stammes MA, Claussen J, Prevoo HA, Sier CF, Hoeben FJ, Robillard MS, Vahrmeijer AL, Devling T, Chan AB, de Geus-Oei LF, Alves F. Fluorescence- and multispectral optoacoustic imaging for an optimized detection of deeply located tumors in an orthotopic mouse model of pancreatic carcinoma. Int J Cancer 2018; 142:2118-2129. [DOI: 10.1002/ijc.31236] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2017] [Revised: 12/04/2017] [Accepted: 12/14/2017] [Indexed: 01/30/2023]
Affiliation(s)
- Joanna Napp
- Institute of Interventional and Diagnostic Radiology, University Medical Center Göttingen; Göttingen Lower Saxony Germany
- Clinic of Haematology and Medical Oncology; University Medical Center Göttingen; Göttingen Lower Saxony Germany
- Translational Molecular Imaging, Max-Planck-Institute of Experimental Medicine; Göttingen Lower Saxony Germany
| | - Marieke A. Stammes
- Percuros B.V., AE Enschede; The Netherlands
- Department of Radiology; Leiden University Medical Center; RC Leiden The Netherlands
| | - Jing Claussen
- iThera Medical GmbH, Zielstattstrasse; Munich Germany
| | | | | | | | - Marc S. Robillard
- Tagworks Pharmaceuticals, Geert Grooteplein Zuid 10; GA Nijmegen The Netherlands
| | | | - Tim Devling
- iThera Medical GmbH, Zielstattstrasse; Munich Germany
| | | | - Lioe-Fee de Geus-Oei
- Department of Radiology; Leiden University Medical Center; RC Leiden The Netherlands
- Biomedical Photonic Imaging Group, MIRA Institute, University of Twente; AE Enschede The Netherlands
| | - Frauke Alves
- Institute of Interventional and Diagnostic Radiology, University Medical Center Göttingen; Göttingen Lower Saxony Germany
- Clinic of Haematology and Medical Oncology; University Medical Center Göttingen; Göttingen Lower Saxony Germany
- Translational Molecular Imaging, Max-Planck-Institute of Experimental Medicine; Göttingen Lower Saxony Germany
| |
Collapse
|
48
|
An L, Saratoon T, Fonseca M, Ellwood R, Cox B. Statistical independence in nonlinear model-based inversion for quantitative photoacoustic tomography. BIOMEDICAL OPTICS EXPRESS 2017; 8:5297-5310. [PMID: 29188121 PMCID: PMC5695971 DOI: 10.1364/boe.8.005297] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/07/2017] [Revised: 09/26/2017] [Accepted: 09/26/2017] [Indexed: 06/07/2023]
Abstract
The statistical independence between the distributions of different chromophores in tissue has previously been used for linear unmixing with independent component analysis (ICA). In this study, we propose exploiting this statistical property in a nonlinear model-based inversion method. The aim is to reduce the sensitivity of the inversion scheme to errors in the modelling of the fluence, and hence provide more accurate quantification of the concentration of independent chromophores. A gradient-based optimisation algorithm is used to minimise the error functional, which includes a term representing the mutual information between the chromophores in addition to the standard least-squares data error. Both numerical simulations and an experimental phantom study are conducted to demonstrate that, in the presence of experimental errors in the fluence model, the proposed inversion method results in more accurate estimation of the concentrations of independent chromophores compared to the standard model-based inversion.
Collapse
Affiliation(s)
- Lu An
- Department of Medical Physics and Biomedical Engineering, University College London, Gower Street, WC1E 6BT,
UK
| | - Teedah Saratoon
- Department of Medical Physics and Biomedical Engineering, University College London, Gower Street, WC1E 6BT,
UK
| | - Martina Fonseca
- Department of Medical Physics and Biomedical Engineering, University College London, Gower Street, WC1E 6BT,
UK
| | - Robert Ellwood
- Department of Medical Physics and Biomedical Engineering, University College London, Gower Street, WC1E 6BT,
UK
| | - Ben Cox
- Department of Medical Physics and Biomedical Engineering, University College London, Gower Street, WC1E 6BT,
UK
| |
Collapse
|
49
|
Mitcham T, Taghavi H, Long J, Wood C, Fuentes D, Stefan W, Ward J, Bouchard R. Photoacoustic-based sO 2 estimation through excised bovine prostate tissue with interstitial light delivery. PHOTOACOUSTICS 2017; 7:47-56. [PMID: 28794990 PMCID: PMC5540703 DOI: 10.1016/j.pacs.2017.06.004] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2017] [Revised: 06/21/2017] [Accepted: 06/27/2017] [Indexed: 05/08/2023]
Abstract
Photoacoustic (PA) imaging is capable of probing blood oxygen saturation (sO2), which has been shown to correlate with tissue hypoxia, a promising cancer biomarker. However, wavelength-dependent local fluence changes can compromise sO2 estimation accuracy in tissue. This work investigates using PA imaging with interstitial irradiation and local fluence correction to assess precision and accuracy of sO2 estimation of blood samples through ex vivo bovine prostate tissue ranging from 14% to 100% sO2. Study results for bovine blood samples at distances up to 20 mm from the irradiation source show that local fluence correction improved average sO2 estimation error from 16.8% to 3.2% and maintained an average precision of 2.3% when compared to matched CO-oximeter sO2 measurements. This work demonstrates the potential for future clinical translation of using fluence-corrected and interstitially driven PA imaging to accurately and precisely assess sO2 at depth in tissue with high resolution.
Collapse
Affiliation(s)
- Trevor Mitcham
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center, UTHealth Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Houra Taghavi
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - James Long
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Cayla Wood
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center, UTHealth Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - David Fuentes
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center, UTHealth Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Wolfgang Stefan
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - John Ward
- Department of Urology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Richard Bouchard
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center, UTHealth Graduate School of Biomedical Sciences, Houston, TX 77030, USA
- Corresponding author at: Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA.
| |
Collapse
|
50
|
Wang Y, He J, Li J, Lu T, Li Y, Ma W, Zhang L, Zhou Z, Zhao H, Gao F. Toward whole-body quantitative photoacoustic tomography of small-animals with multi-angle light-sheet illuminations. BIOMEDICAL OPTICS EXPRESS 2017; 8:3778-3795. [PMID: 28856049 PMCID: PMC5560840 DOI: 10.1364/boe.8.003778] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/01/2017] [Revised: 07/14/2017] [Accepted: 07/19/2017] [Indexed: 05/31/2023]
Abstract
Several attempts to achieve the quantitative photoacoustic tomography (q-PAT) have been investigated using point sources or a single-angle wide-field illumination. However, these schemes normally suffer from low signal-to-noise ratio (SNR) or poor quantification in imaging applications on large-size domains, due to the limitation of ANSI-safety incidence and incompleteness in the data acquisition. We herein present a q-PAT implementation that uses multi-angle light-sheet illuminations and calibrated recovering-and-averaging iterations. The scheme can obtain more complete information on the intrinsic absorption from the multi-angle illumination mode, and collect SNR-boosted photoacoustic signals in the selected planes from the wide-field light-sheet excitation. Therefore, the sliced absorption maps over whole body of small-animals can be recovered in a measurement-flexible, noise-robust and computation-economic way. The proposed approach is validated by phantom, ex vivo and in vivo experiments, exhibiting promising performances in image fidelity and quantitative accuracy for practical applications.
Collapse
Affiliation(s)
- Yihan Wang
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Jie He
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Jiao Li
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| | - Tong Lu
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Yong Li
- Cancer Institute and Hospital, Tianjin Medical University, Tianjin 300060, China
| | - Wenjuan Ma
- Cancer Institute and Hospital, Tianjin Medical University, Tianjin 300060, China
| | - Limin Zhang
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| | - Zhongxing Zhou
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| | - Huijuan Zhao
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| | - Feng Gao
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| |
Collapse
|