1
|
Wang S, Huang B, Chan SC, Tsang VT, Wong TT. Tri-modality in vivo imaging for tumor detection with combined ultrasound, photoacoustic, and photoacoustic elastography. PHOTOACOUSTICS 2024; 38:100630. [PMID: 39040971 PMCID: PMC11261081 DOI: 10.1016/j.pacs.2024.100630] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 06/14/2024] [Accepted: 06/24/2024] [Indexed: 07/24/2024]
Abstract
A comprehensive understanding of a tumor is required for accurate diagnosis and effective treatment. However, currently, there is no single imaging modality that can provide sufficient information. Photoacoustic (PA) imaging is a hybrid imaging technique with high spatial resolution and detection sensitivity, which can be combined with ultrasound (US) imaging to provide both optical and acoustic contrast. Elastography can noninvasively map the elasticity distribution of biological tissue, which reflects pathological conditions. In this study, we incorporated PA elastography into a commercial US/PA imaging system to develop a tri-modality imaging system, which has been tested for tumor detection using four mice with different physiological conditions. The results show that this tri-modality imaging system can provide complementary information on acoustic, optical, and mechanical properties. The enabled visualization and dimension estimation of tumors can lead to a more comprehensive tissue characterization for diagnosis and treatment.
Collapse
Affiliation(s)
- Shuaihu Wang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
- Department of Mechanical Engineering and Material Science, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - Bingxin Huang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
| | - Simon C.K. Chan
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
| | - Victor T.C. Tsang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
| | - Terence T.W. Wong
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
- Research Center for Medical Imaging and Analysis, The Hong Kong University of Science and Technology, Hong Kong, China
| |
Collapse
|
2
|
Paul A, Mallidi S. U-Net enhanced real-time LED-based photoacoustic imaging. JOURNAL OF BIOPHOTONICS 2024; 17:e202300465. [PMID: 38622811 PMCID: PMC11164633 DOI: 10.1002/jbio.202300465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Revised: 02/18/2024] [Accepted: 03/17/2024] [Indexed: 04/17/2024]
Abstract
Photoacoustic (PA) imaging is hybrid imaging modality with good optical contrast and spatial resolution. Portable, cost-effective, smaller footprint light emitting diodes (LEDs) are rapidly becoming important PA optical sources. However, the key challenge faced by the LED-based systems is the low light fluence that is generally compensated by high frame averaging, consequently reducing acquisition frame-rate. In this study, we present a simple deep learning U-Net framework that enhances the signal-to-noise ratio (SNR) and contrast of PA image obtained by averaging low number of frames. The SNR increased by approximately four-fold for both in-class in vitro phantoms (4.39 ± 2.55) and out-of-class in vivo models (4.27 ± 0.87). We also demonstrate the noise invariancy of the network and discuss the downsides (blurry outcome and failure to reduce the salt & pepper noise). Overall, the developed U-Net framework can provide a real-time image enhancement platform for clinically translatable low-cost and low-energy light source-based PA imaging systems.
Collapse
Affiliation(s)
- Avijit Paul
- Department of Biomedical Engineering, Tufts University, Medford, MA, USA
| | | |
Collapse
|
3
|
Hacker L, Brown EL, Lefebvre TL, Sweeney PW, Bohndiek SE. Performance evaluation of mesoscopic photoacoustic imaging. PHOTOACOUSTICS 2023; 31:100505. [PMID: 37214427 PMCID: PMC10199419 DOI: 10.1016/j.pacs.2023.100505] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Revised: 05/05/2023] [Accepted: 05/05/2023] [Indexed: 05/24/2023]
Abstract
Photoacoustic mesoscopy visualises vascular architecture at high-resolution up to ~3 mm depth. Despite promise in preclinical and clinical imaging studies, with applications in oncology and dermatology, the accuracy and precision of photoacoustic mesoscopy is not well established. Here, we evaluate a commercial photoacoustic mesoscopy system for imaging vascular structures. Typical artefact types are first highlighted and limitations due to non-isotropic illumination and detection are evaluated with respect to rotation, angularity, and depth of the target. Then, using tailored phantoms and mouse models, we investigate system precision, showing coefficients of variation (COV) between repeated scans [short term (1 h): COV= 1.2%; long term (25 days): COV= 9.6%], from target repositioning (without: COV=1.2%, with: COV=4.1%), or from varying in vivo user experience (experienced: COV=15.9%, unexperienced: COV=20.2%). Our findings show robustness of the technique, but also underscore general challenges of limited-view photoacoustic systems in accurately imaging vessel-like structures, thereby guiding users when interpreting biologically-relevant information.
Collapse
Affiliation(s)
- Lina Hacker
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge CB2 0RE, UK
| | - Emma L. Brown
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge CB2 0RE, UK
| | - Thierry L. Lefebvre
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge CB2 0RE, UK
| | - Paul W. Sweeney
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge CB2 0RE, UK
| | - Sarah E. Bohndiek
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge CB2 0RE, UK
| |
Collapse
|
4
|
Fang Z, Gao F, Jin H, Liu S, Wang W, Zhang R, Zheng Z, Xiao X, Tang K, Lou L, Tang KT, Chen J, Zheng Y. A Review of Emerging Electromagnetic-Acoustic Sensing Techniques for Healthcare Monitoring. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2022; 16:1075-1094. [PMID: 36459601 DOI: 10.1109/tbcas.2022.3226290] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Conventional electromagnetic (EM) sensing techniques such as radar and LiDAR are widely used for remote sensing, vehicle applications, weather monitoring, and clinical monitoring. Acoustic techniques such as sonar and ultrasound sensors are also used for consumer applications, such as ranging and in vivo medical/healthcare applications. It has been of long-term interest to doctors and clinical practitioners to realize continuous healthcare monitoring in hospitals and/or homes. Physiological and biopotential signals in real-time serve as important health indicators to predict and prevent serious illness. Emerging electromagnetic-acoustic (EMA) sensing techniques synergistically combine the merits of EM sensing with acoustic imaging to achieve comprehensive detection of physiological and biopotential signals. Further, EMA enables complementary fusion sensing for challenging healthcare settings, such as real-world long-term monitoring of treatment effects at home or in remote environments. This article reviews various examples of EMA sensing instruments, including implementation, performance, and application from the perspectives of circuits to systems. The novel and significant applications to healthcare are discussed. Three types of EMA sensors are presented: (1) Chip-based radar sensors for health status monitoring, (2) Thermo-acoustic sensing instruments for biomedical applications, and (3) Photoacoustic (PA) sensing and imaging systems, including dedicated reconstruction algorithms were reviewed from time-domain, frequency-domain, time-reversal, and model-based solutions. The future of EMA techniques for continuous healthcare with enhanced accuracy supported by artificial intelligence (AI) is also presented.
Collapse
|
5
|
Ganzleben I, Klett D, Hartz W, Götzfried L, Vitali F, Neurath MF, Waldner MJ. Multispectral optoacoustic tomography for the non-invasive identification of patients with severe anemia in vivo. PHOTOACOUSTICS 2022; 28:100414. [PMID: 36276233 PMCID: PMC9583176 DOI: 10.1016/j.pacs.2022.100414] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 09/29/2022] [Accepted: 10/10/2022] [Indexed: 06/16/2023]
Abstract
The immediate diagnosis of severe anemia is crucial for patient outcome. However, reliable non-invasive point-of-care diagnostic tools for e.g., ICU monitoring are currently lacking. Using an advanced Multispectral Optoacoustic Tomography (MSOT) research device, we first substantiated a strong positive correlation of MSOT-signal and absolute hemoglobin concentration ex vivo in blood samples. In a clinical exploratory proof-of-concept study, we then evaluated 19 patients with different severities of anemia and controls by non-invasive in vivo measurement of hemoglobin in the radial artery. Our approach proved excellent in identifying patients with severe anemia triggering RBC transfusion based on a strong positive correlation of MSOT-signal intensity and hemoglobin concentration for 700 nm single wavelength and HbR unmixed MSOT-parameter analysis. In conclusion, our study lays the foundation to further develop MSOT-based real-time quantitative perfusion analyses in follow-up preclinical and clinical imaging studies and as a promising diagnostic tool to improve patient care in the future. DRKS00021442.
Collapse
Affiliation(s)
- Ingo Ganzleben
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Daniel Klett
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Wiebke Hartz
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Lisa Götzfried
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Francesco Vitali
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
| | - Markus F. Neurath
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
- Erlangen Graduate School in Advanced Optical Technologies (SAOT), Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| | - Maximilian J. Waldner
- Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Ludwig-Demling-Center for Molecular Imaging, Department of Medicine 1, University Hospital, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
- Deutsches Zentrum Immuntherapie, Erlangen, Germany
- Erlangen Graduate School in Advanced Optical Technologies (SAOT), Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| |
Collapse
|
6
|
Shi M, Zhao T, West SJ, Desjardins AE, Vercauteren T, Xia W. Improving needle visibility in LED-based photoacoustic imaging using deep learning with semi-synthetic datasets. PHOTOACOUSTICS 2022; 26:100351. [PMID: 35495095 PMCID: PMC9048160 DOI: 10.1016/j.pacs.2022.100351] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 03/29/2022] [Accepted: 03/30/2022] [Indexed: 06/14/2023]
Abstract
Photoacoustic imaging has shown great potential for guiding minimally invasive procedures by accurate identification of critical tissue targets and invasive medical devices (such as metallic needles). The use of light emitting diodes (LEDs) as the excitation light sources accelerates its clinical translation owing to its high affordability and portability. However, needle visibility in LED-based photoacoustic imaging is compromised primarily due to its low optical fluence. In this work, we propose a deep learning framework based on U-Net to improve the visibility of clinical metallic needles with a LED-based photoacoustic and ultrasound imaging system. To address the complexity of capturing ground truth for real data and the poor realism of purely simulated data, this framework included the generation of semi-synthetic training datasets combining both simulated data to represent features from the needles and in vivo measurements for tissue background. Evaluation of the trained neural network was performed with needle insertions into blood-vessel-mimicking phantoms, pork joint tissue ex vivo and measurements on human volunteers. This deep learning-based framework substantially improved the needle visibility in photoacoustic imaging in vivo compared to conventional reconstruction by suppressing background noise and image artefacts, achieving 5.8 and 4.5 times improvements in terms of signal-to-noise ratio and the modified Hausdorff distance, respectively. Thus, the proposed framework could be helpful for reducing complications during percutaneous needle insertions by accurate identification of clinical needles in photoacoustic imaging.
Collapse
Affiliation(s)
- Mengjie Shi
- School of Biomedical Engineering and Imaging Sciences, King’s College London, London SE1 7EH, United Kingdom
| | - Tianrui Zhao
- School of Biomedical Engineering and Imaging Sciences, King’s College London, London SE1 7EH, United Kingdom
| | - Simeon J. West
- Department of Anaesthesia, University College Hospital, London NW1 2BU, United Kingdom
| | - Adrien E. Desjardins
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London W1 W 7TY, United Kingdom
- Department of Medical Physics and Biomedical Engineering, University College London, London WC1E 6BT, United Kingdom
| | - Tom Vercauteren
- School of Biomedical Engineering and Imaging Sciences, King’s College London, London SE1 7EH, United Kingdom
| | - Wenfeng Xia
- School of Biomedical Engineering and Imaging Sciences, King’s College London, London SE1 7EH, United Kingdom
| |
Collapse
|