1
|
Zhang C, Lei S, Ma A, Wang B, Wang S, Liu J, Shang D, Zhang Q, Li Y, Zheng H, Ma T. Evaluation of tumor microvasculature with 3D ultrasound localization microscopy based on 2D matrix array. Eur Radiol 2024; 34:5250-5259. [PMID: 38265473 DOI: 10.1007/s00330-023-10039-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 04/26/2023] [Accepted: 05/22/2023] [Indexed: 01/25/2024]
Abstract
OBJECTIVE Evaluation of tumor microvascular morphology is of great significance in tumor diagnosis, therapeutic effect prediction, and surgical planning. Recently, two-dimensional ultrasound localization microscopy (2DULM) has demonstrated its superiority in the field of microvascular imaging. However, it suffers from planar dependence and is unintuitive. We propose a novel three-dimensional ultrasound localization microscopy (3DULM) to avoid these limitations. METHODS We investigated 3DULM based on a 2D array for tumor microvascular imaging. After intravenous injection of contrast agents, all elements of the 2D array transmit and receive signals to ensure a high and stable frame rate. Microbubble signal extraction, filtering, positioning, tracking, and other processing were used to obtain a 3D vascular map, flow velocity, and flow direction. To verify the effectiveness of 3DULM, it was validated on double helix tubes and rabbit VX2 tumors. Cisplatin was used to verify the ability of 3DULM to detect microvascular changes during tumor treatment. RESULTS In vitro, the sizes measured by 3DULM at 3 mm and 13 mm were 178 μ m and 182 μ m , respectively. In the rabbit tumors, we acquired 9000 volumes to reveal vessels about 30 μ m in diameter, which surpasses the diffraction limit of ultrasound in traditional ultrasound imaging, and the results matched with micro-angiography. In addition, there were significant changes in vascular density and curvature between the treatment and control groups. CONCLUSIONS The effectiveness of 3DULM was verified in vitro and in vivo. Hence, 3DULM may have potential applications in tumor diagnosis, tumor treatment evaluation, surgical protocol guidance, and cardiovascular disease. CLINICAL RELEVANCE STATEMENT 3D ultrasound localization microscopy is highly sensitive to microvascular changes; thus, it has clinical potential for tumor diagnosis and treatment evaluation. KEY POINTS • 3D ultrasound localization microscopy is demonstrated on double helix tubes and rabbit VX2 tumors. • 3D ultrasound localization microscopy can reveal vessels about 30 μ m in diameter-far smaller than traditional ultrasound. • This form of imaging has potential applications in tumor diagnosis, tumor treatment evaluation, surgical protocol guidance, and cardiovascular disease.
Collapse
Affiliation(s)
- Changlu Zhang
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
- University of the Chinese Academy of Sciences, Beijing, 100000, China
| | - Shuang Lei
- School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Aiqing Ma
- Nanomedicine and Nanoformulations Institute of Biomedicine and Biotechnology, Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Bing Wang
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Shuo Wang
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Jiamei Liu
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Dongqing Shang
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
- University of the Chinese Academy of Sciences, Beijing, 100000, China
| | - Qi Zhang
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Yongchuan Li
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Hairong Zheng
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
- University of the Chinese Academy of Sciences, Beijing, 100000, China
| | - Teng Ma
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.
- University of the Chinese Academy of Sciences, Beijing, 100000, China.
| |
Collapse
|
2
|
Luan S, Yu X, Lei S, Ma C, Wang X, Xue X, Ding Y, Ma T, Zhu B. Deep learning for fast super-resolution ultrasound microvessel imaging. Phys Med Biol 2023; 68:245023. [PMID: 37934040 DOI: 10.1088/1361-6560/ad0a5a] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 11/07/2023] [Indexed: 11/08/2023]
Abstract
Objective. Ultrasound localization microscopy (ULM) enables microvascular reconstruction by localizing microbubbles (MBs). Although ULM can obtain microvascular images that are beyond the ultimate resolution of the ultrasound (US) diffraction limit, it requires long data processing time, and the imaging accuracy is susceptible to the density of MBs. Deep learning (DL)-based ULM is proposed to alleviate these limitations, which simulated MBs at low-resolution and mapped them to coordinates at high-resolution by centroid localization. However, traditional DL-based ULMs are imprecise and computationally complex. Also, the performance of DL is highly dependent on the training datasets, which are difficult to realistically simulate.Approach. A novel architecture called adaptive matching network (AM-Net) and a dataset generation method named multi-mapping (MMP) was proposed to overcome the above challenges. The imaging performance and processing time of the AM-Net have been assessed by simulation andin vivoexperiments.Main results. Simulation results show that at high density (20 MBs/frame), when compared to other DL-based ULM, AM-Net achieves higher localization accuracy in the lateral/axial direction.In vivoexperiment results show that the AM-Net can reconstruct ∼24.3μm diameter micro-vessels and separate two ∼28.3μm diameter micro-vessels. Furthermore, when processing a 128 × 128 pixels image in simulation experiments and an 896 × 1280 pixels imagein vivoexperiment, the processing time of AM-Net is ∼13 s and ∼33 s, respectively, which are 0.3-0.4 orders of magnitude faster than other DL-based ULM.Significance. We proposes a promising solution for ULM with low computing costs and high imaging performance.
Collapse
Affiliation(s)
- Shunyao Luan
- School of Integrated Circuits, Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Xiangyang Yu
- School of Integrated Circuits, Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shuang Lei
- School of Integrated Circuits, Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Chi Ma
- Department of Radiation Oncology, Rutgers-Cancer Institute of New Jersey, Rutgers-Robert Wood Johnson Medical School, New Brunswick, NJ, United States of America
| | - Xiao Wang
- Department of Radiation Oncology, Rutgers-Cancer Institute of New Jersey, Rutgers-Robert Wood Johnson Medical School, New Brunswick, NJ, United States of America
| | - Xudong Xue
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Yi Ding
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Teng Ma
- The Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, People's Republic of China
| | - Benpeng Zhu
- School of Integrated Circuits, Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| |
Collapse
|
3
|
Yu X, Luan S, Lei S, Huang J, Liu Z, Xue X, Ma T, Ding Y, Zhu B. Deep learning for fast denoising filtering in ultrasound localization microscopy. Phys Med Biol 2023; 68:205002. [PMID: 37703894 DOI: 10.1088/1361-6560/acf98f] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Accepted: 09/13/2023] [Indexed: 09/15/2023]
Abstract
Objective.Addition of a denoising filter step in ultrasound localization microscopy (ULM) has been shown to effectively reduce the error localizations of microbubbles (MBs) and achieve resolution improvement for super-resolution ultrasound (SR-US) imaging. However, previous image-denoising methods (e.g. block-matching 3D, BM3D) requires long data processing times, making ULM only able to be processed offline. This work introduces a new way to reduce data processing time through deep learning.Approach.In this study, we propose deep learning (DL) denoising based on contrastive semi-supervised network (CS-Net). The neural network is mainly trained with simulated MBs data to extract MB signals from noise. And the performances of CS-Net denoising are evaluated in bothin vitroflow phantom experiment andin vivoexperiment of New Zealand rabbit tumor.Main results.Forin vitroflow phantom experiment, the signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) of single microbubble image are 26.91 dB and 4.01 dB, repectively. Forin vivoanimal experiment , the SNR and CNR were 12.29 dB and 6.06 dB. In addition, single microvessel of 24μm and two microvessels separated by 46μm could be clearly displayed. Most importantly,, the CS-Net denoising speeds forin vitroandin vivoexperiments were 0.041 s frame-1and 0.062 s frame-1, respectively.Significance.DL denoising based on CS-Net can improve the resolution of SR-US as well as reducing denoising time, thereby making further contributions to the clinical real-time imaging of ULM.
Collapse
Affiliation(s)
- Xiangyang Yu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shunyao Luan
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shuang Lei
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Jing Huang
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Zeqing Liu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Xudong Xue
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Teng Ma
- The Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, People's Republic of China
| | - Yi Ding
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Benpeng Zhu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| |
Collapse
|
4
|
Yang Y, Wu R, Chen D, Fei C, Li D, Yang Y. An improved Fourier Ptychography algorithm for ultrasonic array imaging. Comput Biol Med 2023; 163:107157. [PMID: 37352636 DOI: 10.1016/j.compbiomed.2023.107157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Revised: 06/03/2023] [Accepted: 06/07/2023] [Indexed: 06/25/2023]
Abstract
Inspired by the optical imaging algorithm, the Fourier Ptychography (FP) algorithm is adopted to improve the resolution of ultrasonic array imaging. In the FP algorithm, the steady-state spectrum is utilized to recover the high-resolution ultrasonic images. Meanwhile, the parameters of FP algorithm are empirical, which can affect the imaging quality of ultrasonic array. Then the particle swarm optimization (PSO) algorithm is used to optimize the parameters of FP algorithm to further improve the imaging quality of ultrasonic array. The tungsten imaging experiments and pig eye imaging experiments are conducted to demonstrate the feasibility and effectiveness of the developed algorithm. In addition, the proposed algorithm and the coherent wave superposition (CWS) algorithm are both based on single plane wave (SPW) algorithms and they are then compared. The results show that the CWS algorithm and FP algorithm have good longitudinal and lateral resolutions, respectively. The particle swarm optimization-based FP (PSOFP) imaging algorithm has both excellent lateral and longitudinal resolutions. The average lateral resolution of PSOFP imaging algorithm is improved by 34.47% compared with CWS imaging algorithm in the tungsten wires experiments, and the lateral boundary structure width of the lens is improved by 49.48% in the pig eye experiments. The proposed algorithm can effectively improve the ultrasonic imaging quality for medical application.
Collapse
Affiliation(s)
- Yaoyao Yang
- School of Microelectronics, Xidian University, Xi'an, 710071, China
| | - Runcong Wu
- School of Microelectronics, Xidian University, Xi'an, 710071, China
| | - Dongdong Chen
- School of Microelectronics, Xidian University, Xi'an, 710071, China.
| | - Chunlong Fei
- School of Microelectronics, Xidian University, Xi'an, 710071, China; Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.
| | - Di Li
- School of Microelectronics, Xidian University, Xi'an, 710071, China
| | - Yintang Yang
- School of Microelectronics, Xidian University, Xi'an, 710071, China
| |
Collapse
|
5
|
Goudot G, Jimenez A, Mohamedi N, Sitruk J, Khider L, Mortelette H, Papadacci C, Hyafil F, Tanter M, Messas E, Pernot M, Mirault T. Assessment of Takayasu's arteritis activity by ultrasound localization microscopy. EBioMedicine 2023; 90:104502. [PMID: 36893585 PMCID: PMC10017361 DOI: 10.1016/j.ebiom.2023.104502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 02/10/2023] [Accepted: 02/10/2023] [Indexed: 03/09/2023] Open
Abstract
BACKGROUND Ultrasound localization microscopy (ULM) based on ultrafast ultrasound imaging of circulating microbubbles (MB) can image microvascular blood flows in vivo up to the micron scale. Takayasu arteritis (TA) has an increased vascularisation of the thickened arterial wall when active. We aimed to perform vasa vasorum ULM of the carotid wall and demonstrate that ULM can provide imaging markers to assess the TA activity. METHODS Patients with TA were consecutively included with assessment of activity by the National Institute of Health criteria: 5 had active TA (median age 35.8 [24.5-46.0] years) and 11 had quiescent TA (37.2 [31.7-47.3] years). ULM was performed using a 6.4 MHz probe and a dedicated imaging sequence (plane waves with 8 angles, frame rate 500 Hz), coupled with the intravenous injection of MB. Individual MB were localised at a subwavelength scale then tracked, allowing the reconstruction of the vasa vasorum flow anatomy and velocity. FINDINGS ULM allowed to show microvessels and to measure their flow velocity within the arterial wall. The number of MB detected per second in the wall was 121 [80-146] in active cases vs. 10 [6-15] in quiescent cases (p = 0.0005), with a mean velocity of 40.5 [39.0-42.9] mm.s-1 in active cases. INTERPRETATION ULM allows visualisation of microvessels within the thickened carotid wall in TA, with significantly greater MB density in active cases. ULM provides a precise visualisation in vivo of the vasa vasorum and gives access to the arterial wall vascularisation quantification. FUNDING French Society of Cardiology. ART (Technological Research Accelerator) biomedical ultrasound program of INSERM, France.
Collapse
Affiliation(s)
- Guillaume Goudot
- Vascular Medicine Department, Georges Pompidou European Hospital, APHP, Paris, France; Université Paris Cité, INSERM U970 PARCC, F-75015 Paris, France.
| | - Anatole Jimenez
- Physics for Medicine Paris, INSERM U1273, ESPCI Paris, CNRS UMR 8631, PSL Research University, Paris, France
| | - Nassim Mohamedi
- Vascular Medicine Department, Georges Pompidou European Hospital, APHP, Paris, France; Université Paris Cité, INSERM U970 PARCC, F-75015 Paris, France
| | - Jonas Sitruk
- Vascular Medicine Department, Georges Pompidou European Hospital, APHP, Paris, France; Université Paris Cité, INSERM U970 PARCC, F-75015 Paris, France
| | - Lina Khider
- Vascular Medicine Department, Georges Pompidou European Hospital, APHP, Paris, France; Université Paris Cité, INSERM U970 PARCC, F-75015 Paris, France
| | - Hélène Mortelette
- Vascular Medicine Department, Georges Pompidou European Hospital, APHP, Paris, France
| | - Clément Papadacci
- Physics for Medicine Paris, INSERM U1273, ESPCI Paris, CNRS UMR 8631, PSL Research University, Paris, France
| | - Fabien Hyafil
- Nuclear Medicine Department, Georges Pompidou European Hospital, APHP, Université Paris Cité, Paris, France
| | - Mickaël Tanter
- Physics for Medicine Paris, INSERM U1273, ESPCI Paris, CNRS UMR 8631, PSL Research University, Paris, France
| | - Emmanuel Messas
- Vascular Medicine Department, Georges Pompidou European Hospital, APHP, Paris, France; Université Paris Cité, INSERM U970 PARCC, F-75015 Paris, France
| | - Mathieu Pernot
- Physics for Medicine Paris, INSERM U1273, ESPCI Paris, CNRS UMR 8631, PSL Research University, Paris, France
| | - Tristan Mirault
- Vascular Medicine Department, Georges Pompidou European Hospital, APHP, Paris, France; Université Paris Cité, INSERM U970 PARCC, F-75015 Paris, France; French National Reference Centre for Rare Vascular Diseases, FAVA-MULTI, Member of the European Reference Network on Rare Multisystemic Vascular Diseases (VASCERN), F-75015 Paris, France
| |
Collapse
|
6
|
Wang S, Gao Z, Yang Y, Zhang Q, Huang J, Wang B, Lei S, Tan Q, Liu D, Guo L, Song Y, Liu J, Ma T, Tian Y. Sonodynamic Therapy With Concentric Ultrasound Imaging Array for Precision Theranostics for Atherosclerotic Plaque. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:3270-3283. [PMID: 36269912 DOI: 10.1109/tuffc.2022.3215436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Atherosclerotic cardiovascular disease is a major cause of human disability and mortality. Our previous study demonstrated the safety and efficacy of sonodynamic therapy (SDT) on atherosclerotic plaques. However, traditional single-element therapeutic transducer has single acoustic field, and positioning therapeutic and imaging transducers in the same position is difficult during ultrasound imaging-guided SDT. Continuously changing the position of transducers to intervene lesions in different positions is required, increasing the difficulty of treatment. Thus, an SDT device with precise theranostics is required. Therefore, we designed and fabricated a "concentric ultrasound transducer for theranostics" (CUST-T), comprising a central 8-MHz linear array transducer for ultrasound imaging, and a peripheral 1-MHz hollow two-dimensional (2-D) planar array transducer for generating phased-array focused ultrasound (PAFUS). The CUST-T exhibited high imaging resolution at a distance of up to 20 mm from the transducer and could generate a personalized complex PAFUS acoustic field to match various lesions. In vitro biomedical results showed that PAFUS-SDT induced RAW264.7-derived foam cell apoptosis leading to a targeting field apoptotic rate 4.36-6.24 times that of the nontargeting field and the significant apoptotic region was consistent with the PAFUS acoustic field. In vivo, PAFUS-SDT guided by ultrasound imaging significantly increased the lumen area ( ) and collagen level ( ), whereas the wall thickness ( ) and lipid content ( ) of rabbit femoral artery were reduced. In conclusion, CUST-T provided image guidance sufficient for accurate SDT for atherosclerotic plaques in peripheral arteries and could be applied in clinical practice.
Collapse
|