1
|
Yan J, Huang B, Tonko J, Toulemonde M, Hansen-Shearer J, Tan Q, Riemer K, Ntagiantas K, Chowdhury RA, Lambiase PD, Senior R, Tang MX. Transthoracic ultrasound localization microscopy of myocardial vasculature in patients. Nat Biomed Eng 2024:10.1038/s41551-024-01206-6. [PMID: 38710839 DOI: 10.1038/s41551-024-01206-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 03/30/2024] [Indexed: 05/08/2024]
Abstract
Myocardial microvasculature and haemodynamics are indicative of potential microvascular diseases for patients with symptoms of coronary heart disease in the absence of obstructive coronary arteries. However, imaging microvascular structure and flow within the myocardium is challenging owing to the small size of the vessels and the constant movement of the patient's heart. Here we show the feasibility of transthoracic ultrasound localization microscopy for imaging myocardial microvasculature and haemodynamics in explanted pig hearts and in patients in vivo. Through a customized data-acquisition and processing pipeline with a cardiac phased-array probe, we leveraged motion correction and tracking to reconstruct the dynamics of microcirculation. For four patients, two of whom had impaired myocardial function, we obtained super-resolution images of myocardial vascular structure and flow using data acquired within a breath hold. Myocardial ultrasound localization microscopy may facilitate the understanding of myocardial microcirculation and the management of patients with cardiac microvascular diseases.
Collapse
Affiliation(s)
- Jipeng Yan
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Biao Huang
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Johanna Tonko
- Institute of Cardiovascular Science, University College London, London, UK
| | - Matthieu Toulemonde
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Joseph Hansen-Shearer
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Qingyuan Tan
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Kai Riemer
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | | | - Rasheda A Chowdhury
- Faculty of Medicine, National Heart and Lung Institute, Imperial College London, London, UK
| | - Pier D Lambiase
- Institute of Cardiovascular Science, University College London, London, UK
| | - Roxy Senior
- Faculty of Medicine, National Heart and Lung Institute, Imperial College London, London, UK
- Royal Brompton Hospital, London, UK
- Northwick Park Hospital, Harrow, UK
| | - Meng-Xing Tang
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK.
| |
Collapse
|
2
|
Tuccio G, Afrakhteh S, Iacca G, Demi L. Time Efficient Ultrasound Localization Microscopy Based on A Novel Radial Basis Function 2D Interpolation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1690-1701. [PMID: 38145542 DOI: 10.1109/tmi.2023.3347261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/27/2023]
Abstract
Ultrasound localization microscopy (ULM) allows for the generation of super-resolved (SR) images of the vasculature by precisely localizing intravenously injected microbubbles. Although SR images may be useful for diagnosing and treating patients, their use in the clinical context is limited by the need for prolonged acquisition times and high frame rates. The primary goal of our study is to relax the requirement of high frame rates to obtain SR images. To this end, we propose a new time-efficient ULM (TEULM) pipeline built on a cutting-edge interpolation method. More specifically, we suggest employing Radial Basis Functions (RBFs) as interpolators to estimate the missing values in the 2-dimensional (2D) spatio-temporal structures. To evaluate this strategy, we first mimic the data acquisition at a reduced frame rate by applying a down-sampling (DS = 2, 4, 8, and 10) factor to high frame rate ULM data. Then, we up-sample the data to the original frame rate using the suggested interpolation to reconstruct the missing frames. Finally, using both the original high frame rate data and the interpolated one, we reconstruct SR images using the ULM framework steps. We evaluate the proposed TEULM using four in vivo datasets, a Rat brain (dataset A), a Rat kidney (dataset B), a Rat tumor (dataset C) and a Rat brain bolus (dataset D), interpolating at the in-phase and quadrature (IQ) level. Results demonstrate the effectiveness of TEULM in recovering vascular structures, even at a DS rate of 10 (corresponding to a frame rate of sub-100Hz). In conclusion, the proposed technique is successful in reconstructing accurate SR images while requiring frame rates of one order of magnitude lower than standard ULM.
Collapse
|
3
|
Zhang Z, Hwang M, Kilbaugh TJ, Katz J. Improving sub-pixel accuracy in ultrasound localization microscopy using supervised and self-supervised deep learning. MEASUREMENT SCIENCE & TECHNOLOGY 2024; 35:045701. [PMID: 38205381 PMCID: PMC10774911 DOI: 10.1088/1361-6501/ad1671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 11/30/2023] [Accepted: 12/17/2023] [Indexed: 01/12/2024]
Abstract
With a spatial resolution of tens of microns, ultrasound localization microscopy (ULM) reconstructs microvascular structures and measures intravascular flows by tracking microbubbles (1-5 μm) in contrast enhanced ultrasound (CEUS) images. Since the size of CEUS bubble traces, e.g. 0.5-1 mm for ultrasound with a wavelength λ = 280 μm, is typically two orders of magnitude larger than the bubble diameter, accurately localizing microbubbles in noisy CEUS data is vital to the fidelity of the ULM results. In this paper, we introduce a residual learning based supervised super-resolution blind deconvolution network (SupBD-net), and a new loss function for a self-supervised blind deconvolution network (SelfBD-net), for detecting bubble centers at a spatial resolution finer than λ/10. Our ultimate purpose is to improve the ability to distinguish closely located microvessels and the accuracy of the velocity profile measurements in macrovessels. Using realistic synthetic data, the performance of these methods is calibrated and compared against several recently introduced deep learning and blind deconvolution techniques. For bubble detection, errors in bubble center location increase with the trace size, noise level, and bubble concentration. For all cases, SupBD-net yields the least error, keeping it below 0.1 λ. For unknown bubble trace morphology, where all the supervised learning methods fail, SelfBD-net can still maintain an error of less than 0.15 λ. SupBD-net also outperforms the other methods in separating closely located bubbles and parallel microvessels. In macrovessels, SupBD-net maintains the least errors in the vessel radius and velocity profile after introducing a procedure that corrects for terminated tracks caused by overlapping traces. Application of these methods is demonstrated by mapping the cerebral microvasculature of a neonatal pig, where neighboring microvessels separated by 0.15 λ can be readily distinguished by SupBD-net and SelfBD-net, but not by the other techniques. Hence, the newly proposed residual learning based methods improve the spatial resolution and accuracy of ULM in micro- and macro-vessels.
Collapse
Affiliation(s)
- Zeng Zhang
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, United States of America
| | - Misun Hwang
- Departments of Radiology, Children’s Hospital of Philadelphia, Philadelphia, PA, United States of America
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Todd J Kilbaugh
- Department of Anesthesiology and Critical Care Medicine, Children’s Hospital of Philadelphia, Philadelphia, PA, United States of America
| | - Joseph Katz
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, United States of America
| |
Collapse
|
4
|
Wang W, Zhang H, Li Y, Wang Y, Zhang Q, Ding G, Yin L, Tang J, Peng B. An Automated Heart Shunt Recognition Pipeline Using Deep Neural Networks. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01047-4. [PMID: 38388868 DOI: 10.1007/s10278-024-01047-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 01/21/2024] [Accepted: 02/11/2024] [Indexed: 02/24/2024]
Abstract
Automated recognition of heart shunts using saline contrast transthoracic echocardiography (SC-TTE) has the potential to transform clinical practice, enabling non-experts to assess heart shunt lesions. This study aims to develop a fully automated and scalable analysis pipeline for distinguishing heart shunts, utilizing a deep neural network-based framework. The pipeline consists of three steps: (1) chamber segmentation, (2) ultrasound microbubble localization, and (3) disease classification model establishment. The study's normal control group included 91 patients with intracardiac shunts, 61 patients with extracardiac shunts, and 84 asymptomatic individuals. Participants' SC-TTE images were segmented using the U-Net model to obtain cardiac chambers. The segmentation results were combined with ultrasound microbubble localization to generate multivariate time series data on microbubble counts in each chamber. A classification model was then trained using this data to distinguish between intracardiac and extracardiac shunts. The proposed framework accurately segmented heart chambers (dice coefficient = 0.92 ± 0.1) and localized microbubbles. The disease classification model achieved high accuracy, sensitivity, specificity, F1 score, kappa value, and AUC value for both intracardiac and extracardiac shunts. For intracardiac shunts, accuracy was 0.875 ± 0.008, sensitivity was 0.891 ± 0.002, specificity was 0.865 ± 0.012, F1 score was 0.836 ± 0.011, kappa value was 0.735 ± 0.017, and AUC value was 0.942 ± 0.014. For extracardiac shunts, accuracy was 0.902 ± 0.007, sensitivity was 0.763 ± 0.014, specificity was 0.966 ± 0.008, F1 score was 0.830 ± 0.012, kappa value was 0.762 ± 0.017, and AUC value was 0.916 ± 0.006. The proposed framework utilizing deep neural networks offers a fast, convenient, and accurate method for identifying intracardiac and extracardiac shunts. It aids in shunt recognition and generates valuable quantitative indices, assisting clinicians in diagnosing these conditions.
Collapse
Affiliation(s)
- Weidong Wang
- School of Computer Science and Software Engineering, Southwest Petroleum University, Chengdu, Sichuan, China
| | - Hongme Zhang
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| | - Yizhen Li
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Yi Wang
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Qingfeng Zhang
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Geqi Ding
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Lixue Yin
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Jinshan Tang
- Department of Health Administration and Policy, College of Public Health, George Mason University, Fairfax, USA
| | - Bo Peng
- School of Computer Science and Software Engineering, Southwest Petroleum University, Chengdu, Sichuan, China.
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| |
Collapse
|
5
|
Porte C, Lisson T, Kohlen M, von Maltzahn F, Dencks S, von Stillfried S, Piepenbrock M, Rix A, Dasgupta A, Koczera P, Boor P, Stickeler E, Schmitz G, Kiessling F. Ultrasound Localization Microscopy for Breast Cancer Imaging in Patients: Protocol Optimization and Comparison with Shear Wave Elastography. ULTRASOUND IN MEDICINE & BIOLOGY 2024; 50:57-66. [PMID: 37805359 DOI: 10.1016/j.ultrasmedbio.2023.09.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Revised: 07/25/2023] [Accepted: 09/02/2023] [Indexed: 10/09/2023]
Abstract
OBJECTIVE Ultrasound localization microscopy (ULM) has gained increasing attention in recent years because of its ability to visualize blood vessels at super-resolution. The field of oncology, in particular, could benefit from detailed vascular characterization, for example, for diagnosis and therapy monitoring. This study was aimed at refining ULM for breast cancer patients by optimizing the measurement protocol, identifying translational challenges and combining ULM and shear wave elastography. METHODS We computed ULM images of 11 patients with breast cancer by recording contrast-enhanced ultrasound (CEUS) sequences and post-processing them in an offline pipeline. For CEUS, two different doses and injection speeds of SonoVue were applied. The best injection protocol was determined based on quantitative parameters derived from so-called occurrence maps. In addition, a suitable measurement time window was determined, also considering the occurrence of motion. ULM results were compared with shear wave elastography and histological vessel density. RESULTS At the higher dose and injection speed, the highest number of microbubbles, number of tracks and vessel coverage were achieved, leading to the most detailed representation of tumor vasculature. Even at the highest concentration, no significant overlay of microbubble signals occurred. Motion significantly reduced the number of usable frames, thus limiting the measurement window to 3.5 min. ULM vessel coverage was comparable to the histological vessel fraction and correlated significantly with mean tumor elasticity. CONCLUSION The settings for microbubble injection strongly influence ULM images, thus requiring optimized protocols for different indications. Patient and examiner motion was identified as the main translational challenge for ULM.
Collapse
Affiliation(s)
- Céline Porte
- Institute for Experimental Molecular Imaging, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Thomas Lisson
- Department of Electrical Engineering and Information Technology, Ruhr University Bochum, Bochum, Germany
| | - Matthias Kohlen
- Department of Gynecology and Obstetrics, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Finn von Maltzahn
- Institute for Experimental Molecular Imaging, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Stefanie Dencks
- Department of Electrical Engineering and Information Technology, Ruhr University Bochum, Bochum, Germany
| | - Saskia von Stillfried
- Institute of Pathology, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Marion Piepenbrock
- Department of Electrical Engineering and Information Technology, Ruhr University Bochum, Bochum, Germany
| | - Anne Rix
- Institute for Experimental Molecular Imaging, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Anshuman Dasgupta
- Institute for Experimental Molecular Imaging, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Patrick Koczera
- Institute for Experimental Molecular Imaging, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Peter Boor
- Institute of Pathology, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Elmar Stickeler
- Department of Gynecology and Obstetrics, University Clinic Aachen, RWTH Aachen University, Aachen, Germany
| | - Georg Schmitz
- Department of Electrical Engineering and Information Technology, Ruhr University Bochum, Bochum, Germany
| | - Fabian Kiessling
- Institute for Experimental Molecular Imaging, University Clinic Aachen, RWTH Aachen University, Aachen, Germany; Fraunhofer Institute for Digital Medicine MEVIS, Aachen, Germany.
| |
Collapse
|
6
|
Yu X, Luan S, Lei S, Huang J, Liu Z, Xue X, Ma T, Ding Y, Zhu B. Deep learning for fast denoising filtering in ultrasound localization microscopy. Phys Med Biol 2023; 68:205002. [PMID: 37703894 DOI: 10.1088/1361-6560/acf98f] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Accepted: 09/13/2023] [Indexed: 09/15/2023]
Abstract
Objective.Addition of a denoising filter step in ultrasound localization microscopy (ULM) has been shown to effectively reduce the error localizations of microbubbles (MBs) and achieve resolution improvement for super-resolution ultrasound (SR-US) imaging. However, previous image-denoising methods (e.g. block-matching 3D, BM3D) requires long data processing times, making ULM only able to be processed offline. This work introduces a new way to reduce data processing time through deep learning.Approach.In this study, we propose deep learning (DL) denoising based on contrastive semi-supervised network (CS-Net). The neural network is mainly trained with simulated MBs data to extract MB signals from noise. And the performances of CS-Net denoising are evaluated in bothin vitroflow phantom experiment andin vivoexperiment of New Zealand rabbit tumor.Main results.Forin vitroflow phantom experiment, the signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) of single microbubble image are 26.91 dB and 4.01 dB, repectively. Forin vivoanimal experiment , the SNR and CNR were 12.29 dB and 6.06 dB. In addition, single microvessel of 24μm and two microvessels separated by 46μm could be clearly displayed. Most importantly,, the CS-Net denoising speeds forin vitroandin vivoexperiments were 0.041 s frame-1and 0.062 s frame-1, respectively.Significance.DL denoising based on CS-Net can improve the resolution of SR-US as well as reducing denoising time, thereby making further contributions to the clinical real-time imaging of ULM.
Collapse
Affiliation(s)
- Xiangyang Yu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shunyao Luan
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shuang Lei
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Jing Huang
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Zeqing Liu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Xudong Xue
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Teng Ma
- The Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, People's Republic of China
| | - Yi Ding
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Benpeng Zhu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| |
Collapse
|
7
|
Yan J, Wang B, Riemer K, Hansen-Shearer J, Lerendegui M, Toulemonde M, Rowlands CJ, Weinberg PD, Tang MX. Fast 3D Super-Resolution Ultrasound With Adaptive Weight-Based Beamforming. IEEE Trans Biomed Eng 2023; 70:2752-2761. [PMID: 37015124 PMCID: PMC7614997 DOI: 10.1109/tbme.2023.3263369] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/01/2023]
Abstract
OBJECTIVE Super-resolution ultrasound (SRUS) imaging through localising and tracking sparse microbubbles has been shown to reveal microvascular structure and flow beyond the wave diffraction limit. Most SRUS studies use standard delay and sum (DAS) beamforming, where high side lobes and broad main lobes make isolation and localisation of densely distributed bubbles challenging, particularly in 3D due to the typically small aperture of matrix array probes. METHOD This study aimed to improve 3D SRUS by implementing a new fast 3D coherence beamformer based on channel signal variance. Two additional fast coherence beamformers, that have been implemented in 2D were implemented in 3D for the first time as comparison: a nonlinear beamformer with p-th root compression and a coherence factor beamformer. The 3D coherence beamformers, together with DAS, were compared in computer simulation, on a microflow phantom and in vivo. RESULTS Simulation results demonstrated that all three adaptive weight-based beamformers can narrow the main lobe, suppress the side lobes, while maintaining the weaker scatter signals. Improved 3D SRUS images of microflow phantom and a rabbit kidney within a 3-second acquisition were obtained using the adaptive weight-based beamformers, when compared with DAS. CONCLUSION The adaptive weight-based 3D beamformers can improve the SRUS and the proposed variance-based beamformer performs best in simulations and experiments. SIGNIFICANCE Fast 3D SRUS would significantly enhance the potential utility of this emerging imaging modality in a broad range of biomedical applications.
Collapse
Affiliation(s)
- Jipeng Yan
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | - Bingxue Wang
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | - Kai Riemer
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | - Joseph Hansen-Shearer
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | - Marcelo Lerendegui
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | - Matthieu Toulemonde
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | | | - Peter D. Weinberg
- Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | - Meng-Xing Tang
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| |
Collapse
|
8
|
Dencks S, Schmitz G. Ultrasound localization microscopy. Z Med Phys 2023; 33:292-308. [PMID: 37328329 PMCID: PMC10517400 DOI: 10.1016/j.zemedi.2023.02.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 01/24/2023] [Accepted: 02/10/2023] [Indexed: 06/18/2023]
Abstract
Ultrasound Localization Microscopy (ULM) is an emerging technique that provides impressive super-resolved images of microvasculature, i.e., images with much better resolution than the conventional diffraction-limited ultrasound techniques and is already taking its first steps from preclinical to clinical applications. In comparison to the established perfusion or flow measurement methods, namely contrast-enhanced ultrasound (CEUS) and Doppler techniques, ULM allows imaging and flow measurements even down to the capillary level. As ULM can be realized as a post-processing method, conventional ultrasound systems can be used for. ULM relies on the localization of single microbubbles (MB) of commercial, clinically approved contrast agents. In general, these very small and strong scatterers with typical radii of 1-3 µm are imaged much larger in ultrasound images than they actually are due to the point spread function of the imaging system. However, by applying appropriate methods, these MBs can be localized with sub-pixel precision. Then, by tracking MBs over successive frames of image sequences, not only the morphology of vascular trees but also functional information such as flow velocities or directions can be obtained and visualized. In addition, quantitative parameters can be derived to describe pathological and physiological changes in the microvasculature. In this review, the general concept of ULM and conditions for its applicability to microvessel imaging are explained. Based on this, various aspects of the different processing steps for a concrete implementation are discussed. The trade-off between complete reconstruction of the microvasculature and the necessary measurement time as well as the implementation in 3D are reviewed in more detail, as they are the focus of current research. Through an overview of potential or already realized preclinical and clinical applications - pathologic angiogenesis or degeneration of vessels, physiological angiogenesis, or the general understanding of organ or tissue function - the great potential of ULM is demonstrated.
Collapse
Affiliation(s)
- Stefanie Dencks
- Lehrstuhl für Medizintechnik, Fakultät für Elektrotechnik und Informationstechnik, Ruhr-Universität Bochum, Bochum, Germany.
| | - Georg Schmitz
- Lehrstuhl für Medizintechnik, Fakultät für Elektrotechnik und Informationstechnik, Ruhr-Universität Bochum, Bochum, Germany
| |
Collapse
|
9
|
Song P, Rubin JM, Lowerison MR. Super-resolution ultrasound microvascular imaging: Is it ready for clinical use? Z Med Phys 2023; 33:309-323. [PMID: 37211457 PMCID: PMC10517403 DOI: 10.1016/j.zemedi.2023.04.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 03/31/2023] [Accepted: 04/01/2023] [Indexed: 05/23/2023]
Abstract
The field of super-resolution ultrasound microvascular imaging has been rapidly growing over the past decade. By leveraging contrast microbubbles as point targets for localization and tracking, super-resolution ultrasound pinpoints the location of microvessels and measures their blood flow velocity. Super-resolution ultrasound is the first in vivo imaging modality that can image micron-scale vessels at a clinically relevant imaging depth without tissue destruction. These unique capabilities of super-resolution ultrasound provide structural (vessel morphology) and functional (vessel blood flow) assessments of tissue microvasculature on a global and local scale, which opens new doors for many enticing preclinical and clinical applications that benefit from microvascular biomarkers. The goal of this short review is to provide an update on recent advancements in super-resolution ultrasound imaging, with a focus on summarizing existing applications and discussing the prospects of translating super-resolution imaging to clinical practice and research. In this review, we also provide brief introductions of how super-resolution ultrasound works, how does it compare with other imaging modalities, and what are the tradeoffs and limitations for an audience who is not familiar with the technology.
Collapse
Affiliation(s)
- Pengfei Song
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, United States; Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, United States; Department of Bioengineering, University of Illinois Urbana-Champaign, United States; Carle Illinois College of Medicine, University of Illinois Urbana-Champaign, United States.
| | - Jonathan M Rubin
- Department of Radiology, University of Michigan, Ann Arbor, United States
| | - Matthew R Lowerison
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, United States; Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, United States
| |
Collapse
|
10
|
Guo X, Ta D, Xu K. Frame rate effects and their compensation on super-resolution microvessel imaging using ultrasound localization microscopy. ULTRASONICS 2023; 132:107009. [PMID: 37060620 DOI: 10.1016/j.ultras.2023.107009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 03/21/2023] [Accepted: 04/07/2023] [Indexed: 05/29/2023]
Abstract
Ultrasound localization microscopy (ULM) breaks the diffraction limit and allows imaging microvasculature at micrometric resolution while preserving the penetration depth. Frame rate plays an important role for high-quality ULM imaging, but there is still a lack of review and investigation of the frame rate effects on ULM. This work aims to clarify how frame rate influences the performance of ULM, including the effects of microbubble detection, localization and tracking. The performance of ULM was evaluated using an in vivo rat brain dataset (15.6 MHz, 3 tilted plane waves (-5°, 0°, +5°), at a compounded frame rate of 1000 Hz) with different frame rates. Quantification methods, including Fourier ring correlation and saturation parameter, were applied to analyze the spatial resolution and reconstruction efficiency, respectively. In addition, effects on each crucial step in ULM processing were further analyzed. Results showed that when frame rates dropped from 1000 Hz to 250 Hz, the spatial resolution deteriorated from 9.9 μm to 15.0 μm. Applying a velocity constraint was able to improve the ULM performance, but inappropriate constraint may artificially result in high apparent resolution. For the dataset, compared with the results of 1000 Hz frame rate, the velocity was underestimated at 100 Hz with 47.18% difference and the saturation was reduced from 55.00% at 1000 Hz to 43.34% at 100 Hz. Analysis showed that inadequate frame rate generated unreliable microbubble detection, localization and tracking as well as incomplete track reconstruction, resulting in the deterioration in spatial resolution, the underestimation in velocity measurement and the decrease in saturation. Finally, a guidance of determining the frame rate requirement was discussed by considering the required spatial sampling points based on vessel morphology, clutter filtering method, tracking algorithm and acquisition time, which provides indications for future clinical application of ULM method.
Collapse
Affiliation(s)
- Xingyi Guo
- Center for Biomedical Engineering, School of Information Science and Technology, Fudan University, Shanghai 200438, China; State Key Laboratory of Integrated Chips and Systems, Fudan University, Shanghai 201203, China
| | - Dean Ta
- Center for Biomedical Engineering, School of Information Science and Technology, Fudan University, Shanghai 200438, China; State Key Laboratory of Integrated Chips and Systems, Fudan University, Shanghai 201203, China; Yiwu Research Institute of Fudan University, Zhejiang 322000, China
| | - Kailiang Xu
- Center for Biomedical Engineering, School of Information Science and Technology, Fudan University, Shanghai 200438, China; State Key Laboratory of Integrated Chips and Systems, Fudan University, Shanghai 201203, China; Yiwu Research Institute of Fudan University, Zhejiang 322000, China.
| |
Collapse
|
11
|
Liang M, Liu J, Guo C, Zong Y, Wan M. Velocity field estimation in transcranial small vessel using super-resolution ultrasound imaging velocimetry. ULTRASONICS 2023; 132:107016. [PMID: 37094521 DOI: 10.1016/j.ultras.2023.107016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 04/11/2023] [Accepted: 04/13/2023] [Indexed: 05/03/2023]
Abstract
Based on the diameter and position information of small vessels obtained by transcranial super-resolution imaging using 3 MHz low-frequency chirp plane waves, a Gaussian-like non-linear compression was adopted to compress the blood flow signals in spatiotemporal filtering (STF) data to a precise region, and then estimate the blood flow velocity field inside the region over the adjacent time intervals using ultrasound imaging velocimetry (UIV). Imaging parameters, such as the mechanical index (MI), frame rate, and microbubble (MB) concentration, are critical during the estimation of velocity fields over a short time at high MB contrast agent concentrations. These were optimized through experiments and algorithms, in which dividing the connected domain was proposed to calculate MB cluster spot centroid spacing (SCS) and the spot-to-flow area ratio (SFAR) to determine the suitable MB concentration. The results of the in vitro experiments showed that the estimation of the small vessel flow velocity field was consistent with the theoretical results; the velocity field resolution for vessels with diameters of 0.5 mm and 0.3 mm was 36 μm and 21 μm, and the error between the mean velocity and the theoretical value was 0.7 % and 0.67 %, respectively.
Collapse
Affiliation(s)
- Meiling Liang
- College of Life Sciences and Technology, Xi'an Jiaotong University, Xi'an, China
| | - Jiacheng Liu
- College of Life Sciences and Technology, Xi'an Jiaotong University, Xi'an, China
| | - Chao Guo
- College of Life Sciences and Technology, Xi'an Jiaotong University, Xi'an, China
| | - Yujin Zong
- College of Life Sciences and Technology, Xi'an Jiaotong University, Xi'an, China.
| | - Mingxi Wan
- College of Life Sciences and Technology, Xi'an Jiaotong University, Xi'an, China.
| |
Collapse
|
12
|
Lok UW, Huang C, Trzasko JD, Kim Y, Lucien F, Tang S, Gong P, Song P, Chen S. Three-Dimensional Ultrasound Localization Microscopy with Bipartite Graph-Based Microbubble Pairing and Kalman-Filtering-Based Tracking on a 256-Channel Verasonics Ultrasound System with a 32 × 32 Matrix Array. J Med Biol Eng 2022; 42:767-779. [PMID: 36712192 PMCID: PMC9881453 DOI: 10.1007/s40846-022-00755-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 10/05/2022] [Indexed: 02/02/2023]
Abstract
Three-dimensional (3D) ultrasound localization microscopy (ULM) using a 2-D matrix probe and microbubbles (MBs) has been recently proposed to visualize microvasculature beyond the ultrasound diffraction limit in three spatial dimensions. However, 3D ULM suffers from several limitations: (1) high system complexity due to numerous channel counts, (2) complex MB flow dynamics in 3D, and (3) extremely long acquisition time. To reduce the system complexity while maintaining high image quality, we used a sub-aperture process to reduce received channel counts. To address the second issue, a 3D bipartite graph-based method with Kalman filtering-based tracking was used in this study for MB tracking. An MB separation approach was incorporated to separate high concentration MB data into multiple, sparser MB datasets, allowing better MB localization and tracking for a limited acquisition time. The proposed method was first validated in a flow channel phantom, showing improved spatial resolutions compared with the contrasted enhanced power Doppler image. Then the proposed method was evaluated with an in vivo chicken embryo brain dataset. Results showed that the reconstructed 3D super-resolution image achieved a spatial resolution of around 52 μm (smaller than the wavelength of around 200 μm). Microvessels that cannot be resolved clearly using localization only, can be well identified with the tailored 3D pairing and tracking algorithms. To sum up, the feasibility of the 3D ULM is shown, indicating the great possibility in clinical applications.
Collapse
Affiliation(s)
- U-Wai Lok
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Chengwu Huang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Joshua D. Trzasko
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Yohan Kim
- Department of Urology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Fabrice Lucien
- Department of Urology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Shanshan Tang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Ping Gong
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Pengfei Song
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
- Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, IL
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL
| | - Shigao Chen
- Corresponding Author: Dr. Shigao Chen, Department of Radiology, Mayo Clinic, 200 First Street SW, Rochester, MN 55905,
| |
Collapse
|
13
|
Jensen JA, Schou M, Jorgensen LT, Tomov BG, Stuart MB, Traberg MS, Taghavi I, Oygaard SH, Ommen ML, Steenberg K, Thomsen EV, Panduro NS, Nielsen MB, Sorensen CM. Anatomic and Functional Imaging Using Row-Column Arrays. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:2722-2738. [PMID: 35839193 DOI: 10.1109/tuffc.2022.3191391] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Row-column (RC) arrays have the potential to yield full 3-D ultrasound imaging with a greatly reduced number of elements compared to fully populated arrays. They, however, have several challenges due to their special geometry. This review article summarizes the current literature for RC imaging and demonstrates that full anatomic and functional imaging can attain a high quality using synthetic aperture (SA) sequences and modified delay-and-sum beamforming. Resolution can approach the diffraction limit with an isotropic resolution of half a wavelength with low sidelobe levels, and the field of view can be expanded by using convex or lensed RC probes. GPU beamforming allows for three orthogonal planes to be beamformed at 30 Hz, providing near real-time imaging ideal for positioning the probe and improving the operator's workflow. Functional imaging is also attainable using transverse oscillation and dedicated SA sequence for tensor velocity imaging for revealing the full 3-D velocity vector as a function of spatial position and time for both blood velocity and tissue motion estimation. Using RC arrays with commercial contrast agents can reveal super-resolution imaging (SRI) with isotropic resolution below [Formula: see text]. RC arrays can, thus, yield full 3-D imaging at high resolution, contrast, and volumetric rates for both anatomic and functional imaging with the same number of receive channels as current commercial 1-D arrays.
Collapse
|
14
|
Yan J, Zhang T, Broughton-Venner J, Huang P, Tang MX. Super-Resolution Ultrasound Through Sparsity-Based Deconvolution and Multi-Feature Tracking. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1938-1947. [PMID: 35171767 PMCID: PMC7614417 DOI: 10.1109/tmi.2022.3152396] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Ultrasound super-resolution imaging through localisation and tracking of microbubbles can achieve sub-wave-diffraction resolution in mapping both micro-vascular structure and flow dynamics in deep tissue in vivo. Currently, it is still challenging to achieve high accuracy in localisation and tracking particularly with limited imaging frame rates and in the presence of high bubble concentrations. This study introduces microbubble image features into a Kalman tracking framework, and makes the framework compatible with sparsity-based deconvolution to address these key challenges. The performance of the method is evaluated on both simulations using individual bubble signals segmented from in vivo data and experiments on a mouse brain and a human lymph node. The simulation results show that the deconvolution not only significantly improves the accuracy of isolating overlapping bubbles, but also preserves some image features of the bubbles. The combination of such features with Kalman motion model can achieve a significant improvement in tracking precision at a low frame rate over that using the distance measure, while the improvement is not significant at the highest frame rate. The in vivo results show that the proposed framework generates SR images that are significantly different from the current methods with visual improvement, and is more robust to high bubble concentrations and low frame rates.
Collapse
Affiliation(s)
- Jipeng Yan
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | - Tao Zhang
- Second Affiliate Hospital, Zhejiang University, Hangzhou, China, 313000
| | - Jacob Broughton-Venner
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| | - Pintong Huang
- Second Affiliate Hospital, Zhejiang University, Hangzhou, China, 313000
| | - Meng-Xing Tang
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK, SW7 2AZ
| |
Collapse
|
15
|
Taghavi I, Andersen SB, Hoyos CAV, Schou M, Gran F, Hansen KL, Nielsen MB, Sørensen CM, Stuart MB, Jensen JA. Ultrasound super-resolution imaging with a hierarchical Kalman tracker. ULTRASONICS 2022; 122:106695. [PMID: 35149256 DOI: 10.1016/j.ultras.2022.106695] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 11/18/2021] [Accepted: 01/19/2022] [Indexed: 06/14/2023]
Abstract
Microbubble (MB) tracking plays an important role in ultrasound super-resolution imaging (SRI) by enabling velocity estimation and improving image quality. This work presents a new hierarchical Kalman (HK) tracker to achieve better performance at scenarios with high concentrations of MBs and high localization uncertainty. The method attempts to follow MBs with different velocity ranges using different Kalman filters. An extended simulation framework for evaluating trackers is also presented and used for comparison of the proposed HK tracker with the nearest-neighbor (NN) and Kalman (K) trackers. The HK tracks were most similar to the ground truth with the highest Jaccard similarity coefficient in 79% of the scenarios and the lowest root-mean-square error in 72% of the scenarios. The HK tracker reconstructed vessels with a more accurate diameter. In a scenario with an uncertainty of 51.2μm in MB localization, a vessel diameter of 250μm was estimated as 257μm by HK tracker, compared with 329μm and 389μm for the K and NN trackers. In the same scenario, the HK tracker estimated MB velocities with a relative bias down to 1.7% and a relative standard deviation down to 8.3%. Finally, the different tracking techniques were applied to in vivo data from rat kidneys, and trends similar to the simulations were observed. Conclusively, the results showed an improvement in tracking performance, when the HK tracker was employed in comparison with the NN and K trackers.
Collapse
Affiliation(s)
- Iman Taghavi
- Center for Fast Ultrasound Imaging, Department of Health Technology, Technical University of Denmark, DK 2800, Kgs. Lyngby Denmark.
| | - Sofie Bech Andersen
- Department of Biomedical Sciences, University of Copenhagen, DK 2200, Copenhagen, Denmark; Department of Diagnostic Radiology, Rigshospitalet, DK 2100, Copenhagen, Denmark; Department of Clinical Medicine, University of Copenhagen, DK 2200, Copenhagen, Denmark.
| | | | - Mikkel Schou
- Center for Fast Ultrasound Imaging, Department of Health Technology, Technical University of Denmark, DK 2800, Kgs. Lyngby Denmark.
| | | | - Kristoffer Lindskov Hansen
- Department of Diagnostic Radiology, Rigshospitalet, DK 2100, Copenhagen, Denmark; Department of Clinical Medicine, University of Copenhagen, DK 2200, Copenhagen, Denmark.
| | - Michael Bachmann Nielsen
- Department of Diagnostic Radiology, Rigshospitalet, DK 2100, Copenhagen, Denmark; Department of Clinical Medicine, University of Copenhagen, DK 2200, Copenhagen, Denmark.
| | | | - Matthias Bo Stuart
- Center for Fast Ultrasound Imaging, Department of Health Technology, Technical University of Denmark, DK 2800, Kgs. Lyngby Denmark.
| | - Jørgen Arendt Jensen
- Center for Fast Ultrasound Imaging, Department of Health Technology, Technical University of Denmark, DK 2800, Kgs. Lyngby Denmark.
| |
Collapse
|
16
|
Arjas A, Alles EJ, Maneas E, Arridge S, Desjardins A, Sillanpaa MJ, Hauptmann A. Neural Network Kalman Filtering for 3-D Object Tracking From Linear Array Ultrasound Data. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:1691-1702. [PMID: 35324438 DOI: 10.1109/tuffc.2022.3162097] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Many interventional surgical procedures rely on medical imaging to visualize and track instruments. Such imaging methods not only need to be real time capable but also provide accurate and robust positional information. In ultrasound (US) applications, typically, only 2-D data from a linear array are available, and as such, obtaining accurate positional estimation in three dimensions is nontrivial. In this work, we first train a neural network, using realistic synthetic training data, to estimate the out-of-plane offset of an object with the associated axial aberration in the reconstructed US image. The obtained estimate is then combined with a Kalman filtering approach that utilizes positioning estimates obtained in previous time frames to improve localization robustness and reduce the impact of measurement noise. The accuracy of the proposed method is evaluated using simulations, and its practical applicability is demonstrated on experimental data obtained using a novel optical US imaging setup. Accurate and robust positional information is provided in real time. Axial and lateral coordinates for out-of-plane objects are estimated with a mean error of 0.1 mm for simulated data and a mean error of 0.2 mm for experimental data. The 3-D localization is most accurate for elevational distances larger than 1 mm, with a maximum distance of 6 mm considered for a 25-mm aperture.
Collapse
|
17
|
Ultrasound Localization Microscopy in Liquid Metal Flows. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094517] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Liquid metal convection plays an important role in natural and technical processes. In experimental studies, an instrumentation with a sub-millimeter spatial resolution is required in an opaque fluid to resolve the flow field near the boundary layer. Using ultrasound methods, the trade-off between the frequency and imaging depth of typical laboratory experiments limits the spatial resolution. Therefore, the method of ultrasound localization microscopy (ULM) was introduced in liquid metal experiments for the first time in this study. To isolate the intrinsic scattering particles, an adaptive nonlinear beamformer was applied. As a result, an average spatial resolution of 188 μm could be achieved, which corresponded to a fraction of the ultrasound wavelength of 0.28. A convection experiment was measured using ULM. Due to the increased spatial resolution, the high-velocity gradients and the recirculation areas of a liquid metal convection experiment could be observed for the first time. The presented technique paves the way for in-depth flow studies of convective turbulent liquid metal flows that are close to the boundary layer.
Collapse
|
18
|
Porte C, Kiessling F. [Super-resolution ultrasound imaging : Methods and applications]. Radiologe 2022; 62:467-474. [PMID: 35380263 DOI: 10.1007/s00117-022-00995-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/14/2022] [Indexed: 11/24/2022]
Abstract
CLINICAL/METHODICAL ISSUE The microvasculature plays an important role in many pathologic conditions but cannot be characterized in high resolution via conventional ultrasound methods. STANDARD RADIOLOGICAL METHODS Doppler-based techniques, contrast-enhanced sonography as well as dynamic contrast-enhanced computed tomography (CT) and magnetic resonance imaging (MRI) are commonly used to characterize tissue vascularization. However, these techniques cannot visualize the microvasculature adequately. METHODICAL INNOVATION Ultrasound localization microscopy (ULM) consists of contrast-enhanced ultrasound measurements in combination with a complex post-processing algorithm which detects microbubbles with high precision. The vasculature can then be visualized by accumulating the microbubble positions in a final image. PERFORMANCE Compared to conventional ultrasound techniques, ULM improves the image resolution by a factor of more than 10. This currently results in resolutions down to 10 µm and allows, therefore, the visualization of capillaries and the assessment of their perfusion. Also, this does not lead to a reduction of the penetration depth or the signal-to-noise ratio (SNR). ACHIEVEMENT The method enables the visualization of vascular structures in unsurpassed detail and has the potential to offer new possibilities for the diagnosis of various diseases and for gaining insights into physiological processes. However, ULM is not commercially available yet but is intensely being tested in clinical studies. PRACTICAL RECOMMENDATIONS ULM could potentially be applied to all fields in which the vasculature is relevant. Current fields of application include oncology, nephrology, and neurological research.
Collapse
Affiliation(s)
- Céline Porte
- Institut für Experimentelle Molekulare Bildgebung, Rheinisch-Westfälische Technische Hochschule Aachen, Center for Biohybrid Medical Systems, Forckenbeckstraße 55, 52074, Aachen, Deutschland
| | - Fabian Kiessling
- Institut für Experimentelle Molekulare Bildgebung, Rheinisch-Westfälische Technische Hochschule Aachen, Center for Biohybrid Medical Systems, Forckenbeckstraße 55, 52074, Aachen, Deutschland.
| |
Collapse
|
19
|
Vermeulen I, Isin EM, Barton P, Cillero-Pastor B, Heeren RM. Multimodal molecular imaging in drug discovery and development. Drug Discov Today 2022; 27:2086-2099. [DOI: 10.1016/j.drudis.2022.04.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Revised: 03/03/2022] [Accepted: 04/08/2022] [Indexed: 02/06/2023]
|
20
|
Zhang Z, Hwang M, Kilbaugh TJ, Sridharan A, Katz J. Cerebral microcirculation mapped by echo particle tracking velocimetry quantifies the intracranial pressure and detects ischemia. Nat Commun 2022; 13:666. [PMID: 35115552 PMCID: PMC8814032 DOI: 10.1038/s41467-022-28298-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 01/14/2022] [Indexed: 12/26/2022] Open
Abstract
Affecting 1.1‰ of infants, hydrocephalus involves abnormal accumulation of cerebrospinal fluid, resulting in elevated intracranial pressure (ICP). It is the leading cause for brain surgery in newborns, often causing long-term neurologic disabilities or even death. Since conventional invasive ICP monitoring is risky, early neurosurgical interventions could benefit from noninvasive techniques. Here we use clinical contrast-enhanced ultrasound (CEUS) imaging and intravascular microbubble tracking algorithms to map the cerebral blood flow in hydrocephalic pediatric porcine models. Regional microvascular perfusions are quantified by the cerebral microcirculation (CMC) parameter, which accounts for the concentration of micro-vessels and flow velocity in them. Combining CMC with hemodynamic parameters yields functional relationships between cortical micro-perfusion and ICP, with correlation coefficients exceeding 0.85. For cerebral ischemia cases, the nondimensionalized cortical micro-perfusion decreases by an order of magnitude when ICP exceeds 50% of the MAP. These findings suggest that CEUS-based CMC measurement is a plausible noninvasive method for assessing the ICP and detecting ischemia.
Collapse
Affiliation(s)
- Zeng Zhang
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Misun Hwang
- Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA.,Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Todd J Kilbaugh
- Department of Anesthesiology and Critical Care Medicine, Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | - Anush Sridharan
- Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | - Joseph Katz
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA.
| |
Collapse
|
21
|
Lei S, Zhang G, Zhu B, Long X, Jiang Z, Liu Y, Hu D, Sheng Z, Zhang Q, Wang C, Gao Z, Zheng H, Ma T. In Vivo Ultrasound Localization Microscopy Imaging of the Kidney's Microvasculature With Block-Matching 3-D Denoising. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:523-533. [PMID: 34727030 DOI: 10.1109/tuffc.2021.3125010] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Structural abnormalities and functional changes of renal microvascular networks play a significant pathophysiologic role in the occurrence of kidney diseases. Super-resolution ultrasound imaging has been successfully utilized to visualize the microvascular network and provide valuable diagnostic information. To prevent the burst of microbubbles, a lower mechanical index (MI) is generally used in ultrasound localization microscopy (ULM) imaging. However, high noise levels lead to incorrect signal localizations in relatively low-MI settings and deep tissue. In this study, we implemented a block-matching 3-D (BM3D) image-denoising method, after the application of singular value decomposition filtering, to further suppress the noise at various depths. The in vitro flow-phantom results show that the BM3D method helps the significant reduction of the error localizations, thus improving the localization accuracy. In vivo rhesus macaque experiments help conclude that the BM3D method improves the resolution more than other image-based denoising techniques, such as the nonlocal means method. The obtained clutter-filtered images with fewer incorrect localizations can enable robust ULM imaging, thus helping in establishing an effective diagnostic tool.
Collapse
|
22
|
Kurochkin MA, German SV, Abalymov A, Vorontsov DА, Gorin DA, Novoselova MV. Sentinel lymph node detection by combining nonradioactive techniques with contrast agents: State of the art and prospects. JOURNAL OF BIOPHOTONICS 2022; 15:e202100149. [PMID: 34514735 DOI: 10.1002/jbio.202100149] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Revised: 08/21/2021] [Accepted: 09/09/2021] [Indexed: 06/13/2023]
Abstract
The status of sentinel lymph nodes (SLNs) has a substantial prognostic value because these nodes are the first place where cancer cells accumulate along their spreading route. Routine SLN biopsy ("gold standard") involves peritumoral injections of radiopharmaceuticals, such as technetium-99m, which has obvious disadvantages. This review examines the methods used as "gold standard" analogs to diagnose SLNs. Nonradioactive preoperative and intraoperative methods of SLN detection are analyzed. Promising photonic tools for SLNs detection are reviewed, including NIR-I/NIR-II fluorescence imaging, photoswitching dyes for SLN detection, in vivo photoacoustic detection, imaging and biopsy of SLNs. Also are discussed methods of SLN detection by magnetic resonance imaging, ultrasonic imaging systems including as combined with photoacoustic imaging, and methods based on the magnetometer-aided detection of superparamagnetic nanoparticles. The advantages and disadvantages of nonradioactive SLN-detection methods are shown. The review concludes with prospects for the use of conservative diagnostic methods in combination with photonic tools.
Collapse
Affiliation(s)
| | - Sergey V German
- Skolkovo Institute of Science and Technology, Moscow, Russia
- Institute of Spectroscopy of the Russian Academy of Sciences, Moscow, Russia
| | | | - Dmitry А Vorontsov
- State Budgetary Institution of Health Care of Nizhny Novgorod "Nizhny Novgorod Regional Clinical Oncological Dispensary", Nizhny Novgorod, Russia
| | - Dmitry A Gorin
- Skolkovo Institute of Science and Technology, Moscow, Russia
| | | |
Collapse
|
23
|
Yan L, Bai C, Zheng Y, Zhou X, Wan M, Zong Y, Chen S, Zhou Y. Study on the Application of Super-Resolution Ultrasound for Cerebral Vessel Imaging in Rhesus Monkeys. Front Neurol 2021; 12:720320. [PMID: 34867712 PMCID: PMC8637903 DOI: 10.3389/fneur.2021.720320] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 10/13/2021] [Indexed: 11/17/2022] Open
Abstract
Background: Ultrasound is ideal for displaying intracranial great vessels but not intracranial microvessels and terminal vessels. Even with contrast agents, the imaging effect is still unsatisfactory. In recent years, significant theoretical advances have been achieved in super-resolution imaging. The latest commonly used ultrafast plane-wave ultrasound Doppler imaging of the brain and microbubble-based super-resolution ultrasound imaging have been applied to the imaging of cerebral microvessels and blood flow in small animals such as mice but have not been applied to in vivo imaging of the cerebral microvessels in monkeys and larger animals. In China, preliminary research results have been obtained using super-resolution imaging in certain fields but rarely in fundamental and clinical experiments on large animals. In recent years, we have conducted a joint study with the Xi'an Jiaotong University to explore the application and performance of this new technique in the diagnosis of cerebrovascular diseases in large animals. Objective: To explore the characteristics and advantages of microbubble-based super-resolution ultrasound imaging of intracranial vessels in rhesus monkeys compared with conventional transcranial ultrasound. Methods: First, the effectiveness and feasibility of the super-resolution imaging technique were verified by modular simulation experiments. Then, the imaging parameters were adjusted based on in vitro experiments. Finally, two rhesus monkeys were used for in vivo experiments of intracranial microvessel imaging. Results: Compared with conventional plane-wave imaging, super-resolution imaging could measure the inner diameters of cerebral microvessels at a resolution of 1 mm or even 0.7 mm and extract blood flow information. In addition, it has a better signal-to-noise ratio (5.625 dB higher) and higher resolution (~30-fold higher). The results of the experiments with rhesus monkeys showed that microbubble-based super-resolution ultrasound imaging can achieve an optimal resolution at the micron level and an imaging depth >35 mm. Conclusion: Super-resolution imaging can realize the monitoring imaging of high-resolution and fast calculation of microbubbles in the process of tissue damage, providing an important experimental basis for the clinical application of non-invasive transcranial ultrasound.
Collapse
Affiliation(s)
- Li Yan
- Institute of Medical Research, Northwestern Polytechnical University, Xi'an, China
| | - Chen Bai
- State Key Laboratory of Transient Optics and Photonics, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, China
| | - Yu Zheng
- Department of Ultrasonography, Xi'an Central Hospital, The Third Affiliated Hospital of Jiaotong University, Xi'an, China
| | - Xiaodong Zhou
- Ultrasound Diagnosis & Treatment Center, Xi'an International Medical Center, Xi'an, China
| | - Mingxi Wan
- Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Yujin Zong
- Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Shanshan Chen
- Ultrasound Diagnosis & Treatment Center, Xi'an International Medical Center, Xi'an, China
| | - Yin Zhou
- Institute of Medical Research, Northwestern Polytechnical University, Xi'an, China
| |
Collapse
|
24
|
Hingot V, Chavignon A, Heiles B, Couture O. Measuring Image Resolution in Ultrasound Localization Microscopy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3812-3819. [PMID: 34280094 DOI: 10.1109/tmi.2021.3097150] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
The resolution of an imaging system is usually determined by the width of its point spread function and is measured using the Rayleigh criterion. For most system, it is in the order of the imaging wavelength. However, super resolution techniques such as localization microscopy in optical and ultrasound imaging can resolve features an order of magnitude finer than the wavelength. The classical description of spatial resolution no longer applies and new methods need to be developed. In optical localization microscopy, the Fourier Ring Correlation has showed to be an effective and practical way to estimate spatial resolution for Single Molecule Localization Microscopy data. In this work, we wish to investigate how this tool can provide a direct and universal estimation of spatial resolution in Ultrasound Localization Microscopy. Moreover, we discuss the concept of spatial sampling in Ultrasound Localization Microscopy and demonstrate how the Nyquist criterion for sampling drives the spatial/temporal resolution tradeoff. We measured spatial resolution on five different datasets over rodent's brain, kidney and tumor finding values between [Formula: see text] and [Formula: see text] for precision of localization between [Formula: see text] and [Formula: see text]. Eventually, we discuss from those in vivo datasets how spatial resolution in Ultrasound Localization Microscopy depends on both the localization precision and the total number of detected microbubbles. This study aims to offer a practical and theoretical framework for image resolution in Ultrasound Localization Microscopy.
Collapse
|
25
|
Lowerison M, Zhang W, Chen X, Fan T, Song P. Characterization of Anti-angiogenic Chemo-sensitization via Longitudinal Ultrasound Localization Microscopy in Colorectal Carcinoma Tumor Xenografts. IEEE Trans Biomed Eng 2021; 69:1449-1460. [PMID: 34633926 PMCID: PMC9014806 DOI: 10.1109/tbme.2021.3119280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Super-resolution ultrasound localization microscopy (ULM) has unprecedented vascular resolution at clinically relevant imaging penetration depths. This technology can potentially screen for the transient microvascular changes that are thought to be critical to the synergistic effect(s) of combined chemotherapy-antiangiogenic agent regimens for cancer. METHODS In this paper, we apply this technology to a high-throughput colorectal carcinoma xenograft model treated with either the antiangiogenic agent sorafenib, FOLFOX-6 chemotherapy, a combination of the two treatments, or vehicle control. RESULTS Longitudinal ULM demonstrated morphological changes in the antiangiogenic treated cohorts, and evidence of vascular disruption caused by chemotherapy. Gold-standard histological measurements revealed reduced levels of hypoxia in the sorafenib treated cohort for both of the human cell lines tested (HCT-116 and HT-29). Therapy resistance was associated with an increase in tumor vascular fractal dimension as measured by a box-counting technique on ULM images. CONCLUSION These results imply that the morphological changes evident on ULM signify a functional change in the tumor microvasculature, which may be indicative of chemo-sensitivity. SIGNIFICANCE ULM provides additional utility for tumor therapy response evaluation by offering a myriad of morphological and functional quantitative indices for gauging treatment effect(s).
Collapse
|
26
|
Taghavi I, Andersen SB, Hoyos CAV, Nielsen MB, Sorensen CM, Jensen JA. In Vivo Motion Correction in Super-Resolution Imaging of Rat Kidneys. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2021; 68:3082-3093. [PMID: 34097608 DOI: 10.1109/tuffc.2021.3086983] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Super-resolution (SR) imaging has the potential of visualizing the microvasculature down to the 10- [Formula: see text] level, but motion induced by breathing, heartbeats, and muscle contractions are often significantly above this level. This article, therefore, introduces a method for estimating tissue motion and compensating for this. The processing pipeline is described and validated using Field II simulations of an artificial kidney. In vivo measurements were conducted using a modified bk5000 research scanner (BK Medical, Herlev, Denmark) with a BK 9009 linear array probe employing a pulse amplitude modulation scheme. The left kidney of ten Sprague-Dawley rats was scanned during open laparotomy. A 1:10 diluted SonoVue contrast agent (Bracco, Milan, Italy) was injected through a jugular vein catheter at 100 [Formula: see text]/min. Motion was estimated using speckle tracking and decomposed into contributions from the heartbeats, breathing, and residual motion. The estimated peak motions and their precisions were: heart: axial- [Formula: see text] and lateral- [Formula: see text], breathing: axial- [Formula: see text] and lateral- [Formula: see text], and residual: axial-30 [Formula: see text] and lateral-90 [Formula: see text]. The motion corrected microbubble tracks yielded SR images of both bubble density and blood vector velocity. The estimation was, thus, sufficiently precise to correct shifts down to the 10- [Formula: see text] capillary level. Similar results were found in the other kidney measurements with a restoration of resolution for the small vessels demonstrating that motion correction in 2-D can enhance SR imaging quality.
Collapse
|
27
|
Zhang W, Lowerison MR, Dong Z, Miller RJ, Keller KA, Song P. Super-Resolution Ultrasound Localization Microscopy on a Rabbit Liver VX2 Tumor Model: An Initial Feasibility Study. ULTRASOUND IN MEDICINE & BIOLOGY 2021; 47:2416-2429. [PMID: 34045095 PMCID: PMC8278629 DOI: 10.1016/j.ultrasmedbio.2021.04.012] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Revised: 03/18/2021] [Accepted: 04/12/2021] [Indexed: 05/09/2023]
Abstract
Ultrasound localization microscopy can image microvasculature in vivo without sacrificing imaging penetration depth. However, the reliance on super-resolution inference limits the applicability of the technique because subpixel tissue motion can corrupt microvascular reconstruction. Consequently, the majority of previous pre-clinical research on this super-resolution procedure has been restricted to low-motion experimental models with ample motion correction or data rejection, which precludes the imaging of organ sites that exhibit a high degree of respiratory and other motion. In this article, we present a novel anesthesia protocol in rabbits that induces safe, controllable periods of apnea to enable the long image-acquisition times required for ultrasound localization microscopy. We apply this protocol to a VX2 liver tumor model undergoing sorafenib therapy and compare the results to super-resolution images from conventional high-dose isoflurane anesthesia. We find that the apneic protocol was necessary to correctly identify the poorly vascularized tumor cores, as verified by immunohistochemistry, and to reveal the tumoral microvascular architecture.
Collapse
Affiliation(s)
- Wei Zhang
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA; Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Wuhan, China
| | - Matthew R Lowerison
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| | - Zhijie Dong
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| | - Rita J Miller
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| | - Krista A Keller
- Department of Veterinary Clinical Medicine, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| | - Pengfei Song
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA; Cancer Center at Illinois, University of Illinois at Urbana-Champaign, Urbana, IL, USA.
| |
Collapse
|
28
|
From Anatomy to Functional and Molecular Biomarker Imaging and Therapy: Ultrasound Is Safe, Ultrafast, Portable, and Inexpensive. Invest Radiol 2021; 55:559-572. [PMID: 32776766 DOI: 10.1097/rli.0000000000000675] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Ultrasound is the most widely used medical imaging modality worldwide. It is abundant, extremely safe, portable, and inexpensive. In this review, we consider some of the current development trends for ultrasound imaging, which build upon its current strength and the popularity it experiences among medical imaging professional users.Ultrasound has rapidly expanded beyond traditional radiology departments and cardiology practices. Computing power and data processing capabilities of commonly available electronics put ultrasound systems in a lab coat pocket or on a user's mobile phone. Taking advantage of new contributions and discoveries in ultrasound physics, signal processing algorithms, and electronics, the performance of ultrasound systems and transducers have progressed in terms of them becoming smaller, with higher imaging performance, and having lower cost. Ultrasound operates in real time, now at ultrafast speeds; kilohertz frame rates are already achieved by many systems.Ultrasound has progressed beyond anatomical imaging and monitoring blood flow in large vessels. With clinical approval of ultrasound contrast agents (gas-filled microbubbles) that are administered in the bloodstream, tissue perfusion studies are now routine. Through the use of modern ultrasound pulse sequences, individual microbubbles, with subpicogram mass, can be detected and observed in real time, many centimeters deep in the body. Ultrasound imaging has broken the wavelength barrier; by tracking positions of microbubbles within the vasculature, superresolution imaging has been made possible. Ultrasound can now trace the smallest vessels and capillaries, and obtain blood velocity data in those vessels.Molecular ultrasound imaging has now moved closer to clinic; the use of microbubbles with a specific affinity to endothelial biomarkers allows selective accumulation and retention of ultrasound contrast in the areas of ischemic injury, inflammation, or neoangiogenesis. This will aid in noninvasive molecular imaging and may provide additional help with real-time guidance of biopsy, surgery, and ablation procedures.The ultrasound field can be tightly focused inside the body, many centimeters deep, with millimeter precision, and ablate lesions by energy deposition, with thermal or mechanical bioeffects. Some of such treatments are already in clinical use, with more indications progressing through the clinical trial stage. In conjunction with intravascular microbubbles, focused ultrasound can be used for tissue-specific drug delivery; localized triggered release of sequestered drugs from particles in the bloodstream may take time to get to clinic. A combination of intravascular microbubbles with circulating drug and low-power ultrasound allows transient opening of vascular endothelial barriers, including blood-brain barrier; this approach has reached clinical trial stage. Therefore, the drugs that normally would not be getting to the target tissue in the brain will now have an opportunity to produce therapeutic efficacy.Overall, medical ultrasound is developing at a brisk rate, even in an environment where other imaging modalities are also advancing rapidly and may be considered more lucrative. With all the current advances that we discuss, and many more to come, ultrasound may help solve many problems that modern medicine is facing.
Collapse
|
29
|
Huang C, Zhang W, Gong P, Lok UW, Tang S, Yin T, Zhang X, Zhu L, Sang M, Song P, Zheng R, Chen S. Super-resolution ultrasound localization microscopy based on a high frame-rate clinical ultrasound scanner: an in-human feasibility study. Phys Med Biol 2021; 66. [PMID: 33725687 DOI: 10.1088/1361-6560/abef45] [Citation(s) in RCA: 42] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Accepted: 03/16/2021] [Indexed: 12/11/2022]
Abstract
Non-invasive detection of microvascular alterations in deep tissuesin vivoprovides critical information for clinical diagnosis and evaluation of a broad-spectrum of pathologies. Recently, the emergence of super-resolution ultrasound localization microscopy (ULM) offers new possibilities for clinical imaging of microvasculature at capillary level. Currently, the clinical utility of ULM on clinical ultrasound scanners is hindered by the technical limitations, such as long data acquisition time, high microbubble (MB) concentration, and compromised tracking performance associated with low imaging frame-rate. Here we present a robust in-human ULM on a high frame-rate (HFR) clinical ultrasound scanner to achieve super-resolution microvessel imaging using a short acquisition time (<10 s). Ultrasound MB data were acquired from different human tissues, including a healthy liver and a diseased liver with acute-on-chronic liver failure, a kidney, a pancreatic tumor, and a breast mass using an HFR clinical scanner. By leveraging the HFR and advanced processing techniques including sub-pixel motion registration, MB signal separation, and Kalman filter-based tracking, MBs can be robustly localized and tracked for ULM under the circumstances of relatively high MB concentration associated with standard clinical MB administration and limited data acquisition time in humans. Subtle morphological and hemodynamic information in microvasculature were shown based on data acquired with single breath-hold and free-hand scanning. Compared with contrast-enhanced power Doppler generated based on the same MB dataset, ULM showed a 5.7-fold resolution improvement in a vessel based on a linear transducer, and provided a wide-range blood flow speed measurement that is Doppler angle-independent. Microvasculatures with complex hemodynamics can be well-differentiated at super-resolution in both normal and pathological tissues. This preliminary study implemented the ultrafast in-human ULM in various human tissues based on a clinical scanner that supports HFR imaging, indicating the potentials of the technique for various clinical applications. However, rigorous validation of the technique in imaging human microvasculature (especially for those tiny vessel structure), preferably with a gold standard, is still required.
Collapse
Affiliation(s)
- Chengwu Huang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, United States of America
| | - Wei Zhang
- Department of Ultrasound, Guangdong Key Laboratory of Liver Disease Research, Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, People's Republic of China
| | - Ping Gong
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, United States of America
| | - U-Wai Lok
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, United States of America
| | - Shanshan Tang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, United States of America
| | - Tinghui Yin
- Department of Ultrasound, Guangdong Key Laboratory of Liver Disease Research, Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, People's Republic of China
| | - Xirui Zhang
- Shenzhen Mindray Bio-Medical Electronics Co. Ltd, Shenzhen, Guangdong, People's Republic of China
| | - Lei Zhu
- Shenzhen Mindray Bio-Medical Electronics Co. Ltd, Shenzhen, Guangdong, People's Republic of China
| | - Maodong Sang
- Shenzhen Mindray Bio-Medical Electronics Co. Ltd, Shenzhen, Guangdong, People's Republic of China
| | - Pengfei Song
- Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, IL, United States of America.,Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, United States of America
| | - Rongqin Zheng
- Department of Ultrasound, Guangdong Key Laboratory of Liver Disease Research, Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, People's Republic of China
| | - Shigao Chen
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, United States of America
| |
Collapse
|
30
|
Lok UW, Huang C, Gong P, Tang S, Yang L, Zhang W, Kim Y, Korfiatis P, Blezek DJ, Lucien F, Zheng R, Trzasko JD, Chen S. Fast super-resolution ultrasound microvessel imaging using spatiotemporal data with deep fully convolutional neural network. Phys Med Biol 2021; 66:10.1088/1361-6560/abeb31. [PMID: 33652418 PMCID: PMC8483593 DOI: 10.1088/1361-6560/abeb31] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Accepted: 03/02/2021] [Indexed: 02/08/2023]
Abstract
Ultrasound localization microscopy (ULM) has been proposed to image microvasculature beyond the ultrasound diffraction limit. Although ULM can attain microvascular images with a sub-diffraction resolution, long data acquisition time and processing time are the critical limitations. Deep learning-based ULM (deep-ULM) has been proposed to mitigate these limitations. However, microbubble (MB) localization used in deep-ULMs is currently based on spatial information without the use of temporal information. The highly spatiotemporally coherent MB signals provide a strong feature that can be used to differentiate MB signals from background artifacts. In this study, a deep neural network was employed and trained with spatiotemporal ultrasound datasets to better identify the MB signals by leveraging both the spatial and temporal information of the MB signals. Training, validation and testing datasets were acquired from MB suspension to mimic the realistic intensity-varying and moving MB signals. The performance of the proposed network was first demonstrated in the chicken embryo chorioallantoic membrane dataset with an optical microscopic image as the reference standard. Substantial improvement in spatial resolution was shown for the reconstructed super-resolved images compared with power Doppler images. The full-width-half-maximum (FWHM) of a microvessel was improved from 133μm to 35μm, which is smaller than the ultrasound wavelength (73μm). The proposed method was further tested in anin vivohuman liver data. Results showed the reconstructed super-resolved images could resolve a microvessel of nearly 170μm (FWHM). Adjacent microvessels with a distance of 670μm, which cannot be resolved with power Doppler imaging, can be well-separated with the proposed method. Improved contrast ratios using the proposed method were shown compared with that of the conventional deep-ULM method. Additionally, the processing time to reconstruct a high-resolution ultrasound frame with an image size of 1024 × 512 pixels was around 16 ms, comparable to state-of-the-art deep-ULMs.
Collapse
Affiliation(s)
- U-Wai Lok
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Chengwu Huang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Ping Gong
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Shanshan Tang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Lulu Yang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
- West China Hospital of Sichuan University, Chengdu, Sichuan 610041, China
| | - Wei Zhang
- Department of Ultrasound, Guangdong Key Laboratory of Liver Disease Research, Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Yohan Kim
- Department of Urology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Panagiotis Korfiatis
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Daniel J. Blezek
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Fabrice Lucien
- Department of Urology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Rongqin Zheng
- Department of Ultrasound, Guangdong Key Laboratory of Liver Disease Research, Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Joshua D. Trzasko
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| | - Shigao Chen
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN
| |
Collapse
|
31
|
van Sloun RJG, Solomon O, Bruce M, Khaing ZZ, Wijkstra H, Eldar YC, Mischi M. Super-Resolution Ultrasound Localization Microscopy Through Deep Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:829-839. [PMID: 33180723 DOI: 10.1109/tmi.2020.3037790] [Citation(s) in RCA: 39] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Ultrasound localization microscopy has enabled super-resolution vascular imaging through precise localization of individual ultrasound contrast agents (microbubbles) across numerous imaging frames. However, analysis of high-density regions with significant overlaps among the microbubble point spread responses yields high localization errors, constraining the technique to low-concentration conditions. As such, long acquisition times are required to sufficiently cover the vascular bed. In this work, we present a fast and precise method for obtaining super-resolution vascular images from high-density contrast-enhanced ultrasound imaging data. This method, which we term Deep Ultrasound Localization Microscopy (Deep-ULM), exploits modern deep learning strategies and employs a convolutional neural network to perform localization microscopy in dense scenarios, learning the nonlinear image-domain implications of overlapping RF signals originating from such sets of closely spaced microbubbles. Deep-ULM is trained effectively using realistic on-line synthesized data, enabling robust inference in-vivo under a wide variety of imaging conditions. We show that deep learning attains super-resolution with challenging contrast-agent densities, both in-silico as well as in-vivo. Deep-ULM is suitable for real-time applications, resolving about 70 high-resolution patches ( 128×128 pixels) per second on a standard PC. Exploiting GPU computation, this number increases to 1250 patches per second.
Collapse
|
32
|
Kupsch C, Feierabend L, Nauber R, Buttner L, Czarske J. Ultrasound Super-Resolution Flow Measurement of Suspensions in Narrow Channels. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2021; 68:807-817. [PMID: 32746205 DOI: 10.1109/tuffc.2020.3007483] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Zinc-air flow batteries provide a scalable and cost-efficient energy storage solution. However, the achieved power density depends on the local flow conditions of the zinc particle suspension in the electrochemical cell. Numerical modeling is challenging due to the complex multiphase fluid and the interaction of flow and electrochemistry. Hence, performing experiments is crucial to investigate the influence of the flow conditions on the electrical performance, which requires flow instrumentation for the opaque suspension. To resolve the flow field across the 2.6-mm-wide flow channel of the investigated zinc-air flow battery (ZAB), a spatial resolution below 100 [Formula: see text] has to be typically achieved. Using ultrasound techniques, the achieved spatial resolution is limited by the trade-off between ultrasound frequency and imaging depth. This trade-off is even more critical for suspensions due to the scattering of the ultrasound, which increases strongly with frequency. We propose super-resolution particle tracking velocimetry (SRPTV) to overcome this limitation by achieving the required spatial resolution at a low ultrasound frequency. SRPTV is based on the super-resolution technique ultrasound localization microscopy, which is adapted to strongly scattering suspensions by using a dual-frequency-phased array and applying a coherence weighting beamformer to suppress speckles, which result from the scattering at the zinc particles of the suspension. The spatial resolution and the velocity uncertainty are characterized through calibration measurement and numerical simulation. A spatial resolution of 66 [Formula: see text] at an excitation wavelength of 330 [Formula: see text] was achieved, which is sufficient for performing flow investigation in an operational ZAB. The measured flow profile reveals shear-thinning properties and wall slip and therefore differs significantly from a parabolic flow profile of a Newtonian fluid. The presented technique offers potential for performing flow investigations of suspensions in small geometries with a spatial resolution beyond the diffraction limit.
Collapse
|
33
|
Wang Q, Yang L, Yu J, Chiu PWY, Zheng YP, Zhang L. Real-Time Magnetic Navigation of a Rotating Colloidal Microswarm Under Ultrasound Guidance. IEEE Trans Biomed Eng 2020; 67:3403-3412. [PMID: 32305888 DOI: 10.1109/tbme.2020.2987045] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Untethered microrobots hold great promise for applications in biomedical field including targeted delivery, biosensing, and microsurgery. A major challenge of using microrobots to perform in vivo tasks is the real-time localization and motion control using medical imaging technologies. Here we report real-time magnetic navigation of a paramagnetic nanoparticle-based microswarm under ultrasound guidance. METHODS A three-axis Helmholtz electromagnetic coil system integrated with an ultrasound imaging system is developed for generation, actuation, and closed-loop control of the microswarm. The magnetite nanoparticle-based microswarm is generated and navigated using rotating magnetic fields. In order to localize the microswarm in real time, the dynamic imaging contrast has been analyzed and exploited in image process to increase the signal-to-noise ratio. Moreover, imaging of the microswarm at different depths are experimentally studied and analyzed, and the minimal dose of nanoparticles for localizing a microswarm at different depths is ex vivo investigated. For real-time navigating the microswarm in a confined environment, a PI control scheme is designed. RESULTS Image differencing-based processing increases the signal-to-noise ratio, and the microswarm can be ex vivo localized at depth of 2.2-7.8 cm. Experimental results show that the microswarm is able to be real-time navigated along a planned path in a channel, and the average steady-state error is 0.27 mm ( ∼ 33.7% of the body length). SIGNIFICANCE The colloidal microswarm is real-time localized and navigated using ultrasound feedback, which shows great potential for biomedical applications that require real-time noninvasive tracking.
Collapse
|
34
|
Tang S, Song P, Trzasko JD, Lowerison M, Huang C, Gong P, Lok UW, Manduca A, Chen S. Kalman Filter-Based Microbubble Tracking for Robust Super-Resolution Ultrasound Microvessel Imaging. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2020; 67:1738-1751. [PMID: 32248099 PMCID: PMC7485263 DOI: 10.1109/tuffc.2020.2984384] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Contrast microbubble (MB)-based super-resolution ultrasound microvessel imaging (SR-UMI) overcomes the compromise in conventional ultrasound imaging between spatial resolution and penetration depth and has been successfully applied to a wide range of clinical applications. However, clinical translation of SR-UMI remains challenging due to the limited number of MBs detected within a given accumulation time. Here, we propose a Kalman filter-based method for robust MB tracking and improved blood flow speed measurement with reduced numbers of MBs. An acceleration constraint and a direction constraint for MB movement were developed to control the quality of the estimated MB trajectory. An adaptive interpolation approach was developed to inpaint the missing microvessel signal based on the estimated local blood flow speed, facilitating more robust depiction of microvasculature with a limited amount of MBs. The proposed method was validated on an ex ovo chorioallantoic membrane and an in vivo rabbit kidney. Results demonstrated improved imaging performance on both microvessel density maps and blood flow speed maps. With the proposed method, the percentage of microvessel filling in a selected blood vessel at a given accumulation period was increased from 28.17% to 74.45%. A similar SR-UMI performance was achieved with MB numbers reduced by 85.96%, compared to that with the original MB number. The results indicate that the proposed method substantially improves the robustness of SR-UMI under a clinically relevant imaging scenario where SR-UMI is challenged by a limited MB accumulation time, reduced number of MBs, lowered imaging frame rate, and degraded signal-to-noise ratio.
Collapse
Affiliation(s)
- Shanshan Tang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
| | - Pengfei Song
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801
| | - Joshua D. Trzasko
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
| | - Matthew Lowerison
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801
| | - Chengwu Huang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
| | - Ping Gong
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
| | - U-Wai Lok
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
| | - Armando Manduca
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
| | - Shigao Chen
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905
- Corresponding Author: Shigao Chen ()
| |
Collapse
|
35
|
Dencks S, Piepenbrock M, Schmitz G. Assessing Vessel Reconstruction in Ultrasound Localization Microscopy by Maximum Likelihood Estimation of a Zero-Inflated Poisson Model. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2020; 67:1603-1612. [PMID: 32167890 DOI: 10.1109/tuffc.2020.2980063] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
In clinical applications of super-resolution ultrasound imaging, it is often not possible to achieve a full reconstruction of the microvasculature within a limited measurement time. This makes the comparison of studies and quantitative parameters of vascular morphology and perfusion difficult. Therefore, saturation models were proposed to predict adequate measurement times and estimate the degree of vessel reconstruction. Here, we derive a statistical model for the microbubble counts in super-resolution voxels by a zero-inflated Poisson (ZIP) process. In this model, voxels either belong to vessels with probability Pv and count events with Poisson rate Λ , or they are empty and remain zero. In this model, Pv represents the vessel voxel density in the super-resolution image after infinite measurement time. For the parameters Pv and Λ , we give Cramér-Rao lower bounds (CRLBs) for the estimation variance and derive maximum likelihood estimators (MLEs) in a novel closed-form solution. These can be calculated with knowledge of only the counts at the end of the acquisition time. The estimators are applied to preclinical and clinical data and the MLE outperforms alternative estimators proposed before. The estimated degree of reconstruction lies between 38% and 74% after less than 90 s. Vessel probability Pv ranged from 4% to 20%. The rate parameter Λ was estimated in the range of 0.5-1.3 microbubbles/voxel. For these parameter ranges, the CRLB gives standard deviations of less than 2%, which supports that the parameters can be estimated with good precision already for limited acquisition times.
Collapse
|
36
|
Zhang J, Li N, Dong F, Liang S, Wang D, An J, Long Y, Wang Y, Luo Y, Zhang J. Ultrasound Microvascular Imaging Based on Super-Resolution Radial Fluctuations. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2020; 39:1507-1516. [PMID: 32064662 DOI: 10.1002/jum.15238] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2019] [Revised: 01/02/2020] [Accepted: 01/27/2020] [Indexed: 06/10/2023]
Abstract
OBJECTIVES Super-resolution ultrasound (SRUS) has become a tool for in vivo microvascular imaging. Most of the SRUS methods are based on microbubble localization: namely, ultrasound localization microscopy (ULM). The aim of this study was to develop a nonlocalization SRUS method and verify its feasibility in microvascular imaging. METHODS We introduce a new super-resolution strategy based on the postprocessing of contrast-enhanced ultrasound. The proposed method, which is termed ultrasound diffraction attenuation microscopy (UDAM), uses super-resolution radial fluctuations instead of microbubble localization to overcome acoustic diffraction limits. Biceps of Japanese long-ear white rabbits were adopted to validate its feasibility on muscle vascular imaging, using a clinical accessible ultrasound system at a frame rate of 30 Hz under a single bolus injection of SonoVue (Bracco SpA, Milan, Italy). The super-resolution image was compared with the maximum-intensity projection and ULM. RESULTS The animal study illustrates that the proposed UDAM can obtain super-resolution microvascular images of rabbits' muscles under a single bolus injection of SonoVue with a 150-second contrast-enhanced ultrasound video. Both ULM and UDAM can achieve a very similar vascular structure with the maximum-intensity projection but much higher spatial resolution. The measurement of 1-dimensional signals shows that UDAM can distinguish the subwavelength structures and substantial reduce the full width at half-maximum of microvessels. CONCLUSIONS We conclude UDAM provides a noninvasive tool for in vivo super-resolution microvascular imaging.
Collapse
Affiliation(s)
- Jiabin Zhang
- Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China
- Institute of Molecular Medicine, Peking University, Beijing, China
| | - Nan Li
- Department of Ultrasound, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Feihong Dong
- Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China
| | - Shuyuan Liang
- Department of Ultrasound, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Di Wang
- Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China
| | - Jian An
- Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China
| | - Yunfei Long
- College of Engineering, Peking University, Beijing, China
| | - Yuexiang Wang
- Department of Ultrasound, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Yukun Luo
- Department of Ultrasound, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Jue Zhang
- Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China
- College of Engineering, Peking University, Beijing, China
| |
Collapse
|
37
|
Espíndola D, DeRuiter RM, Santibanez F, Dayton PA, Pinton G. Quantitative sub-resolution blood velocity estimation using ultrasound localization microscopy ex-vivo and in-vivo. Biomed Phys Eng Express 2020; 6:035019. [DOI: 10.1088/2057-1976/ab7f26] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
|
38
|
Huang C, Lowerison MR, Trzasko JD, Manduca A, Bresler Y, Tang S, Gong P, Lok UW, Song P, Chen S. Short Acquisition Time Super-Resolution Ultrasound Microvessel Imaging via Microbubble Separation. Sci Rep 2020; 10:6007. [PMID: 32265457 PMCID: PMC7138805 DOI: 10.1038/s41598-020-62898-9] [Citation(s) in RCA: 53] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2019] [Accepted: 03/09/2020] [Indexed: 01/07/2023] Open
Abstract
Super-resolution ultrasound localization microscopy (ULM), based on localization and tracking of individual microbubbles (MBs), offers unprecedented microvascular imaging resolution at clinically relevant penetration depths. However, ULM is currently limited by the requirement of dilute MB concentrations to ensure spatially sparse MB events for accurate localization and tracking. The corresponding long imaging acquisition times (tens of seconds or several minutes) to accumulate sufficient isolated MB events for full reconstruction of microvasculature preclude the clinical translation of the technique. To break this fundamental tradeoff between acquisition time and MB concentration, in this paper we propose to separate spatially overlapping MB events into sub-populations, each with sparser MB concentration, based on spatiotemporal differences in the flow dynamics (flow speeds and directions). MB localization and tracking are performed for each sub-population separately, permitting more robust ULM imaging of high-concentration MB injections. The superiority of the proposed MB separation technique over conventional ULM processing is demonstrated in flow channel phantom data, and in the chorioallantoic membrane of chicken embryos with optical imaging as an in vivo reference standard. Substantial improvement of ULM is further demonstrated on a chicken embryo tumor xenograft model and a chicken brain, showing both morphological and functional microvasculature details at super-resolution within a short acquisition time (several seconds). The proposed technique allows more robust MB localization and tracking at relatively high MB concentrations, alleviating the need for dilute MB injections, and thereby shortening the acquisition time of ULM imaging and showing great potential for clinical translation.
Collapse
Affiliation(s)
- Chengwu Huang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, USA
| | - Matthew R Lowerison
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, USA
- Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, IL, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| | - Joshua D Trzasko
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, USA
| | - Armando Manduca
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Yoram Bresler
- Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, IL, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA
- Coordinated Science Laboratory, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| | - Shanshan Tang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, USA
| | - Ping Gong
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, USA
| | - U-Wai Lok
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, USA
| | - Pengfei Song
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, USA.
- Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, IL, USA.
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA.
| | - Shigao Chen
- Department of Radiology, Mayo Clinic College of Medicine and Science, Mayo Clinic, Rochester, MN, USA.
| |
Collapse
|
39
|
Christensen-Jeffries K, Couture O, Dayton PA, Eldar YC, Hynynen K, Kiessling F, O'Reilly M, Pinton GF, Schmitz G, Tang MX, Tanter M, van Sloun RJG. Super-resolution Ultrasound Imaging. ULTRASOUND IN MEDICINE & BIOLOGY 2020; 46:865-891. [PMID: 31973952 PMCID: PMC8388823 DOI: 10.1016/j.ultrasmedbio.2019.11.013] [Citation(s) in RCA: 161] [Impact Index Per Article: 40.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/04/2019] [Revised: 11/17/2019] [Accepted: 11/20/2019] [Indexed: 05/02/2023]
Abstract
The majority of exchanges of oxygen and nutrients are performed around vessels smaller than 100 μm, allowing cells to thrive everywhere in the body. Pathologies such as cancer, diabetes and arteriosclerosis can profoundly alter the microvasculature. Unfortunately, medical imaging modalities only provide indirect observation at this scale. Inspired by optical microscopy, ultrasound localization microscopy has bypassed the classic compromise between penetration and resolution in ultrasonic imaging. By localization of individual injected microbubbles and tracking of their displacement with a subwavelength resolution, vascular and velocity maps can be produced at the scale of the micrometer. Super-resolution ultrasound has also been performed through signal fluctuations with the same type of contrast agents, or through switching on and off nano-sized phase-change contrast agents. These techniques are now being applied pre-clinically and clinically for imaging of the microvasculature of the brain, kidney, skin, tumors and lymph nodes.
Collapse
Affiliation(s)
- Kirsten Christensen-Jeffries
- Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Sciences, King's College London, St Thomas' Hospital, London, United Kingdom
| | - Olivier Couture
- Institute of Physics for Medicine Paris, Inserm U1273, ESPCI Paris, CNRS FRE 2031, PSL University, Paris, France.
| | - Paul A Dayton
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, North Carolina, USA
| | - Yonina C Eldar
- Department of Mathematics and Computer Science, Weizmann Institute of Science, Rehovot, Israel
| | - Kullervo Hynynen
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, Ontario, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Canada; Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada
| | - Fabian Kiessling
- Institute for Experimental Molecular Imaging, RWTH Aachen University, Aachen, Germany
| | - Meaghan O'Reilly
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, Ontario, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Canada
| | - Gianmarco F Pinton
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, North Carolina, USA
| | - Georg Schmitz
- Chair for Medical Engineering, Faculty for Electrical Engineering and Information Technology, Ruhr University Bochum, Bochum, Germany
| | - Meng-Xing Tang
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Mickael Tanter
- Institute of Physics for Medicine Paris, Inserm U1273, ESPCI Paris, CNRS FRE 2031, PSL University, Paris, France
| | - Ruud J G van Sloun
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| |
Collapse
|
40
|
Harput S, Christensen-Jeffries K, Ramalli A, Brown J, Zhu J, Zhang G, Leow CH, Toulemonde M, Boni E, Tortoli P, Eckersley RJ, Dunsby C, Tang MX. 3-D Super-Resolution Ultrasound Imaging With a 2-D Sparse Array. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2020; 67:269-277. [PMID: 31562080 PMCID: PMC7614008 DOI: 10.1109/tuffc.2019.2943646] [Citation(s) in RCA: 43] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
High-frame-rate 3-D ultrasound imaging technology combined with super-resolution processing method can visualize 3-D microvascular structures by overcoming the diffraction-limited resolution in every spatial direction. However, 3-D super-resolution ultrasound imaging using a full 2-D array requires a system with a large number of independent channels, the design of which might be impractical due to the high cost, complexity, and volume of data produced. In this study, a 2-D sparse array was designed and fabricated with 512 elements chosen from a density-tapered 2-D spiral layout. High-frame-rate volumetric imaging was performed using two synchronized ULA-OP 256 research scanners. Volumetric images were constructed by coherently compounding nine-angle plane waves acquired at a pulse repetition frequency of 4500 Hz. Localization-based 3-D super-resolution images of two touching subwavelength tubes were generated from 6000 volumes acquired in 12 s. Finally, this work demonstrates the feasibility of 3-D super-resolution imaging and super-resolved velocity mapping using a customized 2-D sparse array transducer.
Collapse
Affiliation(s)
- Sevan Harput
- ULIS Group, Department of Bioengineering, Imperial College London, London SW7 2AZ, U.K., and also with the Division of Electrical and Electronic Engineering, London South Bank University, London SE1 0AA, U.K
| | | | - Alessandro Ramalli
- Department of Information Engineering, University of Florence, 50139 Florence, Italy, and also with the Laboratory of Cardiovascular Imaging and Dynamics, Department of Cardiovascular Sciences, KU Leuven, 3000 Leuven, Belgium
| | - Jemma Brown
- Biomedical Engineering Department, Division of Imaging Sciences, King’s College London, London SE1 7EH, U.K
| | - Jiaqi Zhu
- ULIS Group, Department of Bioengineering, Imperial College London, London SW7 2AZ, U.K
| | - Ge Zhang
- ULIS Group, Department of Bioengineering, Imperial College London, London SW7 2AZ, U.K
| | - Chee Hau Leow
- ULIS Group, Department of Bioengineering, Imperial College London, London SW7 2AZ, U.K
| | - Matthieu Toulemonde
- ULIS Group, Department of Bioengineering, Imperial College London, London SW7 2AZ, U.K
| | - Enrico Boni
- Department of Information Engineering, University of Florence, 50139 Florence, Italy
| | - Piero Tortoli
- Department of Information Engineering, University of Florence, 50139 Florence, Italy
| | - Robert J. Eckersley
- Biomedical Engineering Department, Division of Imaging Sciences, King’s College London, London SE1 7EH, U.K
| | - Chris Dunsby
- Department of Physics and the Centre for Pathology, Imperial College London, London SW7 2AZ, U.K
| | - Meng-Xing Tang
- ULIS Group, Department of Bioengineering, Imperial College London, London SW7 2AZ, U.K
| |
Collapse
|
41
|
Denis de Senneville B, Frulio N, Laumonier H, Salut C, Lafitte L, Trillaud H. Liver contrast-enhanced sonography: computer-assisted differentiation between focal nodular hyperplasia and inflammatory hepatocellular adenoma by reference to microbubble transport patterns. Eur Radiol 2020; 30:2995-3003. [PMID: 32002637 DOI: 10.1007/s00330-019-06566-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Revised: 10/21/2019] [Accepted: 10/30/2019] [Indexed: 01/17/2023]
Abstract
OBJECTIVE A new computer tool is proposed to distinguish between focal nodular hyperplasia (FNH) and an inflammatory hepatocellular adenoma (I-HCA) using contrast-enhanced ultrasound (CEUS). The new method was compared with the usual qualitative analysis. METHODS The proposed tool embeds an "optical flow" algorithm, designed to mimic the human visual perception of object transport in image series, to quantitatively analyse apparent microbubble transport parameters visible on CEUS. Qualitative (visual) and quantitative (computer-assisted) CEUS data were compared in a cohort of adult patients with either FNH or I-HCA based on pathological and radiological results. For quantitative analysis, several computer-assisted classification models were tested and subjected to cross-validation. The accuracies, area under the receiver-operating characteristic curve (AUROC), sensitivity and specificity, positive predictive values (PPVs), negative predictive values (NPVs), false predictive rate (FPRs) and false negative rate (FNRs) were recorded. RESULTS Forty-six patients with FNH (n = 29) or I-HCA (n = 17) with 47 tumours (one patient with 2 I-HCA) were analysed. The qualitative diagnostic parameters were accuracy = 93.6%, AUROC = 0.94, sensitivity = 94.4%, specificity = 93.1%, PPV = 89.5%, NPV = 96.4%, FPR = 6.9% and FNR = 5.6%. The quantitative diagnostic parameters were accuracy = 95.9%, AUROC = 0.97, sensitivity = 93.4%, specificity = 97.6%, PPV = 95.3%, NPV = 96.7%, FPR = 2.4% and FNR = 6.6%. CONCLUSIONS Microbubble transport patterns evident on CEUS are valuable diagnostic indicators. Machine-learning algorithms analysing such data facilitate the diagnosis of FNH and I-HCA tumours. KEY POINTS • Distinguishing between focal nodular hyperplasia and an inflammatory hepatocellular adenoma using dynamic contrast-enhanced ultrasound is sometimes difficult. • Microbubble transport patterns evident on contrast-enhanced sonography are valuable diagnostic indicators. • Machine-learning algorithms analysing microbubble transport patterns facilitate the diagnosis of FNH and I-HCA.
Collapse
Affiliation(s)
- Baudouin Denis de Senneville
- Institut de Mathématiques de Bordeaux (IMB), UMR 5251 CNRS/Université de Bordeaux, 351 cours de la Libération, F-33405, Talence, France.
| | - Nora Frulio
- CHU de Bordeaux, Service d'imagerie diagnostique et Interventionnelle Magellan/Saint André, F-33000, Bordeaux, France
| | - Hervé Laumonier
- CHU de Bordeaux, Service d'imagerie diagnostique et Interventionnelle Magellan/Saint André, F-33000, Bordeaux, France
| | - Cécile Salut
- CHU de Bordeaux, Service d'imagerie diagnostique et Interventionnelle Magellan/Saint André, F-33000, Bordeaux, France
| | - Luc Lafitte
- Institut de Mathématiques de Bordeaux (IMB), UMR 5251 CNRS/Université de Bordeaux, 351 cours de la Libération, F-33405, Talence, France
| | - Hervé Trillaud
- CHU de Bordeaux, Service d'imagerie diagnostique et Interventionnelle Magellan/Saint André, F-33000, Bordeaux, France.,EA IMOTION (Imagerie moléculaire et thérapies innovantes en oncologie), Université de Bordeaux, F-33000, Bordeaux, France
| |
Collapse
|
42
|
Soulioti DE, Espindola D, Dayton PA, Pinton GF. Super-Resolution Imaging Through the Human Skull. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2020; 67:25-36. [PMID: 31494546 DOI: 10.1109/tuffc.2019.2937733] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
High-resolution transcranial ultrasound imaging in humans has been a persistent challenge for ultrasound due to the imaging degradation effects from aberration and reverberation. These mechanisms depend strongly on skull morphology and have high variability across individuals. Here, we demonstrate the feasibility of human transcranial super-resolution imaging using a geometrical focusing approach to efficiently concentrate energy at the region of interest, and a phase correction focusing approach that takes the skull morphology into account. It is shown that using the proposed focused super-resolution method, we can image a 208- [Formula: see text] microtube behind a human skull phantom in both an out-of-plane and an in-plane configuration. Individual phase correction profiles for the temporal region of the human skull were calculated and subsequently applied to transmit-receive a custom focused super-resolution imaging sequence through a human skull phantom, targeting the 208- [Formula: see text] diameter microtube at 68.5 mm in depth and at 2.5 MHz. Microbubble contrast agents were diluted to a concentration of 1.6×106 bubbles/mL and perfused through the microtube. It is shown that by correcting for the skull aberration, the RF signal amplitude from the tube improved by a factor of 1.6 in the out-of-plane focused emission case. The lateral registration error of the tube's position, which in the uncorrected case was 990 [Formula: see text], was reduced to as low as 50 [Formula: see text] in the corrected case as measured in the B-mode images. Sensitivity in microbubble detection for the phase-corrected case increased by a factor of 1.48 in the out-of-plane imaging case, while, in the in-plane target case, it improved by a factor of 1.31 while achieving an axial registration correction from an initial 1885- [Formula: see text] error for the uncorrected emission, to a 284- [Formula: see text] error for the corrected counterpart. These findings suggest that super-resolution imaging may be used far more generally as a clinical imaging modality in the brain.
Collapse
|
43
|
Abstract
Ultrasound imaging plays an important role in oncological imaging for more than five decades now. It can be applied in all tissues that are not occluded by bone or gas-filled regions. The quality of ultrasound images benefitted strongly from improved electronics and increased computational power. To the morphological imaging, several functional imaging methods were added: Flow visualization became possible by Doppler techniques and as a recent addition the elastic properties of tissues can be imaged by elastographic methods with transient shear wave imaging. In the beginning of molecular imaging, ultrasound with its contrast based on mechanical tissue properties was an unlikely candidate to play a role. However, with contrast agents consisting of micrometer-sized gas bubbles, which can be imaged with high sensitivity, ligands addressing targets in the vascular wall could be used. Because even single bubbles can be detected, this led to various ultrasound molecular imaging techniques and the ongoing development of clinical molecular contrast media. In this chapter, the basic properties of ultrasonic imaging like its contrast mechanisms and spatiotemporal resolution are discussed. The image formation and its ongoing change from line-oriented scanning to full-volume reconstructions are explained. Then, the ultrasound contrast media and imaging techniques are introduced and emerging new methods like super-resolution vascular imaging demonstrate the ongoing development in this field.
Collapse
|
44
|
Solomon O, van Sloun RJG, Wijkstra H, Mischi M, Eldar YC. Exploiting Flow Dynamics for Superresolution in Contrast-Enhanced Ultrasound. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2019; 66:1573-1586. [PMID: 31265391 DOI: 10.1109/tuffc.2019.2926062] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Ultrasound (US) localization microscopy offers new radiation-free diagnostic tools for vascular imaging deep within the tissue. Sequential localization of echoes returned from inert microbubbles (MBs) with low concentration within the bloodstream reveals the vasculature with capillary resolution. Despite its high spatial resolution, low MB concentrations dictate the acquisition of tens of thousands of images, over the course of several seconds to tens of seconds, to produce a single superresolved image. Such long acquisition times and stringent constraints on MB concentration are undesirable in many clinical scenarios. To address these restrictions, sparsity-based approaches have recently been developed. These methods reduce the total acquisition time dramatically, while maintaining good spatial resolution in settings with considerable MB overlap. Here, we further improve the spatial resolution and visual vascular reconstruction quality of sparsity-based superresolution US imaging from low-frame rate acquisitions, by exploiting the inherent flow of MBs and utilize their motion kinematics. We also provide quantitative measurements of MB velocities and show that our approach achieves higher MB recall rate than the state-of-the-art techniques, while increasing contrast agents concentration. Our method relies on simultaneous tracking and sparsity-based detection of individual MBs in a frame-by-frame manner, and as such, may be suitable for real-time implementation. The effectiveness of the proposed approach is demonstrated on both simulations and an in vivo contrast-enhanced human prostate scan, acquired with a clinically approved scanner operating at a 10-Hz frame rate.
Collapse
|
45
|
Ghosh D, Peng J, Brown K, Sirsi S, Mineo C, Shaul PW, Hoyt K. Super-Resolution Ultrasound Imaging of Skeletal Muscle Microvascular Dysfunction in an Animal Model of Type 2 Diabetes. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2019; 38:2589-2599. [PMID: 30706511 PMCID: PMC6669112 DOI: 10.1002/jum.14956] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2018] [Revised: 12/26/2018] [Accepted: 01/06/2019] [Indexed: 05/03/2023]
Abstract
OBJECTIVES To evaluate the use of super-resolution ultrasound (SR-US) imaging for quantifying microvascular changes in skeletal muscle using a mouse model of type 2 diabetes. METHODS Study groups were young, standard chow-fed male C57BL/6J mice (lean group) and high fat diet-fed older mice (obese group). After an overnight fast, dynamic contrast-enhanced US imaging was performed on the proximal hind limb adductor muscle group for 10 minutes at baseline and again at 1 and 2 hours during administration of a hyperinsulinemic-euglycemic clamp. Dynamic contrast-enhanced US images were collected on a clinical US scanner (Acuson Sequoia 512; Siemens Healthcare, Mountain View, CA) equipped with a 15L8 linear array transducer. Dynamic contrast-enhanced US images were processed with a spatiotemporal filter to remove tissue clutter. Individual microbubbles were localized and counted to create an SR-US image. A frame-by-frame analysis of the microbubble count was generated (ie, time-microbubble count curve [TMC]) to estimate tissue perfusion and microvascular blood flow. The conventional time-intensity curve (TIC) was also generated for comparison. RESULTS In vivo SR-US imaging could delineate microvascular structures in the mouse hind limb. Compared with lean animals, insulin-induced microvascular recruitment was attenuated in the obese group. The SR-US-based TMC analysis revealed differences between lean and obese animal data for select microvascular parameters (P < .04), which was not true for TIC-based measurements. Whereas the TMC and TIC microvascular parameters yielded similar temporal trends, there was less variance associated with the TMC-derived values. CONCLUSIONS Super-resolution US imaging is a new modality for measuring the microvascular properties of skeletal muscle and dysfunction from type 2 diabetes.
Collapse
Affiliation(s)
- Debabrata Ghosh
- Department of Electronics and Communication Engineering, Thapar Institute of Engineering and Technology, Patiala, India
- Department of Bioengineering, University of Texas at Dallas, Richardson, Texas, USA
| | - Jun Peng
- Center for Pulmonary and Vascular Biology, Department of Pediatrics, University of Texas Southwestern Medical Center, Dallas, Texas, USA
| | - Katherine Brown
- Department of Bioengineering, University of Texas at Dallas, Richardson, Texas, USA
| | - Shashank Sirsi
- Department of Bioengineering, University of Texas at Dallas, Richardson, Texas, USA
- Center for Pulmonary and Vascular Biology, Department of Pediatrics, University of Texas Southwestern Medical Center, Dallas, Texas, USA
| | - Chieko Mineo
- Center for Pulmonary and Vascular Biology, Department of Pediatrics, University of Texas Southwestern Medical Center, Dallas, Texas, USA
| | - Philip W Shaul
- Center for Pulmonary and Vascular Biology, Department of Pediatrics, University of Texas Southwestern Medical Center, Dallas, Texas, USA
| | - Kenneth Hoyt
- Department of Bioengineering, University of Texas at Dallas, Richardson, Texas, USA
- Department of Radiology, University of Texas Southwestern Medical Center, Dallas, Texas, USA
| |
Collapse
|
46
|
Kanoulas E, Butler M, Rowley C, Voulgaridou V, Diamantis K, Duncan WC, McNeilly A, Averkiou M, Wijkstra H, Mischi M, Wilson RS, Lu W, Sboros V. Super-Resolution Contrast-Enhanced Ultrasound Methodology for the Identification of In Vivo Vascular Dynamics in 2D. Invest Radiol 2019; 54:500-516. [PMID: 31058661 PMCID: PMC6661242 DOI: 10.1097/rli.0000000000000565] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2018] [Revised: 02/20/2019] [Accepted: 02/20/2019] [Indexed: 12/11/2022]
Abstract
OBJECTIVES The aim of this study was to provide an ultrasound-based super-resolution methodology that can be implemented using clinical 2-dimensional ultrasound equipment and standard contrast-enhanced ultrasound modes. In addition, the aim is to achieve this for true-to-life patient imaging conditions, including realistic examination times of a few minutes and adequate image penetration depths that can be used to scan entire organs without sacrificing current super-resolution ultrasound imaging performance. METHODS Standard contrast-enhanced ultrasound was used along with bolus or infusion injections of SonoVue (Bracco, Geneva, Switzerland) microbubble (MB) suspensions. An image analysis methodology, translated from light microscopy algorithms, was developed for use with ultrasound contrast imaging video data. New features that are tailored for ultrasound contrast image data were developed for MB detection and segmentation, so that the algorithm can deal with single and overlapping MBs. The method was tested initially on synthetic data, then with a simple microvessel phantom, and then with in vivo ultrasound contrast video loops from sheep ovaries. Tracks detailing the vascular structure and corresponding velocity map of the sheep ovary were reconstructed. Images acquired from light microscopy, optical projection tomography, and optical coherence tomography were compared with the vasculature network that was revealed in the ultrasound contrast data. The final method was applied to clinical prostate data as a proof of principle. RESULTS Features of the ovary identified in optical modalities mentioned previously were also identified in the ultrasound super-resolution density maps. Follicular areas, follicle wall, vessel diameter, and tissue dimensions were very similar. An approximately 8.5-fold resolution gain was demonstrated in vessel width, as vessels of width down to 60 μm were detected and verified (λ = 514 μm). Best agreement was found between ultrasound measurements and optical coherence tomography with 10% difference in the measured vessel widths, whereas ex vivo microscopy measurements were significantly lower by 43% on average. The results were mostly achieved using video loops of under 2-minute duration that included respiratory motion. A feasibility study on a human prostate showed good agreement between density and velocity ultrasound maps with the histological evaluation of the location of a tumor. CONCLUSIONS The feasibility of a 2-dimensional contrast-enhanced ultrasound-based super-resolution method was demonstrated using in vitro, synthetic and in vivo animal data. The method reduces the examination times to a few minutes using state-of-the-art ultrasound equipment and can provide super-resolution maps for an entire prostate with similar resolution to that achieved in other studies.
Collapse
Affiliation(s)
- Evangelos Kanoulas
- From the Institute of Biochemistry, Biological Physics, and Bio Engineering, and
| | - Mairead Butler
- From the Institute of Biochemistry, Biological Physics, and Bio Engineering, and
| | - Caitlin Rowley
- Department of Physics, Heriot-Watt University, Riccarton
| | - Vasiliki Voulgaridou
- From the Institute of Biochemistry, Biological Physics, and Bio Engineering, and
| | | | - William Colin Duncan
- Center for Reproductive Health, University of Edinburgh, Edinburgh, United Kingdom
| | - Alan McNeilly
- Center for Reproductive Health, University of Edinburgh, Edinburgh, United Kingdom
| | | | | | - Massimo Mischi
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands; and
| | - Rhodri Simon Wilson
- **Oxford Institute for Radiation Oncology, Department of Oncology, University of Oxford, Oxford, United Kingdom
| | - Weiping Lu
- From the Institute of Biochemistry, Biological Physics, and Bio Engineering, and
| | - Vassilis Sboros
- From the Institute of Biochemistry, Biological Physics, and Bio Engineering, and
| |
Collapse
|
47
|
Zhu J, Rowland EM, Harput S, Riemer K, Leow CH, Clark B, Cox K, Lim A, Christensen-Jeffries K, Zhang G, Brown J, Dunsby C, Eckersley RJ, Weinberg PD, Tang MX. 3D Super-Resolution US Imaging of Rabbit Lymph Node Vasculature in Vivo by Using Microbubbles. Radiology 2019; 291:642-650. [PMID: 30990382 DOI: 10.1148/radiol.2019182593] [Citation(s) in RCA: 53] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Background Variations in lymph node (LN) microcirculation can be indicative of metastasis. The identification and quantification of metastatic LNs remains essential for prognosis and treatment planning, but a reliable noninvasive imaging technique is lacking. Three-dimensional super-resolution (SR) US has shown potential to noninvasively visualize microvascular networks in vivo. Purpose To study the feasibility of three-dimensional SR US imaging of rabbit LN microvascular structure and blood flow by using microbubbles. Materials and Methods In vivo studies were carried out to image popliteal LNs of two healthy male New Zealand white rabbits aged 6-8 weeks. Three-dimensional, high-frame-rate, contrast material-enhanced US was achieved by mechanically scanning with a linear imaging probe. Individual microbubbles were identified, localized, and tracked to form three-dimensional SR images and super-resolved velocity maps. Acoustic subaperture processing was used to improve image contrast and to generate enhanced power Doppler and color Doppler images. Vessel size and blood flow velocity distributions were evaluated and assessed by using Student paired t test. Results SR images revealed microvessels in the rabbit LN, with branches clearly resolved when separated by 30 µm, which is less than half of the acoustic wavelength and not resolvable by using power or color Doppler. The apparent size distribution of most vessels in the SR images was below 80 µm and agrees with micro-CT data, whereas most of those detected with Doppler techniques were larger than 80 µm in the images. The blood flow velocity distribution indicated that most of the blood flow in rabbit popliteal LN was at velocities lower than 5 mm/sec. Conclusion Three-dimensional super-resolution US imaging using microbubbles allows noninvasive nonionizing visualization and quantification of lymph node microvascular structures and blood flow dynamics with resolution below the wave diffraction limit. This technology has potential for studying the physiologic functions of the lymph system and for clinical detection of lymph node metastasis. Published under a CC BY 4.0 license. Online supplemental material is available for this article.
Collapse
Affiliation(s)
- Jiaqi Zhu
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Ethan M Rowland
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Sevan Harput
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Kai Riemer
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Chee Hau Leow
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Brett Clark
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Karina Cox
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Adrian Lim
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Kirsten Christensen-Jeffries
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Ge Zhang
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Jemma Brown
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Christopher Dunsby
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Robert J Eckersley
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Peter D Weinberg
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| | - Meng-Xing Tang
- From the Department of Bioengineering, Imperial College London, South Kensington Campus, London SW7 2AZ, England (J.Z., E.M.R., S.H., K.R., C.H.L., G.Z., P.D.W., M.X.T.); Department of Surgery, Maidstone and Tunbridge Wells NHS Trust, Maidstone, England (K.C.); Department of Imaging, Charing Cross Hospital, Fulham Palace Rd, London, England (A.L.); Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, Kings College London, London, England (K.C.J., J.B., R.J.E.); Department of Physics and Centre for Pathology, Imperial College London, London, England (C.D.); and Department of Imaging, Natural History Museum, London, England (B.C.)
| |
Collapse
|
48
|
Brown J, Christensen-Jeffries K, Harput S, Zhang G, Zhu J, Dunsby C, Tang MX, Eckersley RJ. Investigation of Microbubble Detection Methods for Super-Resolution Imaging of Microvasculature. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2019; 66:676-691. [PMID: 30676955 DOI: 10.1109/tuffc.2019.2894755] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Ultrasound super-resolution techniques use the response of microbubble (MB) contrast agents to visualize the microvasculature. Techniques that localize isolated bubble signals first require detection algorithms to separate the MB and tissue responses. This work explores the three main MB detection techniques for super-resolution of microvasculature. Pulse inversion (PI), differential imaging (DI), and singular value decomposition (SVD) filtering were compared in terms of the localization accuracy, precision, and contrast-to-tissue ratio. MB responses were simulated based on the properties of Sonovue and using the Marmottant model. Nonlinear propagation through tissue was modeled using the k-Wave software package. For the parameters studied, the results show that PI is most appropriate for low frequency applications, but also most dependent on transducer bandwidth. SVD is preferable for high frequency acquisition where localization precision on the order of a few microns is possible. PI is largely independent of flow direction and speed compared to SVD and DI, so is appropriate for visualizing the slowest flows and tortuous vasculature. SVD is unsuitable for stationary MBs and can introduce a localization error on the order of hundreds of microns over the speed range 0-2 mm/s and flow directions from lateral (parallel to probe) to axial (perpendicular to probe). DI is only suitable for flow rates >0.5 mm/s or as flow becomes more axial. Overall, this study develops an MB and tissue nonlinear simulation platform to improve understanding of how different MB detection techniques can impact the super-resolution process and explores some of the factors influencing the suitability of each.
Collapse
|
49
|
Zhang G, Harput S, Hu H, Christensen-Jeffries K, Zhu J, Brown J, Leow CH, Eckersley RJ, Dunsby C, Tang MX. Fast Acoustic Wave Sparsely Activated Localization Microscopy (fast-AWSALM): Ultrasound Super-Resolution using Plane-Wave Activation of Nanodroplets. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2019; 66:1039-1046. [PMID: 30908211 DOI: 10.1109/tuffc.2019.2906496] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Localization-based ultrasound super-resolution imaging using microbubble contrast agents and phase-change nano-droplets has been developed to visualize microvascular structures beyond the diffraction limit. However, the long data acquisition time makes the clinical translation more challenging. In this study, fast acoustic wave sparsely activated localization microscopy (fast-AWSALM) was developed to achieve super-resolved frames with sub-second temporal resolution, by using low-boiling-point octafluoropropane nanodroplets and high frame rate plane waves for activation, destruction, as well as imaging. Fast-AWSALM was demonstrated on an in vitro microvascular phantom to super-resolve structures that could not be resolved by conventional B-mode imaging. The effects of the temperature and mechanical index on fast-AWSALM was investigated. Experimental results show that sub-wavelength micro-structures as small as 190 lm were resolvable in 200 ms with plane-wave transmission at a center frequency of 3.5 MHz and a pulse repetition frequency of 5000 Hz. This is about a 3.5 fold reduction in point spread function full-width-half-maximum compared to that measured in conventional B-mode, and two orders of magnitude faster than the recently reported AWSALM under a non-flow/very slow flow situations and other localization based methods. Just as in AWSALM, fast-AWSALM does not require flow, as is required by current microbubble based ultrasound super resolution techniques. In conclusion, this study shows the promise of fast-AWSALM, a super-resolution ultrasound technique using nanodroplets, which can generate super-resolution images in milli-seconds and does not require flow.
Collapse
|
50
|
Dencks S, Piepenbrock M, Opacic T, Krauspe B, Stickeler E, Kiessling F, Schmitz G. Clinical Pilot Application of Super-Resolution US Imaging in Breast Cancer. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2019; 66:517-526. [PMID: 30273150 DOI: 10.1109/tuffc.2018.2872067] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Recently, we proved in the first measurements of breast carcinomas the feasibility of super-resolution ultrasound (US) imaging by motion-model ultrasound localization microscopy in a clinical setup. Nevertheless, pronounced in-plane and out-of-plane motions, a nonoptimized microbubble injection scheme, the lower frame rate and the larger slice thickness made the processing more complex than in preclinical investigations. Here, we compare the results of state-of-the-art contrast-enhanced to super-resolution US imaging and systematically analyze the measurements to get indications for the improvement of image acquisition and processing in the future clinical studies. In this regard, the application of a saturation model to the reconstructed vessels is shown to be a valuable tool not only to estimate the measurement times necessary to adequately reconstruct the microvasculature but also for the validation of the measurements. The parameters from this model can also serve to optimize contrast agent concentration and injection protocols. Finally, for the measurements of well-perfused tumors, we observed between 28% and 50% filling for 90-s examination times.
Collapse
|