1
|
He X, Cai W, Li F, Fan Q, Zhang P, Cuaron JJ, Cerviño LI, Moran JM, Li X, Li T. Patient specific prior cross attention for kV decomposition in paraspinal motion tracking. Med Phys 2023; 50:5343-5353. [PMID: 37538040 PMCID: PMC11167561 DOI: 10.1002/mp.16644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 06/20/2023] [Accepted: 06/28/2023] [Indexed: 08/05/2023] Open
Abstract
BACKGROUND X-ray image quality is critical for accurate intrafraction motion tracking in radiation therapy. PURPOSE This study aims to develop a deep-learning algorithm to improve kV image contrast by decomposing the image into bony and soft tissue components. In particular, we designed a priori attention mechanism in the neural network framework for optimal decomposition. We show that a patient-specific prior cross-attention (PCAT) mechanism can boost the performance of kV image decomposition. We demonstrate its use in paraspinal SBRT motion tracking with online kV imaging. METHODS Online 2D kV projections were acquired during paraspinal SBRT for patient motion monitoring. The patient-specific prior images were generated by randomly shifting and rotating spine-only DRR created from the setup CBCT, simulating potential motions. The latent features of the prior images were incorporated into the PCAT using multi-head cross attention. The neural network aimed to learn to selectively amplify the transmission of the projection image features that correlate with features of the priori. The PCAT network structure consisted of (1) a dual-branch generator that separates the spine and soft tissue component of the kV projection image and (2) a dual-function discriminator (DFD) that provides the realness score of the predicted images. For supervision, we used a loss combining mean absolute error loss, discriminator loss, perceptual loss, total variation, and mean squared error loss for soft tissues. The proposed PCAT approach was benchmarked against previous work using the ResNet generative adversarial network (ResNetGAN) without prior information. RESULTS The trained PCAT had improved performance in effectively retaining and preserving the spine structure and texture information while suppressing the soft tissues from the kV projection images. The decomposed spine-only x-ray images had the submillimeter matching accuracy at all beam angles. The decomposed spine-only x-ray significantly reduced the maximum errors to 0.44 mm (<2 pixels) in comparison to 0.92 mm (∼4 pixels) of ResNetGAN. The PCAT decomposed spine images also had higher PSNR and SSIM (p-value < 0.001). CONCLUSION The PCAT selectively learned the important latent features by incorporating the patient-specific prior knowledge into the deep learning algorithm, significantly improving the robustness of the kV projection image decomposition, and leading to improved motion tracking accuracy in paraspinal SBRT.
Collapse
Affiliation(s)
- Xiuxiu He
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Weixing Cai
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Feifei Li
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Qiyong Fan
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Pengpeng Zhang
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - John J. Cuaron
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Laura I. Cerviño
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Jean M. Moran
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Xiang Li
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Tianfang Li
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| |
Collapse
|
2
|
Zeng D, Zeng C, Zeng Z, Li S, Deng Z, Chen S, Bian Z, Ma J. Basis and current state of computed tomography perfusion imaging: a review. Phys Med Biol 2022; 67. [PMID: 35926503 DOI: 10.1088/1361-6560/ac8717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 08/04/2022] [Indexed: 12/30/2022]
Abstract
Computed tomography perfusion (CTP) is a functional imaging that allows for providing capillary-level hemodynamics information of the desired tissue in clinics. In this paper, we aim to offer insight into CTP imaging which covers the basics and current state of CTP imaging, then summarize the technical applications in the CTP imaging as well as the future technological potential. At first, we focus on the fundamentals of CTP imaging including systematically summarized CTP image acquisition and hemodynamic parameter map estimation techniques. A short assessment is presented to outline the clinical applications with CTP imaging, and then a review of radiation dose effect of the CTP imaging on the different applications is presented. We present a categorized methodology review on known and potential solvable challenges of radiation dose reduction in CTP imaging. To evaluate the quality of CTP images, we list various standardized performance metrics. Moreover, we present a review on the determination of infarct and penumbra. Finally, we reveal the popularity and future trend of CTP imaging.
Collapse
Affiliation(s)
- Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Cuidie Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhixiong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Sui Li
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhen Deng
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Sijin Chen
- Department of Medical Imaging Center, Nanfang Hospital, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| |
Collapse
|
3
|
Xu S, Fan Z. Iterative Alpha Expansion for estimating gradient‐sparse signals from linear measurements. J R Stat Soc Series B Stat Methodol 2021. [DOI: 10.1111/rssb.12407] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Affiliation(s)
- Sheng Xu
- Department of Statistics and Data Science Yale University New Haven USA
| | - Zhou Fan
- Department of Statistics and Data Science Yale University New Haven USA
| |
Collapse
|
4
|
Chen Z, Zeng D, Huang Z, Ma J, Gu Z, Yang Y, Liu X, Zheng H, Liang D, Hu Z. Temporal feature prior-aided separated reconstruction method for low-dose dynamic myocardial perfusion computed tomography. Phys Med Biol 2021; 66:045012. [PMID: 33333495 DOI: 10.1088/1361-6560/abd4ba] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Dynamic myocardial perfusion computed tomography (DMP-CT) is an effective medical imaging technique for coronary artery disease diagnosis and therapy guidance. However, the radiation dose received by the patient during repeated CT scans is a widespread concern of radiologists because of the increased risk of cancer. The sparse few-view CT scanning protocol can be a feasible approach to reduce the radiation dose of DMP-CT imaging; however, an advanced reconstruction algorithm is needed. In this paper, a temporal feature prior-aided separated reconstruction method (TFP-SR) for low-dose DMP-CT images reconstruction from sparse few-view sinograms is proposed. To implement the proposed method, the objective perfusion image is divided into the baseline fraction and the enhancement fraction introduced by the arrival of the contrast agent. The core of the proposed TFP-SR method is the utilization of the temporal evolution information that naturally exists in the DMP-CT image sequence to aid the enhancement image reconstruction from limited data. The temporal feature vector of an image pixel is defined by the intensities of this pixel in the pre-reconstructed enhancement sequence, and the connection between two related features is calculated via a zero-mean Gaussian function. A prior matrix is constructed based on the connections between the extracted temporal features and used in the iterative reconstruction of the enhancement images. To evaluate the proposed method, the conventional filtered back-projection algorithm, the total variation regularized PWLS (PWLS-TV) and the prior image constrained compressed sensing are compared in this paper based on studies on a digital extended cardiac-torso (XCAT) thoracic phantom and a preclinical porcine DMP-CT data set that take image misregistration into account. The experimental results demonstrate that the proposed TFP-SR method has superior performance in sparse DMP-CT images reconstruction in terms of image quality and the analyses of the time attenuation curve and hemodynamic parameters.
Collapse
Affiliation(s)
- Zixiang Chen
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen 518055, People's Republic of China
| | - Dong Zeng
- College of Automation Science and Engineering, South China University of Technology, Guangzhou 510641, People's Republic of China
| | - Zhenxing Huang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen 518055, People's Republic of China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, People's Republic of China
| | - Zheng Gu
- Institute of Biomedical Engineering, Shenzhen Bay Laboratory, Shenzhen 518107, People's Republic of China
| | - Yongfeng Yang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen 518055, People's Republic of China
| | - Xin Liu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen 518055, People's Republic of China
| | - Hairong Zheng
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen 518055, People's Republic of China
| | - Dong Liang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen 518055, People's Republic of China
| | - Zhanli Hu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen 518055, People's Republic of China.,Institute of Biomedical Engineering, Shenzhen Bay Laboratory, Shenzhen 518107, People's Republic of China
| |
Collapse
|
5
|
Devi M, Singh S, Tiwari S. CT Image Reconstruction using NLMfuzzyCD Regularization Method. Curr Med Imaging 2021; 17:1103-1113. [PMID: 33438549 DOI: 10.2174/1573405617999210112195819] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2020] [Revised: 10/02/2020] [Accepted: 10/07/2020] [Indexed: 11/22/2022]
Abstract
Aims and scope: Computed Tomography (CT) is one of the most efficient clinical diagnostic tools. The main goal of CT is to reproduce an acceptable reconstructed image of an object (either anatomical or functional behaviour) with the help of a limited set of its projections at different angles. BACKGROUND To achieve this goal, one of the most commonly iterative reconstruction algorithm called Maximum Likelihood Expectation Maximization (MLEM) is used. OBJECTIVE Although the conventional Maximum Likelihood (ML) algorithm can achieve quality images in CT. However, it still suffers from the optimal smoothing as the number of iterations increase. METHODS For solving this problem, in this paper present a novel statistical image reconstruction algorithm for CT, which utilizes a nonlocal means fuzzy complex diffusion as a regularization term for noise reduction and edge preservation. RESULTS The proposed model was evaluated on four test cases phantoms. CONCLUSION Qualitative and quantitative analyses indicate that the proposed technique has higher efficiency for computed tomography. The proposed method yields significant improvements when compare with the state-of-the-art techniques.
Collapse
Affiliation(s)
- Manju Devi
- Deenbandhu Chhotu Ram University of Science and Technology, Murthal, Haryana,. India
| | - Sukhdip Singh
- Deenbandhu Chhotu Ram University of Science and Technology, Murthal, Haryana,. India
| | - Shailendra Tiwari
- Thapar Institute of Engineering and Technology (TIET), Patiala, Punjab,. India
| |
Collapse
|
6
|
Yang MX, Xu HY, Zhang L, Chen L, Xu R, Fu H, Liu H, Li XS, Fu C, Liu KL, Li H, Zhou XY, Guo YK, Yang ZG. Myocardial perfusion assessment in the infarct core and penumbra zones in an in-vivo porcine model of the acute, sub-acute, and chronic infarction. Eur Radiol 2020; 31:2798-2808. [PMID: 33156386 DOI: 10.1007/s00330-020-07220-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2019] [Revised: 07/12/2020] [Accepted: 08/21/2020] [Indexed: 02/08/2023]
Abstract
OBJECTIVES To assess the longitudinal changes of microvascular function in different myocardial regions after myocardial infarction (MI) using myocardial blood flow derived by dynamic CT perfusion (CTP-MBF), and compare CTP-MBF with the results of cardiac magnetic resonance (CMR) and histopathology. METHODS The CTP scanning was performed in a MI porcine model 1 day (n = 15), 7 days (n = 10), and 3 months (n = 5) following induction surgery. CTP-MBF was measured in the infarcted myocardium, penumbra, and remote myocardium, respectively. CMR perfusion and histopathology were performed for validation. RESULTS From baseline to follow-up scans, CTP-MBF presented a stepwise increase in the infarcted myocardium (68.51 ± 11.04 vs. 86.73 ± 13.32 vs. 109.53 ± 26.64 ml/100 ml/min, p = 0.001) and the penumbra (104.92 ± 29.29 vs. 120.32 ± 24.74 vs. 183.01 ± 57.98 ml/100 ml/min, p = 0.008), but not in the remote myocardium (150.05 ± 35.70 vs. 166.66 ± 38.17 vs. 195.36 ± 49.64 ml/100 ml/min, p = 0.120). The CTP-MBF correlated with max slope (r = 0.584, p < 0.001), max signal intensity (r = 0.357, p < 0.001), and time to max (r = - 0.378, p < 0.001) by CMR perfusion. Moreover, CTP-MBF defined the infarcted myocardium on triphenyl tetrazolium chloride staining (AUC: 0.810, p < 0.001) and correlated with microvascular density on CD31 staining (r = 0.561, p = 0.002). CONCLUSION CTP-MBF could quantify the longitudinal changes of microvascular function in different regions of the post-MI myocardium, which demonstrates good agreement with contemporary CMR and histopathological findings. KEY POINTS • The CT perfusion-based myocardial blood flow (CTP-MBF) could quantify the microvascular impairment in different myocardial regions after myocardial infarction (MI) and track its recovery over time. • The assessment of CTP-MBF is in good agreement with contemporary cardiac MRI and histopathological findings, which potentially facilitates a rapid approach for pathophysiological insights following MI.
Collapse
Affiliation(s)
- Meng-Xi Yang
- Department of Radiology, State Key Laboratory of Biotherapy and Cancer Center, West China Hospital, Sichuan University, Chengdu, China
| | - Hua-Yan Xu
- Department of Radiology, Key Laboratory of Obstetric & Gynecologic and Pediatric Diseases and Birth Defects of Ministry of Education, West China Second Hospital, Sichuan University, Chengdu, China
| | - Lu Zhang
- Department of Radiology, Key Laboratory of Obstetric & Gynecologic and Pediatric Diseases and Birth Defects of Ministry of Education, West China Second Hospital, Sichuan University, Chengdu, China
| | - Lin Chen
- Department of Radiology, Key Laboratory of Obstetric & Gynecologic and Pediatric Diseases and Birth Defects of Ministry of Education, West China Second Hospital, Sichuan University, Chengdu, China
| | - Rong Xu
- Department of Radiology, Key Laboratory of Obstetric & Gynecologic and Pediatric Diseases and Birth Defects of Ministry of Education, West China Second Hospital, Sichuan University, Chengdu, China
| | - Hang Fu
- Department of Radiology, Key Laboratory of Obstetric & Gynecologic and Pediatric Diseases and Birth Defects of Ministry of Education, West China Second Hospital, Sichuan University, Chengdu, China
| | - Hui Liu
- Department of Radiology, Key Laboratory of Obstetric & Gynecologic and Pediatric Diseases and Birth Defects of Ministry of Education, West China Second Hospital, Sichuan University, Chengdu, China
| | - Xue-Sheng Li
- Department of Radiology, West China Second Hospital, Sichuan University, Chengdu, China
| | - Chuan Fu
- Department of Radiology, West China Second Hospital, Sichuan University, Chengdu, China
| | - Ke-Ling Liu
- Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
| | - Hong Li
- Key Laboratory of Birth Defects and Related Diseases of Women and Children of Ministry of Education, West China Second Hospital, Sichuan University, Chengdu, China
| | - Xiao-Yue Zhou
- MR Collaboration, Siemens Healthcare Ltd, Shanghai, China
| | - Ying-Kun Guo
- Department of Radiology, Key Laboratory of Obstetric & Gynecologic and Pediatric Diseases and Birth Defects of Ministry of Education, West China Second Hospital, Sichuan University, Chengdu, China
| | - Zhi-Gang Yang
- Department of Radiology, State Key Laboratory of Biotherapy and Cancer Center, West China Hospital, Sichuan University, Chengdu, China. .,Department of Radiology, West China Hospital, Sichuan University, Chengdu, China.
| |
Collapse
|
7
|
Shi Y, Gao Y, Zhang Y, Sun J, Mou X, Liang Z. Spectral CT Reconstruction via Low-Rank Representation and Region-Specific Texture Preserving Markov Random Field Regularization. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2996-3007. [PMID: 32217474 PMCID: PMC7529661 DOI: 10.1109/tmi.2020.2983414] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Photon-counting spectral computed tomography (CT) is capable of material characterization and can improve diagnostic performance over traditional clinical CT. However, it suffers from photon count starving for each individual energy channel which may cause severe artifacts in the reconstructed images. Furthermore, since the images in different energy channels describe the same object, there are high correlations among different channels. To make full use of the inter-channel correlations and minimize the count starving effect while maintaining clinically meaningful texture information, this paper combines a region-specific texture model with a low-rank correlation descriptor as an a priori regularization to explore a superior texture preserving Bayesian reconstruction of spectral CT. Specifically, the inter-channel correlations are characterized by the low-rank representation, and the inner-channel regional textures are modeled by a texture preserving Markov random field. In other words, this paper integrates the spectral and spatial information into a unified Bayesian reconstruction framework. The widely-used Split-Bregman algorithm is employed to minimize the objective function because of the non-differentiable property of the low-rank representation. To evaluate the tissue texture preserving performance of the proposed method for each channel, three references are built for comparison: one is the traditional CT image from energy integration detection. The second one is spectral images from dual-energy CT. The third one is individual channels images from custom-made photon-counting spectral CT. As expected, the proposed method produced promising results in terms of not only preserving texture features but also suppressing image noise in each channel, comparing to existing methods of total variation (TV), low-rank TV and tensor dictionary learning, by both visual inspection and quantitative indexes of root mean square error, peak signal to noise ratio, structural similarity and feature similarity.
Collapse
|
8
|
Zhang Y, Peng J, Zeng D, Xie Q, Li S, Bian Z, Wang Y, Zhang Y, Zhao Q, Zhang H, Liang Z, Lu H, Meng D, Ma J. Contrast-Medium Anisotropy-Aware Tensor Total Variation Model for Robust Cerebral Perfusion CT Reconstruction with Low-Dose Scans. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING 2020; 6:1375-1388. [PMID: 33313342 PMCID: PMC7731921 DOI: 10.1109/tci.2020.3023598] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Perfusion computed tomography (PCT) is critical in detecting cerebral ischemic lesions. PCT examination with low-dose scans can effectively reduce radiation exposure to patients at the cost of degraded images with severe noise and artifacts. Tensor total variation (TTV) models are powerful tools that can encode the regional continuous structures underlying a PCT object. In a TTV model, the sparsity structures of the contrast-medium concentration (CMC) across PCT frames are assumed to be isotropic with identical and independent distribution. However, this assumption is inconsistent with practical PCT tasks wherein the sparsity has evident variations and correlations. Such modeling deviation hampers the performance of TTV-based PCT reconstructions. To address this issue, we developed a novel contrast-medium anisotropy-aware tensor total variation (CMAA-TTV) model to describe the intrinsic anisotropy sparsity of the CMC in PCT imaging tasks. Instead of directly on the difference matrices, the CMAA-TTV model characterizes sparsity on a low-rank subspace of the difference matrices which are calculated from the input data adaptively, thus naturally encoding the intrinsic variant and correlated anisotropy sparsity structures of the CMC. We further proposed a robust and efficient PCT reconstruction algorithm to improve low-dose PCT reconstruction performance using the CMAA-TTV model. Experimental studies using a digital brain perfusion phantom, patient data with low-dose simulation and clinical patient data were performed to validate the effectiveness of the presented algorithm. The results demonstrate that the CMAA-TTV algorithm can achieve noticeable improvements over state-of-the-art methods in low-dose PCT reconstruction tasks.
Collapse
Affiliation(s)
- Yuanke Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China, and also with the School of Information Science and Engineering, Qufu Normal University, Rizhao 276826, China
| | - Jiangjun Peng
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Qi Xie
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Sui Li
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Yongbo Wang
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Yong Zhang
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Qian Zhao
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Hao Zhang
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, USA
| | - Zhengrong Liang
- Departments of Radiology and Biomedical Engineering, State University of New York at Stony Brook, NY 11794, USA
| | - Hongbing Lu
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an 710032, China
| | - Deyu Meng
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| |
Collapse
|
9
|
Abadi E, Segars WP, Tsui BMW, Kinahan PE, Bottenus N, Frangi AF, Maidment A, Lo J, Samei E. Virtual clinical trials in medical imaging: a review. J Med Imaging (Bellingham) 2020; 7:042805. [PMID: 32313817 PMCID: PMC7148435 DOI: 10.1117/1.jmi.7.4.042805] [Citation(s) in RCA: 73] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2019] [Accepted: 03/23/2020] [Indexed: 12/13/2022] Open
Abstract
The accelerating complexity and variety of medical imaging devices and methods have outpaced the ability to evaluate and optimize their design and clinical use. This is a significant and increasing challenge for both scientific investigations and clinical applications. Evaluations would ideally be done using clinical imaging trials. These experiments, however, are often not practical due to ethical limitations, expense, time requirements, or lack of ground truth. Virtual clinical trials (VCTs) (also known as in silico imaging trials or virtual imaging trials) offer an alternative means to efficiently evaluate medical imaging technologies virtually. They do so by simulating the patients, imaging systems, and interpreters. The field of VCTs has been constantly advanced over the past decades in multiple areas. We summarize the major developments and current status of the field of VCTs in medical imaging. We review the core components of a VCT: computational phantoms, simulators of different imaging modalities, and interpretation models. We also highlight some of the applications of VCTs across various imaging modalities.
Collapse
Affiliation(s)
- Ehsan Abadi
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - William P. Segars
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - Benjamin M. W. Tsui
- Johns Hopkins University, Department of Radiology, Baltimore, Maryland, United States
| | - Paul E. Kinahan
- University of Washington, Department of Radiology, Seattle, Washington, United States
| | - Nick Bottenus
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
- University of Colorado Boulder, Department of Mechanical Engineering, Boulder, Colorado, United States
| | - Alejandro F. Frangi
- University of Leeds, School of Computing, Leeds, United Kingdom
- University of Leeds, School of Medicine, Leeds, United Kingdom
| | - Andrew Maidment
- University of Pennsylvania, Department of Radiology, Philadelphia, Pennsylvania, United States
| | - Joseph Lo
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - Ehsan Samei
- Duke University, Department of Radiology, Durham, North Carolina, United States
| |
Collapse
|
10
|
Wu J, Wang X, Mou X, Chen Y, Liu S. Low Dose CT Image Reconstruction Based on Structure Tensor Total Variation Using Accelerated Fast Iterative Shrinkage Thresholding Algorithm. SENSORS 2020; 20:s20061647. [PMID: 32188068 PMCID: PMC7146515 DOI: 10.3390/s20061647] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/30/2020] [Revised: 03/07/2020] [Accepted: 03/10/2020] [Indexed: 12/20/2022]
Abstract
Low dose computed tomography (CT) has drawn much attention in the medical imaging field because of its ability to reduce the radiation dose. Recently, statistical iterative reconstruction (SIR) with total variation (TV) penalty has been developed to low dose CT image reconstruction. Nevertheless, the TV penalty has the drawback of creating blocky effects in the reconstructed images. To overcome the limitations of TV, in this paper we firstly introduce the structure tensor total variation (STV1) penalty into SIR framework for low dose CT image reconstruction. Then, an accelerated fast iterative shrinkage thresholding algorithm (AFISTA) is developed to minimize the objective function. The proposed AFISTA reconstruction algorithm was evaluated using numerical simulated low dose projection based on two CT images and realistic low dose projection data of a sheep lung CT perfusion. The experimental results demonstrated that our proposed STV1-based algorithm outperform FBP and TV-based algorithm in terms of removing noise and restraining blocky effects.
Collapse
Affiliation(s)
- Junfeng Wu
- Department of Applied Mathematics, Xi’an University of Technology, Xi’an 710048, China;
- The Key Laboratory of Computer Network and Information Integration, Southeast University and Ministry of Education, Nanjing 210096, China;
- Correspondence:
| | - Xiaofeng Wang
- Department of Applied Mathematics, Xi’an University of Technology, Xi’an 710048, China;
| | - Xuanqin Mou
- The Institute of Image processing and Pattern recognition, Xi’an Jiaotong University, Xi’an 710049, China;
| | - Yang Chen
- The Key Laboratory of Computer Network and Information Integration, Southeast University and Ministry of Education, Nanjing 210096, China;
| | - Shuguang Liu
- Equipment Management and Unmanned Aerial Vehicle Engineering College, Air Force Engineering University, Xi’an 710051, China;
| |
Collapse
|
11
|
Gao Y, Shi Y, Cao W, Zhang S, Liang Z. Energy enhanced tissue texture in spectral computed tomography for lesion classification. Vis Comput Ind Biomed Art 2019; 2:16. [PMID: 32226923 PMCID: PMC7089716 DOI: 10.1186/s42492-019-0028-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Accepted: 10/16/2019] [Indexed: 12/30/2022] Open
Abstract
Tissue texture reflects the spatial distribution of contrasts of image voxel gray levels, i.e., the tissue heterogeneity, and has been recognized as important biomarkers in various clinical tasks. Spectral computed tomography (CT) is believed to be able to enrich tissue texture by providing different voxel contrast images using different X-ray energies. Therefore, this paper aims to address two related issues for clinical usage of spectral CT, especially the photon counting CT (PCCT): (1) texture enhancement by spectral CT image reconstruction, and (2) spectral energy enriched tissue texture for improved lesion classification. For issue (1), we recently proposed a tissue-specific texture prior in addition to low rank prior for the individual energy-channel low-count image reconstruction problems in PCCT under the Bayesian theory. Reconstruction results showed the proposed method outperforms existing methods of total variation (TV), low-rank TV and tensor dictionary learning in terms of not only preserving texture features but also suppressing image noise. For issue (2), this paper will investigate three models to incorporate the enriched texture by PCCT in accordance with three types of inputs: one is the spectral images, another is the co-occurrence matrices (CMs) extracted from the spectral images, and the third one is the Haralick features (HF) extracted from the CMs. Studies were performed on simulated photon counting data by introducing attenuation-energy response curve to the traditional CT images from energy integration detectors. Classification results showed the spectral CT enriched texture model can improve the area under the receiver operating characteristic curve (AUC) score by 7.3%, 0.42% and 3.0% for the spectral images, CMs and HFs respectively on the five-energy spectral data over the original single energy data only. The CM- and HF-inputs can achieve the best AUC of 0.934 and 0.927. This texture themed study shows the insight that incorporating clinical important prior information, e.g., tissue texture in this paper, into the medical imaging, such as the upstream image reconstruction, the downstream diagnosis, and so on, can benefit the clinical tasks.
Collapse
Affiliation(s)
- Yongfeng Gao
- 1Department of Radiology, Stony Brook University, Stony Brook, NY 11794 USA
| | - Yongyi Shi
- 1Department of Radiology, Stony Brook University, Stony Brook, NY 11794 USA.,2Institute of Image Processing and Pattern Recognition, Xi'an Jiaotong University, Xi'an, 710049 Shanxi China
| | - Weiguo Cao
- 1Department of Radiology, Stony Brook University, Stony Brook, NY 11794 USA
| | - Shu Zhang
- 1Department of Radiology, Stony Brook University, Stony Brook, NY 11794 USA
| | - Zhengrong Liang
- 3Departments of Radiology, Biomedical Engineering, Computer Science, and Electrical Engineering, Stony Brook University, Stony Brook, NY 11794 USA
| |
Collapse
|
12
|
Gong C, Shen M, Zheng X, Han C, Zhou Y, Xie C, Jin X. Precise delineation and tumor localization based on novel image registration strategy between optical coherence tomography and computed tomography in the radiotherapy of intraocular cancer. Phys Med Biol 2019; 64:125009. [PMID: 30844768 DOI: 10.1088/1361-6560/ab0ddf] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Radiation-associated toxicities due to sophisticated ocular anatomy and shape variability of organs at risk (OARs) are major concerns during external beam radiation therapy (EBRT) of patients with intraocular cancer. A novel two-step image registration strategy between optical coherence tomography (OCT) and computed tomography (CT) images was proposed and validated to precisely localize the target in the EBRT of patients with intraocular cancer. Specifically, multiple features from OCT and CT images were extracted automatically, then spatial transformation based on thin-plate spline function was performed iteratively to achieve feature alignment between the CT and OCT images. Finally, an exclusive OR (XOR) algorithm was applied for precise 3D registration using a 3D-mesh model generated from OCT and CT volumes. The accuracy of the proposed novel registration strategy was validated and tested in a schematic-eye phantom with an artificially introduced tumor and in ten patients with confirmed primary and/or secondary intraocular cancer. There was an average registration error and computational time of 0.21 ± 0.05° and 259 ± 5 s, together with an average Dice similarity coefficient and Hausdorff distance of 88.4 ± 0.65 and 0.89 ± 0.09, respectively. The preliminary experimental results demonstrated that the proposed novel strategy to overcome current limitations on eye modeling and to localize precisely the tumor target during EBRT of intraocular cancer is promising.
Collapse
Affiliation(s)
- Changfei Gong
- Department of Radiation and Medical Oncology, Wenzhou Medical University 1st Affiliated Hospital, Wenzhou 325000, People's Republic of China. The authors contributed equally to this study
| | | | | | | | | | | | | |
Collapse
|
13
|
Performance of sparse-view CT reconstruction with multi-directional gradient operators. PLoS One 2019; 14:e0209674. [PMID: 30615635 PMCID: PMC6322781 DOI: 10.1371/journal.pone.0209674] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2018] [Accepted: 12/09/2018] [Indexed: 01/21/2023] Open
Abstract
To further reduce the noise and artifacts in the reconstructed image of sparse-view CT, we have modified the traditional total variation (TV) methods, which only calculate the gradient variations in x and y directions, and have proposed 8- and 26-directional (the multi-directional) gradient operators for TV calculation to improve the quality of reconstructed images. Different from traditional TV methods, the proposed 8- and 26-directional gradient operators additionally consider the diagonal directions in TV calculation. The proposed method preserves more information from original tomographic data in the step of gradient transform to obtain better reconstruction image qualities. Our algorithms were tested using two-dimensional Shepp–Logan phantom and three-dimensional clinical CT images. Results were evaluated using the root-mean-square error (RMSE), peak signal-to-noise ratio (PSNR), and universal quality index (UQI). All the experiment results show that the sparse-view CT images reconstructed using the proposed 8- and 26-directional gradient operators are superior to those reconstructed by traditional TV methods. Qualitative and quantitative analyses indicate that the more number of directions that the gradient operator has, the better images can be reconstructed. The 8- and 26-directional gradient operators we proposed have better capability to reduce noise and artifacts than traditional TV methods, and they are applicable to be applied to and combined with existing CT reconstruction algorithms derived from CS theory to produce better image quality in sparse-view reconstruction.
Collapse
|
14
|
Hsieh CJ, Huang TK, Hsieh TH, Chen GH, Shih KL, Chen ZY, Chen JC, Chu WC. Compressed sensing based CT reconstruction algorithm combined with modified Canny edge detection. Phys Med Biol 2018; 63:155011. [PMID: 29938686 DOI: 10.1088/1361-6560/aacece] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
Given that the computed tomography (CT) reconstruction algorithm based on compressed sensing (CS) results in blurred edges, we propose a modified Canny operator that assists the CS algorithm to accurately capture an object's edge, to preserve and further enhance the contrasts in the reconstructed image, thereby improving image quality. We modified two procedures of the traditional Canny operator, namely non-maximum suppression and edge tracking by hysteresis according to the characteristics of low-dose CT reconstruction, and proposed two major modifications: double-response edge detection and directional edge tracking. The newly modified Canny operator was combined with the CS reconstruction algorithm to become an edge-enhanced CS (EECS). Both a 2D Shepp-Logan phantom and a 3D dental phantom were used to conduct reconstruction testing. Root-mean-square error, peak signal-to-noise ratio, and universal quality index were employed to verify the reconstruction results. Qualitative and quantitative results of EECS reconstruction showed its superiority over conventional CS or CS combined with different edge detection techniques, such as Laplacian, Prewitt, Sobel operators, etc. The experiments verified that the proposed modified Canny operator is able to effectively detect the edge location of an object during low-dose reconstruction, enabling EECS to reconstruct images with better quality than those produced by other algorithms.
Collapse
Affiliation(s)
- Chia-Jui Hsieh
- Department of Biomedical Engineering, National Yang-Ming University, 155 Linong Street, Sec. 2, Beitou, Taipei 11221, Taiwan, People's Republic of China. Department of Biomedical Imaging and Radiological Sciences, National Yang-Ming University, 155 Linong Street, Sec. 2, Beitou, Taipei 11221, Taiwan, People's Republic of China
| | | | | | | | | | | | | | | |
Collapse
|
15
|
Segars WP, Tsui BMW, Jing Cai, Fang-Fang Yin, Fung GSK, Samei E. Application of the 4-D XCAT Phantoms in Biomedical Imaging and Beyond. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:680-692. [PMID: 28809677 PMCID: PMC5809240 DOI: 10.1109/tmi.2017.2738448] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
The four-dimensional (4-D) eXtended CArdiac-Torso (XCAT) series of phantoms was developed to provide accurate computerized models of the human anatomy and physiology. The XCAT series encompasses a vast population of phantoms of varying ages from newborn to adult, each including parameterized models for the cardiac and respiratory motions. With great flexibility in the XCAT's design, any number of body sizes, different anatomies, cardiac or respiratory motions or patterns, patient positions and orientations, and spatial resolutions can be simulated. As such, the XCAT phantoms are gaining a wide use in biomedical imaging research. There they can provide a virtual patient base from which to quantitatively evaluate and improve imaging instrumentation, data acquisition, techniques, and image reconstruction and processing methods which can lead to improved image quality and more accurate clinical diagnoses. The phantoms have also found great use in radiation dosimetry, radiation therapy, medical device design, and even the security and defense industry. This review paper highlights some specific areas in which the XCAT phantoms have found use within biomedical imaging and other fields. From these examples, we illustrate the increasingly important role that computerized phantoms and computer simulation are playing in the research community.
Collapse
|
16
|
Li Y, Speidel MA, Francois CJ, Chen GH. Radiation Dose Reduction in CT Myocardial Perfusion Imaging Using SMART-RECON. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:2557-2568. [PMID: 28866488 DOI: 10.1109/tmi.2017.2747521] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
In this paper, a newly developed statistical model-based image reconstruction [referred to as Simultaneous Multiple Artifacts Reduction in Tomographic RECONstruction (SMART-RECON)] is applied to low dose computer tomography (CT) myocardial perfusion imaging (CT-MPI). This method uses the nuclear norm of the spatial-temporal image matrix of the CT-MPI images as a regularizer, rather than a conventional spatial regularizer that incorporates image smoothness, edge preservation, or spatial sparsity into the reconstruction. In addition to providing the needed noise reduction for low-dose CT-MPI, SMART-RECON provides images with spatial resolution and noise power spectrum (NPS) properties, which are independent of contrast and dose levels. Both numerical simulations and in vivo animal studies were performed to validate the proposed method. In these studies, it was found that: 1) quantitative accuracy of perfusion maps in CT-MPI was well maintained for radiation dose level as low as 10 mAs per image frame, compared with the reference standard of 200 mAs for conventional filtered backprojection; 2) flow-occluded myocardium in the porcine heart was well delineated by SMART-RECON at 10 mAs per frame when compared with model-based image reconstruction using spatial total variation (TV) as the regularizer (referred to as TV-SIR) or spatial-temporal TV (ST-TV-SIR); the CT-MPI results were confirmed with positron-emission tomography imaging; 3) image sharpness in SMART-RECON images was nearly independent of image contrast level and radiation dose level, in stark contrast to TV-SIR and ST-TV-SIR, which displayed a strong dependence on both image contrast and radiation dose levels; and 4) the structure of the dose-normalized NPS for the SMART-RECON method did not depend on dose, while the TV-SIR and ST-TV-SIR NPS structure was dose-dependent.
Collapse
|