1
|
Li X, Jing K, Yang Y, Wang Y, Ma J, Zheng H, Xu Z. Noise-Generating and Imaging Mechanism Inspired Implicit Regularization Learning Network for Low Dose CT Reconstrution. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1677-1689. [PMID: 38145543 DOI: 10.1109/tmi.2023.3347258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/27/2023]
Abstract
Low-dose computed tomography (LDCT) helps to reduce radiation risks in CT scanning while maintaining image quality, which involves a consistent pursuit of lower incident rays and higher reconstruction performance. Although deep learning approaches have achieved encouraging success in LDCT reconstruction, most of them treat the task as a general inverse problem in either the image domain or the dual (sinogram and image) domains. Such frameworks have not considered the original noise generation of the projection data and suffer from limited performance improvement for the LDCT task. In this paper, we propose a novel reconstruction model based on noise-generating and imaging mechanism in full-domain, which fully considers the statistical properties of intrinsic noises in LDCT and prior information in sinogram and image domains. To solve the model, we propose an optimization algorithm based on the proximal gradient technique. Specifically, we derive the approximate solutions of the integer programming problem on the projection data theoretically. Instead of hand-crafting the sinogram and image regularizers, we propose to unroll the optimization algorithm to be a deep network. The network implicitly learns the proximal operators of sinogram and image regularizers with two deep neural networks, providing a more interpretable and effective reconstruction procedure. Numerical results demonstrate our proposed method improvements of > 2.9 dB in peak signal to noise ratio, > 1.4% promotion in structural similarity metric, and > 9 HU decrements in root mean square error over current state-of-the-art LDCT methods.
Collapse
|
2
|
Shin M, Seo M, Lee K, Yoon K. Super-resolution techniques for biomedical applications and challenges. Biomed Eng Lett 2024; 14:465-496. [PMID: 38645589 PMCID: PMC11026337 DOI: 10.1007/s13534-024-00365-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 02/12/2024] [Accepted: 02/18/2024] [Indexed: 04/23/2024] Open
Abstract
Super-resolution (SR) techniques have revolutionized the field of biomedical applications by detailing the structures at resolutions beyond the limits of imaging or measuring tools. These techniques have been applied in various biomedical applications, including microscopy, magnetic resonance imaging (MRI), computed tomography (CT), X-ray, electroencephalogram (EEG), ultrasound, etc. SR methods are categorized into two main types: traditional non-learning-based methods and modern learning-based approaches. In both applications, SR methodologies have been effectively utilized on biomedical images, enhancing the visualization of complex biological structures. Additionally, these methods have been employed on biomedical data, leading to improvements in computational precision and efficiency for biomedical simulations. The use of SR techniques has resulted in more detailed and accurate analyses in diagnostics and research, essential for early disease detection and treatment planning. However, challenges such as computational demands, data interpretation complexities, and the lack of unified high-quality data persist. The article emphasizes these issues, underscoring the need for ongoing development in SR technologies to further improve biomedical research and patient care outcomes.
Collapse
Affiliation(s)
- Minwoo Shin
- School of Mathematics and Computing (Computational Science and Engineering), Yonsei University, 50 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722 Republic of Korea
| | - Minjee Seo
- School of Mathematics and Computing (Computational Science and Engineering), Yonsei University, 50 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722 Republic of Korea
| | - Kyunghyun Lee
- School of Mathematics and Computing (Computational Science and Engineering), Yonsei University, 50 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722 Republic of Korea
| | - Kyungho Yoon
- School of Mathematics and Computing (Computational Science and Engineering), Yonsei University, 50 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722 Republic of Korea
| |
Collapse
|
3
|
Li Z, Liu Y, Chen Y, Shu H, Lu J, Gui Z. Dual-domain fusion deep convolutional neural network for low-dose CT denoising. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2023:XST230020. [PMID: 37212059 DOI: 10.3233/xst-230020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
BACKGROUND In view of the underlying health risks posed by X-ray radiation, the main goal of the present research is to achieve high-quality CT images at the same time as reducing x-ray radiation. In recent years, convolutional neural network (CNN) has shown excellent performance in removing low-dose CT noise. However, previous work mainly focused on deepening and feature extraction work on CNN without considering fusion of features from frequency domain and image domain. OBJECTIVE To address this issue, we propose to develop and test a new LDCT image denoising method based on a dual-domain fusion deep convolutional neural network (DFCNN). METHODS This method deals with two domains, namely, the DCT domain and the image domain. In the DCT domain, we design a new residual CBAM network to enhance the internal and external relations of different channels while reducing noise to promote richer image structure information. For the image domain, we propose a top-down multi-scale codec network as a denoising network to obtain more acceptable edges and textures while obtaining multi-scale information. Then, the feature images of the two domains are fused by a combination network. RESULTS The proposed method was validated on the Mayo dataset and the Piglet dataset. The denoising algorithm is optimal in both subjective and objective evaluation indexes as compared to other state-of-the-art methods reported in previous studies. CONCLUSIONS The study results demonstrate that by applying the new fusion model denoising, denoising results in both image domain and DCT domain are better than other models developed using features extracted in the single image domain.
Collapse
Affiliation(s)
- Zhiyuan Li
- School of Information and Communication Engineering, North University of China, Taiyuan Shanxi Province, China
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| | - Yi Liu
- School of Information and Communication Engineering, North University of China, Taiyuan Shanxi Province, China
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| | - Yang Chen
- School of Computer Science and Engineering, Southeast University, Nanjing, Jiangsu, China
| | - Huazhong Shu
- Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing, Southeast University, Nanjing, Jiangsu, China
| | - Jing Lu
- School of Information and Communication Engineering, North University of China, Taiyuan Shanxi Province, China
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| | - Zhiguo Gui
- School of Information and Communication Engineering, North University of China, Taiyuan Shanxi Province, China
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
- Shanxi Provincial Key Laboratory for Biomedical Imaging and Big Data, North University of China, Taiyuan, China
| |
Collapse
|
4
|
Gao X, Su T, Zhang Y, Zhu J, Tan Y, Cui H, Long X, Zheng H, Liang D, Ge Y. Attention-based dual-branch deep network for sparse-view computed tomography image reconstruction. Quant Imaging Med Surg 2023; 13:1360-1374. [PMID: 36915341 PMCID: PMC10006128 DOI: 10.21037/qims-22-609] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Accepted: 12/01/2022] [Indexed: 02/25/2023]
Abstract
Background The widespread application of X-ray computed tomography (CT) imaging in medical screening makes radiation safety a major concern for public health. Sparse-view CT is a promising solution to reduce the radiation dose. However, the reconstructed CT images obtained using sparse-view CT may suffer severe streaking artifacts and structural information loss. Methods In this study, a novel attention-based dual-branch network (ADB-Net) is proposed to solve the ill-posed problem of sparse-view CT image reconstruction. In this network, downsampled sinogram input is processed through 2 parallel branches (CT branch and signogram branch) of the ADB-Net to independently extract the distinct, high-level feature maps. These feature maps are fused in a specified attention module from 3 perspectives (channel, plane, and spatial) to allow complementary optimizations that can mitigate the streaking artifacts and the structure loss in sparse-view CT imaging. Results Numerical simulations, an anthropomorphic thorax phantom, and in vivo preclinical experiments were conducted to verify the sparse-view CT imaging performance of the ADB-Net. The proposed network achieved a root-mean-square error (RMSE) of 20.6160, a structural similarity (SSIM) of 0.9257, and a peak signal-to-noise ratio (PSNR) of 38.8246 on numerical data. The visualization results demonstrate that this newly developed network can consistently remove the streaking artifacts while maintaining the fine structures. Conclusions The proposed attention-based dual-branch deep network, ADB-Net, provides a promising alternative to reconstruct high-quality sparse-view CT images for low-dose CT imaging.
Collapse
Affiliation(s)
- Xiang Gao
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,University of Chinese Academy of Sciences, Beijing, China
| | - Ting Su
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Yunxin Zhang
- Department of Vascular Surgery, Beijing Jishuitan Hospital, Beijing, China
| | - Jiongtao Zhu
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen, China
| | - Yuhang Tan
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Han Cui
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Xiaojing Long
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Hairong Zheng
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Dong Liang
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Yongshuai Ge
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| |
Collapse
|
5
|
Zhang P, Ren S, Liu Y, Gui Z, Shangguan H, Wang Y, Shu H, Chen Y. A total variation prior unrolling approach for computed tomography reconstruction. Med Phys 2023; 50:2816-2834. [PMID: 36791315 DOI: 10.1002/mp.16307] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 01/09/2023] [Accepted: 02/06/2023] [Indexed: 02/17/2023] Open
Abstract
BACKGROUND With the rapid development of deep learning technology, deep neural networks can effectively enhance the performance of computed tomography (CT) reconstructions. One kind of commonly used method to construct CT reconstruction networks is to unroll the conventional iterative reconstruction (IR) methods to convolutional neural networks (CNNs). However, most unrolling methods primarily unroll the fidelity term of IR methods to CNNs, without unrolling the prior terms. The prior terms are always directly replaced by neural networks. PURPOSE In conventional IR methods, the prior terms play a vital role in improving the visual quality of reconstructed images. Unrolling the hand-crafted prior terms to CNNs may provide a more specialized unrolling approach to further improve the performance of CT reconstruction. In this work, a primal-dual network (PD-Net) was proposed by unrolling both the data fidelity term and the total variation (TV) prior term, which effectively preserves the image edges and textures in the reconstructed images. METHODS By further deriving the Chambolle-Pock (CP) algorithm instance for CT reconstruction, we discovered that the TV prior updates the reconstructed images with its divergences in each iteration of the solution process. Based on this discovery, CNNs were applied to yield the divergences of the feature maps for the reconstructed image generated in each iteration. Additionally, a loss function was applied to the predicted divergences of the reconstructed image to guarantee that the CNNs' results were the divergences of the corresponding feature maps in the iteration. In this manner, the proposed CNNs seem to play the same roles in the PD-Net as the TV prior in the IR methods. Thus, the TV prior in the CP algorithm instance can be directly unrolled to CNNs. RESULTS The datasets from the Low-Dose CT Image and Projection Data and the Piglet dataset were employed to assess the effectiveness of our proposed PD-Net. Compared with conventional CT reconstruction methods, our proposed method effectively preserves the structural and textural information in reference to ground truth. CONCLUSIONS The experimental results show that our proposed PD-Net framework is feasible for the implementation of CT reconstruction tasks. Owing to the promising results yielded by our proposed neural network, this study is intended to inspire further development of unrolling approaches by enabling the direct unrolling of hand-crafted prior terms to CNNs.
Collapse
Affiliation(s)
- Pengcheng Zhang
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| | - Shuhui Ren
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| | - Yi Liu
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| | - Zhiguo Gui
- State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| | - Hong Shangguan
- School of Electronic Information Engineering, Taiyuan University of Science and Technology, Taiyuan, China
| | - Yanling Wang
- School of Information, Shanxi University of Finance and Economics, Taiyuan, China
| | - Huazhong Shu
- Laboratory of Image Science and Technology, Southeast University, Nanjing, China
| | - Yang Chen
- Laboratory of Image Science and Technology, Southeast University, Nanjing, China.,Centre de Recherche en Information Biomedicale Sino-Francais (LIA CRIBs), Rennes, France.,Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, China.,Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing, Southeast University, Nanjing, China
| |
Collapse
|
6
|
Han Z, Shangguan H, Zhang X, Zhang P, Cui X, Ren H. A Dual-Encoder-Single-Decoder Based Low-dose CT Denoising Network. IEEE J Biomed Health Inform 2022; 26:3251-3260. [PMID: 35239495 DOI: 10.1109/jbhi.2022.3155788] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Generative adversarial networks (GAN) have shown great potential for image quality improvement in low-dose CT (LDCT). In general, the shallow features of generator include more shallow visual information such as edges and texture, while the deep features of generator contain more deep semantic information such as organization structure. To improve the networks ability to categorically deal with different kinds of information, this paper proposes a new type of GAN with dual-encoder- single-decoder structure. In the structure of the generator, firstly, a pyramid non-local attention module in the main encoder channel is designed to improve the feature extraction effectiveness by enhancing the features with self-similarity; Secondly, another encoder with shallow feature processing module and deep feature processing module is proposed to improve the encoding capabilities of the generator; Finally, the final denoised CT image is generated by fusing main encoders features, shallow visual features, and deep semantic features. The quality of the generated images is improved due to the use of feature complementation in the generator. In order to improve the adversarial training ability of discriminator, a hierarchical-split ResNet structure is proposed, which improves the features richness and reduces the features redundancy in discriminator. The experimental results show that compared with the traditional single-encoder- single-decoder based GAN, the proposed method performs better in both image quality and medical diagnostic acceptability. Code is available in https://github.com/hanzefang/DESDGAN.
Collapse
|
7
|
Zhou B, Chen X, Zhou SK, Duncan JS, Liu C. DuDoDR-Net: Dual-domain data consistent recurrent network for simultaneous sparse view and metal artifact reduction in computed tomography. Med Image Anal 2022; 75:102289. [PMID: 34758443 PMCID: PMC8678361 DOI: 10.1016/j.media.2021.102289] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Revised: 09/03/2021] [Accepted: 10/20/2021] [Indexed: 01/03/2023]
Abstract
Sparse-view computed tomography (SVCT) aims to reconstruct a cross-sectional image using a reduced number of x-ray projections. While SVCT can efficiently reduce the radiation dose, the reconstruction suffers from severe streak artifacts, and the artifacts are further amplified with the presence of metallic implants, which could adversely impact the medical diagnosis and other downstream applications. Previous methods have extensively explored either SVCT reconstruction without metallic implants, or full-view CT metal artifact reduction (MAR). The issue of simultaneous sparse-view and metal artifact reduction (SVMAR) remains under-explored, and it is infeasible to directly apply previous SVCT and MAR methods to SVMAR which may yield non-ideal reconstruction quality. In this work, we propose a dual-domain data consistent recurrent network, called DuDoDR-Net, for SVMAR. Our DuDoDR-Net aims to reconstruct an artifact-free image by recurrent image domain and sinogram domain restorations. To ensure the metal-free part of acquired projection data is preserved, we also develop the image data consistent layer (iDCL) and sinogram data consistent layer (sDCL) that are interleaved in our recurrent framework. Our experimental results demonstrate that our DuDoDR-Net is able to produce superior artifact-reduced results while preserving the anatomical structures, that outperforming previous SVCT and SVMAR methods, under different sparse-view acquisition settings.
Collapse
Affiliation(s)
- Bo Zhou
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA.
| | - Xiongchao Chen
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - S Kevin Zhou
- School of Biomedical Engineering & Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, China; Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
| | - James S Duncan
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA; Department of Electrical Engineering, Yale University, New Haven, CT, USA
| | - Chi Liu
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
| |
Collapse
|
8
|
Gao Y, Zhu Y, Bilgel M, Ashrafinia S, Lu L, Rahmim A. Voxel-based partial volume correction of PET images via subtle MRI guided non-local means regularization. Phys Med 2021; 89:129-139. [PMID: 34365117 DOI: 10.1016/j.ejmp.2021.07.028] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2021] [Revised: 07/18/2021] [Accepted: 07/19/2021] [Indexed: 11/26/2022] Open
Abstract
PURPOSE Positron emission tomography (PET) images tend to be significantly degraded by the partial volume effect (PVE) resulting from the limited spatial resolution of the reconstructed images. Our purpose is to propose a partial volume correction (PVC) method to tackle this issue. METHODS In the present work, we explore a voxel-based PVC method under the least squares framework (LS) employing anatomical non-local means (NLMA) regularization. The well-known non-local means (NLM) filter utilizes the high degree of information redundancy that typically exists in images, and is typically used to directly reduce image noise by replacing each voxel intensity with a weighted average of its non-local neighbors. Here we explore NLM as a regularization term within iterative-deconvolution model to perform PVC. Further, an anatomical-guided version of NLM was proposed that incorporates MRI information into NLM to improve resolution and suppress image noise. The proposed approach makes subtle usage of the accompanying MRI information to define a more appropriate search space within the prior model. To optimize the regularized LS objective function, we used the Gauss-Seidel (GS) algorithm with the one-step-late (OSL) technique. RESULTS After the import of NLMA, the visual and quality results are all improved. With a visual check, we notice that NLMA reduce the noise compared to other PVC methods. This is also validated in bias-noise curve compared to non-MRI-guided PVC framework. We can see NLMA gives better bias-noise trade-off compared to other PVC methods. CONCLUSIONS Our efforts were evaluated in the base of amyloid brain PET imaging using the BrainWeb phantom and in vivo human data. We also compared our method with other PVC methods. Overall, we demonstrated the value of introducing subtle MRI-guidance in the regularization process, the proposed NLMA method resulting in promising visual as well as quantitative performance improvements.
Collapse
Affiliation(s)
- Yuanyuan Gao
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China; Department of Radiology, Johns Hopkins University, Baltimore, MD 21287, USA.
| | - Yansong Zhu
- Department of Radiology, Johns Hopkins University, Baltimore, MD 21287, USA; Department of Electrical & Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA; Departments of Radiology and Physics, University of British Columbia, Vancouver, BC V5Z 1M9, Canada
| | - Murat Bilgel
- Laboratory of Behavioral Neuroscience, National Institute on Aging, Baltimore, MD 20892, USA
| | - Saeed Ashrafinia
- Department of Radiology, Johns Hopkins University, Baltimore, MD 21287, USA; Department of Electrical & Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA
| | - Lijun Lu
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
| | - Arman Rahmim
- Department of Radiology, Johns Hopkins University, Baltimore, MD 21287, USA; Department of Electrical & Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA; Departments of Radiology and Physics, University of British Columbia, Vancouver, BC V5Z 1M9, Canada.
| |
Collapse
|
9
|
Lévêque L, Outtas M, Liu H, Zhang L. Comparative study of the methodologies used for subjective medical image quality assessment. Phys Med Biol 2021; 66. [PMID: 34225264 DOI: 10.1088/1361-6560/ac1157] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2021] [Accepted: 07/05/2021] [Indexed: 11/12/2022]
Abstract
Healthcare professionals have been increasingly viewing medical images and videos in their routine clinical practice, and this in a wide variety of environments. Both the perception and interpretation of medical visual information, across all branches of practice or medical specialties (e.g. diagnostic, therapeutic, or surgical medicine), career stages, and practice settings (e.g. emergency care), appear to be critical for patient care. However, medical images and videos are not self-explanatory and, therefore, need to be interpreted by humans, i.e. medical experts. In addition, various types of degradations and artifacts may appear during image acquisition or processing, and consequently affect medical imaging data. Such distortions tend to impact viewers' quality of experience, as well as their clinical practice. It is accordingly essential to better understand how medical experts perceive the quality of visual content. Thankfully, progress has been made in the recent literature towards such understanding. In this article, we present an up-to-date state-of the-art of relatively recent (i.e. not older than ten years old) existing studies on the subjective quality assessment of medical images and videos, as well as research works using task-based approaches. Furthermore, we discuss the merits and drawbacks of the methodologies used, and we provide recommendations about experimental designs and statistical processes to evaluate the perception of medical images and videos for future studies, which could then be used to optimise the visual experience of image readers in real clinical practice. Finally, we tackle the issue of the lack of available annotated medical image and video quality databases, which appear to be indispensable for the development of new dedicated objective metrics.
Collapse
Affiliation(s)
- Lucie Lévêque
- Nantes Laboratory of Digital Sciences (LS2N), University of Nantes, Nantes, France
| | - Meriem Outtas
- Department of Industrial Computer Science and Electronics, National Institute of Applied Sciences, Rennes, France
| | - Hantao Liu
- School of Computer Science and Informatics, Cardiff University, Cardiff, United Kingdom
| | - Lu Zhang
- Department of Industrial Computer Science and Electronics, National Institute of Applied Sciences, Rennes, France
| |
Collapse
|
10
|
Zhou B, Zhou SK, Duncan JS, Liu C. Limited View Tomographic Reconstruction Using a Cascaded Residual Dense Spatial-Channel Attention Network With Projection Data Fidelity Layer. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1792-1804. [PMID: 33729929 PMCID: PMC8325575 DOI: 10.1109/tmi.2021.3066318] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Limited view tomographic reconstruction aims to reconstruct a tomographic image from a limited number of projection views arising from sparse view or limited angle acquisitions that reduce radiation dose or shorten scanning time. However, such a reconstruction suffers from severe artifacts due to the incompleteness of sinogram. To derive quality reconstruction, previous methods use UNet-like neural architectures to directly predict the full view reconstruction from limited view data; but these methods leave the deep network architecture issue largely intact and cannot guarantee the consistency between the sinogram of the reconstructed image and the acquired sinogram, leading to a non-ideal reconstruction. In this work, we propose a cascaded residual dense spatial-channel attention network consisting of residual dense spatial-channel attention networks and projection data fidelity layers. We evaluate our methods on two datasets. Our experimental results on AAPM Low Dose CT Grand Challenge datasets demonstrate that our algorithm achieves a consistent and substantial improvement over the existing neural network methods on both limited angle reconstruction and sparse view reconstruction. In addition, our experimental results on Deep Lesion datasets demonstrate that our method is able to generate high-quality reconstruction for 8 major lesion types.
Collapse
|
11
|
Flores JD, Gang GJ, Zhang H, Lin CT, Fung SK, Stayman JW. Direct reconstruction of anatomical change in low-dose lung nodule surveillance. J Med Imaging (Bellingham) 2021; 8:023503. [PMID: 33846692 DOI: 10.1117/1.jmi.8.2.023503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 03/18/2021] [Indexed: 11/14/2022] Open
Abstract
Purpose: In sequential imaging studies, there exists rich information from past studies that can be used in prior-image-based reconstruction (PIBR) as a form of improved regularization to yield higher-quality images in subsequent studies. PIBR methods, such as reconstruction of difference (RoD), have demonstrated great improvements in the image quality of subsequent anatomy reconstruction even when CT data are acquired at very low-exposure settings. Approach: However, to effectively use information from past studies, two major elements are required: (1) registration, usually deformable, must be applied between the current and prior scans. Such registration is greatly complicated by potential ambiguity between patient motion and anatomical change-which is often the target of the followup study. (2) One must select regularization parameters for reliable and robust reconstruction of features. Results: We address these two major issues and apply a modified RoD framework to the clinical problem of lung nodule surveillance. Specifically, we develop a modified deformable registration approach that enforces a locally smooth/rigid registration around the change region and extend previous analytic expressions relating reconstructed contrast to the regularization parameter and other system dependencies for reliable representation of image features. We demonstrate the efficacy of this approach using a combination of realistic digital phantoms and clinical projection data. Performance is characterized as a function of the size of the locally smooth registration region of interest as well as x-ray exposure. Conclusions: This modified framework is effectively able to separate patient motion and anatomical change to directly highlight anatomical change in lung nodule surveillance.
Collapse
Affiliation(s)
- Jessica D Flores
- Johns Hopkins University, Department of Biomedical Engineering, Baltimore, Maryland, United States
| | - Grace J Gang
- Johns Hopkins University, Department of Biomedical Engineering, Baltimore, Maryland, United States
| | - Hao Zhang
- Johns Hopkins University, Department of Biomedical Engineering, Baltimore, Maryland, United States
| | - Cheng T Lin
- Johns Hopkins University, Department of Radiology, Baltimore, Maryland, United States
| | | | - J Webster Stayman
- Johns Hopkins University, Department of Biomedical Engineering, Baltimore, Maryland, United States
| |
Collapse
|
12
|
Zhang H, Capaldi D, Zeng D, Ma J, Xing L. Prior-image-based CT reconstruction using attenuation-mismatched priors. Phys Med Biol 2021; 66:064007. [PMID: 33729997 DOI: 10.1088/1361-6560/abe760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Prior-image-based reconstruction (PIBR) methods are powerful tools for reducing radiation doses and improving the image quality of low-dose computed tomography (CT). Apart from anatomical changes, prior and current images can also have different attenuations because they originated from different scanners or from the same scanner but with different x-ray beam qualities (e.g., kVp settings, beam filters) during data acquisition. In such scenarios, with attenuation-mismatched priors, PIBR is challenging. In this work, we investigate a specific PIBR method, called statistical image reconstruction, using normal-dose image-induced nonlocal means regularization (SIR-ndiNLM), to address PIBR with such attenuation-mismatched priors and achieve quantitative low-dose CT imaging. We propose two corrective schemes for the original SIR-ndiNLM method, (1) a global histogram-matching approach and (2) a local attenuation correction approach, to account for the attenuation differences between the prior and current images in PIBR. We validate the efficacy of the proposed schemes using images acquired from dual-energy CT scanners to simulate attenuation mismatches. Meanwhile, we utilize different CT slices to simulate anatomical mismatches or changes between the prior and the current low-dose image. We observe that the original SIR-ndiNLM introduces artifacts to the reconstruction when an attenuation-mismatched prior is used. Furthermore, we find that a larger attenuation mismatch between the prior and current images results in more severe artifacts in the SIR-ndiNLM reconstruction. Our two proposed corrective schemes enable SIR-ndiNLM to effectively handle the attenuation mismatch and anatomical changes between the two images and successfully eliminate the artifacts. We demonstrate that the proposed techniques permit SIR-ndiNLM to leverage the attenuation-mismatched prior and achieve quantitative low-dose CT reconstruction from both low-flux and sparse-view data acquisitions. This work permits robust and reliable PIBR for CT data acquired using different beam settings.
Collapse
Affiliation(s)
- Hao Zhang
- Department of Radiation Oncology, Stanford University School of Medicine, California, United States of America. Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, United States of America
| | | | | | | | | |
Collapse
|
13
|
Estimating dual-energy CT imaging from single-energy CT data with material decomposition convolutional neural network. Med Image Anal 2021; 70:102001. [PMID: 33640721 DOI: 10.1016/j.media.2021.102001] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 02/06/2021] [Accepted: 02/11/2021] [Indexed: 01/12/2023]
Abstract
Dual-energy computed tomography (DECT) is of great significance for clinical practice due to its huge potential to provide material-specific information. However, DECT scanners are usually more expensive than standard single-energy CT (SECT) scanners and thus are less accessible to undeveloped regions. In this paper, we show that the energy-domain correlation and anatomical consistency between standard DECT images can be harnessed by a deep learning model to provide high-performance DECT imaging from fully-sampled low-energy data together with single-view high-energy data. We demonstrate the feasibility of the approach with two independent cohorts (the first cohort including contrast-enhanced DECT scans of 5753 image slices from 22 patients and the second cohort including spectral CT scans without contrast injection of 2463 image slices from other 22 patients) and show its superior performance on DECT applications. The deep-learning-based approach could be useful to further significantly reduce the radiation dose of current premium DECT scanners and has the potential to simplify the hardware of DECT imaging systems and to enable DECT imaging using standard SECT scanners.
Collapse
|
14
|
Li Z, Zhou S, Huang J, Yu L, Jin M. Investigation of Low-Dose CT Image Denoising Using Unpaired Deep Learning Methods. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2020; 5:224-234. [PMID: 33748562 DOI: 10.1109/trpms.2020.3007583] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Low-dose computed tomography (LDCT) is desired due to prevalence and ionizing radiation of CT, but suffers elevated noise. To improve LDCT image quality, an image-domain denoising method based on cycle-consistent generative adversarial network ("CycleGAN") is developed and compared with two other variants, IdentityGAN and GAN-CIRCLE. Different from supervised deep learning methods, these unpaired methods can effectively learn image translation from the low-dose domain to the full-dose (FD) domain without the need of aligning FDCT and LDCT images. The results on real and synthetic patient CT data show that these methods can achieve peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) comparable to, if not better than, the other state-of-the-art denoising methods. Among CycleGAN, IdentityGAN, and GAN-CIRCLE, the later achieves the best denoising performance with the shortest computation time. Subsequently, GAN-CIRCLE is used to demonstrate that the increasing number of training patches and of training patients can improve denoising performance. Finally, two non-overlapping experiments, i.e. no counterparts of FDCT and LDCT images in the training data, further demonstrate the effectiveness of unpaired learning methods. This work paves the way for applying unpaired deep learning methods to enhance LDCT images without requiring aligned full-dose and low-dose images from the same patient.
Collapse
Affiliation(s)
- Zeheng Li
- Computer Science and Engineering Department, University of Texas at Arlington, Arlington, TX 76019 USA
| | - Shiwei Zhou
- Physics Department, University of Texas at Arlington, Arlington, TX 76019 USA
| | - Junzhou Huang
- Computer Science and Engineering Department, University of Texas at Arlington, Arlington, TX 76019 USA
| | - Lifeng Yu
- Department of Radiology at Mayo Clinic, Rochester, MN 55905 USA
| | - Mingwu Jin
- Physics Department, University of Texas at Arlington, Arlington, TX 76019 USA
| |
Collapse
|
15
|
Abstract
The Radon transform is widely used in physical and life sciences, and one of its major applications is in medical X-ray computed tomography (CT), which is significantly important in disease screening and diagnosis. In this paper, we propose a novel reconstruction framework for Radon inversion with deep learning (DL) techniques. For simplicity, the proposed framework is denoted as iRadonMAP, i.e., inverse Radon transform approximation. Specifically, we construct an interpretable neural network that contains three dedicated components. The first component is a fully connected filtering (FCF) layer along the rotation angle direction in the sinogram domain, and the second one is a sinusoidal back-projection (SBP) layer, which back-projects the filtered sinogram data into the spatial domain. Next, a common network structure is added to further improve the overall performance. iRadonMAP is first pretrained on a large number of generic images from the ImageNet database and then fine-tuned with clinical patient data. The experimental results demonstrate the feasibility of the proposed iRadonMAP framework for Radon inversion.
Collapse
|
16
|
CT image denoising using multivariate model and its method noise thresholding in non-subsampled shearlet domain. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101754] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
17
|
Yao L, Zeng D, Chen G, Liao Y, Li S, Zhang Y, Wang Y, Tao X, Niu S, Lv Q, Bian Z, Ma J, Huang J. Multi-energy computed tomography reconstruction using a nonlocal spectral similarity model. Phys Med Biol 2019; 64:035018. [PMID: 30577033 DOI: 10.1088/1361-6560/aafa99] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
Multi-energy computed tomography (MECT) is able to acquire simultaneous multi-energy measurements from one scan. In addition, it allows material differentiation and quantification effectively. However, due to the limited energy bin width, the number of photons detected in an energy-specific channel is smaller than that in traditional CT, which results in image quality degradation. To address this issue, in this work, we develop a statistical iterative reconstruction algorithm to acquire high-quality MECT images and high-accuracy material-specific images. Specifically, this algorithm fully incorporates redundant self-similarities within nonlocal regions in the MECT image at one bin and rich spectral similarities among MECT images at all bins. For simplicity, the presented algorithm is referred to as 'MECT-NSS'. Moreover, an efficient optimization algorithm is developed to solve the MECT-NSS objective function. Then, a comprehensive evaluation of parameter selection for the MECT-NSS algorithm is conducted. In the experiment, the datasets include images from three phantoms and one patient to validate and evaluate the MECT-NSS reconstruction performance. The qualitative and quantitative results demonstrate that the presented MECT-NSS can successfully yield better MECT image quality and more accurate material estimation than the competing algorithms.
Collapse
Affiliation(s)
- Lisha Yao
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, People's Republic of China. Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou 510515, People's Republic of China. These authors contributed equally
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
18
|
Zhang H, Gang GJ, Dang H, Stayman JW. Regularization Analysis and Design for Prior-Image-Based X-Ray CT Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:2675-2686. [PMID: 29994249 PMCID: PMC6295916 DOI: 10.1109/tmi.2018.2847250] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Prior-image-based reconstruction (PIBR) methods have demonstrated great potential for radiation dose reduction in computed tomography applications. PIBR methods take advantage of shared anatomical information between sequential scans by incorporating a patient-specific prior image into the reconstruction objective function, often as a form of regularization. However, one major challenge with PIBR methods is how to optimally determine the prior image regularization strength which balances anatomical information from the prior image with data fitting to the current measurements. Too little prior information yields limited improvements over traditional model-based iterative reconstruction, while too much prior information can force anatomical features from the prior image not supported by the measurement data, concealing true anatomical changes. In this paper, we develop quantitative measures of the bias associated with PIBR. This bias exhibits as a fractional reconstructed contrast of the difference between the prior image and current anatomy, which is quite different from traditional reconstruction biases that are typically quantified in terms of spatial resolution or artifacts. We have derived an analytical relationship between the PIBR bias and prior image regularization strength and illustrated how this relationship can be used as a predictive tool to prospectively determine prior image regularization strength to admit specific kinds of anatomical change in the reconstruction. Because bias is dependent on local statistics, we further generalized shift-variant prior image penalties that permit uniform (shift invariant) admission of anatomical changes across the imaging field of view. We validated the mathematical framework in phantom studies and compared bias predictions with estimates based on brute force exhaustive evaluation using numerous iterative reconstructions across regularization values. The experimental results demonstrate that the proposed analytical approach can predict the bias-regularization relationship accurately, allowing for prospective determination of the prior image regularization strength in PIBR. Thus, the proposed approach provides an important tool for controlling image quality of PIBR methods in a reliable, robust, and efficient fashion.
Collapse
Affiliation(s)
- Hao Zhang
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205 USA (telephone: 410-955-1314, )
| | - Grace J. Gang
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205 USA (telephone: 410-955-1314, )
| | - Hao Dang
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205 USA (telephone: 410-955-1314, )
| | - J. Webster Stayman
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205 USA (telephone: 410-955-1314, )
| |
Collapse
|
19
|
Jia X, Liao Y, Zeng D, Zhang H, Zhang Y, He J, Bian Z, Wang Y, Tao X, Liang Z, Huang J, Ma J. Statistical CT reconstruction using region-aware texture preserving regularization learning from prior normal-dose CT image. Phys Med Biol 2018; 63:225020. [PMID: 30457116 PMCID: PMC6309620 DOI: 10.1088/1361-6560/aaebc9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
In some clinical applications, prior normal-dose CT (NdCT) images are available, and the valuable textures and structure features in them may be used to promote follow-up low-dose CT (LdCT) reconstruction. This study aims to learn texture information from the NdCT images and leverage it for follow-up LdCT image reconstruction to preserve textures and structure features. Specifically, the proposed reconstruction method first learns the texture information from those patches with similar structures in NdCT image, and the similar patches can be clustered by searching context features efficiently from the surroundings of the current patch. Then it utilizes redundant texture information from the similar patches as a priori knowledge to describe specific regions in the LdCT image. The advanced region-aware texture preserving prior is termed as 'RATP'. The main advantage of the PATP prior is that it can properly learn the texture features from available NdCT images and adaptively characterize the region-specific structures in the LdCT image. The experiments using patient data were performed to evaluate the performance of the proposed method. The proposed RATP method demonstrated superior performance in LdCT imaging compared to the filtered back projection (FBP) and statistical iterative reconstruction (SIR) methods using Gaussian regularization, Huber regularization and the original texture preserving regularization.
Collapse
Affiliation(s)
- Xiao Jia
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- School of Software Engineering, Nanyang Normal University, Nanyang, Henan 473061, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Yuting Liao
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Hao Zhang
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| | - Yuanke Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Ji He
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Yongbo Wang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Xi Tao
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Zhengrong Liang
- Department of Radiology and Biomedical Engineering, State University of New York at Stony Brook, NY 11794, United States of America
| | - Jing Huang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| |
Collapse
|
20
|
Zhang H, Wang J, Zeng D, Tao X, Ma J. Regularization strategies in statistical image reconstruction of low-dose x-ray CT: A review. Med Phys 2018; 45:e886-e907. [PMID: 30098050 DOI: 10.1002/mp.13123] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2018] [Revised: 06/22/2018] [Accepted: 08/04/2018] [Indexed: 12/17/2022] Open
Abstract
Statistical image reconstruction (SIR) methods have shown potential to substantially improve the image quality of low-dose x-ray computed tomography (CT) as compared to the conventional filtered back-projection (FBP) method. According to the maximum a posteriori (MAP) estimation, the SIR methods are typically formulated by an objective function consisting of two terms: (a) a data-fidelity term that models imaging geometry and physical detection processes in projection data acquisition, and (b) a regularization term that reflects prior knowledge or expectations of the characteristics of the to-be-reconstructed image. SIR desires accurate system modeling of data acquisition, while the regularization term also has a strong influence on the quality of reconstructed images. A variety of regularization strategies have been proposed for SIR in the past decades, based on different assumptions, models, and prior knowledge. In this paper, we review the conceptual and mathematical bases of these regularization strategies and briefly illustrate their efficacies in SIR of low-dose CT.
Collapse
Affiliation(s)
- Hao Zhang
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94304, USA
| | - Jing Wang
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China
| | - Xi Tao
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China
| |
Collapse
|
21
|
Zhang Y, Lu H, Rong J, Meng J, Shang J, Ren P, Zhang J. Adaptive non-local means on local principle neighborhood for noise/artifacts reduction in low-dose CT images. Med Phys 2018; 44:e230-e241. [PMID: 28901609 DOI: 10.1002/mp.12388] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Revised: 02/24/2017] [Accepted: 04/27/2017] [Indexed: 11/06/2022] Open
Abstract
PURPOSE Low-dose CT (LDCT) technique can reduce the x-ray radiation exposure to patients at the cost of degraded images with severe noise and artifacts. Non-local means (NLM) filtering has shown its potential in improving LDCT image quality. However, currently most NLM-based approaches employ a weighted average operation directly on all neighbor pixels with a fixed filtering parameter throughout the NLM filtering process, ignoring the non-stationary noise nature of LDCT images. In this paper, an adaptive NLM filtering scheme on local principle neighborhoods (PC-NLM) is proposed for structure-preserving noise/artifacts reduction in LDCT images. METHODS Instead of using neighboring patches directly, in the PC-NLM scheme, the principle component analysis (PCA) is first applied on local neighboring patches of the target patch to decompose the local patches into uncorrelated principle components (PCs), then a NLM filtering is used to regularize each PC of the target patch and finally the regularized components is transformed to get the target patch in image domain. Especially, in the NLM scheme, the filtering parameter is estimated adaptively from local noise level of the neighborhood as well as the signal-to-noise ratio (SNR) of the corresponding PC, which guarantees a "weaker" NLM filtering on PCs with higher SNR and a "stronger" filtering on PCs with lower SNR. The PC-NLM procedure is iteratively performed several times for better removal of the noise and artifacts, and an adaptive iteration strategy is developed to reduce the computational load by determining whether a patch should be processed or not in next round of the PC-NLM filtering. RESULTS The effectiveness of the presented PC-NLM algorithm is validated by experimental phantom studies and clinical studies. The results show that it can achieve promising gain over some state-of-the-art methods in terms of artifact suppression and structure preservation. CONCLUSIONS With the use of PCA on local neighborhoods to extract principal structural components, as well as adaptive NLM filtering on PCs of the target patch using filtering parameter estimated based on the local noise level and corresponding SNR, the proposed PC-NLM method shows its efficacy in preserving fine anatomical structures and suppressing noise/artifacts in LDCT images.
Collapse
Affiliation(s)
- Yuanke Zhang
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an, Shaanxi, 710032, China.,School of Information Science and Engineering, Qufu Normal University, Rizhao, Shandong, 276826, China
| | - Hongbing Lu
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an, Shaanxi, 710032, China
| | - Junyan Rong
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an, Shaanxi, 710032, China
| | - Jing Meng
- School of Information Science and Engineering, Qufu Normal University, Rizhao, Shandong, 276826, China
| | - Junliang Shang
- School of Information Science and Engineering, Qufu Normal University, Rizhao, Shandong, 276826, China
| | - Pinghong Ren
- School of Information Science and Engineering, Qufu Normal University, Rizhao, Shandong, 276826, China
| | - Junying Zhang
- School of Computer Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, China
| |
Collapse
|
22
|
Zhang H, Ma J, Wang J, Moore W, Liang Z. Assessment of prior image induced nonlocal means regularization for low-dose CT reconstruction: Change in anatomy. Med Phys 2018; 44:e264-e278. [PMID: 28901622 DOI: 10.1002/mp.12378] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Revised: 05/04/2017] [Accepted: 05/18/2017] [Indexed: 11/06/2022] Open
Abstract
PURPOSE Repeated computed tomography (CT) scans are prescribed for some clinical applications such as lung nodule surveillance. Several studies have demonstrated that incorporating a high-quality prior image into the reconstruction of subsequent low-dose CT (LDCT) acquisitions can either improve image quality or reduce data fidelity requirements. Our proposed previous normal-dose image induced nonlocal means (ndiNLM) regularization method for LDCT is an example of such a method. However, one major concern with prior image based methods is that they might produce false information when the prior image and the current LDCT image show different structures (for example, if a lung nodule emerges, grows, shrinks, or disappears over time). This study aims to assess the performance of the ndiNLM regularization method in situations with change in anatomy. METHOD We incorporated the ndiNLM regularization into the statistical image reconstruction (SIR) framework for reconstruction of subsequent LDCT images. Because of its patch-based search mechanism, a rough registration between the prior image and the current LDCT image is adequate for the SIR-ndiNLM method. We assessed the performance of the SIR-ndiNLM method in lung nodule surveillance for two different scenarios: (a) the nodule was not found in a baseline exam but appears in a follow-up LDCT scan; (b) the nodule was present in a baseline exam but disappears in a follow-up LDCT scan. We further investigated the effect of nodule size on the performance of the SIR-ndiNLM method. RESULTS We found that a relatively large search-window (e.g., 33 × 33) should be used for the SIR-ndiNLM method to account for misalignment between the prior image and the current LDCT image, and to ensure that enough similar patches can be found in the prior image. With proper selection of other parameters, experimental results with two patient datasets demonstrated that the SIR-ndiNLM method did not miss true nodules nor introduce false nodules in the lung nodule surveillance scenarios described above. We also found that the SIR-ndiNLM reconstruction shows improved image quality when the prior image is similar to the current LDCT image in anatomy. These gains in image quality might appear small upon visual inspection, but they can be detected using quantitative measures. Finally, the SIR-ndiNLM method also performed well in ultra-low-dose conditions and with different nodule sizes. CONCLUSIONS This study assessed the performance of the SIR-ndiNLM method in situations in which the prior image and the current LDCT image show substantial anatomical differences, specifically, changes in lung nodules. The experimental results demonstrate that the SIR-ndiNLM method does not introduce false lung nodules nor miss true nodules, which relieves the concern that this method might produce false information. However, there is insufficient evidence that these findings will hold true for all kinds of anatomical changes.
Collapse
Affiliation(s)
- Hao Zhang
- Department of Radiology, Stony Brook University, NY, 11794, USA.,Department of Biomedical Engineering, Stony Brook University, NY, 11794, USA
| | - Jianhua Ma
- Department of Biomedical Engineering, Southern Medical University, Guangdong, 510515, China
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, TX, 75390, USA
| | - William Moore
- Department of Radiology, Stony Brook University, NY, 11794, USA
| | - Zhengrong Liang
- Department of Radiology, Stony Brook University, NY, 11794, USA.,Department of Biomedical Engineering, Stony Brook University, NY, 11794, USA
| |
Collapse
|
23
|
Chen B, Xiang K, Gong Z, Wang J, Tan S. Statistical Iterative CBCT Reconstruction Based on Neural Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:1511-1521. [PMID: 29870378 PMCID: PMC6002810 DOI: 10.1109/tmi.2018.2829896] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Cone-beam computed tomography (CBCT) plays an important role in radiation therapy. Statistical iterative reconstruction (SIR) algorithms with specially designed penalty terms provide good performance for low-dose CBCT imaging. Among others, the total variation (TV) penalty is the current state-of-the-art in removing noises and preserving edges, but one of its well-known limitations is its staircase effect. Recently, various penalty terms with higher order differential operators were proposed to replace the TV penalty to avoid the staircase effect, at the cost of slightly blurring object edges. We developed a novel SIR algorithm using a neural network for CBCT reconstruction. We used a data-driven method to learn the "potential regularization term" rather than design a penalty term manually. This approach converts the problem of designing a penalty term in the traditional statistical iterative framework to designing and training a suitable neural network for CBCT reconstruction. We proposed using transfer learning to overcome the data deficiency problem and an iterative deblurring approach specially designed for the CBCT iterative reconstruction process during which the noise level and resolution of the reconstructed images may change. Through experiments conducted on two physical phantoms, two simulation digital phantoms, and patient data, we demonstrated the excellent performance of the proposed network-based SIR for CBCT reconstruction, both visually and quantitatively. Our proposed method can overcome the staircase effect, preserve both edges and regions with smooth intensity transition, and provide reconstruction results at high resolution and low noise level.
Collapse
|
24
|
Niu S, Yu G, Ma J, Wang J. Nonlocal low-rank and sparse matrix decomposition for spectral CT reconstruction. INVERSE PROBLEMS 2018; 34:024003. [PMID: 30294061 PMCID: PMC6168215 DOI: 10.1088/1361-6420/aa942c] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Spectral computed tomography (CT) has been a promising technique in research and clinic because of its ability to produce improved energy resolution images with narrow energy bins. However, the narrow energy bin image is often affected by serious quantum noise because of the limited number of photons used in the corresponding energy bin. To address this problem, we present an iterative reconstruction method for spectral CT using nonlocal low-rank and sparse matrix decomposition (NLSMD), which exploits the self-similarity of patches that are collected in multi-energy images. Specifically, each set of patches can be decomposed into a low-rank component and a sparse component, and the low-rank component represents the stationary background over different energy bins, while the sparse component represents the rest of different spectral features in individual energy bins. Subsequently, an effective alternating optimization algorithm was developed to minimize the associated objective function. To validate and evaluate the NLSMD method, qualitative and quantitative studies were conducted by using simulated and real spectral CT data. Experimental results show that the NLSMD method improves spectral CT images in terms of noise reduction, artifacts suppression and resolution preservation.
Collapse
Affiliation(s)
- Shanzhou Niu
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75235, USA
- School of Mathematics and Computer Science, Gannan Normal University, Ganzhou 341000, China
| | - Gaohang Yu
- School of Mathematics and Computer Science, Gannan Normal University, Ganzhou 341000, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75235, USA
| |
Collapse
|
25
|
[Redundancy information-induced image reconstruction for low-dose myocardial perfusion computed tomography]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2018; 38:27-33. [PMID: 33177030 PMCID: PMC6765608 DOI: 10.3969/j.issn.1673-4254.2018.01.05] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
OBJECTIVE In the clinic, myocardial perfusion computed tomography (MPCT) imaging is commonly used to detect and assess myocardial ischemia quantitatively. However, repeated scanning on the myocardial region in the cine mode will increase the radiation dose for patients. With lowering radiation dose, the quality of images are degraded by noise induced artifact, which hampers the diagnostic accuracy. Therefore, in this paper, we propose a redundancy information induced iterative reconstruction framework for high quality MPCT images at the case of low dose. METHODS MPCT images have redundant structural information within frames and highly similarity between adjacent frames. Inspired by the two properties, in this work we propose a penalized weighted least-squares (PWLS) model incorporating NLM and TV based hybrid constraints, which is referred to as PWLS-aviNLM-TV for simplicity. The proposed algorithm can effectively eliminate noise and artifacts by taking into account the similarity between adjacent frames and redundancy information within frames, which also can improve spatial resolution within frames and maintain temporal resolution. RESULTS The experimental results on the 4D extended cardiac-torso (XCAT) phantom and preclinical porcine dataset demonstrates that the PWLS-aviNLM-TV algorithm obtains better performance in terms of noise reduction and artifacts suppression than the PWLS-TV and PWLSaviNLM algorithm. Moreover, the proposed algorithm can preserve the edges and detail information thereby efficiently differentiate ischemia from myocardium. CONCLUSIONS The present redundancy information induced reconstruction algorithm can reconstruct high-quality images from low-dose MPCT for better clinical imaging diagnosis.
Collapse
|
26
|
Zhang L, Zeng L, Guo Y. l0 regularization based on a prior image incorporated non-local means for limited-angle X-ray CT reconstruction. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2018; 26:481-498. [PMID: 29562578 DOI: 10.3233/xst-17334] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
PURPOSES Restricted by the scanning environment in some CT imaging modalities, the acquired projection data are usually incomplete, which may lead to a limited-angle reconstruction problem. Thus, image quality usually suffers from the slope artifacts. The objective of this study is to first investigate the distorted domains of the reconstructed images which encounter the slope artifacts and then present a new iterative reconstruction method to address the limited-angle X-ray CT reconstruction problem. METHODS The presented framework of new method exploits the structural similarity between the prior image and the reconstructed image aiming to compensate the distorted edges. Specifically, the new method utilizes l0 regularization and wavelet tight framelets to suppress the slope artifacts and pursue the sparsity. New method includes following 4 steps to (1) address the data fidelity using SART; (2) compensate for the slope artifacts due to the missed projection data using the prior image and modified nonlocal means (PNLM); (3) utilize l0 regularization to suppress the slope artifacts and pursue the sparsity of wavelet coefficients of the transformed image by using iterative hard thresholding (l0W); and (4) apply an inverse wavelet transform to reconstruct image. In summary, this method is referred to as "l0W-PNLM". RESULTS Numerical implementations showed that the presented l0W-PNLM was superior to suppress the slope artifacts while preserving the edges of some features as compared to the commercial and other popular investigative algorithms. When the image to be reconstructed is inconsistent with the prior image, the new method can avoid or minimize the distorted edges in the reconstructed images. Quantitative assessments also showed that applying the new method obtained the highest image quality comparing to the existing algorithms. CONCLUSIONS This study demonstrated that the presented l0W-PNLM yielded higher image quality due to a number of unique characteristics, which include that (1) it utilizes the structural similarity between the reconstructed image and prior image to modify the distorted edges by slope artifacts; (2) it adopts wavelet tight frames to obtain the first and high derivative in several directions and levels; and (3) it takes advantage of l0 regularization to promote the sparsity of wavelet coefficients, which is effective for the inhibition of the slope artifacts. Therefore, the new method can address the limited-angle CT reconstruction problem effectively and have practical significance.
Collapse
Affiliation(s)
- Lingli Zhang
- College of Mathematics and Statistics, Chongqing University, Chongqing, China
- Engineering Research Center of Industrial Computed Tomography Nondestructive Testing of the Education Ministry of China, Chongqing University, Chongqing, China
| | - Li Zeng
- College of Mathematics and Statistics, Chongqing University, Chongqing, China
- Engineering Research Center of Industrial Computed Tomography Nondestructive Testing of the Education Ministry of China, Chongqing University, Chongqing, China
| | - Yumeng Guo
- College of Mathematics and Statistics, Chongqing University, Chongqing, China
- Engineering Research Center of Industrial Computed Tomography Nondestructive Testing of the Education Ministry of China, Chongqing University, Chongqing, China
| |
Collapse
|
27
|
Liu J, Ma J, Zhang Y, Chen Y, Yang J, Shu H, Luo L, Coatrieux G, Yang W, Feng Q, Chen W. Discriminative Feature Representation to Improve Projection Data Inconsistency for Low Dose CT Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:2499-2509. [PMID: 28816658 DOI: 10.1109/tmi.2017.2739841] [Citation(s) in RCA: 46] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
In low dose computed tomography (LDCT) imaging, the data inconsistency of measured noisy projections can significantly deteriorate reconstruction images. To deal with this problem, we propose here a new sinogram restoration approach, the sinogram- discriminative feature representation (S-DFR) method. Different from other sinogram restoration methods, the proposed method works through a 3-D representation-based feature decomposition of the projected attenuation component and the noise component using a well-designed composite dictionary containing atoms with discriminative features. This method can be easily implemented with good robustness in parameter setting. Its comparison to other competing methods through experiments on simulated and real data demonstrated that the S-DFR method offers a sound alternative in LDCT.
Collapse
|
28
|
Zhang W, Song Y, Chen Y, Ma J, Sun J, Zhao J. Limited-Range Few-View CT: Using Historical Images for ROI Reconstruction in Solitary Lung Nodules Follow-up Examination. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:2569-2577. [PMID: 29192886 DOI: 10.1109/tmi.2017.2766101] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Repeated CT scans are known to increase the risk of cancer; thus, it is paradoxical to use multiple follow-up CT scans to monitor the development of a lung nodule and conduct early treatment of the nodule. In the case of a solitary lung nodule, regional scanning and region of interest (ROI) reconstruction are likely to restore the internal area at the nodule. A limited-range few-view CT is proposed in this paper for lung nodule follow-ups with extremely reduced X-radiation. For a planned scanning of an ROI, where a solitary lung nodule is positioned, a limited-range few-view CT can be employed, and thus, less tissue is exposed to X-radiation per view. An ROI reconstruction method is also proposed that makes full use of the former standard lung scan. The experimental results show that the nodule size and shape are preserved. In the case of a 40-mm ROI, the number of exposed X-rays can be reduced by 99.6% for a circular scan and 99.9% for a 3-D scan.
Collapse
|
29
|
Zhang Y, Rong J, Lu H, Xing Y, Meng J. Low-Dose Lung CT Image Restoration Using Adaptive Prior Features From Full-Dose Training Database. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:2510-2523. [PMID: 28961108 DOI: 10.1109/tmi.2017.2757035] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The valuable structure features in full-dose computed tomography (FdCT) scans can be exploited as prior knowledge for low-dose CT (LdCT) imaging. However, lacking the capability to represent local characteristics of interested structures of the LdCT image adaptively may result in poor preservation of details/textures in LdCT image. This paper aims to explore a novel prior knowledge retrieval and representation paradigm, called adaptive prior features assisted restoration algorithm, for the purpose of better restoration of the low-dose lung CT images by capturing local features from FdCT scans adaptively. The innovation lies in the construction of an offline training database and the online patch-search scheme integrated with the principal components analysis (PCA). Specifically, the offline training database is composed of 3-D patch samples extracted from existing full-dose lung scans. For online patch-search, 3-D patches with structure similar to the noisy target patch are first selected from the database as the training samples. Then, PCA is applied on the training samples to retrieve their local prior principal features adaptively. By employing the principal features to decompose the noisy target patch and using an adaptive coefficient shrinkage technique for inverse transformation, the noise of the target patch can be efficiently removed and the detailed texture can be well preserved. The effectiveness of the proposed algorithm was validated by CT scans of patients with lung cancer. The results show that it can achieve a noticeable gain over some state-of-the-art methods in terms of noise suppression and details/textures preservation.
Collapse
|
30
|
Zhang H, Zeng D, Lin J, Zhang H, Bian Z, Huang J, Gao Y, Zhang S, Zhang H, Feng Q, Liang Z, Chen W, Ma J. Iterative reconstruction for dual energy CT with an average image-induced nonlocal means regularization. Phys Med Biol 2017; 62:5556-5574. [PMID: 28471750 PMCID: PMC5497789 DOI: 10.1088/1361-6560/aa7122] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Reducing radiation dose in dual energy computed tomography (DECT) is highly desirable but it may lead to excessive noise in the filtered backprojection (FBP) reconstructed DECT images, which can inevitably increase the diagnostic uncertainty. To obtain clinically acceptable DECT images from low-mAs acquisitions, in this work we develop a novel scheme based on measurement of DECT data. In this scheme, inspired by the success of edge-preserving non-local means (NLM) filtering in CT imaging and the intrinsic characteristics underlying DECT images, i.e. global correlation and non-local similarity, an averaged image induced NLM-based (aviNLM) regularization is incorporated into the penalized weighted least-squares (PWLS) framework. Specifically, the presented NLM-based regularization is designed by averaging the acquired DECT images, which takes the image similarity within the two energies into consideration. In addition, the weighted least-squares term takes into account DECT data-dependent variance. For simplicity, the presented scheme was termed as 'PWLS-aviNLM'. The performance of the presented PWLS-aviNLM algorithm was validated and evaluated on digital phantom, physical phantom and patient data. The extensive experiments validated that the presented PWLS-aviNLM algorithm outperforms the FBP, PWLS-TV and PWLS-NLM algorithms quantitatively. More importantly, it delivers the best qualitative results with the finest details and the fewest noise-induced artifacts, due to the aviNLM regularization learned from DECT images. This study demonstrated the feasibility and efficacy of the presented PWLS-aviNLM algorithm to improve the DECT reconstruction and resulting material decomposition.
Collapse
Affiliation(s)
- Houjin Zhang
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Dong Zeng
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Jiahui Lin
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Hao Zhang
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, USA
| | - Zhaoying Bian
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Jing Huang
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Yuanyuan Gao
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Shanli Zhang
- The First Affiliated Hospital of Guangzhou University of Traditional Chinese Medicine, Guangzhou, Guangdong, China
| | - Hua Zhang
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Qianjin Feng
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Zhengrong Liang
- Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, New York 11794 USA
| | - Wufan Chen
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University Guangzhou, Guangdong 510515, China
| | - Jianhua Ma
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Guangzhou 510515, China
| |
Collapse
|
31
|
[Sinogram restoration for low-dose cerebral perfusion CT images]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2017; 37. [PMID: 28446398 PMCID: PMC6744093 DOI: 10.3969/j.issn.1673-4254.2017.04.08] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
In clinical cerebral perfusion CT examination, repeated scanning the region of interest in the cine mode increases the radiation dose of the patients, while decreasing the radiation dose by lowering the scanning current results in poor image quality and affects the clinical diagnosis. We propose a penalized weighted least-square (PWLS) method for recovering the projection data to improve the quality of low-dose cerebral perfusion CT imaged. This method incorporates the statistical distribution characteristics of brain perfusion CT projection data and uses the statistical properties of the projection data for modeling. The PWLS method was used to recover the data, and the Gauss-Seidel (GS) method was employed for iterative solving. Adaptive weighting is introduced between the original projection data and the projection data after PWLS restoration. The experimental results on the clinical data demonstrated that the PWLS-based sinogram restoration method improved noise reduction and artifact suppression as compared with the conventional noise reduction methods, and better retained the edges and details to generate better cerebral perfusion maps.
Collapse
|
32
|
Zhang H, Zeng D, Zhang H, Wang J, Liang Z, Ma J. Applications of nonlocal means algorithm in low-dose X-ray CT image processing and reconstruction: A review. Med Phys 2017; 44:1168-1185. [PMID: 28303644 DOI: 10.1002/mp.12097] [Citation(s) in RCA: 47] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2016] [Revised: 09/12/2016] [Accepted: 12/13/2016] [Indexed: 02/03/2023] Open
Abstract
Low-dose X-ray computed tomography (LDCT) imaging is highly recommended for use in the clinic because of growing concerns over excessive radiation exposure. However, the CT images reconstructed by the conventional filtered back-projection (FBP) method from low-dose acquisitions may be severely degraded with noise and streak artifacts due to excessive X-ray quantum noise, or with view-aliasing artifacts due to insufficient angular sampling. In 2005, the nonlocal means (NLM) algorithm was introduced as a non-iterative edge-preserving filter to denoise natural images corrupted by additive Gaussian noise, and showed superior performance. It has since been adapted and applied to many other image types and various inverse problems. This paper specifically reviews the applications of the NLM algorithm in LDCT image processing and reconstruction, and explicitly demonstrates its improving effects on the reconstructed CT image quality from low-dose acquisitions. The effectiveness of these applications on LDCT and their relative performance are described in detail.
Collapse
Affiliation(s)
- Hao Zhang
- Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China.,Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, 510515, China.,Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Guangzhou, 510515, China
| | - Hua Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China.,Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, 510515, China.,Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Guangzhou, 510515, China
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Zhengrong Liang
- Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China.,Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, 510515, China.,Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Guangzhou, 510515, China
| |
Collapse
|
33
|
张 忻, 张 华, 边 兆, 曾 栋, 何 基, 田 秀, 马 建, 黄 静. [Influence of projection data correction on digital breast tomosynthesis imaging]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2017; 37:323-329. [PMID: 28377347 PMCID: PMC6780453 DOI: 10.3969/j.issn.1673-4254.2017.03.08] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Received: 09/15/2016] [Indexed: 06/07/2023]
Abstract
OBJECTIVE To investigate the effect of detector performance during digital breast tomography (DBT) projection data acquisition on reconstructed image quality. METHODS With reference to the traditional detector data correction method and the specific data acquisition pattern in DBT imaging, we utilized dark field correction, light field and its gain correction for processing the projection data collected by the detector. The reconstructed images were evaluated using iterative reconstruction method based on total generalized variation (TGV). RESULTS In physical breast phantom experiment, the proposed method resulted in a reduced Heel effect caused by nonuniform photon number. The reconstructed DBT images after correction showed obviously improved image quality especially in the details with a low contrast. CONCLUSION The dark field correction, light field and its gain correction process for DBT image reconstruction can improve the image quality.
Collapse
Affiliation(s)
- 忻宇 张
- />南方医科大学生物医学工程学院,广东省医学图像处理重点实验室,广东 广州 510515Department of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University,
Guangzhou 510515, China
| | - 华 张
- />南方医科大学生物医学工程学院,广东省医学图像处理重点实验室,广东 广州 510515Department of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University,
Guangzhou 510515, China
| | - 兆英 边
- />南方医科大学生物医学工程学院,广东省医学图像处理重点实验室,广东 广州 510515Department of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University,
Guangzhou 510515, China
| | - 栋 曾
- />南方医科大学生物医学工程学院,广东省医学图像处理重点实验室,广东 广州 510515Department of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University,
Guangzhou 510515, China
| | - 基 何
- />南方医科大学生物医学工程学院,广东省医学图像处理重点实验室,广东 广州 510515Department of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University,
Guangzhou 510515, China
| | - 秀梅 田
- />南方医科大学生物医学工程学院,广东省医学图像处理重点实验室,广东 广州 510515Department of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University,
Guangzhou 510515, China
| | - 建华 马
- />南方医科大学生物医学工程学院,广东省医学图像处理重点实验室,广东 广州 510515Department of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University,
Guangzhou 510515, China
| | - 静 黄
- />南方医科大学生物医学工程学院,广东省医学图像处理重点实验室,广东 广州 510515Department of Biomedical Engineering, Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University,
Guangzhou 510515, China
| |
Collapse
|
34
|
Kim SM, Alessio AM, De Man B, Kinahan PE. Direct Reconstruction of CT-based Attenuation Correction Images for PET with Cluster-Based Penalties. IEEE TRANSACTIONS ON NUCLEAR SCIENCE 2017; 64:959-968. [PMID: 30337765 PMCID: PMC6191195 DOI: 10.1109/tns.2017.2654680] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Extremely low-dose CT acquisitions used for PET attenuation correction have high levels of noise and potential bias artifacts due to photon starvation. This work explores the use of a priori knowledge for iterative image reconstruction of the CT-based attenuation map. We investigate a maximum a posteriori framework with cluster-based multinomial penalty for direct iterative coordinate decent (dICD) reconstruction of the PET attenuation map. The objective function for direct iterative attenuation map reconstruction used a Poisson log-likelihood data fit term and evaluated two image penalty terms of spatial and mixture distributions. The spatial regularization is based on a quadratic penalty. For the mixture penalty, we assumed that the attenuation map may consist of four material clusters: air+background, lung, soft tissue, and bone. Using simulated noisy sinogram data, dICD reconstruction was performed with different strengths of the spatial and mixture penalties. The combined spatial and mixture penalties reduced the RMSE by roughly 2 times compared to a weighted least square and filtered backprojection reconstruction of CT images. The combined spatial and mixture penalties resulted in only slightly lower RMSE compared to a spatial quadratic penalty alone. For direct PET attenuation map reconstruction from ultra-low dose CT acquisitions, the combination of spatial and mixture penalties offers regularization of both variance and bias and is a potential method to reconstruct attenuation maps with negligible patient dose. The presented results, using a best-case histogram suggest that the mixture penalty does not offer a substantive benefit over conventional quadratic regularization and diminishes enthusiasm for exploring future application of the mixture penalty.
Collapse
Affiliation(s)
- Soo Mee Kim
- Department of Radiology, University of Washington, Seattle, WA 98185, USA, telephone: +1-206-543-0236
| | - Adam M Alessio
- Department of Radiology, University of Washington, Seattle, WA 98185, USA, telephone: +1-206-543-0236
| | - Bruno De Man
- Image Reconstruction Laboratory, General Electric Global Research Center, Niskayuna, NY 12309, USA
| | - Paul E Kinahan
- Department of Radiology, University of Washington, Seattle, WA 98185, USA, telephone: +1-206-543-0236
| |
Collapse
|
35
|
Chen Y, Liu J, Hu Y, Yang J, Shi L, Shu H, Gui Z, Coatrieux G, Luo L. Discriminative feature representation: an effective postprocessing solution to low dose CT imaging. Phys Med Biol 2017; 62:2103-2131. [PMID: 28212114 DOI: 10.1088/1361-6560/aa5c24] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
This paper proposes a concise and effective approach termed discriminative feature representation (DFR) for low dose computerized tomography (LDCT) image processing, which is currently a challenging problem in medical imaging field. This DFR method assumes LDCT images as the superposition of desirable high dose CT (HDCT) 3D features and undesirable noise-artifact 3D features (the combined term of noise and artifact features induced by low dose scan protocols), and the decomposed HDCT features are used to provide the processed LDCT images with higher quality. The target HDCT features are solved via the DFR algorithm using a featured dictionary composed by atoms representing HDCT features and noise-artifact features. In this study, the featured dictionary is efficiently built using physical phantom images collected from the same CT scanner as the target clinical LDCT images to process. The proposed DFR method also has good robustness in parameter setting for different CT scanner types. This DFR method can be directly applied to process DICOM formatted LDCT images, and has good applicability to current CT systems. Comparative experiments with abdomen LDCT data validate the good performance of the proposed approach.
Collapse
Affiliation(s)
- Yang Chen
- Laboratory of Image Science and Technology, Southeast University, Nanjing 210096, People's Republic of China. Centre de Recherche en Information Biomedicale Sino-Francais (LIA CRIBs), Rennes, France. Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, People's Republic of China
| | | | | | | | | | | | | | | | | |
Collapse
|
36
|
Arcadu F, Marone F, Stampanoni M. Fast iterative reconstruction of data in full interior tomography. JOURNAL OF SYNCHROTRON RADIATION 2017; 24:205-219. [PMID: 28009560 DOI: 10.1107/s1600577516015794] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2016] [Accepted: 10/06/2016] [Indexed: 06/06/2023]
Abstract
This paper introduces two novel strategies for iterative reconstruction of full interior tomography (FINT) data, i.e. when the field of view is entirely inside the object support and knowledge of the object support itself or the attenuation coefficients inside specific regions of interest are not available. The first approach is based on data edge-padding. The second technique creates an intermediate virtual sinogram, which is, then, reconstructed by a standard iterative algorithm. Both strategies are validated in the framework of the alternate direction method of multipliers plug-and-play with gridding projectors that provide a speed-up of three orders of magnitude with respect to standard operators implemented in real space. The proposed methods are benchmarked on synchrotron-based X-ray tomographic microscopy datasets of mouse lung alveoli. Compared with analytical techniques, the proposed methods substantially improve the reconstruction quality for FINT underconstrained datasets, facilitating subsequent post-processing steps.
Collapse
Affiliation(s)
- F Arcadu
- Institute for Biomedical Engineering, ETH Zurich, 8092 Zurich, Switzerland
| | - F Marone
- Swiss Light Source, Paul Scherrer Institute, 5232 Villigen, Switzerland
| | - M Stampanoni
- Institute for Biomedical Engineering, ETH Zurich, 8092 Zurich, Switzerland
| |
Collapse
|
37
|
Li B, Lyu Q, Ma J, Wang J. Iterative reconstruction for CT perfusion with a prior-image induced hybrid nonlocal means regularization: Phantom studies. Med Phys 2016; 43:1688. [PMID: 27036567 DOI: 10.1118/1.4943380] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE In computed tomography perfusion (CTP) imaging, an initial phase CT acquired with a high-dose protocol can be used to improve the image quality of later phase CT acquired with a low-dose protocol. For dynamic regions, signals in the later low-dose CT may not be completely recovered if the initial CT heavily regularizes the iterative reconstruction process. The authors propose a hybrid nonlocal means (hNLM) regularization model for iterative reconstruction of low-dose CTP to overcome the limitation of the conventional prior-image induced penalty. METHODS The hybrid penalty was constructed by combining the NLM of the initial phase high-dose CT in the stationary region and later phase low-dose CT in the dynamic region. The stationary and dynamic regions were determined by the similarity between the initial high-dose scan and later low-dose scan. The similarity was defined as a Gaussian kernel-based distance between the patch-window of the same pixel in the two scans, and its measurement was then used to weigh the influence of the initial high-dose CT. For regions with high similarity (e.g., stationary region), initial high-dose CT played a dominant role for regularizing the solution. For regions with low similarity (e.g., dynamic region), the regularization relied on a low-dose scan itself. This new hNLM penalty was incorporated into the penalized weighted least-squares (PWLS) for CTP reconstruction. Digital and physical phantom studies were performed to evaluate the PWLS-hNLM algorithm. RESULTS Both phantom studies showed that the PWLS-hNLM algorithm is superior to the conventional prior-image induced penalty term without considering the signal changes within the dynamic region. In the dynamic region of the Catphan phantom, the reconstruction error measured by root mean square error was reduced by 42.9% in PWLS-hNLM reconstructed image. CONCLUSIONS The PWLS-hNLM algorithm can effectively use the initial high-dose CT to reconstruct low-dose CTP in the stationary region while reducing its influence in the dynamic region.
Collapse
Affiliation(s)
- Bin Li
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China and Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, Texas 75390
| | - Qingwen Lyu
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, Texas 75390 and Zhujiang Hospital, Southern Medical University, Guangdong 510280, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, Texas 75390
| |
Collapse
|
38
|
Tian X, Zeng D, Zhang S, Huang J, Zhang H, He J, Lu L, Xi W, Ma J, Bian Z. Robust low-dose dynamic cerebral perfusion CT image restoration via coupled dictionary learning scheme. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2016; 24:837-853. [PMID: 27612048 DOI: 10.3233/xst-160593] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Dynamic cerebral perfusion x-ray computed tomography (PCT) imaging has been advocated to quantitatively and qualitatively assess hemodynamic parameters in the diagnosis of acute stroke or chronic cerebrovascular diseases. However, the associated radiation dose is a significant concern to patients due to its dynamic scan protocol. To address this issue, in this paper we propose an image restoration method by utilizing coupled dictionary learning (CDL) scheme to yield clinically acceptable PCT images with low-dose data acquisition. Specifically, in the present CDL scheme, the 2D background information from the average of the baseline time frames of low-dose unenhanced CT images and the 3D enhancement information from normal-dose sequential cerebral PCT images are exploited to train the dictionary atoms respectively. After getting the two trained dictionaries, we couple them to represent the desired PCT images as spatio-temporal prior in objective function construction. Finally, the low-dose dynamic cerebral PCT images are restored by using a general DL image processing. To get a robust solution, the objective function is solved by using a modified dictionary learning based image restoration algorithm. The experimental results on clinical data show that the present method can yield more accurate kinetic enhanced details and diagnostic hemodynamic parameter maps than the state-of-the-art methods.
Collapse
Affiliation(s)
- Xiumei Tian
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| | - Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| | - Shanli Zhang
- The First Affiliated Hospital of Guangzhou University of Traditional Chinese Medicine, Guangzhou, Guangdong, China
| | - Jing Huang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| | - Hua Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| | - Ji He
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| | - Lijun Lu
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| | - Weiwen Xi
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, China
| |
Collapse
|
39
|
Zeng D, Gao Y, Huang J, Bian Z, Zhang H, Lu L, Ma J. Penalized weighted least-squares approach for multienergy computed tomography image reconstruction via structure tensor total variation regularization. Comput Med Imaging Graph 2016; 53:19-29. [PMID: 27490315 DOI: 10.1016/j.compmedimag.2016.07.002] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2015] [Revised: 06/13/2016] [Accepted: 07/14/2016] [Indexed: 11/17/2022]
Abstract
Multienergy computed tomography (MECT) allows identifying and differentiating different materials through simultaneous capture of multiple sets of energy-selective data belonging to specific energy windows. However, because sufficient photon counts are not available in each energy window compared with that in the whole energy window, the MECT images reconstructed by the analytical approach often suffer from poor signal-to-noise and strong streak artifacts. To address the particular challenge, this work presents a penalized weighted least-squares (PWLS) scheme by incorporating the new concept of structure tensor total variation (STV) regularization, which is henceforth referred to as 'PWLS-STV' for simplicity. Specifically, the STV regularization is derived by penalizing higher-order derivatives of the desired MECT images. Thus it could provide more robust measures of image variation, which can eliminate the patchy artifacts often observed in total variation (TV) regularization. Subsequently, an alternating optimization algorithm was adopted to minimize the objective function. Extensive experiments with a digital XCAT phantom and meat specimen clearly demonstrate that the present PWLS-STV algorithm can achieve more gains than the existing TV-based algorithms and the conventional filtered backpeojection (FBP) algorithm in terms of both quantitative and visual quality evaluations.
Collapse
Affiliation(s)
- Dong Zeng
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong 510515, China
| | - Yuanyuan Gao
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong 510515, China
| | - Jing Huang
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong 510515, China
| | - Zhaoying Bian
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong 510515, China
| | - Hua Zhang
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong 510515, China
| | - Lijun Lu
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong 510515, China
| | - Jianhua Ma
- Department of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong 510515, China.
| |
Collapse
|
40
|
Ji D, Qu G, Liu B. Simultaneous algebraic reconstruction technique based on guided image filtering. OPTICS EXPRESS 2016; 24:15897-911. [PMID: 27410859 DOI: 10.1364/oe.24.015897] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
The challenge of computed tomography is to reconstruct high-quality images from few-view projections. Using a prior guidance image, guided image filtering smoothes images while preserving edge features. The prior guidance image can be incorporated into the image reconstruction process to improve image quality. We propose a new simultaneous algebraic reconstruction technique based on guided image filtering. Specifically, the prior guidance image is updated in the image reconstruction process, merging information iteratively. To validate the algorithm practicality and efficiency, experiments were performed with numerical phantom projection data and real projection data. The results demonstrate that the proposed method is effective and efficient for nondestructive testing and rock mechanics.
Collapse
|
41
|
Karimi D, Ward RK. Patch-based models and algorithms for image processing: a review of the basic principles and methods, and their application in computed tomography. Int J Comput Assist Radiol Surg 2016; 11:1765-77. [PMID: 27287761 DOI: 10.1007/s11548-016-1434-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2016] [Accepted: 05/27/2016] [Indexed: 11/28/2022]
Abstract
PURPOSE Image models are central to all image processing tasks. The great advancements in digital image processing would not have been made possible without powerful models which, themselves, have evolved over time. In the past decade, "patch-based" models have emerged as one of the most effective models for natural images. Patch-based methods have outperformed other competing methods in many image processing tasks. These developments have come at a time when greater availability of powerful computational resources and growing concerns over the health risks of the ionizing radiation encourage research on image processing algorithms for computed tomography (CT). The goal of this paper is to explain the principles of patch-based methods and to review some of their recent applications in CT. METHODS We first review the central concepts in patch-based image processing and explain some of the state-of-the-art algorithms, with a focus on aspects that are more relevant to CT. Then, we review some of the recent application of patch-based methods in CT. RESULTS Patch-based methods have already transformed the field of image processing, leading to state-of-the-art results in many applications. More recently, several studies have proposed patch-based algorithms for various image processing tasks in CT, from denoising and restoration to iterative reconstruction. Although these studies have reported good results, the true potential of patch-based methods for CT has not been yet appreciated. CONCLUSIONS Patch-based methods can play a central role in image reconstruction and processing for CT. They have the potential to lead to substantial improvements in the current state of the art.
Collapse
Affiliation(s)
| | - Rabab K Ward
- , 2366 Main Mall, Vancouver, BC, V6T 1Z4, Canada
| |
Collapse
|
42
|
Rashed EA, Kudo H. Probabilistic atlas prior for CT image reconstruction. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 128:119-136. [PMID: 27040837 DOI: 10.1016/j.cmpb.2016.02.017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2015] [Revised: 02/24/2016] [Accepted: 02/24/2016] [Indexed: 06/05/2023]
Abstract
BACKGROUND AND OBJECTIVES In computed tomography (CT), statistical iterative reconstruction (SIR) approaches can produce images of higher quality compared to the conventional analytical methods such as filtered backprojection (FBP) algorithm. Effective noise modeling and possibilities to incorporate priors in the image reconstruction problem are the main advantages that lead to continuous development of SIR methods. Oriented by low-dose CT requirements, several methods are recently developed to obtain a high-quality image reconstruction from down-sampled or noisy projection data. In this paper, a new prior information obtained from probabilistic atlas is proposed for low-dose CT image reconstruction. METHODS The proposed approach consists of two main phases. In learning phase, a dataset of images obtained from different patients is used to construct a 3D atlas with Laplacian mixture model. The expectation maximization (EM) algorithm is used to estimate the mixture parameters. In reconstruction phase, prior information obtained from the probabilistic atlas is used to construct the cost function for image reconstruction. RESULTS We investigate the low-dose imaging by considering the reduction of X-ray beam intensity and by acquiring the projection data through a small number of views or limited view angles. Experimental studies using simulated data and chest screening CT data demonstrate that the probabilistic atlas prior is a practically promising approach for the low-dose CT imaging. CONCLUSIONS The prior information obtained from probabilistic atlas constructed from earlier scans of different patients is useful in low-dose CT imaging.
Collapse
Affiliation(s)
- Essam A Rashed
- Image Science Lab., Department of Mathematics, Faculty of Science, Suez Canal University, Ismailia 41522, Egypt; Division of Information Engineering, Faculty of Engineering, Information and Systems, University of Tsukuba, Tennoudai1-1-1, Tsukuba 305-8573, Japan.
| | - Hiroyuki Kudo
- Division of Information Engineering, Faculty of Engineering, Information and Systems, University of Tsukuba, Tennoudai1-1-1, Tsukuba 305-8573, Japan; JST-ERATO, Momose Quantum-Beam Phase Imaging Project, Katahira 2-1-1, Aoba-ku, Sendai 980-8577, Japan
| |
Collapse
|
43
|
Zhang H, Han H, Liang Z, Hu Y, Liu Y, Moore W, Ma J, Lu H. Extracting Information From Previous Full-Dose CT Scan for Knowledge-Based Bayesian Reconstruction of Current Low-Dose CT Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:860-870. [PMID: 26561284 PMCID: PMC4783190 DOI: 10.1109/tmi.2015.2498148] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
Markov random field (MRF) model has been widely employed in edge-preserving regional noise smoothing penalty to reconstruct piece-wise smooth images in the presence of noise, such as in low-dose computed tomography (LdCT). While it preserves edge sharpness, its regional smoothing may sacrifice tissue image textures, which have been recognized as useful imaging biomarkers, and thus it may compromise clinical tasks such as differentiating malignant vs. benign lesions, e.g., lung nodules or colon polyps. This study aims to shift the edge-preserving regional noise smoothing paradigm to texture-preserving framework for LdCT image reconstruction while retaining the advantage of MRF's neighborhood system on edge preservation. Specifically, we adapted the MRF model to incorporate the image textures of muscle, fat, bone, lung, etc. from previous full-dose CT (FdCT) scan as a priori knowledge for texture-preserving Bayesian reconstruction of current LdCT images. To show the feasibility of the proposed reconstruction framework, experiments using clinical patient scans were conducted. The experimental outcomes showed a dramatic gain by the a priori knowledge for LdCT image reconstruction using the commonly-used Haralick texture measures. Thus, it is conjectured that the texture-preserving LdCT reconstruction has advantages over the edge-preserving regional smoothing paradigm for texture-specific clinical applications.
Collapse
Affiliation(s)
| | | | | | - Yifan Hu
- Dept. of Radiology, State University of New York at Stony Brook, NY 11794 USA
| | - Yan Liu
- Dept. of Radiology, State University of New York at Stony Brook, NY 11794 USA
| | - William Moore
- Dept. of Radiology, State University of New York at Stony Brook, NY 11794 USA
| | - Jianhua Ma
- Dept. of Biomedical Engineering, Southern Medical University, Guangdong 510515, China
| | - Hongbing Lu
- Dept. of Biomedical Engineering, Fourth Military Medical University, Shaanxi 710032, China
| |
Collapse
|
44
|
Kazantsev D, Guo E, Kaestner A, Lionheart WRB, Bent J, Withers PJ, Lee PD. Temporal sparsity exploiting nonlocal regularization for 4D computed tomography reconstruction. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2016; 24:207-219. [PMID: 27002902 PMCID: PMC4929339 DOI: 10.3233/xst-160546] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2015] [Revised: 12/14/2015] [Accepted: 02/07/2016] [Indexed: 06/05/2023]
Abstract
X-ray imaging applications in medical and material sciences are frequently limited by the number of tomographic projections collected. The inversion of the limited projection data is an ill-posed problem and needs regularization. Traditional spatial regularization is not well adapted to the dynamic nature of time-lapse tomography since it discards the redundancy of the temporal information. In this paper, we propose a novel iterative reconstruction algorithm with a nonlocal regularization term to account for time-evolving datasets. The aim of the proposed nonlocal penalty is to collect the maximum relevant information in the spatial and temporal domains. With the proposed sparsity seeking approach in the temporal space, the computational complexity of the classical nonlocal regularizer is substantially reduced (at least by one order of magnitude). The presented reconstruction method can be directly applied to various big data 4D (x, y, z+time) tomographic experiments in many fields. We apply the proposed technique to modelled data and to real dynamic X-ray microtomography (XMT) data of high resolution. Compared to the classical spatio-temporal nonlocal regularization approach, the proposed method delivers reconstructed images of improved resolution and higher contrast while remaining significantly less computationally demanding.
Collapse
Affiliation(s)
- Daniil Kazantsev
- The Manchester X-ray Imaging Facility, School of Materials, The University of Manchester, Manchester, UK
- Research Complex at Harwell, Didcot, Oxfordshire, UK
| | - Enyu Guo
- The Manchester X-ray Imaging Facility, School of Materials, The University of Manchester, Manchester, UK
- Research Complex at Harwell, Didcot, Oxfordshire, UK
| | - Anders Kaestner
- Neutron Imaging and Activation Group, Paul Scherrer Institut, Switzerland
| | | | | | - Philip J. Withers
- The Manchester X-ray Imaging Facility, School of Materials, The University of Manchester, Manchester, UK
- Research Complex at Harwell, Didcot, Oxfordshire, UK
| | - Peter D. Lee
- The Manchester X-ray Imaging Facility, School of Materials, The University of Manchester, Manchester, UK
- Research Complex at Harwell, Didcot, Oxfordshire, UK
| |
Collapse
|
45
|
Shangguan H, Zhang Q, Liu Y, Cui X, Bai Y, Gui Z. Low-dose CT statistical iterative reconstruction via modified MRF regularization. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 123:129-141. [PMID: 26542474 DOI: 10.1016/j.cmpb.2015.10.004] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/17/2015] [Revised: 09/07/2015] [Accepted: 10/05/2015] [Indexed: 06/05/2023]
Abstract
It is desirable to reduce the excessive radiation exposure to patients in repeated medical CT applications. One of the most effective ways is to reduce the X-ray tube current (mAs) or tube voltage (kVp). However, it is difficult to achieve accurate reconstruction from the noisy measurements. Compared with the conventional filtered back-projection (FBP) algorithm leading to the excessive noise in the reconstructed images, the approaches using statistical iterative reconstruction (SIR) with low mAs show greater image quality. To eliminate the undesired artifacts and improve reconstruction quality, we proposed, in this work, an improved SIR algorithm for low-dose CT reconstruction, constrained by a modified Markov random field (MRF) regularization. Specifically, the edge-preserving total generalized variation (TGV), which is a generalization of total variation (TV) and can measure image characteristics up to a certain degree of differentiation, was introduced to modify the MRF regularization. In addition, a modified alternating iterative algorithm was utilized to optimize the cost function. Experimental results demonstrated that images reconstructed by the proposed method could not only generate high accuracy and resolution properties, but also ensure a higher peak signal-to-noise ratio (PSNR) in comparison with those using existing methods.
Collapse
Affiliation(s)
- Hong Shangguan
- National Key Laboratory for Electronic Measurement Technology, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China; Key Laboratory of Instrumentation Science & Dynamic Measurement, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China
| | - Quan Zhang
- National Key Laboratory for Electronic Measurement Technology, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China; Key Laboratory of Instrumentation Science & Dynamic Measurement, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China
| | - Yi Liu
- National Key Laboratory for Electronic Measurement Technology, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China; Key Laboratory of Instrumentation Science & Dynamic Measurement, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China
| | - Xueying Cui
- National Key Laboratory for Electronic Measurement Technology, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China; Key Laboratory of Instrumentation Science & Dynamic Measurement, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China; School of Applied Science, Taiyuan University of Science and Technology, Taiyuan 030024, China
| | - Yunjiao Bai
- National Key Laboratory for Electronic Measurement Technology, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China; Key Laboratory of Instrumentation Science & Dynamic Measurement, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China
| | - Zhiguo Gui
- National Key Laboratory for Electronic Measurement Technology, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China; Key Laboratory of Instrumentation Science & Dynamic Measurement, School of Information and Communication Engineering, North University of China, Taiyuan 030051, China.
| |
Collapse
|
46
|
Li J, Niu S, Huang J, Bian Z, Feng Q, Yu G, Liang Z, Chen W, Ma J. An Efficient Augmented Lagrangian Method for Statistical X-Ray CT Image Reconstruction. PLoS One 2015; 10:e0140579. [PMID: 26495975 PMCID: PMC4619856 DOI: 10.1371/journal.pone.0140579] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2014] [Accepted: 09/28/2015] [Indexed: 11/24/2022] Open
Abstract
Statistical iterative reconstruction (SIR) for X-ray computed tomography (CT) under the penalized weighted least-squares criteria can yield significant gains over conventional analytical reconstruction from the noisy measurement. However, due to the nonlinear expression of the objective function, most exiting algorithms related to the SIR unavoidably suffer from heavy computation load and slow convergence rate, especially when an edge-preserving or sparsity-based penalty or regularization is incorporated. In this work, to address abovementioned issues of the general algorithms related to the SIR, we propose an adaptive nonmonotone alternating direction algorithm in the framework of augmented Lagrangian multiplier method, which is termed as “ALM-ANAD”. The algorithm effectively combines an alternating direction technique with an adaptive nonmonotone line search to minimize the augmented Lagrangian function at each iteration. To evaluate the present ALM-ANAD algorithm, both qualitative and quantitative studies were conducted by using digital and physical phantoms. Experimental results show that the present ALM-ANAD algorithm can achieve noticeable gains over the classical nonlinear conjugate gradient algorithm and state-of-the-art split Bregman algorithm in terms of noise reduction, contrast-to-noise ratio, convergence rate, and universal quality index metrics.
Collapse
Affiliation(s)
- Jiaojiao Li
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Shanzhou Niu
- School of Mathematics and Computer Sciences, Gannan Normal University, Ganzhou 341000, China
| | - Jing Huang
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
- * E-mail:
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Qianjin Feng
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Gaohang Yu
- School of Mathematics and Computer Sciences, Gannan Normal University, Ganzhou 341000, China
| | - Zhengrong Liang
- Department of Radiology, State University of New York, Stony Brook, NY 11794, United States of America
| | - Wufan Chen
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| |
Collapse
|
47
|
Kazantsev D, Van Eyndhoven G, Lionheart WRB, Withers PJ, Dobson KJ, McDonald SA, Atwood R, Lee PD. Employing temporal self-similarity across the entire time domain in computed tomography reconstruction. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2015; 373:rsta.2014.0389. [PMID: 25939621 PMCID: PMC4424485 DOI: 10.1098/rsta.2014.0389] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/09/2015] [Indexed: 05/19/2023]
Abstract
There are many cases where one needs to limit the X-ray dose, or the number of projections, or both, for high frame rate (fast) imaging. Normally, it improves temporal resolution but reduces the spatial resolution of the reconstructed data. Fortunately, the redundancy of information in the temporal domain can be employed to improve spatial resolution. In this paper, we propose a novel regularizer for iterative reconstruction of time-lapse computed tomography. The non-local penalty term is driven by the available prior information and employs all available temporal data to improve the spatial resolution of each individual time frame. A high-resolution prior image from the same or a different imaging modality is used to enhance edges which remain stationary throughout the acquisition time while dynamic features tend to be regularized spatially. Effective computational performance together with robust improvement in spatial and temporal resolution makes the proposed method a competitive tool to state-of-the-art techniques.
Collapse
Affiliation(s)
- D Kazantsev
- Manchester X-ray Imaging Facility, School of Materials, University of Manchester, Manchester M13 9PL, UK Research Complex at Harwell, Didcot, Oxfordshire OX11 0FA, UK
| | - G Van Eyndhoven
- iMinds-Vision Lab, University of Antwerp, 2610 Wilrijk, Belgium
| | - W R B Lionheart
- School of Mathematics, University of Manchester, Alan Turing Building, Manchester M13 9PL, UK
| | - P J Withers
- Manchester X-ray Imaging Facility, School of Materials, University of Manchester, Manchester M13 9PL, UK Research Complex at Harwell, Didcot, Oxfordshire OX11 0FA, UK
| | - K J Dobson
- Department of Earth and Environmental Sciences, Ludwig Maximilian University, Munich, Germany
| | - S A McDonald
- Manchester X-ray Imaging Facility, School of Materials, University of Manchester, Manchester M13 9PL, UK
| | - R Atwood
- Diamond Light Source, Harwell Science and Innovation Campus, Didcot OX11 0DE, UK
| | - P D Lee
- Manchester X-ray Imaging Facility, School of Materials, University of Manchester, Manchester M13 9PL, UK Research Complex at Harwell, Didcot, Oxfordshire OX11 0FA, UK
| |
Collapse
|
48
|
Zhang H, Ouyang L, Huang J, Ma J, Chen W, Wang J. Few-view cone-beam CT reconstruction with deformed prior image. Med Phys 2014; 41:121905. [DOI: 10.1118/1.4901265] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
49
|
Zhang H, Ma J, Wang J, Liu Y, Lu H, Liang Z. Statistical image reconstruction for low-dose CT using nonlocal means-based regularization. Comput Med Imaging Graph 2014; 38:423-35. [PMID: 24881498 PMCID: PMC4152958 DOI: 10.1016/j.compmedimag.2014.05.002] [Citation(s) in RCA: 56] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2013] [Revised: 03/24/2014] [Accepted: 05/02/2014] [Indexed: 11/19/2022]
Abstract
Low-dose computed tomography (CT) imaging without sacrifice of clinical tasks is desirable due to the growing concerns about excessive radiation exposure to the patients. One common strategy to achieve low-dose CT imaging is to lower the milliampere-second (mAs) setting in data scanning protocol. However, the reconstructed CT images by the conventional filtered back-projection (FBP) method from the low-mAs acquisitions may be severely degraded due to the excessive noise. Statistical image reconstruction (SIR) methods have shown potentials to significantly improve the reconstructed image quality from the low-mAs acquisitions, wherein the regularization plays a critical role and an established family of regularizations is based on the Markov random field (MRF) model. Inspired by the success of nonlocal means (NLM) in image processing applications, in this work, we propose to explore the NLM-based regularization for SIR to reconstruct low-dose CT images from low-mAs acquisitions. Experimental results with both digital and physical phantoms consistently demonstrated that SIR with the NLM-based regularization can achieve more gains than SIR with the well-known Gaussian MRF regularization or the generalized Gaussian MRF regularization and the conventional FBP method, in terms of image noise reduction and resolution preservation.
Collapse
Affiliation(s)
- Hao Zhang
- Department of Radiology, State University of New York at Stony Brook, NY 11794, USA; Department of Biomedical Engineering, State University of New York at Stony Brook, NY 11794, USA
| | - Jianhua Ma
- Department of Radiology, State University of New York at Stony Brook, NY 11794, USA; School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, TX 75390, USA
| | - Yan Liu
- Department of Radiology, State University of New York at Stony Brook, NY 11794, USA
| | - Hongbing Lu
- Department of Biomedical Engineering, Fourth Military Medical University, Shanxi 710032, China
| | - Zhengrong Liang
- Department of Radiology, State University of New York at Stony Brook, NY 11794, USA; Department of Biomedical Engineering, State University of New York at Stony Brook, NY 11794, USA.
| |
Collapse
|