Iterative metal artifact reduction for x-ray computed tomography using unmatched projector/backprojector pairs

b-MAR: bidirectional artifact representations learning framework for metal artifact reduction in dental CBCT

Objective.Metal artifacts in computed tomography (CT) images hinder diagnosis and treatment significantly. Specifically, dental cone-beam computed tomography (Dental CBCT) images are seriously contaminated by metal artifacts due to the widespread use of low tube voltages and the presence of various high-attenuation materials in dental structures. Existing supervised metal artifact reduction (MAR) methods mainly learn the mapping of artifact-affected images to clean images, while ignoring the modeling of the metal artifact generation process. Therefore, we propose the bidirectional artifact representations learning framework to adaptively encode metal artifacts caused by various dental implants and model the generation and elimination of metal artifacts, thereby improving MAR performance.Approach.Specifically, we introduce an efficient artifact encoder to extract multi-scale representations of metal artifacts from artifact-affected images. These extracted metal artifact representations are then bidirectionally embedded into both the metal artifact generator and the metal artifact eliminator, which can simultaneously improve the performance of artifact removal and artifact generation. The artifact eliminator learns artifact removal in a supervised manner, while the artifact generator learns artifact generation in an adversarial manner. To further improve the performance of the bidirectional task networks, we propose artifact consistency loss to align the consistency of images generated by the eliminator and the generator with or without embedding artifact representations.Main results.To validate the effectiveness of our algorithm, experiments are conducted on simulated and clinical datasets containing various dental metal morphologies. Quantitative metrics are calculated to evaluate the results of the simulation tests, which demonstrate b-MAR improvements of >1.4131 dB in PSNR, >0.3473 HU decrements in RMSE, and >0.0025 promotion in structural similarity index measurement over the current state-of-the-art MAR methods. All results indicate that the proposed b-MAR method can remove artifacts caused by various metal morphologies and restore the structural integrity of dental tissues effectively.Significance.The proposed b-MAR method strengthens the joint learning of the artifact removal process and the artifact generation process by bidirectionally embedding artifact representations, thereby improving the model's artifact removal performance. Compared with other comparison methods, b-MAR can robustly and effectively correct metal artifacts in dental CBCT images caused by different dental metals.

InDuDoNet+: A deep unfolding dual domain network for metal artifact reduction in CT images

During the computed tomography (CT) imaging process, metallic implants within patients often cause harmful artifacts, which adversely degrade the visual quality of reconstructed CT images and negatively affect the subsequent clinical diagnosis. For the metal artifact reduction (MAR) task, current deep learning based methods have achieved promising performance. However, most of them share two main common limitations: (1) the CT physical imaging geometry constraint is not comprehensively incorporated into deep network structures; (2) the entire framework has weak interpretability for the specific MAR task; hence, the role of each network module is difficult to be evaluated. To alleviate these issues, in the paper, we construct a novel deep unfolding dual domain network, termed InDuDoNet+, into which CT imaging process is finely embedded. Concretely, we derive a joint spatial and Radon domain reconstruction model and propose an optimization algorithm with only simple operators for solving it. By unfolding the iterative steps involved in the proposed algorithm into the corresponding network modules, we easily build the InDuDoNet+ with clear interpretability. Furthermore, we analyze the CT values among different tissues, and merge the prior observations into a prior network for our InDuDoNet+, which significantly improve its generalization performance. Comprehensive experiments on synthesized data and clinical data substantiate the superiority of the proposed methods as well as the superior generalization performance beyond the current state-of-the-art (SOTA) MAR methods. Code is available at https://github.com/hongwang01/InDuDoNet_plus.

Physics-informed sinogram completion for metal artifact reduction in CT imaging

Objective.Metal artifacts in the computed tomography (CT) imaging are unavoidably adverse to the clinical diagnosis and treatment outcomes. Most metal artifact reduction (MAR) methods easily result in the over-smoothing problem and loss of structure details near the metal implants, especially for these metal implants with irregular elongated shapes. To address this problem, we present the physics-informed sinogram completion (PISC) method for MAR in CT imaging, to reduce metal artifacts and recover more structural textures.Approach.Specifically, the original uncorrected sinogram is firstly completed by the normalized linear interpolation algorithm to reduce metal artifacts. Simultaneously, the uncorrected sinogram is also corrected based on the beam-hardening correction physical model, to recover the latent structure information in metal trajectory region by leveraging the attenuation characteristics of different materials. Both corrected sinograms are fused with the pixel-wise adaptive weights, which are manually designed according to the shape and material information of metal implants. To furtherly reduce artifacts and improve the CT image quality, a post-processing frequency split algorithm is adopted to yield the final corrected CT image after reconstructing the fused sinogram.Main results.We qualitatively and quantitatively evaluated the presented PISC method on two simulated datasets and three real datasets. All results demonstrate that the presented PISC method can effectively correct the metal implants with various shapes and materials, in terms of artifact suppression and structure preservation.Significance.We proposed a sinogram-domain MAR method to compensate for the over-smoothing problem existing in most MAR methods by taking advantage of the physical prior knowledge, which has the potential to improve the performance of the deep learning based MAR approaches.

Addressing CT metal artifacts using photon-counting detectors and one-step spectral CT image reconstruction

PURPOSE

The constrained one-step spectral CT image reconstruction (cOSSCIR) algorithm with a nonconvex alternating direction method of multipliers optimizer is proposed for addressing computed tomography (CT) metal artifacts caused by beam hardening, noise, and photon starvation. The quantitative performance of cOSSCIR is investigated through a series of photon-counting CT simulations.

METHODS

cOSSCIR directly estimates basis material maps from photon-counting data using a physics-based forward model that accounts for beam hardening. The cOSSCIR optimization framework places constraints on the basis maps, which we hypothesize will stabilize the decomposition and reduce streaks caused by noise and photon starvation. Another advantage of cOSSCIR is that the spectral data need not be registered, so that a ray can be used even if some energy window measurements are unavailable. Photon-counting CT acquisitions of a virtual pelvic phantom with low-contrast soft tissue texture and bilateral hip prostheses were simulated. Bone and water basis maps were estimated using the cOSSCIR algorithm and combined to form a virtual monoenergetic image for the evaluation of metal artifacts. The cOSSCIR images were compared to a "two-step" decomposition approach that first estimated basis sinograms using a maximum likelihood algorithm and then reconstructed basis maps using an iterative total variation constrained least-squares optimization (MLE+TVmin $_{\text{min}}$ ). Images were also compared to a nonspectral TVmin $_{\text{min}}$ reconstruction of the total number of counts detected for each ray with and without normalized metal artifact reduction (NMAR) applied. The simulated metal density was increased to investigate the effects of increasing photon starvation. The quantitative error and standard deviation in regions of the phantom were compared across the investigated algorithms. The ability of cOSSCIR to reproduce the soft-tissue texture, while reducing metal artifacts, was quantitatively evaluated.

RESULTS

Noiseless simulations demonstrated the convergence of the cOSSCIR and MLE+TVmin $_{\text{min}}$ algorithms to the correct basis maps in the presence of beam-hardening effects. When noise was simulated, cOSSCIR demonstrated a quantitative error of -1 HU, compared to 2 HU error for the MLE+TVmin $_{\text{min}}$ algorithm and -154 HU error for the nonspectral TVmin $_{\text{min}}$ +NMAR algorithm. For the cOSSCIR algorithm, the standard deviation in the central iodine region of interest was 20 HU, compared to 299 HU for the MLE+TVmin $_{\text{min}}$ algorithm, 41 HU for the MLE+TVmin $_{\text{min}}$ +Mask algorithm that excluded rays through metal, and 55 HU for the nonspectral TVmin $_{\text{min}}$ +NMAR algorithm. Increasing levels of photon starvation did not impact the bias or standard deviation of the cOSSCIR images. cOSSCIR was able to reproduce the soft-tissue texture when an appropriate regularization constraint value was selected.

CONCLUSIONS

By directly inverting photon-counting CT data into basis maps using an accurate physics-based forward model and a constrained optimization algorithm, cOSSCIR avoids metal artifacts due to beam hardening, noise, and photon starvation. The cOSSCIR algorithm demonstrated improved stability and accuracy compared to a two-step method of decomposition followed by reconstruction.

DICDNet: Deep Interpretable Convolutional Dictionary Network for Metal Artifact Reduction in CT Images

Computed tomography (CT) images are often impaired by unfavorable artifacts caused by metallic implants within patients, which would adversely affect the subsequent clinical diagnosis and treatment. Although the existing deep-learning-based approaches have achieved promising success on metal artifact reduction (MAR) for CT images, most of them treated the task as a general image restoration problem and utilized off-the-shelf network modules for image quality enhancement. Hence, such frameworks always suffer from lack of sufficient model interpretability for the specific task. Besides, the existing MAR techniques largely neglect the intrinsic prior knowledge underlying metal-corrupted CT images which is beneficial for the MAR performance improvement. In this paper, we specifically propose a deep interpretable convolutional dictionary network (DICDNet) for the MAR task. Particularly, we first explore that the metal artifacts always present non-local streaking and star-shape patterns in CT images. Based on such observations, a convolutional dictionary model is deployed to encode the metal artifacts. To solve the model, we propose a novel optimization algorithm based on the proximal gradient technique. With only simple operators, the iterative steps of the proposed algorithm can be easily unfolded into corresponding network modules with specific physical meanings. Comprehensive experiments on synthesized and clinical datasets substantiate the effectiveness of the proposed DICDNet as well as its superior interpretability, compared to current state-of-the-art MAR methods. Code is available at https://github.com/hongwang01/DICDNet.

Analysis of objective quality metrics in computed tomography images affected by metal artifacts

Image quality (IQ) assessment plays an important role in the medical world. New methods to evaluate image quality have been developed, but their application in the context of computer tomography is yet limited. In this paper the performance of fifteen well-known full reference (FR) IQ metrics is compared with human judgment using images affected by metal artifacts and processed with metal artifact reduction methods from a phantom. Five region of interest with different sizes were selected. IQ was evaluated by seven experienced radiologists completely blinded to the information. To measure the correlation between FR-IQ, and the score assigned by radiologists non-parametric Spearman rank-order correlation coefficient and Kendall's Rank-order Correlation coefficient were used; so as root mean square error and the mean absolute error to measure the prediction accuracy. Cohen's kappa was employed with the purpose of assessing inter-observer agreement. The metrics GMSD, IWMSE, IWPSNR, WSNR and OSS-PSNR were the best ranked. Inter-observer agreement was between 0.596 and 0.954, with p<0.001 in all study. The objective scores predicted by these methods correlate consistently with the subjective evaluations. The application of this metrics will make possible a better evaluation of metal artifact reduction algorithms in future works.

Inpainting-filtering for metal artifact reduction (IMIF-MAR) in computed tomography

The reduction of metal artifacts remains a challenge in computed tomography because they decrease image quality, and consequently might affect the medical diagnosis. The objective of this study is to present a novel method to correct metal artifacts based solely on the CT-slices. The proposed method consists of four steps. First, metal implants in the original CT-slice are segmented using an entropy based method, producing a metal image. Second, a prior image is acquired using three transformations: Gaussian filter, Parisotto and Schoenlieb inpainting method with the Mumford-Shah image model and L0 Gradient Minimization method (L0GM). Next, based on the projections from the original CT-slice, prior image and metal image, the sinogram is corrected in the traces affected by metal in the process called normalization and denormalization. Finally, the reconstructed image is obtained by FBP and a Nonlocal Means (NLM) filtering. The efficacy of the algorithm is evaluated by comparing five image quality metrics of the images and by inspecting regions of interest (ROI). Phantom data as well as clinical datasets are included. The proposed method is compared with three established metal artifact reduction (MAR) methods. The results from a phantom and clinical dataset show the visible reduction of artifacts. The conclusion is that IMIF-MAR method can reduce streak metal artifacts effectively and avoid new artifacts around metal implants, while preserving the anatomical structures. Considering both clinical and phantom studies, the proposed MAR algorithm improves the quality of clinical images affected by metal artifacts, and could be integrated in clinical setting.

Counter examples for unmatched projector/backprojector in an iterative algorithm

It is rather controversial whether it is justified to use an unmatched projector/backprojector pair in an iterative image reconstruction algorithm. One common concern of using an unmatched projector/backprojector pair is that the optimal solution cannot be reached. This concern is misleading and must be clarified. We define a figure-of-merit in the image domain as the distance between the reconstructed image and the true image, as the normalized mean-squared-error (NMSE). The NMSE is used to determine whether an unmatched matched projector/backprojector pair can provide a better image than a matched projector/backprojector pair. Hot and cold lesion's contrast-to-noise ratio is also used as an alternative secondary figure-of-merit for algorithm comparison. Computer-generated counterexamples are used to test the performance for matched and unmatched projection/backprojection pairs for different reconstruction algorithms. The projectors are ray-driven, and the backprojectors are ray-driven and pixel-driven. For the attenuation-free data examples, the unmatched pixel-driven backprojector outperforms the matched ray-driven backprojector. For the attenuated data example, the matched ray-driven backprojector performs better. The ray-driven backprojector can be slightly improved by using an attenuation coefficient that is larger than the true one; in this case the backprojector becomes unmatched. Unmatched projector/backprojector pairs are fairly flexible. If the backprojector is properly chosen, good results can be obtained. However, we have not found a general rule to select a good backprojector.

An additional tilted-scan-based CT metal-artifact-reduction method for radiation therapy planning

Purpose

As computed tomography (CT) imaging is the most commonly used modality for treatment planning in radiation therapy, metal artifacts in the planning CT images may complicate the target delineation and reduce the dose calculation accuracy. Although current CT scanners do provide certain correction steps, it is a common understanding that there is not a universal solution yet to the metal artifact reduction (MAR) in general. Particularly noting the importance of MAR for radiation treatment planning, we propose a novel MAR method in this work that recruits an additional tilted CT scan and synthesizes nearly metal‐artifact‐free CT images.

Methods

The proposed method is based on the facts that the most pronounced metal artifacts in CT images show up along the x‐ray beam direction traversing multiple metallic objects and that a tilted CT scan can provide complementary information free of such metal artifacts in the earlier scan. Although the tilted CT scan would contain its own metal artifacts in the images, the artifacts may manifest in a different fashion leaving a chance to concatenate the two CT images with the metal artifacts much suppressed. We developed an image processing technique that uses the structural similarity (SSIM) for suppressing the metal artifacts. On top of the additional scan, we proposed to use an existing MAR method for each scan if necessary to further suppress the metal artifacts.

Results

The proposed method was validated by a simulation study using the pelvic region of an XCAT numerical phantom and also by an experimental study using the head part of the Rando phantom. The proposed method was found to effectively reduce the metal artifacts. Quantitative analyses revealed that the proposed method reduced the mean absolute percentages of the error by up to 86% and 89% in the simulation and experimental studies, respectively.

Conclusions

It was confirmed that the proposed method, using complementary information acquired from an additional tilted CT scan, can provide nearly metal‐artifact‐free images for the treatment planning.

Metal Artifact Reduction in X-ray Computed Tomography Using Computer-Aided Design Data of Implants as Prior Information

OBJECTIVES

The performance of metal artifact reduction (MAR) methods in x-ray computed tomography (CT) suffers from incorrect identification of metallic implants in the artifact-affected volumetric images. The aim of this study was to investigate potential improvements of state-of-the-art MAR methods by using prior information on geometry and material of the implant.

MATERIALS AND METHODS

The influence of a novel prior knowledge-based segmentation (PS) compared with threshold-based segmentation (TS) on 2 MAR methods (linear interpolation [LI] and normalized-MAR [NORMAR]) was investigated. The segmentation is the initial step of both MAR methods. Prior knowledge-based segmentation uses 3-dimensional registered computer-aided design (CAD) data as prior knowledge to estimate the correct position and orientation of the metallic objects. Threshold-based segmentation uses an adaptive threshold to identify metal. Subsequently, for LI and NORMAR, the selected voxels are projected into the raw data domain to mark metal areas. Attenuation values in these areas are replaced by different interpolation schemes followed by a second reconstruction. Finally, the previously selected metal voxels are replaced by the metal voxels determined by PS or TS in the initial reconstruction. First, we investigated in an elaborate phantom study if the knowledge of the exact implant shape extracted from the CAD data provided by the manufacturer of the implant can improve the MAR result. Second, the leg of a human cadaver was scanned using a clinical CT system before and after the implantation of an artificial knee joint. The results were compared regarding segmentation accuracy, CT number accuracy, and the restoration of distorted structures.

RESULTS

The use of PS improved the efficacy of LI and NORMAR compared with TS. Artifacts caused by insufficient segmentation were reduced, and additional information was made available within the projection data. The estimation of the implant shape was more exact and not dependent on a threshold value. Consequently, the visibility of structures was improved when comparing the new approach to the standard method. This was further confirmed by improved CT value accuracy and reduced image noise.

CONCLUSIONS

The PS approach based on prior implant information provides image quality which is superior to TS-based MAR, especially when the shape of the metallic implant is complex. The new approach can be useful for improving MAR methods and dose calculations within radiation therapy based on the MAR corrected CT images.