Fast X-ray CT image reconstruction using a linearized augmented Lagrangian method with ordered subsets

Simultaneous Activity and Attenuation Estimation in TOF-PET With TV-Constrained Nonconvex Optimization

An alternating direction method of multipliers (ADMM) framework is developed for nonsmooth biconvex optimization for inverse problems in imaging. In particular, the simultaneous estimation of activity and attenuation (SAA) problem in time-of-flight positron emission tomography (TOF-PET) has such a structure when maximum likelihood estimation (MLE) is employed. The ADMM framework is applied to MLE for SAA in TOF-PET, resulting in the ADMM-SAA algorithm. This algorithm is extended by imposing total variation (TV) constraints on both the activity and attenuation map, resulting in the ADMM-TVSAA algorithm. The performance of this algorithm is illustrated using the penalized maximum likelihood activity and attenuation estimation (P-MLAA) algorithm as a reference.

Simultaneous activity and attenuation estimation in TOF-PET with TV-constrained nonconvex optimization

An alternating direction method of multipliers (ADMM) framework is developed for nonsmooth biconvex optimization for inverse problems in imaging. In particular, the simultaneous estimation of activity and attenuation (SAA) problem in time-of-flight positron emission tomography (TOF-PET) has such a structure when maximum likelihood estimation (MLE) is employed. The ADMM framework is applied to MLE for SAA in TOF-PET, resulting in the ADMM-SAA algorithm. This algorithm is extended by imposing total variation (TV) constraints on both the activity and attenuation map, resulting in the ADMM-TVSAA algorithm. The performance of this algorithm is illustrated using the penalized maximum likelihood activity and attenuation estimation (P-MLAA) algorithm as a reference. Additional results on step-size tuning and on the use of unconstrained ADMM-SAA are presented in the previous arXiv submission: arXiv:2303.17042v1.

Convergence for nonconvex ADMM, with applications to CT imaging

The alternating direction method of multipliers (ADMM) algorithm is a powerful and flexible tool for complex optimization problems of the form m i n { f ( x ) + g ( y ) : A x + B y = c } . ADMM exhibits robust empirical performance across a range of challenging settings including nonsmoothness and nonconvexity of the objective functions f and g , and provides a simple and natural approach to the inverse problem of image reconstruction for computed tomography (CT) imaging. From the theoretical point of view, existing results for convergence in the nonconvex setting generally assume smoothness in at least one of the component functions in the objective. In this work, our new theoretical results provide convergence guarantees under a restricted strong convexity assumption without requiring smoothness or differentiability, while still allowing differentiable terms to be treated approximately if needed. We validate these theoretical results empirically, with a simulated example where both f and g are nondifferentiable-and thus outside the scope of existing theory-as well as a simulated CT image reconstruction problem.

Convex optimization algorithms in medical image reconstruction-in the age of AI

The past decade has seen the rapid growth of model based image reconstruction (MBIR) algorithms, which are often applications or adaptations of convex optimization algorithms from the optimization community. We review some state-of-the-art algorithms that have enjoyed wide popularity in medical image reconstruction, emphasize known connections between different algorithms, and discuss practical issues such as computation and memory cost. More recently, deep learning (DL) has forayed into medical imaging, where the latest development tries to exploit the synergy between DL and MBIR to elevate the MBIR's performance. We present existing approaches and emerging trends in DL-enhanced MBIR methods, with particular attention to the underlying role of convexity and convex algorithms on network architecture. We also discuss how convexity can be employed to improve the generalizability and representation power of DL networks in general.

[Free trajectory cone beam computed tomography reconstruction method for synchronous scanning of geometric calibration phantom and imaging object]

In order to suppress the geometrical artifacts caused by random jitter in ray source scanning, and to achieve flexible ray source scanning trajectory and meet the requirements of task-driven scanning imaging, a method of free trajectory cone-beam computed tomography (CBCT) reconstruction is proposed in this paper. This method proposed a geometric calibration method of two-dimensional plane. Based on this method, the geometric calibration phantom and the imaging object could be simultaneously imaged. Then, the geometric parameters could be obtained by online calibration method, and then combined with the geometric parameters, the alternating direction multiplier method (ADMM) was used for image iterative reconstruction. Experimental results showed that this method obtained high quality reconstruction image with high contrast and clear feature edge. The root mean square errors (RMSE) of the simulation results were rather small, and the structural similarity (SSIM) values were all above 0.99. The experimental results showed that it had lower image information entropy (IE) and higher contrast noise ratio (CNR). This method provides some practical value for CBCT to realize trajectory freedom and obtain high quality reconstructed image.

A fast regularized iterative algorithm for fan-beam CT reconstruction

We propose a fast iterative image reconstruction algorithm for normal, short-scan, and super-short-scan fan-beam computed tomography (CT), which aims at iterative reconstruction for low-dose and few-view CT by minimizing a data-fidelity term regularized with a total variation (TV) penalty. The derivation of the algorithm can be outlined as follows. First, the original minimization problem is formulated into a saddle-point (primal-dual) problem by using the Lagrangian duality, to which we apply the alternating projection proximal (APP) algorithm, which belongs to a class of first-order primal-dual methods. Second, we precondition the iterative formula using the modified ramp filter of the filtered back-projection (FBP) reconstruction algorithm in such a way that the solution to this preconditioned iteration perfectly coincides with the solution to the original problem. The resulting algorithm converges quickly to the minimizer of the cost function. To demonstrate the advantages of our method, we perform reconstruction experiments using projection data from both numerical phantoms and real CT data. Both qualitative and quantitative results are presented.

Reduced anatomical clutter in digital breast tomosynthesis with statistical iterative reconstruction

PURPOSE

Digital breast tomosynthesis (DBT) has been shown to somewhat alleviate the breast tissue overlapping issues of two-dimensional (2D) mammography. However, the improvement in current DBT systems over mammography is still limited. Statistical image reconstruction (SIR) methods have the potential to reduce through-plane artifacts in DBT, and thus may be used to further reduce anatomical clutter. The purpose of this work was to study the impact of SIR on anatomical clutter in the reconstructed DBT image volumes.

METHODS

An SIR with a slice-wise total variation (TV) regularizer was implemented to reconstruct DBT images which were compared with the clinical reconstruction method (filtered backprojection). The artifact spread function (ASF) was measured to quantify the reduction of the through-plane artifacts level in phantom studies and microcalcifications in clinical cases. The anatomical clutter was quantified by the anatomical noise power spectrum with a power law fitting model: NPSa ( f) = α f-β . The β values were measured from the reconstructed image slices when the two reconstruction methods were applied to a cohort of clinical breast exams (N = 101) acquired using Hologic Selenia Dimensions DBT systems.

RESULTS

The full width half maximum (FWHM) of the measured ASF was reduced from 8.7 ± 0.1 mm for clinical reconstruction to 6.5 ± 0.1 mm for SIR which yields a 25% reduction in FWHM in phantom studies and the same amount of ASF reduction was also found in clinical measurements from microcalcifications. The measured β values for the two reconstruction methods were 3.17 ± 0.36 and 2.14 ± 0.39 for the clinical reconstruction method and the SIR method, respectively. This difference was statistically significant (P << 0.001). The dependence of β on slice location using either method was negligible.

CONCLUSIONS

Statistical image reconstruction enabled a significant reduction of both the through-plane artifacts level and anatomical clutter in the DBT reconstructions. The β value was found to be β≈2.14 with the SIR method. This value stays in the middle between the β≈1.8 for cone beam CT and β≈3.2 for mammography. In contrast, the measured β value in the clinical reconstructions (β≈3.17) remains close to that of mammography.

Block-matching sparsity regularization-based image reconstruction for low-dose computed tomography

PURPOSE

Low-dose computed tomography (CT) imaging has been widely explored because it can reduce the radiation risk to human bodies. This presents challenges in improving the image quality because low radiation dose with reduced tube current and pulse duration introduces severe noise. In this study, we investigate block-matching sparsity regularization (BMSR) and devise an optimization problem for low-dose image reconstruction.

METHOD

The objective function of the program is built by combining the sparse coding of BMSR and analysis error, which is subject to physical data measurement. A practical reconstruction algorithm using hard thresholding and projection-onto-convex-set for fast and stable performance is developed. An efficient scheme for the choices of regularization parameters is analyzed and designed.

RESULTS

In the experiments, the proposed method is compared with a conventional edge preservation method and adaptive dictionary-based iterative reconstruction. Experiments with clinical images and real CT data indicate that the obtained results show promising capabilities in noise suppression and edge preservation compared with the competing methods.

CONCLUSIONS

A block-matching-based reconstruction method for low-dose CT is proposed. Improvements in image quality are verified by quantitative metrics and visual comparisons, thereby indicating the potential of the proposed method for real-life applications.

Block matching sparsity regularization-based image reconstruction for incomplete projection data in computed tomography

In medical imaging many conventional regularization methods, such as total variation or total generalized variation, impose strong prior assumptions which can only account for very limited classes of images. A more reasonable sparse representation frame for images is still badly needed. Visually understandable images contain meaningful patterns, and combinations or collections of these patterns can be utilized to form some sparse and redundant representations which promise to facilitate image reconstructions. In this work, we propose and study block matching sparsity regularization (BMSR) and devise an optimization program using BMSR for computed tomography (CT) image reconstruction for an incomplete projection set. The program is built as a constrained optimization, minimizing the L1-norm of the coefficients of the image in the transformed domain subject to data observation and positivity of the image itself. To solve the program efficiently, a practical method based on the proximal point algorithm is developed and analyzed. In order to accelerate the convergence rate, a practical strategy for tuning the BMSR parameter is proposed and applied. The experimental results for various settings, including real CT scanning, have verified the proposed reconstruction method showing promising capabilities over conventional regularization.

A comparison of linear interpolation models for iterative CT reconstruction

PURPOSE

Recent reports indicate that model-based iterative reconstruction methods may improve image quality in computed tomography (CT). One difficulty with these methods is the number of options available to implement them, including the selection of the forward projection model and the penalty term. Currently, the literature is fairly scarce in terms of guidance regarding this selection step, whereas these options impact image quality. Here, the authors investigate the merits of three forward projection models that rely on linear interpolation: the distance-driven method, Joseph's method, and the bilinear method. The authors' selection is motivated by three factors: (1) in CT, linear interpolation is often seen as a suitable trade-off between discretization errors and computational cost, (2) the first two methods are popular with manufacturers, and (3) the third method enables assessing the importance of a key assumption in the other methods.

METHODS

One approach to evaluate forward projection models is to inspect their effect on discretized images, as well as the effect of their transpose on data sets, but significance of such studies is unclear since the matrix and its transpose are always jointly used in iterative reconstruction. Another approach is to investigate the models in the context they are used, i.e., together with statistical weights and a penalty term. Unfortunately, this approach requires the selection of a preferred objective function and does not provide clear information on features that are intrinsic to the model. The authors adopted the following two-stage methodology. First, the authors analyze images that progressively include components of the singular value decomposition of the model in a reconstructed image without statistical weights and penalty term. Next, the authors examine the impact of weights and penalty on observed differences.

RESULTS

Image quality metrics were investigated for 16 different fan-beam imaging scenarios that enabled probing various aspects of all models. The metrics include a surrogate for computational cost, as well as bias, noise, and an estimation task, all at matched resolution. The analysis revealed fundamental differences in terms of both bias and noise. Task-based assessment appears to be required to appreciate the differences in noise; the estimation task the authors selected showed that these differences balance out to yield similar performance. Some scenarios highlighted merits for the distance-driven method in terms of bias but with an increase in computational cost. Three combinations of statistical weights and penalty term showed that the observed differences remain the same, but strong edge-preserving penalty can dramatically reduce the magnitude of these differences.

CONCLUSIONS

In many scenarios, Joseph's method seems to offer an interesting compromise between cost and computational effort. The distance-driven method offers the possibility to reduce bias but with an increase in computational cost. The bilinear method indicated that a key assumption in the other two methods is highly robust. Last, strong edge-preserving penalty can act as a compensator for insufficiencies in the forward projection model, bringing all models to similar levels in the most challenging imaging scenarios. Also, the authors find that their evaluation methodology helps appreciating how model, statistical weights, and penalty term interplay together.

Iterative metal artifact reduction for x-ray computed tomography using unmatched projector/backprojector pairs

PURPOSE

Metal artifact reduction (MAR) is a major problem and a challenging issue in x-ray computed tomography (CT) examinations. Iterative reconstruction from sinograms unaffected by metals shows promising potential in detail recovery. This reconstruction has been the subject of much research in recent years. However, conventional iterative reconstruction methods easily introduce new artifacts around metal implants because of incomplete data reconstruction and inconsistencies in practical data acquisition. Hence, this work aims at developing a method to suppress newly introduced artifacts and improve the image quality around metal implants for the iterative MAR scheme.

METHODS

The proposed method consists of two steps based on the general iterative MAR framework. An uncorrected image is initially reconstructed, and the corresponding metal trace is obtained. The iterative reconstruction method is then used to reconstruct images from the unaffected sinogram. In the reconstruction step of this work, an iterative strategy utilizing unmatched projector/backprojector pairs is used. A ramp filter is introduced into the back-projection procedure to restrain the inconsistency components in low frequencies and generate more reliable images of the regions around metals. Furthermore, a constrained total variation (TV) minimization model is also incorporated to enhance efficiency. The proposed strategy is implemented based on an iterative FBP and an alternating direction minimization (ADM) scheme, respectively. The developed algorithms are referred to as "iFBP-TV" and "TV-FADM," respectively. Two projection-completion-based MAR methods and three iterative MAR methods are performed simultaneously for comparison.

RESULTS

The proposed method performs reasonably on both simulation and real CT-scanned datasets. This approach could reduce streak metal artifacts effectively and avoid the mentioned effects in the vicinity of the metals. The improvements are evaluated by inspecting regions of interest and by comparing the root-mean-square errors, normalized mean absolute distance, and universal quality index metrics of the images. Both iFBP-TV and TV-FADM methods outperform other counterparts in all cases. Unlike the conventional iterative methods, the proposed strategy utilizing unmatched projector/backprojector pairs shows excellent performance in detail preservation and prevention of the introduction of new artifacts.

CONCLUSIONS

Qualitative and quantitative evaluations of experimental results indicate that the developed method outperforms classical MAR algorithms in suppressing streak artifacts and preserving the edge structural information of the object. In particular, structures lying close to metals can be gradually recovered because of the reduction of artifacts caused by inconsistency effects.

Optimization-based image reconstruction in computed tomography by alternating direction method with ordered subsets

Nowadays, diversities of task-specific applications for computed tomography (CT) have already proposed multiple challenges for algorithm design of image reconstructions. Consequently, efficient algorithm design tool is necessary to be established. A fast and efficient algorithm design framework for CT image reconstruction, which is based on alternating direction method (ADM) with ordered subsets (OS), is proposed, termed as OS-ADM. The general ideas of ADM and OS have been abstractly introduced and then they are combined for solving convex optimizations in CT image reconstruction. Standard procedures are concluded for algorithm design which contain 1) model mapping, 2) sub-problem dividing and 3) solving, 4) OS level setting and 5) algorithm evaluation. Typical reconstruction problems are modeled as convex optimizations, including (non-negative) least-square, constrained L1 minimization, constrained total variation (TV) minimization and TV minimizations with different data fidelity terms. Efficient working algorithms for these problems are derived with detailed derivations by the proposed framework. In addition, both simulations and real CT projections are tested to verify the performances of two TV-based algorithms. Experimental investigations indicate that these algorithms are of the state-of-the-art performances. The algorithm instances show that the proposed OS-ADM framework is promising for practical applications.

Iterative reconstruction for CT perfusion with a prior-image induced hybrid nonlocal means regularization: Phantom studies

PURPOSE

In computed tomography perfusion (CTP) imaging, an initial phase CT acquired with a high-dose protocol can be used to improve the image quality of later phase CT acquired with a low-dose protocol. For dynamic regions, signals in the later low-dose CT may not be completely recovered if the initial CT heavily regularizes the iterative reconstruction process. The authors propose a hybrid nonlocal means (hNLM) regularization model for iterative reconstruction of low-dose CTP to overcome the limitation of the conventional prior-image induced penalty.

METHODS

The hybrid penalty was constructed by combining the NLM of the initial phase high-dose CT in the stationary region and later phase low-dose CT in the dynamic region. The stationary and dynamic regions were determined by the similarity between the initial high-dose scan and later low-dose scan. The similarity was defined as a Gaussian kernel-based distance between the patch-window of the same pixel in the two scans, and its measurement was then used to weigh the influence of the initial high-dose CT. For regions with high similarity (e.g., stationary region), initial high-dose CT played a dominant role for regularizing the solution. For regions with low similarity (e.g., dynamic region), the regularization relied on a low-dose scan itself. This new hNLM penalty was incorporated into the penalized weighted least-squares (PWLS) for CTP reconstruction. Digital and physical phantom studies were performed to evaluate the PWLS-hNLM algorithm.

RESULTS

Both phantom studies showed that the PWLS-hNLM algorithm is superior to the conventional prior-image induced penalty term without considering the signal changes within the dynamic region. In the dynamic region of the Catphan phantom, the reconstruction error measured by root mean square error was reduced by 42.9% in PWLS-hNLM reconstructed image.

CONCLUSIONS

The PWLS-hNLM algorithm can effectively use the initial high-dose CT to reconstruct low-dose CTP in the stationary region while reducing its influence in the dynamic region.

Accelerated fast iterative shrinkage thresholding algorithms for sparsity-regularized cone-beam CT image reconstruction

PURPOSE

The development of iterative image reconstruction algorithms for cone-beam computed tomography (CBCT) remains an active and important research area. Even with hardware acceleration, the overwhelming majority of the available 3D iterative algorithms that implement nonsmooth regularizers remain computationally burdensome and have not been translated for routine use in time-sensitive applications such as image-guided radiation therapy (IGRT). In this work, two variants of the fast iterative shrinkage thresholding algorithm (FISTA) are proposed and investigated for accelerated iterative image reconstruction in CBCT.

METHODS

Algorithm acceleration was achieved by replacing the original gradient-descent step in the FISTAs by a subproblem that is solved by use of the ordered subset simultaneous algebraic reconstruction technique (OS-SART). Due to the preconditioning matrix adopted in the OS-SART method, two new weighted proximal problems were introduced and corresponding fast gradient projection-type algorithms were developed for solving them. We also provided efficient numerical implementations of the proposed algorithms that exploit the massive data parallelism of multiple graphics processing units.

RESULTS

The improved rates of convergence of the proposed algorithms were quantified in computer-simulation studies and by use of clinical projection data corresponding to an IGRT study. The accelerated FISTAs were shown to possess dramatically improved convergence properties as compared to the standard FISTAs. For example, the number of iterations to achieve a specified reconstruction error could be reduced by an order of magnitude. Volumetric images reconstructed from clinical data were produced in under 4 min.

CONCLUSIONS

The FISTA achieves a quadratic convergence rate and can therefore potentially reduce the number of iterations required to produce an image of a specified image quality as compared to first-order methods. We have proposed and investigated accelerated FISTAs for use with two nonsmooth penalty functions that will lead to further reductions in image reconstruction times while preserving image quality. Moreover, with the help of a mixed sparsity-regularization, better preservation of soft-tissue structures can be potentially obtained. The algorithms were systematically evaluated by use of computer-simulated and clinical data sets.

Fast 3D reconstruction method for differential phase contrast X-ray CT

We present a fast algorithm for fully 3D regularized X-ray tomography reconstruction for both traditional and differential phase contrast measurements. In many applications, it is critical to reduce the X-ray dose while producing high-quality reconstructions. Regularization is an excellent way to do this, but in the differential phase contrast case it is usually applied in a slice-by-slice manner. We propose using fully 3D regularization to improve the dose/quality trade-off beyond what is possible using slice-by-slice regularization. To make this computationally feasible, we show that the two computational bottlenecks of our iterative optimization process can be expressed as discrete convolutions; the resulting algorithms for computation of the X-ray adjoint and normal operator are fast and simple alternatives to regridding. We validate this algorithm on an analytical phantom as well as conventional CT and differential phase contrast measurements from two real objects. Compared to the slice-by-slice approach, our algorithm provides a more accurate reconstruction of the analytical phantom and better qualitative appearance on one of the two real datasets.

Relaxed Linearized Algorithms for Faster X-Ray CT Image Reconstruction

Statistical image reconstruction (SIR) methods are studied extensively for X-ray computed tomography (CT) due to the potential of acquiring CT scans with reduced X-ray dose while maintaining image quality. However, the longer reconstruction time of SIR methods hinders their use in X-ray CT in practice. To accelerate statistical methods, many optimization techniques have been investigated. Over-relaxation is a common technique to speed up convergence of iterative algorithms. For instance, using a relaxation parameter that is close to two in alternating direction method of multipliers (ADMM) has been shown to speed up convergence significantly. This paper proposes a relaxed linearized augmented Lagrangian (AL) method that shows theoretical faster convergence rate with over-relaxation and applies the proposed relaxed linearized AL method to X-ray CT image reconstruction problems. Experimental results with both simulated and real CT scan data show that the proposed relaxed algorithm (with ordered-subsets [OS] acceleration) is about twice as fast as the existing unrelaxed fast algorithms, with negligible computation and memory overhead.

Line Integral Alternating Minimization Algorithm for Dual-Energy X-Ray CT Image Reconstruction

We propose a new algorithm, called line integral alternating minimization (LIAM), for dual-energy X-ray CT image reconstruction. Instead of obtaining component images by minimizing the discrepancy between the data and the mean estimates, LIAM allows for a tunable discrepancy between the basis material projections and the basis sinograms. A parameter is introduced that controls the size of this discrepancy, and with this parameter the new algorithm can continuously go from a two-step approach to the joint estimation approach. LIAM alternates between iteratively updating the line integrals of the component images and reconstruction of the component images using an image iterative deblurring algorithm. An edge-preserving penalty function can be incorporated in the iterative deblurring step to decrease the roughness in component images. Images from both simulated and experimentally acquired sinograms from a clinical scanner were reconstructed by LIAM while varying the regularization parameters to identify good choices. The results from the dual-energy alternating minimization algorithm applied to the same data were used for comparison. Using a small fraction of the computation time of dual-energy alternating minimization, LIAM achieves better accuracy of the component images in the presence of Poisson noise for simulated data reconstruction and achieves the same level of accuracy for real data reconstruction.

Alternating dual updates algorithm for X-ray CT reconstruction on the GPU

Model-based image reconstruction (MBIR) for X-ray computed tomography (CT) offers improved image quality and potential low-dose operation, but has yet to reach ubiquity in the clinic. MBIR methods form an image by solving a large statistically motivated optimization problem, and the long time it takes to numerically solve this problem has hampered MBIR's adoption. We present a new optimization algorithm for X-ray CT MBIR based on duality and group coordinate ascent that may converge even with approximate updates and can handle a wide range of regularizers, including total variation (TV). The algorithm iteratively updates groups of dual variables corresponding to terms in the cost function; these updates are highly parallel and map well onto the GPU. Although the algorithm stores a large number of variables, the "working size" for each of the algorithm's steps is small and can be efficiently streamed to the GPU while other calculations are being performed. The proposed algorithm converges rapidly on both real and simulated data and shows promising parallelization over multiple devices.