Motion compensation for cone-beam CT using Fourier consistency conditions

Vessel-targeted compensation of deformable motion in interventional cone-beam CT

The present standard of care for unresectable liver cancer is transarterial chemoembolization (TACE), which involves using chemotherapeutic particles to selectively embolize the arteries supplying hepatic tumors. Accurate volumetric identification of intricate fine vascularity is crucial for selective embolization. Three-dimensional imaging, particularly cone-beam CT (CBCT), aids in visualization and targeting of small vessels in such highly variable anatomy, but long image acquisition time results in intra-scan patient motion, which distorts vascular structures and tissue boundaries. To improve clarity of vascular anatomy and intra-procedural utility, this work proposes a targeted motion estimation and compensation framework that removes the need for any prior information or external tracking and for user interaction. Motion estimation is performed in two stages: (i) a target identification stage that segments arteries and catheters in the projection domain using a multi-view convolutional neural network to construct a coarse 3D vascular mask; and (ii) a targeted motion estimation stage that iteratively solves for the time-varying motion field via optimization of a vessel-enhancing objective function computed over the target vascular mask. The vessel-enhancing objective is derived through eigenvalues of the local image Hessian to emphasize bright tubular structures. Motion compensation is achieved via spatial transformer operators that apply time-dependent deformations to partial angle reconstructions, allowing efficient minimization via gradient backpropagation. The framework was trained and evaluated in anatomically realistic simulated motion-corrupted CBCTs mimicking TACE of hepatic tumors, at intermediate (3.0 mm) and large (6.0 mm) motion magnitudes. Motion compensation substantially improved median vascular DICE score (from 0.30 to 0.59 for large motion), image SSIM (from 0.77 to 0.93 for large motion), and vessel sharpness (0.189 mm-1 to 0.233 mm-1 for large motion) in simulated cases. Motion compensation also demonstrated increased vessel sharpness (0.188 mm-1 before to 0.205 mm-1 after) and reconstructed vessel length (median increased from 37.37 to 41.00 mm) on a clinical interventional CBCT. The proposed anatomy-aware motion compensation framework presented a promising approach for improving the utility of CBCT for intra-procedural vascular imaging, facilitating selective embolization procedures.

[A deep blur learning-based motion artifact reduction algorithm for dental cone-beam computed tomography images]

OBJECTIVE

We propose a motion artifact correction algorithm (DMBL) for reducing motion artifacts in reconstructed dental cone-beam computed tomography (CBCT) images based on deep blur learning.

METHODS

A blur encoder was used to extract motion-related degradation features to model the degradation process caused by motion, and the obtained motion degradation features were imported in the artifact correction module for artifact removal. The artifact correction module adopts a joint learning framework for image blur removal and image blur simulation for treatment of spatially varying and random motion patterns. Comparative experiments were conducted to verify the effectiveness of the proposed method using both simulated motion data sets and clinical data sets.

RESULTS

The experimental results with the simulated dataset showed that compared with the existing methods, the PSNR of the proposed method increased by 2.88%, the SSIM increased by 0.89%, and the RMSE decreased by 10.58%. The results with the clinical dataset showed that the proposed method achieved the highest expert level with a subjective image quality score of 4.417 (in a 5-point scale), significantly higher than those of the comparison methods.

CONCLUSION

The proposed DMBL algorithm with a deep blur joint learning network structure can effectively reduce motion artifacts in dental CBCT images and achieve high-quality image restoration.

Deformable motion compensation in interventional cone-beam CT with a context-aware learned autofocus metric

PURPOSE

Interventional Cone-Beam CT (CBCT) offers 3D visualization of soft-tissue and vascular anatomy, enabling 3D guidance of abdominal interventions. However, its long acquisition time makes CBCT susceptible to patient motion. Image-based autofocus offers a suitable platform for compensation of deformable motion in CBCT, but it relies on handcrafted motion metrics based on first-order image properties and that lack awareness of the underlying anatomy. This work proposes a data-driven approach to motion quantification via a learned, context-aware, deformable metric,VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ , that quantifies the amount of motion degradation as well as the realism of the structural anatomical content in the image.

METHODS

The proposedVI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ was modeled as a deep convolutional neural network (CNN) trained to recreate a reference-based structural similarity metric-visual information fidelity (VIF). The deep CNN acted on motion-corrupted images, providing an estimation of the spatial VIF map that would be obtained against a motion-free reference, capturing motion distortion, and anatomic plausibility. The deep CNN featured a multi-branch architecture with a high-resolution branch for estimation of voxel-wise VIF on a small volume of interest. A second contextual, low-resolution branch provided features associated to anatomical context for disentanglement of motion effects and anatomical appearance. The deep CNN was trained on paired motion-free and motion-corrupted data obtained with a high-fidelity forward projection model for a protocol involving 120 kV and 9.90 mGy. The performance ofVI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ was evaluated via metrics of correlation with ground truth VIF ${\bm{VIF}}$ and with the underlying deformable motion field in simulated data with deformable motion fields with amplitude ranging from 5 to 20 mm and frequency from 2.4 up to 4 cycles/scan. Robustness to variation in tissue contrast and noise levels was assessed in simulation studies with varying beam energy (90-120 kV) and dose (1.19-39.59 mGy). Further validation was obtained on experimental studies with a deformable phantom. Final validation was obtained via integration ofVI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ on an autofocus compensation framework, applied to motion compensation on experimental datasets and evaluated via metric of spatial resolution on soft-tissue boundaries and sharpness of contrast-enhanced vascularity.

RESULTS

The magnitude and spatial map ofVI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ showed consistent and high correlation levels with the ground truth in both simulation and real data, yielding average normalized cross correlation (NCC) values of 0.95 and 0.88, respectively. Similarly,VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ achieved good correlation values with the underlying motion field, with average NCC of 0.90. In experimental phantom studies,VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ properly reflects the change in motion amplitudes and frequencies: voxel-wise averaging of the localVI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ across the full reconstructed volume yielded an average value of 0.69 for the case with mild motion (2 mm, 12 cycles/scan) and 0.29 for the case with severe motion (12 mm, 6 cycles/scan). Autofocus motion compensation usingVI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ resulted in noticeable mitigation of motion artifacts and improved spatial resolution of soft tissue and high-contrast structures, resulting in reduction of edge spread function width of 8.78% and 9.20%, respectively. Motion compensation also increased the conspicuity of contrast-enhanced vascularity, reflected in an increase of 9.64% in vessel sharpness.

CONCLUSION

The proposedVI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ , featuring a novel context-aware architecture, demonstrated its capacity as a reference-free surrogate of structural similarity to quantify motion-induced degradation of image quality and anatomical plausibility of image content. The validation studies showed robust performance across motion patterns, x-ray techniques, and anatomical instances. The proposed anatomy- and context-aware metric poses a powerful alternative to conventional motion estimation metrics, and a step forward for application of deep autofocus motion compensation for guidance in clinical interventional procedures.

Motion artifact correction for cone beam CT stroke imaging: a prospective series

BACKGROUND

Imaging assessment for acute ischemic stroke (AIS) patients in the angiosuite using cone beam CT (CBCT) has created increased interest since endovascular treatment became the first line therapy for proximal vessel occlusions. One of the main challenges of CBCT imaging in AIS patients is degraded image quality due to motion artifacts. This study aims to evaluate the prevalence of motion artifacts in CBCT stroke imaging and the effectiveness of a novel motion artifact correction algorithm for image quality improvement.

METHODS

Patients presenting with acute stroke symptoms and considered for endovascular treatment were included in the study. CBCT scans were performed using the angiosuite X-ray system. All CBCT scans were post-processed using a motion artifact correction algorithm. Motion artifacts were scored before and after processing using a 4-point scale.

RESULTS

We prospectively included 310 CBCT scans from acute stroke patients. 51% (n=159/310) of scans had motion artifacts, with 24% being moderate to severe. The post-processing algorithm improved motion artifacts in 91% of scans with motion (n=144/159), restoring clinical diagnostic capability in 34%. Overall, 76% of the scans were sufficient for clinical decision-making before correction, which improved to 93% (n=289/310) after post-processing with our algorithm.

CONCLUSIONS

Our results demonstrate that CBCT motion artifacts are significantly reduced using a novel post-processing algorithm, which improved brain CBCT image quality and diagnostic assessment for stroke. This is an important step on the road towards a direct-to-angio approach for endovascular thrombectomy (EVT) treatment.

Gradient-based geometry learning for fan-beam CT reconstruction

Objective.Incorporating computed tomography (CT) reconstruction operators into differentiable pipelines has proven beneficial in many applications. Such approaches usually focus on the projection data and keep the acquisition geometry fixed. However, precise knowledge of the acquisition geometry is essential for high quality reconstruction results. In this paper, the differentiable formulation of fan-beam CT reconstruction is extended to the acquisition geometry.Approach.The CT fan-beam reconstruction is analytically derived with respect to the acquisition geometry. This allows to propagate gradient information from a loss function on the reconstructed image into the geometry parameters. As a proof-of-concept experiment, this idea is applied to rigid motion compensation. The cost function is parameterized by a trained neural network which regresses an image quality metric from the motion-affected reconstruction alone.Main results.The algorithm improves the structural similarity index measure (SSIM) from 0.848 for the initial motion-affected reconstruction to 0.946 after compensation. It also generalizes to real fan-beam sinograms which are rebinned from a helical trajectory where the SSIM increases from 0.639 to 0.742.Significance.Using the proposed method, we are the first to optimize an autofocus-inspired algorithm based on analytical gradients. Next to motion compensation, we see further use cases of our differentiable method for scanner calibration or hybrid techniques employing deep models.

Computed Tomography: State-of-the-Art Advancements in Musculoskeletal Imaging

ABSTRACT

Although musculoskeletal magnetic resonance imaging (MRI) plays a dominant role in characterizing abnormalities, novel computed tomography (CT) techniques have found an emerging niche in several scenarios such as trauma, gout, and the characterization of pathologic biomechanical states during motion and weight-bearing. Recent developments and advancements in the field of musculoskeletal CT include 4-dimensional, cone-beam (CB), and dual-energy (DE) CT. Four-dimensional CT has the potential to quantify biomechanical derangements of peripheral joints in different joint positions to diagnose and characterize patellofemoral instability, scapholunate ligamentous injuries, and syndesmotic injuries. Cone-beam CT provides an opportunity to image peripheral joints during weight-bearing, augmenting the diagnosis and characterization of disease processes. Emerging CBCT technologies improved spatial resolution for osseous microstructures in the quantitative analysis of osteoarthritis-related subchondral bone changes, trauma, and fracture healing. Dual-energy CT-based material decomposition visualizes and quantifies monosodium urate crystals in gout, bone marrow edema in traumatic and nontraumatic fractures, and neoplastic disease. Recently, DE techniques have been applied to CBCT, contributing to increased image quality in contrast-enhanced arthrography, bone densitometry, and bone marrow imaging. This review describes 4-dimensional CT, CBCT, and DECT advances, current logistical limitations, and prospects for each technique.

Reference-free learning-based similarity metric for motion compensation in cone-beam CT

Purpose. Patient motion artifacts present a prevalent challenge to image quality in interventional cone-beam CT (CBCT). We propose a novel reference-free similarity metric (DL-VIF) that leverages the capability of deep convolutional neural networks (CNN) to learn features associated with motion artifacts within realistic anatomical features. DL-VIF aims to address shortcomings of conventional metrics of motion-induced image quality degradation that favor characteristics associated with motion-free images, such as sharpness or piecewise constancy, but lack any awareness of the underlying anatomy, potentially promoting images depicting unrealistic image content. DL-VIF was integrated in an autofocus motion compensation framework to test its performance for motion estimation in interventional CBCT.Methods. DL-VIF is a reference-free surrogate for the previously reported visual image fidelity (VIF) metric, computed against a motion-free reference, generated using a CNN trained using simulated motion-corrupted and motion-free CBCT data. Relatively shallow (2-ResBlock) and deep (3-Resblock) CNN architectures were trained and tested to assess sensitivity to motion artifacts and generalizability to unseen anatomy and motion patterns. DL-VIF was integrated into an autofocus framework for rigid motion compensation in head/brain CBCT and assessed in simulation and cadaver studies in comparison to a conventional gradient entropy metric.Results. The 2-ResBlock architecture better reflected motion severity and extrapolated to unseen data, whereas 3-ResBlock was found more susceptible to overfitting, limiting its generalizability to unseen scenarios. DL-VIF outperformed gradient entropy in simulation studies yielding average multi-resolution structural similarity index (SSIM) improvement over uncompensated image of 0.068 and 0.034, respectively, referenced to motion-free images. DL-VIF was also more robust in motion compensation, evidenced by reduced variance in SSIM for various motion patterns (σ_DL-VIF = 0.008 versusσ_{gradient entropy} = 0.019). Similarly, in cadaver studies, DL-VIF demonstrated superior motion compensation compared to gradient entropy (an average SSIM improvement of 0.043 (5%) versus little improvement and even degradation in SSIM, respectively) and visually improved image quality even in severely motion-corrupted images.Conclusion: The studies demonstrated the feasibility of building reference-free similarity metrics for quantification of motion-induced image quality degradation and distortion of anatomical structures in CBCT. DL-VIF provides a reliable surrogate for motion severity, penalizes unrealistic distortions, and presents a valuable new objective function for autofocus motion compensation in CBCT.

Flat-panel conebeam CT in the clinic: history and current state

Research into conebeam CT concepts began as soon as the first clinical single-slice CT scanner was conceived. Early implementations of conebeam CT in the 1980s focused on high-contrast applications where concurrent high resolution ( < 200    μ m ), for visualization of small contrast-filled vessels, bones, or teeth, was an imaging requirement that could not be met by the contemporaneous CT scanners. However, the use of nonlinear imagers, e.g., x-ray image intensifiers, limited the clinical utility of the earliest diagnostic conebeam CT systems. The development of consumer-electronics large-area displays provided a technical foundation that was leveraged in the 1990s to first produce large-area digital x-ray detectors for use in radiography and then compact flat panels suitable for high-resolution and high-frame-rate conebeam CT. In this review, we show the concurrent evolution of digital flat panel (DFP) technology and clinical conebeam CT. We give a brief summary of conebeam CT reconstruction, followed by a brief review of the correction approaches for DFP-specific artifacts. The historical development and current status of flat-panel conebeam CT in four clinical areas-breast, fixed C-arm, image-guided radiation therapy, and extremity/head-is presented. Advances in DFP technology over the past two decades have led to improved visualization of high-contrast, high-resolution clinical tasks, and image quality now approaches the soft-tissue contrast resolution that is the standard in clinical CT. Future technical developments in DFPs will enable an even broader range of clinical applications; research in the arena of flat-panel CT shows no signs of slowing down.

Motion estimation and correction in SPECT, PET and CT

Patient motion impacts single photon emission computed tomography (SPECT), positron emission tomography (PET) and X-ray computed tomography (CT) by giving rise to projection data inconsistencies that can manifest as reconstruction artifacts, thereby degrading image quality and compromising accurate image interpretation and quantification. Methods to estimate and correct for patient motion in SPECT, PET and CT have attracted considerable research effort over several decades. The aims of this effort have been two-fold: to estimate relevant motion fields characterizing the various forms of voluntary and involuntary motion; and to apply these motion fields within a modified reconstruction framework to obtain motion-corrected images. The aims of this review are to outline the motion problem in medical imaging and to critically review published methods for estimating and correcting for the relevant motion fields in clinical and preclinical SPECT, PET and CT. Despite many similarities in how motion is handled between these modalities, utility and applications vary based on differences in temporal and spatial resolution. Technical feasibility has been demonstrated in each modality for both rigid and non-rigid motion, but clinical feasibility remains an important target. There is considerable scope for further developments in motion estimation and correction, and particularly in data-driven methods that will aid clinical utility. State-of-the-art machine learning methods may have a unique role to play in this context.

Motion Reduction for C-Arm Computed Tomography of the Pulmonary Arteries: Image Quality of a Motion Correction Algorithm in Patients with Chronic Thromboembolic Hypertension During Balloon Pulmonary Angioplasty

PURPOSE

 To evaluate the feasibility and image quality of a motion correction algorithm for supra-selective C-arm computed tomography (CACT) of the pulmonary arteries in patients with chronic thromboembolic pulmonary hypertension (CTEPH) undergoing balloon pulmonary angioplasty (BPA).

MATERIALS & METHODS

 CACT raw data acquired during 30 consecutive BPAs were used for image reconstruction using either standard (CACTorg) or a motion correction algorithm (CACTmc), using 400 iterations. Two readers independently evaluated 188 segmental and 564 sub-segmental contrast-enhanced pulmonary arteries in each reconstruction. The following categories were assessed: Sharpness of the vessel, motion artifacts, delineation of bronchial structures, vessel geometry, and visibility of treatable lesions. The mentioned criteria were rated from grade 1 to grade 3: grade 1: excellent quality; grade 2: good quality; grade 3: poor/seriously impaired quality. Inter-observer agreement was calculated using Cohen's Kappa. Due to an excellent agreement, the ratings of both readers were merged. Differences in the assessed image quality criteria were evaluated using pairwise Wilcoxon signed-rank test.

RESULTS

 Inter-observer agreement was excellent for all evaluated image quality criteria (κ > 0.81). For all assessed image quality criteria, the ratings on CACTorg were good but improved significantly for CACTmc to excellent for the whole vascular tree (p < 0.01). When considering segmental and sub-segmental levels individually, all image quality criteria improved significantly for CACTmc on both levels (p < 0.01). While ratings of CACTmc were constant for both levels (segmental and sub-segmental) for all criteria, the ratings of CACTorg were slightly impaired for the sub-segmental arteries.

CONCLUSION

 Motion correction for supra-selective contrast-enhanced CACT of the pulmonary arteries is feasible and improves the overall image quality.

KEY POINTS

  · Motion artifacts can severely impair the diagnostic accuracy of CACT.. · A motion correction algorithm can significantly improve image quality in CACT of the pulmonary arteries.. · Especially the overall image quality of sub-segmental branches is significantly improved..

CITATION FORMAT

· Maschke S, Werncke T, Becker LS et al. Motion Reduction for C-Arm Computed Tomography of the Pulmonary Arteries: Image Quality of a Motion Correction Algorithm in Patients with Chronic Thromboembolic Hypertension During Balloon Pulmonary Angioplasty. Fortschr Röntgenstr 2021; 193: 1074 - 1080.

Deformable motion compensation for interventional cone-beam CT

Image-guided therapies in the abdomen and pelvis are often hindered by motion artifacts in cone-beam CT (CBCT) arising from complex, non-periodic, deformable organ motion during long scan times (5-30 s). We propose a deformable image-based motion compensation method to address these challenges and improve CBCT guidance. Motion compensation is achieved by selecting a set of small regions of interest in the uncompensated image to minimize a cost function consisting of an autofocus objective and spatiotemporal regularization penalties. Motion trajectories are estimated using an iterative optimization algorithm (CMA-ES) and used to interpolate a 4D spatiotemporal motion vector field. The motion-compensated image is reconstructed using a modified filtered backprojection approach. Being image-based, the method does not require additional input besides the raw CBCT projection data and system geometry that are used for image reconstruction. Experimental studies investigated: (1) various autofocus objective functions, analyzed using a digital phantom with a range of sinusoidal motion magnitude (4, 8, 12, 16, 20 mm); (2) spatiotemporal regularization, studied using a CT dataset from The Cancer Imaging Archive with deformable sinusoidal motion of variable magnitude (10, 15, 20, 25 mm); and (3) performance in complex anatomy, evaluated in cadavers undergoing simple and complex motion imaged on a CBCT-capable mobile C-arm system (Cios Spin 3D, Siemens Healthineers, Forchheim, Germany). Gradient entropy was found to be the best autofocus objective for soft-tissue CBCT, increasing structural similarity (SSIM) by 42%-92% over the range of motion magnitudes investigated. The optimal temporal regularization strength was found to vary widely (0.5-5 mm^-2) over the range of motion magnitudes investigated, whereas optimal spatial regularization strength was relatively constant (0.1). In cadaver studies, deformable motion compensation was shown to improve local SSIM by ∼17% for simple motion and ∼21% for complex motion and provided strong visual improvement of motion artifacts (reduction of blurring and streaks and improved visibility of soft-tissue edges). The studies demonstrate the robustness of deformable motion compensation to a range of motion magnitudes, frequencies, and other factors (e.g. truncation and scatter).

Deep Learning-based Inaccuracy Compensation in Reconstruction of High Resolution XCT Data

While X-ray computed tomography (XCT) is pushed further into the micro- and nanoscale, the limitations of various tool components and object motion become more apparent. For high-resolution XCT, it is necessary but practically difficult to align these tool components with sub-micron precision. The aim is to develop a novel reconstruction methodology that considers unavoidable misalignment and object motion during the data acquisition in order to obtain high-quality three-dimensional images and that is applicable for data recovery from incomplete datasets. A reconstruction software empowered by sophisticated correction modules that autonomously estimates and compensates artefacts using gradient descent and deep learning algorithms has been developed and applied. For motion estimation, a novel computer vision methodology coupled with a deep convolutional neural network approach provides estimates for the object motion by tracking features throughout the adjacent projections. The model is trained using the forward projections of simulated phantoms that consist of several simple geometrical features such as sphere, triangle and rectangular. The feature maps extracted by a neural network are used to detect and to classify features done by a support vector machine. For missing data recovery, a novel deep convolutional neural network is used to infer high-quality reconstruction data from incomplete sets of projections. The forward and back projections of simulated geometric shapes from a range of angular ranges are used to train the model. The model is able to learn the angular dependency based on a limited angle coverage and to propose a new set of projections to suppress artefacts. High-quality three-dimensional images demonstrate that it is possible to effectively suppress artefacts caused by thermomechanical instability of tool components and objects resulting in motion, by center of rotation misalignment and by inaccuracy in the detector position without additional computational efforts. Data recovery from incomplete sets of projections result in directly corrected projections instead of suppressing artefacts in the final reconstructed images. The proposed methodology has been proven and is demonstrated for a ball bearing sample. The reconstruction results are compared to prior corrections and benchmarked with a commercially available reconstruction software. Compared to conventional approaches in XCT imaging and data analysis, the proposed methodology for the generation of high-quality three-dimensional X-ray images is fully autonomous. The methodology presented here has been proven for high-resolution micro-XCT and nano-XCT, however, is applicable for all length scales.