High-quality four-dimensional cone-beam CT by deforming prior images

Prior frequency guided diffusion model for limited angle (LA)-CBCT reconstruction

Objective.Cone-beam computed tomography (CBCT) is widely used in image-guided radiotherapy. Reconstructing CBCTs from limited-angle acquisitions (LA-CBCT) is highly desired for improved imaging efficiency, dose reduction, and better mechanical clearance. LA-CBCT reconstruction, however, suffers from severe under-sampling artifacts, making it a highly ill-posed inverse problem. Diffusion models can generate data/images by reversing a data-noising process through learned data distributions; and can be incorporated as a denoiser/regularizer in LA-CBCT reconstruction. In this study, we developed a diffusion model-based framework, prior frequency-guided diffusion model (PFGDM), for robust and structure-preserving LA-CBCT reconstruction.Approach.PFGDM uses a conditioned diffusion model as a regularizer for LA-CBCT reconstruction, and the condition is based on high-frequency information extracted from patient-specific prior CT scans which provides a strong anatomical prior for LA-CBCT reconstruction. Specifically, we developed two variants of PFGDM (PFGDM-A and PFGDM-B) with different conditioning schemes. PFGDM-A applies the high-frequency CT information condition until a pre-optimized iteration step, and drops it afterwards to enable both similar and differing CT/CBCT anatomies to be reconstructed. PFGDM-B, on the other hand, continuously applies the prior CT information condition in every reconstruction step, while with a decaying mechanism, to gradually phase out the reconstruction guidance from the prior CT scans. The two variants of PFGDM were tested and compared with current available LA-CBCT reconstruction solutions, via metrics including peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM).Main results.PFGDM outperformed all traditional and diffusion model-based methods. The mean(s.d.) PSNR/SSIM were 27.97(3.10)/0.949(0.027), 26.63(2.79)/0.937(0.029), and 23.81(2.25)/0.896(0.036) for PFGDM-A, and 28.20(1.28)/0.954(0.011), 26.68(1.04)/0.941(0.014), and 23.72(1.19)/0.894(0.034) for PFGDM-B, based on 120°, 90°, and 30° orthogonal-view scan angles respectively. In contrast, the PSNR/SSIM was 19.61(2.47)/0.807(0.048) for 30° for DiffusionMBIR, a diffusion-based method without prior CT conditioning.Significance. PFGDM reconstructs high-quality LA-CBCTs under very-limited gantry angles, allowing faster and more flexible CBCT scans with dose reductions.

Motion compensated cone-beam CT reconstruction using ana priorimotion model from CT simulation: a pilot study

Objective. To combat the motion artifacts present in traditional 4D-CBCT reconstruction, an iterative technique known as the motion-compensated simultaneous algebraic reconstruction technique (MC-SART) was previously developed. MC-SART employs a 4D-CBCT reconstruction to obtain an initial model, which suffers from a lack of sufficient projections in each bin. The purpose of this study is to demonstrate the feasibility of introducing a motion model acquired during CT simulation to MC-SART, coined model-based CBCT (MB-CBCT).Approach. For each of 5 patients, we acquired 5DCTs during simulation and pre-treatment CBCTs with a simultaneous breathing surrogate. We cross-calibrated the 5DCT and CBCT breathing waveforms by matching the diaphragms and employed the 5DCT motion model parameters for MC-SART. We introduced the Amplitude Reassignment Motion Modeling technique, which measures the ability of the model to control diaphragm sharpness by reassigning projection amplitudes with varying resolution. We evaluated the sharpness of tumors and compared them between MB-CBCT and 4D-CBCT. We quantified sharpness by fitting an error function across anatomical boundaries. Furthermore, we compared our MB-CBCT approach to the traditional MC-SART approach. We evaluated MB-CBCT's robustness over time by reconstructing multiple fractions for each patient and measuring consistency in tumor centroid locations between 4D-CBCT and MB-CBCT.Main results. We found that the diaphragm sharpness rose consistently with increasing amplitude resolution for 4/5 patients. We observed consistently high image quality across multiple fractions, and observed stable tumor centroids with an average 0.74 ± 0.31 mm difference between the 4D-CBCT and MB-CBCT. Overall, vast improvements over 3D-CBCT and 4D-CBCT were demonstrated by our MB-CBCT technique in terms of both diaphragm sharpness and overall image quality.Significance. This work is an important extension of the MC-SART technique. We demonstrated the ability ofa priori5DCT models to provide motion compensation for CBCT reconstruction. We showed improvements in image quality over both 4D-CBCT and the traditional MC-SART approach.

Deep Filtered Back Projection for CT Reconstruction

Filtered back projection (FBP) is a classic analytical algorithm for computed tomography (CT) reconstruction, with high computational efficiency. However, images reconstructed by FBP often suffer from excessive noise and artifacts. The original FBP algorithm uses a window function to smooth signals and a linear interpolation to estimate projection values at un-sampled locations. In this study, we propose a novel framework named DeepFBP in which an optimized filter and an optimized nonlinear interpolation operator are learned with neural networks. Specifically, the learned filter can be considered as the product of an optimized window function and the ramp filter, and the learned interpolation can be considered as an optimized way to utilize projection information of nearby locations through nonlinear combination. The proposed method remains the high computational efficiency of the original FBP and achieves much better reconstruction quality at different noise levels. It also outperforms the TV-based statistical iterative algorithm, with computational time being reduced in an order of two, and state-of-the-art post-processing deep learning methods that have deeper and more complicated network structures.

Real-time liver motion estimation via deep learning-based angle-agnostic X-ray imaging

BACKGROUND

Real-time liver imaging is challenged by the short imaging time (within hundreds of milliseconds) to meet the temporal constraint posted by rapid patient breathing, resulting in extreme under-sampling for desired 3D imaging. Deep learning (DL)-based real-time imaging/motion estimation techniques are emerging as promising solutions, which can use a single X-ray projection to estimate 3D moving liver volumes by solved deformable motion. However, such techniques were mostly developed for a specific, fixed X-ray projection angle, thereby impractical to verify and guide arc-based radiotherapy with continuous gantry rotation.

PURPOSE

To enable deformable motion estimation and 3D liver imaging from individual X-ray projections acquired at arbitrary X-ray scan angles, and to further improve the accuracy of single X-ray-driven motion estimation.

METHODS

We developed a DL-based method, X360, to estimate the deformable motion of the liver boundary using an X-ray projection acquired at an arbitrary gantry angle (angle-agnostic). X360 incorporated patient-specific prior information from planning 4D-CTs to address the under-sampling issue, and adopted a deformation-driven approach to deform a prior liver surface mesh to new meshes that reflect real-time motion. The liver mesh motion is solved via motion-related image features encoded in the arbitrary-angle X-ray projection, and through a sequential combination of rigid and deformable registration modules. To achieve the angle agnosticism, a geometry-informed X-ray feature pooling layer was developed to allow X360 to extract angle-dependent image features for motion estimation. As a liver boundary motion solver, X360 was also combined with priorly-developed, DL-based optical surface imaging and biomechanical modeling techniques for intra-liver motion estimation and tumor localization.

RESULTS

With geometry-aware feature pooling, X360 can solve the liver boundary motion from an arbitrary-angle X-ray projection. Evaluated on a set of 10 liver patient cases, the mean (± s.d.) 95-percentile Hausdorff distance between the solved liver boundary and the "ground-truth" decreased from 10.9 (±4.5) mm (before motion estimation) to 5.5 (±1.9) mm (X360). When X360 was further integrated with surface imaging and biomechanical modeling for liver tumor localization, the mean (± s.d.) center-of-mass localization error of the liver tumors decreased from 9.4 (± 5.1) mm to 2.2 (± 1.7) mm.

CONCLUSION

X360 can achieve fast and robust liver boundary motion estimation from arbitrary-angle X-ray projections for real-time imaging guidance. Serving as a surface motion solver, X360 can be integrated into a combined framework to achieve accurate, real-time, and marker-less liver tumor localization.

Real-time liver tumor localization via combined surface imaging and a single x-ray projection

Objective. Real-time imaging, a building block of real-time adaptive radiotherapy, provides instantaneous knowledge of anatomical motion to drive delivery adaptation to improve patient safety and treatment efficacy. The temporal constraint of real-time imaging (<500 milliseconds) significantly limits the imaging signals that can be acquired, rendering volumetric imaging and 3D tumor localization extremely challenging. Real-time liver imaging is particularly difficult, compounded by the low soft tissue contrast within the liver. We proposed a deep learning (DL)-based framework (Surf-X-Bio), to track 3D liver tumor motion in real-time from combined optical surface image and a single on-board x-ray projection.Approach. Surf-X-Bio performs mesh-based deformable registration to track/localize liver tumors volumetrically via three steps. First, a DL model was built to estimate liver boundary motion from an optical surface image, using learnt motion correlations between the respiratory-induced external body surface and liver boundary. Second, the residual liver boundary motion estimation error was further corrected by a graph neural network-based DL model, using information extracted from a single x-ray projection. Finally, a biomechanical modeling-driven DL model was applied to solve the intra-liver motion for tumor localization, using the liver boundary motion derived via prior steps.Main results. Surf-X-Bio demonstrated higher accuracy and better robustness in tumor localization, as compared to surface-image-only and x-ray-only models. By Surf-X-Bio, the mean (±s.d.) 95-percentile Hausdorff distance of the liver boundary from the 'ground-truth' decreased from 9.8 (±4.5) (before motion estimation) to 2.4 (±1.6) mm. The mean (±s.d.) center-of-mass localization error of the liver tumors decreased from 8.3 (±4.8) to 1.9 (±1.6) mm.Significance. Surf-X-Bio can accurately track liver tumors from combined surface imaging and x-ray imaging. The fast computational speed (<250 milliseconds per inference) allows it to be applied clinically for real-time motion management and adaptive radiotherapy.

A deep unsupervised learning framework for the 4D CBCT artifact correction

Objective. Four-dimensional cone-beam computed tomography (4D CBCT) has unique advantages in moving target localization, tracking and therapeutic dose accumulation in adaptive radiotherapy. However, the severe fringe artifacts and noise degradation caused by 4D CBCT reconstruction restrict its clinical application. We propose a novel deep unsupervised learning model to generate the high-quality 4D CBCT from the poor-quality 4D CBCT. Approach. The proposed model uses a contrastive loss function to preserve the anatomical structure in the corrected image. To preserve the relationship between the input and output image, we use a multilayer, patch-based method rather than operate on entire images. Furthermore, we draw negatives from within the input 4D CBCT rather than from the rest of the dataset. Main results. The results showed that the streak and motion artifacts were significantly suppressed. The spatial resolution of the pulmonary vessels and microstructure were also improved. To demonstrate the results in the different directions, we make the animation to show the different views of the predicted correction image in the supplementary animation. Significance. The proposed method can be integrated into any 4D CBCT reconstruction method and maybe a practical way to enhance the image quality of the 4D CBCT.

An unsupervised 2D-3D deformable registration network (2D3D-RegNet) for cone-beam CT estimation

Acquiring CBCTs from a limited scan angle can help to reduce the imaging time, save the imaging dose, and allow continuous target localizations through arc-based treatments with high temporal resolution. However, insufficient scan angle sampling leads to severe distortions and artifacts in the reconstructed CBCT images, limiting their clinical applicability. 2D-3D deformable registration can map a prior fully-sampled CT/CBCT volume to estimate a new CBCT, based on limited-angle on-board cone-beam projections. The resulting CBCT images estimated by 2D-3D deformable registration can successfully suppress the distortions and artifacts, and reflect up-to-date patient anatomy. However, traditional iterative 2D-3D deformable registration algorithm is very computationally expensive and time-consuming, which takes hours to generate a high quality deformation vector field (DVF) and the CBCT. In this work, we developed an unsupervised, end-to-end, 2D-3D deformable registration framework using convolutional neural networks (2D3D-RegNet) to address the speed bottleneck of the conventional iterative 2D-3D deformable registration algorithm. The 2D3D-RegNet was able to solve the DVFs within 5 seconds for 90 orthogonally-arranged projections covering a combined 90° scan angle, with DVF accuracy superior to 3D-3D deformable registration, and on par with the conventional 2D-3D deformable registration algorithm. We also performed a preliminary robustness analysis of 2D3D-RegNet towards projection angular sampling frequency variations, as well as scan angle offsets. The synergy of 2D3D-RegNet with biomechanical modeling was also evaluated, and demonstrated that 2D3D-RegNet can function as a fast DVF solution core for further DVF refinement.

Fully Automatic Sliding Motion Compensated and Simultaneous 4D-CBCT via Bilateral Filtering

Purpose

To incorporate the bilateral filtering into the Deformable Vector Field (DVF) based 4D-CBCT reconstruction for realizing a fully automatic sliding motion compensated 4D-CBCT.

Materials and Methods

Initially, a motion compensated simultaneous algebraic reconstruction technique (mSART) is used to generate a high quality reference phase (e.g. 0% phase) by using all phase projections together with the initial 4D-DVFs. The initial 4D-DVF were generated via Demons registration between 0% phase and each other phase image. The 4D-DVF will then kept updating by matching the forward projection of the deformed high quality 0% phase with the measured projection of the target phase. The loss function during this optimization contains an projection intensity difference matching criterion plus a DVF smoothing constrain term. We introduce a bilateral filtering kernel into the DVF constrain term to estimate the sliding motion automatically. The bilateral filtering kernel contains three sub-kernels: 1) an spatial domain Guassian kernel; 2) an image intensity domain Guassian kernel; and 3) a DVF domain Guassian kernel. By choosing suitable kernel variances, the sliding motion can be extracted. A non-linear conjugate gradient optimizer was used. We validated the algorithm on a non-uniform rotational B-spline based cardiac-torso (NCAT) phantom and four anonymous patient data. For quantification, we used: 1) the Root-Mean-Square-Error (RMSE) together with the Maximum-Error (MaxE); 2) the Dice coefficient of the extracted lung contour from the final reconstructed images and 3) the relative reconstruction error (RE) to evaluate the algorithm's performance.

Results

For NCAT phantom, the motion trajectory's RMSE/MaxE are 0.796/1.02 mm for bilateral filtering reconstruction; and 2.704/4.08 mm for original reconstruction. For patient pilot study, the 4D-Dice coefficient obtained with bilateral filtering are consistently higher than that without bilateral filtering. Meantime several image content such as the rib position, the heart edge definition, the fibrous structures all has been better corrected with bilateral filtering.

Conclusion

We developed a bilateral filtering based fully automatic sliding motion compensated 4D-CBCT scheme. Both digital phantom and initial patient pilot studies confirmed the improved motion estimation and image reconstruction ability. It can be used as a 4D-CBCT image guidance tool for lung SBRT treatment.

Change detection in sparse repeat CT scans with non-rigid deformations

BACKGROUND

Detecting and interpreting changes in the images of follow-up CT scans by the clinicians is often time-consuming and error-prone due to changes in patient position and non-rigid anatomy deformations. Thus, reconstructed repeat scan images are required, precluding reduced dose sparse-view repeat scanning.

OBJECTIVE

A method to automatically detect changes in a region of interest of sparse-view repeat CT scans in the presence of non-rigid deformations of the patient's anatomy without reconstructing the original images.

METHODS

The proposed method uses the sparse sinogram data of two CT scans to distinguish between genuine changes in the repeat scan and differences due to non-rigid anatomic deformations. First, size and contrast level of the changed regions are estimated from the difference between the scans' sinogram data. The estimated types of changes in the repeat scan help optimize the method's parameter values. Two scans are then aligned using Radon space non-rigid registration. Rays which crossed changes in the ROI are detected and back-projected onto image space in a two-phase procedure. These rays form a likelihood map from which the binary changed region map is computed.

RESULTS

Experimental studies on four pairs of clinical lung and liver CT scans with simulated changed regions yield a mean changed region recall rate > 86%and a mean precision rate > 83%when detecting large changes with low contrast, and high contrast changes, even when small. The new method outperforms image space methods using prior image constrained compressed sensing (PICCS) reconstruction, particularly for small, low contrast changes (recall = 15.8%, precision = 94.7%).

CONCLUSION

Our method for automatic change detection in sparse-view repeat CT scans with non-rigid deformations may assist radiologists by highlighting the changed regions and may obviate the need for a high-quality repeat scan image when no changes are detected.

Unsupervised learning for deformable registration of thoracic CT and cone-beam CT based on multiscale features matching with spatially adaptive weighting

PURPOSE

Cone-beam computed tomography (CBCT) is a common on-treatment imaging widely used in image-guided radiotherapy. Fast and accurate registration between the on-treatment CBCT and planning CT is significant for and precise adaptive radiotherapy treatment (ART). However, existing CT-CBCT registration methods, which are mostly affine or time-consuming intensity- based deformation registration, still need further study due to the considerable CT-CBCT intensity discrepancy and the artifacts in low-quality CBCT images. In this paper, we propose a deep learning-based CT-CBCT registration model to promote rapid and accurate CT-CBCT registration for radiotherapy.

METHODS

The proposed CT-CBCT registration model consists of a registration network and an innovative deep similarity metric network. The registration network is a novel fully convolution network adapted specially for patch-wise CT-CBCT registration. The metric network, going beyond intensity, automatically evaluates the high-dimensional attribute-based dissimilarity between the registered CT and CBCT images. In addition, considering the artifacts in low-quality CBCT images, we add spatial weighting (SW) block to adaptively attach more importance to those informative voxels while inhibit the interference of artifact regions. Such SW-based metric network is expected to extract the most meaningful and discriminative deep features, and form a more reliable CT-CBCT similarity measure to train the registration network.

RESULTS

We evaluate the proposed method on clinical thoracic CBCT and CT dataset, and compare the registration results with some other common image similarity metrics and some state-of-the-art registration algorithms. The proposed method provides the highest Structural Similarity index (86.17 ± 5.09), minimum Target Registration Error of landmarks (2.37 ± 0.32 mm), and the best DSC coefficient (78.71 ± 10.95) of tumor volumes. Moreover, our model also obtains comparable distance error of lung surfaces (1.75 ± 0.35 mm).

CONCLUSION

The proposed model shows both efficiency and efficacy for reliable thoracic CT-CBCT registration, and can generate the matched CT and CBCT images within few seconds, which is of great significance to clinical radiotherapy.

A modern review of the uncertainties in volumetric imaging of respiratory-induced target motion in lung radiotherapy

Radiotherapy has become a critical component for the treatment of all stages and types of lung cancer, often times being the primary gateway to a cure. However, given that radiation can cause harmful side effects depending on how much surrounding healthy tissue is exposed, treatment of the lung can be particularly challenging due to the presence of moving targets. Careful implementation of every step in the radiotherapy process is absolutely integral for attaining optimal clinical outcomes. With the advent and now widespread use of stereotactic body radiation therapy (SBRT), where extremely large doses are delivered, accurate, and precise dose targeting is especially vital to achieve an optimal risk to benefit ratio. This has largely become possible due to the rapid development of image-guided technology. Although imaging is critical to the success of radiotherapy, it can often be plagued with uncertainties due to respiratory-induced target motion. There has and continues to be an immense research effort aimed at acknowledging and addressing these uncertainties to further our abilities to more precisely target radiation treatment. Thus, the goal of this article is to provide a detailed review of the prevailing uncertainties that remain to be investigated across the different imaging modalities, as well as to highlight the more modern solutions to imaging motion and their role in addressing the current challenges.

U-net-based deformation vector field estimation for motion-compensated 4D-CBCT reconstruction

PURPOSE

For four-dimensional cone-beam computed tomography (4D-CBCT), its image quality is usually degraded by insufficient projections at each respiratory phase after phase-sorting. Recently, we developed a simultaneous motion estimation and image reconstruction (SMEIR) technique, which can improve lung 4D-CBCT reconstruction quality by incorporating an interphase motion model generated as deformation vector fields (DVFs). Simultaneous motion estimation and image reconstruction uses an intensity-driven two-dimensional (2D)-three-dimensional (3D) deformation technique to estimate these DVFs by intensity-matching 2D projections. However, 2D-3D deformation may fail to generate accurate intra-lung DVFs, since the motion of intricate, small lung structures only leads to subtle intensity variations on 2D projections that are insufficient to drive accurate DVF optimization. This study is to develop convolutional neural network (CNN)-based methods to fine-tune the 2D-3D deformation DVFs to improve the efficiency and accuracy of 4D-CBCT reconstruction.

METHODS

We built two U-net-based architectures for this study. The first architecture (U-net-3C) uses 2D-3D deformation-estimated DVFs (in three cardinal directions) as the input with three channels (3C), and outputs are fine-tuned DVFs. For the second architecture (U-net-4C), the reference phase CBCT image reconstructed by SMEIR was added as an additional input channel (4C) to represent patient-specific heterogeneous properties of the lung. The output fine-tuned high-quality DVFs of both models were input again into the SMEIR workflow, as an optimized motion model, to generate the final 4D-CBCT. Both methods were evaluated on 11 lung patient cases, using fivefold cross-validation. We also reconstructed 4D-CBCTs by the original SMEIR and the SMEIR-Bio (SMEIR with biomechanical modeling) algorithms for comparison. The 4D-CBCT accuracy was quantitatively assessed through metrics including root-mean-square-error (RMSE), universal quality index (UQI), and normalized cross-correlation (NCC). The DVF accuracy was evaluated by manually tracked lung landmarks. We also evaluated our proposed methods on the SPARE challenge dataset based on reconstructed 4D-CBCT quality using the above metrics.

RESULTS

The average (±standard deviation) residual DVF errors of SMEIR-U-net-3C, SMEIR-U-net-4C, SMEIR-Bio, and SMEIR were 3.88 ± 3.12 mm, 3.71 ± 2.90 mm, 3.75 ± 3.40 mm, and 5.73 ± 4.61 mm, respectively. The SMEIR-U-net-3C and SMEIR-U-net-4C generated images of generally improved RMSE, UQI, and NCC as compared to the other methods. Compared with SMERI-U-net-3C, SMEIR-U-net-4C has slightly higher 4D-CBCT reconstruction and DVF estimation accuracy. For the SPARE dataset, the UQI for SMEIR-U-net-3C, SMEIR-U-net-4C, SMEIR-Bio, and SMEIR were 0.96, 0.97, 0.96, and 0.94.

CONCLUSION

The CNN-based models can achieve fast (~10 s) and accurate DVF fine-tuning to improve the efficiency and accuracy of 4D-CBCT reconstruction.

Quantifying day-to-day variations in 4DCBCT-based PCA motion models

The aim of this paper is to quantify the day-to-day variations of motion models derived from pre-treatment 4-dimensional cone beam CT (4DCBCT) fractions for lung cancer stereotactic body radiotherapy (SBRT) patients. Motion models are built by (1) applying deformable image registration (DIR) on each 4DCBCT image with respect to a reference image from that day, resulting in a set of displacement vector fields (DVFs), and (2) applying principal component analysis (PCA) on the DVFs to obtain principal components representing a motion model. Variations were quantified by comparing the PCA eigenvectors of the motion model built from the first day of treatment to the corresponding eigenvectors of the other motion models built from each successive day of treatment. Three metrics were used to quantify the variations: root mean squared (RMS) difference in the vectors, directional similarity, and an introduced metric called the Euclidean Model Norm (EMN). EMN quantifies the degree to which a motion model derived from the first fraction can represent the motion models of subsequent fractions. Twenty-one 4DCBCT scans from five SBRT patient treatments were used in this retrospective study. Experimental results demonstrated that the first two eigenvectors of motion models across all fractions have smaller RMS (0.00017), larger directional similarity (0.528), and larger EMN (0.678) than the last three eigenvectors (RMS: 0.00025, directional similarity: 0.041, and EMN: 0.212). The study concluded that, while the motion model eigenvectors varied from fraction to fraction, the first few eigenvectors were shown to be more stable across treatment fractions than others. This supports the notion that a pre-treatment motion model built from the first few PCA eigenvectors may remain valid throughout a treatment course. Future work is necessary to quantify how day-to-day variations in these models will affect motion reconstruction accuracy for specific clinical tasks.

High-quality initial image-guided 4D CBCT reconstruction

PURPOSE

Four-dimensional cone-beam computed tomography (4D CBCT) has been developed to provide a sequence of phase-resolved reconstructions in image-guided radiation therapy. However, 4D CBCT images are degraded by severe streaking artifacts because the 4D CBCT reconstruction process is an extreme sparse-view CT procedure wherein only under-sampled projections are used for the reconstruction of each phase. To obtain a set of 4D CBCT images achieving both high spatial and temporal resolution, we propose an algorithm by providing a high-quality initial image at the beginning of the iterative reconstruction process for each phase to guide the final reconstructed result toward its optimal solution.

METHODS

The proposed method consists of three steps to generate the initial image. First, a prior image is obtained by an iterative reconstruction method using the measured projections of the entire set of 4D CBCT images. The prior image clearly shows the appearance of structures in static regions, although it contains blurring artifacts in motion regions. Second, the robust principal component analysis (RPCA) model is adopted to extract the motion components corresponding to each phase-resolved image. Third, a set of initial images are produced by the proposed linear estimation model that combines the prior image and the RPCA-decomposed motion components. The final 4D CBCT images are derived from the simultaneous algebraic reconstruction technique (SART) equipped with the initial images. Qualitative and quantitative evaluations were performed by using two extended cardiac-torso (XCAT) phantoms and two sets of patient data. Several state-of-the-art 4D CBCT algorithms were performed for comparison to validate the performance of the proposed method.

RESULTS

The image quality of phase-resolved images is greatly improved by the proposed method in both phantom and patient studies. The results show an outstanding spatial resolution, in which streaking artifacts are suppressed to a large extent, while detailed structures such as tumors and blood vessels are well restored. Meanwhile, the proposed method depicts a high temporal resolution with a distinct respiratory motion change at different phases. For simulation phantom, quantitative evaluations of the simulation data indicate that an average of 36.72% decrease at EI phase and 42% decrease at EE phase in terms of root-mean-square error (RMSE) are achieved by our method when comparing with PICCS algorithm in Phantom 1 and Phantom 2. In addition, the proposed method has the lowest entropy and the highest normalized mutual information compared with the existing methods in simulation experiments, such as PRI, RPCA-4DCT, SMART, and PICCS. And for real patient cases, the proposed method also achieves the lowest entropy value compared with the competitive method.

CONCLUSIONS

The proposed algorithm can generate an optimal initial image to improve iterative reconstruction performance. The final sequence of phase-resolved volumes guided by the initial image achieves high spatiotemporal resolution by eliminating motion-induced artifacts. This study presents a practical 4D CBCT reconstruction method with leading image quality.

Advanced 4-dimensional cone-beam computed tomography reconstruction by combining motion estimation, motion-compensated reconstruction, biomechanical modeling and deep learning

4-Dimensional cone-beam computed tomography (4D-CBCT) offers several key advantages over conventional 3D-CBCT in moving target localization/delineation, structure de-blurring, target motion tracking, treatment dose accumulation and adaptive radiation therapy. However, the use of the 4D-CBCT in current radiation therapy practices has been limited, mostly due to its sub-optimal image quality from limited angular sampling of cone-beam projections. In this study, we summarized the recent developments of 4D-CBCT reconstruction techniques for image quality improvement, and introduced our developments of a new 4D-CBCT reconstruction technique which features simultaneous motion estimation and image reconstruction (SMEIR). Based on the original SMEIR scheme, biomechanical modeling-guided SMEIR (SMEIR-Bio) was introduced to further improve the reconstruction accuracy of fine details in lung 4D-CBCTs. To improve the efficiency of reconstruction, we recently developed a U-net-based deformation-vector-field (DVF) optimization technique to leverage a population-based deep learning scheme to improve the accuracy of intra-lung DVFs (SMEIR-Unet), without explicit biomechanical modeling. Details of each of the SMEIR, SMEIR-Bio and SMEIR-Unet techniques were included in this study, along with the corresponding results comparing the reconstruction accuracy in terms of CBCT images and the DVFs. We also discussed the application prospects of the SMEIR-type techniques in image-guided radiation therapy and adaptive radiation therapy, and presented potential schemes on future developments to achieve faster and more accurate 4D-CBCT imaging.

Automatic large quantity landmark pairs detection in 4DCT lung images

PURPOSE

To automatically and precisely detect a large quantity of landmark pairs between two lung computed tomography (CT) images to support evaluation of deformable image registration (DIR). We expect that the generated landmark pairs will significantly augment the current lung CT benchmark datasets in both quantity and positional accuracy.

METHODS

A large number of landmark pairs were detected within the lung between the end-exhalation (EE) and end-inhalation (EI) phases of the lung four-dimensional computed tomography (4DCT) datasets. Thousands of landmarks were detected by applying the Harris-Stephens corner detection algorithm on the probability maps of the lung vasculature tree. A parametric image registration method (pTVreg) was used to establish initial landmark correspondence by registering the images at EE and EI phases. A multi-stream pseudo-siamese (MSPS) network was then developed to further improve the landmark pair positional accuracy by directly predicting three-dimensional (3D) shifts to optimally align the landmarks in EE to their counterparts in EI. Positional accuracies of the detected landmark pairs were evaluated using both digital phantoms and publicly available landmark pairs.

RESULTS

Dense sets of landmark pairs were detected for 10 4DCT lung datasets, with an average of 1886 landmark pairs per case. The mean and standard deviation of target registration error (TRE) were 0.47 ± 0.45 mm with 98% of landmark pairs having a TRE smaller than 2 mm for 10 digital phantom cases. Tests using 300 manually labeled landmark pairs in 10 lung 4DCT benchmark datasets (DIRLAB) produced TRE results of 0.73 ± 0.53 mm with 97% of landmark pairs having a TRE smaller than 2 mm.

CONCLUSION

A new method was developed to automatically and precisely detect a large quantity of landmark pairs between lung CT image pairs. The detected landmark pairs could be used as benchmark datasets for more accurate and informative quantitative evaluation of DIR algorithms.

Dosimetric evaluation of 4D-CBCT reconstructed by Simultaneous Motion Estimation and Image Reconstruction (SMEIR) for carbon ion therapy of lung cancer

PURPOSE

Motion management is critical for the efficacy of carbon ion therapy for moving targets such as lung tumors. We evaluated the feasibility of using four-dimensional cone beam computed tomography (4D-CBCT) reconstructed by Simultaneous Motion Estimation and Image Reconstruction (SMEIR) for dose calculation and accumulation in carbon ion treatment of lung cancer.

METHODS

Motion-compensated 4D-CBCT images were reconstructed with the SMEIR algorithm to capture the most updated anatomy and motion with an updated interphase motion model on the treatment day. Projections of all CBCT phases were simulated from the planning 4D-CT by the ray tracing technique. Treatment planning and dose calculation were performed with a GPU-based Monte Carlo dose calculation software for carbon ion therapy. The treatment plan was optimized on the average computed tomography (CT) to obtain optimal intensity of the carbon ions. From the optimized plan, dose distributions on individual phases of 4D-CT and 4D-CBCT were calculated by the Monte Carlo-based dose engine. Dose accumulation was performed on 4D-CBCT images using deformable vector fields (DVF) generated by SMEIR. The accumulated planning target volume (PTV) dose based on 4D-CBCT was then compared to the accumulated dose calculated on 4D-CT, where the DVFs between different phases were obtained by the demons deformable registration algorithm.

RESULTS

Dose value histograms (DVH) as well as absolute deviations of the maximum dose ( Δ D max ), mean dose ( Δ D mean ), and dose coverage metrics ( Δ V 95 % and Δ V 100 % ) for PTV were quantitatively evaluated for the two sets of plans. Good agreement was found between the 4D-CT and 4D-CBCT-based PTV-DVH curves. The average values of Δ D max , Δ D mean , Δ V 95 % , and Δ V 100 % calculated between the 4D-CT and SMEIR-4D-CBCT-based plans were 1.91 % , 3.55 % , 2.12%, and 1.15 % , respectively, for the PTVs of ten patient case studies.

CONCLUSIONS

Based on these results, SMEIR-reconstructed 4D-CBCTs can potentially be used for motion estimation, dose evaluation, and adaptive treatment planning in lung cancer carbon ion therapy.

SPARE: Sparse-view reconstruction challenge for 4D cone-beam CT from a 1-min scan

PURPOSE

Currently, four-dimensional (4D) cone-beam computed tomography (CBCT) requires a 3-4 min full-fan scan to ensure usable image quality. Recent advancements in sparse-view 4D-CBCT reconstruction have opened the possibility to reduce scan time and dose. The aim of this study is to provide a common framework for systematically evaluating algorithms for 4D-CBCT reconstruction from a 1-min scan. Using this framework, the AAPM-sponsored SPARE Challenge was conducted in 2018 to identify and compare state-of-the-art algorithms.

METHODS

A clinically realistic CBCT dataset was simulated using patient CT volumes from the 4D-Lung database. The selected patients had multiple 4D-CT sessions, where the first 4D-CT was used as the prior CT, and the rest were used as the ground truth volumes for simulating CBCT projections. A GPU-based Monte Carlo tool was used to simulate the primary, scatter, and quantum noise signals. A total of 32 CBCT scans of nine patients were generated. Additional qualitative analysis was performed on a clinical Varian and clinical Elekta dataset to validate the simulation study. Participants were blinded from the ground truth, and were given 3 months to apply their reconstruction algorithms to the projection data. The submitted reconstructions were analyzed in terms of root-mean-squared-error (RMSE) and structural similarity index (SSIM) with the ground truth within four different region-of-interests (ROI) - patient body, lungs, planning target volume (PTV), and bony anatomy. Geometric accuracy was quantified as the alignment error of the PTV.

RESULTS

Twenty teams participated in the challenge, with five teams completing the challenge. Techniques involved in the five methods included iterative optimization, motion-compensation, and deformation of the prior 4D-CT. All five methods rendered significant reduction in noise and streaking artifacts when compared to the conventional Feldkamp-Davis-Kress (FDK) algorithm. The RMS of the three-dimensional (3D) target registration error of the five methods ranged from 1.79 to 3.00 mm. Qualitative observations from the Varian and Elekta datasets mostly concur with those from the simulation dataset. Each of the methods was found to have its own strengths and weaknesses. Overall, the MA-ROOSTER method, which utilizes a 4D-CT motion model for temporal regularization, had the best and most consistent image quality and accuracy.

CONCLUSION

The SPARE Challenge represents the first framework for systematically evaluating state-of-the-art algorithms for 4D-CBCT reconstruction from a 1-min scan. Results suggest the potential for reducing scan time and dose for 4D-CBCT. The challenge dataset and analysis framework are publicly available for benchmarking future reconstruction algorithms.

Enhancing liver tumor localization accuracy by prior-knowledge-guided motion modeling and a biomechanical model

BACKGROUND

Pre-treatment liver tumor localization remains a challenging task for radiation therapy, mostly due to the limited tumor contrast against normal liver tissues, and the respiration-induced liver tumor motion. Recently, we developed a biomechanical modeling-based, deformation-driven cone-beam CT estimation technique (Bio-CBCT), which achieved substantially improved accuracy on low-contrast liver tumor localization. However, the accuracy of Bio-CBCT is still affected by the limited tissue contrast around the caudal liver boundary, which reduces the accuracy of the boundary condition that is fed into the biomechanical modeling process. In this study, we developed a motion modeling and biomechanical modeling-guided CBCT estimation technique (MM-Bio-CBCT), to further improve the liver tumor localization accuracy by incorporating a motion model into the CBCT estimation process.

METHODS

MM-Bio-CBCT estimates new CBCT images through deforming a prior high-quality CT or CBCT volume. The deformation vector field (DVF) is solved by iteratively matching the digitally-reconstructed-radiographs (DRRs) of the deformed prior image to the acquired 2D cone-beam projections. Using the same solved DVF, the liver tumor volume contoured on the prior image can be transferred onto the new CBCT image for automatic tumor localization. To maximize the accuracy of the solved DVF, MM-Bio-CBCT employs two strategies for additional DVF optimization: (I) prior-knowledge-guided liver boundary motion modeling with motion patterns extracted from a prior 4D imaging set like 4D-CTs/4D-CBCTs, to improve the liver boundary DVF accuracy; and (II) finite-element-analysis-based biomechanical modeling of the liver volume to improve the intra-liver DVF accuracy. We evaluated the accuracy of MM-Bio-CBCT on both the digital extended-cardiac-torso (XCAT) phantom images and real liver patient images. The liver tumor localization accuracy of MM-Bio-CBCT was evaluated and compared with that of the purely intensity-driven 2D-3D deformation technique, the 2D-3D deformation technique with motion modeling, and the Bio-CBCT technique. Metrics including the DICE coefficient and the center-of-mass-error (COME) were assessed for quantitative evaluation.

RESULTS

Using limited-view 20 projections for CBCT estimation, the average (± SD) DICE coefficients between the estimated and the 'gold-standard' liver tumors of the XCAT study were 0.57±0.31, 0.78±0.26, 0.83±0.21, and 0.89±0.11 for 2D-3D deformation, 2D-3D deformation with motion modeling, Bio-CBCT and MM-Bio-CBCT techniques, respectively. Using 20 projections for estimation, the patient study yielded average DICE results of 0.63±0.21, 0.73±0.13 and 0.78±0.12, and 0.83±0.09, correspondingly. The MM-Bio-CBCT localized the liver tumor to an average COME of ~2 mm for both the XCAT and the liver patient studies.

CONCLUSIONS

Compared to Bio-CBCT, MM-Bio-CBCT further improves the accuracy of liver tumor localization. MM-Bio-CBCT can potentially be used towards pre-treatment liver tumor localization and intra-treatment liver tumor location verification to achieve substantial radiotherapy margin reduction.

Reconstruction of a high-quality volumetric image and a respiratory motion model from patient CBCT projections

PURPOSE

To develop and evaluate a method of reconstructing a patient- and treatment day- specific volumetric image and motion model from free-breathing cone-beam projections and respiratory surrogate measurements. This Motion-Compensated Simultaneous Algebraic Reconstruction Technique (MC-SART) generates and uses a motion model derived directly from the cone-beam projections, without requiring prior motion measurements from 4DCT, and can compensate for both inter- and intrabin deformations. The motion model can be used to generate images at arbitrary breathing points, which can be used for estimating volumetric images during treatment delivery.

METHODS

The MC-SART was formulated using simultaneous image reconstruction and motion model estimation. For image reconstruction, projections were first binned according to external surrogate measurements. Projections in each bin were used to reconstruct a set of volumetric images using MC-SART. The motion model was estimated based on deformable image registration between the reconstructed bins, and least squares fitting to model parameters. The model was used to compensate for motion in both projection and backprojection operations in the subsequent image reconstruction iterations. These updated images were then used to update the motion model, and the two steps were alternated between. The final output is a volumetric reference image and a motion model that can be used to generate images at any other time point from surrogate measurements.

RESULTS

A retrospective patient dataset consisting of eight lung cancer patients was used to evaluate the method. The absolute intensity differences in the lung regions compared to ground truth were 50.8 ± 43.9 HU in peak exhale phases (reference) and 80.8 ± 74.0 in peak inhale phases (generated). The 50th percentile of voxel registration error of all voxels in the lung regions with >5 mm amplitude was 1.3 mm. The MC-SART was also applied to measured patient cone-beam projections acquired with a linac-mounted CBCT system. Results from this patient data demonstrate the feasibility of MC-SART and showed qualitative image quality improvements compared to other state-of-the-art algorithms.

CONCLUSION

We have developed a simultaneous image reconstruction and motion model estimation method that uses Cone-beam computed tomography (CBCT) projections and respiratory surrogate measurements to reconstruct a high-quality reference image and motion model of a patient in treatment position. The method provided superior performance in both HU accuracy and positional accuracy compared to other existing methods. The resultant reference image and motion model can be combined with respiratory surrogate measurements to generate volumetric images representing patient anatomy at arbitrary time points.

4D liver tumor localization using cone-beam projections and a biomechanical model

PURPOSE

To improve the accuracy of liver tumor localization, this study tests a biomechanical modeling-guided liver cone-beam CT (CBCT) estimation (Bio-CBCT-est) technique, which generates new CBCTs by deforming a prior high-quality CT or CBCT image using deformation vector fields (DVFs). The DVFs can be used to propagate tumor contours from the prior image to new CBCTs for automatic 4D tumor localization.

METHODS/MATERIALS

To solve the DVFs, the Bio-CBCT-est technique employs an iterative scheme that alternates between intensity-driven 2D-3D deformation and biomechanical modeling-guided DVF regularization and optimization. The 2D-3D deformation step solves DVFs by matching digitally reconstructed radiographs of the 3D deformed prior image to 2D phase-sorted on-board projections according to imaging intensities. This step's accuracy is limited at low-contrast intra-liver regions without sufficient intensity variations. To boost the DVF accuracy in these regions, we use the intensity-driven DVFs solved at higher-contrast liver boundaries to fine-tune the intra-liver DVFs by finite element analysis-based biomechanical modeling. We evaluated Bio-CBCT-est's accuracy with seven liver cancer patient cases. For each patient, we simulated 4D cone-beam projections from 4D-CT images, and used these projections for Bio-CBCT-est based image estimations. After Bio-CBCT-est, the DVF-propagated liver tumor/cyst contours were quantitatively compared with the manual contours on the original 4D-CT 'reference' images, using the DICE similarity index, the center-of-mass-error (COME), the Hausdorff distance (HD) and the voxel-wise cross-correlation (CC) metrics. In addition to simulation, we also performed a preliminary study to qualitatively evaluate the Bio-CBCT-est technique via clinically acquired cone beam projections. A quantitative study using an in-house deformable liver phantom was also performed.

RESULTS

Using 20 projections for image estimation, the average (±s.d.) DICE index increased from 0.48 ± 0.13 (by 2D-3D deformation) to 0.77 ± 0.08 (by Bio-CBCT-est), the average COME decreased from 7.7 ± 1.5 mm to 2.2 ± 1.2 mm, the average HD decreased from 10.6 ± 2.2 mm to 5.9 ± 2.0 mm, and the average CC increased from -0.004 ± 0.216 to 0.422 ± 0.206. The tumor/cyst trajectory solved by Bio-CBCT-est matched well with that manually obtained from 4D-CT reference images.

CONCLUSIONS

Bio-CBCT-est substantially improves the accuracy of 4D liver tumor localization via cone-beam projections and a biomechanical model.

A modified McKinnon-Bates (MKB) algorithm for improved 4D cone-beam computed tomography (CBCT) of the lung

PURPOSE

Four-dimensional (4D) cone-beam computed tomography (CBCT) of the lung is an effective tool for motion management in radiotherapy but presents a challenge because of slow gantry rotation times. Sorting the individual projections by breathing phase and using an established technique such as Feldkamp-Davis-Kress (FDK) to generate corresponding phase-correlated (PC) three-dimensional (3D) images results in reconstructions (FDK-PC) that often contain severe streaking artifacts due to the sparse angular sampling distributions. These can be reduced by further slowing down the gantry at the expense of incurring unwanted increases in scan times and dose. A computationally efficient alternative is the McKinnon-Bates (MKB) reconstruction algorithm that has shown promise in reducing view aliasing-induced streaking but can produce ghosting artifacts that reduce contrast and impede the determination of motion trajectories. The purpose of this work was to identify and correct shortcomings in the MKB algorithm.

METHODS

In the general MKB approach, a time-averaged 3D prior image is first reconstructed. The prior is then forward-projected at the same angles as the original projection data creating time-averaged reprojections. These reprojections are subsequently subtracted from the original (unblurred) projections to create motion-encoded difference projections. The difference projections are reconstructed into PC difference images that are added to the well-sampled 3D prior to create the higher quality 4D image. The cause of the ghosting in the traditional 4D MKB images was studied and traced to motion-induced streaking in the prior that, when reprojected, has the undesirable effect of re-encoding for motion in what should be a purely time-averaged reprojection. A new method, designated as the modified McKinnon-Bates (mMKB) algorithm, was developed based on destreaking the prior. This was coupled with a postprocessing 4D bilateral filter for noise suppression and edge preservation (mMKBbf ). The algorithms were tested with the 4D XCAT phantom using four simulated scan times (57, 60, 120, 180 s) and with two in vivo thorax studies (acquisition time of 60 and 90 s). Contrast-to-noise ratios (CNRs) of the target lesions and overall visual quality of the images were assessed.

RESULTS

Prior destreaking (mMKB algorithm) reduced ghosting artifacts and increased CNRs for all cases, with the biggest impacts seen in the end inhale (EI) and end exhale (EE) phases of the respiratory cycle. For the XCAT phantom, mMKB lesion CNR was 44% higher than the MKB lesion CNR and was 81% higher than the FDK-PC lesion CNR (EI and EE phases). The bilateral filter provided a further average CNR improvement of 87% with the highest increases associated with longer scan times. Across all phases and scan times, the maximum mMKBbf -to-FDK-PC CNR improvement was over 300%. In vivo results agreed with XCAT results. Significantly less ghosting was observed throughout the mMKB images including near the lesions-of-interest and the diaphragm allowing for, in one case, visualization of a small tumor with nearly 30 mm of motion. The maximum FDK-PC-to-MKBbf CNR improvement for Patient 1's lesion was 261% and for Patient 2's lesion was 318%.

CONCLUSIONS

The 4D mMKB algorithm yields good quality coronal and sagittal images in the thorax that may provide sufficient information for patient verification.

Quantitative 4D-PET reconstruction for small animal using SMEIR-reconstructed 4D-CBCT

Respiratory motions in small animals PET cause image degradation during reconstruction. This work aims to develop a motion compensated 4D-PET reconstruction method using accurate motion corrections and attenuation corrections from 4D-CBCT images reconstructed using a simultaneous motion estimation and image reconstruction (SMEIR) method. Projections of 4D-CBCT were calculated using a ray-tracing method on a digital 4D rat phantom, and list-mode data of 4D-PET with matched respiratory phases were simulated using the GATE Monte Carlo package. The respiratory rate was set at 1.0 second per cycle with 10 phases of 30 projection images each. 4D-CBCT images were reconstructed using the SMEIR method and motion information and linear attenuation from 4D-CBCT were subsequently used for motion compensated 4D-PET reconstruction and attenuation corrections. We quantitatively evaluate the reconstructed 4D-PET using the errors of tumor volume and standard uptake values of tumors with different sizes. The tumor motion was successfully reconstructed and showed good agreement with the original phantom. The proposed method reduced tumor volume errors and standard uptake value errors. For tumor diameters of 3.0, 4.5, and 6.0 mm, the tumor volume errors are 32.5%, 29.2% and 19.4% respectively with motion compensation and 45.1%, 37.5% and 20.2% respectively without compensation.

Fast 4D cone-beam CT from 60 s acquisitions

Background & purpose

Four dimensional Cone beam CT (CBCT) has many potential benefits for radiotherapy but suffers from poor image quality, long acquisition times, and/or long reconstruction times. In this work we present a fast iterative reconstruction algorithm for 4D reconstruction of fast acquisition cone beam CT, as well as a new method for temporal regularization and compare to state of the art methods for 4D CBCT.

Materials & methods

Regularization parameters for the iterative algorithms were found automatically via computer optimization on 60 s acquisitions using the XCAT phantom. Nineteen lung cancer patients were scanned with 60 s arcs using the onboard image on a Varian trilogy linear accelerator. Images were reconstructed using an accelerated ordered subset algorithm. A frequency based temporal regularization algorithm was developed and compared to the McKinnon-Bates algorithm, 4D total variation and prior images compressed sensing (PICCS).

Results

All reconstructions were completed in 60 s or less. The proposed method provided a structural similarity of 0.915, compared with 0.786 for the classic McKinnon-bates method. For the patient study, it provided fewer image artefacts than PICCS, and better spatial resolution than 4D TV.

Conclusion

Four dimensional iterative CBCT reconstruction was done in less than 60 s, demonstrating the clinical feasibility. The frequency based method outperformed 4D total variation and PICCS on the simulated data, and for patients allowed for tumor location based on 60 s acquisitions, even for slowly breathing patients. It should thus be suitable for routine clinical use.

Iterative reconstruction with boundary detection for carbon ion computed tomography

In heavy ion radiation therapy, improving the accuracy in range prediction of the ions inside the patient's body has become essential. Accurate localization of the Bragg peak provides greater conformity of the tumor while sparing healthy tissues. We investigated the use of carbon ions directly for computed tomography (carbon CT) to create the relative stopping power map of a patient's body. The Geant4 toolkit was used to perform a Monte Carlo simulation of the carbon ion trajectories, to study their lateral and angular deflections and the most likely paths, using a water phantom. Geant4 was used to create carbonCT projections of a contrast and spatial resolution phantom, with a cone beam of 430 MeV/u carbon ions. The contrast phantom consisted of cranial bone, lung material, and PMMA inserts while the spatial resolution phantom contained bone and lung material inserts with line pair (lp) densities ranging from 1.67 lp cm^-1 through 5 lp cm^-1. First, the positions of each carbon ion on the rear and front trackers were used for an approximate reconstruction of the phantom. The phantom boundary was extracted from this approximate reconstruction, by using the position as well as angle information from the four tracking detectors, resulting in the entry and exit locations of the individual ions on the phantom surface. Subsequent reconstruction was performed by the iterative algebraic reconstruction technique coupled with total variation minimization (ART-TV) assuming straight line trajectories for the ions inside the phantom. The influence of number of projections was studied with reconstruction from five different sets of projections: 15, 30, 45, 60 and 90. Additionally, the effect of number of ions on the image quality was investigated by reducing the number of ions/projection while keeping the total number of projections at 60. An estimation of carbon ion range using the carbonCT image resulted in improved range prediction compared to the range calculated using a calibration curve.

A biomechanical modeling-guided simultaneous motion estimation and image reconstruction technique (SMEIR-Bio) for 4D-CBCT reconstruction

Reconstructing four-dimensional cone-beam computed tomography (4D-CBCT) images directly from respiratory phase-sorted traditional 3D-CBCT projections can capture target motion trajectory, reduce motion artifacts, and reduce imaging dose and time. However, the limited numbers of projections in each phase after phase-sorting decreases CBCT image quality under traditional reconstruction techniques. To address this problem, we developed a simultaneous motion estimation and image reconstruction (SMEIR) algorithm, an iterative method that can reconstruct higher quality 4D-CBCT images from limited projections using an inter-phase intensity-driven motion model. However, the accuracy of the intensity-driven motion model is limited in regions with fine details whose quality is degraded due to insufficient projection number, which consequently degrades the reconstructed image quality in corresponding regions. In this study, we developed a new 4D-CBCT reconstruction algorithm by introducing biomechanical modeling into SMEIR (SMEIR-Bio) to boost the accuracy of the motion model in regions with small fine structures. The biomechanical modeling uses tetrahedral meshes to model organs of interest and solves internal organ motion using tissue elasticity parameters and mesh boundary conditions. This physics-driven approach enhances the accuracy of solved motion in the organ's fine structures regions. This study used 11 lung patient cases to evaluate the performance of SMEIR-Bio, making both qualitative and quantitative comparisons between SMEIR-Bio, SMEIR, and the algebraic reconstruction technique with total variation regularization (ART-TV). The reconstruction results suggest that SMEIR-Bio improves the motion model's accuracy in regions containing small fine details, which consequently enhances the accuracy and quality of the reconstructed 4D-CBCT images.

A fast 4D cone beam CT reconstruction method based on the OSC-TV algorithm

BACKGROUND

Four-dimensional cone beam computed tomography allows for temporally resolved imaging with useful applications in radiotherapy, but raises particular challenges in terms of image quality and computation time.

OBJECTIVE

The purpose of this work is to develop a fast and accurate 4D algorithm by adapting a GPU-accelerated ordered subsets convex algorithm (OSC), combined with the total variation minimization regularization technique (TV).

METHODS

Different initialization schemes were studied to adapt the OSC-TV algorithm to 4D reconstruction: each respiratory phase was initialized either with a 3D reconstruction or a blank image. Reconstruction algorithms were tested on a dynamic numerical phantom and on a clinical dataset. 4D iterations were implemented for a cluster of 8 GPUs.

RESULTS

All developed methods allowed for an adequate visualization of the respiratory movement and compared favorably to the McKinnon-Bates and adaptive steepest descent projection onto convex sets algorithms, while the 4D reconstructions initialized from a prior 3D reconstruction led to better overall image quality.

CONCLUSION

The most suitable adaptation of OSC-TV to 4D CBCT was found to be a combination of a prior FDK reconstruction and a 4D OSC-TV reconstruction with a reconstruction time of 4.5 minutes. This relatively short reconstruction time could facilitate a clinical use.

A method to detect landmark pairs accurately between intra-patient volumetric medical images

PURPOSES

An image processing procedure was developed in this study to detect large quantity of landmark pairs accurately in pairs of volumetric medical images. The detected landmark pairs can be used to evaluate of deformable image registration (DIR) methods quantitatively.

METHODS

Landmark detection and pair matching were implemented in a Gaussian pyramid multi-resolution scheme. A 3D scale-invariant feature transform (SIFT) feature detection method and a 3D Harris-Laplacian corner detection method were employed to detect feature points, i.e., landmarks. A novel feature matching algorithm, Multi-Resolution Inverse-Consistent Guided Matching or MRICGM, was developed to allow accurate feature pairs matching. MRICGM performs feature matching using guidance by the feature pairs detected at the lower resolution stage and the higher confidence feature pairs already detected at the same resolution stage, while enforces inverse consistency.

RESULTS

The proposed feature detection and feature pair matching algorithms were optimized to process 3D CT and MRI images. They were successfully applied between the inter-phase abdomen 4DCT images of three patients, between the original and the re-scanned radiation therapy simulation CT images of two head-neck patients, and between inter-fractional treatment MRIs of two patients. The proposed procedure was able to successfully detect and match over 6300 feature pairs on average. The automatically detected landmark pairs were manually verified and the mismatched pairs were rejected. The automatic feature matching accuracy before manual error rejection was 99.4%. Performance of MRICGM was also evaluated using seven digital phantom datasets with known ground truth of tissue deformation. On average, 11855 feature pairs were detected per digital phantom dataset with TRE = 0.77 ± 0.72 mm.

CONCLUSION

A procedure was developed in this study to detect large number of landmark pairs accurately between two volumetric medical images. It allows a semi-automatic way to generate the ground truth landmark datasets that allow quantitatively evaluation of DIR algorithms for radiation therapy applications.

Prognostic factors associated with the accuracy of deformable image registration in lung cancer patients treated with stereotactic body radiotherapy

We evaluated the accuracy of an in-house program in lung stereotactic body radiation therapy (SBRT) cancer patients, and explored the prognostic factors associated with the accuracy of deformable image registrations (DIRs). The accuracy of the 3 programs which implement the free-form deformation and the B-spline algorithm was compared regarding the structures on 4-dimensional computed tomography (4DCT) image datasets between the peak-inhale and peak-exhale phases. The dice similarity coefficient (DSC) and normalized DSC (NDSC) were measured for the gross tumor volumes from 19 lung SBRT patients. We evaluated the accuracy of DIR using gross tumor volume, magnitude of displacement from 0% phase to 50% phase, whole lung volume in the 50% phase image, and status of tumor pleural attachment. The median NDSC values using the NiftyReg, MIM Maestro and Velocity AI programs were 1.027, 1.005, and 0.946, respectively, indicating that NiftyReg and MIM Maestro programs had similar accuracy with an uncertainty of < 1 mm. Larger uncertainty of 1 to 2 mm was observed using the Velocity AI program. The NiftyReg and the MIM programs provided higher NDSC values than the median values when the gross tumor volume was attached to the pleura (p <0.05). However, it showed a different trend in using the Velocity AI program. All software programs provided unexpected results, and there is a possibility that such results would reduce the accuracy of 4D treatment planning and adaptive radiotherapy. The unexpected results may be because the tumors are surrounded by other tissues, and there are differences regarding the region of interest for rigid and nonrigid registration. Furthermore, our results indicated that the pleural attachment status might be an important predictor of DIR accuracy for thoracic images, indicating that there is a potentially large dose distribution discrepancy concerning 4D treatment planning and adaptive radiotherapy.

Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132

Image registration and fusion algorithms exist in almost every software system that creates or uses images in radiotherapy. Most treatment planning systems support some form of image registration and fusion to allow the use of multimodality and time-series image data and even anatomical atlases to assist in target volume and normal tissue delineation. Treatment delivery systems perform registration and fusion between the planning images and the in-room images acquired during the treatment to assist patient positioning. Advanced applications are beginning to support daily dose assessment and enable adaptive radiotherapy using image registration and fusion to propagate contours and accumulate dose between image data taken over the course of therapy to provide up-to-date estimates of anatomical changes and delivered dose. This information aids in the detection of anatomical and functional changes that might elicit changes in the treatment plan or prescription. As the output of the image registration process is always used as the input of another process for planning or delivery, it is important to understand and communicate the uncertainty associated with the software in general and the result of a specific registration. Unfortunately, there is no standard mathematical formalism to perform this for real-world situations where noise, distortion, and complex anatomical variations can occur. Validation of the software systems performance is also complicated by the lack of documentation available from commercial systems leading to use of these systems in undesirable 'black-box' fashion. In view of this situation and the central role that image registration and fusion play in treatment planning and delivery, the Therapy Physics Committee of the American Association of Physicists in Medicine commissioned Task Group 132 to review current approaches and solutions for image registration (both rigid and deformable) in radiotherapy and to provide recommendations for quality assurance and quality control of these clinical processes.

A new CT reconstruction technique using adaptive deformation recovery and intensity correction (ADRIC)

PURPOSE

Sequential same-patient CT images may involve deformation-induced and non-deformation-induced voxel intensity changes. An adaptive deformation recovery and intensity correction (ADRIC) technique was developed to improve the CT reconstruction accuracy, and to separate deformation from non-deformation-induced voxel intensity changes between sequential CT images.

MATERIALS AND METHODS

ADRIC views the new CT volume as a deformation of a prior high-quality CT volume, but with additional non-deformation-induced voxel intensity changes. ADRIC first applies the 2D-3D deformation technique to recover the deformation field between the prior CT volume and the new, to-be-reconstructed CT volume. Using the deformation-recovered new CT volume, ADRIC further corrects the non-deformation-induced voxel intensity changes with an updated algebraic reconstruction technique ("ART-dTV"). The resulting intensity-corrected new CT volume is subsequently fed back into the 2D-3D deformation process to further correct the residual deformation errors, which forms an iterative loop. By ADRIC, the deformation field and the non-deformation voxel intensity corrections are optimized separately and alternately to reconstruct the final CT. CT myocardial perfusion imaging scenarios were employed to evaluate the efficacy of ADRIC, using both simulated data of the extended-cardiac-torso (XCAT) digital phantom and experimentally acquired porcine data. The reconstruction accuracy of the ADRIC technique was compared to the technique using ART-dTV alone, and to the technique using 2D-3D deformation alone. The relative error metric and the universal quality index metric are calculated between the images for quantitative analysis. The relative error is defined as the square root of the sum of squared voxel intensity differences between the reconstructed volume and the "ground-truth" volume, normalized by the square root of the sum of squared "ground-truth" voxel intensities. In addition to the XCAT and porcine studies, a physical lung phantom measurement study was also conducted. Water-filled balloons with various shapes/volumes and concentrations of iodinated contrasts were put inside the phantom to simulate both deformations and non-deformation-induced intensity changes for ADRIC reconstruction. The ADRIC-solved deformations and intensity changes from limited-view projections were compared to those of the "gold-standard" volumes reconstructed from fully sampled projections.

RESULTS

For the XCAT simulation study, the relative errors of the reconstructed CT volume by the 2D-3D deformation technique, the ART-dTV technique, and the ADRIC technique were 14.64%, 19.21%, and 11.90% respectively, by using 20 projections for reconstruction. Using 60 projections for reconstruction reduced the relative errors to 12.33%, 11.04%, and 7.92% for the three techniques, respectively. For the porcine study, the corresponding results were 13.61%, 8.78%, and 6.80% by using 20 projections; and 12.14%, 6.91%, and 5.29% by using 60 projections. The ADRIC technique also demonstrated robustness to varying projection exposure levels. For the physical phantom study, the average DICE coefficient between the initial prior balloon volume and the new "gold-standard" balloon volumes was 0.460. ADRIC reconstruction by 21 projections increased the average DICE coefficient to 0.954.

CONCLUSION

The ADRIC technique outperformed both the 2D-3D deformation technique and the ART-dTV technique in reconstruction accuracy. The alternately solved deformation field and non-deformation voxel intensity corrections can benefit multiple clinical applications, including tumor tracking, radiotherapy dose accumulation, and treatment outcome analysis.

Estimating 4D-CBCT from prior information and extremely limited angle projections using structural PCA and weighted free-form deformation for lung radiotherapy

PURPOSE

To investigate the feasibility of using structural-based principal component analysis (PCA) motion-modeling and weighted free-form deformation to estimate on-board 4D-CBCT using prior information and extremely limited angle projections for potential 4D target verification of lung radiotherapy.

METHODS

A technique for lung 4D-CBCT reconstruction has been previously developed using a deformation field map (DFM)-based strategy. In the previous method, each phase of the 4D-CBCT was generated by deforming a prior CT volume. The DFM was solved by a motion model extracted by a global PCA and free-form deformation (GMM-FD) technique, using a data fidelity constraint and deformation energy minimization. In this study, a new structural PCA method was developed to build a structural motion model (SMM) by accounting for potential relative motion pattern changes between different anatomical structures from simulation to treatment. The motion model extracted from planning 4DCT was divided into two structures: tumor and body excluding tumor, and the parameters of both structures were optimized together. Weighted free-form deformation (WFD) was employed afterwards to introduce flexibility in adjusting the weightings of different structures in the data fidelity constraint based on clinical interests. XCAT (computerized patient model) simulation with a 30 mm diameter lesion was simulated with various anatomical and respiratory changes from planning 4D-CT to on-board volume to evaluate the method. The estimation accuracy was evaluated by the volume percent difference (VPD)/center-of-mass-shift (COMS) between lesions in the estimated and "ground-truth" on-board 4D-CBCT. Different on-board projection acquisition scenarios and projection noise levels were simulated to investigate their effects on the estimation accuracy. The method was also evaluated against three lung patients.

RESULTS

The SMM-WFD method achieved substantially better accuracy than the GMM-FD method for CBCT estimation using extremely small scan angles or projections. Using orthogonal 15° scanning angles, the VPD/COMS were 3.47 ± 2.94% and 0.23 ± 0.22 mm for SMM-WFD and 25.23 ± 19.01% and 2.58 ± 2.54 mm for GMM-FD among all eight XCAT scenarios. Compared to GMM-FD, SMM-WFD was more robust against reduction of the scanning angles down to orthogonal 10° with VPD/COMS of 6.21 ± 5.61% and 0.39 ± 0.49 mm, and more robust against reduction of projection numbers down to only 8 projections in total for both orthogonal-view 30° and orthogonal-view 15° scan angles. SMM-WFD method was also more robust than the GMM-FD method against increasing levels of noise in the projection images. Additionally, the SMM-WFD technique provided better tumor estimation for all three lung patients compared to the GMM-FD technique.

CONCLUSION

Compared to the GMM-FD technique, the SMM-WFD technique can substantially improve the 4D-CBCT estimation accuracy using extremely small scan angles and low number of projections to provide fast low dose 4D target verification.

Simultaneous 4D-CBCT reconstruction with sliding motion constraint

PURPOSE

Current approaches using deformable vector field (DVF) for motion-compensated 4D-cone beam CT (CBCT) reconstruction typically utilize an isotropically smoothed DVF between different respiration phases. Such isotropically smoothed DVF does not work well if sliding motion exists between neighboring organs. This study investigated an anisotropic motion modeling scheme by extracting organ boundary local motions (e.g., sliding) and incorporated them into 4D-CBCT reconstruction to optimize the motion modeling and reconstruction methods.

METHODS

Initially, a modified simultaneous algebraic reconstruction technique (mSART) was applied to reconstruct high quality reference phase CBCT using all phase projections. The initial DVFs were precalculated and subsequently updated to achieve the optimized solution. During the DVF update, sliding motion estimation was performed by matching the measured projections to the forward projection of the deformed reference phase CBCT. In this process, each moving organ boundary was first segmented. The normal vectors of the boundary DVF were then extracted and incorporated for further DVF optimization. The regularization term in the objective function adaptively regularizes the DVF by (1) isotopically smoothing the DVF within each organ; (2) smoothing the DVF at boundary along the normal direction; and (3) leaving the tangent direction of boundary DVF unsmoothed (i.e., allowing for sliding motion). A nonlinear conjugate gradient optimizer was used. The algorithm was validated on a digital cubic tube phantom with sliding motion, nonuniform rotational B-spline based cardiac-torso (NCAT) phantom, and two anonymized patient data. The relative reconstruction error (RE), the motion trajectory's root mean square error (RMSE) together with its maximum error (MaxE), and the Dice coefficient of the lung boundary were calculated to evaluate the algorithm performance.

RESULTS

For the cubic tube and NCAT phantom tests, the REs are 10.2% and 7.4% with sliding motion compensation, compared to 13.4% and 8.9% without sliding modeling. The motion trajectory's RMSE and MaxE for NCAT phantom tests are 0.5 and 0.8 mm with sliding motion constraint compared to 3.5 and 7.3 mm without sliding motion modeling. The Dice coefficients for both NCAT phantom and the patients show a consistent trend that sliding motion constraint achieves better similarity for segmented lung boundary compared with the ground truth or patient reference.

CONCLUSIONS

A sliding motion-compensated 4D-CBCT reconstruction and the motion modeling scheme was developed. Both phantom and patient study demonstrated the improved accuracy and motion modeling accuracy in reconstructed 4D-CBCT.

A Biomechanical Modeling Guided CBCT Estimation Technique

Two-dimensional-to-three-dimensional (2D-3D) deformation has emerged as a new technique to estimate cone-beam computed tomography (CBCT) images. The technique is based on deforming a prior high-quality 3D CT/CBCT image to form a new CBCT image, guided by limited-view 2D projections. The accuracy of this intensity-based technique, however, is often limited in low-contrast image regions with subtle intensity differences. The solved deformation vector fields (DVFs) can also be biomechanically unrealistic. To address these problems, we have developed a biomechanical modeling guided CBCT estimation technique (Bio-CBCT-est) by combining 2D-3D deformation with finite element analysis (FEA)-based biomechanical modeling of anatomical structures. Specifically, Bio-CBCT-est first extracts the 2D-3D deformation-generated displacement vectors at the high-contrast anatomical structure boundaries. The extracted surface deformation fields are subsequently used as the boundary conditions to drive structure-based FEA to correct and fine-tune the overall deformation fields, especially those at low-contrast regions within the structure. The resulting FEA-corrected deformation fields are then fed back into 2D-3D deformation to form an iterative loop, combining the benefits of intensity-based deformation and biomechanical modeling for CBCT estimation. Using eleven lung cancer patient cases, the accuracy of the Bio-CBCT-est technique has been compared to that of the 2D-3D deformation technique and the traditional CBCT reconstruction techniques. The accuracy was evaluated in the image domain, and also in the DVF domain through clinician-tracked lung landmarks.

Motion-aware temporal regularization for improved 4D cone-beam computed tomography

Four-dimensional cone-beam computed tomography (4D-CBCT) of the free-breathing thorax is a valuable tool in image-guided radiation therapy of the thorax and the upper abdomen. It allows the determination of the position of a tumor throughout the breathing cycle, while only its mean position can be extracted from three-dimensional CBCT. The classical approaches are not fully satisfactory: respiration-correlated methods allow one to accurately locate high-contrast structures in any frame, but contain strong streak artifacts unless the acquisition is significantly slowed down. Motion-compensated methods can yield streak-free, but static, reconstructions. This work proposes a 4D-CBCT method that can be seen as a trade-off between respiration-correlated and motion-compensated reconstruction. It builds upon the existing reconstruction using spatial and temporal regularization (ROOSTER) and is called motion-aware ROOSTER (MA-ROOSTER). It performs temporal regularization along curved trajectories, following the motion estimated on a prior 4D CT scan. MA-ROOSTER does not involve motion-compensated forward and back projections: the input motion is used only during temporal regularization. MA-ROOSTER is compared to ROOSTER, motion-compensated Feldkamp-Davis-Kress (MC-FDK), and two respiration-correlated methods, on CBCT acquisitions of one physical phantom and two patients. It yields streak-free reconstructions, visually similar to MC-FDK, and robust information on tumor location throughout the breathing cycle. MA-ROOSTER also allows a variation of the lung tissue density during the breathing cycle, similar to that of planning CT, which is required for quantitative post-processing.

A promising limited angular computed tomography reconstruction via segmentation based regional enhancement and total variation minimization

X-ray computed tomography (CT) is a powerful and common inspection technique used for the industrial non-destructive testing. However, large-sized and heavily absorbing objects cause the formation of artifacts because of either the lack of specimen penetration in specific directions or the acquisition of data from only a limited angular range of views. Although the sparse optimization-based methods, such as the total variation (TV) minimization method, can suppress artifacts to some extent, reconstructing the images such that they converge to accurate values remains difficult because of the deficiency in continuous angular data and inconsistency in the projections. To address this problem, we use the idea of regional enhancement of the true values and suppression of the illusory artifacts outside the region to develop an efficient iterative algorithm. This algorithm is based on the combination of regional enhancement of the true values and TV minimization for the limited angular reconstruction. In this algorithm, the segmentation approach is introduced to distinguish the regions of different image knowledge and generate the support mask of the image. A new regularization term, which contains the support knowledge to enhance the true values of the image, is incorporated into the objective function. Then, the proposed optimization model is solved by variable splitting and the alternating direction method efficiently. A compensation approach is also designed to extract useful information from the initial projections and thus reduce false segmentation result and correct the segmentation support and the segmented image. The results obtained from comparing both simulation studies and real CT data set reconstructions indicate that the proposed algorithm generates a more accurate image than do the other reconstruction methods. The experimental results show that this algorithm can produce high-quality reconstructed images for the limited angular reconstruction and suppress the illusory artifacts caused by the deficiency in valid data.

Respiratory motion correction in 4D-PET by simultaneous motion estimation and image reconstruction (SMEIR)

In conventional 4D positron emission tomography (4D-PET), images from different frames are reconstructed individually and aligned by registration methods. Two issues that arise with this approach are as follows: (1) the reconstruction algorithms do not make full use of projection statistics; and (2) the registration between noisy images can result in poor alignment. In this study, we investigated the use of simultaneous motion estimation and image reconstruction (SMEIR) methods for motion estimation/correction in 4D-PET. A modified ordered-subset expectation maximization algorithm coupled with total variation minimization (OSEM-TV) was used to obtain a primary motion-compensated PET (pmc-PET) from all projection data, using Demons derived deformation vector fields (DVFs) as initial motion vectors. A motion model update was performed to obtain an optimal set of DVFs in the pmc-PET and other phases, by matching the forward projection of the deformed pmc-PET with measured projections from other phases. The OSEM-TV image reconstruction was repeated using updated DVFs, and new DVFs were estimated based on updated images. A 4D-XCAT phantom with typical FDG biodistribution was generated to evaluate the performance of the SMEIR algorithm in lung and liver tumors with different contrasts and different diameters (10-40 mm). The image quality of the 4D-PET was greatly improved by the SMEIR algorithm. When all projections were used to reconstruct 3D-PET without motion compensation, motion blurring artifacts were present, leading up to 150% tumor size overestimation and significant quantitative errors, including 50% underestimation of tumor contrast and 59% underestimation of tumor uptake. Errors were reduced to less than 10% in most images by using the SMEIR algorithm, showing its potential in motion estimation/correction in 4D-PET.

Dosimetric verification of lung cancer treatment using the CBCTs estimated from limited-angle on-board projections

PURPOSE

Lung cancer treatment is susceptible to treatment errors caused by interfractional anatomical and respirational variations of the patient. On-board treatment dose verification is especially critical for the lung stereotactic body radiation therapy due to its high fractional dose. This study investigates the feasibility of using cone-beam (CB)CT images estimated by a motion modeling and free-form deformation (MM-FD) technique for on-board dose verification.

METHODS

Both digital and physical phantom studies were performed. Various interfractional variations featuring patient motion pattern change, tumor size change, and tumor average position change were simulated from planning CT to on-board images. The doses calculated on the planning CT (planned doses), the on-board CBCT estimated by MM-FD (MM-FD doses), and the on-board CBCT reconstructed by the conventional Feldkamp-Davis-Kress (FDK) algorithm (FDK doses) were compared to the on-board dose calculated on the "gold-standard" on-board images (gold-standard doses). The absolute deviations of minimum dose (ΔDmin), maximum dose (ΔDmax), and mean dose (ΔDmean), and the absolute deviations of prescription dose coverage (ΔV100%) were evaluated for the planning target volume (PTV). In addition, 4D on-board treatment dose accumulations were performed using 4D-CBCT images estimated by MM-FD in the physical phantom study. The accumulated doses were compared to those measured using optically stimulated luminescence (OSL) detectors and radiochromic films.

RESULTS

Compared with the planned doses and the FDK doses, the MM-FD doses matched much better with the gold-standard doses. For the digital phantom study, the average (± standard deviation) ΔDmin, ΔDmax, ΔDmean, and ΔV100% (values normalized by the prescription dose or the total PTV) between the planned and the gold-standard PTV doses were 32.9% (±28.6%), 3.0% (±2.9%), 3.8% (±4.0%), and 15.4% (±12.4%), respectively. The corresponding values of FDK PTV doses were 1.6% (±1.9%), 1.2% (±0.6%), 2.2% (±0.8%), and 17.4% (±15.3%), respectively. In contrast, the corresponding values of MM-FD PTV doses were 0.3% (±0.2%), 0.9% (±0.6%), 0.6% (±0.4%), and 1.0% (±0.8%), respectively. Similarly, for the physical phantom study, the average ΔDmin, ΔDmax, ΔDmean, and ΔV100% of planned PTV doses were 38.1% (±30.8%), 3.5% (±5.1%), 3.0% (±2.6%), and 8.8% (±8.0%), respectively. The corresponding values of FDK PTV doses were 5.8% (±4.5%), 1.6% (±1.6%), 2.0% (±0.9%), and 9.3% (±10.5%), respectively. In contrast, the corresponding values of MM-FD PTV doses were 0.4% (±0.8%), 0.8% (±1.0%), 0.5% (±0.4%), and 0.8% (±0.8%), respectively. For the 4D dose accumulation study, the average (± standard deviation) absolute dose deviation (normalized by local doses) between the accumulated doses and the OSL measured doses was 3.3% (±2.7%). The average gamma index (3%/3 mm) between the accumulated doses and the radiochromic film measured doses was 94.5% (±2.5%).

CONCLUSIONS

MM-FD estimated 4D-CBCT enables accurate on-board dose calculation and accumulation for lung radiation therapy. It can potentially be valuable for treatment quality assessment and adaptive radiation therapy.

3D-2D Deformable Image Registration Using Feature-Based Nonuniform Meshes

By using prior information of planning CT images and feature-based nonuniform meshes, this paper demonstrates that volumetric images can be efficiently registered with a very small portion of 2D projection images of a Cone-Beam Computed Tomography (CBCT) scan. After a density field is computed based on the extracted feature edges from planning CT images, nonuniform tetrahedral meshes will be automatically generated to better characterize the image features according to the density field; that is, finer meshes are generated for features. The displacement vector fields (DVFs) are specified at the mesh vertices to drive the deformation of original CT images. Digitally reconstructed radiographs (DRRs) of the deformed anatomy are generated and compared with corresponding 2D projections. DVFs are optimized to minimize the objective function including differences between DRRs and projections and the regularity. To further accelerate the above 3D-2D registration, a procedure to obtain good initial deformations by deforming the volume surface to match 2D body boundary on projections has been developed. This complete method is evaluated quantitatively by using several digital phantoms and data from head and neck cancer patients. The feature-based nonuniform meshing method leads to better results than either uniform orthogonal grid or uniform tetrahedral meshes.

3D fluoroscopic image estimation using patient-specific 4DCBCT-based motion models

3D fluoroscopic images represent volumetric patient anatomy during treatment with high spatial and temporal resolution. 3D fluoroscopic images estimated using motion models built using 4DCT images, taken days or weeks prior to treatment, do not reliably represent patient anatomy during treatment. In this study we developed and performed initial evaluation of techniques to develop patient-specific motion models from 4D cone-beam CT (4DCBCT) images, taken immediately before treatment, and used these models to estimate 3D fluoroscopic images based on 2D kV projections captured during treatment. We evaluate the accuracy of 3D fluoroscopic images by comparison to ground truth digital and physical phantom images. The performance of 4DCBCT-based and 4DCT-based motion models are compared in simulated clinical situations representing tumor baseline shift or initial patient positioning errors. The results of this study demonstrate the ability for 4DCBCT imaging to generate motion models that can account for changes that cannot be accounted for with 4DCT-based motion models. When simulating tumor baseline shift and patient positioning errors of up to 5 mm, the average tumor localization error and the 95th percentile error in six datasets were 1.20 and 2.2 mm, respectively, for 4DCBCT-based motion models. 4DCT-based motion models applied to the same six datasets resulted in average tumor localization error and the 95th percentile error of 4.18 and 5.4 mm, respectively. Analysis of voxel-wise intensity differences was also conducted for all experiments. In summary, this study demonstrates the feasibility of 4DCBCT-based 3D fluoroscopic image generation in digital and physical phantoms and shows the potential advantage of 4DCBCT-based 3D fluoroscopic image estimation when there are changes in anatomy between the time of 4DCT imaging and the time of treatment delivery.

A method for volumetric imaging in radiotherapy using single x-ray projection

PURPOSE

It is an intriguing problem to generate an instantaneous volumetric image based on the corresponding x-ray projection. The purpose of this study is to develop a new method to achieve this goal via a sparse learning approach.

METHODS

To extract motion information hidden in projection images, the authors partitioned a projection image into small rectangular patches. The authors utilized a sparse learning method to automatically select patches that have a high correlation with principal component analysis (PCA) coefficients of a lung motion model. A model that maps the patch intensity to the PCA coefficients was built along with the patch selection process. Based on this model, a measured projection can be used to predict the PCA coefficients, which are then further used to generate a motion vector field and hence a volumetric image. The authors have also proposed an intensity baseline correction method based on the partitioned projection, in which the first and the second moments of pixel intensities at a patch in a simulated projection image are matched with those in a measured one via a linear transformation. The proposed method has been validated in both simulated data and real phantom data.

RESULTS

The algorithm is able to identify patches that contain relevant motion information such as the diaphragm region. It is found that an intensity baseline correction step is important to remove the systematic error in the motion prediction. For the simulation case, the sparse learning model reduced the prediction error for the first PCA coefficient to 5%, compared to the 10% error when sparse learning was not used, and the 95th percentile error for the predicted motion vector was reduced from 2.40 to 0.92 mm. In the phantom case with a regular tumor motion, the predicted tumor trajectory was successfully reconstructed with a 0.82 mm error for tumor center localization compared to a 1.66 mm error without using the sparse learning method. When the tumor motion was driven by a real patient breathing signal with irregular periods and amplitudes, the average tumor center error was 0.6 mm. The algorithm robustness with respect to sparsity level, patch size, and presence or absence of diaphragm, as well as computation time, has also been studied.

CONCLUSIONS

The authors have developed a new method that automatically identifies motion information from an x-ray projection, based on which a volumetric image is generated.

A pilot evaluation of a 4-dimensional cone-beam computed tomographic scheme based on simultaneous motion estimation and image reconstruction

PURPOSE

To evaluate the performance of a 4-dimensional (4-D) cone-beam computed tomographic (CBCT) reconstruction scheme based on simultaneous motion estimation and image reconstruction (SMEIR) through patient studies.

METHODS AND MATERIALS

The SMEIR algorithm contains 2 alternating steps: (1) motion-compensated CBCT reconstruction using projections from all phases to reconstruct a reference phase 4D-CBCT by explicitly considering the motion models between each different phase and (2) estimation of motion models directly from projections by matching the measured projections to the forward projection of the deformed reference phase 4D-CBCT. Four lung cancer patients were scanned for 4 to 6 minutes to obtain approximately 2000 projections for each patient. To evaluate the performance of the SMEIR algorithm on a conventional 1-minute CBCT scan, the number of projections at each phase was reduced by a factor of 5, 8, or 10 for each patient. Then, 4D-CBCTs were reconstructed from the down-sampled projections using Feldkamp-Davis-Kress, total variation (TV) minimization, prior image constrained compressive sensing (PICCS), and SMEIR. Using the 4D-CBCT reconstructed from the fully sampled projections as a reference, the relative error (RE) of reconstructed images, root mean square error (RMSE), and maximum error (MaxE) of estimated tumor positions were analyzed to quantify the performance of the SMEIR algorithm.

RESULTS

The SMEIR algorithm can achieve results consistent with the reference 4D-CBCT reconstructed with many more projections per phase. With an average of 30 to 40 projections per phase, the MaxE in tumor position detection is less than 1 mm in SMEIR for all 4 patients.

CONCLUSION

The results from a limited number of patients show that SMEIR is a promising tool for high-quality 4D-CBCT reconstruction and tumor motion modeling.

A hybrid reconstruction algorithm for fast and accurate 4D cone-beam CT imaging

PURPOSE

4D cone beam CT (4D-CBCT) has been utilized in radiation therapy to provide 4D image guidance in lung and upper abdomen area. However, clinical application of 4D-CBCT is currently limited due to the long scan time and low image quality. The purpose of this paper is to develop a new 4D-CBCT reconstruction method that restores volumetric images based on the 1-min scan data acquired with a standard 3D-CBCT protocol.

METHODS

The model optimizes a deformation vector field that deforms a patient-specific planning CT (p-CT), so that the calculated 4D-CBCT projections match measurements. A forward-backward splitting (FBS) method is invented to solve the optimization problem. It splits the original problem into two well-studied subproblems, i.e., image reconstruction and deformable image registration. By iteratively solving the two subproblems, FBS gradually yields correct deformation information, while maintaining high image quality. The whole workflow is implemented on a graphic-processing-unit to improve efficiency. Comprehensive evaluations have been conducted on a moving phantom and three real patient cases regarding the accuracy and quality of the reconstructed images, as well as the algorithm robustness and efficiency.

RESULTS

The proposed algorithm reconstructs 4D-CBCT images from highly under-sampled projection data acquired with 1-min scans. Regarding the anatomical structure location accuracy, 0.204 mm average differences and 0.484 mm maximum difference are found for the phantom case, and the maximum differences of 0.3-0.5 mm for patients 1-3 are observed. As for the image quality, intensity errors below 5 and 20 HU compared to the planning CT are achieved for the phantom and the patient cases, respectively. Signal-noise-ratio values are improved by 12.74 and 5.12 times compared to results from FDK algorithm using the 1-min data and 4-min data, respectively. The computation time of the algorithm on a NVIDIA GTX590 card is 1-1.5 min per phase.

CONCLUSIONS

High-quality 4D-CBCT imaging based on the clinically standard 1-min 3D CBCT scanning protocol is feasible via the proposed hybrid reconstruction algorithm.

Prior-based artifact correction (PBAC) in computed tomography

PURPOSE

Image quality in computed tomography (CT) often suffers from artifacts which may reduce the diagnostic value of the image. In many cases, these artifacts result from missing or corrupt regions in the projection data, e.g., in the case of metal, truncation, and limited angle artifacts. The authors propose a generalized correction method for different kinds of artifacts resulting from missing or corrupt data by making use of available prior knowledge to perform data completion.

METHODS

The proposed prior-based artifact correction (PBAC) method requires prior knowledge in form of a planning CT of the same patient or in form of a CT scan of a different patient showing the same body region. In both cases, the prior image is registered to the patient image using a deformable transformation. The registered prior is forward projected and data completion of the patient projections is performed using smooth sinogram inpainting. The obtained projection data are used to reconstruct the corrected image.

RESULTS

The authors investigate metal and truncation artifacts in patient data sets acquired with a clinical CT and limited angle artifacts in an anthropomorphic head phantom data set acquired with a gantry-based flat detector CT device. In all cases, the corrected images obtained by PBAC are nearly artifact-free. Compared to conventional correction methods, PBAC achieves better artifact suppression while preserving the patient-specific anatomy at the same time. Further, the authors show that prominent anatomical details in the prior image seem to have only minor impact on the correction result.

CONCLUSIONS

The results show that PBAC has the potential to effectively correct for metal, truncation, and limited angle artifacts if adequate prior data are available. Since the proposed method makes use of a generalized algorithm, PBAC may also be applicable to other artifacts resulting from missing or corrupt data.

A limited-angle intrafraction verification (LIVE) system for radiation therapy

PURPOSE

Currently, no 3D or 4D volumetric x-ray imaging techniques are available for intrafraction verification of target position during actual treatment delivery or in-between treatment beams, which is critical for stereotactic radiosurgery (SRS) and stereotactic body radiation therapy (SBRT) treatments. This study aims to develop a limited-angle intrafraction verification (LIVE) system to use prior information, deformation models, and limited angle kV-MV projections to verify target position intrafractionally.

METHODS

The LIVE system acquires limited-angle kV projections simultaneously during arc treatment delivery or in-between static 3D/IMRT treatment beams as the gantry moves from one beam to the next. Orthogonal limited-angle MV projections are acquired from the beam's eye view (BEV) exit fluence of arc treatment beam or in-between static beams to provide additional anatomical information. MV projections are converted to kV projections using a linear conversion function. Patient prior planning CT at one phase is used as the prior information, and the on-board patient volume is considered as a deformation of the prior images. The deformation field is solved using the data fidelity constraint, a breathing motion model extracted from the planning 4D-CT based on principal component analysis (PCA) and a free-form deformation (FD) model. LIVE was evaluated using a 4D digital extended cardiac torso phantom (XCAT) and a CIRS 008A dynamic thoracic phantom. In the XCAT study, patient breathing pattern and tumor size changes were simulated from CT to treatment position. In the CIRS phantom study, the artificial target in the lung region experienced both size change and position shift from CT to treatment position. Varian Truebeam research mode was used to acquire kV and MV projections simultaneously during the delivery of a dynamic conformal arc plan. The reconstruction accuracy was evaluated by calculating the 3D volume percentage difference (VPD) and the center of mass (COM) difference of the tumor in the true on-board images and reconstructed images.

RESULTS

In both simulation and phantom studies, LIVE achieved substantially better reconstruction accuracy than reconstruction using PCA or FD deformation model alone. In the XCAT study, the average VPD and COM differences among different patient scenarios for LIVE system using orthogonal 30° scan angles were 4.3% and 0.3 mm when using kV+BEV MV. Reducing scan angle to 15° increased the average VPD and COM differences to 15.1% and 1.7 mm. In the CIRS phantom study, the VPD and COM differences for the LIVE system using orthogonal 30° scan angles were 6.4% and 1.4 mm. Reducing scan angle to 15° increased the VPD and COM differences to 51.9% and 3.8 mm.

CONCLUSIONS

The LIVE system has the potential to substantially improve intrafraction target localization accuracy by providing volumetric verification of tumor position simultaneously during arc treatment delivery or in-between static treatment beams. With this improvement, LIVE opens up a new avenue for margin reduction and dose escalation in both fractionated treatments and SRS and SBRT treatments.