Effect of Deformation Methods on the Accuracy of Deformable Image Registration From Kilovoltage CT to Tomotherapy Megavoltage CT

Evaluation of DIR algorithm performance in real patients for radiotherapy treatments: A systematic review of operator-dependent strategies

PURPOSE

The performance of deformable medical image registration (DIR) algorithms has become a major concern.

METHODS

We aimed to obtain updated information on DIR algorithm performance quantification through a literature review of articles published between 2010 and 2022. We focused only on studies using operator-based methods to treat real patients. The PubMed, Google Scholar and Embase databases were searched following PRISMA guidelines.

RESULTS

One hundred and seven articles were identified. The mean number of patients and registrations per publication was 20 and 63, respectively. We found 23 different geometric metrics appearing at least twice, and the dosimetric impact of DIR was quantified in 32 articles. Forty-eight different at-risk organs were described, and target volumes were studied in 43 publications. Prostate, head-and-neck and thoracic locations represented more than ¾ of the studied locations. We summarized the type of DIR and the images used, and other key elements. Intra/interobserver variability, threshold values and the correlation between metrics were also discussed.

CONCLUSIONS

This literature review covers the past decade and should facilitate the implementation of DIR algorithms in clinical practice by providing practical and pertinent information to quantify their performance on real patients.

Performance Evaluation of Deformable Image Registration Algorithms Using Computed Tomography of Multiple Lung Metastases

Purpose: Various deformable image registration (DIR) methods have been used to evaluate organ deformations in 4-dimensional computed tomography (4D CT) images scanned during the respiratory motions of a patient. This study assesses the performance of 10 DIR algorithms using 4D CT images of 5 patients with fiducial markers (FMs) implanted during the postoperative radiosurgery of multiple lung metastases. Methods: To evaluate DIR algorithms, 4D CT images of 5 patients were used, and ground-truths of FMs and tumors were generated by physicians based on their medical expertise. The positions of FMs and tumors in each 4D CT phase image were determined using 10 DIR algorithms, and the deformed results were compared with ground-truth data. Results: The target registration errors (TREs) between the FM positions estimated by optical flow algorithms and the ground-truth ranged from 1.82 ± 1.05 to 1.98 ± 1.17 mm, which is within the uncertainty of the ground-truth position. Two algorithm groups, namely, optical flow and demons, were used to estimate tumor positions with TREs ranging from 1.29 ± 1.21 to 1.78 ± 1.75 mm. With respect to the deformed position for tumors, for the 2 DIR algorithm groups, the maximum differences of the deformed positions for gross tumor volume tracking were approximately 4.55 to 7.55 times higher than the mean differences. Errors caused by the aforementioned difference in the Hounsfield unit values were also observed. Conclusions: We quantitatively evaluated 10 DIR algorithms using 4D CT images of 5 patients and compared the results with ground-truth data. The optical flow algorithms showed reasonable FM-tracking results in patient 4D CT images. The iterative optical flow method delivered the best performance in this study. With respect to the tumor volume, the optical flow and demons algorithms delivered the best performance.

Comparison of an in-house hybrid DIR method to NiftyReg on CBCT and CT images for head and neck cancer

An in-house hybrid deformable image registration (DIR) method, which combines free-form deformation (FFD) and the viscous fluid registration method, is proposed. Its results on the planning computed tomography (CT) and the day 1 treatment cone-beam CT (CBCT) image from 68 head and neck cancer patients are compared with the results of NiftyReg, which uses B-spline FFD alone. Several similarity metrics, the target registration error (TRE) of annotated points, as well as the Dice similarity coefficient (DSC) and Hausdorff distance (HD) of the propagated organs at risk are employed to analyze their registration accuracy. According to quantitative analysis on mutual information, normalized cross-correlation, and the absolute pixel value differences, the results of the proposed DIR are more similar to the CBCT images than the NiftyReg results. Smaller TRE of the annotated points is observed in the proposed method, and the overall mean TRE for the proposed method and NiftyReg was 2.34 and 2.98 mm, respectively (p < 0.001). The mean DSC in the larynx, spinal cord, oral cavity, mandible, and parotid given by the proposed method ranged from 0.78 to 0.91, significantly higher than the NiftyReg results (ranging from 0.77 to 0.90), and the HD was significantly lower compared to NiftyReg. Furthermore, the proposed method did not suffer from unrealistic deformations as the NiftyReg did in the visual evaluation. Meanwhile, the execution time of the proposed method was much higher than NiftyReg (96.98 ± 11.88 s vs. 4.60 ± 0.49 s). In conclusion, the in-house hybrid method gave better accuracy and more stable performance than NiftyReg.

Improvement of megavoltage computed tomography image quality for adaptive helical tomotherapy using cycleGAN-based image synthesis with small datasets

PURPOSE

Megavoltage computed tomography (MVCT) offers an opportunity for adaptive helical tomotherapy. However, high noise and reduced contrast in the MVCT images due to a decrease in the imaging dose to patients limits its usability. Therefore, we propose an algorithm to improve the image quality of MVCT.

METHODS

The proposed algorithm generates kilovoltage CT (kVCT)-like images from MVCT images using a cycle-consistency generative adversarial network (cycleGAN)-based image synthesis model. Data augmentation using an affine transformation was applied to the training data to overcome the lack of data diversity in the network training. The mean absolute error (MAE), root-mean-square error (RMSE), peak signal-to-noise ratio (PSNR), and structural similarity index measure (SSIM) were used to quantify the correction accuracy of the images generated by the proposed algorithm. The proposed method was validated by comparing the images generated with those obtained from conventional and deep learning-based image processing method through non-augmented datasets.

RESULTS

The average MAE, RMSE, PSNR, and SSIM values were 18.91 HU, 69.35 HU, 32.73 dB, and 95.48 using the proposed method, respectively, whereas cycleGAN with non-augmented data showed inferior results (19.88 HU, 70.55 HU, 32.62 dB, 95.19, respectively). The voxel values of the image obtained by the proposed method also indicated similar distributions to those of the kVCT image. The dose-volume histogram of the proposed method was also similar to that of electron density corrected MVCT.

CONCLUSIONS

The proposed algorithm generates synthetic kVCT images from MVCT images using cycleGAN with small patient datasets. The image quality achieved by the proposed method was correspondingly improved to the level of a kVCT image while maintaining the anatomical structure of an MVCT image. The evaluation of dosimetric effectiveness of the proposed method indicates the applicability of accurate treatment planning in adaptive radiation therapy.

Free-to-use DIR solutions in radiotherapy: Benchmark against commercial platforms through a contour-propagation study

PURPOSE

A contour propagation study has been conducted to benchmark three algorithms for Deformable Image Registration (DIR) freely available online against well-established commercial solutions.

METHODS

ElastiX, BRAINS and Plastimach, available as modules in the open source platform 3DSlicer, were tested as the recent AAPM Task group 132 guidelines proposes. The overlap of the DIR-mapped ROIs in four computational anthropomorphic phantoms was measured. To avoid bias every algorithm was left to run without any human interaction nor particular registration strategy. The accuracy of the algorithms was measured using the Dice Similarity Coefficient (DSC) and Mean Distance to Conformity (MDC) metrics. The registration quality was compared to the recommended geometrical accuracy suggested by AAPM TG132 and to the results of a large population-based study performed with commercial DIR solutions.

RESULTS

The considered free-to-use DIR solutions generally meet acceptable accuracy and good overlap (DSC > 0.85). Mild failures (DSC < 0.75) were detected only for the smallest structures. In case of extremely severe deformations acceptable accuracy was not met (MDC > 3 mm). The morphing capability of the tested algorithms equals those of commercial systems when the user interaction is avoided. Underperformances were detected only in cases where a specific registration strategy is mandatory to obtain a satisfying match.

CONCLUSIONS

All of the considered algorithms show performances not inferior to previously published data and have the potential to be good candidates for use in the clinical routine. The results and conclusions only apply to the considered phantoms and should not be considered to be generally applicable and extendable to patient cases.

Computed Tomography to Cone Beam Computed Tomography Deformable Image Registration for Contour Propagation Using Head and Neck, Patient-Based Computational Phantoms: A Multicenter Study

PURPOSE

To investigate the performance of various algorithms for deformable image registration (DIR) for propagating regions of interest (ROIs) using multiple commercial platforms, from computed tomography to cone beam computed tomography (CBCT) and megavoltage computed tomography.

METHODS AND MATERIALS

Fourteen institutions participated in the study using 5 commercial platforms: RayStation (RaySearch Laboratories, Stockholm, Sweden), MIM (Cleveland, OH), VelocityAI and SmartAdapt (Varian Medical Systems, Palo Alto, CA), and ABAS (Elekta AB, Stockholm, Sweden). Algorithms were tested on synthetic images generated with the ImSimQA (Oncology Systems Limited, Shrewsbury, UK) package by applying 2 specific deformation vector fields (DVF) to real head and neck patient datasets. On-board images from 3 systems were used: megavoltage computed tomography from Tomotherapy and 2 kinds of CBCT from a clinical linear accelerator. Image quality of the system was evaluated. The algorithms' accuracy was assessed by comparing the DIR-mapped ROIs returned by each center with those of the reference, using the Dice similarity coefficient and mean distance to conformity metrics. Statistical inference on the validation results was carried out to identify the prognostic factors of DIR performance.

RESULTS

Analyzing 840 DIR-mapped ROIs returned by the centers, it was demonstrated that DVF intensity and image quality were significant prognostic factors of DIR performance. The accuracy of the propagated contours was generally high, and acceptable DIR performance can be obtained with lower-dose CBCT image protocols.

CONCLUSIONS

The performance of the systems proved to be image quality specific, depending on the DVF type and only partially on the platforms. All systems proved to be robust against image artifacts and noise, except the demon-based software.