Evaluation of super-resolution on 50 pancreatic cancer patients with real-time cine MRI from 0.35T MRgRT

Improvement of 2D cine image quality using 3D priors and cycle generative adversarial network for low field MRI-guided radiation therapy

BACKGROUND

Cine magnetic resonance (MR) images have been used for real-time MR guided radiation therapy (MRgRT). However, the onboard MR systems with low-field strength face the problem of limited image quality.

PURPOSE

To improve the quality of cine MR images in MRgRT using prior image information provided by the patient planning and positioning MR images.

METHODS

This study employed MR images from 18 pancreatic cancer patients who received MR-guided stereotactic body radiation therapy. Planning 3D MR images were acquired during the patient simulation, and positioning 3D MR images and 2D sagittal cine MR images were acquired before and during the beam delivery, respectively. A deep learning-based framework consisting of two cycle generative adversarial networks (CycleGAN), Denoising CycleGAN and Enhancement CycleGAN, was developed to establish the mapping between the 3D and 2D MR images. The Denoising CycleGAN was trained to first denoise the cine images using the time domain cine image series, and the Enhancement CycleGAN was trained to enhance the spatial resolution and contrast by taking advantage of the prior image information from the planning and positioning images. The denoising performance was assessed by signal-to-noise ratio (SNR), structural similarity index measure, peak SNR, blind/reference-less image spatial quality evaluator (BRISQUE), natural image quality evaluator, and perception-based image quality evaluator scores. The quality enhancement performance was assessed by the BRISQUE and physician visual scores. In addition, the target contouring was evaluated on the original and processed images.

RESULTS

Significant differences were found for all evaluation metrics after Denoising CycleGAN processing. The BRISQUE and visual scores were also significantly improved after sequential Denoising and Enhancement CycleGAN processing. In target contouring evaluation, Dice similarity coefficient, centroid distance, Hausdorff distance, and average surface distance values were significantly improved on the enhanced images. The whole processing time was within 20 ms for a typical input image size of 512 × 512.

CONCLUSION

Taking advantage of the prior high-quality positioning and planning MR images, the deep learning-based framework enhanced the cine MR image quality significantly, leading to improved accuracy in automatic target contouring. With the merits of both high computational efficiency and considerable image quality enhancement, the proposed method may hold important clinical implication for real-time MRgRT.

Real-time motion management in MRI-guided radiotherapy: Current status and AI-enabled prospects

MRI-guided radiotherapy (MRIgRT) is a highly complex treatment modality, allowing adaptation to anatomical changes occurring from one treatment day to the other (inter-fractional), but also to motion occurring during a treatment fraction (intra-fractional). In this vision paper, we describe the different steps of intra-fractional motion management during MRIgRT, from imaging to beam adaptation, and the solutions currently available both clinically and at a research level. Furthermore, considering the latest developments in the literature, a workflow is foreseen in which motion-induced over- and/or under-dosage is compensated in 3D, with minimal impact to the radiotherapy treatment time. Considering the time constraints of real-time adaptation, a particular focus is put on artificial intelligence (AI) solutions as a fast and accurate alternative to conventional algorithms.

Fast Deformable Image Registration for Real-Time Target Tracking During Radiation Therapy Using Cine MRI and Deep Learning

PURPOSE

We developed a deep learning (DL) model for fast deformable image registration using 2-dimensional sagittal cine magnetic resonance imaging (MRI) acquired during radiation therapy and evaluated its potential for real-time target tracking compared with conventional image registration methods.

METHODS AND MATERIALS

Our DL model uses a pair of cine MRI images as input and provides a motion vector field (MVF) as output. The MVF is then applied to align the input images. A retrospective study was conducted to train and evaluate our model using cine MRI data from patients undergoing treatment for abdominal and thoracic tumors. For each treatment fraction, MR-linear accelerator delivery log files, tracking videos, and cine image files were analyzed. Individual MRI frames were temporally sampled to construct a large set of image registration pairs used to evaluate multiple methods. The DL model was optimized using 5-fold cross validation, and model outputs (transformed images and MVFs) using test set images were saved for comparison with 3 conventional registration methods (affine, b-spline, and demons). Evaluation metrics were 3-fold: (1) registration error, (2) MVF stability (both spatial and temporal), and (3) average computation time.

RESULTS

We analyzed >21 hours of cine MRI (>629,000 frames) acquired during 86 treatment fractions from 21 patients. In a test set of 10,320 image registration pairs, DL registration outperformed conventional methods in both registration error (affine, b-spline, demons, DL; root mean square error: 0.067, 0.040, 0.036, 0.032; paired t test demons vs DL: t[20] = 4.2, P < .001) and computation time per frame (51, 1150, 4583, 8 ms). Among deformable methods, spatial stability of resulting MVFs was comparable; however, the DL model had significantly improved temporal consistency.

CONCLUSIONS

DL-based image registration can leverage large-scale MR cine data sets to outperform conventional registration methods and is a promising solution for real-time deformable motion estimation in radiation therapy.