Deep learning-based synthetic CT generation for paediatric brain MR-only photon and proton radiotherapy

Intra-fractional per-beam adaptive workflow to mitigate the need for a rotating gantry during MRI-guided proton therapy

The integration of real-time magnetic resonance imaging (MRI)-guidance and proton therapy would potentially improve the proton dose steering capability by reducing daily uncertainties due to anatomical variations. The use of a fixed beamline coupled with an axial patient couch rotation would greatly simplify the proton delivery with MRI-guidance. Nonetheless, it is mandatory to assure that the plan quality is not deteriorated by the anatomical deformations due to patient rotation. In this work, an in-house tool allowing for intra-fractional per-beam adaptation of intensity-modulated proton plans (BeamAdapt) was implemented through features available in RayStation. A set of three MRIs was acquired for two healthy volunteers (V1, V2): (1) no rotation/static, (2) rotation to the right and (3) left. V1 was rotated by 15º, to simulate a clinical pediatric abdominal case and V2 by 45º, to simulate an extreme patient rotation case. For each volunteer, a total of four intensity-modulated pencil beam scanning plans were optimized on the static MRI using virtual abdominal targets and 2-3 posterior-oblique beams. Beam angles were defined according to the angulations on the rotated MRIs. With BeamAdapt, each original plan was first converted into separate plans with one beam per plan. In an iterative order, individual beam doses were non-rigidly deformed to the rotated anatomies and re-optimized accounting for the consequent deformations and the beam doses delivered so far. For evaluation, the final adapted dose distribution was propagated back to the static MRI. Planned and adapted dose distributions were compared by computing relative differences between dose-volume histogram (DVH) metrics. Absolute target dose differences were on average below 1% and mean dose organs-at-risk differences were below 3%. With BeamAdapt, not only intra-fractional per-beam proton plan adaptation coupled with axial patient rotation is possible but also the need for a rotating gantry during MRI-guidance might be mitigated.

Facilitating MR-Guided Adaptive Proton Therapy in Children Using Deep Learning-Based Synthetic CT

Purpose

To determine whether self-attention cycle-generative adversarial networks (cycle-GANs), a novel deep-learning method, can generate accurate synthetic computed tomography (sCT) to facilitate adaptive proton therapy in children with brain tumors.

Materials and Methods

Both CT and T1-weighted magnetic resonance imaging (MRI) of 125 children (ages 1-20 years) with brain tumors were included in the training dataset. A model introducing a self-attention mechanism into the conventional cycle-GAN was created to enhance tissue interfaces and reduce noise. The test dataset consisted of 7 patients (ages 2-14 years) who underwent adaptive planning because of changes in anatomy discovered on MRI during proton therapy. The MRI during proton therapy-based sCT was compared with replanning CT (ground truth).

Results

The Hounsfield unit-mean absolute error was significantly reduced with self-attention cycle-GAN, as compared with conventional cycle-GAN (65.3 ± 13.9 versus 88.9 ± 19.3, P < .01). The average 3-dimensional gamma passing rates (2%/2 mm criteria) for the original plan on the anatomy of the day and for the adapted plan were high (97.6% ± 1.2% and 98.9 ± 0.9%, respectively) when using sCT generated by self-attention cycle-GAN. The mean absolute differences in clinical target volume (CTV) receiving 95% of the prescription dose and 80% distal falloff along the beam axis were 1.1% ± 0.8% and 1.1 ± 0.9 mm, respectively. Areas of greatest dose difference were distal to the CTV and corresponded to shifts in distal falloff. Plan adaptation was appropriately triggered in all test patients when using sCT.

Conclusion

The novel cycle-GAN model with self-attention outperforms conventional cycle-GAN for children with brain tumors. Encouraging dosimetric results suggest that sCT generation can be used to identify patients who would benefit from adaptive replanning.

Artificial Intelligence in magnetic Resonance guided Radiotherapy: Medical and physical considerations on state of art and future perspectives

Over the last years, technological innovation in Radiotherapy (RT) led to the introduction of Magnetic Resonance-guided RT (MRgRT) systems. Due to the higher soft tissue contrast compared to on-board CT-based systems, MRgRT is expected to significantly improve the treatment in many situations. MRgRT systems may extend the management of inter- and intra-fraction anatomical changes, offering the possibility of online adaptation of the dose distribution according to daily patient anatomy and to directly monitor tumor motion during treatment delivery by means of a continuous cine MR acquisition. Online adaptive treatments require a multidisciplinary and well-trained team, able to perform a series of operations in a safe, precise and fast manner while the patient is waiting on the treatment couch. Artificial Intelligence (AI) is expected to rapidly contribute to MRgRT, primarily by safely and efficiently automatising the various manual operations characterizing online adaptive treatments. Furthermore, AI is finding relevant applications in MRgRT in the fields of image segmentation, synthetic CT reconstruction, automatic (on-line) planning and the development of predictive models based on daily MRI. This review provides a comprehensive overview of the current AI integration in MRgRT from a medical physicist's perspective. Medical physicists are expected to be major actors in solving new tasks and in taking new responsibilities: their traditional role of guardians of the new technology implementation will change with increasing emphasis on the managing of AI tools, processes and advanced systems for imaging and data analysis, gradually replacing many repetitive manual tasks.

Cone beam computed tomography based image guidance and quality assessment of prostate cancer for magnetic resonance imaging-only radiotherapy in the pelvis

•

MRI-only IGRT accuracy is ≤2 mm as compared to CT but significant differences were observed.

•

MRI-only CBCT-based IGRT seems feasible but caution is advised.

•

The median absolute error (MeAE) for independent verification on the sCT quality is proposed.

•

A MeAE around 0.1 in mass density could call for sCT quality inspection.

Background and purpose

Radiotherapy (RT) based on magentic resonance imaging (MRI) only is currently used clinically in the pelvis. A synthetic computed tomography (sCT) is needed for dose planning. Here, we investigate the accuracy of cone beam CT (CBCT) based MRI-only image guided RT (IGRT) and sCT image quality.

Materials and methods

CT, MRI and CBCT scans of ten prostate cancer patients were included. The MRI was converted to a sCT using a multi-atlas approach. The sCT, CT and MR images were auto-matched with the CBCT on the bony anatomy. Paired sCT-CT and sCT-CBCT data were created. CT numbers were converted to relative electron (RED) and mass densities (DES) using a standard calibration curve for the CT and sCT. For the CBCT RED/DES conversion, a phantom and paired CT-CBCT population based calibration curve was used. For the latter, the CBCT numbers were averaged in 100 HU bins and the known RED/DES of the CT were assigned. The paired sCT-CT and sCT-CBCT data were averaged in bins of 10 HU or 0.01 RED/DES. The median absolute error (MeAE) between the sCT-CT and sCT-CBCT bins was calculated. Wilcoxon rank-sum tests were carried out for the IGRT and MeAE study.

Results

The mean sCT or MR IGRT difference from CT was ≤ 2 mm but significant differences were observed. A CBCT HU or phantom-based RED/DES MeAE did not estimate the sCT quality similar to a CT based MeAE but the CBCT population-based RED/DES MeAE did.

Conclusions

MRI-only CBCT-based IGRT seems feasible but caution is advised. A MeAE around 0.1 DES could call for sCT quality inspection.

A feature invariant generative adversarial network for head and neck MRI/CT image synthesis

With the emergence of online MRI radiotherapy treatments, MR-based workflows have increased in importance in the clinical workflow. However proper dose planning still requires CT images to calculate dose attenuation due to bony structures. In this paper, we present a novel deep image synthesis model that generates in an unsupervised manner CT images from diagnostic MRI for radiotherapy planning. The proposed model based on a generative adversarial network (GAN) consists of learning a new invariant representation to generate synthetic CT (sCT) images based on high frequency and appearance patterns. This new representation encodes each convolutional feature map of the convolutional GAN discriminator, leading the training of the proposed model to be particularly robust in terms of image synthesis quality. Our model includes an analysis of common histogram features in the training process, thus reinforcing the generator such that the output sCT image exhibits a histogram matching that of the ground-truth CT. This CT-matched histogram is embedded then in a multi-resolution framework by assessing the evaluation over all layers of the discriminator network, which then allows the model to robustly classify the output synthetic image. Experiments were conducted on head and neck images of 56 cancer patients with a wide range of shape sizes and spatial image resolutions. The obtained results confirm the efficiency of the proposed model compared to other generative models, where the mean absolute error yielded by our model was 26.44(0.62), with a Hounsfield unit error of 45.3(1.87), and an overall Dice coefficient of 0.74(0.05), demonstrating the potential of the synthesis model for radiotherapy planning applications.

Synthetic CT for single-fraction neoadjuvant partial breast irradiation on an MRI-linac

A synthetic computed tomography (sCT) is required for daily plan optimization on an MRI-linac. Yet, only limited information is available on the accuracy of dose calculations on sCT for breast radiotherapy. This work aimed to (1) evaluate dosimetric accuracy of treatment plans for single-fraction neoadjuvant partial breast irradiation (PBI) on a 1.5 T MRI-linac calculated on a) bulk-density sCT mimicking the current MRI-linac workflow and b) deep learning-generated sCT, and (2) investigate the number of bulk-density levels required. For ten breast cancer patients we created three bulk-density sCTs of increasing complexity from the planning-CT, using bulk-density for: (1) body, lungs, and GTV (sCT_BD1); (2) volumes for sCT_BD1plus chest wall and ipsilateral breast (sCT_BD2); (3) volumes for sCT_BD2plus ribs (sCT_BD3); and a deep learning-generated sCT (sCT_DL) from a 1.5 T MRI in supine position. Single-fraction neoadjuvant PBI treatment plans for a 1.5 T MRI-linac were optimized on each sCT and recalculated on the planning-CT. Image evaluation was performed by assessing mean absolute error (MAE) and mean error (ME) in Hounsfield Units (HU) between the sCTs and the planning-CT. Dosimetric evaluation was performed by assessing dose differences, gamma pass rates, and dose-volume histogram (DVH) differences. The following results were obtained (median across patients for sCT_BD1/sCT_BD2/sCT_BD3/sCT_DLrespectively): MAE inside the body contour was 106/104/104/75 HU and ME was 8/9/6/28 HU, mean dose difference in the PTV_GTVwas 0.15/0.00/0.00/-0.07 Gy, median gamma pass rate (2%/2 mm, 10% dose threshold) was 98.9/98.9/98.7/99.4%, and differences in DVH parameters were well below 2% for all structures except for the skin in the sCT_DL. Accurate dose calculations for single-fraction neoadjuvant PBI on an MRI-linac could be performed on both bulk-density and deep learning sCT, facilitating further implementation of MRI-guided radiotherapy for breast cancer. Balancing simplicity and accuracy, sCT_BD2showed the optimal number of bulk-density levels for a bulk-density approach.

Technical Challenges of Real-Time Adaptive MR-Guided Radiotherapy

In the past few years, radiotherapy (RT) has experienced a major technological innovation with the development of hybrid machines combining magnetic resonance (MR) imaging and linear accelerators. This new technology for MR-guided cancer treatment has the potential to revolutionize the field of adaptive RT due to the opportunity to provide high-resolution, real-time MR imaging before and during treatment application. However, from a technical point of view, several challenges remain which need to be tackled to ensure safe and robust real-time adaptive MR-guided RT delivery. In this manuscript, several technical challenges to MR-guided RT are discussed. Starting with magnetic field strength tradeoffs, the potential and limitations for purely MR-based RT workflows are discussed. Furthermore, the current status of real-time 3D MR imaging and its potential for real-time RT are summarized. Finally, the potential of quantitative MR imaging for future biological RT adaptation is highlighted.