A single neural network for cone-beam computed tomography-based radiotherapy of head-and-neck, lung and breast cancer

Examination of immunohistochemical of the effects of flattened and unflattened radiotherapy beams in nude mice breast cancer xenografts

PURPOSE

The aim of this study was to investigate the radiobiological effects underlying the inhibition of breast cancer (BCa) following radiotherapy in nude mice models, and to evaluate the impact of changes in immunohistochemical parameters induced by FF and FFF beams.

MATERIALS AND METHODS

The study included thirty-six adult nude mouse models, which were randomly assigned to five groups: control (G1), breast cancer (BCa) (G2), FF-400 MU/min (G3), FFF-1100 MU/min (G4), and FFF-1800 MU/min (G5). The control group received neither radiation nor treatment, while the BCa group had a cancer model without radiation. The BCa models were subjected to a single dose of 20 Gy of radiotherapy at varying dose rates. Twenty days after the implantation of the MCF-7 cancer cell line, the nude mice were irradiated and sacrificed 48 h later for ER, PR, HER-2, Ki-67, CD-133, Caspase-3, APAF-1, NOS-2 and NOS-3 IHC analysis.

RESULTS

A statistically significant decrease in IHC staining values for ER, Ki-67 and NOS-2 was observed in the FF-400 MU/min, FFF-1100 MU/min and FFF-1800 MU/min groups due to radiotherapy compared to the BCa group. The FFF beams demonstrated superior efficacy in the treatment of BCa. The significant differences in Caspase-3 and APAF-1 levels were found between BCa and control groups, while CD-133, NOS-3, HER-2, and PR staining showed no differences between groups.

CONCLUSIONS

It was concluded that FFF beam was more effective than FF beam for BCa, especially on ER, Ki-67 and NOS-2 IHC parameters.

Unsupervised Deep Learning for Synthetic CT Generation from CBCT Images for Proton and Carbon Ion Therapy for Paediatric Patients

Image-guided treatment adaptation is a game changer in oncological particle therapy (PT), especially for younger patients. The purpose of this study is to present a cycle generative adversarial network (CycleGAN)-based method for synthetic computed tomography (sCT) generation from cone beam CT (CBCT) towards adaptive PT (APT) of paediatric patients. Firstly, 44 CBCTs of 15 young pelvic patients were pre-processed to reduce ring artefacts and rigidly registered on same-day CT scans (i.e., verification CT scans, vCT scans) and then inputted to the CycleGAN network (employing either Res-Net and U-Net generators) to synthesise sCT. In particular, 36 and 8 volumes were used for training and testing, respectively. Image quality was evaluated qualitatively and quantitatively using the structural similarity index metric (SSIM) and the peak signal-to-noise ratio (PSNR) between registered CBCT (rCBCT) and vCT and between sCT and vCT to evaluate the improvements brought by CycleGAN. Despite limitations due to the sub-optimal input image quality and the small field of view (FOV), the quality of sCT was found to be overall satisfactory from a quantitative and qualitative perspective. Our findings indicate that CycleGAN is promising to produce sCT scans with acceptable CT-like image texture in paediatric settings, even when CBCT with narrow fields of view (FOV) are employed.

Exploring dual energy CT synthesis in CBCT-based adaptive radiotherapy and proton therapy: application of denoising diffusion probabilistic models

Background.Adaptive radiotherapy (ART) requires precise tissue characterization to optimize treatment plans and enhance the efficacy of radiation delivery while minimizing exposure to organs at risk. Traditional imaging techniques such as cone beam computed tomography (CBCT) used in ART settings often lack the resolution and detail necessary for accurate dosimetry, especially in proton therapy.Purpose.This study aims to enhance ART by introducing an innovative approach that synthesizes dual-energy computed tomography (DECT) images from CBCT scans using a novel 3D conditional denoising diffusion probabilistic model (DDPM) multi-decoder. This method seeks to improve dose calculations in ART planning, enhancing tissue characterization.Methods.We utilized a paired CBCT-DECT dataset from 54 head and neck cancer patients to train and validate our DDPM model. The model employs a multi-decoder Swin-UNET architecture that synthesizes high-resolution DECT images by progressively reducing noise and artifacts in CBCT scans through a controlled diffusion process.Results.The proposed method demonstrated superior performance in synthesizing DECT images (High DECT MAE 39.582 ± 0.855 and Low DECT MAE 48.540± 1.833) with significantly enhanced signal-to-noise ratio and reduced artifacts compared to traditional GAN-based methods. It showed marked improvements in tissue characterization and anatomical structure similarity, critical for precise proton and radiation therapy planning.Conclusions.This research has opened a new avenue in CBCT-CT synthesis for ART/APT by generating DECT images using an enhanced DDPM approach. The demonstrated similarity between the synthesized DECT images and ground truth images suggests that these synthetic volumes can be used for accurate dose calculations, leading to better adaptation in treatment planning.

Proton dose calculation on cone-beam computed tomography using unsupervised 3D deep learning networks

Background and Purpose

Poor image quality of cone-beam computed tomography (CBCT) images can hinder proton dose calculation to assess the influence of anatomy changes. The aim of this study was to evaluate image quality and proton dose calculation accuracy of synthetic CTs generated from CBCT using unsupervised 3D deep-learning networks.

Materials and methods

A total of 102 head-and-neck cancer patients were used to train (N=82) and test (N=20) i) a cycle-consistent generative adversarial network, ii) a contrastive unpaired translation, and iii) a fusion of the two (CycleCUT). For patients in the test set, a repeat CT was deformably registered to a same-day CBCT to create a ground-truth CT for comparison. The proton plan was re-calculated on the ground-truth CT and synthetic CTs. The image quality of the synthetic CTs was evaluated using peak signal-to-noise ratio, structural similarity index measure, mean error, and mean absolute error (MAE). Proton dose calculation accuracy was assessed through 3D gamma analysis and dose-volume-histogram parameters.

Results

All synthetic CTs accurately preserved the CBCT anatomy (verified by visual inspection) while improving the image quality. The CycleCUT network had slightly improved image quality compared to the other networks (MAE in body: 53 Hounsfield units (HU) vs. 54/55 HU). All networks had similar proton dose calculation accuracy with gamma passing rate above 97%.

Conclusions

All three evaluated networks generated synthetic CT images with dose distributions comparable to those of conventional fan-beam CT. The synthetic CT generation was fast, making all networks feasible for adaptive proton therapy.

Supervised deep learning-based synthetic computed tomography from kilovoltage cone-beam computed tomography images for adaptive radiation therapy in head and neck cancer

PURPOSE

To generate and investigate a supervised deep learning algorithm for creating synthetic computed tomography (sCT) images from kilovoltage cone-beam computed tomography (kV-CBCT) images for adaptive radiation therapy (ART) in head and neck cancer (HNC).

MATERIALS AND METHODS

This study generated the supervised U-Net deep learning model using 3,491 image pairs from planning computed tomography (pCT) and kV-CBCT datasets obtained from 40 HNC patients. The dataset was split into 80% for training and 20% for testing. The evaluation of the sCT images compared to pCT images focused on three aspects: Hounsfield units accuracy, assessed using mean absolute error (MAE) and root mean square error (RMSE); image quality, evaluated using the peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) between sCT and pCT images; and dosimetric accuracy, encompassing 3D gamma passing rates for dose distribution and percentage dose difference.

RESULTS

MAE, RMSE, PSNR, and SSIM showed improvements from their initial values of 53.15 ± 40.09, 153.99 ± 79.78, 47.91 ± 4.98 dB, and 0.97 ± 0.02 to 41.47 ± 30.59, 130.39 ± 78.06, 49.93 ± 6.00 dB, and 0.98 ± 0.02, respectively. Regarding dose evaluation, 3D gamma passing rates for dose distribution within sCT images under 2%/2 mm, 3%/2 mm, and 3%/3 mm criteria, yielded passing rates of 92.1% ± 3.8%, 93.8% ± 3.0%, and 96.9% ± 2.0%, respectively. The sCT images exhibited minor variations in the percentage dose distribution of the investigated target and structure volumes. However, it is worth noting that the sCT images exhibited anatomical variations when compared to the pCT images.

CONCLUSION

These findings highlight the potential of the supervised U-Net deep learningmodel in generating kV-CBCT-based sCT images for ART in patients with HNC.

Artificial intelligence for treatment delivery: image-guided radiotherapy

Radiation therapy (RT) is a highly digitized field relying heavily on computational methods and, as such, has a high affinity for the automation potential afforded by modern artificial intelligence (AI). This is particularly relevant where imaging is concerned and is especially so during image-guided RT (IGRT). With the advent of online adaptive RT (ART) workflows at magnetic resonance (MR) linear accelerators (linacs) and at cone-beam computed tomography (CBCT) linacs, the need for automation is further increased. AI as applied to modern IGRT is thus one area of RT where we can expect important developments in the near future. In this review article, after outlining modern IGRT and online ART workflows, we cover the role of AI in CBCT and MRI correction for dose calculation, auto-segmentation on IGRT imaging, motion management, and response assessment based on in-room imaging.

Cone-Beam Computed Tomography-Guided Adaptive Radiotherapy: A Case Report on Dynamic Tumor Response in Lung Adenocarcinoma

Cone-beam computed tomography (CBCT) is an essential tool in radiotherapy, enhancing patient positioning accuracy and enabling precise treatment delivery by monitoring anatomical changes throughout the treatment process. This case report highlights the significant role of CBCT in managing a patient with lung adenocarcinoma treated with concurrent chemoradiation. The lung mass and lower paratracheal lymph nodes were irradiated with 60 Gy in 30 fractions. During the course of treatment, CBCT allowed us to observe substantial tumor shrinkage, prompting a treatment replanning to ensure optimal targeting of the tumor while minimizing radiation exposure to healthy tissues. This adaptive approach resulted in excellent treatment outcomes with no complications, demonstrating the efficacy of CBCT in modern radiotherapy.

A systematic literature review: deep learning techniques for synthetic medical image generation and their applications in radiotherapy

The aim of this systematic review is to determine whether Deep Learning (DL) algorithms can provide a clinically feasible alternative to classic algorithms for synthetic Computer Tomography (sCT). The following categories are presented in this study: ∙ MR-based treatment planning and synthetic CT generation techniques. ∙ Generation of synthetic CT images based on Cone Beam CT images. ∙ Low-dose CT to High-dose CT generation. ∙ Attenuation correction for PET images. To perform appropriate database searches, we reviewed journal articles published between January 2018 and June 2023. Current methodology, study strategies, and results with relevant clinical applications were analyzed as we outlined the state-of-the-art of deep learning based approaches to inter-modality and intra-modality image synthesis. This was accomplished by contrasting the provided methodologies with traditional research approaches. The key contributions of each category were highlighted, specific challenges were identified, and accomplishments were summarized. As a final step, the statistics of all the cited works from various aspects were analyzed, which revealed that DL-based sCTs have achieved considerable popularity, while also showing the potential of this technology. In order to assess the clinical readiness of the presented methods, we examined the current status of DL-based sCT generation.

Evaluating AI-generated CBCT-based synthetic CT images for target delineation in palliative treatments of pelvic bone metastasis at conventional C-arm linacs

PURPOSE

One-table treatments with treatment imaging, preparation and delivery occurring at one treatment couch, could increase patients' comfort and throughput for palliative treatments. On regular C-arm linacs, however, cone-beam CT (CBCT) imaging quality is currently insufficient. Therefore, our goal was to assess the suitability of AI-generated CBCT based synthetic CT (sCT) images for target delineation and treatment planning for palliative radiotherapy.

MATERIALS AND METHODS

CBCTs and planning CT-scans of 22 female patients with pelvic bone metastasis were included. For each CBCT, a corresponding sCT image was generated by a deep learning model in ADMIRE 3.38.0. Radiation oncologists delineated 23 target volumes (TV) on the sCTs (TVsCT) and scored their delineation confidence. The delineations were transferred to planning CTs and manually adjusted if needed to yield gold standard target volumes (TVclin). TVsCT were geometrically compared to TVclin using Dice coefficient (DC) and Hausdorff Distance (HD). The dosimetric impact of TVsCT inaccuracies was evaluated for VMAT plans with different PTV margins.

RESULTS

Radiation oncologists scored the sCT quality as sufficient for 13/23 TVsCT (median: DC = 0.9, HD = 11 mm) and insufficient for 10/23 TVsCT (median: DC = 0.7, HD = 34 mm). For the sufficient category, remaining inaccuracies could be compensated by +1 to +4 mm additional margin to achieve coverage of V95% > 95% and V95% > 98%, respectively in 12/13 TVsCT.

CONCLUSION

The evaluated sCT quality allowed for accurate delineation for most targets. sCTs with insufficient quality could be identified accurately upfront. A moderate PTV margin expansion could address remaining delineation inaccuracies. Therefore, these findings support further exploration of CBCT based one-table treatments on C-arm linacs.

Simulation and pre-planning omitted radiotherapy (SPORT): a feasibility study for prostate cancer

This study explored the feasibility of on-couch intensity modulated radiotherapy (IMRT) planning for prostate cancer (PCa) on a cone-beam CT (CBCT)-based online adaptive RT platform without an individualized pre-treatment plan and contours. Ten patients with PCa previously treated with image-guided IMRT (60 Gy/20 fractions) were selected. In contrast to the routine online adaptive RT workflow, a novel approach was employed in which the same preplan that was optimized on one reference patient was adapted to generate individual on-couch/initial plans for the other nine test patients using Ethos emulator. Simulation CTs of the test patients were used as simulated online CBCT (sCBCT) for emulation. Quality assessments were conducted on synthetic CTs (sCT). Dosimetric comparisons were performed between on-couch plans, on-couch plans recomputed on the sCBCT and individually optimized plans for test patients. The median value of mean absolute difference between sCT and sCBCT was 74.7 HU (range 69.5-91.5 HU). The average CTV/PTV coverage by prescription dose was 100.0%/94.7%, and normal tissue constraints were met for the nine test patients in on-couch plans on sCT. Recalculating on-couch plans on the sCBCT showed about 0.7% reduction of PTV coverage and a 0.6% increasing of hotspot, and the dose difference of the OARs was negligible (<0.5 Gy). Hence, initial IMRT plans for new patients can be generated by adapting a reference patient's preplan with online contours, which had similar qualities to the conventional approach of individually optimized plan on the simulation CT. Further study is needed to identify selection criteria for patient anatomy most amenable to this workflow.

Artificial intelligence applied to image-guided radiation therapy (IGRT): a systematic review by the Young Group of the Italian Association of Radiotherapy and Clinical Oncology (yAIRO)

INTRODUCTION

The advent of image-guided radiation therapy (IGRT) has recently changed the workflow of radiation treatments by ensuring highly collimated treatments. Artificial intelligence (AI) and radiomics are tools that have shown promising results for diagnosis, treatment optimization and outcome prediction. This review aims to assess the impact of AI and radiomics on modern IGRT modalities in RT.

METHODS

A PubMed/MEDLINE and Embase systematic review was conducted to investigate the impact of radiomics and AI to modern IGRT modalities. The search strategy was "Radiomics" AND "Cone Beam Computed Tomography"; "Radiomics" AND "Magnetic Resonance guided Radiotherapy"; "Radiomics" AND "on board Magnetic Resonance Radiotherapy"; "Artificial Intelligence" AND "Cone Beam Computed Tomography"; "Artificial Intelligence" AND "Magnetic Resonance guided Radiotherapy"; "Artificial Intelligence" AND "on board Magnetic Resonance Radiotherapy" and only original articles up to 01.11.2022 were considered.

RESULTS

A total of 402 studies were obtained using the previously mentioned search strategy on PubMed and Embase. The analysis was performed on a total of 84 papers obtained following the complete selection process. Radiomics application to IGRT was analyzed in 23 papers, while a total 61 papers were focused on the impact of AI on IGRT techniques.

DISCUSSION

AI and radiomics seem to significantly impact IGRT in all the phases of RT workflow, even if the evidence in the literature is based on retrospective data. Further studies are needed to confirm these tools' potential and provide a stronger correlation with clinical outcomes and gold-standard treatment strategies.

Generating synthetic images from cone beam computed tomography using self-attention residual UNet for head and neck radiotherapy

Background and purpose

Accurate CT numbers in Cone Beam CT (CBCT) are crucial for precise dose calculations in adaptive radiotherapy (ART). This study aimed to generate synthetic CT (sCT) from CBCT using deep learning (DL) models in head and neck (HN) radiotherapy.

Materials and methods

A novel DL model, the 'self-attention-residual-UNet' (ResUNet), was developed for accurate sCT generation. ResUNet incorporates a self-attention mechanism in its long skip connections to enhance information transfer between the encoder and decoder. Data from 93 HN patients, each with planning CT (pCT) and first-day CBCT images were used. Model performance was evaluated using two DL approaches (non-adversarial and adversarial training) and two model types (2D axial only vs. 2.5D axial, sagittal, and coronal). ResUNet was compared with the traditional UNet through image quality assessment (Mean Absolute Error (MAE), Peak-Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM)) and dose calculation accuracy evaluation (DVH deviation and gamma evaluation (1 %/1mm)).

Results

Image similarity evaluation results for the 2.5D-ResUNet and 2.5D-UNet models were: MAE: 46±7 HU vs. 51±9 HU, PSNR: 66.6±2.0 dB vs. 65.8±1.8 dB, and SSIM: 0.81±0.04 vs. 0.79±0.05. There were no significant differences in dose calculation accuracy between DL models. Both models demonstrated DVH deviation below 0.5 % and a gamma-pass-rate (1 %/1mm) exceeding 97 %.

Conclusions

ResUNet enhanced CT number accuracy and image quality of sCT and outperformed UNet in sCT generation from CBCT. This method holds promise for generating precise sCT for HN ART.

Towards real-time EPID-based 3D in vivo dosimetry for IMRT with Deep Neural Networks: A feasibility study

We investigate the potential of the Deep Dose Estimate (DDE) neural network to predict 3D dose distributions inside patients with Monte Carlo (MC) accuracy, based on transmitted EPID signals and patient CTs. The network was trained using as input patient CTs and first-order dose approximations (FOD). Accurate dose distributions (ADD) simulated with MC were given as training targets. 83 pelvic CTs were used to simulate ADDs and respective EPID signals for subfields of prostate IMRT plans (gantry at 0∘). FODs were produced as backprojections from the EPID signals. 581 ADD-FOD sets were produced and divided into training and test sets. An additional dataset simulated with gantry at 90∘ (lateral set) was used for evaluating the performance of the DDE at different beam directions. The quality of the FODs and DDE-predicted dose distributions (DDEP) with respect to ADDs, from the test and lateral sets, was evaluated with gamma analysis (3%,2 mm). The passing rates between FODs and ADDs were as low as 46%, while for DDEPs the passing rates were above 97% for the test set. Meaningful improvements were also observed for the lateral set. The high passing rates for DDEPs indicate that the DDE is able to convert FODs into ADDs. Moreover, the trained DDE predicts the dose inside a patient CT within 0.6 s/subfield (GPU), in contrast to 14 h needed for MC (CPU-cluster). 3D in vivo dose distributions due to clinical patient irradiation can be obtained within seconds, with MC-like accuracy, potentially paving the way towards real-time EPID-based in vivo dosimetry.

Clinical evaluation of synthetic computed tomography methods in adaptive proton therapy of lung cancer patients

Background and purpose

Efficient workflows for adaptive proton therapy are of high importance. This study evaluated the possibility to replace repeat-CTs (reCTs) with synthetic CTs (sCTs), created based on cone-beam CTs (CBCTs), for flagging the need of plan adaptations in intensity-modulated proton therapy (IMPT) treatment of lung cancer patients.

Materials and methods

Forty-two IMPT patients were retrospectively included. For each patient, one CBCT and a same-day reCT were included. Two commercial sCT methods were applied; one based on CBCT number correction (Cor-sCT), and one based on deformable image registration (DIR-sCT). The clinical reCT workflow (deformable contour propagation and robust dose re-computation) was performed on the reCT as well as the two sCTs. The deformed target contours on the reCT/sCTs were checked by radiation oncologists and edited if needed. A dose-volume-histogram triggered plan adaptation method was compared between the reCT and the sCTs; patients needing a plan adaptation on the reCT but not on the sCT were denoted false negatives. As secondary evaluation, dose-volume-histogram comparison and gamma analysis (2%/2mm) were performed between the reCT and sCTs.

Results

There were five false negatives, two for Cor-sCT and three for DIR-sCT. However, three of these were only minor, and one was caused by tumour position differences between the reCT and CBCT and not by sCT quality issues. An average gamma pass rate of 93% was obtained for both sCT methods.

Conclusion

Both sCT methods were judged to be of clinical quality and valuable for reducing the amount of reCT acquisitions.

Enhancing Radiotherapy Workflow for Head and Neck Cancer with Artificial Intelligence: A Systematic Review

BACKGROUND

Head and neck cancer (HNC) is characterized by complex-shaped tumors and numerous organs at risk (OARs), inducing challenging radiotherapy (RT) planning, optimization, and delivery. In this review, we provided a thorough description of the applications of artificial intelligence (AI) tools in the HNC RT process.

METHODS

The PubMed database was queried, and a total of 168 articles (2016-2022) were screened by a group of experts in radiation oncology. The group selected 62 articles, which were subdivided into three categories, representing the whole RT workflow: (i) target and OAR contouring, (ii) planning, and (iii) delivery.

RESULTS

The majority of the selected studies focused on the OARs segmentation process. Overall, the performance of AI models was evaluated using standard metrics, while limited research was found on how the introduction of AI could impact clinical outcomes. Additionally, papers usually lacked information about the confidence level associated with the predictions made by the AI models.

CONCLUSIONS

AI represents a promising tool to automate the RT workflow for the complex field of HNC treatment. To ensure that the development of AI technologies in RT is effectively aligned with clinical needs, we suggest conducting future studies within interdisciplinary groups, including clinicians and computer scientists.

Deep learning based synthetic CT from cone beam CT generation for abdominal paediatric radiotherapy

Objective. Adaptive radiotherapy workflows require images with the quality of computed tomography (CT) for re-calculation and re-optimisation of radiation doses. In this work we aim to improve the quality of on-board cone beam CT (CBCT) images for dose calculation using deep learning.Approach. We propose a novel framework for CBCT-to-CT synthesis using cycle-consistent Generative Adversarial Networks (cycleGANs). The framework was tailored for paediatric abdominal patients, a challenging application due to the inter-fractional variability in bowel filling and small patient numbers. We introduced to the networks the concept of global residuals only learning and modified the cycleGAN loss function to explicitly promote structural consistency between source and synthetic images. Finally, to compensate for the anatomical variability and address the difficulties in collecting large datasets in the paediatric population, we applied a smart 2D slice selection based on the common field-of-view (abdomen) to our imaging dataset. This acted as a weakly paired data approach that allowed us to take advantage of scans from patients treated for a variety of malignancies (thoracic-abdominal-pelvic) for training purposes. We first optimised the proposed framework and benchmarked its performance on a development dataset. Later, a comprehensive quantitative evaluation was performed on an unseen dataset, which included calculating global image similarity metrics, segmentation-based measures and proton therapy-specific metrics.Main results. We found improved performance for our proposed method, compared to a baseline cycleGAN implementation, on image-similarity metrics such as Mean Absolute Error calculated for a matched virtual CT (55.0 ± 16.6 HU proposed versus 58.9 ± 16.8 HU baseline). There was also a higher level of structural agreement for gastrointestinal gas between source and synthetic images measured using the dice similarity coefficient (0.872 ± 0.053 proposed versus 0.846 ± 0.052 baseline). Differences found in water-equivalent thickness metrics were also smaller for our method (3.3 ± 2.4% proposed versus 3.7 ± 2.8% baseline).Significance. Our findings indicate that our innovations to the cycleGAN framework improved the quality and structure consistency of the synthetic CTs generated.

Improving synthetic CT accuracy by combining the benefits of multiple normalized preprocesses

PURPOSE

To investigate the effect of different normalization preprocesses in deep learning on the accuracy of different tissues in synthetic computed tomography (sCT) and to combine their advantages to improve the accuracy of all tissues.

METHODS

The cycle-consistent adversarial network (CycleGAN) model was used to generate sCT images from megavolt cone-beam CT (MVCBCT) images. In this study, 2639 head MVCBCT and CT image pairs from 203 patients were collected as a training set, and 249 image pairs from 29 patients were collected as a test set. We normalized the voxel values in images to 0 to 1 or -1 to 1, using two linear and five nonlinear normalization preprocessing methods to obtain seven data sets and compared the accuracy of different tissues in different sCT obtained from training these data. Finally, to combine the advantages of different normalization preprocessing methods, we obtained sCT_Blur by cropping, stitching, and smoothing (OpenCV's cv2.medianBlur, kernel size 5) each group of sCTs and evaluated its image quality and accuracy of OARs.

RESULTS

Different normalization preprocesses made sCT more accurate in different tissues. The proposed sCT_Blur took advantage of multiple normalization preprocessing methods, and all tissues are more accurate than the sCT obtained using a single conventional normalization method. Compared with other sCT images, the structural similarity of sCT_Blur versus CT was improved to 0.906 ± 0.019. The mean absolute errors of the CT numbers were reduced to 15.7 ± 4.1 HU, 23.2 ± 7.1 HU, 11.5 ± 4.1 HU, 212.8 ± 104.6 HU, 219.4 ± 35.1 HU, and 268.8 ± 88.8 HU for the oral cavity, parotid, spinal cord, cavity, mandible, and teeth, respectively.

CONCLUSION

The proposed approach combined the advantages of several normalization preprocessing methods to improve the accuracy of all tissues in sCT images, which is promising for improving the accuracy of dose calculations based on CBCT images in adaptive radiotherapy.

CBCT-to-CT Translation Using Registration-Based Generative Adversarial Networks in Patients with Head and Neck Cancer

Recently, deep learning with generative adversarial networks (GANs) has been applied in multi-domain image-to-image translation. This study aims to improve the image quality of cone-beam computed tomography (CBCT) by generating synthetic CT (sCT) that maintains the patient’s anatomy as in CBCT, while having the image quality of CT. As CBCT and CT are acquired at different time points, it is challenging to obtain paired images with aligned anatomy for supervised training. To address this limitation, the study incorporated a registration network (RegNet) into GAN during training. RegNet can dynamically estimate the correct labels, allowing supervised learning with noisy labels. The study developed and evaluated the approach using imaging data from 146 patients with head and neck cancer. The results showed that GAN trained with RegNet performed better than those trained without RegNet. Specifically, in the UNIT model trained with RegNet, the mean absolute error (MAE) was reduced from 40.46 to 37.21, the root mean-square error (RMSE) was reduced from 119.45 to 108.86, the peak signal-to-noise ratio (PSNR) was increased from 28.67 to 29.55, and the structural similarity index (SSIM) was increased from 0.8630 to 0.8791. The sCT generated from the model had fewer artifacts and retained the anatomical information as in CBCT.

Fan beam CT image synthesis from cone beam CT image using nested residual UNet based conditional generative adversarial network

A radiotherapy technique called Image-Guided Radiation Therapy adopts frequent imaging throughout a treatment session. Fan Beam Computed Tomography (FBCT) based planning followed by Cone Beam Computed Tomography (CBCT) based radiation delivery drastically improved the treatment accuracy. Furtherance in terms of radiation exposure and cost can be achieved if FBCT could be replaced with CBCT. This paper proposes a Conditional Generative Adversarial Network (CGAN) for CBCT-to-FBCT synthesis. Specifically, a new architecture called Nested Residual UNet (NR-UNet) is introduced as the generator of the CGAN. A composite loss function, which comprises adversarial loss, Mean Squared Error (MSE), and Gradient Difference Loss (GDL), is used with the generator. The CGAN utilises the inter-slice dependency in the input by taking three consecutive CBCT slices to generate an FBCT slice. The model is trained using Head-and-Neck (H&N) FBCT-CBCT images of 53 cancer patients. The synthetic images exhibited a Peak Signal-to-Noise Ratio of 34.04±0.93 dB, Structural Similarity Index Measure of 0.9751±0.001 and a Mean Absolute Error of 14.81±4.70 HU. On average, the proposed model guarantees an improvement in Contrast-to-Noise Ratio four times better than the input CBCT images. The model also minimised the MSE and alleviated blurriness. Compared to the CBCT-based plan, the synthetic image results in a treatment plan closer to the FBCT-based plan. The three-slice to single-slice translation captures the three-dimensional contextual information in the input. Besides, it withstands the computational complexity associated with a three-dimensional image synthesis model. Furthermore, the results demonstrate that the proposed model is superior to the state-of-the-art methods.

Adaptive radiotherapy for breast cancer

Research in the field of local and locoregional breast cancer radiotherapy aims to maintain excellent oncological outcomes while reducing treatment-related toxicity. Adaptive radiotherapy (ART) considers variations in target and organs at risk (OARs) anatomy occurring during the treatment course and integrates these in re-optimized treatment plans. Exploiting ART routinely in clinic may result in smaller target volumes and better OAR sparing, which may lead to reduction of acute as well as late toxicities. In this review MR-guided and CT-guided ART for breast cancer patients according to different clinical scenarios (neoadjuvant and adjuvant partial breast irradiation, whole breast, chest wall and regional nodal irradiation) are reviewed and their advantages as well as challenging aspects discussed.

Deep learning based unpaired image-to-image translation applications for medical physics: a systematic review

Purpose. There is a growing number of publications on the application of unpaired image-to-image (I2I) translation in medical imaging. However, a systematic review covering the current state of this topic for medical physicists is lacking. The aim of this article is to provide a comprehensive review of current challenges and opportunities for medical physicists and engineers to apply I2I translation in practice.Methods and materials. The PubMed electronic database was searched using terms referring to unpaired (unsupervised), I2I translation, and medical imaging. This review has been reported in compliance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. From each full-text article, we extracted information extracted regarding technical and clinical applications of methods, Transparent Reporting for Individual Prognosis Or Diagnosis (TRIPOD) study type, performance of algorithm and accessibility of source code and pre-trained models.Results. Among 461 unique records, 55 full-text articles were included in the review. The major technical applications described in the selected literature are segmentation (26 studies), unpaired domain adaptation (18 studies), and denoising (8 studies). In terms of clinical applications, unpaired I2I translation has been used for automatic contouring of regions of interest in MRI, CT, x-ray and ultrasound images, fast MRI or low dose CT imaging, CT or MRI only based radiotherapy planning, etc Only 5 studies validated their models using an independent test set and none were externally validated by independent researchers. Finally, 12 articles published their source code and only one study published their pre-trained models.Conclusion. I2I translation of medical images offers a range of valuable applications for medical physicists. However, the scarcity of external validation studies of I2I models and the shortage of publicly available pre-trained models limits the immediate applicability of the proposed methods in practice.

Streaking artifact reduction for CBCT-based synthetic CT generation in adaptive radiotherapy

BACKGROUND

Cone-beam computed tomography (CBCT) is widely used for daily image guidance in radiation therapy, enhancing the reproducibility of patient setup. However, its application in adaptive radiotherapy (ART) is limited by many imaging artifacts and inaccurate Hounsfield units (HUs). The correction of CBCT image is necessary and of great value for CBCT-based ART.

PURPOSE

To explore the synthetic CT (sCT) generation from CBCT images of thorax and abdomen patients, which usually surfer from serious artifacts duo to organ state changes. In this study, a streaking artifact reduction network (SARN) is proposed to reduce artifacts and combine with cycleGAN to generate high-quality sCT images from CBCT and achieve an accurate dose calculation.

METHODS

The proposed SARN was trained in a self-supervised manner. Artifact-CT images were generated from planning CT by random deformation and projection replacement, and SARN was trained based on paired artifact-CT and CT images. The planning CT and CBCT images of 260 patients with cancer, including 120 thoracic and 140 abdominal CT scans, were used to train and evaluate neural networks. The CBCT images of another 12 patients in late treatment fractions, which contained large anatomy changes, were also tested by trained models. The trained models include commonly used U-Net, cycleGAN, attention-gated cycleGAN (cycAT), and cascade models combined SARN with cycleGAN or cycAT. The generated sCT images were compared in terms of image quality and dose calculation accuracy.

RESULTS

The sCT images generated by SARN combined with cycleGAN and cycAT showed the best image quality, removed the most artifacts, and retained the normal anatomical structure. The SARN+cycleGAN performed best in streaking artifacts removal with the maximum percent integrity uniformity (PIU_m ) of 91.0% and minimum standard deviation (SD) of 35.4 HU for delineated artifact regions among all models. The mean absolute error (MAE) of CBCT images in the thorax and abdomen were 71.6 and 55.2 HU, respectively, using planning CT images after deformable registration as ground truth. Compared with CBCT, the thoracic and abdominal sCT images generated by each model had significantly improved image quality with smaller MAE (p < 0.05). The SARN+cycAT obtained the minimum MAEs of 42.5 HU in the thorax while SARN+cycleGAN got the minimum MAEs of 32.0 HU in the abdomen. The sCT generated by U-Net had a remarkably lower anatomical structure accuracy compared with the other models. The thoracic and abdominal sCT images generated by SARN+cycleGAN showed optimal dose calculation accuracy with gamma passing rates (2 mm/2%) of 98.2% and 96.9%, respectively.

CONCLUSIONS

The proposed SARN can reduce serious streaking artifacts in CBCT images. The SARN combined with cycleGAN can generate high-quality sCT images with fewer artifacts, high-accuracy HU values, and accurate anatomical structures, thus providing reliable dose calculation in ART.

Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation

Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable for medical imaging use cases. In an attempt to address this, we explore the effect of structure losses on the CycleGAN and propose a generalized frequency-based loss that aims at preserving the content in the frequency domain. We apply this loss to the use-case of cone-beam computed tomography (CBCT) translation to computed tomography (CT)-like quality. Synthetic CT (sCT) images generated from our methods are compared against baseline CycleGAN along with other existing structure losses proposed in the literature. Our methods (MAE: 85.5, MSE: 20433, NMSE: 0.026, PSNR: 30.02, SSIM: 0.935) quantitatively and qualitatively improve over the baseline CycleGAN (MAE: 88.8, MSE: 24244, NMSE: 0.03, PSNR: 29.37, SSIM: 0.935) across all investigated metrics and are more robust than existing methods. Furthermore, no observable artifacts or loss in image quality were observed. Finally, we demonstrated that sCTs generated using our methods have superior performance compared to the original CBCT images on selected downstream tasks.

Anatomical evaluation of deep-learning synthetic computed tomography images generated from male pelvis cone-beam computed tomography

Background and purpose

To improve cone-beam computed tomography (CBCT), deep-learning (DL)-models are being explored to generate synthetic CTs (sCT). The sCT evaluation is mainly focused on image quality and CT number accuracy. However, correct representation of daily anatomy of the CBCT is also important for sCTs in adaptive radiotherapy. The aim of this study was to emphasize the importance of anatomical correctness by quantitatively assessing sCT scans generated from CBCT scans using different paired and unpaired dl-models.

Materials and methods

Planning CTs (pCT) and CBCTs of 56 prostate cancer patients were included to generate sCTs. Three different dl-models, Dual-UNet, Single-UNet and Cycle-consistent Generative Adversarial Network (CycleGAN), were evaluated on image quality and anatomical correctness. The image quality was assessed using image metrics, such as Mean Absolute Error (MAE). The anatomical correctness between sCT and CBCT was quantified using organs-at-risk volumes and average surface distances (ASD).

Results

MAE was 24 Hounsfield Unit (HU) [range:19-30 HU] for Dual-UNet, 40 HU [range:34-56 HU] for Single-UNet and 41HU [range:37-46 HU] for CycleGAN. Bladder ASD was 4.5 mm [range:1.6-12.3 mm] for Dual-UNet, 0.7 mm [range:0.4-1.2 mm] for Single-UNet and 0.9 mm [range:0.4-1.1 mm] CycleGAN.

Conclusions

Although Dual-UNet performed best in standard image quality measures, such as MAE, the contour based anatomical feature comparison with the CBCT showed that Dual-UNet performed worst on anatomical comparison. This emphasizes the importance of adding anatomy based evaluation of sCTs generated by dl-models. For applications in the pelvic area, direct anatomical comparison with the CBCT may provide a useful method to assess the clinical applicability of dl-based sCT generation methods.

Accuracy and Feasibility of Synthetic CT for Lung Adaptive Radiotherapy: A Phantom Study

OBJECTIVES

The respiratory variations will lead to inconsistency between the actual delivery dose and the planning dose. How the minor interfractional amplitude changes affect the geometry and dose delivery accuracy remains to be investigated in the context of lung adaptive radiotherapy.

METHODS

Planning 4-dimensional-computed tomography and kV-cone beam computed tomography were scanned based on the Computerized Imaging Reference Systems phantom, which was employed to simulate the minor interfractional amplitude variations. The corresponding synthetic computed tomography for a particular motion pattern can be generated from Velocity program. Then a clinically meaningful synthetic computed tomography was analyzed through the geometrical and dosimetric assessment.

RESULTS

The image quality of synthetic computed tomography was improved obviously compared with cone beam computed tomography. Mean absolute error was minimized when no significant interfractional motion occurs and Velocity can be qualified for dealing with the regular breathing motion patterns. The mean percent hounsfield unit difference of the synthetic hounsfield unit values per organ relative to the planning 4-dimensional-computed tomography image was 22.3%. Under the same conditions, the mean percent hounsfield unit difference of the cone beam computed tomography hounsfield unit values per organ, relative to the planning 4-dimensional-computed tomography image was 83.9%. Overall, the accuracy of hounsfield unit in synthetic computed tomography was improved obviously and the variability of the synthetic image correlates with the planning 4-dimensional-computed tomography image variability. Meanwhile, the dose-volume histograms between planning 4-dimensional-computed tomography and synthetic computed tomography almost coincided each other, which indicates that Velocity program can qualify lung adaptive radiotherapy well when there were no interfractional respiratory variations. However, for cases with obvious interfractional amplitude change, the volume covered at least by 100% of the prescription dose was only 59.6% for that synthetic image.

CONCLUSION

The synthetic computed tomography images generated from Velocity were close to the real images in anatomy and dosimetry, which can make clinical lung adaptive radiotherapy possible based on the actual patient anatomy during treatment.

Deep learning for x-ray scatter correction in dedicated breast CT

BACKGROUND

Accurate correction of x-ray scatter in dedicated breast computed tomography (bCT) imaging may result in improved visual interpretation and is crucial to achieve quantitative accuracy during image reconstruction and analysis.

PURPOSE

To develop a deep learning (DL) model to correct for x-ray scatter in bCT projection images.

METHODS

A total of 115 patient scans acquired with a bCT clinical system were segmented into the major breast tissue types (skin, adipose, and fibroglandular tissue). The resulting breast phantoms were divided into training (n = 110) and internal validation cohort (n = 5). Training phantoms were augmented by a factor of four by random translation of the breast in the image field of view. Using a previously validated Monte Carlo (MC) simulation algorithm, 12 primary and scatter bCT projection images with a 30-degree step were generated from each phantom. For each projection, the thickness map and breast location in the field of view were also calculated. A U-Net based DL model was developed to estimate the scatter signal based on the total input simulated image and trained single-projection-wise, with the thickness map and breast location provided as additional inputs. The model was internally validated using MC-simulated projections and tested using an external data set of 10 phantoms derived from images acquired with a different bCT system. For this purpose, the mean relative difference (MRD) and mean absolute error (MAE) were calculated. To test for accuracy in reconstructed images, a full bCT acquisition was mimicked with MC-simulations and then assessed by calculating the MAE and the structural similarity (SSIM). Subsequently, scatter was estimated and subtracted from the bCT scans of three patients to obtain the scatter-corrected image. The scatter-corrected projections were reconstructed and compared with the uncorrected reconstructions by evaluating the correction of the cupping artifact, increase in image contrast, and contrast-to-noise ratio (CNR).

RESULTS

The mean MRD and MAE across all cases (min, max) for the internal validation set were 0.04% (-1.1%, 1.3%) and 2.94% (2.7%, 3.2%), while for the external test set they were -0.64% (-1.6%, 0.2%) and 2.84% (2.3%, 3.5%), respectively. For MC-simulated reconstruction slices, the computed SSIM was 0.99 and the MAE was 0.11% (range: 0%, 0.35%) with a single outlier slice of 2.06%. For the three patient bCT reconstructed images, the correction increased the contrast by a mean of 25% (range: 20%, 30%), and reduced the cupping artifact. The mean CNR increased by 0.32 after scatter correction, which was not found to be significant (95% confidence interval: [-0.01, 0.65], p = 0.059). The time required to correct the scatter in a single bCT projection was 0.2 s on an NVIDIA GeForce GTX 1080 GPU.

CONCLUSION

The developed DL model could accurately estimate scatter in bCT projection images and could enhance contrast and correct for cupping artifact in reconstructed patient images without significantly affecting the CNR. The time required for correction would allow its use in daily clinical practice, and the reported accuracy will potentially allow quantitative reconstructions.

A Comprehensive Survey on the Progress, Process, and Challenges of Lung Cancer Detection and Classification

Lung cancer is the primary reason of cancer deaths worldwide, and the percentage of death rate is increasing step by step. There are chances of recovering from lung cancer by detecting it early. In any case, because the number of radiologists is limited and they have been working overtime, the increase in image data makes it hard for them to evaluate the images accurately. As a result, many researchers have come up with automated ways to predict the growth of cancer cells using medical imaging methods in a quick and accurate way. Previously, a lot of work was done on computer-aided detection (CADe) and computer-aided diagnosis (CADx) in computed tomography (CT) scan, magnetic resonance imaging (MRI), and X-ray with the goal of effective detection and segmentation of pulmonary nodule, as well as classifying nodules as malignant or benign. But still, no complete comprehensive review that includes all aspects of lung cancer has been done. In this paper, every aspect of lung cancer is discussed in detail, including datasets, image preprocessing, segmentation methods, optimal feature extraction and selection methods, evaluation measurement matrices, and classifiers. Finally, the study looks into several lung cancer-related issues with possible solutions.

Daily dose evaluation based on corrected CBCTs for breast cancer patients: accuracy of dose and complication risk assessment

OBJECTIVES

The goal of this study is to validate different CBCT correction methods to select the superior method that can be used for dose evaluation in breast cancer patients with large anatomical changes treated with photon irradiation.

MATERIALS AND METHOD

Seventy-six breast cancer patients treated with a partial VMAT photon technique (70% conformal, 30% VMAT) were included in this study. All patients showed at least a 5 mm variation (swelling or shrinkage) of the breast on the CBCT compared to the planning-CT (pCT) and had a repeat-CT (rCT) for dose evaluation acquired within 3 days of this CBCT. The original CBCT was corrected using four methods: (1) HU-override correction (CBCT_HU), (2) analytical correction and conversion (CBCT_CC), (3) deep learning (DL) correction (CT_DL) and (4) virtual correction (CT_V). Image quality evaluation consisted of calculating the mean absolute error (MAE) and mean error (ME) within the whole breast clinical target volume (CTV) and the field of view of the CBCT minus 2 cm (CBCT-ROI) with respect to the rCT. The dose was calculated on all image sets using the clinical treatment plan for dose and gamma passing rate analysis.

RESULTS

The MAE of the CBCT-ROI was below 66 HU for all corrected CBCTs, except for the CBCT_HU with a MAE of 142 HU. No significant dose differences were observed in the CTV regions in the CBCT_CC, CT_DL and CT_v. Only the CBCT_HU deviated significantly (p < 0.01) resulting in 1.7% (± 1.1%) average dose deviation. Gamma passing rates were > 95% for 2%/2 mm for all corrected CBCTs.

CONCLUSION

The analytical correction and conversion, deep learning correction and virtual correction methods can be applied for an accurate CBCT correction that can be used for dose evaluation during the course of photon radiotherapy of breast cancer patients.

Deep learning-based 4D-synthetic CTs from sparse-view CBCTs for dose calculations in adaptive proton therapy

BACKGROUND

Time-resolved 4D cone beam-computed tomography (4D-CBCT) allows a daily assessment of patient anatomy and respiratory motion. However, 4D-CBCTs suffer from imaging artifacts that affect the CT number accuracy and prevent accurate proton dose calculations. Deep learning can be used to correct CT numbers and generate synthetic CTs (sCTs) that can enable CBCT-based proton dose calculations.

PURPOSE

In this work, sparse view 4D-CBCTs were converted into 4D-sCT utilizing a deep convolutional neural network (DCNN). 4D-sCTs were evaluated in terms of image quality and dosimetric accuracy to determine if accurate proton dose calculations for adaptive proton therapy workflows of lung cancer patients are feasible.

METHODS

A dataset of 45 thoracic cancer patients was utilized to train and evaluate a DCNN to generate 4D-sCTs, based on sparse view 4D-CBCTs reconstructed from projections acquired with a 3D acquisition protocol. Mean absolute error (MAE) and mean error were used as metrics to evaluate the image quality of single phases and average 4D-sCTs against 4D-CTs acquired on the same day. The dosimetric accuracy was checked globally (gamma analysis) and locally for target volumes and organs-at-risk (OARs) (lung, heart, and esophagus). Furthermore, 4D-sCTs were also compared to 3D-sCTs. To evaluate CT number accuracy, proton radiography simulations in 4D-sCT and 4D-CTs were compared in terms of range errors. The clinical suitability of 4D-sCTs was demonstrated by performing a 4D dose reconstruction using patient specific treatment delivery log files and breathing signals.

RESULTS

4D-sCTs resulted in average MAEs of 48.1 ± 6.5 HU (single phase) and 37.7 ± 6.2 HU (average). The global dosimetric evaluation showed gamma pass ratios of 92.3% ± 3.2% (single phase) and 94.4% ± 2.1% (average). The clinical target volume showed high agreement in D₉₈ between 4D-CT and 4D-sCT, with differences below 2.4% for all patients. Larger dose differences were observed in mean doses of OARs (up to 8.4%). The comparison with 3D-sCTs showed no substantial image quality and dosimetric differences for the 4D-sCT average. Individual 4D-sCT phases showed slightly lower dosimetric accuracy. The range error evaluation revealed that lung tissues cause range errors about three times higher than the other tissues.

CONCLUSION

In this study, we have investigated the accuracy of deep learning-based 4D-sCTs for daily dose calculations in adaptive proton therapy. Despite image quality differences between 4D-sCTs and 3D-sCTs, comparable dosimetric accuracy was observed globally and locally. Further improvement of 3D and 4D lung sCTs could be achieved by increasing CT number accuracy in lung tissues.

Assessment of CBCT-based synthetic CT generation accuracy for adaptive radiotherapy planning

PURPOSE

Cone-beam CT (CBCT)-based synthetic CT (sCT) dose calculation has the potential to make the adaptive radiotherapy (ART) pathway more efficient while removing subjectivity. This study assessed four sCT generation methods using 15 head-and-neck rescanned ART patients. Each patient's planning CT (pCT), rescan CT (rCT), and CBCT post-rCT was acquired with the CBCT deformably registered to the rCT (dCBCT).

METHODS

The four methods investigated were as follows: method 1-deformably registering the pCT to the dCBCT. Method 2-assigning six mass density values to the dCBCT. Method 3-iteratively removing artifacts and correcting the dCBCT Hounsfield units (HU). Method 4-using a cycle general adversarial network machine learning model (trained with 45 paired pCT and CBCT). Treatment plans were created on the rCT and recalculated on each sCT. Planning target volume (PTV) and organ-at-risk (OAR) structures were contoured by clinicians on the rCT (high-dose PTV, low-dose PTV, spinal canal, larynx, brainstem, and parotids) to allow the assessment of dose-volume histogram statistics at clinically relevant points.

RESULTS

The HU mean absolute error (MAE) and minimum dose gamma index pass rate (2%/2 mm) were calculated, and the generation time was measured for 15 patients using the rCT as the comparator. For methods 1-4 the MAE, gamma index analysis, and generation time were as follows: 59.7 HU, 100.0%, and 143 s; 164.2 HU, 95.2%, and 232 s; 75.7 HU, 99.9%, and 153 s; and 79.4 HU, 99.8%, and 112 s, respectively. Dose differences for PTVs and OARs were all <0.3 Gy except for method 2 (<0.5 Gy).

CONCLUSION

All methods were considered clinically viable. The machine learning method was found to be most suitable for clinical implementation due to its high dosimetric accuracy and short generation time. Further investigation is required for larger anatomical changes between the CBCT and pCT and for other anatomical sites.

Generation and Evaluation of Synthetic Computed Tomography (CT) from Cone-Beam CT (CBCT) by Incorporating Feature-Driven Loss into Intensity-Based Loss Functions in Deep Convolutional Neural Network

Simple Summary

Despite numerous benefits of cone-beam computed tomography (CBCT), its applications to radiotherapy were limited mainly due to degraded image quality. Recently, enhancing the CBCT image quality by generating synthetic CT image by deep convolutional neural network (CNN) has become frequent. Most of the previous works, however, generated synthetic CT with simple, classical intensity-driven loss in network training, while not specifying a full-package of verifications. This work trained the network by combining feature- and intensity-driven losses and attempted to demonstrate clinical relevance of the synthetic CT images by assessing both image similarity and dose calculating accuracy throughout a commercial Monte-Carlo.

Abstract

Deep convolutional neural network (CNN) helped enhance image quality of cone-beam computed tomography (CBCT) by generating synthetic CT. Most of the previous works, however, trained network by intensity-based loss functions, possibly undermining to promote image feature similarity. The verifications were not sufficient to demonstrate clinical applicability, either. This work investigated the effect of variable loss functions combining feature- and intensity-driven losses in synthetic CT generation, followed by strengthening the verification of generated images in both image similarity and dosimetry accuracy. The proposed strategy highlighted the feature-driven quantification in (1) training the network by perceptual loss, besides L1 and structural similarity (SSIM) losses regarding anatomical similarity, and (2) evaluating image similarity by feature mapping ratio (FMR), besides conventional metrics. In addition, the synthetic CT images were assessed in terms of dose calculating accuracy by a commercial Monte-Carlo algorithm. The network was trained with 50 paired CBCT-CT scans acquired at the same CT simulator and treatment unit to constrain environmental factors any other than loss functions. For 10 independent cases, incorporating perceptual loss into L1 and SSIM losses outperformed the other combinations, which enhanced FMR of image similarity by 10%, and the dose calculating accuracy by 1–2% of gamma passing rate in 1%/1mm criterion.

Deep learning methods for enhancing cone-beam CT image quality towards adaptive radiation therapy: A systematic review

The use of deep learning (DL) to improve cone-beam CT (CBCT) image quality has gained popularity as computational resources and algorithmic sophistication have advanced in tandem. CBCT imaging has the potential to facilitate online adaptive radiation therapy (ART) by utilizing up-to-date patient anatomy to modify treatment parameters before irradiation. Poor CBCT image quality has been an impediment to realizing ART due to the increased scatter conditions inherent to cone-beam acquisitions. Given the recent interest in DL applications in radiation oncology, and specifically DL for CBCT correction, we provide a systematic theoretical and literature review for future stakeholders. The review encompasses DL approaches for synthetic CT generation, as well as projection domain methods employed in the CBCT correction literature. We review trends pertaining to publications from January 2018 to April 2022 and condense their major findings - with emphasis on study design and deep learning techniques. Clinically relevant endpoints relating to image quality and dosimetric accuracy are summarised, highlighting gaps in the literature. Finally, we make recommendations for both clinicians and DL practitioners based on literature trends and the current DL state of the art methods utilized in radiation oncology. This article is protected by copyright. All rights reserved.

A Survey on Deep Learning for Precision Oncology

Precision oncology, which ensures optimized cancer treatment tailored to the unique biology of a patient’s disease, has rapidly developed and is of great clinical importance. Deep learning has become the main method for precision oncology. This paper summarizes the recent deep-learning approaches relevant to precision oncology and reviews over 150 articles within the last six years. First, we survey the deep-learning approaches categorized by various precision oncology tasks, including the estimation of dose distribution for treatment planning, survival analysis and risk estimation after treatment, prediction of treatment response, and patient selection for treatment planning. Secondly, we provide an overview of the studies per anatomical area, including the brain, bladder, breast, bone, cervix, esophagus, gastric, head and neck, kidneys, liver, lung, pancreas, pelvis, prostate, and rectum. Finally, we highlight the challenges and discuss potential solutions for future research directions.

Recent Applications of Artificial Intelligence in Radiotherapy: Where We Are and Beyond

In recent decades, artificial intelligence (AI) tools have been applied in many medical fields, opening the possibility of finding novel solutions for managing very complex and multifactorial problems, such as those commonly encountered in radiotherapy (RT). We conducted a PubMed and Scopus search to identify the AI application field in RT limited to the last four years. In total, 1824 original papers were identified, and 921 were analyzed by considering the phase of the RT workflow according to the applied AI approaches. AI permits the processing of large quantities of information, data, and images stored in RT oncology information systems, a process that is not manageable for individuals or groups. AI allows the iterative application of complex tasks in large datasets (e.g., delineating normal tissues or finding optimal planning solutions) and might support the entire community working in the various sectors of RT, as summarized in this overview. AI-based tools are now on the roadmap for RT and have been applied to the entire workflow, mainly for segmentation, the generation of synthetic images, and outcome prediction. Several concerns were raised, including the need for harmonization while overcoming ethical, legal, and skill barriers.

Artificial Intelligence in Radiation Therapy

Artificial intelligence (AI) has great potential to transform the clinical workflow of radiotherapy. Since the introduction of deep neural networks, many AI-based methods have been proposed to address challenges in different aspects of radiotherapy. Commercial vendors have started to release AI-based tools that can be readily integrated to the established clinical workflow. To show the recent progress in AI-aided radiotherapy, we have reviewed AI-based studies in five major aspects of radiotherapy including image reconstruction, image registration, image segmentation, image synthesis, and automatic treatment planning. In each section, we summarized and categorized the recently published methods, followed by a discussion of the challenges, concerns, and future development. Given the rapid development of AI-aided radiotherapy, the efficiency and effectiveness of radiotherapy in the future could be substantially improved through intelligent automation of various aspects of radiotherapy.

Generating synthesized computed tomography from CBCT using a conditional generative adversarial network for head and neck cancer patients

Purpose: To overcome the imaging artifacts and Hounsfield unit inaccuracy limitations of cone-beam computed tomography, a conditional generative adversarial network is proposed to synthesize high-quality computed tomography-like images from cone-beam computed tomography images. Methods: A total of 120 paired cone-beam computed tomography and computed tomography scans of patients with head and neck cancer who were treated during January 2019 and December 2020 retrospectively collected; the scans of 90 patients were assembled into training and validation datasets, and the scans of 30 patients were used in testing datasets. The proposed method integrates a U-Net backbone architecture with residual blocks into a conditional generative adversarial network framework to learn a mapping from cone-beam computed tomography images to pair planning computed tomography images. The mean absolute error, root-mean-square error, structural similarity index, and peak signal-to-noise ratio were used to assess the performance of this method compared with U-Net and CycleGAN. Results: The synthesized computed tomography images produced by the conditional generative adversarial network were visually similar to planning computed tomography images. The mean absolute error, root-mean-square error, structural similarity index, and peak signal-to-noise ratio calculated from test images generated by conditional generative adversarial network were all significantly different than CycleGAN and U-Net. The mean absolute error, root-mean-square error, structural similarity index, and peak signal-to-noise ratio values between the synthesized computed tomography and the reference computed tomography were 16.75 ± 11.07 Hounsfield unit, 58.15 ± 28.64 Hounsfield unit, 0.92 ± 0.04, and 30.58 ± 3.86 dB in conditional generative adversarial network, 20.66 ± 12.15 Hounsfield unit, 66.53 ± 29.73 Hounsfield unit, 0.90 ± 0.05, and 29.29 ± 3.49 dB in CycleGAN, and 16.82 ± 10.99 Hounsfield unit, 58.68 ± 28.34 Hounsfield unit, 0.92 ± 0.04, and 30.48 ± 3.83 dB in U-Net, respectively. Conclusions: The synthesized computed tomography generated from the cone-beam computed tomography-based conditional generative adversarial network method has accurate computed tomography numbers while keeping the same anatomical structure as cone-beam computed tomography. It can be used effectively for quantitative applications in radiotherapy.

Geometric and Dosimetric Evaluation of Deep Learning-Based Automatic Delineation on CBCT-Synthesized CT and Planning CT for Breast Cancer Adaptive Radiotherapy: A Multi-Institutional Study

Purpose

We developed a deep learning model to achieve automatic multitarget delineation on planning CT (pCT) and synthetic CT (sCT) images generated from cone-beam CT (CBCT) images. The geometric and dosimetric impact of the model was evaluated for breast cancer adaptive radiation therapy.

Methods

We retrospectively analyzed 1,127 patients treated with radiotherapy after breast-conserving surgery from two medical institutions. The CBCT images for patient setup acquired utilizing breath-hold guided by optical surface monitoring system were used to generate sCT with a generative adversarial network. Organs at risk (OARs), clinical target volume (CTV), and tumor bed (TB) were delineated automatically with a 3D U-Net model on pCT and sCT images. The geometric accuracy of the model was evaluated with metrics, including Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95). Dosimetric evaluation was performed by quick dose recalculation on sCT images relying on gamma analysis and dose-volume histogram (DVH) parameters. The relationship between ΔD95, ΔV95 and DSC-CTV was assessed to quantify the clinical impact of the geometric changes of CTV.

Results

The ranges of DSC and HD95 were 0.73–0.97 and 2.22–9.36 mm for pCT, 0.63–0.95 and 2.30–19.57 mm for sCT from institution A, 0.70–0.97 and 2.10–11.43 mm for pCT from institution B, respectively. The quality of sCT was excellent with an average mean absolute error (MAE) of 71.58 ± 8.78 HU. The mean gamma pass rate (3%/3 mm criterion) was 91.46 ± 4.63%. DSC-CTV down to 0.65 accounted for a variation of more than 6% of V95 and 3 Gy of D95. DSC-CTV up to 0.80 accounted for a variation of less than 4% of V95 and 2 Gy of D95. The mean ΔD90/ΔD95 of CTV and TB were less than 2Gy/4Gy, 4Gy/5Gy for all the patients. The cardiac dose difference in left breast cancer cases was larger than that in right breast cancer cases.

Conclusions

The accurate multitarget delineation is achievable on pCT and sCT via deep learning. The results show that dose distribution needs to be considered to evaluate the clinical impact of geometric variations during breast cancer radiotherapy.

Clinical suitability of deep learning based synthetic CTs for adaptive proton therapy of lung cancer

Purpose

Adaptive proton therapy (APT) of lung cancer patients requires frequent volumetric imaging of diagnostic quality. Cone‐beam CT (CBCT) can provide these daily images, but x‐ray scattering limits CBCT‐image quality and hampers dose calculation accuracy. The purpose of this study was to generate CBCT‐based synthetic CTs using a deep convolutional neural network (DCNN) and investigate image quality and clinical suitability for proton dose calculations in lung cancer patients.

Methods

A dataset of 33 thoracic cancer patients, containing CBCTs, same‐day repeat CTs (rCT), planning‐CTs (pCTs), and clinical proton treatment plans, was used to train and evaluate a DCNN with and without a pCT‐based correction method. Mean absolute error (MAE), mean error (ME), peak signal‐to‐noise ratio, and structural similarity were used to quantify image quality. The evaluation of clinical suitability was based on recalculation of clinical proton treatment plans. Gamma pass ratios, mean dose to target volumes and organs at risk, and normal tissue complication probabilities (NTCP) were calculated. Furthermore, proton radiography simulations were performed to assess the HU‐accuracy of sCTs in terms of range errors.

Results

On average, sCTs without correction resulted in a MAE of 34 ± 6 HU and ME of 4 ± 8 HU. The correction reduced the MAE to 31 ± 4HU (ME to 2 ± 4HU). Average 3%/3 mm gamma pass ratios increased from 93.7% to 96.8%, when the correction was applied. The patient specific correction reduced mean proton range errors from 1.5 to 1.1 mm. Relative mean target dose differences between sCTs and rCT were below ± 0.5% for all patients and both synthetic CTs (with/without correction). NTCP values showed high agreement between sCTs and rCT (<2%).

Conclusion

CBCT‐based sCTs can enable accurate proton dose calculations for APT of lung cancer patients. The patient specific correction method increased the image quality and dosimetric accuracy but had only a limited influence on clinically relevant parameters.

Deep learning-based thoracic CBCT correction with histogram matching

Kilovoltage cone-beam computed tomography (CBCT)-based image-guided radiation therapy (IGRT) is used for daily delivery of radiation therapy, especially for stereotactic body radiation therapy (SBRT), which imposes particularly high demands for setup accuracy. The clinical applications of CBCTs are constrained, however, by poor soft tissue contrast, image artifacts, and instability of Hounsfield unit (HU) values. Here, we propose a new deep learning-based method to generate synthetic CTs (sCT) from thoracic CBCTs. A deep-learning model which integrates histogram matching (HM) into a cycle-consistent adversarial network (Cycle-GAN) framework, called HM-Cycle-GAN, was trained to learn mapping between thoracic CBCTs and paired planning CTs. Perceptual supervision was adopted to minimize blurring of tissue interfaces. An informative maximizing loss was calculated by feeding CBCT into the HM-Cycle-GAN to evaluate the image histogram matching between the planning CTs and the sCTs. The proposed algorithm was evaluated using data from 20 SBRT patients who each received 5 fractions and therefore 5 thoracic CBCTs. To reduce the effect of anatomy mismatch, original CBCT images were pre-processed via deformable image registrations with the planning CT before being used in model training and result assessment. We used planning CTs as ground truth for the derived sCTs from the correspondent co-registered CBCTs. The mean absolute error (MAE), peak signal-to-noise ratio (PSNR), and normalized cross-correlation (NCC) indices were adapted as evaluation metrics of the proposed algorithm. Assessments were done using Cycle-GAN as the benchmark. The average MAE, PSNR, and NCC of the sCTs generated by our method were 66.2 HU, 30.3 dB, and 0.95, respectively, over all CBCT fractions. Superior image quality and reduced noise and artifact severity were seen using the proposed method compared to the results from the standard Cycle-GAN method. Our method could therefore improve the accuracy of IGRT and corrected CBCTs could help improve online adaptive RT by offering better contouring accuracy and dose calculation.

Cone beam CT-based dose accumulation and analysis of delivered dose to the dominant intraprostatic lesion in primary radiotherapy of prostate cancer

Background

Evaluation of delivered dose to the dominant intraprostatic lesion (DIL) for moderately hypofractionated radiotherapy of prostate cancer by cone beam computed tomography (CBCT)-based dose accumulation and target coverage analysis.

Methods

Twenty-three patients with localized prostate cancer treated with moderately hypofractionated prostate radiotherapy with simultaneous integrated boost (SIB) between December 2016 and February 2020 were retrospectively analyzed. Included patients were required to have an identifiable DIL on bi-parametric planning magnetic resonance imaging (MRI). After import into the RayStation treatment planning system and application of a step-wise density override, the fractional doses were computed on each CBCT and were consecutively mapped onto the planning CT via a deformation vector field derived from deformable image registration. Fractional doses were accumulated for all CBCTs and interpolated for missing CBCTs, resulting in the delivered dose for PTV_DIL, PTV_Boost, PTV, and the organs at risk. The location of the index lesions was recorded according to the sector map of the Prostate Imaging Reporting and Data System (PIRADS) Version 2.1. Target coverage of the index lesions was evaluated and stratified for location.

Results

In total, 338 CBCTs were available for analysis. Dose accumulation target coverage of PTV_DIL, PTV_Boost, and PTV was excellent and no cases of underdosage in D_Mean, D_95%, D_02%, and D_98% could be detected. Delivered rectum D_Mean did not significantly differ from the planned dose. Bladder mean D_Mean was higher than planned with 19.4 ± 7.4 Gy versus 18.8 ± 7.5 Gy, p < 0.001. The penile bulb showed a decreased delivered mean D_Mean with 29.1 ± 14.0 Gy versus 29.8 ± 14.4 Gy, p < 0.001. Dorsal DILs, defined as DILs in the posterior medial peripheral zone of the prostate, showed a significantly lower delivered dose with a mean D_Mean difference of 2.2 Gy (95% CI 1.3–3.1 Gy, p < 0.001) compared to ventral lesions.

Conclusions

CBCT-based dose accumulation showed an adequate delivered dose to the dominant intraprostatic lesion and organs at risk within planning limits. Cautious evaluation of the target coverage for index lesions adjacent to the rectum is warranted to avoid underdosage.

Image-based shading correction for narrow-FOV truncated pelvic CBCT with deep convolutional neural networks and transfer learning

Purpose: Cone beam computed tomography (CBCT) is a standard solution for in‐room image guidance for radiation therapy. It is used to evaluate and compensate for anatomopathological changes between the dose delivery plan and the fraction delivery day. CBCT is a fast and versatile solution, but it suffers from drawbacks like low contrast and requires proper calibration to derive density values. Although these limitations are even more prominent with in‐room customized CBCT systems, strategies based on deep learning have shown potential in improving image quality. As such, this article presents a method based on a convolutional neural network and a novel two‐step supervised training based on the transfer learning paradigm for shading correction in CBCT volumes with narrow field of view (FOV) acquired with an ad hoc in‐room system.

Methods: We designed a U‐Net convolutional neural network, trained on axial slices of corresponding CT/CBCT couples. To improve the generalization capability of the network, we exploited two‐stage learning using two distinct data sets. At first, the network weights were trained using synthetic CBCT scans generated from a public data set, and then only the deepest layers of the network were trained again with real‐world clinical data to fine‐tune the weights. Synthetic data were generated according to real data acquisition parameters. The network takes a single grayscale volume as input and outputs the same volume with corrected shading and improved HU values.

Results: Evaluation was carried out with a leave‐one‐out cross‐validation, computed on 18 unique CT/CBCT pairs from six different patients from a real‐world dataset. Comparing original CBCT to CT and improved CBCT to CT, we obtained an average improvement of 6 dB on peak signal‐to‐noise ratio (PSNR), +2% on structural similarity index measure (SSIM). The median interquartile range (IQR) Hounsfield unit (HU) difference between CBCT and CT improved from 161.37 (162.54) HU to 49.41 (66.70) HU. Region of interest (ROI)‐based HU difference was narrowed by 75% in the spongy bone (femoral head), 89% in the bladder, 85% for fat, and 83% for muscle. The improvement in contrast‐to‐noise ratio for these ROIs was about 67%.

Conclusions: We demonstrated that shading correction obtaining CT‐compatible data from narrow‐FOV CBCTs acquired with a customized in‐room system is possible. Moreover, the transfer learning approach proved particularly beneficial for such a shading correction approach.

Deep learning based synthetic-CT generation in radiotherapy and PET: A review

Recently,deep learning (DL)-based methods for the generation of synthetic computed tomography (sCT) have received significant research attention as an alternative to classical ones. We present here a systematic review of these methods by grouping them into three categories, according to their clinical applications: (i) to replace computed tomography in magnetic resonance (MR) based treatment planning, (ii) facilitate cone-beam computed tomography based image-guided adaptive radiotherapy, and (iii) derive attenuation maps for the correction of positron emission tomography. Appropriate database searching was performed on journal articles published between January 2014 and December 2020. The DL methods' key characteristics were extracted from each eligible study, and a comprehensive comparison among network architectures and metrics was reported. A detailed review of each category was given, highlighting essential contributions, identifying specific challenges, and summarizing the achievements. Lastly, the statistics of all the cited works from various aspects were analyzed, revealing the popularity and future trends and the potential of DL-based sCT generation. The current status of DL-based sCT generation was evaluated, assessing the clinical readiness of the presented methods.

Dosimetric benefits of daily treatment plan adaptation for prostate cancer stereotactic body radiotherapy

BACKGROUND

Hypofractionation is increasingly being applied in radiotherapy for prostate cancer, requiring higher accuracy of daily treatment deliveries than in conventional image-guided radiotherapy (IGRT). Different adaptive radiotherapy (ART) strategies were evaluated with regard to dosimetric benefits.

METHODS

Treatments plans for 32 patients were retrospectively generated and analyzed according to the PACE-C trial treatment scheme (40 Gy in 5 fractions). Using a previously trained cycle-generative adversarial network algorithm, synthetic CT (sCT) were generated out of five daily cone-beam CT. Dose calculation on sCT was performed for four different adaptation approaches: IGRT without adaptation, adaptation via segment aperture morphing (SAM) and segment weight optimization (ART1) or additional shape optimization (ART2) as well as a full re-optimization (ART3). Dose distributions were evaluated regarding dose-volume parameters and a penalty score.

RESULTS

Compared to the IGRT approach, the ART1, ART2 and ART3 approaches substantially reduced the V37Gy(bladder) and V36Gy(rectum) from a mean of 7.4cm3 and 2.0cm3 to (5.9cm3, 6.1cm3, 5.2cm3) as well as to (1.4cm3, 1.4cm3, 1.0cm3), respectively. Plan adaptation required on average 2.6 min for the ART1 approach and yielded doses to the rectum being insignificantly different from the ART2 approach. Based on an accumulation over the total patient collective, a penalty score revealed dosimetric violations reduced by 79.2%, 75.7% and 93.2% through adaptation.

CONCLUSION

Treatment plan adaptation was demonstrated to adequately restore relevant dose criteria on a daily basis. While for SAM adaptation approaches dosimetric benefits were realized through ensuring sufficient target coverage, a full re-optimization mainly improved OAR sparing which helps to guide the decision of when to apply which adaptation strategy.

Efficient high cone-angle artifact reduction in circular cone-beam CT using deep learning with geometry-aware dimension reduction

High cone-angle artifacts (HCAAs) appear frequently in circular cone-beam computed tomography (CBCT) images and can heavily affect diagnosis and treatment planning. To reduce HCAAs in CBCT scans, we propose a novel deep learning approach that reduces the three-dimensional (3D) nature of HCAAs to two-dimensional (2D) problems in an efficient way. Specifically, we exploit the relationship between HCAAs and the rotational scanning geometry by training a convolutional neural network (CNN) using image slices that were radially sampled from CBCT scans. We evaluated this novel approach using a dataset of input CBCT scans affected by HCAAs and high-quality artifact-free target CBCT scans. Two different CNN architectures were employed, namely U-Net and a mixed-scale dense CNN (MS-D Net). The artifact reduction performance of the proposed approach was compared to that of a Cartesian slice-based artifact reduction deep learning approach in which a CNN was trained to remove the HCAAs from Cartesian slices. In addition, all processed CBCT scans were segmented to investigate the impact of HCAAs reduction on the quality of CBCT image segmentation. We demonstrate that the proposed deep learning approach with geometry-aware dimension reduction greatly reduces HCAAs in CBCT scans and outperforms the Cartesian slice-based deep learning approach. Moreover, the proposed artifact reduction approach markedly improves the accuracy of the subsequent segmentation task compared to the Cartesian slice-based workflow.