Cone-beam CT-derived relative stopping power map generation via deep learning for proton radiotherapy

The emerging role of Artificial Intelligence in proton therapy: A review

Artificial intelligence (AI) has made a tremendous impact in the space of healthcare, and proton therapy is not an exception. Proton therapy has witnessed growing popularity in oncology over recent decades, and researchers are increasingly looking to develop AI and machine learning tools to aid in various steps of the treatment planning and delivery processes. This review delves into the emergent role of AI in proton therapy, evaluating its development, advantages, intended clinical contexts, and areas of application. Through the analysis of 76 studies, we aim to underscore the importance of AI applications in advancing proton therapy and to highlight their prospective influence on clinical practices.

CT-based synthetic iodine map generation using conditional denoising diffusion probabilistic model

BACKGROUND

Iodine maps, derived from image-processing of contrast-enhanced dual-energy computed tomography (DECT) scans, highlight the differences in tissue iodine intake. It finds multiple applications in radiology, including vascular imaging, pulmonary evaluation, kidney assessment, and cancer diagnosis. In radiation oncology, it can contribute to designing more accurate and personalized treatment plans. However, DECT scanners are not commonly available in radiation therapy centers. Additionally, the use of iodine contrast agents is not suitable for all patients, especially those allergic to iodine agents, posing further limitations to the accessibility of this technology.

PURPOSE

The purpose of this work is to generate synthetic iodine map images from non-contrast single-energy CT (SECT) images using conditional denoising diffusion probabilistic model (DDPM).

METHODS

One-hundered twenty-six head-and-neck patients' images were retrospectively investigated in this work. Each patient underwent non-contrast SECT and contrast DECT scans. Ground truth iodine maps were generated from contrast DECT scans using commercial software syngo.via installed in the clinic. A conditional DDPM was implemented in this work to synthesize iodine maps. Three-fold cross-validation was conducted, with each iteration selecting the data from 42 patients as the test dataset and the remainder as the training dataset. Pixel-to-pixel generative adversarial network (GAN) and CycleGAN served as reference methods for evaluating the proposed DDPM method.

RESULTS

The accuracy of the proposed DDPM was evaluated using three quantitative metrics: mean absolute error (MAE) (1.039 ± 0.345 mg/mL), structural similarity index measure (SSIM) (0.89 ± 0.10) and peak signal-to-noise ratio (PSNR) (25.4 ± 3.5 db) respectively. Compared to the reference methods, the proposed technique showcased superior performance across the evaluated metrics, further validated by the paired two-tailed t-tests.

CONCLUSION

The proposed conditional DDPM framework has demonstrated the feasibility of generating synthetic iodine map images from non-contrast SECT images. This method presents a potential clinical application, which is providing accurate iodine contrast map in instances where only non-contrast SECT is accessible.

CT-based synthetic contrast-enhanced dual-energy CT generation using conditional denoising diffusion probabilistic model

Objective.The study aimed to generate synthetic contrast-enhanced Dual-energy CT (CE-DECT) images from non-contrast single-energy CT (SECT) scans, addressing the limitations posed by the scarcity of DECT scanners and the health risks associated with iodinated contrast agents, particularly for high-risk patients.Approach.A conditional denoising diffusion probabilistic model (C-DDPM) was utilized to create synthetic images. Imaging data were collected from 130 head-and-neck (HN) cancer patients who had undergone both non-contrast SECT and CE-DECT scans.Main Results.The performance of the C-DDPM was evaluated using Mean Absolute Error (MAE), Structural Similarity Index (SSIM), and Peak Signal-to-Noise Ratio (PSNR). The results showed MAE values of 27.37±3.35 Hounsfield Units (HU) for high-energy CT (H-CT) and 24.57±3.35HU for low-energy CT (L-CT), SSIM values of 0.74±0.22 for H-CT and 0.78±0.22 for L-CT, and PSNR values of 18.51±4.55 decibels (dB) for H-CT and 18.91±4.55 dB for L-CT.Significance.The study demonstrates the efficacy of the deep learning model in producing high-quality synthetic CE-DECT images, which significantly benefits radiation therapy planning. This approach provides a valuable alternative imaging solution for facilities lacking DECT scanners and for patients who are unsuitable for iodine contrast imaging, thereby enhancing the reach and effectiveness of advanced imaging in cancer treatment planning.

MRI-only based material mass density and relative stopping power estimation via deep learning for proton therapy: a preliminary study

Magnetic Resonance Imaging (MRI) is increasingly being used in treatment planning due to its superior soft tissue contrast, which is useful for tumor and soft tissue delineation compared to computed tomography (CT). However, MRI cannot directly provide mass density or relative stopping power (RSP) maps, which are required for calculating proton radiotherapy doses. Therefore, the integration of artificial intelligence (AI) into MRI-based treatment planning to estimate mass density and RSP directly from MRI has generated significant interest. A deep learning (DL) based framework was developed to establish a voxel-wise correlation between MR images and mass density as well as RSP. To facilitate the study, five tissue substitute phantoms were created, representing different tissues such as skin, muscle, adipose tissue, 45% hydroxyapatite (HA), and spongiosa bone. The composition of these phantoms was based on information from ICRP reports. Additionally, two animal tissue phantoms, simulating pig brain and liver, were prepared for DL training purposes. The phantom study involved the development of two DL models. The first model utilized clinical T1 and T2 MRI scans as input, while the second model incorporated zero echo time (ZTE) MRI scans. In the patient application study, two more DL models were trained: one using T1 and T2 MRI scans as input, and another model incorporating synthetic dual-energy computed tomography (sDECT) images to provide accurate bone tissue information. The DECT empirical model was used as a reference to evaluate the proposed models in both phantom and patient application studies. The DECT empirical model was selected as the reference for evaluating the proposed models in both phantom and patient application studies. In the phantom study, the DL model based on T1, and T2 MRI scans demonstrated higher accuracy in estimating mass density and RSP for skin, muscle, adipose tissue, brain, and liver. The mean absolute percentage errors (MAPE) were 0.42%, 0.14%, 0.19%, 0.78%, and 0.26% for mass density, and 0.30%, 0.11%, 0.16%, 0.61%, and 0.23% for RSP, respectively. The DL model incorporating ZTE MRI further improved the accuracy of mass density and RSP estimation for 45% HA and spongiosa bone, with MAPE values of 0.23% and 0.09% for mass density, and 0.19% and 0.07% for RSP, respectively. These results demonstrate the feasibility of using an MRI-only approach combined with DL methods for mass density and RSP estimation in proton therapy treatment planning. By employing this approach, it is possible to obtain the necessary information for proton radiotherapy directly from MRI scans, eliminating the need for additional imaging modalities.

Deep learning-based synthetic dose-weighted LET map generation for intensity modulated proton therapy

The advantage of proton therapy as compared to photon therapy stems from the Bragg peak effect, which allows protons to deposit most of their energy directly at the tumor while sparing healthy tissue. However, even with such benefits, proton therapy does present certain challenges. The biological effectiveness differences between protons and photons are not fully incorporated into clinical treatment planning processes. In current clinical practice, the relative biological effectiveness (RBE) between protons and photons is set as constant 1.1. Numerous studies have suggested that the RBE of protons can exhibit significant variability. Given these findings, there is a substantial interest in refining proton therapy treatment planning to better account for the variable RBE. Dose-average linear energy transfer (LETd) is a key physical parameter for evaluating the RBE of proton therapy and aids in optimizing proton treatment plans. Calculating precise LETddistributions necessitates the use of intricate physical models and the execution of specialized Monte-Carlo simulation software, which is a computationally intensive and time-consuming progress. In response to these challenges, we propose a deep learning based framework designed to predict the LETddistribution map using the dose distribution map. This approach aims to simplify the process and increase the speed of LETdmap generation in clinical settings. The proposed CycleGAN model has demonstrated superior performance over other GAN-based models. The mean absolute error (MAE), peak signal-to-noise ratio and normalized cross correlation of the LETdmaps generated by the proposed method are 0.096 ± 0.019 keVμm-1, 24.203 ± 2.683 dB, and 0.997 ± 0.002, respectively. The MAE of the proposed method in the clinical target volume, bladder, and rectum are 0.193 ± 0.103, 0.277 ± 0.112, and 0.211 ± 0.086 keVμm-1, respectively. The proposed framework has demonstrated the feasibility of generating synthetic LETdmaps from dose maps and has the potential to improve proton therapy planning by providing accurate LETdinformation.

Artificial intelligence applied to image-guided radiation therapy (IGRT): a systematic review by the Young Group of the Italian Association of Radiotherapy and Clinical Oncology (yAIRO)

INTRODUCTION

The advent of image-guided radiation therapy (IGRT) has recently changed the workflow of radiation treatments by ensuring highly collimated treatments. Artificial intelligence (AI) and radiomics are tools that have shown promising results for diagnosis, treatment optimization and outcome prediction. This review aims to assess the impact of AI and radiomics on modern IGRT modalities in RT.

METHODS

A PubMed/MEDLINE and Embase systematic review was conducted to investigate the impact of radiomics and AI to modern IGRT modalities. The search strategy was "Radiomics" AND "Cone Beam Computed Tomography"; "Radiomics" AND "Magnetic Resonance guided Radiotherapy"; "Radiomics" AND "on board Magnetic Resonance Radiotherapy"; "Artificial Intelligence" AND "Cone Beam Computed Tomography"; "Artificial Intelligence" AND "Magnetic Resonance guided Radiotherapy"; "Artificial Intelligence" AND "on board Magnetic Resonance Radiotherapy" and only original articles up to 01.11.2022 were considered.

RESULTS

A total of 402 studies were obtained using the previously mentioned search strategy on PubMed and Embase. The analysis was performed on a total of 84 papers obtained following the complete selection process. Radiomics application to IGRT was analyzed in 23 papers, while a total 61 papers were focused on the impact of AI on IGRT techniques.

DISCUSSION

AI and radiomics seem to significantly impact IGRT in all the phases of RT workflow, even if the evidence in the literature is based on retrospective data. Further studies are needed to confirm these tools' potential and provide a stronger correlation with clinical outcomes and gold-standard treatment strategies.

The Applications and Pitfalls of Cone-Beam Computed Tomography-Based Synthetic Computed Tomography for Adaptive Evaluation in Pencil-Beam Scanning Proton Therapy

PURPOSE

The study evaluates the efficacy of cone-beam computed tomography (CBCT)-based synthetic CTs (sCT) as a potential alternative to verification CT (vCT) for enhanced treatment monitoring and early adaptation in proton therapy.

METHODS

Seven common treatment sites were studied. Two sets of sCT per case were generated: direct-deformed (DD) sCT and image-correction (IC) sCT. The image qualities and dosimetric impact of the sCT were compared to the same-day vCT.

RESULTS

The sCT agreed with vCT in regions of homogeneous tissues such as the brain and breast; however, notable discrepancies were observed in the thorax and abdomen. The sCT outliers existed for DD sCT when there was an anatomy change and for IC sCT in low-density regions. The target coverage exhibited less than a 5% variance in most DD and IC sCT cases when compared to vCT. The Dmax of serial organ-at-risk (OAR) in sCT plans shows greater deviation from vCT than small-volume dose metrics (D0.1cc). The parallel OAR volumetric and mean doses remained consistent, with average deviations below 1.5%.

CONCLUSION

The use of sCT enables precise treatment and prompt early adaptation for proton therapy. The quality assurance of sCT is mandatory in the early stage of clinical implementation.

A generalizable new figure of merit for dose optimization in dual energy cone beam CT scanning protocols

Objective. This study proposes and evaluates a new figure of merit (FOMn) for dose optimization of Dual-energy cone-beam CT (DE-CBCT) scanning protocols based on size-dependent modeling of radiation dose and multi-scale image quality.Approach. FOMn was defined using Z-score normalization and was proportional to the dose efficiency providing better multi-scale image quality, including comprehensive contrast-to-noise ratio (CCNR) and electron density (CED) for CatPhan604 inserts of various materials. Acrylic annuluses were combined with CatPhan604 to create four phantom sizes (diameters of the long axis are 200 mm, 270 mm, 350 mm, and 380 mm, respectively). DE-CBCT was decomposed using image-domain iterative methods based on Varian kV-CBCT images acquired using 25 protocols (100 kVp and 140 kVp combined with 5 tube currents).Main results. The accuracy of CED was approximately 1% for all protocols, but degraded monotonically with the increased phantom sizes. Combinations of lower voltage + higher current and higher voltage + lower current were optimal protocols balancing CCNR and dose. The most dose-efficient protocols for CED and CCNR were inconsistent, underlining the necessity of including multi-scale image quality in the evaluation and optimization of DE-CBCT. Pediatric and adult anthropomorphic phantom tests confirmed dose-efficiency of FOMn-recommended protocols.Significance. FOMn is a comprehensive metric that collectively evaluates radiation dose and multi-scale image quality for DE-CBCT. The models and data can also serve as lookup tables, suggesting personalized dose-efficient protocols for specific clinical imaging purposes.

A hybrid method of correcting CBCT for proton range estimation with deep learning and deformable image registration

Objective. This study aimed to develop a novel method for generating synthetic CT (sCT) from cone-beam CT (CBCT) of the abdomen/pelvis with bowel gas pockets to facilitate estimation of proton ranges.Approach. CBCT, the same-day repeat CT, and the planning CT (pCT) of 81 pediatric patients were used for training (n= 60), validation (n= 6), and testing (n= 15) of the method. The proposed method hybridizes unsupervised deep learning (CycleGAN) and deformable image registration (DIR) of the pCT to CBCT. The CycleGAN and DIR are respectively applied to generate the geometry-weighted (high spatial-frequency) and intensity-weighted (low spatial-frequency) components of the sCT, thereby each process deals with only the component weighted toward its strength. The resultant sCT is further improved in bowel gas regions and other tissues by iteratively feeding back the sCT to adjust incorrect DIR and by increasing the contribution of the deformed pCT in regions of accurate DIR.Main results. The hybrid sCT was more accurate than deformed pCT and CycleGAN-only sCT as indicated by the smaller mean absolute error in CT numbers (28.7 ± 7.1 HU versus 38.8 ± 19.9 HU/53.2 ± 5.5 HU;P≤ 0.012) and higher Dice similarity of the internal gas regions (0.722 ± 0.088 versus 0.180 ± 0.098/0.659 ± 0.129;P≤ 0.002). Accordingly, the hybrid method resulted in more accurate proton range for the beams intersecting gas pockets (11 fields in 6 patients) than the individual methods (the 90th percentile error in 80% distal fall-off, 1.8 ± 0.6 mm versus 6.5 ± 7.8 mm/3.7 ± 1.5 mm;P≤ 0.013). The gamma passing rates also showed a significant dosimetric advantage by the hybrid method (99.7 ± 0.8% versus 98.4 ± 3.1%/98.3 ± 1.8%;P≤ 0.007).Significance. The hybrid method significantly improved the accuracy of sCT and showed promises in CBCT-based proton range verification and adaptive replanning of abdominal/pelvic proton therapy even when gas pockets are present in the beam path.

CBCT-Based Dose Monitoring and Adaptive Planning Triggers in Head and Neck PBS Proton Therapy

PURPOSE

To investigate the feasibility of using cone-beam computed tomography (CBCT)-derived synthetic CTs to monitor the daily dose and trigger a plan review for adaptive proton therapy (APT) in head and neck cancer (HNC) patients.

METHODS

For 84 HNC patients treated with proton pencil-beam scanning (PBS), same-day CBCT and verification CT (vfCT) pairs were retrospectively collected. The ground truth CT (gtCT) was created by deforming the vfCT to the same-day CBCT, and it was then used as a dosimetric baseline and for establishing plan review trigger recommendations. Two different synthetic CT algorithms were tested; the corrected CBCT (corrCBCT) was created using an iterative image correction method and the virtual CT (virtCT) was created by deforming the planning CT to the CBCT, followed by a low-density masking process. Clinical treatment plans were recalculated on the image sets for evaluation.

RESULTS

Plan review trigger criteria for adaptive therapy were established after closely reviewing the cohort data. Compared to the vfCT, the corrCBCT and virtCT reliably produced dosimetric data more similar to the gtCT. The average discrepancy in D99 for high-risk clinical target volumes (CTV) was 1.1%, 0.7%, and 0.4% and for standard-risk CTVs was 1.8%, 0.5%, and 0.5% for the vfCT, corrCBCT, and virtCT, respectively.

CONCLUSION

Streamlined APT has been achieved with the proposed plan review criteria and CBCT-based synthetic CT workflow.

Enhancing Radiotherapy Workflow for Head and Neck Cancer with Artificial Intelligence: A Systematic Review

BACKGROUND

Head and neck cancer (HNC) is characterized by complex-shaped tumors and numerous organs at risk (OARs), inducing challenging radiotherapy (RT) planning, optimization, and delivery. In this review, we provided a thorough description of the applications of artificial intelligence (AI) tools in the HNC RT process.

METHODS

The PubMed database was queried, and a total of 168 articles (2016-2022) were screened by a group of experts in radiation oncology. The group selected 62 articles, which were subdivided into three categories, representing the whole RT workflow: (i) target and OAR contouring, (ii) planning, and (iii) delivery.

RESULTS

The majority of the selected studies focused on the OARs segmentation process. Overall, the performance of AI models was evaluated using standard metrics, while limited research was found on how the introduction of AI could impact clinical outcomes. Additionally, papers usually lacked information about the confidence level associated with the predictions made by the AI models.

CONCLUSIONS

AI represents a promising tool to automate the RT workflow for the complex field of HNC treatment. To ensure that the development of AI technologies in RT is effectively aligned with clinical needs, we suggest conducting future studies within interdisciplinary groups, including clinicians and computer scientists.

Four-Dimensional Cone Beam CT Imaging Using a Single Routine Scan via Deep Learning

A novel method is proposed to obtain four-dimensional (4D) cone-beam computed tomography (CBCT) images from a routine scan in patients with upper abdominal cancer. The projections are sorted according to the location of the lung diaphragm before being reconstructed to phase-sorted data. A multiscale-discriminator generative adversarial network (MSD-GAN) is proposed to alleviate the severe streaking artifacts in the original images. The MSD-GAN is trained using simulated CBCT datasets from patient planning CT images. The enhanced images are further used to estimate the deformable vector field (DVF) among breathing phases using a deformable image registration method. The estimated DVF is then applied in the motion-compensated ordered-subset simultaneous algebraic reconstruction approach to generate 4D CBCT images. The proposed MSD-GAN is compared with U-Net on the performance of image enhancement. Results show that the proposed method significantly outperforms the total variation regularization-based iterative reconstruction approach and the method using only MSD-GAN to enhance original phase-sorted images in simulation and patient studies on 4D reconstruction quality. The MSD-GAN also shows higher accuracy than the U-Net. The proposed method enables a practical way for 4D-CBCT imaging from a single routine scan in upper abdominal cancer treatment including liver and pancreatic tumors.

Dosimetric evaluation of cone-beam CT-based synthetic CTs in pediatric patients undergoing intensity-modulated proton therapy

PURPOSE

To evaluate dosimetric changes detected using synthetic computed tomography (sCT) derived from online cone-beam CTs (CBCT) in pediatric patients treated using intensity-modulated proton therapy (IMPT).

METHODS

Ten pediatric patients undergoing IMPT and aligned daily using proton gantry-mounted CBCT were identified for retrospective analysis with treated anatomical sites fully encompassed in the CBCT field of view. Dates were identified when the patient received both a CBCT and a quality assurance CT (qCT) for routine dosimetric evaluation. sCTs were generated based on a deformable registration between the initial plan CT (pCT) and CBCT. The clinical IMPT plans were re-computed on the same day qCT and sCT, and dosimetric changes due to tissue change or response from the initial plan were computed using each image. Linear regression analysis was performed to determine the correlation between dosimetric changes detected using the qCT and the sCT. Gamma analysis was also used to compare the dose distributions computed on the qCT and sCT.

RESULTS

The correlation coefficients (p-values) between qCTs and sCTs for changes detected in target coverage, overall maximum dose, and organ at risk dose were 0.97 (< .001), 0.84 (.002) and 0.91 (< .001), respectively. Mean ± SD gamma pass rates of the sCT-based dose compared to the qCT-based dose at 3%/3 mm, 3%/2 mm, and 2%/2 mm criteria were 96.5%±4.5%, 93.2%±6.3%, and 91.3%±7.8%, respectively. Pass rates tended to be lower for targets near lung.

CONCLUSION

While insufficient for re-planning, sCTs provide approximate dosimetry without administering additional imaging dose in pediatric patients undergoing IMPT. Dosimetric changes detected using sCTs are correlated with changes detected using clinically-standard qCTs; however, residual differences in dosimetry remain a limitation. Further improvements in sCT image quality may both improve online dosimetric evaluation and reduce imaging dose for pediatric patients by reducing the need for routine qCTs.

Management of Motion and Anatomical Variations in Charged Particle Therapy: Past, Present, and Into the Future

The major aim of radiation therapy is to provide curative or palliative treatment to cancerous malignancies while minimizing damage to healthy tissues. Charged particle radiotherapy utilizing carbon ions or protons is uniquely suited for this task due to its ability to achieve highly conformal dose distributions around the tumor volume. For these treatment modalities, uncertainties in the localization of patient anatomy due to inter- and intra-fractional motion present a heightened risk of undesired dose delivery. A diverse range of mitigation strategies have been developed and clinically implemented in various disease sites to monitor and correct for patient motion, but much work remains. This review provides an overview of current clinical practices for inter and intra-fractional motion management in charged particle therapy, including motion control, current imaging and motion tracking modalities, as well as treatment planning and delivery techniques. We also cover progress to date on emerging technologies including particle-based radiography imaging, novel treatment delivery methods such as tumor tracking and FLASH, and artificial intelligence and discuss their potential impact towards improving or increasing the challenge of motion mitigation in charged particle therapy.

Adaptive proton therapy

Radiation therapy treatments are typically planned based on a single image set, assuming that the patient's anatomy and its position relative to the delivery system remains constant during the course of treatment. Similarly, the prescription dose assumes constant biological dose-response over the treatment course. However, variations can and do occur on multiple time scales. For treatment sites with significant intra-fractional motion, geometric changes happen over seconds or minutes, while biological considerations change over days or weeks. At an intermediate timescale, geometric changes occur between daily treatment fractions. Adaptive radiation therapy is applied to consider changes in patient anatomy during the course of fractionated treatment delivery. While traditionally adaptation has been done off-line with replanning based on new CT images, online treatment adaptation based on on-board imaging has gained momentum in recent years due to advanced imaging techniques combined with treatment delivery systems. Adaptation is particularly important in proton therapy where small changes in patient anatomy can lead to significant dose perturbations due to the dose conformality and finite range of proton beams. This review summarizes the current state-of-the-art of on-line adaptive proton therapy and identifies areas requiring further research.

Deep learning based synthetic-CT generation in radiotherapy and PET: A review

Recently,deep learning (DL)-based methods for the generation of synthetic computed tomography (sCT) have received significant research attention as an alternative to classical ones. We present here a systematic review of these methods by grouping them into three categories, according to their clinical applications: (i) to replace computed tomography in magnetic resonance (MR) based treatment planning, (ii) facilitate cone-beam computed tomography based image-guided adaptive radiotherapy, and (iii) derive attenuation maps for the correction of positron emission tomography. Appropriate database searching was performed on journal articles published between January 2014 and December 2020. The DL methods' key characteristics were extracted from each eligible study, and a comprehensive comparison among network architectures and metrics was reported. A detailed review of each category was given, highlighting essential contributions, identifying specific challenges, and summarizing the achievements. Lastly, the statistics of all the cited works from various aspects were analyzed, revealing the popularity and future trends and the potential of DL-based sCT generation. The current status of DL-based sCT generation was evaluated, assessing the clinical readiness of the presented methods.

A deep transfer learning approach for the detection and diagnosis of maxillary sinusitis on panoramic radiographs

To investigate the use of transfer learning when applying a deep learning source model from one institution (institution A) to another institution (institution B) for creating effective models (target models) for the detection of maxillary sinuses and diagnosis of maxillary sinusitis on panoramic radiographs. In addition, to determine appropriate numbers of training data for the transfer learning. Source model was created using 350 panoramic radiographs from institution A as training data. Transfer learning was performed by adding 25, 50, 100, 150, or 225 panoramic radiographs as training data from institution B to the source model; this yielded the target models T25, T50, T100, T150 and T225. Each model was then evaluated using test data that comprised 40 images from institution A, 30 images from institution B. The performance indices (recall, precision and F1 score) for detecting the maxillary sinuses by the source model exceeded 0.98 when using test data A from institution A, but they deteriorated when using test data B from institution B. In the evaluation of target models using test data B, model T25 showed improved detection performance (recall of 0.967). The diagnostic performance of model T50 for maxillary sinusitis exceeded 0.9 in sensitivity. Transfer learning, which involves applying a small amount of data to the source model, yielded high performances in detecting the maxillary sinuses and diagnosing the maxillary sinusitis on panoramic radiographs. This study serves as a reference when adapting source models to other institutions.

Training a deep neural network coping with diversities in abdominal and pelvic images of children and young adults for CBCT-based adaptive proton therapy

PURPOSE

To train a deep neural network for correcting abdominal and pelvic cone-beam computed tomography (CBCT) of children and young adults in the presence of diverse patient size, anatomic extent, and scan parameters.

MATERIALS AND METHODS

Pretreatment CBCT and planning/repeat CT image pairs from 64 children and young adults treated with proton therapy (aged 1-23 years) were analyzed. To evaluate the impact of anatomic extent in CBCT and data size in the training data, we compared the performance of three cycle-consistent generative adversarial network models that were separately trained by three datasets comprising abdominal (n = 21), pelvic (n = 29), and combined abdominal-pelvic image pairs (n = 50), respectively. The maximum body width of each patient was normalized to a fixed width before training and model application to reduce the impact of variations in body size. The corrected CBCT images by the three models were comparatively evaluated against the repeat CT closest in time to the CBCT (median gap, 0 days; range, 0-6 days) in HU accuracy, estimated dose distribution, and proton range.

RESULTS

The network model trained by the combined dataset significantly outperformed the abdomen and pelvis models in mean absolute HU error of the corrected CBCT from 14 testing patients (47 ± 7 HU versus 51 ± 8 HU; paired Wilcoxon signed-rank test, P < 0.01). The larger error (60 ± 7 HU) without the body-size normalization confirmed the efficacy of the preprocessing. The model trained with the combined dataset resulted in gamma passing rates of 98.5 ± 1.9% (2%/2 mm criterion) and the range (80% distal fall-off) differences from the reference within ±3 mm for 91.2 ± 11.5% beamlets.

CONCLUSION

Combining data from adjacent anatomic sites and normalizing age-dependent body sizes in children and young adults were beneficial in training a neural network to accurately estimate proton dose from CBCT despite limited training data size and anatomic diversities.

A review of deep learning based methods for medical image multi-organ segmentation

Deep learning has revolutionized image processing and achieved the-state-of-art performance in many medical image segmentation tasks. Many deep learning-based methods have been published to segment different parts of the body for different medical applications. It is necessary to summarize the current state of development for deep learning in the field of medical image segmentation. In this paper, we aim to provide a comprehensive review with a focus on multi-organ image segmentation, which is crucial for radiotherapy where the tumor and organs-at-risk need to be contoured for treatment planning. We grouped the surveyed methods into two broad categories which are 'pixel-wise classification' and 'end-to-end segmentation'. Each category was divided into subgroups according to their network design. For each type, we listed the surveyed works, highlighted important contributions and identified specific challenges. Following the detailed review, we discussed the achievements, shortcomings and future potentials of each category. To enable direct comparison, we listed the performance of the surveyed works that used thoracic and head-and-neck benchmark datasets.

Learning-Based Stopping Power Mapping on Dual-Energy CT for Proton Radiation Therapy

Purpose

Dual-energy computed tomography (DECT) has been used to derive relative stopping power (RSP) maps by obtaining the energy dependence of photon interactions. The DECT-derived RSP maps could potentially be compromised by image noise levels and the severity of artifacts when using physics-based mapping techniques. This work presents a noise-robust learning-based method to predict RSP maps from DECT for proton radiation therapy.

Materials and Methods

The proposed method uses a residual attention cycle-consistent generative adversarial network to bring DECT-to-RSP mapping close to a 1-to-1 mapping by introducing an inverse RSP-to-DECT mapping. To evaluate the proposed method, we retrospectively investigated 20 head-and-neck cancer patients with DECT scans in proton radiation therapy simulation. Ground truth RSP values were assigned by calculation based on chemical compositions and acted as learning targets in the training process for DECT datasets; they were evaluated against results from the proposed method using a leave-one-out cross-validation strategy.

Results

The predicted RSP maps showed an average normalized mean square error of 2.83% across the whole body volume and an average mean error less than 3% in all volumes of interest. With additional simulated noise added in DECT datasets, the proposed method still maintained a comparable performance, while the physics-based stoichiometric method suffered degraded inaccuracy from increased noise level. The average differences from ground truth in dose volume histogram metrics for clinical target volumes were less than 0.2 Gy for D_95% and D_max with no statistical significance. Maximum difference in dose volume histogram metrics of organs at risk was around 1 Gy on average.

Conclusion

These results strongly indicate the high accuracy of RSP maps predicted by our machine-learning–based method and show its potential feasibility for proton treatment planning and dose calculation.