Deep learning prediction of proton and photon dose distributions for paediatric abdominal tumours

Deep learning applied to dose prediction in external radiation therapy: A narrative review

Over the last decades, the use of artificial intelligence, machine learning and deep learning in medical fields has skyrocketed. Well known for their results in segmentation, motion management and posttreatment outcome tasks, investigations of machine learning and deep learning models as fast dose calculation or quality assurance tools have been present since 2000. The main motivation for this increasing research and interest in artificial intelligence, machine learning and deep learning is the enhancement of treatment workflows, specifically dosimetry and quality assurance accuracy and time points, which remain important time-consuming aspects of clinical patient management. Since 2014, the evolution of models and architectures for dose calculation has been related to innovations and interest in the theory of information research with pronounced improvements in architecture design. The use of knowledge-based approaches to patient-specific methods has also considerably improved the accuracy of dose predictions. This paper covers the state of all known deep learning architectures and models applied to external radiotherapy with a description of each architecture, followed by a discussion on the performance and future of deep learning predictive models in external radiotherapy.

The partial adaptation strategy for online-adaptive proton therapy: A proof of concept study in head and neck cancer patients

BACKGROUND

The accuracy of intensity-modulated proton therapy (IMPT) is greatly affected by anatomy variations that might occur during the treatment course. Online plan adaptations have been proposed as a solution to intervene promptly during a treatment session once the anatomy changes are detected. The implementation of online-adaptive proton therapy (OAPT) is still hindered by time-consuming tasks in the workflow.

PURPOSE

The study introduces the novel concept of partial adaptation and aims at investigating its feasibility as a potential solution to parallelize tasks during an OAPT workflow for saving valuable in-room time.

METHODS

The proof-of-principle simulation study includes datasets from six head and neck cancer (HNC) patients, each consisting of one planning CT (pCT) and three contoured control CTs (cCTs). Robust 3-field normo-fractionated initial IMPT plans were generated on the pCTs with a standardized field configuration, delivering 66 Gy and 54 Gy to the high-risk and low-risk clinical target volume (CTVHigh and CTVLow), respectively. For each cCT, a dose-mimicking-based partial adaptation was applied: two fields were adapted on the current anatomy taking into account the background dose of the first non-adapted field supposedly delivered in the meantime. Fraction doses on the cCTs resulting from partially adapted plans with different first (non-adapted) field assignments were compared against those from non-adapted and fully adapted plans regarding target coverage and organs at risk (OARs) sparing. The robustness of partially adapted plans was also evaluated.

RESULTS

Partially adapted plans showed comparable results to fully adapted plans and were superior to non-adapted plans for both target coverage and OAR sparing. Target coverage degradation in the non-adapted plans (median D98%: 95.9% and 97.5% for CTVLow and CTVHigh, respectively) was recovered by both partial (98.0% and 98.5%) and full adaptation (98.2% and 98.7%) in comparison to the initial plans (98.7% and 98.8%). The initial hotspot dose for the CTVHigh (median D2%: 101.8%) increased in the non-adapted plans (102.9%) and was recovered by the adaptive strategies (partial: 102.5%, full: 101.9%). The near-maximum dose (D0.01cc) to brainstem and spinal cord was within clinical constraints for all investigated dose distributions, but clearly increased for no adaptation and improved in the (both partially and fully) adapted plans with respect to the non-adapted ones. The parotids' median doses (D50) were mainly patient-specific depending on the proximity to the target region, but anyway lower for the partially and fully adapted plans compared to the non-adapted ones. OAR sparing was furthermore improved for the partially adapted plans in comparison to full adaptation. Robustness of the target dose metrics was preserved in all evaluated scenarios.

CONCLUSIONS

For OAPT of HNC patients, partial adaptation is able to generate plans of superior conformity to non-adapted plans and of comparable conformity as fully adapted plans, while having the potential to speed up the online-adaptive workflows. Thus, partial adaptation represents an intermediate approach until fast online adaptation workflows become available. Furthermore, it can be applied in workflows where online treatment verification stops the delivery and triggers an online adaptation for the remaining fraction.

Multi-center Dose Prediction Using Attention-aware Deep learning Algorithm Based on Transformers for Cervical Cancer Radiotherapy

AIMS

Accurate dose delivery is crucial for cervical cancer volumetric modulated arc therapy (VMAT). We aimed to develop a robust deep-learning (DL) algorithm for fast and accurate dose prediction of cervical cancer VMAT in multicenter datasets and then explore the feasibility of the DL algorithm to endometrial cancer VMAT with different prescriptions.

MATERIALS AND METHODS

We proposed the AtTranNet algorithm for three-dimensional dose prediction. A total of 367 cervical patients were enrolled in this study. Three hundred twenty-two cervical patients from 3 centers were randomly divided into 70%, 10%, and 20% as training, validation, and testing sets, respectively. Forty-five cervical patients from another center were selected for external testing. Moreover, 70 patients of endometrial cancer with different prescriptions were further selected to test the model. Prediction precision was evaluated by dosimetric difference, dose map, and dose-volume histogram metrics.

RESULTS

The prediction results were all clinically acceptable. The mean absolute error within the body in internal testing was 0.66 ± 0.63%. The maximum |δD| for planning target volume was observed in D98, which is 1.24 ± 2.73 Gy. The maximum |δD| for organs at risk was observed in Dmean of bladder, which is 4.79 ± 3.14 Gy. The maximum |δV| were observed in V40 of pelvic bones, which is 4.77 ± 4.48%.

CONCLUSION

AtTranNet showed the feasibility and reasonable accuracy in the dose prediction for cervical cancer in multiple centers. The model can also be generalized for endometrial cancer with different prescriptions without any transfer learning.

Evaluation of an automated clinical decision system with deep learning dose prediction and NTCP model for prostate cancer proton therapy

Objective.To evaluate the feasibility of using a deep learning dose prediction approach to identify patients who could benefit most from proton therapy based on the normal tissue complication probability (NTCP) model.Approach.Two 3D UNets were established to predict photon and proton doses. A dataset of 95 patients with localized prostate cancer was randomly partitioned into 55, 10, and 30 for training, validation, and testing, respectively. We selected NTCP models for late rectum bleeding and acute urinary urgency of grade 2 or higher to quantify the benefit of proton therapy. Propagated uncertainties of predicted ΔNTCPs resulting from the dose prediction errors were calculated. Patient selection accuracies for a single endpoint and a composite evaluation were assessed under different ΔNTCP thresholds.Main results.Our deep learning-based dose prediction technique can reduce the time spent on plan comparison from approximately 2 days to as little as 5 seconds. The expanded uncertainty of predicted ΔNTCPs for rectum and bladder endpoints propagated from the dose prediction error were 0.0042 and 0.0016, respectively, which is less than one-third of the acceptable tolerance. The averaged selection accuracies for rectum bleeding, urinary urgency, and composite evaluation were 90%, 93.5%, and 93.5%, respectively.Significance.Our study demonstrates that deep learning dose prediction and NTCP evaluation scheme could distinguish the NTCP differences between photon and proton treatment modalities. In addition, the dose prediction uncertainty does not significantly influence the decision accuracy of NTCP-based patient selection for proton therapy. Therefore, automated deep learning dose prediction and NTCP evaluation schemes can potentially be used to screen large patient populations and to avoid unnecessary delays in the start of prostate cancer radiotherapy in the future.

Assessment of bias in scoring of AI-based radiotherapy segmentation and planning studies using modified TRIPOD and PROBAST guidelines as an example

BACKGROUND AND PURPOSE

Studies investigating the application of Artificial Intelligence (AI) in the field of radiotherapy exhibit substantial variations in terms of quality. The goal of this study was to assess the amount of transparency and bias in scoring articles with a specific focus on AI based segmentation and treatment planning, using modified PROBAST and TRIPOD checklists, in order to provide recommendations for future guideline developers and reviewers.

MATERIALS AND METHODS

The TRIPOD and PROBAST checklist items were discussed and modified using a Delphi process. After consensus was reached, 2 groups of 3 co-authors scored 2 articles to evaluate usability and further optimize the adapted checklists. Finally, 10 articles were scored by all co-authors. Fleiss' kappa was calculated to assess the reliability of agreement between observers.

RESULTS

Three of the 37 TRIPOD items and 5 of the 32 PROBAST items were deemed irrelevant. General terminology in the items (e.g., multivariable prediction model, predictors) was modified to align with AI-specific terms. After the first scoring round, further improvements of the items were formulated, e.g., by preventing the use of sub-questions or subjective words and adding clarifications on how to score an item. Using the final consensus list to score the 10 articles, only 2 out of the 61 items resulted in a statistically significant kappa of 0.4 or more demonstrating substantial agreement. For 41 items no statistically significant kappa was obtained indicating that the level of agreement among multiple observers is due to chance alone.

CONCLUSION

Our study showed low reliability scores with the adapted TRIPOD and PROBAST checklists. Although such checklists have shown great value during development and reporting, this raises concerns about the applicability of such checklists to objectively score scientific articles for AI applications. When developing or revising guidelines, it is essential to consider their applicability to score articles without introducing bias.

Beam mask and sliding window-facilitated deep learning-based accurate and efficient dose prediction for pencil beam scanning proton therapy

BACKGROUND

Accurate and efficient dose calculation is essential for on-line adaptive planning in proton therapy. Deep learning (DL) has shown promising dose prediction results in photon therapy. However, there is a scarcity of DL-based dose prediction methods specifically designed for proton therapy. Successful dose prediction method for proton therapy should account for more challenging dose prediction problems in pencil beam scanning proton therapy (PBSPT) due to its sensitivity to heterogeneities.

PURPOSE

To develop a DL-based PBSPT dose prediction workflow with high accuracy and balanced complexity to support on-line adaptive proton therapy clinical decision and subsequent replanning.

METHODS

PBSPT plans of 103 prostate cancer patients (93 for training and the other 10 for independent testing) and 83 lung cancer patients (73 for training and the other 10 for independent testing) previously treated at our institution were included in the study, each with computed tomography scans (CTs), structure sets, and plan doses calculated by the in-house developed Monte-Carlo dose engine (considered as the ground truth in the model training and testing). For the ablation study, we designed three experiments corresponding to the following three methods: (1) Experiment 1, the conventional region of interest (ROI) (composed of targets and organs-at-risk [OARs]) method. (2) Experiment 2, the beam mask (generated by raytracing of proton beams) method to improve proton dose prediction. (3) Experiment 3, the sliding window method for the model to focus on local details to further improve proton dose prediction. A fully connected 3D-Unet was adopted as the backbone. Dose volume histogram (DVH) indices, 3D Gamma passing rates with a criterion of 3%/3 mm/10%, and dice coefficients for the structures enclosed by the iso-dose lines between the predicted and the ground truth doses were used as the evaluation metrics. The calculation time for each proton dose prediction was recorded to evaluate the method's efficiency.

RESULTS

Compared to the conventional ROI method, the beam mask method improved the agreement of DVH indices for both targets and OARs and the sliding window method further improved the agreement of the DVH indices (for lung cancer, CTV D98 absolute deviation: 0.74 ± 0.18 vs. 0.57 ± 0.21 vs. 0.54 ± 0.15 Gy[RBE], ROI vs. beam mask vs. sliding window methods, respectively). For the 3D Gamma passing rates in the target, OARs, and BODY (outside target and OARs), the beam mask method improved the passing rates in these regions and the sliding window method further improved them (for prostate cancer, targets: 96.93% ± 0.53% vs. 98.88% ± 0.49% vs. 99.97% ± 0.07%, BODY: 86.88% ± 0.74% vs. 93.21% ± 0.56% vs. 95.17% ± 0.59%). A similar trend was also observed for the dice coefficients. This trend was especially remarkable for relatively low prescription isodose lines (for lung cancer, 10% isodose line dice: 0.871 ± 0.027 vs. 0.911 ± 0.023 vs. 0.927 ± 0.017). The dose predictions for all the testing cases were completed within 0.25 s.

CONCLUSIONS

An accurate and efficient deep learning-augmented proton dose prediction framework has been developed for PBSPT, which can predict accurate dose distributions not only inside but also outside ROI efficiently. The framework can potentially further reduce the initial planning and adaptive replanning workload in PBSPT.

Invertible and Variable Augmented Network for Pretreatment Patient-Specific Quality Assurance Dose Prediction

Pretreatment patient-specific quality assurance (prePSQA) is conducted to confirm the accuracy of the radiotherapy dose delivered. However, the process of prePSQA measurement is time consuming and exacerbates the workload for medical physicists. The purpose of this work is to propose a novel deep learning (DL) network to improve the accuracy and efficiency of prePSQA. A modified invertible and variable augmented network was developed to predict the three-dimensional (3D) measurement-guided dose (MDose) distribution of 300 cancer patients who underwent volumetric modulated arc therapy (VMAT) between 2018 and 2021, in which 240 cases were randomly selected for training, and 60 for testing. For simplicity, the present approach was termed as "IVPSQA." The input data include CT images, radiotherapy dose exported from the treatment planning system, and MDose distribution extracted from the verification system. Adam algorithm was used for first-order gradient-based optimization of stochastic objective functions. The IVPSQA model obtained high-quality 3D prePSQA dose distribution maps in head and neck, chest, and abdomen cases, and outperformed the existing U-Net-based prediction approaches in terms of dose difference maps and horizontal profiles comparison. Moreover, quantitative evaluation metrics including SSIM, MSE, and MAE demonstrated that the proposed approach achieved a good agreement with ground truth and yield promising gains over other advanced methods. This study presented the first work on predicting 3D prePSQA dose distribution by using the IVPSQA model. The proposed method could be taken as a clinical guidance tool and help medical physicists to reduce the measurement work of prePSQA.

A narrative review of radiomics and deep learning advances in neuroblastoma: updates and challenges

Neuroblastoma is an extremely heterogeneous tumor that commonly occurs in children. The diagnosis and treatment of this tumor pose considerable challenges due to its varied clinical presentations and intricate genetic aberrations. Presently, various imaging modalities, including computed tomography, magnetic resonance imaging, and positron emission tomography, are utilized to assess neuroblastoma. Nevertheless, these conventional imaging modalities have limitations in providing quantitative information for accurate diagnosis and prognosis. Radiomics, an emerging technique, can extract intricate medical imaging information that is imperceptible to the human eye and transform it into quantitative data. In conjunction with deep learning algorithms, radiomics holds great promise in complementing existing imaging modalities. The aim of this review is to showcase the potential of radiomics and deep learning advancements to enhance the diagnostic capabilities of current imaging modalities for neuroblastoma.

Deep learning-based dose prediction to improve the plan quality of volumetric modulated arc therapy for gynecologic cancers

BACKGROUND

In recent years, deep-learning models have been used to predict entire three-dimensional dose distributions. However, the usability of dose predictions to improve plan quality should be further investigated.

PURPOSE

To develop a deep-learning model to predict high-quality dose distributions for volumetric modulated arc therapy (VMAT) plans for patients with gynecologic cancer and to evaluate their usability in driving plan quality improvements.

METHODS

A total of 79 VMAT plans for the female pelvis were used to train (47 plans), validate (16 plans), and test (16 plans) 3D dense dilated U-Net models to predict 3D dose distributions. The models received the normalized CT scan, dose prescription, and target and normal tissue contours as inputs. Three models were used to predict the dose distributions for plans in the test set. A radiation oncologist specializing in the treatment of gynecologic cancers scored the test set predictions using a 5-point scale (5, acceptable as-is; 4, prefer minor edits; 3, minor edits needed; 2, major edits needed; and 1, unacceptable). The clinical plans for which the dose predictions indicated that improvements could be made were reoptimized with constraints extracted from the predictions.

RESULTS

The predicted dose distributions in the test set were of comparable quality to the clinical plans. The mean voxel-wise dose difference was -0.14 ± 0.46 Gy. The percentage dose differences in the predicted target metrics ofD 1 % ${D}_{1{\mathrm{\% }}}$ andD 98 % ${D}_{98{\mathrm{\% }}}$ were -1.05% ± 0.59% and 0.21% ± 0.28%, respectively. The dose differences in the predicted organ at risk mean and maximum doses were -0.30 ± 1.66 Gy and -0.42 ± 2.07 Gy, respectively. A radiation oncologist deemed all of the predicted dose distributions clinically acceptable; 12 received a score of 5, and four received a score of 4. Replanning of flagged plans (five plans) showed that the original plans could be further optimized to give dose distributions close to the predicted dose distributions.

CONCLUSIONS

Deep-learning dose prediction can be used to predict high-quality and clinically acceptable dose distributions for VMAT female pelvis plans, which can then be used to identify plans that can be improved with additional optimization.

Patient selection for proton therapy using Normal Tissue Complication Probability with deep learning dose prediction for oropharyngeal cancer

BACKGROUND

In cancer care, determining the most beneficial treatment technique is a key decision affecting the patient's survival and quality of life. Patient selection for proton therapy (PT) over conventional radiotherapy (XT) currently entails comparing manually generated treatment plans, which requires time and expertise.

PURPOSE

We developed an automatic and fast tool, AI-PROTIPP (Artificial Intelligence Predictive Radiation Oncology Treatment Indication to Photons/Protons), that assesses quantitatively the benefits of each therapeutic option. Our method uses deep learning (DL) models to directly predict the dose distributions for a given patient for both XT and PT. By using models that estimate the Normal Tissue Complication Probability (NTCP), namely the likelihood of side effects to occur for a specific patient, AI-PROTIPP can propose a treatment selection quickly and automatically.

METHODS

A database of 60 patients presenting oropharyngeal cancer, obtained from the Cliniques Universitaires Saint Luc in Belgium, was used in this study. For every patient, a PT plan and an XT plan were generated. The dose distributions were used to train the two dose DL prediction models (one for each modality). The model is based on U-Net architecture, a type of convolutional neural network currently considered as the state of the art for dose prediction models. A NTCP protocol used in the Dutch model-based approach, including grades II and III xerostomia and grades II and III dysphagia, was later applied in order to perform automatic treatment selection for each patient. The networks were trained using a nested cross-validation approach with 11-folds. We set aside three patients in an outer set and each fold consists of 47 patients in training, five in validation and five for testing. This method allowed us to assess our method on 55 patients (five patients per test times the number of folds).

RESULTS

The treatment selection based on the DL-predicted doses reached an accuracy of 87.4% for the threshold parameters set by the Health Council of the Netherlands. The selected treatment is directly linked with these threshold parameters as they express the minimal gain brought by the PT treatment for a patient to be indicated to PT. To validate the performance of AI-PROTIPP in other conditions, we modulated these thresholds, and the accuracy was above 81% for all the considered cases. The difference in average cumulative NTCP per patient of predicted and clinical dose distributions is very similar (less than 1% difference).

CONCLUSIONS

AI-PROTIPP shows that using DL dose prediction in combination with NTCP models to select PT for patients is feasible and can help to save time by avoiding the generation of treatment plans only used for the comparison. Moreover, DL models are transferable, allowing, in the future, experience to be shared with centers that would not have PT planning expertise.

Deep learning-based dose map prediction for high-dose-rate brachytherapy

Background. Creating a clinically acceptable plan in the time-sensitive clinic workflow of brachytherapy is challenging. Deep learning-based dose prediction techniques have been reported as promising solutions with high efficiency and accuracy. However, current dose prediction studies mainly target EBRT which are inappropriate for brachytherapy, the model designed specifically for brachytherapy has not yet well-established.Purpose. To predict dose distribution in brachytherapy using a novel Squeeze and Excitation Attention Net (SE_AN) model.Method. We hypothesized the tracks of192Ir inside applicators are essential for brachytherapy dose prediction. To emphasize the applicator contribution, a novel SE module was integrated into a Cascaded UNet to recalibrate informative features and suppress less useful ones. The Cascaded UNet consists of two stacked UNets, with the first designed to predict coarse dose distribution and the second added for fine-tuning 250 cases including all typical clinical applicators were studied, including vaginal, tandem and ovoid, multi-channel, and free needle applicators. The developed SE_AN was subsequently compared to the classic UNet and classic Cascaded UNet (without SE module) models. The model performance was evaluated by comparing the predicted dose against the clinically approved plans using mean absolute error (MAE) of DVH metrics, includingD2ccandD90%.Results. The MAEs of DVH metrics demonstrated that SE_AN accurately predicted the dose with 0.37 ± 0.25 difference for HRCTVD90%, 0.23 ± 0.14 difference for bladderD2cc, and 0.28 ± 0.20 difference for rectumD2cc. In comparison studies, UNet achieved 0.34 ± 0.24 for HRCTV, 0.25 ± 0.20 for bladder, 0.25 ± 0.21 for rectum, and Cascaded UNet achieved 0.42 ± 0.31 for HRCTV, 0.24 ± 0.19 for bladder, 0.23 ± 0.19 for rectum.Conclusion. We successfully developed a method specifically for 3D brachytherapy dose prediction. Our model demonstrated comparable performance to clinical plans generated by experienced dosimetrists. The developed technique is expected to improve the standardization and quality control of brachytherapy treatment planning.

Automation of pencil beam scanning proton treatment planning for intracranial tumours

PURPOSE

To evaluate the feasibility of comprehensive automation of an intra-cranial proton treatment planning.

MATERIALS AND METHODS

Class solution (CS) beam configuration selection allows the user to identify predefined beam configuration based on target localization; automatic CS (aCS) will then explore all the possible CS beam geometries. Ten patients, already used for the evaluation of the automatic selection of the beam configuration, have been also employed to training an algorithm based on the computation of a benchmark dose exploit automatic general planning solution (GPS) optimization with a wish list approach for the planning optimization. An independent cohort of ten patients has been then used for the evaluation step between the clinical and the GPS plan in terms of dosimetric quality of plans and the time needed to generate a plan.

RESULTS

The definition of a beam configuration requires on average 22 min (range 9-29 min). The average time for GPS plan generation is 18 min (range 7-26 min). Median dose differences (GPS-Manual) for each OAR constraints are: brainstem -1.60 Gy, left cochlea -1.22 Gy, right cochlea -1.42 Gy, left eye 0.55 Gy, right eye -2.33 Gy, optic chiasm -1.87 Gy, left optic nerve -4.45 Gy, right optic nerve -2.48 Gy and optic tract -0.31 Gy. Dosimetric CS and aCS plan evaluation shows a slightly worsening of the OARs values except for the optic tract and optic chiasm for both CS and aCS, where better results have been observed.

CONCLUSION

This study has shown the feasibility and implementation of the automatic planning system for intracranial tumors. The method developed in this work is ready to be implemented in a clinical workflow.

Three-dimensional dose and LETD prediction in proton therapy using artificial neural networks

PURPOSE

Challenges in proton therapy include identifying patients most likely to benefit; ensuring consistent, high-quality plans as its adoption becomes more widespread; and recognizing biological uncertainties that may be related to increased relative biologic effectiveness driven by linear energy transfer (LET). Knowledge-based planning (KBP) is a domain that may help to address all three.

METHODS

Artificial neural networks were trained using 117 unique treatment plans and associated dose and dose-weighted LET (LET_D ) distributions. The data set was split into training (n = 82), validation (n = 17), and test (n = 18) sets. Model performance was evaluated on the test set using dose- and LET_D -volume metrics in the clinical target volume (CTV) and nearby organs at risk and Dice similarity coefficients (DSC) comparing predicted and planned isodose lines at 50%, 75%, and 95% of the prescription dose.

RESULTS

Dose-volume metrics significantly differed (α = 0.05) between predicted and planned dose distributions in only one dose-volume metric, D_2% to the CTV. The maximum observed root mean square (RMS) difference between corresponding metrics was 4.3 Gy_RBE (8% of prescription) for D_1cc to optic chiasm. DSC were 0.90, 0.93, and 0.88 for the 50%, 75%, and 95% isodose lines, respectively. LET_D -volume metrics significantly differed in all but one metric, L_0.1cc of the brainstem. The maximum observed difference in RMS differences for LET_D metrics was 1.0 keV/μm for L_0.1cc to brainstem.

CONCLUSIONS

We have devised the first three-dimensional dose and LET_D -prediction model for cranial proton radiation therapy has been developed. Dose accuracy compared favorably with that of previously published models in other treatment sites. The agreement in LET_D supports future investigations with biological doses in mind to enable the full potential of KBP in proton therapy.

The role of artificial intelligence in veterinary radiation oncology

Veterinary radiation oncology regularly deploys sophisticated contouring, image registration, and treatment planning optimization software for patient care. Over the past decade, advances in computing power and the rapid development of neural networks, open-source software packages, and data science have been realized and resulted in new research and clinical applications of artificial intelligent (AI) systems in radiation oncology. These technologies differ from conventional software in their level of complexity and ability to learn from representative and local data. We provide clinical and research application examples of AI in human radiation oncology and their potential applications in veterinary medicine throughout the patient's care-path: from treatment simulation, deformable registration, auto-segmentation, automated treatment planning and plan selection, quality assurance, adaptive radiotherapy, and outcomes modeling. These technologies have the potential to offer significant time and cost savings in the veterinary setting; however, since the range of usefulness of these technologies have not been well studied nor understood, care must be taken if adopting AI technologies in clinical practice. Over the next several years, some practical and realizable applications of AI in veterinary radiation oncology include automated segmentation of normal tissues and tumor volumes, deformable registration, multi-criteria plan optimization, and adaptive radiotherapy. Keys in achieving success in adopting AI in veterinary radiation oncology include: establishing "truth-data"; data harmonization; multi-institutional data and collaborations; standardized dose reporting and taxonomy; adopting an open access philosophy, data collection and curation; open-source algorithm development; and transparent and platform-independent code development.

Automated clinical decision support system with deep learning dose prediction and NTCP models to evaluate treatment complications in patients with esophageal cancer

BACKGROUND AND PURPOSE

This study aims to investigate how accurate our deep learning (DL) dose prediction models for intensity modulated radiotherapy (IMRT) and pencil beam scanning (PBS) treatments, when chained with normal tissue complication probability (NTCP) models, are at identifying esophageal cancer patients who are at high risk of toxicity and should be switched to proton therapy (PT).

MATERIALS AND METHODS

Two U-Net were created, for photon (XT) and proton (PT) plans, respectively. To estimate the dose distribution for each patient, they were trained on a database of 40 uniformly planned patients using cross validation and a circulating test set. These models were combined with a NTCP model for postoperative pulmonary complications. The NTCP model used the mean lung dose, age, histology type, and body mass index as predicting variables. The treatment choice is then done by using a ΔNTCP threshold between XT and PT plans. Patients with ΔNTCP ≥ 10% were referred to PT.

RESULTS

Our DL models succeed in predicting dose distributions with a mean error on the mean dose to the lungs (MLD) of 1.14 ± 0.93% for XT and 0.66 ± 0.48% for PT. The complete automated workflow (DL chained with NTCP) achieved 100% accuracy in patient referral. The average residual (ΔNTCP ground truth - ΔNTCP predicted) is 1.43 ± 1.49%.

CONCLUSION

This study evaluates our DL dose prediction models in a broader patient referral context and demonstrates their ability to support clinical decisions.

Artificial intelligence in radiotherapy

Radiotherapy is a discipline closely integrated with computer science. Artificial intelligence (AI) has developed rapidly over the past few years. With the explosive growth of medical big data, AI promises to revolutionize the field of radiotherapy through highly automated workflow, enhanced quality assurance, improved regional balances of expert experiences, and individualized treatment guided by multi-omics. In addition to independent researchers, the increasing number of large databases, biobanks, and open challenges significantly facilitated AI studies on radiation oncology. This article reviews the latest research, clinical applications, and challenges of AI in each part of radiotherapy including image processing, contouring, planning, quality assurance, motion management, and outcome prediction. By summarizing cutting-edge findings and challenges, we aim to inspire researchers to explore more future possibilities and accelerate the arrival of AI radiotherapy.

A Survey on Deep Learning for Precision Oncology

Precision oncology, which ensures optimized cancer treatment tailored to the unique biology of a patient’s disease, has rapidly developed and is of great clinical importance. Deep learning has become the main method for precision oncology. This paper summarizes the recent deep-learning approaches relevant to precision oncology and reviews over 150 articles within the last six years. First, we survey the deep-learning approaches categorized by various precision oncology tasks, including the estimation of dose distribution for treatment planning, survival analysis and risk estimation after treatment, prediction of treatment response, and patient selection for treatment planning. Secondly, we provide an overview of the studies per anatomical area, including the brain, bladder, breast, bone, cervix, esophagus, gastric, head and neck, kidneys, liver, lung, pancreas, pelvis, prostate, and rectum. Finally, we highlight the challenges and discuss potential solutions for future research directions.

Towards a safe and efficient clinical implementation of machine learning in radiation oncology by exploring model interpretability, explainability and data-model dependency

The interest in machine learning (ML) has grown tremendously in recent years, partly due to the performance leap that occurred with new techniques of deep learning, convolutional neural networks for images, increased computational power, and wider availability of large datasets. Most fields of medicine follow that popular trend and, notably, radiation oncology is one of those that are at the forefront, with already a long tradition in using digital images and fully computerized workflows. ML models are driven by data, and in contrast with many statistical or physical models, they can be very large and complex, with countless generic parameters. This inevitably raises two questions, namely, the tight dependence between the models and the datasets that feed them, and the interpretability of the models, which scales with its complexity. Any problems in the data used to train the model will be later reflected in their performance. This, together with the low interpretability of ML models, makes their implementation into the clinical workflow particularly difficult. Building tools for risk assessment and quality assurance of ML models must involve then two main points: interpretability and data-model dependency. After a joint introduction of both radiation oncology and ML, this paper reviews the main risks and current solutions when applying the latter to workflows in the former. Risks associated with data and models, as well as their interaction, are detailed. Next, the core concepts of interpretability, explainability, and data-model dependency are formally defined and illustrated with examples. Afterwards, a broad discussion goes through key applications of ML in workflows of radiation oncology as well as vendors' perspectives for the clinical implementation of ML.

Feasibility study of fast intensity-modulated proton therapy dose prediction method using deep neural networks for prostate cancer

PURPOSE

Compared to the pencil-beam algorithm, the Monte-Carlo (MC) algorithm is more accurate for dose calculation but time-consuming in proton therapy. To solve this problem, this study uses deep learning to provide fast 3D dose prediction for prostate cancer patients treated with intensity-modulated proton therapy (IMPT).

METHODS

A novel recurrent U-net (RU-net) architecture was trained to predict the 3D dose distribution. Doses, CT images, and beam spot information from IMPT plans were used to train the RU-net with a 5-fold cross-validation. However, predicting the complicated dose properties of the IMPT plan is difficult for neural networks. Instead of the Peak-MU model, this work develops the Multi-MU model that adopted more comprehensive inputs and was trained with a combinational loss function. The dose difference between the prediction dose and MC dose was evaluated with gamma analysis, dice similarity coefficient (DSC), and dose-volume histogram (DVH) metrics. The Monte-Carlo dropout was also added to the network to quantify the uncertainty of the model.

RESULTS

Compared to the Peak-MU model, the Multi-MU model led to smaller mean absolute errors (3.03% vs. 2.05%, p = 0.005), higher gamma-passing rate (2mm, 3%: 97.42% vs. 93.69%, p = 0.005), higher dice similarity coefficient, and smaller relative DVH metrics error (CTV D_98% : 3.03% vs. 6.08%, p = 0.017; in Bladder V30: 3.08% vs. 5.28%, p = 0.028; and in Bladder V20: 3.02% vs. 4.42%, p = 0.017). Considering more prior knowledge, the Multi-MU model had better-predicted accuracy with a prediction time of less than half a second for each fold. The mean uncertainty value of the Multi-MU model is 0.46%, with a dropout rate of 10%.

CONCLUSION

This method was a nearly real-time IMPT dose prediction algorithm with accuracy comparable to the PB analytical algorithms used in prostate cancer. This RU-net might be used in plan robustness optimization and robustness evaluation in the future. This article is protected by copyright. All rights reserved.

Evaluation of the clinical value of automatic online dose restoration for adaptive proton therapy of head and neck cancer

INTRODUCTION

Intensity modulated proton therapy (IMPT) is highly sensitive to anatomical variations which can cause inadequate target coverage during treatment. This study compares not-adapted (NA) robust plans to two adaptive IMPT methods - a fully-offline adaptive (FOA) and a simplified automatic online adaptive strategy (dose restoration (DR)) to determine the benefit of DR, in head and neck cancer (HNC).

MATERIAL/METHODS

Robustly optimized clinical IMPT doses in planning-CTs (pCTs) were available for a cohort of 10 HNC patients. During robust re-optimization, DR used isodose contours, generated from the clinical dose on pCTs, and patient specific objectives to reproduce the clinical dose in every repeated-CT(rCT). For each rCT(n=50), NA, DR and FOA plans were robustly evaluated.

RESULTS

An improvement in DVH-metrics and robustness was seen for DR and FOA plans compared to NA plans. For NA plans, 74%(37/50) of rCTs did not fulfill the CTV coverage criteria (D98%>95%Dprescription). DR improved target coverage, target homogeneity and variability on critical risk organs such as the spinal cord. After DR, 52%(26/50) of rCTs met all clinical goals. Because of large anatomical changes and/or inaccurate patient repositioning, 48%(24/50) of rCTs still needed full offline adaptation to ensure an optimal treatment since dose restoration was not able to re-establish the initial plan quality.

CONCLUSION

Robust optimization together with fully-automatized DR avoided offline adaptation in 52% of the cases. Implementation of dose restoration in clinical routine could ensure treatment plan optimality while saving valuable human and material resources to radiotherapy departments.

A hybrid optimization strategy for deliverable Intensity-modulated radiotherapy plan generation using deep learning-based dose prediction

PURPOSE

To propose a clinically feasible automatic planning solution for external beam intensity-modulated radiotherapy (IMRT) including dose prediction via a deep learning and voxel-based optimization strategy.

MATERIALS AND METHODS

The dose distribution of patients was predicted using a U-Net-based deep learning network based on the patient's anatomy information. One hundred seventeen patients with nasopharyngeal cancer (NPC) and 200 patients with rectal cancer were enrolled in this study. For NPC cases, 94 cases were included in the training dataset, 13 in the validation dataset and 10 in the testing dataset. For rectal cancer cases, 172 cases were included in the training set, 18 in the validation set and 10 in the testing set. A voxel-based optimization strategy, "Voxel", was proposed to achieve treatment planning optimization by dividing body voxels into two parts: inside planning target volumes (PTVs) and outside PTVs. Fixed dose-volume objectives were attached to the total objective function to realize individualized planning intended as the "hybrid" optimizing strategy. Automatically generated plans were compared with clinically approved plans to evaluate clinical gains, according to dosimetric indices and dose-volume histograms (DVHs).

RESULTS

Similarities were found between the DVH of the predicted dose and clinical plan, although significant differences were found in some organs at risk (OARs). Better organ sparing and suboptimal PTV coverage were shown using the voxel strategy; however, the deviation in homogeneity indices (HI) and conformity indices (CI) of the PTV between automatically generated plans and manual plans were reduced by the hybrid strategy ((Manual plans)/(Voxel plans)/(Hybrid plans): HI of PTV70 (1.06/1.12/1.02), CI of PTV70 (0.79/0.58/0.76)). The optimization time for each patient was within 1 minute and included fluence map optimization, leaf sequencing and control point optimization. All the generated plans (voxel & hybrid strategy) could be delivered on uRT-linac 506c (United Imaging Health care, Shanghai, China).

CONCLUSION

Deliverable plans can be generated by incorporating a voxel-based optimization strategy into a commercial TPS. The hybrid optimization method shows the benefit and clinical feasibility in generating clinically acceptable plans. This article is protected by copyright. All rights reserved.

Dose Prediction Using a Three-Dimensional Convolutional Neural Network for Nasopharyngeal Carcinoma With Tomotherapy

Purpose

This study focused on predicting 3D dose distribution at high precision and generated the prediction methods for nasopharyngeal carcinoma patients (NPC) treated with Tomotherapy based on the patient-specific gap between organs at risk (OARs) and planning target volumes (PTVs).

Methods

A convolutional neural network (CNN) is trained using the CT and contour masks as the input and dose distributions as output. The CNN is based on the "3D Dense-U-Net", which combines the U-Net and the Dense-Net. To evaluate the model, we retrospectively used 124 NPC patients treated with Tomotherapy, in which 96 and 28 patients were randomly split and used for model training and test, respectively. We performed comparison studies using different training matrix shapes and dimensions for the CNN models, i.e., 128 ×128 ×48 (for Model I), 128 ×128 ×16 (for Model II), and 2D Dense U-Net (for Model III). The performance of these models was quantitatively evaluated using clinically relevant metrics and statistical analysis.

Results

We found a more considerable height of the training patch size yields a better model outcome. The study calculated the corresponding errors by comparing the predicted dose with the ground truth. The mean deviations from the mean and maximum doses of PTVs and OARs were 2.42 and 2.93%. Error for the maximum dose of right optic nerves in Model I was 4.87 ± 6.88%, compared with 7.9 ± 6.8% in Model II (p=0.08) and 13.85 ± 10.97% in Model III (p<0.01); the Model I performed the best. The gamma passing rates of PTV₆₀ for 3%/3 mm criteria was 83.6 ± 5.2% in Model I, compared with 75.9 ± 5.5% in Model II (p<0.001) and 77.2 ± 7.3% in Model III (p<0.01); the Model I also gave the best outcome. The prediction error of D₉₅ for PTV₆₀ was 0.64 ± 0.68% in Model I, compared with 2.04 ± 1.38% in Model II (p<0.01) and 1.05 ± 0.96% in Model III (p=0.01); the Model I was also the best one.

Conclusions

It is significant to train the dose prediction model by exploiting deep-learning techniques with various clinical logic concepts. Increasing the height (Y direction) of training patch size can improve the dose prediction accuracy of tiny OARs and the whole body. Our dose prediction network model provides a clinically acceptable result and a training strategy for a dose prediction model. It should be helpful to build automatic Tomotherapy planning.

Prediction of liver Dmean for proton beam therapy using deep learning and contour-based data augmentation

The prediction of liver Dmean with 3-dimensional radiation treatment planning (3DRTP) is time consuming in the selection of proton beam therapy (PBT), and deep learning prediction generally requires large and tumor-specific databases. We developed a simple dose prediction tool (SDP) using deep learning and a novel contour-based data augmentation (CDA) approach and assessed its usability. We trained the SDP to predict the liver Dmean immediately. Five and two computed tomography (CT) data sets of actual patients with liver cancer were used for the training and validation. Data augmentation was performed by artificially embedding 199 contours of virtual clinical target volume (CTV) into CT images for each patient. The data sets of the CTVs and OARs are labeled with liver Dmean for six different treatment plans using two-dimensional calculations assuming all tissue densities as 1.0. The test of the validated model was performed using 10 unlabeled CT data sets of actual patients. Contouring only of the liver and CTV was required as input. The mean relative error (MRE), the mean percentage error (MPE) and regression coefficient between the planned and predicted Dmean was 0.1637, 6.6%, and 0.9455, respectively. The mean time required for the inference of liver Dmean of the six different treatment plans for a patient was 4.47±0.13 seconds. We conclude that the SDP is cost-effective and usable for gross estimation of liver Dmean in the clinic although the accuracy should be improved further if we need the accuracy of liver Dmean to be compatible with 3DRTP.