Technical Note: A feasibility study on deep learning-based radiotherapy dose calculation

Large-language-model empowered 3D dose prediction for intensity-modulated radiotherapy

BACKGROUND

Treatment planning is currently a patient specific, time-consuming, and resource demanding task in radiotherapy. Dose-volume histogram (DVH) prediction plays a critical role in automating this process. The geometric relationship between DVHs in radiotherapy plans and organs-at-risk (OAR) and planning target volume (PTV) has been well established. This study explores the potential of deep learning models for predicting DVHs using images and subsequent human intervention facilitated by a large-language model (LLM) to enhance the planning quality.

METHOD

We propose a pipeline to convert unstructured images to a structured graph consisting of image-patch nodes and dose nodes. A novel Dose Graph Neural Network (DoseGNN) model is developed for predicting DVHs from the structured graph. The proposed DoseGNN is enhanced with the LLM to encode massive knowledge from prescriptions and interactive instructions from clinicians. In this study, we introduced an online human-AI collaboration (OHAC) system as a practical implementation of the concept proposed for the automation of intensity-modulated radiotherapy (IMRT) planning.

RESULTS

The proposed DoseGNN model was compared to widely employed DL models used in radiotherapy, including Swin Transformer, 3D U-Net CNN, and vanilla MLP. For PTV, DoseGNN achieved the mean absolute error (MAE) ofD m a x ${D}_{max}$ ,D m e a n ${D}_{mean}$ ,D 95 ${D}_{95}$ , andD 1 ${D}_1$ between true plans and predicted plans that were 64%, 53%, 64%, 61% of the best baseline model. For the worst case among OARs (left lung, right lung, chest wall, heart, spinal cord), DoseGNN achieved the mean absolute error ofD m a x ${D}_{max}$ ,D m e a n ${D}_{mean}$ ,D 50 ${D}_{50}$ that were 85%, 91%, 80% of the best baseline model. Moreover, the LLM-empowered DoseGNN model facilitates seamless adjustment to treatment plans through interaction with clinicians using natural language.

CONCLUSION

We developed DoseGNN, a novel deep learning model for predicting delivered radiation doses from medical images, enhanced by LLM to allow adjustment through seamless interaction with clinicians. The preliminary results confirm DoseGNN's superior accuracy in DVH prediction relative to typical DL methods, highlighting its potential to facilitate an online clinician-AI collaboration system for streamlined treatment planning automation.

Artificial intelligence (AI) applications in improvement of IMRT and VMAT radiotherapy treatment planning processes: A systematic review

INTRODUCTION

Radiotherapy is a common option in the treatment of many types of cancer. Intensity-Modulated Radiation Therapy (IMRT) and Volumetric-Modulated Arc Therapy (VMAT) are the latest radiotherapy techniques. However, clinicians face problems due to these techniques' complexity and time-consuming planning. Various studies have pointed out the importance and role of artificial intelligence (AI) in radiotherapy and accelerating and improving its quality. This research explores different AI methods in different fields of IMRT and VMAT. This study evaluated both quantitative and qualitative methods used within the reviewed articles.

METHODS

Various articles were reviewed from Google Scholar, Science Direct, and PubMed databases between 2018 and 2024. According to PRISMA 2020 guidelines, study selection processes, screening, and inclusion and exclusion criteria were defined. The critical Appraisal Skill Program qualitative checklist tool was used for the qualitative evaluation of articles.

RESULTS

26 articles met the inclusion among the 33 articles obtained. The search procedure was displayed using the PRISMA flow diagram. The evaluation of the articles shows the automation of various treatment planning processes by AI methods and their better performance than traditional methods. The qualitative evaluation of studies has demonstrated the high quality of all studies. The lowest score obtained from the qualitative evaluation of the article is 7 out of 9.

CONCLUSION

AI methods used in radiotherapy reduce time and increase prediction accuracy. They also work better than other methods in different areas, such as dose prediction, treatment design, and dose delivery.

IMPLICATIONS FOR PRACTICE

Healthcare providers should consider integrating artificial intelligence technologies into their practice to optimize treatment planning and enhance patient care in radiation therapy. Additionally, fostering collaboration between radiotherapy experts and artificial intelligence specialists can significantly improve the development and application of AI technologies in this field.

Deep learning applied to dose prediction in external radiation therapy: A narrative review

Over the last decades, the use of artificial intelligence, machine learning and deep learning in medical fields has skyrocketed. Well known for their results in segmentation, motion management and posttreatment outcome tasks, investigations of machine learning and deep learning models as fast dose calculation or quality assurance tools have been present since 2000. The main motivation for this increasing research and interest in artificial intelligence, machine learning and deep learning is the enhancement of treatment workflows, specifically dosimetry and quality assurance accuracy and time points, which remain important time-consuming aspects of clinical patient management. Since 2014, the evolution of models and architectures for dose calculation has been related to innovations and interest in the theory of information research with pronounced improvements in architecture design. The use of knowledge-based approaches to patient-specific methods has also considerably improved the accuracy of dose predictions. This paper covers the state of all known deep learning architectures and models applied to external radiotherapy with a description of each architecture, followed by a discussion on the performance and future of deep learning predictive models in external radiotherapy.

Application and progress of artificial intelligence in radiation therapy dose prediction

Radiation therapy (RT) nowadays is a main treatment modality of cancer. To ensure the therapeutic efficacy of patients, accurate dose distribution is often required, which is a time-consuming and labor-intensive process. In addition, due to the differences in knowledge and experience among participants and diverse institutions, the predicted dose are often inconsistent. In last several decades, artificial intelligence (AI) has been applied in various aspects of RT, several products have been implemented in clinical practice and confirmed superiority. In this paper, we will review the research of AI in dose prediction, focusing on the progress in deep learning (DL).

A deep learning based dynamic arc radiotherapy photon dose engine trained on Monte Carlo dose distributions

Background and purpose

Despite hardware acceleration, state-of-the-art Monte Carlo (MC) dose engines require considerable computation time to reduce stochastic noise. We developed a deep learning (DL) based dose engine reaching high accuracy at strongly reduced computation times.

Materials and methods

Radiotherapy treatment plans and computed tomography scans were collected for 350 treatments in a variety of tumor sites. Dose distributions were computed using a MC dose engine for ∼ 30,000 separate segments at 6 MV and 10 MV beam energies, both flattened and flattening filter free. For dynamic arcs these explicitly incorporated the leaf, jaw and gantry motions during dose delivery. A neural network was developed, combining two-dimensional convolution and recurrence using 64 hidden channels. Parameters were trained to minimize the mean squared log error loss between the MC computed dose and the model output. Full dose distributions were reconstructed for 100 additional treatment plans. Gamma analyses were performed to assess accuracy.

Results

DL dose evaluation was on average 82 times faster than MC computation at a 1 % accuracy setting. In voxels receiving at least 10 % of the maximum dose the overall global gamma pass rate using a 2 % and 2 mm criterion was 99.6 %, while mean local gamma values were accurate within 2 %. In the high dose region over 50 % of maximum the mean local gamma approached a 1 % accuracy.

Conclusions

A DL based dose engine was implemented, able to accurately reproduce MC computed dynamic arc radiotherapy dose distributions at high speed.

Automatic planning for head and neck seed implant brachytherapy based on deep convolutional neural network dose engine

BACKGROUND

Seed implant brachytherapy (SIBT) is an effective treatment modality for head and neck (H&N) cancers; however, current clinical planning requires manual setting of needle paths and utilizes inaccurate dose calculation algorithms.

PURPOSE

This study aims to develop an accurate and efficient deep convolutional neural network dose engine (DCNN-DE) and an automatic SIBT planning method for H&N SIBT.

METHODS

A cohort of 25 H&N patients who received SIBT was utilized to develop and validate the methods. The DCNN-DE was developed based on 3D-unet model. It takes single seed dose distribution from a modified TG-43 method, the CT image and a novel inter-seed shadow map (ISSM) as inputs, and predicts the dose map of accuracy close to the one from Monte Carlo simulations (MCS). The ISSM was proposed to better handle inter-seed attenuation. The accuracy and efficacy of the DCNN-DE were validated by comparing with other methods taking MCS dose as reference. For SIBT planning, a novel strategy inspired by clinical practice was proposed to automatically generate parallel or non-parallel potential needle paths that avoid puncturing bone and critical organs. A heuristic-based optimization method was developed to optimize the seed positions to meet clinical prescription requirements. The proposed planning method was validated by re-planning the 25 cases and comparing with clinical plans.

RESULTS

The absolute percentage error in the TG-43 calculation for CTV V100 and D90 was reduced from 5.4% and 13.2% to 0.4% and 1.1% with DCNN-DE, an accuracy improvement of 93% and 92%, respectively. The proposed planning method could automatically obtain a plan in 2.5 ± 1.5 min. The generated plans were judged clinically acceptable with dose distribution comparable with those of the clinical plans.

CONCLUSIONS

The proposed method can generate clinically acceptable plans quickly with high accuracy in dose evaluation, and thus has a high potential for clinical use in SIBT.

Benchmarking ChatGPT-4 on a radiation oncology in-training exam and Red Journal Gray Zone cases: potentials and challenges for ai-assisted medical education and decision making in radiation oncology

Purpose

The potential of large language models in medicine for education and decision-making purposes has been demonstrated as they have achieved decent scores on medical exams such as the United States Medical Licensing Exam (USMLE) and the MedQA exam. This work aims to evaluate the performance of ChatGPT-4 in the specialized field of radiation oncology.

Methods

The 38th American College of Radiology (ACR) radiation oncology in-training (TXIT) exam and the 2022 Red Journal Gray Zone cases are used to benchmark the performance of ChatGPT-4. The TXIT exam contains 300 questions covering various topics of radiation oncology. The 2022 Gray Zone collection contains 15 complex clinical cases.

Results

For the TXIT exam, ChatGPT-3.5 and ChatGPT-4 have achieved the scores of 62.05% and 78.77%, respectively, highlighting the advantage of the latest ChatGPT-4 model. Based on the TXIT exam, ChatGPT-4's strong and weak areas in radiation oncology are identified to some extent. Specifically, ChatGPT-4 demonstrates better knowledge of statistics, CNS & eye, pediatrics, biology, and physics than knowledge of bone & soft tissue and gynecology, as per the ACR knowledge domain. Regarding clinical care paths, ChatGPT-4 performs better in diagnosis, prognosis, and toxicity than brachytherapy and dosimetry. It lacks proficiency in in-depth details of clinical trials. For the Gray Zone cases, ChatGPT-4 is able to suggest a personalized treatment approach to each case with high correctness and comprehensiveness. Importantly, it provides novel treatment aspects for many cases, which are not suggested by any human experts.

Conclusion

Both evaluations demonstrate the potential of ChatGPT-4 in medical education for the general public and cancer patients, as well as the potential to aid clinical decision-making, while acknowledging its limitations in certain domains. Owing to the risk of hallucinations, it is essential to verify the content generated by models such as ChatGPT for accuracy.

Performance assessment of variant UNet-based deep-learning dose engines for MR-Linac-based prostate IMRT plans

Objective. UNet-based deep-learning (DL) architectures are promising dose engines for traditional linear accelerator (Linac) models. Current UNet-based engines, however, were designed differently with various strategies, making it challenging to fairly compare the results from different studies. The objective of this study is to thoroughly evaluate the performance of UNet-based models on magnetic-resonance (MR)-Linac-based intensity-modulated radiation therapy (IMRT) dose calculations.Approach. The UNet-based models, including the standard-UNet, cascaded-UNet, dense-dilated-UNet, residual-UNet, HD-UNet, and attention-aware-UNet, were implemented. The model input is patient CT and IMRT field dose in water, and the output is patient dose calculated by DL model. The reference dose was calculated by the Monaco Monte Carlo module. Twenty training and ten test cases of prostate patients were included. The accuracy of the DL-calculated doses was measured using gamma analysis, and the calculation efficiency was evaluated by inference time.Results. All the studied models effectively corrected low-accuracy doses in water to high-accuracy patient doses in a magnetic field. The gamma passing rates between reference and DL-calculated doses were over 86% (1%/1 mm), 98% (2%/2 mm), and 99% (3%/3 mm) for all the models. The inference times ranged from 0.03 (graphics processing unit) to 7.5 (central processing unit) seconds. Each model demonstrated different strengths in calculation accuracy and efficiency; Res-UNet achieved the highest accuracy, HD-UNet offered high accuracy with the fewest parameters but the longest inference, dense-dilated-UNet was consistently accurate regardless of model levels, standard-UNet had the shortest inference but relatively lower accuracy, and the others showed average performance. Therefore, the best-performing model would depend on the specific clinical needs and available computational resources.Significance. The feasibility of using common UNet-based models for MR-Linac-based dose calculations has been explored in this study. By using the same model input type, patient training data, and computing environment, a fair assessment of the models' performance was present.

A deep-learning-based dose verification tool utilizing fluence maps for a cobalt-60 compensator-based intensity-modulated radiation therapy system

Background and purpose

A novel cobalt-60 compensator-based intensity-modulated radiation therapy (IMRT) system was developed for a resource-limited environment but lacked an efficient dose verification algorithm. The aim of this study was to develop a deep-learning-based dose verification algorithm for accurate and rapid dose predictions.

Materials and methods

A deep-learning network was employed to predict the doses from static fields related to beam commissioning. Inputs were a cube-shaped phantom, a beam binary mask, and an intersecting volume of the phantom and beam binary mask, while output was a 3-dimensional (3D) dose. The same network was extended to predict patient-specific doses for head and neck cancers using two different approaches. A field-based method predicted doses for each field and combined all calculated doses into a plan, while the plan-based method combined all nine fluences into a plan to predict doses. Inputs included patient computed tomography (CT) scans, binary beam masks, and fluence maps truncated to the patient's CT in 3D.

Results

For static fields, predictions agreed well with ground truths with average deviations of less than 0.5% for percent depth doses and profiles. Even though the field-based method showed excellent prediction performance for each field, the plan-based method showed better agreement between clinical and predicted dose distributions. The distributed dose deviations for all planned target volumes and organs at risk were within 1.3 Gy. The calculation speed for each case was within two seconds.

Conclusions

A deep-learning-based dose verification tool can accurately and rapidly predict doses for a novel cobalt-60 compensator-based IMRT system.

Prediction of dose deposition matrix using voxel features driven machine learning approach

OBJECTIVES

A dose deposition matrix (DDM) prediction method using several voxel features and a machine learning (ML) approach is proposed for plan optimization in radiation therapy.

METHODS

Head and lung cases with the inhomogeneous medium are used as training and testing data. The prediction model is a cascade forward backprop neural network where the input is the features of the voxel, including 1) voxel to body surface distance along the beamlet axis, 2) voxel to beamlet axis distance, 3) voxel density, 4) heterogeneity corrected voxel to body surface distance, 5) heterogeneity corrected voxel to beamlet axis, and (6) the dose of voxel obtained from the pencil beam (PB) algorithm. The output is the predicted voxel dose corresponding to a beamlet. The predicted DDM was used for plan optimization (ML method) and compared with the dose of MC-based plan optimization (MC method) and the dose of pencil beam-based plan optimization (PB method). The mean absolute error (MAE) value was calculated for full volume relative to the dose of the MC method to evaluate the overall dose performance of the final plan.

RESULTS

For patient with head tumor, the ML method achieves MAE value 0.49 × 10-4 and PB has MAE 1.86 × 10-4. For patient with lung tumor, the ML method has MAE 1.42 × 10-4 and PB has MAE 3.72 × 10-4. The maximum percentage difference in PTV dose coverage (D98) between ML and MC methods is no more than 1.2% for patient with head tumor, while the difference is larger than 10% using the PB method. For patient with lung tumor, the maximum percentage difference in PTV dose coverage (D98) between ML and MC methods is no more than 2.1%, while the difference is larger than 16% using the PB method.

CONCLUSIONS

In this work, a reliable DDM prediction method is established for plan optimization by applying several voxel features and the ML approach. The results show that the ML method based on voxel features can obtain plans comparable to the MC method and is better than the PB method in achieving accurate dose to the patient, which is helpful for rapid plan optimization and accurate dose calculation.

ADVANCES IN KNOWLEDGE

Establishment of a new machine learning method based on the relationship between the voxel and beamlet features for dose deposition matrix prediction in radiation therapy.

An ultra-fast deep-learning-based dose engine for prostate VMAT via knowledge distillation framework with limited patient data

Objective. Deep-learning (DL)-based dose engines have been developed to alleviate the intrinsic compromise between the calculation accuracy and efficiency of the traditional dose calculation algorithms. However, current DL-based engines typically possess high computational complexity and require powerful computing devices. Therefore, to mitigate their computational burdens and broaden their applicability to a clinical setting where resource-limited devices are available, we proposed a compact dose engine via knowledge distillation (KD) framework that offers an ultra-fast calculation speed with high accuracy for prostate Volumetric Modulated Arc Therapy (VMAT).Approach. The KD framework contains two sub-models: a large pre-trained teacher and a small to-be-trained student. The student receives knowledge transferred from the teacher for better generalization. The trained student serves as the final engine for dose calculation. The model input is patient computed tomography and VMAT dose in water, and the output is DL-calculated patient dose. The ground-truth \dose was computed by the Monte Carlo module of the Monaco treatment planning system. Twenty and ten prostate cases were included for model training and assessment, respectively. The model's performance (teacher/student/student-only) was evaluated by Gamma analysis and inference efficiency.Main results. The dosimetric comparisons (input/DL-calculated/ground-truth doses) suggest that the proposed engine can effectively convert low-accuracy doses in water to high-accuracy patient doses. The Gamma passing rate (2%/2 mm, 10% threshold) between the DL-calculated and ground-truth doses was 98.64 ± 0.62% (teacher), 98.13 ± 0.76% (student), and 96.95 ± 1.02% (student-only). The inference time was 16 milliseconds (teacher) and 11 milliseconds (student/student-only) using a graphics processing unit device, while it was 936 milliseconds (teacher) and 374 milliseconds (student/student-only) using a central processing unit device.Significance. With the KD framework, a compact dose engine can achieve comparable accuracy to that of a larger one. Its compact size reduces the computational burdens and computing device requirements, and thus such an engine can be more clinically applicable.

Machine learning in neuro-oncology: toward novel development fields

PURPOSE

Artificial Intelligence (AI) involves several and different techniques able to elaborate a large amount of data responding to a specific planned outcome. There are several possible applications of this technology in neuro-oncology.

METHODS

We reviewed, according to PRISMA guidelines, available studies adopting AI in different fields of neuro-oncology including neuro-radiology, pathology, surgery, radiation therapy, and systemic treatments.

RESULTS

Neuro-radiology presented the major number of studies assessing AI. However, this technology is being successfully tested also in other operative settings including surgery and radiation therapy. In this context, AI shows to significantly reduce resources and costs maintaining an elevated qualitative standard. Pathological diagnosis and development of novel systemic treatments are other two fields in which AI showed promising preliminary data.

CONCLUSION

It is likely that AI will be quickly included in some aspects of daily clinical practice. Possible applications of these techniques are impressive and cover all aspects of neuro-oncology.

A Survey on Deep Learning for Precision Oncology

Precision oncology, which ensures optimized cancer treatment tailored to the unique biology of a patient’s disease, has rapidly developed and is of great clinical importance. Deep learning has become the main method for precision oncology. This paper summarizes the recent deep-learning approaches relevant to precision oncology and reviews over 150 articles within the last six years. First, we survey the deep-learning approaches categorized by various precision oncology tasks, including the estimation of dose distribution for treatment planning, survival analysis and risk estimation after treatment, prediction of treatment response, and patient selection for treatment planning. Secondly, we provide an overview of the studies per anatomical area, including the brain, bladder, breast, bone, cervix, esophagus, gastric, head and neck, kidneys, liver, lung, pancreas, pelvis, prostate, and rectum. Finally, we highlight the challenges and discuss potential solutions for future research directions.

Millisecond speed deep learning based proton dose calculation with Monte Carlo accuracy

Objective.Next generation online and real-time adaptive radiotherapy workflows require precise particle transport simulations in sub-second times, which is unfeasible with current analytical pencil beam algorithms (PBA) or Monte Carlo (MC) methods. We present a deep learning based millisecond speed dose calculation algorithm (DoTA) accurately predicting the dose deposited by mono-energetic proton pencil beams for arbitrary energies and patient geometries.Approach.Given the forward-scattering nature of protons, we frame 3D particle transport as modeling a sequence of 2D geometries in the beam's eye view. DoTA combines convolutional neural networks extracting spatial features (e.g. tissue and density contrasts) with a transformer self-attention backbone that routes information between the sequence of geometry slices and a vector representing the beam's energy, and is trained to predict low noise MC simulations of proton beamlets using 80 000 different head and neck, lung, and prostate geometries.Main results.Predicting beamlet doses in 5 ± 4.9 ms with a very high gamma pass rate of 99.37 ± 1.17% (1%, 3 mm) compared to the ground truth MC calculations, DoTA significantly improves upon analytical pencil beam algorithms both in precision and speed. Offering MC accuracy 100 times faster than PBAs for pencil beams, our model calculates full treatment plan doses in 10-15 s depending on the number of beamlets (800-2200 in our plans), achieving a 99.70 ± 0.14% (2%, 2 mm) gamma pass rate across 9 test patients.Significance.Outperforming all previous analytical pencil beam and deep learning based approaches, DoTA represents a new state of the art in data-driven dose calculation and can directly compete with the speed of even commercial GPU MC approaches. Providing the sub-second speed required for adaptive treatments, straightforward implementations could offer similar benefits to other steps of the radiotherapy workflow or other modalities such as helium or carbon treatments.

A feasibility study for in vivo treatment verification of IMRT using Monte Carlo dose calculation and deep learning-based modelling of EPID detector response

Background

This paper describes the development of a predicted electronic portal imaging device (EPID) transmission image (TI) using Monte Carlo (MC) and deep learning (DL). The measured and predicted TI were compared for two-dimensional in vivo radiotherapy treatment verification.

Methods

The plan CT was pre-processed and combined with solid water and then imported into PRIMO. The MC method was used to calculate the dose distribution of the combined CT. The U-net neural network-based deep learning model was trained to predict EPID TI based on the dose distribution of solid water calculated by PRIMO. The predicted TI was compared with the measured TI for two-dimensional in vivo treatment verification.

Results

The EPID TI of 1500 IMRT fields were acquired, among which 1200, 150, and 150 fields were used as the training set, the validation set, and the test set, respectively. A comparison of the predicted and measured TI was carried out using global gamma analyses of 3%/3 mm and 2%/2 mm (5% threshold) to validate the model's accuracy. The gamma pass rates were greater than 96.7% and 92.3%, and the mean gamma values were 0.21 and 0.32, respectively.

Conclusions

Our method facilitates the modelling process more easily and increases the calculation accuracy when using the MC algorithm to simulate the EPID response, and has potential to be used for in vivo treatment verification in the clinic.

Assessment of efficacy in automated plan generation for Varian Ethos intelligent optimization engine

Varian Ethos, a new treatment platform, is capable of automatically generating treatment plans for initial planning and for online, adaptive planning, using an intelligent optimization engine (IOE). The primary purpose of this study is to assess the efficacy of Varian Ethos IOE for auto‐planning and intercompare different treatment modalities within the Ethos treatment planning system (TPS). A total of 36 retrospective prostate and proximal seminal vesicles cases were selected for this study. The prescription dose was 50.4 Gy in 28 fractions to the proximal seminal vesicles, with a simultaneous integrated boost of 70 Gy to the prostate gland. Based on RT intent, three treatment plans were auto‐generated in the Ethos TPS and were exported to the Eclipse TPS for intercomparison with the Eclipse treatment plan. When normalized for the same planning target volume (PTV) coverage, Ethos plans D_max% were 108.1 ± 1.2%, 108.4 ± 1.6%, and 109.6 ± 2.0%, for the 9‐field IMRT, 12‐field IMRT, and 2‐full arc VMAT plans, respectively. This compared well with Eclipse plan D_max% values, which was 108.8 ± 1.4%. OAR indices were also evaluated for Ethos plans using Radiation Therapy Oncology Group report 0415 as a guide and were found to be comparable to each other and the Eclipse plans. While all Ethos plans were comparable, we found that, in general, the Ethos 12‐field IMRT plans met most of the dosimetric goals for treatment. Also, Ethos IOE consistently generated dosimetrically hotter VMAT plans versus IMRT plans. On average, Ethos TPS took 13 min to generate 2‐full arc VMAT plans, compared to 5 min for 12‐field IMRT plans. Varian Ethos TPS can generate multiple treatment plans in an efficient time frame and the quality of the plans could be deemed clinically acceptable when compared to manually generated treatment plans.

Convolution neural network toward Monte Carlo photon dose calculation in radiation therapy

PURPOSE

The Monte Carlo (MC) algorithm has been widely accepted as the most accurate algorithm for dosimetric calculations under various conditions in radiotherapy. However, the calculation time remains an important obstacle hindering the routine use of MC in clinical settings. In this study, full MC three-dimensional dose distributions were obtained with the inputs of the total energy release per unit mass (TERMA) distributions and the electron density (ED) distributions using a convolutional neural network (CNN). A new Dose-mixup data augmentation routine and training strategy are proposed and applied in the training process. Attempts were made to reduce the calculation time while ensuring that the calculation accuracy is comparable to that of the MC.

METHODS

Datasets were generated via the MC with random rectangular field sizes, random iso-centers, and random gantry angles for head and neck computed tomography (CT) images with Mohan 6-MV spectrum photon beams. 1500 samples were generated for the training set, and 150 samples were generated for the validation set. The T-MC Net model was obtained with the Dose-mixup data augmentation routine. The new CTs were used to test the performance of the model in the rectangular fields and the intensity-modulated radiation therapy (IMRT) fields. The mean ± 95% confidence interval of gamma pass rates were calculated.

RESULTS

For 150 rectangular field test samples, the 1%/2 mm, 2%/2 mm, and 3%/2 mm criteria gamma pass rates were 90.11% ± 0.65%, 97.65% ± 0.31%, and 99.16% ± 0.19%, respectively. For the 100 IMRT field test samples, the 1%/2 mm, 2%/2 mm, and 3%/2 mm criteria gamma pass rates were 96.48% ± 0.28%, 99.14% ± 0.10%, and 99.63% ± 0.06%, respectively. For the 7-fields IMRT plan, the 1%/2 mm, 2%/2 mm, and 3%/2 mm criteria gamma pass rates were 97.06%, 99.10%, and 99.52%, respectively. For the 9-fields IMRT plan, the 1%/2 mm, 2%/2 mm, and 3%/2 mm criteria gamma pass rates were 98.16%, 99.61%, and 99.89%, respectively.

CONCLUSIONS

The feasibility of calculating dose distribution using a CNN with the TERMA three-dimensional distribution and ED distribution was established. The dosimetric results were comparable to those of the full MC. The accuracy and speed of the proposed approach make it a potential solution for full MC in radiotherapy. This method may be used as an acceleration engine for the dose algorithm and shows great potential for cases where fast dose calculations are needed.

NeuralDAO: Incorporating neural network generated dose into direct aperture optimization for end-to-end IMRT planning

PURPOSE

Thecurrent practice in intensity-modulated radiation therapy (IMRT) planning almost always includes different dose calculation strategies for plan optimization and final dose verification. The accurate Monte Carlo (MC) dose algorithm is considered to be time-consuming for the optimization. Thus a fast, simplified dose algorithm is used in the optimization. The significant differences between the optimized dose and the delivered dose lead to tediously planning loops and potentially suboptimal solutions. This work aims to develop an IMRT optimization algorithm to minimize the dose discrepancy so that the delivered dose can be optimized in a holistic, end-to-end manner.

METHODS

The proposed algorithm, namely NeuralDAO, integrates a neural dose network into the column generation (CG) direct aperture optimization (DAO) formulation for step-and-shoot IMRT planning. The neural dose network is designed and trained to produce doses of MC-level accuracy within few milliseconds. Its differentiability is fully exploited to compute gradients for identifying potential aperture shapes. A prototype of NeuralDAO was developed in PyTorch and available to the public. Five lung patient cases have been studied. Dosimetric accuracy was compared with the MC dose. Plan quality and time were compared with a state-of-the-art (SoA) dose-correct algorithm. Statistical analysis was performed by Wilcoxon signed-rank test.

RESULTS

The average gamma passing rate at 2 mm/2% is 99.7% between the optimized and delivered doses. The convergence process produced by NeuralDAO is virtually identical to that produced by an MC-based DAO. The average dose calculation time is 12.1 ms for an aperture on GPU. One session of optimization took 10-36 min. Compared with the SoA, better conformity index and homogeneity index were observed for the target. The esophagus was significantly spared. Significant reductions were observed for the replanning number and the planning time.

CONCLUSIONS

A new DAO algorithm based on the neural dose network has been developed. The results suggest that this algorithm minimizes the discrepancy between the optimized and delivered doses, which offers a promising approach to reduce the time and effort required in IMRT planning. This work demonstrates the possibility of applying the neural network in IMRT optimization. It is of great potential to extend this algorithm to other treatment modalities.

Knowledge-based radiation treatment planning: A data-driven method survey

This paper surveys the data-driven dose prediction methods investigated for knowledge-based planning (KBP) in the last decade. These methods were classified into two major categories-traditional KBP methods and deep-learning (DL) methods-according to their techniques of utilizing previous knowledge. Traditional KBP methods include studies that require geometric or anatomical features to either find the best-matched case(s) from a repository of prior treatment plans or to build dose prediction models. DL methods include studies that train neural networks to make dose predictions. A comprehensive review of each category is presented, highlighting key features, methods, and their advancements over the years. We separated the cited works according to the framework and cancer site in each category. Finally, we briefly discuss the performance of both traditional KBP methods and DL methods, then discuss future trends of both data-driven KBP methods to dose prediction.

Machine learning applications in radiation oncology

Machine learning technology has a growing impact on radiation oncology with an increasing presence in research and industry. The prevalence of diverse data including 3D imaging and the 3D radiation dose delivery presents potential for future automation and scope for treatment improvements for cancer patients. Harnessing this potential requires standardization of tools and data, and focused collaboration between fields of expertise. The rapid advancement of radiation oncology treatment technologies presents opportunities for machine learning integration with investments targeted towards data quality, data extraction, software, and engagement with clinical expertise. In this review, we provide an overview of machine learning concepts before reviewing advances in applying machine learning to radiation oncology and integrating these techniques into the radiation oncology workflows. Several key areas are outlined in the radiation oncology workflow where machine learning has been applied and where it can have a significant impact in terms of efficiency, consistency in treatment and overall treatment outcomes. This review highlights that machine learning has key early applications in radiation oncology due to the repetitive nature of many tasks that also currently have human review. Standardized data management of routinely collected imaging and radiation dose data are also highlighted as enabling engagement in research utilizing machine learning and the ability integrate these technologies into clinical workflow to benefit patients. Physicists need to be part of the conversation to facilitate this technical integration.

DeepDose: a robust deep learning-based dose engine for abdominal tumours in a 1.5 T MRI radiotherapy system

We present a robust deep learning-based framework for dose calculations of abdominal tumours in a 1.5 T MRI radiotherapy system. For a set of patient plans, a convolutional neural network is trained on the dose of individual multi-leaf-collimator segments following the DeepDose framework. It can then be used to predict the dose distribution per segment for a set of patient anatomies. The network was trained using data from three anatomical sites of the abdomen: prostate, rectal and oligometastatic tumours. A total of 216 patient fractions were used, previously treated in our clinic with fixed-beam IMRT using the Elekta MR-linac. For the purpose of training, 176 fractions were used with random gantry angles assigned to each segment, while 20 fractions were used for the validation of the network. The ground truth data were calculated with a Monte Carlo dose engine at 1% statistical uncertainty per segment. For a total of 20 independent abdominal test fractions with the clinical angles, the network was able to accurately predict the dose distributions, achieving 99.4% ± 0.6% for the whole plan prediction at the 3%/3 mm gamma test. The average dose difference and standard deviation per segment was 0.3% ± 0.7%. Additional dose prediction on one cervical and one pancreatic case yielded high dose agreement of 99.9% and 99.8% respectively for the 3%/3 mm criterion. Overall, we show that our deep learning-based dose engine calculates highly accurate dose distributions for a variety of abdominal tumour sites treated on the MR-linac, in terms of performance and generality.

Improving Proton Dose Calculation Accuracy by Using Deep Learning

Introduction

Pencil beam (PB) dose calculation is fast but inaccurate due to the approximations when dealing with inhomogeneities. Monte Carlo (MC) dose calculation is the most accurate method but it is time consuming. The aim of this study was to develop a deep learning model that can boost the accuracy of PB dose calculation to the level of MC dose by converting PB dose to MC dose for different tumor sites.

Methods

The proposed model uses the PB dose and CT image as inputs to generate the MC dose. We used 290 patients (90 head and neck, 93 liver, 75 prostate and 32 lung) to train, validate, and test the model. For each tumor site, we performed four numerical experiments to explore various combinations of training datasets.

Results

Training the model on data from all tumor sites together and using the dose distribution of each individual beam as input yielded the best performance for all four tumor sites. The average gamma passing rate (1mm/1%) between the converted and the MC dose was 92.8%, 92.7%, 89.7% and 99.6% for head and neck, liver, lung, and prostate test patients, respectively. The average dose conversion time for a single field was less than 4 seconds. The trained model can be adapted to new datasets through transfer learning.

Conclusions

Our deep learning-based approach can quickly boost the accuracy of PB dose to that of MC dose. The developed model can be added to the clinical workflow of proton treatment planning to improve dose calculation accuracy.

Artificial Intelligence and Machine Learning in Prostate Cancer Patient Management-Current Trends and Future Perspectives

Artificial intelligence (AI) is the field of computer science that aims to build smart devices performing tasks that currently require human intelligence. Through machine learning (ML), the deep learning (DL) model is teaching computers to learn by example, something that human beings are doing naturally. AI is revolutionizing healthcare. Digital pathology is becoming highly assisted by AI to help researchers in analyzing larger data sets and providing faster and more accurate diagnoses of prostate cancer lesions. When applied to diagnostic imaging, AI has shown excellent accuracy in the detection of prostate lesions as well as in the prediction of patient outcomes in terms of survival and treatment response. The enormous quantity of data coming from the prostate tumor genome requires fast, reliable and accurate computing power provided by machine learning algorithms. Radiotherapy is an essential part of the treatment of prostate cancer and it is often difficult to predict its toxicity for the patients. Artificial intelligence could have a future potential role in predicting how a patient will react to the therapy side effects. These technologies could provide doctors with better insights on how to plan radiotherapy treatment. The extension of the capabilities of surgical robots for more autonomous tasks will allow them to use information from the surgical field, recognize issues and implement the proper actions without the need for human intervention.

DVH Prediction for VMAT in NPC with GRU-RNN: An Improved Method by Considering Biological Effects

Purpose

A recurrent neural network (RNN) and its variants such as gated recurrent unit-based RNN (GRU-RNN) were found to be very suitable for dose-volume histogram (DVH) prediction in our previously published work. Using the dosimetric information generated by nonmodulated beams of different orientations, the GRU-RNN model was capable of accurate DVH prediction for nasopharyngeal carcinoma (NPC) treatment planning. On the basis of our previous work, we proposed an improved approach and aimed to further improve the DVH prediction accuracy as well as study the feasibility of applying the proposed method to relatively small-size patient data.

Methods

Eighty NPC volumetric modulated arc therapy (VMAT) plans with local IRB's approval in recent two years were retrospectively and randomly selected in this study. All these original plans were created using the Eclipse treatment planning system (V13.5, Varian Medical Systems, USA) with ≥95% of PGTVnx receiving the prescribed doses of 70 Gy, ≥95% of PGTVnd receiving 66 Gy, and ≥95% of PTV receiving 60 Gy. Among them, fifty plans were used to train the DVH prediction model, and the remaining were used for testing. On the basis of our previously published work, we simplified the 3-layer GRU-RNN model to a single-layer model and further trained every organ at risk (OAR) separately with an OAR-specific equivalent uniform dose- (EUD-) based loss function.

Results

The results of linear least squares regression obtained by the new proposed method showed the excellent agreements between the predictions and the original plans with the correlation coefficient r = 0.976 and 0.968 for EUD results and maximum dose results, respectively, and the coefficient r of our previously published method was 0.957 and 0.946, respectively. The Wilcoxon signed-rank test results between the proposed and the previous work showed that the proposed method could significantly improve the EUD prediction accuracy for the brainstem, spinal cord, and temporal lobes with a p value < 0.01.

Conclusions

The accuracy of DVH prediction achieved in different OARs showed the great improvements compared to the previous works, and more importantly, the effectiveness and robustness showed by the simplified GRU-RNN trained from relatively small-size DVH samples, fully demonstrated the feasibility of applying the proposed method to small-size patient data. Excellent agreements in both EUD results and maximum dose results between the predictions and original plans indicated the application prospect in a physically and biologically related (or a mixture of both) model for treatment planning.

Data-driven dose calculation algorithm based on deep U-Net

Accurate and efficient dose calculation is an important prerequisite to ensure the success of radiation therapy. However, all the dose calculation algorithms commonly used in current clinical practice have to compromise between calculation accuracy and efficiency, which may result in unsatisfactory dose accuracy or highly intensive computation time in many clinical situations. The purpose of this work is to develop a novel dose calculation algorithm based on the deep learning method for radiation therapy. In this study we performed a feasibility investigation on implementing a fast and accurate dose calculation based on a deep learning technique. A two-dimensional (2D) fluence map was first converted into a three-dimensional (3D) volume using ray traversal algorithm. 3D U-Net like deep residual network was then established to learn a mapping between this converted 3D volume, CT and 3D dose distribution. Therefore an indirect relationship was built between a fluence map and its corresponding 3D dose distribution without using significantly complex neural networks. Two hundred patients, including nasopharyngeal, lung, rectum and breast cancer cases, were collected and applied to train the proposed network. Additional 47 patients were randomly selected to evaluate the accuracy of the proposed method through comparing dose distributions, dose volume histograms and clinical indices with the results from a treatment planning system (TPS), which was used as the ground truth in this study. The proposed deep learning based dose calculation algorithm achieved good predictive performance. For 47 tested patients, the average per-voxel bias of the deep learning calculated value and standard deviation (normalized to the prescription), relative to the TPS calculation, is 0.17%±2.28%. The average deep learning calculated values and standard deviations for relevant clinical indices were compared with the TPS calculated results and the t-test p-values demonstrated the consistency between them. In this study we developed a new deep learning based dose calculation method. This approach was evaluated by the clinical cases with different sites. Our results demonstrated its feasibility and reliability and indicated its great potential to improve the efficiency and accuracy of radiation dose calculation for different treatment modalities.

A preliminary study of a photon dose calculation algorithm using a convolutional neural network

The aim of dose calculation algorithm research is to improve the calculation accuracy while maximizing the calculation efficiency. In this study, the three-dimensional distribution of total energy release per unit mass (TERMA) and the electron density (ED) distribution are considered inputs in a method for calculating the three-dimensional dose distribution based on a convolutional neural network (CNN). Attempts are made to improve the efficiency of the collapsed cone convolution/superposition (CCCS) algorithm while providing an approach to improve the efficiency of other traditional dose calculation algorithms. Twelve sets of computed tomography (CT) images were employed for training. Data sets were generated by the CCCS algorithm with a random beam configuration. For each monoenergetic photon model, 7500 samples were generated for the training set, and 1500 samples were generated for the validation set. Training occurred for 0.5 MeV, 1 MeV, 2 MeV, 3 MeV, 4 MeV, 5 MeV, and 6 MeV monoenergetic photon models. To evaluate the usability under linac conditions, a comparison between CCCS and CNN-Dose was performed for the Mohan 6-MV spectrum for 12 additional new sets of CT images with different anatomies. A total of 1512 test samples were generated. For all anatomies, the mean value, 95% lower confidence limit (LCL) and 95% upper confidence limit (UCL) were 99.56%, 99.51% and 99.61%, respectively, at the 3%/2 mm criteria. The mean value, 95% LCL and 95% UCL were 98.57%, 98.46% and 98.67%, respectively, at the 2%/2 mm criteria. The results meet the relevant clinical requirements. In the proposed methods, the dose distribution of clinical energy can be obtained by TERMA, and the electronic density can be obtained with a CNN. This method can also be used for other traditional dose algorithms and displays potential in treatment planning, adaptive radiation therapy, and in vivo verification.

Artificial intelligence in radiation oncology

Artificial intelligence (AI) has the potential to fundamentally alter the way medicine is practised. AI platforms excel in recognizing complex patterns in medical data and provide a quantitative, rather than purely qualitative, assessment of clinical conditions. Accordingly, AI could have particularly transformative applications in radiation oncology given the multifaceted and highly technical nature of this field of medicine with a heavy reliance on digital data processing and computer software. Indeed, AI has the potential to improve the accuracy, precision, efficiency and overall quality of radiation therapy for patients with cancer. In this Perspective, we first provide a general description of AI methods, followed by a high-level overview of the radiation therapy workflow with discussion of the implications that AI is likely to have on each step of this process. Finally, we describe the challenges associated with the clinical development and implementation of AI platforms in radiation oncology and provide our perspective on how these platforms might change the roles of radiotherapy medical professionals.