A new sparse optimization scheme for simultaneous beam angle and fluence map optimization in radiotherapy planning

Comparison of non-coplanar optimization of static beams and arc trajectories for intensity-modulated treatments of meningioma cases

Two methods for non-coplanar beam direction optimization, one for static beams and another for arc trajectories, were proposed for intracranial tumours. The results of the beam angle optimizations were compared with the beam directions used in the clinical plans. Ten meningioma cases already treated were selected for this retrospective planning study. Algorithms for non-coplanar beam angle optimization (BAO) and arc trajectory optimization (ATO) were used to generate the corresponding plans. A plan quality score, calculated by a graphical method for plan assessment and comparison, was used to guide the beam angle optimization process. For each patient, the clinical plans (CLIN), created with the static beam orientations used for treatment, and coplanar VMAT approximated plans (VMAT) were also generated. To make fair plan comparisons, all plan optimizations were performed in an automated multicriteria calculation engine and the dosimetric plan quality was assessed. BAO and ATO plans presented, on average, moderate global plan score improvements over VMAT and CLIN plans. Nevertheless, while BAO and CLIN plans assured a more efficient OARs sparing, the ATO and VMAT plans presented a higher coverage and conformity of the PTV. Globally, all plans presented high-quality dose distributions. No statistically significant quality differences were found, on average, between BAO, ATO and CLIN plans. However, automated plan solution optimizations (BAO or ATO) may improve plan generation efficiency and standardization. In some individual patients, plan quality improvements were achieved with ATO plans, demonstrating the possible benefits of this automated optimized delivery technique.

A reinforcement learning application of a guided Monte Carlo Tree Search algorithm for beam orientation selection in radiation therapy

Current beam orientation optimization algorithms for radiotherapy, such as column generation (CG), are typically heuristic or greedy in nature because of the size of the combinatorial problem, which leads to suboptimal solutions. We propose a reinforcement learning strategy using a Monte Carlo Tree Search (MCTS) that can find a better beam orientation set in less time than CG. We utilize a reinforcement learning structure involving a supervised learning network to guide the MCTS and to explore the decision space of beam orientation selection problems. We previously trained a deep neural network (DNN) that takes in the patient anatomy, organ weights, and current beams, then approximates beam fitness values to indicate the next best beam to add. Here, we use this DNN to probabilistically guide the traversal of the branches of the Monte Carlo decision tree to add a new beam to the plan. To assess the feasibility of the algorithm, we used a test set of 13 prostate cancer patients, distinct from the 57 patients originally used to train and validate the DNN, to solve five-beam plans. To show the strength of the guided MCTS (GTS) compared to other search methods, we also provided the performances of Guided Search, Uniform Tree Search and Random Search algorithms. On average, GTS outperformed all the other methods. It found a better solution than CG in 237 s on average, compared to 360 s for CG, and outperformed all other methods in finding a solution with a lower objective function value in less than 1000 s. Using our GTS method, we could maintain planning target volume (PTV) coverage within 1% error similar to CG, while reducing the organ-at-risk mean dose for body, rectum, left and right femoral heads; the mean dose to bladder was 1% higher with GTS than with CG.

A cooperative game solution approach for intensity modulated radiation therapy design: Nash Social Welfare optimization

We study the fluency map optimization problem in Intensity Modulated Radiation Therapy (IMRT) from a cooperative game theory point of view. We consider the cancerous and healthy organs in a patient's body as players of a game, where cancerous organs seek to eliminate the cancerous cells and healthy organs seek to receive no harm. The goal is to balance the trade-offs between the utility of players by forming a grand coalition between them. We do so by proposing a methodology that solves a few convex optimization problems in order to transform the fluency map optimization problem into a bargaining game. To solve the bargaining game, we employ the concept of Nash Social Welfare (NSW) optimization due to the desirable efficiency and fairness properties of its outcomes. The proposed NSW optimization is convex and can be solved by powerful commercial solvers such as CPLEX. An additional advantage of the proposed approach is that it has a new control lever for the fluency map optimization, the so-called negotiation powers, which enables practitioners to put more emphasis on an organ by changing its negotiation power. To show the efficacy of our proposed methodology, we apply it to the TG-119 case and a liver case. We compare our proposed approach with a state-of-the-art approach through creating Dose Volume Histograms.

A fast deep learning approach for beam orientation optimization for prostate cancer treated with intensity-modulated radiation therapy

PURPOSE

Beam orientation selection, whether manual or protocol-based, is the current clinical standard in radiation therapy treatment planning, but it is tedious and can yield suboptimal results. Many algorithms have been designed to optimize beam orientation selection because of its impact on treatment plan quality, but these algorithms suffer from slow calculation of the dose influence matrices of all candidate beams. We propose a fast beam orientation selection method, based on deep learning neural networks (DNN), capable of developing a plan comparable to those developed by the state-of-the-art column generation (CG) method. Our model's novelty lies in its supervised learning structure (using CG to teach the network), DNN architecture, and ability to learn from anatomical features to predict dosimetrically suitable beam orientations without using dosimetric information from the candidate beams. This may save hours of computation.

METHODS

A supervised DNN is trained to mimic the CG algorithm, which iteratively chooses beam orientations one-by-one by calculating beam fitness values based on Karush-Kush-Tucker optimality conditions at each iteration. The DNN learns to predict these values. The dataset contains 70 prostate cancer patients - 50 training, 7 validation, and 13 test patients - to develop and test the model. Each patient's data contains 6 contours: PTV, body, bladder, rectum, and left and right femoral heads. Column generation was implemented with a GPU-based Chambolle-Pock algorithm, a first-order primal-dual proximal-class algorithm, to create 6270 plans. The DNN trained over 400 epochs, each with 2500 steps and a batch size of 1, using the Adam optimizer at a learning rate of 1 × 10-5 and a sixfold cross-validation technique.

RESULTS

The average and standard deviation of training, validation, and testing loss functions among the six folds were 0.62 ± 0.09%, 1.04 ± 0.06%, and 1.44 ± 0.11%, respectively. Using CG and supervised DNN, we generated two sets of plans for each scenario in the test set. The proposed method took at most 1.5 s to select a set of five beam orientations and 300 s to calculate the dose influence matrices for 5 beams and finally 20 s to solve the fluence map optimization (FMO). However, CG needed around 15 h to calculate the dose influence matrices of all beams and at least 400 s to solve both the beam orientation selection and FMO problems. The differences in the dose coverage of PTV between plans generated by CG and by DNN were 0.2%. The average dose differences received by organs at risk were between 1 and 6 percent: Bladder had the smallest average difference in dose received (0.956 ± 1.184%), then Rectum (2.44 ± 2.11%), Left Femoral Head (6.03 ± 5.86%), and Right Femoral Head (5.885 ± 5.515%). The dose received by Body had an average difference of 0.10 ± 0.1% between the generated treatment plans.

CONCLUSIONS

We developed a fast beam orientation selection method based on a DNN that selects beam orientations in seconds and is therefore suitable for clinical routines. In the training phase of the proposed method, the model learns the suitable beam orientations based on patients' anatomical features and omits time intensive calculations of dose influence matrices for all possible candidate beams. Solving the FMO to get the final treatment plan requires calculating dose influence matrices only for the selected beams.

Beam selection for stereotactic ablative radiotherapy using Cyberknife with multileaf collimation

The Cyberknife system (Accuray Inc., Sunnyvale, CA) enables radiotherapy using stereotactic ablative body radiotherapy (SABR) with a large number of non-coplanar beam orientations. Recently, a multileaf collimator has also been available to allow flexibility in field shaping. This work aims to evaluate the quality of treatment plans obtainable with the multileaf collimator. Specifically, the aim is to find a subset of beam orientations from a predetermined set of candidate directions, such that the treatment quality is maintained but the treatment time is reduced. An evolutionary algorithm is used to successively refine a randomly selected starting set of beam orientations. By using an efficient computational framework, clinically useful solutions can be found in several hours. It is found that 15 beam orientations are able to provide treatment quality which approaches that of the candidate beam set of 110 beam orientations, but with approximately half of the estimated treatment time. Choice of an efficient subset of beam orientations offers the possibility to improve the patient experience and maximise the number of patients treated.

Lung IMRT planning with automatic determination of beam angle configurations

Beam angle configuration is a major planning decision in intensity modulated radiation treatment (IMRT) that has a significant impact on dose distributions and thus quality of treatment, especially in complex planning cases such as those for lung cancer treatment. We propose a novel method to automatically determine beam configurations that incorporates noncoplanar beams. We then present a completely automated IMRT planning algorithm that combines the proposed method with a previously reported OAR DVH prediction model. Finally, we validate this completely automatic planning algorithm using a set of challenging lung IMRT cases. A beam efficiency index map is constructed to guide the selection of beam angles. This index takes into account both the dose contributions from individual beams and the combined effect of multiple beams by introducing a beam-spread term. The effect of the beam-spread term on plan quality was studied systematically and the weight of the term to balance PTV dose conformity against OAR avoidance was determined. For validation, complex lung cases with clinical IMRT plans that required the use of one or more noncoplanar beams were re-planned with the proposed automatic planning algorithm. Important dose metrics for the PTV and OARs in the automatic plans were compared with those of the clinical plans. The results are very encouraging. The PTV dose conformity and homogeneity in the automatic plans improved significantly. And all the dose metrics of the automatic plans, except the lung V_{5 Gy}, were statistically better than or comparable with those of the clinical plans. In conclusion, the automatic planning algorithm can incorporate non-coplanar beam configurations in challenging lung cases and can generate plans efficiently with quality closely approximating that of clinical plans.

Isodose feature-preserving voxelization (IFPV) for radiation therapy treatment planning

PURPOSE

Inverse planning involves iterative optimization of a large number of parameters and is known to be a labor-intensive procedure. To reduce the scale of computation and improve characterization of isodose plan, this paper presents an isodose feature-preserving voxelization (IFPV) framework for radiation therapy applications and demonstrates an implementation of inverse planning in the IFPV domain.

METHODS

A dose distribution in IFPV scheme is characterized by partitioning the voxels into subgroups according to their geometric and dosimetric values. Computationally, the isodose feature-preserving (IFP) clustering combines the conventional voxels that are spatially and dosimetrically close into physically meaningful clusters. A K-means algorithm and support vector machine (SVM) runs sequentially to group the voxels into IFP clusters. The former generates initial clusters according to the geometric and dosimetric information of the voxels and SVM is invoked to improve the connectivity of the IFP clusters. To illustrate the utility of the formalism, an inverse planning framework in the IFPV domain is implemented, and the resultant plans of three prostate IMRT and one head-and-neck cases are compared quantitatively with that obtained using conventional inverse planning technique.

RESULTS

The IFPV generates models with significant dimensionality reduction without compromising the spatial resolution seen in traditional downsampling schemes. The implementation of inverse planning in IFPV domain is demonstrated. In addition to the improved computational efficiency, it is found that, for the cases studied here, the IFPV-domain inverse planning yields better treatment plans than that of DVH-based planning, primarily because of more effective use of both geometric and dose information of the system during plan optimization.

CONCLUSIONS

The proposed IFPV provides a low parametric representation of isodose plan without compromising the essential characteristics of the plan, thus providing a practically valuable framework for various applications in radiation therapy.

Fraction-variant beam orientation optimization for non-coplanar IMRT

Conventional beam orientation optimization (BOO) algorithms for IMRT assume that the same set of beam angles is used for all treatment fractions. In this paper we present a BOO formulation based on group sparsity that simultaneously optimizes non-coplanar beam angles for all fractions, yielding a fraction-variant (FV) treatment plan. Beam angles are selected by solving a multi-fraction fluence map optimization problem involving 500-700 candidate beams per fraction, with an additional group sparsity term that encourages most candidate beams to be inactive. The optimization problem is solved using the fast iterative shrinkage-thresholding algorithm. Our FV BOO algorithm is used to create five-fraction treatment plans for digital phantom, prostate, and lung cases as well as a 30-fraction plan for a head and neck case. A homogeneous PTV dose coverage is maintained in all fractions. The treatment plans are compared with fraction-invariant plans that use a fixed set of beam angles for all fractions. The FV plans reduced OAR mean dose and D 2 values on average by 3.3% and 3.8% of the prescription dose, respectively. Notably, mean OAR dose was reduced by 14.3% of prescription dose (rectum), 11.6% (penile bulb), 10.7% (seminal vesicle), 5.5% (right femur), 3.5% (bladder), 4.0% (normal left lung), 15.5% (cochleas), and 5.2% (chiasm). D 2 was reduced by 14.9% of prescription dose (right femur), 8.2% (penile bulb), 12.7% (proximal bronchus), 4.1% (normal left lung), 15.2% (cochleas), 10.1% (orbits), 9.1% (chiasm), 8.7% (brainstem), and 7.1% (parotids). Meanwhile, PTV homogeneity defined as D 95/D 5 improved from .92 to .95 (digital phantom), from .95 to .98 (prostate case), and from .94 to .97 (lung case), and remained constant for the head and neck case. Moreover, the FV plans are dosimetrically similar to conventional plans that use twice as many beams per fraction. Thus, FV BOO offers the potential to reduce delivery time for non-coplanar IMRT.