1
|
Hrinivich WT, Bhattacharya M, Mekki L, McNutt T, Jia X, Li H, Song DY, Lee J. Clinical VMAT machine parameter optimization for localized prostate cancer using deep reinforcement learning. Med Phys 2024; 51:3972-3984. [PMID: 38669457 DOI: 10.1002/mp.17100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 03/20/2024] [Accepted: 04/14/2024] [Indexed: 04/28/2024] Open
Abstract
BACKGROUND Volumetric modulated arc therapy (VMAT) machine parameter optimization (MPO) remains computationally expensive and sensitive to input dose objectives creating challenges for manual and automatic planning. Reinforcement learning (RL) involves machine learning through extensive trial-and-error, demonstrating performance exceeding humans, and existing algorithms in several domains. PURPOSE To develop and evaluate an RL approach for VMAT MPO for localized prostate cancer to rapidly and automatically generate deliverable VMAT plans for a clinical linear accelerator (linac) and compare resultant dosimetry to clinical plans. METHODS We extended our previous RL approach to enable VMAT MPO of a 3D beam model for a clinical linac through a policy network. It accepts an input state describing the current control point and predicts continuous machine parameters for the next control point, which are used to update the input state, repeating until plan termination. RL training was conducted to minimize a dose-based cost function for prescription of 60 Gy in 20 fractions using CT scans and contours from 136 retrospective localized prostate cancer patients, 20 of which had existing plans used to initialize training. Data augmentation was employed to mitigate over-fitting, and parameter exploration was achieved using Gaussian perturbations. Following training, RL VMAT was applied to an independent cohort of 15 patients, and the resultant dosimetry was compared to clinical plans. We also combined the RL approach with our clinical treatment planning system (TPS) to automate final plan refinement, and creating the potential for manual review and edits as required for clinical use. RESULTS RL training was conducted for 5000 iterations, producing 40 000 plans during exploration. Mean ± SD execution time to produce deliverable VMAT plans in the test cohort was 3.3 ± 0.5 s which were automatically refined in the TPS taking an additional 77.4 ± 5.8 s. When normalized to provide equivalent target coverage, the RL+TPS plans provided a similar mean ± SD overall maximum dose of 63.2 ± 0.6 Gy and a lower mean rectum dose of 17.4 ± 7.4 compared to 63.9 ± 1.5 Gy (p = 0.061) and 21.0 ± 6.0 (p = 0.024) for the clinical plans. CONCLUSIONS An approach for VMAT MPO using RL for a clinical linac model was developed and applied to automatically generate deliverable plans for localized prostate cancer patients, and when combined with the clinical TPS shows potential to rapidly generate high-quality plans. The RL VMAT approach shows promise to discover advanced linac control policies through trial-and-error, and algorithm limitations and future directions are identified and discussed.
Collapse
Affiliation(s)
- William T Hrinivich
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA
| | - Mahasweta Bhattacharya
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA
| | - Lina Mekki
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA
| | - Todd McNutt
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA
| | - Xun Jia
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA
| | - Heng Li
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA
| | - Daniel Y Song
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA
| | - Junghoon Lee
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA
| |
Collapse
|
2
|
Chourak H, Barateau A, Greer P, Lafond C, Nunes JC, de Crevoisier R, Dowling J, Acosta O. Determination of acceptable Hounsfield units uncertainties via a sensitivity analysis for an accurate dose calculation in the context of prostate MRI-only radiotherapy. Phys Eng Sci Med 2023; 46:1703-1711. [PMID: 37815702 DOI: 10.1007/s13246-023-01333-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 09/06/2023] [Indexed: 10/11/2023]
Abstract
Radiation therapy is moving from CT based to MRI guided planning, particularly for soft tissue anatomy. An important requirement of this new workflow is the generation of synthetic-CT (sCT) from MRI to enable treatment dose calculations. Automatic methods to determine the acceptable range of CT Hounsfield Unit (HU) uncertainties to avoid dose distribution errors is thus a key step toward safe MRI-only radiotherapy. This work has analysed the effects of controlled errors introduced in CT scans on the delivered radiation dose for prostate cancer patients. Spearman correlation coefficient has been computed, and a global sensitivity analysis performed following the Morris screening method. This allows the classification of different error factors according to their impact on the dose at the isocentre. sCT HU estimation errors in the bladder appeared to be the least influential factor, and sCT quality assessment should not only focus on organs surrounding the radiation target, as errors in other soft tissue may significantly impact the dose in the target volume. This methodology links dose and intensity-based metrics, and is the first step to define a threshold of acceptability of HU uncertainties for accurate dose planning.
Collapse
Affiliation(s)
- Hilda Chourak
- Univ Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France.
- CSIRO Australian e-Health Research Centre, Herston, QLD, Australia.
| | - Anaïs Barateau
- Univ Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Peter Greer
- School of Mathematical and Physical Sciences, University of Newcastle, Newcastle, NSW, Australia
- Radiation Oncology, Calvary Mater Newcastle Hospital, Newcastle, NSW, Australia
| | - Caroline Lafond
- Univ Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | - Jean-Claude Nunes
- Univ Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| | | | - Jason Dowling
- CSIRO Australian e-Health Research Centre, Herston, QLD, Australia.
| | - Oscar Acosta
- Univ Rennes, CLCC Eugène Marquis, INSERM, LTSI - UMR 1099, Rennes, France
| |
Collapse
|
3
|
Huang C, Nomura Y, Yang Y, Xing L. Fully automated segmentally boosted VMAT. Med Phys 2023; 50:3842-3851. [PMID: 36779662 PMCID: PMC10272012 DOI: 10.1002/mp.16295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 01/23/2023] [Accepted: 01/30/2023] [Indexed: 02/14/2023] Open
Abstract
PURPOSE Treatment planning for volumetric modulated arc therapy (VMAT) typically involves the use of multiple arcs to achieve sufficient intensity modulation. Alternatively, we can perform segment boosting to achieve similar intensity modulation while also reducing the number of control points used. Here, we propose the MetaPlanner Boosted VMAT (MPBV) approach, which generates boosted VMAT plans through a fully automated framework. METHODS The proposed MPBV approach is an open-source framework that consists of three main stages: meta-optimization of treatment plan hyperparameters, fast beam angle optimization on a coarse dose grid to select desirable segments for boosting, and final plan generation (i.e., constructing the boosted VMAT arc and performing optimization). RESULTS Performance for the MPBV approach is evaluated on 21 prostate cases and 6 head and neck cases using clinically relevant plan quality metrics (i.e., target coverage, dose conformity, dose homogeneity, and OAR sparing). As compared to two baseline methods with multiple arcs, MPBV maintains or improves dosimetric performance for the evaluated metrics while substantially reducing average estimated delivery times (from 2.6 to 2.1 min). CONCLUSION Our proposed MPBV approach provides an automated framework for producing high-quality VMAT plans that uses fewer control points and reduces delivery time as compared to traditional approaches with multiple arcs. MPBV applies automated treatment planning to segmentally boosted VMAT to address the beam utilization inefficiencies of traditional VMAT approaches that use multiple full arcs.
Collapse
Affiliation(s)
- Charles Huang
- Department of Bioengineering, Stanford University, Stanford, USA
| | - Yusuke Nomura
- Department of Radiation Oncology, Stanford University, Stanford, USA
| | - Yong Yang
- Department of Radiation Oncology, Stanford University, Stanford, USA
| | - Lei Xing
- Department of Radiation Oncology, Stanford University, Stanford, USA
| |
Collapse
|
4
|
Sun H, Wang N, Wang X, Huang G, Chang Y, Liu Y. A study of different minimum segment area parameters on automatic IMRT plans for cervical cancer using Pinnacle3 9.10 TPS. Medicine (Baltimore) 2022; 101:e29290. [PMID: 36086767 PMCID: PMC10980374 DOI: 10.1097/md.0000000000029290] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 03/24/2022] [Accepted: 03/24/2022] [Indexed: 11/25/2022] Open
Abstract
Based on Pinnacle39.10 treatment planning system (TPS) automatic planning module, we investigated the effect of minimum segmentation area (MSA) parameters on Auto-Plan Intensity Modulated Radiotherapy (AP-IMRT) without affecting the dose distribution of the target and the Organ at Risk (OAR). The results provided the basis for the ideal MSA parameters in the design of AP-IMRT plan. Ten patients with cervical cancer in our hospital were selected randomly for AP-IMRT design. Each patient was devised with 10 AP-IMRT plans. The prescription dose of PTV was 50 Gy/25 fractions. The radiotherapy plans of all patients were adopted with 7 field-averaged fixed fields. The MSA was set to 4 cm2, 9 cm2, 14 cm2, 20 cm2, 25 cm2, 40 cm2, 50 cm2, 60 cm2, 80 cm2, and 100 cm2. Plan quality and delivery efficiency were evaluated based on dose-volume histograms (DVHs), control points, monitor units (MUs), dosimetric measurement verification results, and plan delivery time. Except for the small difference in monitor units, the number of segmentations and target dose coverage, there were no statistically significant differences between the other dosimetric parameters in the planning target volumes. With the increase of MSA, the total number of MUs in AP-IMRT decreased from (649 ± 32) MUs to (312 ± 26) MUs, and the total number of segmentations decreased from (69 ± 1) to (28 ± 3). There was no statistical significance in the dose distribution of AP-IMRT target area with the MSA of 4-50 cm2 (P > .05). There was no significant difference in OAR dose between AP-IMRT plans with different MSA (P > .05). The calculated gamma indices using the 3% /3 mm and 2%/2 mm criteria. Both of the gamma pass rate and DTA pass rate all ≥95% under the condition of MSA are greater than 4 cm2, and the difference was no statistically significant (P > .05). The plan delivery times decreased with increasing MSA (P < .05). When using Pinnacle3 9.10 TPS to design AP-IMRT plan for cervical cancer, the parameter of MSA can be increased appropriately. Increasing the MSA allows for improved plan delivery accuracy and efficiency without significantly affecting the AP-IMRT plan quality. The MSA in the range of 14 to 50 cm2 can obtain a more reasonable dose distribution in the target area while the dose of target area and OAR had no significant changes. It is important to improve the plan quality, delivery accuracy, and efficiency for cervical AP-IMRT radiation therapy.
Collapse
Affiliation(s)
- Haitao Sun
- Zhongshan Hospital of Traditional Chinese Medicine, Affiliated to Guangzhou University of Chinese Medicine, Zhongshan, Guangdong Province, People’s Republic of China
| | - Ning Wang
- Zhongshan Hospital of Traditional Chinese Medicine, Affiliated to Guangzhou University of Chinese Medicine, Zhongshan, Guangdong Province, People’s Republic of China
| | - Xuetao Wang
- Zhongshan Hospital of Traditional Chinese Medicine, Affiliated to Guangzhou University of Chinese Medicine, Zhongshan, Guangdong Province, People’s Republic of China
| | - Guosen Huang
- Zhongshan Hospital of Traditional Chinese Medicine, Affiliated to Guangzhou University of Chinese Medicine, Zhongshan, Guangdong Province, People’s Republic of China
| | - Yaohua Chang
- School of Control Science and Engineering, Shandong University, Jinan, Shandong Province, People’s Republic of China
| | - Ying Liu
- The Fifth Affiliated Hospital of Guangzhou Medical University, Guangzhou, Guangdong Province, People’s Republic of China
| |
Collapse
|
5
|
Wang Y, Liu H, Yang Y, Lu B. A practical algorithm for VMAT optimization using column generation techniques. Med Phys 2022; 49:4335-4352. [PMID: 35616306 DOI: 10.1002/mp.15776] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 05/05/2022] [Accepted: 05/13/2022] [Indexed: 11/05/2022] Open
Abstract
PURPOSE As a challenging but important optimization problem, the inverse planning for volumetric modulated arc therapy (VMAT) has attracted much research attention. The column generation (CG) type method is so far one of the most effective solution schemes. However, it often relies on simplifications leading to significant gaps between the output and the actual feasible plan. This paper presents a novel column generation (NCG) approach to push the planning results substantially closer to practice. METHODS The proposed NCG algorithm is equipped with multiple new quality-enhancing and computation-facilitating modules as below (A) Flexible constraints are enabled on both dose rates and treatment time to adapt to machine capabilities as well as planner's preferences, respectively; (B) A cross-control-point intermediate aperture simulation is incorporated to better conform to the underlying physics; (C) New pricing and pruning subroutines are adopted to achieve better optimization outputs. To evaluate the effectiveness of this NCG, five VMAT plans, i.e., three prostate cases and two head-and-neck cases, were computed using proposed NCG. The planning results were compared with those yielded by a historical benchmark planning scheme. RESULTS The NCG generated plans of significantly better quality than the benchmark planning algorithm. For prostate cases, NCG plans satisfied all PTV criteria whereas CG plans failed on D10% criteria of PTVs for over 9 Gy or more on all cases. For head-and-neck cases, again, NCG plans satisfied all PTVs criteria while CG plans failed on D10% criteria of PTVs for over 3 Gy or more on all cases as well as the max dose criteria of both cord and brain stem for over 13 Gy on one case. Moreover, the pruning scheme was found to be effective in enhancing the optimization quality. CONCLUSIONS The proposed NCG inherits the computational advantages of the traditional CG, while capturing a more realistic characterization of the machine capability and underlying physics. The output solutions of the NCG are substantially closer to practical implementation. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Yuanbo Wang
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL, 32611-6595, United States
| | - Hongcheng Liu
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL, 32611-6595, United States
| | - Yu Yang
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL, 32611-6595, United States
| | - Bo Lu
- Department of Radiation Oncology, College of Medicine, University of Florida, Gainesville, FL, 32610-0385, United States
| |
Collapse
|
6
|
Huang C, Nomura Y, Yang Y, Xing L. Meta-optimization for fully automated radiation therapy treatment planning. Phys Med Biol 2022; 67. [PMID: 35176734 DOI: 10.1088/1361-6560/ac5672] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Accepted: 02/17/2022] [Indexed: 11/11/2022]
Abstract
Objective. Radiation therapy treatment planning is a time-consuming process involving iterative adjustments of hyperparameters. To automate the treatment planning process, we propose a meta-optimization framework, called MetaPlanner (MP).Approach. Our MP algorithm automates planning by performing meta-optimization of treatment planning hyperparameters. The algorithm uses a derivative-free method (i.e. parallel Nelder-Mead simplex search) to search for weight configurations that minimize a meta-scoring function. Meta-scoring is performed by constructing a tier list of the relevant considerations (e.g. dose homogeneity, conformity, spillage, and OAR sparing) to mimic the clinical decision-making process. Additionally, we have made our source code publicly available via github.Main results. The proposed MP method is evaluated on two datasets (21 prostate cases and 6 head and neck cases) collected as part of clinical workflow. MP is applied to both IMRT and VMAT planning and compared to a baseline of manual VMAT plans. MP in both IMRT and VMAT scenarios has comparable or better performance than manual VMAT planning for all evaluated metrics.Significance. Our proposed MP provides a general framework for fully automated treatment planning that produces high quality treatment plans. Our MP method promises to substantially reduce the workload of treatment planners while maintaining or improving plan quality.
Collapse
Affiliation(s)
- Charles Huang
- Department of Bioengineering, Stanford University, Stanford, United States of America
| | - Yusuke Nomura
- Department of Radiation Oncology, Stanford University, Stanford, United States of America
| | - Yong Yang
- Department of Radiation Oncology, Stanford University, Stanford, United States of America
| | - Lei Xing
- Department of Radiation Oncology, Stanford University, Stanford, United States of America
| |
Collapse
|