A synthesized gamma distribution-based patient-specific VMAT QA using a generative adversarial network

Error detection for radiotherapy planning validation based on deep learning networks

BACKGROUND

Quality assurance (QA) of patient-specific treatment plans for intensity-modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT) necessitates prior validation. However, the standard methodology exhibits deficiencies and lacks sensitivity in the analysis of positional dose distribution data, leading to difficulties in accurately identifying reasons for plan verification failure. This issue complicates and impedes the efficiency of QA tasks.

PURPOSE

The primary aim of this research is to utilize deep learning algorithms for the extraction of 3D dose distribution maps and the creation of a predictive model for error classification across multiple machine models, treatment methodologies, and tumor locations.

METHOD

We devised five categories of validation plans (normal, gantry error, collimator error, couch error, and dose error), conforming to tolerance limits of different accuracy levels and employing 3D dose distribution data from a sample of 94 tumor patients. A CNN model was then constructed to predict the diverse error types, with predictions compared against the gamma pass rate (GPR) standard employing distinct thresholds (3%, 3 mm; 3%, 2 mm; 2%, 2 mm) to evaluate the model's performance. Furthermore, we appraised the model's robustness by assessing its functionality across diverse accelerators.

RESULTS

The accuracy, precision, recall, and F1 scores of CNN model performance were 0.907, 0.925, 0.907, and 0.908, respectively. Meanwhile, the performance on another device is 0.900, 0.918, 0.900, and 0.898. In addition, compared to the GPR method, the CNN model achieved better results in predicting different types of errors.

CONCLUSION

When juxtaposed with the GPR methodology, the CNN model exhibits superior predictive capability for classification in the validation of the radiation therapy plan on different devices. By using this model, the plan validation failures can be detected more rapidly and efficiently, minimizing the time required for QA tasks and serving as a valuable adjunct to overcome the constraints of the GPR method.

Applications of artificial intelligence for machine- and patient-specific quality assurance in radiation therapy: current status and future directions

Machine- and patient-specific quality assurance (QA) is essential to ensure the safety and accuracy of radiotherapy. QA methods have become complex, especially in high-precision radiotherapy such as intensity-modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT), and various recommendations have been reported by AAPM Task Groups. With the widespread use of IMRT and VMAT, there is an emerging demand for increased operational efficiency. Artificial intelligence (AI) technology is quickly growing in various fields owing to advancements in computers and technology. In the radiotherapy treatment process, AI has led to the development of various techniques for automated segmentation and planning, thereby significantly enhancing treatment efficiency. Many new applications using AI have been reported for machine- and patient-specific QA, such as predicting machine beam data or gamma passing rates for IMRT or VMAT plans. Additionally, these applied technologies are being developed for multicenter studies. In the current review article, AI application techniques in machine- and patient-specific QA have been organized and future directions are discussed. This review presents the learning process and the latest knowledge on machine- and patient-specific QA. Moreover, it contributes to the understanding of the current status and discusses the future directions of machine- and patient-specific QA.

Assessment of the deep learning-based gamma passing rate prediction system for 1.5 T magnetic resonance-guided linear accelerator

Measurement-based verification is impossible for the patient-specific quality assurance (QA) of online adaptive magnetic resonance imaging-guided radiotherapy (oMRgRT) because the patient remains on the couch throughout the session. We assessed a deep learning (DL) system for oMRgRT to predict the gamma passing rate (GPR). This study collected 125 verification plans [reference plan (RP), 100; adapted plan (AP), 25] from patients with prostate cancer treated using Elekta Unity. Based on our previous study, we employed a convolutional neural network that predicted the GPRs of nine pairs of gamma criteria from 1%/1 mm to 3%/3 mm. First, we trained and tested the DL model using RPs (n = 75 and n = 25 for training and testing, respectively) for its optimization. Second, we tested the GPR prediction accuracy using APs to determine whether the DL model could be applied to APs. The mean absolute error (MAE) and correlation coefficient (r) of the RPs were 1.22 ± 0.27% and 0.29 ± 0.10 in 3%/2 mm, 1.35 ± 0.16% and 0.37 ± 0.15 in 2%/2 mm, and 3.62 ± 0.55% and 0.32 ± 0.14 in 1%/1 mm, respectively. The MAE and r of the APs were 1.13 ± 0.33% and 0.35 ± 0.22 in 3%/2 mm, 1.68 ± 0.47% and 0.30 ± 0.11 in 2%/2 mm, and 5.08 ± 0.29% and 0.15 ± 0.10 in 1%/1 mm, respectively. The time cost was within 3 s for the prediction. The results suggest the DL-based model has the potential for rapid GPR prediction in Elekta Unity.

Unbiased evaluation of predicted gamma passing rate by an event-mixing technique

BACKGROUND

Predicting models of the gamma passing rate (GPR) have been studied to substitute the measurement-based gamma analysis. Since these studies used data from different radiotherapy systems comprising TPS, linear accelerator, and detector array, it has been difficult to compare the performances of the predicting models among institutions with different radiotherapy systems.

PURPOSE

We aimed to develop unbiased scoring methods to evaluate the performance of the models predicting the GPR, by introducing both best and worst limits for the performance of the GPR prediction.

METHODS

Two hundred head-and-neck VMAT plans were used to develop a framework. The GPRs were measured using the ArcCHECK device. The predicted GPR [p] was generated using a deep learning-based model [pDL ]. The predicting model was evaluated using four metrics: standard deviation (SD) [σ], Pearson's correlation coefficient (CC) [r], mean squared error (MSE) [s], and mean absolute error (MAE) [a]. The best limit [σ m ${\sigma _m}$ ,r m ${r_m}$ ,s m ${s_m}$ , anda m ${a_m}$ ] was estimated by measuring the SD of measured GPR [m] by shifting the device along the longitudinal direction to measure different sampling points. Mimicked best and worst p's [pbest and pworst ] were generated from pDL . The worst limit was defined such that m and p have no correlation [CC ∼ 0]. The worst limit [σMix , rMix , sMix , and aMix ] was generated using the event-mixing (EM) technique originally introduced in high-energy physics experiments. The range of σ, r, s, and a was defined to be[ σ m , σ Mix ] $[ {{\sigma _m},{\sigma _{{\mathrm{Mix}}}}} ]$ ,[ 0 , r m ] $[ {0,{r_m}} ]$ ,[ s m , s Mix ] $[ {{s_m},{s_{{\mathrm{Mix}}}}} ]$ , and[ a m , a Mix ] $[ {{a_m},{a_{{\mathrm{Mix}}}}} ]$ . The achievement score (AS) independently based on σ, r, s, and a were calculated for pDL , pbest and pworst . The probability that p fails the gamma analysis (alert frequency; AF) was estimated as a function ofσ d ${\sigma _d}$ values within the [σ m ${\sigma _m}$ , σMix ] range for the 3%/2 mm data with a 95% criterion.

RESULTS

SDs of the best limit were well reproduced byσ m = 0.531 100 - m ${\sigma _m} = \;0.531\sqrt {100 - m} $ . The EM technique successfully generated the( m , p ) $( {m,p} )$ pairs with no correlation. The AS using four metrics showed good agreement. This agreement indicates successful definitions of both best and worst limits, consistent definitions of the AS, and successful generations of mixed events. The AF for the DL-based model with the 3%/2 mm tolerance was 31.5% and 63.0% with CL's 99% and 99.9%, respectively.

CONCLUSION

We developed the AS to evaluate the predicting model of the GPR in an unbiased manner by excluding the effects of the precision of the radiotherapy system and the spreading of the GPR. The best and worst limits of the GPR prediction were successfully generated using the measured precision of the GPR and the EM technique, respectively. The AS andσ p ${\sigma _p}$ are expected to enable objective evaluation of the predicting model and setting exact achievement goal of precision for the predicted GPR.

Prediction of patient-specific quality assurance for volumetric modulated arc therapy using radiomics-based machine learning with dose distribution

PURPOSE

We sought to develop machine learning models to predict the results of patient-specific quality assurance (QA) for volumetric modulated arc therapy (VMAT), which were represented by several dose-evaluation metrics-including the gamma passing rates (GPRs)-and criteria based on the radiomic features of 3D dose distribution in a phantom.

METHODS

A total of 4,250 radiomic features of 3D dose distribution in a cylindrical dummy phantom for 140 arcs from 106 clinical VMAT plans were extracted. We obtained the following dose-evaluation metrics: GPRs with global and local normalization, the dose difference (DD) in 1% and 2% passing rates (DD1% and DD2%) for 10% and 50% dose threshold, and the distance-to-agreement in 1-mm and 2-mm passing rates (DTA1 mm and DTA2 mm) for 0.5%/mm and 1.0%.mm dose gradient threshold determined by measurement using a diode array in patient-specific QA. The machine learning regression models for predicting the values of the dose-evaluation metrics using the radiomic features were developed based on the elastic net (EN) and extra trees (ET) models. The feature selection and tuning of hyperparameters were performed with nested cross-validation in which four-fold cross-validation is used within the inner loop, and the performance of each model was evaluated in terms of the root mean square error (RMSE), the mean absolute error (MAE), and Spearman's rank correlation coefficient.

RESULTS

The RMSE and MAE for the developed machine learning models ranged from <1% to nearly <10% depending on the dose-evaluation metric, the criteria, and dose and dose gradient thresholds used for both machine learning models. It was advantageous to focus on high dose region for predicating global GPR, DDs, and DTAs. For certain metrics and criteria, it was possible to create models applicable for patients' heterogeneity by training only with dose distributions in phantom.

CONCLUSIONS

The developed machine learning models showed high performance for predicting dose-evaluation metrics especially for high dose region depending on the metric and criteria. Our results demonstrate that the radiomic features of dose distribution can be considered good indicators of the plan complexity and useful in predicting measured dose evaluation metrics.

Virtual pretreatment patient-specific quality assurance of volumetric modulated arc therapy using deep learning

BACKGROUND

Automatic patient-specific quality assurance (PSQA) is recently explored using artificial intelligence approaches, and several studies reported the development of machine learning models for predicting the gamma pass rate (GPR) index only.

PURPOSE

To develop a novel deep learning approach using a generative adversarial network (GAN) to predict the synthetic measured fluence.

METHODS AND MATERIALS

A novel training method called "dual training," which involves the training of the encoder and decoder separately, was proposed and evaluated for cycle GAN (cycle-GAN) and conditional GAN (c-GAN). A total of 164 VMAT treatment plans, including 344 arcs (training data: 262, validation data: 30, and testing data: 52) from various treatment sites, were selected for prediction model development. For each patient, portal-dose-image-prediction fluence from TPS was used as input, and measured fluence from EPID was used as output/response for model training. Predicted GPR was derived by comparing the TPS fluence with the synthetic measured fluence generated by the DL models using gamma evaluation of criteria 2%/2 mm. The performance of dual training was compared against the traditional single-training approach. In addition, we also developed a separate classification model specifically designed to detect automatically three types of errors (rotational, translational, and MU-scale) in the synthetic EPID-measured fluence.

RESULTS

Overall, the dual training improved the prediction accuracy of both cycle-GAN and c-GAN. Predicted GPR results of single training were within 3% for 71.2% and 78.8% of test cases for cycle-GAN and c-GAN, respectively. Moreover, similar results for dual training were 82.7% and 88.5% for cycle-GAN and c-GAN, respectively. The error detection model showed high classification accuracy (>98%) for detecting errors related to rotational and translational errors. However, it struggled to differentiate the fluences with "MU scale error" from "error-free" fluences.

CONCLUSION

We developed a method to automatically generate the synthetic measured fluence and identify errors within them. The proposed dual training improved the PSQA prediction accuracy of both the GAN models, with c-GAN demonstrating superior performance over the cycle-GAN. Our results indicate that the c-GAN with dual training approach combined with error detection model, can accurately generate the synthetic measured fluence for VMAT PSQA and identify the errors. This approach has the potential to pave the way for virtual patient-specific QA of VMAT treatments.