Knowledge-based three-dimensional dose prediction for tandem-and-ovoid brachytherapy

Artificial intelligence in interventional radiotherapy (brachytherapy): Enhancing patient-centered care and addressing patients' needs

This review explores the integration of artificial intelligence (AI) in interventional radiotherapy (IRT), emphasizing its potential to streamline workflows and enhance patient care. Through a systematic analysis of 78 relevant papers spanning from 2002 to 2024, we identified significant advancements in contouring, treatment planning, outcome prediction, and quality assurance. AI-driven approaches offer promise in reducing procedural times, personalizing treatments, and improving treatment outcomes for oncological patients. However, challenges such as clinical validation and quality assurance protocols persist. Nonetheless, AI presents a transformative opportunity to optimize IRT and meet evolving patient needs.

Improvement of accumulated dose distribution in combined cervical cancer radiotherapy with deep learning-based dose prediction

Purpose

Difficulties remain in dose optimization and evaluation of cervical cancer radiotherapy that combines external beam radiotherapy (EBRT) and brachytherapy (BT). This study estimates and improves the accumulated dose distribution of EBRT and BT with deep learning-based dose prediction.

Materials and methods

A total of 30 patients treated with combined cervical cancer radiotherapy were enrolled in this study. The dose distributions of EBRT and BT plans were accumulated using commercial deformable image registration. A ResNet-101-based deep learning model was trained to predict pixel-wise dose distributions. To test the role of the predicted accumulated dose in clinic, each EBRT plan was designed using conventional method and then redesigned referencing the predicted accumulated dose distribution. Bladder and rectum dosimetric parameters and normal tissue complication probability (NTCP) values were calculated and compared between the conventional and redesigned accumulated doses.

Results

The redesigned accumulated doses showed a decrease in mean values of V50, V60, and D2cc for the bladder (-3.02%, -1.71%, and -1.19 Gy, respectively) and rectum (-4.82%, -1.97%, and -4.13 Gy, respectively). The mean NTCP values for the bladder and rectum were also decreased by 0.02‰ and 0.98%, respectively. All values had statistically significant differences (p < 0.01), except for the bladder D2cc (p = 0.112).

Conclusion

This study realized accumulated dose prediction for combined cervical cancer radiotherapy without knowing the BT dose. The predicted dose served as a reference for EBRT treatment planning, leading to a superior accumulated dose distribution and lower NTCP values.

Neural network dose prediction for cervical brachytherapy: Overcoming data scarcity for applicator-specific models

BACKGROUND

3D neural network dose predictions are useful for automating brachytherapy (BT) treatment planning for cervical cancer. Cervical BT can be delivered with numerous applicators, which necessitates developing models that generalize to multiple applicator types. The variability and scarcity of data for any given applicator type poses challenges for deep learning.

PURPOSE

The goal of this work was to compare three methods of neural network training-a single model trained on all applicator data, fine-tuning the combined model to each applicator, and individual (IDV) applicator models-to determine the optimal method for dose prediction.

METHODS

Models were produced for four applicator types-tandem-and-ovoid (T&O), T&O with 1-7 needles (T&ON), tandem-and-ring (T&R) and T&R with 1-4 needles (T&RN). First, the combined model was trained on 859 treatment plans from 266 cervical cancer patients treated from 2010 onwards. The train/validation/test split was 70%/16%/14%, with approximately 49%/10%/19%/22% T&O/T&ON/T&R/T&RN in each dataset. Inputs included four channels for anatomical masks (high-risk clinical target volume [HRCTV], bladder, rectum, and sigmoid), a mask indicating dwell position locations, and applicator channels for each applicator component. Applicator channels were created by mapping the 3D dose for a single dwell position to each dwell position and summing over each applicator component with uniform dwell time weighting. A 3D Cascade U-Net, which consists of two U-Nets in sequence, and mean squared error loss function were used. The combined model was then fine-tuned to produce four applicator-specific models by freezing the first U-Net and encoding layers of the second and resuming training on applicator-specific data. Finally, four IDV models were trained using only data from each applicator type. Performance of these three model types was compared using the following metrics for the test set: mean error (ME, representing model bias) and mean absolute error (MAE) over all dose voxels and ME of clinical metrics (HRCTV D90% and D2cc of bladder, rectum, and sigmoid), averaged over all patients. A positive ME indicates the clinical dose was higher than predicted. 3D global gamma analysis with the prescription dose as reference value was performed. Dice similarity coefficients (DSC) were computed for each isodose volume.

RESULTS

Fine-tuned and combined models showed better performance than IDV applicator training. Fine-tuning resulted in modest improvements in about half the metrics, compared to the combined model, while the remainder were mostly unchanged. Fine-tuned MAE = 3.98%/2.69%/5.36%/3.80% for T&O/T&R/T&ON/T&RN, and ME over all voxels = -0.08%/-0.89%/-0.59%/1.42%. ME D2cc were bladder = -0.77%/1.00%/-0.66%/-1.53%, rectum = 1.11%/-0.22%/-0.29%/-3.37%, sigmoid = -0.47%/-0.06%/-2.37%/-1.40%, and ME D90 = 2.6%/-4.4%/4.8%/0.0%. Gamma pass rates (3%/3 mm) were 86%/91%/83%/89%. Mean DSCs were 0.92%/0.92%/0.88%/0.91% for isodoses ≤ 150% of prescription.

CONCLUSIONS

3D BT dose was accurately predicted for all applicator types, as indicated by the low MAE and MEs, high gamma scores and high DSCs. Training on all treatment data overcomes challenges with data scarcity in each applicator type, resulting in superior performance than can be achieved by training on IDV applicators alone. This could presumably be explained by the fact that the larger, more diverse dataset allows the neural network to learn underlying trends and characteristics in dose that are common to all treatment applicators. Accurate, applicator-specific dose predictions could enable automated, knowledge-based planning for any cervical brachytherapy treatment.

A Neural Network-based Method for Predicting Dose to Organs at Risk in Intensity-modulated Radiotherapy for Nasopharyngeal Carcinoma

OBJECTIVE

A neural network method was used to establish a dose prediction model for organs at risk (OARs) during intensity-modulated radiotherapy (IMRT) for nasopharyngeal carcinoma (NPC).

MATERIALS AND METHODS

In total, 103 patients with NPC were randomly selected for IMRT. Suborgans were automatically generated for OARs using ring structures based on distance to the target using a MATLAB program and the corresponding volume of each suborgan was determined. The correlation between the volume of each suborgan and the dose to each OAR was analysed and neural network prediction models of the OAR dose were established using the MATLAB Neural Net Fitting application. The R-value and mean square error in the regression analysis were used to evaluate the prediction model.

RESULTS

The OAR dose was related to the volume of the corresponding sub-OAR. The average R-values for the normalised mean dose (Dnmean) to parallel organs and serial organs and the normalised maximum dose (Dn0) to serial organs in the training set were 0.880, 0.927 and 0.905, respectively. The mean square error for each OAR in the prediction model was low (ranging from 1.72 × 10-4 to 7.06 × 10-3).

CONCLUSION

The neural network-based model for predicting OAR dose during IMRT for NPC is simple, reliable and worth further investigation and application.

Improving plan quality in cervical brachytherapy using a simple knowledge-based prediction tool for OAR dose (D2cm3)

PURPOSE

Toxicity from cervical brachytherapy has been demonstrated to correlate with the D2cm3 of the bladder, rectum, and bowel. This suggests a simplified version of knowledge-based planning investigating the relationship of the overlap distance for 2cm3 and the D2cm3 from planning may be possible. This work demonstrates the feasibility of simple knowledge-based planning to predict the D2cm3, detect suboptimal plans, and improve plan quality.

METHODS AND MATERIALS

The overlap volume histogram (OVH) method was used to determine the distance for 2cm3 of overlap between the OAR and CTV_HR. Linear plots modeled the OAR D2cm3 and 2cm3 overlap distance. Two datasets of 20 patients (plans from 43 insertions in each dataset) were used to create two independent models, and the performance of each model was compared using cross-validation. Doses were scaled to ensure consistent CTV_HR D90 values. The predicted D2cm3 is entered as the maximum constraint in the inverse planning algorithm.

RESULTS

Mean bladder D2cm3 decreased by 2.9% for the models from each dataset, mean rectal D2cm3 decreased 14.9% for the model from dataset 1 and 6.0% for the model from dataset 2, mean sigmoid D2cm3 decreased 10.7% for the model from dataset 1 and 6.1% for the model from dataset 2, mean bowel D2cm3 decreased 4.1% for the model from dataset 1 but no statistically significant difference was observed for the model from dataset 2.

CONCLUSIONS

A simplified knowledge-based planning method was used to predict D2cm3 and was able to automate optimization of brachytherapy plans for locally advanced cervical cancer.

Deep learning-based dose map prediction for high-dose-rate brachytherapy

Background. Creating a clinically acceptable plan in the time-sensitive clinic workflow of brachytherapy is challenging. Deep learning-based dose prediction techniques have been reported as promising solutions with high efficiency and accuracy. However, current dose prediction studies mainly target EBRT which are inappropriate for brachytherapy, the model designed specifically for brachytherapy has not yet well-established.Purpose. To predict dose distribution in brachytherapy using a novel Squeeze and Excitation Attention Net (SE_AN) model.Method. We hypothesized the tracks of192Ir inside applicators are essential for brachytherapy dose prediction. To emphasize the applicator contribution, a novel SE module was integrated into a Cascaded UNet to recalibrate informative features and suppress less useful ones. The Cascaded UNet consists of two stacked UNets, with the first designed to predict coarse dose distribution and the second added for fine-tuning 250 cases including all typical clinical applicators were studied, including vaginal, tandem and ovoid, multi-channel, and free needle applicators. The developed SE_AN was subsequently compared to the classic UNet and classic Cascaded UNet (without SE module) models. The model performance was evaluated by comparing the predicted dose against the clinically approved plans using mean absolute error (MAE) of DVH metrics, includingD2ccandD90%.Results. The MAEs of DVH metrics demonstrated that SE_AN accurately predicted the dose with 0.37 ± 0.25 difference for HRCTVD90%, 0.23 ± 0.14 difference for bladderD2cc, and 0.28 ± 0.20 difference for rectumD2cc. In comparison studies, UNet achieved 0.34 ± 0.24 for HRCTV, 0.25 ± 0.20 for bladder, 0.25 ± 0.21 for rectum, and Cascaded UNet achieved 0.42 ± 0.31 for HRCTV, 0.24 ± 0.19 for bladder, 0.23 ± 0.19 for rectum.Conclusion. We successfully developed a method specifically for 3D brachytherapy dose prediction. Our model demonstrated comparable performance to clinical plans generated by experienced dosimetrists. The developed technique is expected to improve the standardization and quality control of brachytherapy treatment planning.

Artificial intelligence applications in brachytherapy: A literature review

PURPOSE

Artificial intelligence (AI) has the potential to simplify and optimize various steps of the brachytherapy workflow, and this literature review aims to provide an overview of the work done in this field.

METHODS AND MATERIALS

We conducted a literature search in June 2022 on PubMed, Embase, and Cochrane for papers that proposed AI applications in brachytherapy.

RESULTS

A total of 80 papers satisfied inclusion/exclusion criteria. These papers were categorized as follows: segmentation (24), registration and image processing (6), preplanning (13), dose prediction and treatment planning (11), applicator/catheter/needle reconstruction (16), and quality assurance (10). AI techniques ranged from classical models such as support vector machines and decision tree-based learning to newer techniques such as U-Net and deep reinforcement learning, and were applied to facilitate small steps of a process (e.g., optimizing applicator selection) or even automate the entire step of the workflow (e.g., end-to-end preplanning). Many of these algorithms demonstrated human-level performance and offer significant improvements in speed.

CONCLUSIONS

AI has potential to augment, automate, and/or accelerate many steps of the brachytherapy workflow. We recommend that future studies adhere to standard reporting guidelines. We also stress the importance of using larger sample sizes and reporting results using clinically interpretable measures.

Dose prediction of organs at risk in patients with cervical cancer receiving brachytherapy using needle insertion based on a neural network method

OBJECTIVE

A neural network method was employed to establish a dose prediction model for organs at risk (OAR) in patients with cervical cancer receiving brachytherapy using needle insertion.

METHODS

A total of 218 CT-based needle-insertion brachytherapy fraction plans for loco-regionally advanced cervical cancer treatment were analyzed in 59 patients. The sub-organ of OAR was automatically generated by self-written MATLAB, and the volume of the sub-organ was read. Correlations between D2cm³ of each OAR and volume of each sub-organ-as well as high-risk clinical target volume for bladder, rectum, and sigmoid colon-were analyzed. We then established a neural network predictive model of D2cm³ of OAR using the matrix laboratory neural net. Of these plans, 70% were selected as the training set, 15% as the validation set, and 15% as the test set. The regression R value and mean squared error were subsequently used to evaluate the predictive model.

RESULTS

The D2cm³/D90 of each OAR was related to volume of each respective sub-organ. The R values for bladder, rectum, and sigmoid colon in the training set for the predictive model were 0.80513, 0.93421, and 0.95978, respectively. The ∆D2cm³/D90 for bladder, rectum, and sigmoid colon in all sets was 0.052 ± 0.044, 0.040 ± 0.032, and 0.041 ± 0.037, respectively. The MSE for bladder, rectum, and sigmoid colon in the training set for the predictive model was 4.779 × 10^-3, 1.967 × 10^-3 and 1.574 × 10^-3, respectively.

CONCLUSION

The neural network method based on a dose-prediction model of OAR in brachytherapy using needle insertion was simple and reliable. In addition, it only addressed volumes of sub-organs to predict the dose of OAR, which we believe is worthy of further promotion and application.

Automated treatment planning framework for brachytherapy of cervical cancer using 3D dose predictions

Objective. To lay the foundation for automated knowledge-based brachytherapy treatment planning using 3D dose estimations, we describe an optimization framework to convert brachytherapy dose distributions directly into dwell times (DTs).Approach. A dose rate kernelḋ(r,θ,φ)was produced by exporting 3D dose for one dwell position from the treatment planning system and normalizing by DT. By translating and rotating this kernel to each dwell position, scaling by DT and summing over all dwell positions, dose was computed (Dcalc). We used a Python-coded COBYLA optimizer to iteratively determine the DTs that minimize the mean squared error betweenDcalcand reference doseDref, computed using voxels withDref80%-120% of prescription. As validation of the optimization, we showed that the optimizer replicates clinical plans whenDref= clinical dose in 40 patients treated with tandem-and-ovoid (T&O) or tandem-and-ring (T&R) and 0-3 needles. Then we demonstrated automated planning in 10 T&O usingDref= dose predicted from a convolutional neural network developed in past work. Validation and automated plans were compared to clinical plans using mean absolute differences (MAD=1N∑n=1Nabsxn-xn') over all voxels (xn= Dose,N= #voxels) and DTs (xn= DT,N= #dwell positions), mean differences (MD) in organD2ccand high-risk CTV D90 over all patients (where positive indicates higher clinical dose), and mean Dice similarity coefficients (DSC) for 100% isodose contours.Main results. Validation plans agreed well with clinical plans (MADdose= 1.1%, MADDT= 4 s or 0.8% of total plan time,D2ccMD = -0.2% to 0.2% and D90 MD = -0.6%, DSC = 0.99). For automated plans, MADdose= 6.5% and MADDT= 10.3 s (2.1%). The slightly higher clinical metrics in automated plans (D2ccMD = -3.8% to 1.3% and D90 MD = -5.1%) were due to higher neural network dose predictions. The overall shape of the automated dose distributions were similar to clinical doses (DSC = 0.91).Significance. Automated planning with 3D dose predictions could provide significant time savings and standardize treatment planning across practitioners, regardless of experience.

A personalized DVH prediction model for HDR brachytherapy in cervical cancer treatment

Purpose

Although the knowledge-based dose-volume histogram (DVH) prediction has been largely researched and applied in External Beam Radiation Therapy, it is still less investigated in the domain of brachytherapy. The purpose of this study is to develop a reliable DVH prediction method for high-dose-rate brachytherapy plans.

Method

A DVH prediction workflow combining kernel density estimation (KDE), k-nearest neighbor (kNN), and principal component analysis (PCA) was proposed. PCA and kNN were first employed together to select similar patients based on principal component directions. 79 cervical cancer patients with different applicators inserted was included in this study. The KDE model was built based on the relationship between distance-to-target (DTH) and the dose in selected cases, which can be subsequently used to estimate the dose probability distribution in the validation set. Model performance of bladder and rectum was quantified by |ΔD_2cc|, |ΔD_1cc|, |ΔD_0.1cc|, |ΔD_max|, and |ΔD_mean| in the form of mean and standard deviation. The model performance between KDE only and the combination of kNN, PCA, and KDE was compared.

Result

20, 30 patients were selected for rectum and bladder based on KNN and PCA, respectively. The absolute residual between the actual plans and the predicted plans were 0.38 ± 0.29, 0.4 ± 0.32, 0.43 ± 0.36, 0.97 ± 0.66, and 0.13 ± 0.99 for |ΔD_2cc|, |ΔD_1cc|, |ΔD_0.1cc|, |ΔD_max|, and |ΔD_mean| in the bladder, respectively. For rectum, the corresponding results were 0.34 ± 0.27, 0.38 ± 0.33, 0.63 ± 0.57, 1.41 ± 0.99 and 0.23 ± 0.17, respectively. The combination of kNN, PCA, and KDE showed a significantly better prediction performance than KDE only, with an improvement of 30.3% for the bladder and 33.3% for the rectum.

Conclusion

In this study, a knowledge-based machine learning model was proposed and verified to accurately predict the DVH for new patients. This model is proved to be effective in our testing group in the workflow of HDR brachytherapy.