1
|
Takano S, Tomita N, Takaoka T, Ukai M, Matsuura A, Oguri M, Kita N, Torii A, Niwa M, Okazaki D, Yasui T, Hiwatashi A. Risk Estimation of Late Rectal Toxicity Using a Convolutional Neural Network-based Dose Prediction in Prostate Cancer Radiation Therapy. Adv Radiat Oncol 2025; 10:101739. [PMID: 40161541 PMCID: PMC11950957 DOI: 10.1016/j.adro.2025.101739] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 02/05/2025] [Indexed: 04/02/2025] Open
Abstract
Purpose The present study investigated the feasibility of our automatic plan generation model based on a convolutional neural network (CNN) to estimate the baseline risk of grade ≥2 late rectal bleeding (G2-LRB) in volumetric modulated arc therapy for prostate cancer. Methods and Materials We built the 2-dimensional U-net model to predict dose distributions using the planning computed tomography and organs at risk masks as inputs. Seventy-five volumetric modulated arc therapy plans of prostate cancer, which were delivered at 74.8 Gy in 34 fractions with a uniform planning goal, were included: 60 for training and 5-fold cross-validation, and the remaining 15 for testing. Isodose volume dice similarity coefficient, dose-volume histogram, and normal tissue complication probability (NTCP) metrics between planned and CNN-predicted dose distributions were calculated. The primary endpoint was the goodness-of-fit, expressed as a coefficient of determination (R 2) value, in predicting the percentage of G2-LRB-Lyman-Kutcher-Burman-NTCP. Results In 15 test cases, 2-dimensional U-net predicted dose distributions with a mean isodose volume dice similarity coefficient value of 0.90 within the high-dose region (doses ≥ 50 Gy). Rectum V50Gy, V60Gy, and V70Gy were accurately predicted (R 2 = 0.73, 0.82, and 0.87, respectively). Strong correlations were observed between planned and predicted G2-LRB-Lyman-Kutcher-Burman-NTCP (R 2 = 0.80, P < .001), with a small percent mean absolute error (mean ± 1 standard deviation, 1.24% ± 1.42%). Conclusions A risk estimation of LRB using CNN-based automatic plan generation from anatomic information was feasible. These results will contribute to the development of a decision support system that identifies priority cases for preradiation therapy interventions, such as hydrogel spacer implantation.
Collapse
Affiliation(s)
- Seiya Takano
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Natsuo Tomita
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Taiki Takaoka
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Machiko Ukai
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Akane Matsuura
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Masanosuke Oguri
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Nozomi Kita
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Akira Torii
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Masanari Niwa
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Dai Okazaki
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Takahiro Yasui
- Department of Urology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| | - Akio Hiwatashi
- Department of Radiology, Nagoya City University Graduate School of Medical Sciences, 1 Kawasumi, Mizuho-cho, Mizuho-ku, Nagoya, Aichi, Japan
| |
Collapse
|
2
|
Vazquez I, Liang D, Salazar RM, Gronberg MP, Sjogreen C, Williamson TD, Zhu XR, Whitaker TJ, Frank SJ, Court LE, Yang M. Deep learning techniques for proton dose prediction across multiple anatomical sites and variable beam configurations. Phys Med Biol 2025; 70:075016. [PMID: 40101365 DOI: 10.1088/1361-6560/adc236] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2024] [Accepted: 03/18/2025] [Indexed: 03/20/2025]
Abstract
Objective.To evaluate the impact of beam mask implementation and data aggregation on artificial intelligence-based dose prediction accuracy in proton therapy, with a focus on scenarios involving limited or highly heterogeneous datasets.Approach.In this study, 541 prostate and 632 head and neck (H&N) proton therapy plans were used to train and evaluate convolutional neural networks designed for the task of dose prediction. Datasets were grouped by anatomical site and beam configuration to assess the impact of beam masks-graphical depictions of radiation paths-as a model input. We also evaluated the effect of combining datasets. Model performance was measured using dose-volume histograms (DVHs) scores, mean absolute error, mean absolute percent error, dice similarity coefficients (DSCs), and gamma passing rates.Main results.DSC analysis revealed that the inclusion of beam masks improved dose prediction accuracy, particularly in low-dose regions and for datasets with diverse beam configurations. Data aggregation alone produced mixed results, with improvements in high-dose regions but potential degradation in low-dose areas. Notably, combining beam masks and data aggregation yielded the best overall performance, effectively leveraging the strengths of both strategies. Additionally, the magnitude of the improvements was larger for datasets with greater heterogeneity, with the combined approach increasing the DSC score by as much as 0.2 for a subgroup of H&N cases characterized by small size and heterogeneity in beam arrangement. DVH scores reflected these benefits, showing statistically significant improvements (p< 0.05) for the more heterogeneous H&N datasets.Significance.Artificial intelligence-based dose prediction models incorporating beam masks and data aggregation significantly improve accuracy in proton therapy planning, especially for complex cases. This technique could accelerate the planning process, enabling more efficient and effective cancer treatment strategies.
Collapse
Affiliation(s)
- Ivan Vazquez
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
| | - Danfu Liang
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
| | - Ramon M Salazar
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
| | - Mary P Gronberg
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
- Department of Radiation Oncology, The University of Texas Southwestern Medical Center, Dallas, TX 75390, United States of America
| | - Carlos Sjogreen
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
| | - Tyler D Williamson
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
- Center for Proton Therapy, Paul Scherrer Institute, Villigen, Switzerland
| | - X Ronald Zhu
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
- Medical Physics Program, The University of Texas MD Anderson Cancer Center, MD Anderson UTHealth Graduate School of Biomedical Sciences, Houston, TX 77030, United States of America
| | - Thomas J Whitaker
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
- Medical Physics Program, The University of Texas MD Anderson Cancer Center, MD Anderson UTHealth Graduate School of Biomedical Sciences, Houston, TX 77030, United States of America
| | - Steven J Frank
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
| | - Laurence E Court
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
- Medical Physics Program, The University of Texas MD Anderson Cancer Center, MD Anderson UTHealth Graduate School of Biomedical Sciences, Houston, TX 77030, United States of America
| | - Ming Yang
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States of America
- Medical Physics Program, The University of Texas MD Anderson Cancer Center, MD Anderson UTHealth Graduate School of Biomedical Sciences, Houston, TX 77030, United States of America
| |
Collapse
|
3
|
Wang Q, Wang Z, Li M, Ni X, Tan R, Zhang W, Wubulaishan M, Wang W, Yuan Z, Zhang Z, Liu C. A feasibility study of automating radiotherapy planning with large language model agents. Phys Med Biol 2025; 70:075007. [PMID: 40073507 DOI: 10.1088/1361-6560/adbff1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2024] [Accepted: 03/12/2025] [Indexed: 03/14/2025]
Abstract
Objective.Radiotherapy planning requires significant expertise to balance tumor control and organ-at-risk (OAR) sparing. Automated planning can improve both efficiency and quality. This study introduces GPT-Plan, a novel multi-agent system powered by the GPT-4 family of large language models (LLMs), for automating the iterative radiotherapy plan optimization.Approach.GPT-Plan uses LLM-driven agents, mimicking the collaborative clinical workflow of a dosimetrist and physicist, to iteratively generate and evaluate text-based radiotherapy plans based on predefined criteria. Supporting tools assist the agents by leveraging historical plans, mitigating LLM hallucinations, and balancing exploration and exploitation. Performance was evaluated on 12 lung (IMRT) and 5 cervical (VMAT) cancer cases, benchmarked against the ECHO auto-planning method and manual plans. The impact of historical plan retrieval on efficiency was also assessed.Results.For IMRT lung cancer cases, GPT-Plan generated high-quality plans, demonstrating superior target coverage and homogeneity compared to ECHO while maintaining comparable or better OAR sparing. For VMAT cervical cancer cases, plan quality was comparable to a senior physicist and consistently superior to a junior physicist, particularly for OAR sparing. Retrieving historical plans significantly reduced the number of required optimization iterations for lung cases (p < 0.01) and yielded iteration counts comparable to those of the senior physicist for cervical cases (p = 0.313). Occasional LLM hallucinations have been mitigated by self-reflection mechanisms. One limitation was the inaccuracy of vision-based LLMs in interpreting dose images.Significance.This pioneering study demonstrates the feasibility of automating radiotherapy planning using LLM-powered agents for complex treatment decision-making tasks. While challenges remain in addressing LLM limitations, ongoing advancements hold potential for further refining and expanding GPT-Plan's capabilities.
Collapse
Affiliation(s)
- Qingxin Wang
- Department of Radiation Oncology, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin 300060, People's Republic of China
- School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin 300072, People's Republic of China
- Department of Medical Oncology, Hetian District People's Hospital, Hetian, Xinjiang 848000, People's Republic of China
| | - Zhongqiu Wang
- Department of Radiation Oncology, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin 300060, People's Republic of China
| | - Minghua Li
- Department of Radiation Oncology (Maastro), GROW School for Oncology and Reproduction, Maastricht University Medical Centre+, Maastricht 6229 ET, The Netherlands
| | - Xinye Ni
- Radiation Oncology Center, Affiliated Changzhou No. 2 People's Hospital of Nanjing Medical University, Changzhou, Jiangsu 213003, People's Republic of China
- Center of Medical Physics, Nanjing Medical University, Changzhou, Jiangsu 213003, People's Republic of China
| | - Rong Tan
- Faculty of Business Information, Shanghai Business School, Shanghai 201499, People's Republic of China
| | - Wenwen Zhang
- Department of Radiation Oncology, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin 300060, People's Republic of China
| | - Maitudi Wubulaishan
- Department of Radiation Oncology, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin 300060, People's Republic of China
- Department of Medical Oncology, Hetian District People's Hospital, Hetian, Xinjiang 848000, People's Republic of China
| | - Wei Wang
- Department of Radiation Oncology, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin 300060, People's Republic of China
| | - Zhiyong Yuan
- Department of Radiation Oncology, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin 300060, People's Republic of China
| | - Zhen Zhang
- Department of Radiation Oncology (Maastro), GROW School for Oncology and Reproduction, Maastricht University Medical Centre+, Maastricht 6229 ET, The Netherlands
- Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, Zhejiang 310022, People's Republic of China
| | - Cong Liu
- Radiation Oncology Center, Affiliated Changzhou No. 2 People's Hospital of Nanjing Medical University, Changzhou, Jiangsu 213003, People's Republic of China
- Center of Medical Physics, Nanjing Medical University, Changzhou, Jiangsu 213003, People's Republic of China
- Faculty of Business Information, Shanghai Business School, Shanghai 201499, People's Republic of China
| |
Collapse
|
4
|
Loebner HA, Joost R, Bertholet J, Mougiakakou S, Fix MK, Manser P. DeepSMCP - Deep-learning powered denoising of Monte Carlo dose distributions within the Swiss Monte Carlo Plan. Z Med Phys 2025:S0939-3889(25)00034-0. [PMID: 40102103 DOI: 10.1016/j.zemedi.2025.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 12/26/2024] [Accepted: 02/25/2025] [Indexed: 03/20/2025]
Abstract
This work demonstrated the development of a fast, deep-learning framework (DeepSMCP) to mitigate noise in Monte Carlo dose distributions (MC-DDs) of photon treatment plans with high statistical uncertainty (SU) and its integration into the Swiss Monte Carlo Plan (SMCP). To this end, a two-channel input (MC-DD and computed tomography (CT) scan) 3D U-net was trained, validated and tested (80%/10%/10%) on high/low-SU MC-DD-pairs of 106 clinically-motivated VMAT arcs for 29 available CTs, augmented to 3074 pairs. The model was integrated into SMCP to enable a "one-click" workflow of calculating and denoising MC-DDs of high SU to obtain MC-DDs of low SU. The model accuracy was evaluated on the test set using Gamma passing rate (2% global, 2 mm, 10% threshold) comparing denoised and low-SU MC-DD. Calculation time for the whole workflow was recorded. Denoised MC-DDs match low-SU MC-DDs with average (standard deviation) Gamma passing rate of 82.9% (4.7%). Additional application of DeepSMCP to 12 unseen clinically-motivated cases of different treatment sites, including treatment sites not present during training, resulted in an average Gamma passing rate of 91.0%. Denoised DDs were obtained on average in 35.1 s, a 340-fold efficiency gain compared to low-SU MC-DD calculation. DeepSMCP presented a first seamlessly integrated promising denoising framework for MC-DDs.
Collapse
Affiliation(s)
- Hannes A Loebner
- Division of Medical Radiation Physics and Department of Radiation Oncology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland.
| | - Raphael Joost
- Division of Medical Radiation Physics and Department of Radiation Oncology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland
| | - Jenny Bertholet
- Division of Medical Radiation Physics and Department of Radiation Oncology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland
| | | | - Michael K Fix
- Division of Medical Radiation Physics and Department of Radiation Oncology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland
| | - Peter Manser
- Division of Medical Radiation Physics and Department of Radiation Oncology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland
| |
Collapse
|
5
|
Zamanian M, Irannejad M, Abedi I, Saeb M, Roayaei M. Nested CNN architecture for three-dimensional dose distribution prediction in tomotherapy for prostate cancer. Strahlenther Onkol 2025; 201:306-315. [PMID: 39283345 DOI: 10.1007/s00066-024-02290-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Accepted: 07/29/2024] [Indexed: 02/21/2025]
Abstract
BACKGROUND The hypothesis of changing network layers to increase the accuracy of dose distribution prediction, instead of expanding their dimensions, which requires complex calculations, has been considered in our study. MATERIALS AND METHODS A total of 137 prostate cancer patients treated with the tomotherapy technique were categorized as 80% training and validating as well as 20% testing for the nested UNet and UNet architectures. Mean absolute error (MAE) was used to measure the dosimetry indices of dose-volume histograms (DVHs), and geometry indices, including the structural similarity index measure (SSIM), dice similarity coefficient (DSC), and Jaccard similarity coefficient (JSC), were used to evaluate the isodose volume (IV) similarity prediction. To verify a statistically significant difference, the two-way statistical Wilcoxon test was used at a level of 0.05 (p < 0.05). RESULTS Use of a nested UNet architecture reduced the predicted dose MAE in DVH indices. The MAE for planning target volume (PTV), bladder, rectum, and right and left femur were D98% = 1.11 ± 0.90; D98% = 2.27 ± 2.85, Dmean = 0.84 ± 0.62; D98% = 1.47 ± 12.02, Dmean = 0.77 ± 1.59; D2% = 0.65 ± 0.70, Dmean = 0.96 ± 2.82; and D2% = 1.18 ± 6.65, Dmean = 0.44 ± 1.13, respectively. Additionally, the greatest geometric similarity was observed in the mean SSIM for UNet and nested UNet (0.91 vs. 0.94, respectively). CONCLUSION The nested UNet network can be considered a suitable network due to its ability to improve the accuracy of dose distribution prediction compared to the UNet network in an acceptable time.
Collapse
Affiliation(s)
- Maryam Zamanian
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Maziar Irannejad
- Department of Electrical Engineering, Islamic Azad University Najafabad Branch, Najafabad, Iran
| | - Iraj Abedi
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran.
| | - Mohsen Saeb
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
- Department of Radiation Oncology, Isfahan Seyedoshohada Hospital, Isfahan, Iran
| | - Mahnaz Roayaei
- Department of Radiation Oncology, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| |
Collapse
|
6
|
Yu X, Lin J, Gong C, Zhang M, Luo X, Liu Q, Zhang Y. Therapeutic dose prediction using score-based diffusion model for pretreatment patient-specific quality assurance. Front Oncol 2025; 14:1473050. [PMID: 39830643 PMCID: PMC11739152 DOI: 10.3389/fonc.2024.1473050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Accepted: 12/06/2024] [Indexed: 01/22/2025] Open
Abstract
Objectives Implementing pre-treatment patient-specific quality assurance (prePSQA) for cancer patients is a necessary but time-consuming task, imposing a significant workload on medical physicists. Currently, the prediction methods used for prePSQA fall under the category of supervised learning, limiting their generalization ability and resulting in poor performance on new data. In the context of this work, the limitation of traditional supervised models was broken by proposing a conditional generation method utilizing unsupervised diffusion model. Methods A conditional generation method base on the score-based diffusion model was proposed, which employed diffusion model for the first time to predict the predict patients' therapeutic doses (TherapDose). The proposed diffusion model TherapDose prediction method (DMTP) learns the data distribution of dose images. The data distribution contains the quantitative relationship between the radiotherapy dose (RTDose) derived from the VMAT plan files of the Treatment Planning System (TPS) and the measured Dose (MDose, i.e., TherapDose) obtained from the Dolphin Compass physical system. By sampling from the learnt distribution, efficient prediction of TherapDose was achieved. The training dataset comprises RTDose, and the MDose. The three-dimensional information of dose slice was utilized to predict TherapDose, aiming to enhance the accuracy and efficiency of TherapDose prediction. Root mean square error (RMSE), mean absolute error (MAE), and structural similarity (SSIM) metrics were leveraged to validate the effectiveness of the proposed method. Meanwhile, CT images were further added to test the impacts of CT images on the prediction effect of MDose. Results The DMTP method has demonstrated superior performance in predicting TherapDose within key anatomical regions including the head and neck, chest, and abdomen, outperforming existing state-of-the-art methods by achieving high-quality predictions as measured across different evaluation metrics. It indicates that the proposed method is highly effective and accurate in its dose prediction capabilities. Conclusions The proposed method has proven to be highly effective, consistently outperforming state-of-the-art techniques in MDose prediction across multiple anatomical regions and evaluation metrics. This method can serve as a clinical aid to assist medical physicists in diminishing the measurement workload associated with prePSQA.
Collapse
Affiliation(s)
- Xiuwen Yu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Jiabin Lin
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Changfei Gong
- Department of Radiation Oncology, Jiangxi Cancer Hospital & Institute, Jiangxi Clinical Research Center for Cancer, The Second Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Minhui Zhang
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Xianyu Luo
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Qiegen Liu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Yun Zhang
- Department of Radiation Oncology, Jiangxi Cancer Hospital & Institute, Jiangxi Clinical Research Center for Cancer, The Second Affiliated Hospital of Nanchang Medical College, Nanchang, China
| |
Collapse
|
7
|
Hajim WI, Zainudin S, Daud KM, Alheeti K. Golden eagle optimized CONV-LSTM and non-negativity-constrained autoencoder to support spatial and temporal features in cancer drug response prediction. PeerJ Comput Sci 2024; 10:e2520. [PMID: 39896419 PMCID: PMC11784781 DOI: 10.7717/peerj-cs.2520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2024] [Accepted: 10/25/2024] [Indexed: 02/04/2025]
Abstract
Advanced machine learning (ML) and deep learning (DL) methods have recently been utilized in Drug Response Prediction (DRP), and these models use the details from genomic profiles, such as extensive drug screening data and cell line data, to predict the response of drugs. Comparatively, the DL-based prediction approaches provided better learning of such features. However, prior knowledge, like pathway data, is sometimes discarded as irrelevant since the drug response datasets are multidimensional and noisy. Optimized feature learning and extraction processes are suggested to handle this problem. First, the noise and class imbalance problems must be tackled to avoid low identification accuracy, long prediction times, and poor applicability. This article aims to apply the Non-Negativity-Constrained Auto Encoder (NNCAE) network to tackle these issues, enhance the adaptive search for the optimal size of sliding windows, and ensure that deep network architectures are adept at learning the vital hidden features. NNCAE methodology is used after performing the standard pre-processing procedures to handle the noise and class imbalance problem. This class balanced and noise-removed input data features are learned to train the proposed hybrid classifier. The classification model, Golden Eagle Optimization-based Convolutional Long Short-Term Memory neural networks (GEO-Conv-LSTM), is assembled by integrating Convolutional Neural Network CNN and LSTM models, with parameter tuning performed by the GEO algorithm. Evaluations are conducted on two large datasets from the Genomics of Drug Sensitivity in Cancer (GDSC) repository, and the proposed NNCAE-GEO-Conv-LSTM-based approach has achieved 96.99% and 97.79% accuracies, respectively, with reduced processing time and error rate for the DRP problem.
Collapse
Affiliation(s)
- Wesam Ibrahim Hajim
- Department of Applied Geology, College of Sciences, University of Tikrit, Tikrit, Salah ad Din, Iraq
- Center for Artificial Intelligence Technology, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, Selangor, Malaysia
| | - Suhaila Zainudin
- Center for Artificial Intelligence Technology, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, Selangor, Malaysia
| | - Kauthar Mohd Daud
- Center for Artificial Intelligence Technology, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, Selangor, Malaysia
| | - Khattab Alheeti
- Department of Computer Networking Systems College of Computer Sciences and Information Technology, University of Anbar, Ramadi, Al Anbar, Iraq
| |
Collapse
|
8
|
Saito M, Kadoya N, Kimura Y, Nemoto H, Tozuka R, Jingu K, Onishi H. Evaluation of deep learning based dose prediction in head and neck cancer patients using two different types of input contours. J Appl Clin Med Phys 2024; 25:e14519. [PMID: 39285649 PMCID: PMC11633794 DOI: 10.1002/acm2.14519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2024] [Revised: 08/17/2024] [Accepted: 08/20/2024] [Indexed: 12/12/2024] Open
Abstract
PURPOSE This study evaluates deep learning (DL) based dose prediction methods in head and neck cancer (HNC) patients using two types of input contours. MATERIALS AND METHODS Seventy-five HNC patients undergoing two-step volumetric-modulated arc therapy were included. Dose prediction was performed using the AIVOT prototype (AiRato.Inc, Sendai, Japan), a commercial software with an HD U-net-based dose distribution prediction system. Models were developed for the initial plan (46 Gy/23Fr) and boost plan (24 Gy/12Fr), trained with 65 cases and tested with 10 cases. The 8-channel model used one target (PTV) and seven organs at risk (OARs), while the 10-channel model added two dummy contours (PTV ring and spinal cord PRV). Predicted and deliverable doses, obtained through dose mimicking on another radiation treatment planning system, were evaluated using dose-volume indices for PTV and OARs. RESULTS For the initial plan, both models achieved approximately 2% prediction accuracy for the target dose and maintained accuracy within 3.2 Gy for OARs. The 10-channel model outperformed the 8-channel model for certain dose indices. For the boost plan, both models exhibited prediction accuracies of approximately 2% for the target dose and 1 Gy for OARs. The 10-channel model showed significantly closer predictions to the ground truth for D50% and Dmean. Deliverable plans based on prediction doses showed little significant difference compared to the ground truth, especially for the boost plan. CONCLUSION DL-based dose prediction using the AIVOT prototype software in HNC patients yielded promising results. While additional contours may enhance prediction accuracy, their impact on dose mimicking is relatively small.
Collapse
Affiliation(s)
- Masahide Saito
- Department of RadiologyUniversity of YamanashiYamanashiJapan
| | - Noriyuki Kadoya
- Department of Radiation OncologyTohoku Univ. Graduate School of MedicineSendaiJapan
| | - Yuto Kimura
- Radiation Oncology CenterOfuna Chuo HospitalKamakuraJapan
| | - Hikaru Nemoto
- Department of RadiologyUniversity of YamanashiYamanashiJapan
- Department of Radiation OncologyTohoku Univ. Graduate School of MedicineSendaiJapan
| | - Ryota Tozuka
- Department of RadiologyUniversity of YamanashiYamanashiJapan
- Department of Radiation OncologyTohoku Univ. Graduate School of MedicineSendaiJapan
| | - Keiichi Jingu
- Department of Radiation OncologyTohoku Univ. Graduate School of MedicineSendaiJapan
| | - Hiroshi Onishi
- Department of RadiologyUniversity of YamanashiYamanashiJapan
| |
Collapse
|
9
|
Ma X, Zhang Q, He L, Liu X, Xiao Y, Hu J, Cai S, Cai H, Yu B. Artificial intelligence application in the diagnosis and treatment of bladder cancer: advance, challenges, and opportunities. Front Oncol 2024; 14:1487676. [PMID: 39575423 PMCID: PMC11578829 DOI: 10.3389/fonc.2024.1487676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2024] [Accepted: 10/16/2024] [Indexed: 11/24/2024] Open
Abstract
Bladder cancer (BC) is a serious and common malignant tumor of the urinary system. Accurate and convenient diagnosis and treatment of BC is a major challenge for the medical community. Due to the limited medical resources, the existing diagnosis and treatment protocols for BC without the assistance of artificial intelligence (AI) still have certain shortcomings. In recent years, with the development of AI technologies such as deep learning and machine learning, the maturity of AI has made it more and more applied to the medical field, including improving the speed and accuracy of BC diagnosis and providing more powerful treatment options and recommendations related to prognosis. Advances in medical imaging technology and molecular-level research have also contributed to the further development of such AI applications. However, due to differences in the sources of training information and algorithm design issues, there is still room for improvement in terms of accuracy and transparency for the broader use of AI in clinical practice. With the popularization of digitization of clinical information and the proposal of new algorithms, artificial intelligence is expected to learn more effectively and analyze similar cases more accurately and reliably, promoting the development of precision medicine, reducing resource consumption, and speeding up diagnosis and treatment. This review focuses on the application of artificial intelligence in the diagnosis and treatment of BC, points out some of the challenges it faces, and looks forward to its future development.
Collapse
Affiliation(s)
- Xiaoyu Ma
- Department of Urology, Jiangsu Cancer Hospital & The Affiliated Cancer Hospital of Nanjing Medical University & Jiangsu Institute of Cancer Research, Nanjing, Jiangsu, China
| | - Qiuchen Zhang
- Department of Radiology, The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Lvqi He
- Department of Radiology, The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Xinyang Liu
- Department of Radiology, The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Yang Xiao
- Department of Radiology, The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Jingwen Hu
- School of Public Health, Southern Medical University, Guangzhou, Guangdong, China
| | - Shengjie Cai
- The Third Clinical Medical College, Nanjing University of Chinese Medicine, Nanjing, Jiangsu, China
| | - Hongzhou Cai
- Department of Urology, Jiangsu Cancer Hospital & The Affiliated Cancer Hospital of Nanjing Medical University & Jiangsu Institute of Cancer Research, Nanjing, Jiangsu, China
| | - Bin Yu
- Department of Urology, Jiangsu Cancer Hospital & The Affiliated Cancer Hospital of Nanjing Medical University & Jiangsu Institute of Cancer Research, Nanjing, Jiangsu, China
| |
Collapse
|
10
|
Leino A, Heikkilä J, Virén T, Honkanen JTJ, Seppälä J, Korkalainen H. Deep learning-based prediction of the dose-volume histograms for volumetric modulated arc therapy of left-sided breast cancer. Med Phys 2024; 51:7986-7997. [PMID: 39291645 DOI: 10.1002/mp.17410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 07/01/2024] [Accepted: 08/17/2024] [Indexed: 09/19/2024] Open
Abstract
BACKGROUND The advancements in artificial intelligence and computational power have made deep learning an attractive tool for radiotherapy treatment planning. Deep learning has the potential to significantly simplify the trial-and-error process involved in inverse planning required by modern treatment techniques such as volumetric modulated arc therapy (VMAT). In this study, we explore the ability of deep learning to predict organ-at-risk (OAR) dose-volume histograms (DVHs) of left-sided breast cancer patients undergoing VMAT treatment based solely on their anatomical characteristics. The predicted DVHs could be used to derive patient-specific dose constraints and dose objectives, streamlining the treatment planning process, standardizing the quality of the plans, and personalizing the treatment planning. PURPOSE This study aimed to develop a deep learning-based framework for the prediction of organ-specific dose-volume histograms (DVH) based on structures delineated for left-sided breast cancer treatment. METHODS We used a dataset of 249 left-sided breast cancer patients treated with tangential VMAT fields. We extracted delineated structures and dose distributions for each patient and derived slice-by-slice DVHs for planning target volume (PTV) and organs-at-risk. The patients were divided into training (70%, n = 174), validation (10%, n = 24), and test (20%, n = 51) sets. Collected data were used to train a deep learning model for the prediction of the DVHs based on the delineated structures. The developed deep learning model comprised a modified DenseNet architecture followed by a recurrent neural network. RESULTS In the independent test set (n = 51), the point-wise differences in the slice-by-slice DVHs between the clinical and predicted DVHs were small; the mean squared errors were 3.53, 1.58, 2.28, 3.37, and 1.44 [×10-4] for PTV, heart, ipsilateral lung, contralateral lung, and contralateral breast, respectively. With the derived cumulative DVHs, the mean absolute difference ± standard deviation of mean doses between the clinical and the predicted DVH were 0.08 ± 0.04 Gy, 0.24 ± 0.22 Gy, 0.73 ± 0.46 Gy, 0.07 ± 0.06 Gy, and 0.14 ± 0.14 Gy for PTV, heart, ipsilateral lung, contralateral lung, and contralateral breast, respectively. CONCLUSIONS The deep learning-based approach enabled automatic and reliable prediction of the DVH based on delineated structures. The predicted DVHs could potentially serve as patient-specific clinical goals used to aid treatment planning and avoid suboptimal plans or to derive optimization objectives and constraints for automated treatment planning.
Collapse
Affiliation(s)
- Akseli Leino
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Center of Oncology, Kuopio University Hospital, Kuopio, Finland
- Eastern Finland Cancer Center (FICAN East), Kuopio University Hospital, Kuopio, Finland
| | - Janne Heikkilä
- Center of Oncology, Kuopio University Hospital, Kuopio, Finland
| | - Tuomas Virén
- Center of Oncology, Kuopio University Hospital, Kuopio, Finland
| | | | - Jan Seppälä
- Center of Oncology, Kuopio University Hospital, Kuopio, Finland
| | - Henri Korkalainen
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Center of Oncology, Kuopio University Hospital, Kuopio, Finland
- Eastern Finland Cancer Center (FICAN East), Kuopio University Hospital, Kuopio, Finland
| |
Collapse
|
11
|
Zadnorouzi M, Abtahi SMM. Artificial intelligence (AI) applications in improvement of IMRT and VMAT radiotherapy treatment planning processes: A systematic review. Radiography (Lond) 2024; 30:1530-1535. [PMID: 39321595 DOI: 10.1016/j.radi.2024.09.049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2024] [Revised: 07/11/2024] [Accepted: 09/06/2024] [Indexed: 09/27/2024]
Abstract
INTRODUCTION Radiotherapy is a common option in the treatment of many types of cancer. Intensity-Modulated Radiation Therapy (IMRT) and Volumetric-Modulated Arc Therapy (VMAT) are the latest radiotherapy techniques. However, clinicians face problems due to these techniques' complexity and time-consuming planning. Various studies have pointed out the importance and role of artificial intelligence (AI) in radiotherapy and accelerating and improving its quality. This research explores different AI methods in different fields of IMRT and VMAT. This study evaluated both quantitative and qualitative methods used within the reviewed articles. METHODS Various articles were reviewed from Google Scholar, Science Direct, and PubMed databases between 2018 and 2024. According to PRISMA 2020 guidelines, study selection processes, screening, and inclusion and exclusion criteria were defined. The critical Appraisal Skill Program qualitative checklist tool was used for the qualitative evaluation of articles. RESULTS 26 articles met the inclusion among the 33 articles obtained. The search procedure was displayed using the PRISMA flow diagram. The evaluation of the articles shows the automation of various treatment planning processes by AI methods and their better performance than traditional methods. The qualitative evaluation of studies has demonstrated the high quality of all studies. The lowest score obtained from the qualitative evaluation of the article is 7 out of 9. CONCLUSION AI methods used in radiotherapy reduce time and increase prediction accuracy. They also work better than other methods in different areas, such as dose prediction, treatment design, and dose delivery. IMPLICATIONS FOR PRACTICE Healthcare providers should consider integrating artificial intelligence technologies into their practice to optimize treatment planning and enhance patient care in radiation therapy. Additionally, fostering collaboration between radiotherapy experts and artificial intelligence specialists can significantly improve the development and application of AI technologies in this field.
Collapse
Affiliation(s)
- M Zadnorouzi
- Department of Physics, University of Guilan, Rasht, Iran
| | - S M M Abtahi
- Physics Department, Imam Khomeini International University, Qazvin, Iran.
| |
Collapse
|
12
|
Lagedamon V, Leni PE, Gschwind R. Deep learning applied to dose prediction in external radiation therapy: A narrative review. Cancer Radiother 2024; 28:402-414. [PMID: 39138047 DOI: 10.1016/j.canrad.2024.03.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Revised: 03/28/2024] [Accepted: 03/29/2024] [Indexed: 08/15/2024]
Abstract
Over the last decades, the use of artificial intelligence, machine learning and deep learning in medical fields has skyrocketed. Well known for their results in segmentation, motion management and posttreatment outcome tasks, investigations of machine learning and deep learning models as fast dose calculation or quality assurance tools have been present since 2000. The main motivation for this increasing research and interest in artificial intelligence, machine learning and deep learning is the enhancement of treatment workflows, specifically dosimetry and quality assurance accuracy and time points, which remain important time-consuming aspects of clinical patient management. Since 2014, the evolution of models and architectures for dose calculation has been related to innovations and interest in the theory of information research with pronounced improvements in architecture design. The use of knowledge-based approaches to patient-specific methods has also considerably improved the accuracy of dose predictions. This paper covers the state of all known deep learning architectures and models applied to external radiotherapy with a description of each architecture, followed by a discussion on the performance and future of deep learning predictive models in external radiotherapy.
Collapse
Affiliation(s)
- V Lagedamon
- Laboratoire chronoenvironnement, UMR 6249, université de Franche-Comté, CNRS, 4, place Tharradin, 25200 Montbéliard, France
| | - P-E Leni
- Laboratoire chronoenvironnement, UMR 6249, université de Franche-Comté, CNRS, 4, place Tharradin, 25200 Montbéliard, France.
| | - R Gschwind
- Laboratoire chronoenvironnement, UMR 6249, université de Franche-Comté, CNRS, 4, place Tharradin, 25200 Montbéliard, France
| |
Collapse
|
13
|
Gautam S, Osman AFI, Richeson D, Gholami S, Manandhar B, Alam S, Song WY. Attention 3D U-NET for dose distribution prediction of high-dose-rate brachytherapy of cervical cancer: Direction modulated brachytherapy tandem applicator. Med Phys 2024; 51:5593-5603. [PMID: 38830129 DOI: 10.1002/mp.17238] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 03/27/2024] [Accepted: 05/21/2024] [Indexed: 06/05/2024] Open
Abstract
BACKGROUND Direction Modulated Brachytherapy (DMBT) enables conformal dose distributions. However, clinicians may face challenges in creating viable treatment plans within a fast-paced clinical setting, especially for a novel technology like DMBT, where cumulative clinical experience is limited. Deep learning-based dose prediction methods have emerged as effective tools for enhancing efficiency. PURPOSE To develop a voxel-wise dose prediction model using an attention-gating mechanism and a 3D UNET for cervical cancer high-dose-rate (HDR) brachytherapy treatment planning with DMBT six-groove tandems with ovoids or ring applicators. METHODS A multi-institutional cohort of 122 retrospective clinical HDR brachytherapy plans treated to a prescription dose in the range of 4.8-7.0 Gy/fraction was used. A DMBT tandem model was constructed and incorporated onto a research version of BrachyVision Treatment Planning System (BV-TPS) as a 3D solid model applicator and retrospectively re-planned all cases by seasoned experts. Those plans were randomly divided into 64:16:20 as training, validating, and testing cohorts, respectively. Data augmentation was applied to the training and validation sets to increase the size by a factor of 4. An attention-gated 3D UNET architecture model was developed to predict full 3D dose distributions based on high-risk clinical target volume (CTVHR) and organs at risk (OARs) contour information. The model was trained using the mean absolute error loss function, Adam optimization algorithm, a learning rate of 0.001, 250 epochs, and a batch size of eight. In addition, a baseline UNET model was trained similarly for comparison. The model performance was evaluated on the testing dataset by analyzing the outcomes in terms of mean dose values and derived dose-volume-histogram indices from 3D dose distributions and comparing the generated dose distributions against the ground-truth dose distributions using dose statistics and clinically meaningful dosimetric indices. RESULTS The proposed attention-gated 3D UNET model showed competitive accuracy in predicting 3D dose distributions that closely resemble the ground-truth dose distributions. The average values of the mean absolute errors were 1.82 ± 29.09 Gy (vs. 6.41 ± 20.16 Gy for a baseline UNET) in CTVHR, 0.89 ± 1.25 Gy (vs. 0.94 ± 3.96 Gy for a baseline UNET) in the bladder, 0.33 ± 0.67 Gy (vs. 0.53 ± 1.66 Gy for a baseline UNET) in the rectum, and 0.55 ± 1.57 Gy (vs. 0.76 ± 2.89 Gy for a baseline UNET) in the sigmoid. The results showed that the mean absolute error (MAE) for the bladder, rectum, and sigmoid were 0.22 ± 1.22 Gy (3.62%) (p = 0.015), 0.21 ± 1.06 Gy (2.20%) (p = 0.172), and -0.03 ± 0.54 Gy (1.13%) (p = 0.774), respectively. The MAE for D90, V100%, and V150% of the CTVHR were 0.46 ± 2.44 Gy (8.14%) (p = 0.018), 0.57 ± 11.25% (5.23%) (p = 0.283), and -0.43 ± 19.36% (4.62%) (p = 0.190), respectively. The proposed model needs less than 5 s to predict a full 3D dose distribution of 64 × 64 × 64 voxels for any new patient plan, thus making it sufficient for near real-time applications and aiding with decision-making in the clinic. CONCLUSIONS Attention gated 3D-UNET model demonstrated a capability in predicting voxel-wise dose prediction, in comparison to 3D UNET, for DMBT intracavitary brachytherapy planning. The proposed model could be used to obtain dose distributions for near real-time decision-making before DMBT planning and quality assurance. This will guide future automated planning, making the workflow more efficient and clinically viable.
Collapse
Affiliation(s)
- Suman Gautam
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia, USA
| | | | - Dylan Richeson
- Department of Radiation Oncology, Inova Schar Cancer Institute, Fairfax, Virginia, USA
| | - Somayeh Gholami
- Department of Radiation Oncology, University of Utah, Salt Lake City, Utah, USA
| | - Binod Manandhar
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia, USA
| | - Sharmin Alam
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia, USA
| | - William Y Song
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia, USA
| |
Collapse
|
14
|
Jiang C, Ji T, Qiao Q. Application and progress of artificial intelligence in radiation therapy dose prediction. Clin Transl Radiat Oncol 2024; 47:100792. [PMID: 38779524 PMCID: PMC11109740 DOI: 10.1016/j.ctro.2024.100792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 05/07/2024] [Indexed: 05/25/2024] Open
Abstract
Radiation therapy (RT) nowadays is a main treatment modality of cancer. To ensure the therapeutic efficacy of patients, accurate dose distribution is often required, which is a time-consuming and labor-intensive process. In addition, due to the differences in knowledge and experience among participants and diverse institutions, the predicted dose are often inconsistent. In last several decades, artificial intelligence (AI) has been applied in various aspects of RT, several products have been implemented in clinical practice and confirmed superiority. In this paper, we will review the research of AI in dose prediction, focusing on the progress in deep learning (DL).
Collapse
Affiliation(s)
- Chen Jiang
- Department of Radiation Oncology, The First Hospital of China Medical University, Shenyang, China
| | - Tianlong Ji
- Department of Radiation Oncology, The First Hospital of China Medical University, Shenyang, China
| | - Qiao Qiao
- Department of Radiation Oncology, The First Hospital of China Medical University, Shenyang, China
| |
Collapse
|
15
|
Saito Y, Suzuki R, Miyamoto N, Sutherland KL, Kanehira T, Tamura M, Mori T, Nishioka K, Hashimoto T, Aoyama H. A new predictive parameter for dose-volume metrics in intensity-modulated radiation therapy planning for prostate cancer: Initial phantom study. J Appl Clin Med Phys 2024; 25:e14250. [PMID: 38146130 PMCID: PMC11005967 DOI: 10.1002/acm2.14250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 08/10/2023] [Accepted: 11/23/2023] [Indexed: 12/27/2023] Open
Abstract
BACKGROUND Organ-at-risk (OAR) sparing is often assessed using an overlap volume-based parameter, defined as the ratio of the volume of OAR that overlaps the planning target volume (PTV) to the whole OAR volume. However, this conventional overlap-based predictive parameter (COPP) does not consider the volume relationship between the PTV and OAR. PURPOSE We propose a new overlap-based predictive parameter that consider the PTV volume. The effectiveness of proposed overlap-based predictive parameter (POPP) is evaluated compared with COPP. METHODS We defined as POPP = (overlap volume between OAR and PTV/OAR volume) × (PTV volume/OAR volume). We generated intensity modulated radiation therapy (IMRT) based on step and shoot technique, and volumetric modulated arc therapy (VMAT) plans with the Auto-Planning module of Pinnacle3 treatment planning system (v14.0, Philips Medical Systems, Fitchburg, WI) using the American Association of Physicists in Medicine Task Group (TG119) prostate phantom. The relationship between the position and size of the prostate phantom was systematically modified to simulate various geometric arrangements. The correlation between overlap-based predictive parameters (COPP and POPP) and dose-volume metrics (mean dose, V70Gy, V60Gy, and V37.5 Gy for rectum and bladder) was investigated using linear regression analysis. RESULTS Our results indicated POPP was better than COPP in predicting intermediate-dose metrics. The bladder results showed a trend similar to that of the rectum. The correlation coefficient of POPP was significantly greater than that of COPP in < 62 Gy (82% of the prescribed dose) region for IMRT and in < 55 Gy (73% of the prescribed dose) region for VMAT regarding the rectum (p < 0.05). CONCLUSIONS POPP is superior to COPP for creating predictive models at an intermediate-dose level. Because rectal bleeding and bladder toxicity can be associated with intermediate-doses as well as high-doses, it is important to predict dose-volume metrics for various dose levels. POPP is a useful parameter for predicting dose-volume metrics and assisting the generation of treatment plans.
Collapse
Affiliation(s)
- Yuki Saito
- Graduate School of Biomedical Science and EngineeringHokkaido UniversitySapporoJapan
| | - Ryusuke Suzuki
- Graduate School of Biomedical Science and EngineeringHokkaido UniversitySapporoJapan
- Department of Medical PhysicsHokkaido University HospitalSapporoJapan
| | - Naoki Miyamoto
- Department of Medical PhysicsHokkaido University HospitalSapporoJapan
- Faculty of EngineeringHokkaido UniversitySapporoJapan
| | - Kenneth Lee Sutherland
- Global Center for Biomedical Science and EngineeringFaculty for MedicineHokkaido UniversitySapporoJapan
| | - Takahiro Kanehira
- Graduate School of Biomedical Science and EngineeringHokkaido UniversitySapporoJapan
- Department of Medical PhysicsHokkaido University HospitalSapporoJapan
| | - Masaya Tamura
- Graduate School of Biomedical Science and EngineeringHokkaido UniversitySapporoJapan
- Department of Medical PhysicsHokkaido University HospitalSapporoJapan
| | - Takashi Mori
- Department of Radiation OncologyHokkaido University HospitalSapporoJapan
| | - Kentaro Nishioka
- Global Center for Biomedical Science and EngineeringFaculty for MedicineHokkaido UniversitySapporoJapan
- Department of Radiation OncologyHokkaido University HospitalSapporoJapan
| | - Takayuki Hashimoto
- Global Center for Biomedical Science and EngineeringFaculty for MedicineHokkaido UniversitySapporoJapan
- Department of Radiation OncologyHokkaido University HospitalSapporoJapan
| | - Hidefumi Aoyama
- Department of Radiation OncologyHokkaido University HospitalSapporoJapan
- Department of Radiation OncologyFaculty of MedicineHokkaido UniversitySapporoJapan
| |
Collapse
|
16
|
Irannejad M, Abedi I, Lonbani VD, Hassanvand M. Deep-neural network approaches for predicting 3D dose distribution in intensity-modulated radiotherapy of the brain tumors. J Appl Clin Med Phys 2024; 25:e14197. [PMID: 37933891 PMCID: PMC10962483 DOI: 10.1002/acm2.14197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 09/24/2023] [Accepted: 10/23/2023] [Indexed: 11/08/2023] Open
Abstract
PURPOSE The aim of this study is to reduce treatment planning time by predicting the intensity-modulated radiotherapy 3D dose distribution using deep learning for brain cancer patients. "For this purpose, two different approaches in dose prediction, i.e., first only planning target volume (PTV) and second PTV with organs at risk (OARs) as input of the U-net model, are employed and their results are compared." METHODS AND MATERIALS The data of 99 patients with glioma tumors referred for IMRT treatment were used so that the images of 90 patients were regarded as training datasets and the others were for the test. All patients were manually planned and treated with sixth-field IMRT; the photon energy was 6MV. The treatment plans were done with the Collapsed Cone Convolution algorithm to deliver 60 Gy in 30 fractions. RESULTS The obtained accuracy and similarity for the proposed methods in dose prediction when compared to the clinical dose distributions on test patients according to MSE, dice metric and SSIM for the Only-PTV and PTV-OARs methods are on average (0.05, 0.851, 0.83) and (0.056, 0.842, 0.82) respectively. Also, dose prediction is done in an extremely short time. CONCLUSION The same results of the two proposed methods prove that the presence of OARs in addition to PTV does not provide new knowledge to the network and only by defining the PTV and its location in the imaging slices, does the dose distribution become predictable. Therefore, the Only-PTV method by eliminating the process of introducing OARs can reduce the overall designing time of treatment by IMRT in patients with glioma tumors.
Collapse
Affiliation(s)
- Maziar Irannejad
- Department of Electrical Engineering, Najafabad BranchIslamic Azad UniversityNajafabadIran
| | - Iraj Abedi
- Medical Physics Department, School of MedicineIsfahan University of Medical SciencesIsfahanIran
| | | | | |
Collapse
|
17
|
Zou Z, Gong C, Zeng L, Guan Y, Huang B, Yu X, Liu Q, Zhang M. Invertible and Variable Augmented Network for Pretreatment Patient-Specific Quality Assurance Dose Prediction. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:60-71. [PMID: 38343215 DOI: 10.1007/s10278-023-00930-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 10/13/2023] [Accepted: 10/13/2023] [Indexed: 03/02/2024]
Abstract
Pretreatment patient-specific quality assurance (prePSQA) is conducted to confirm the accuracy of the radiotherapy dose delivered. However, the process of prePSQA measurement is time consuming and exacerbates the workload for medical physicists. The purpose of this work is to propose a novel deep learning (DL) network to improve the accuracy and efficiency of prePSQA. A modified invertible and variable augmented network was developed to predict the three-dimensional (3D) measurement-guided dose (MDose) distribution of 300 cancer patients who underwent volumetric modulated arc therapy (VMAT) between 2018 and 2021, in which 240 cases were randomly selected for training, and 60 for testing. For simplicity, the present approach was termed as "IVPSQA." The input data include CT images, radiotherapy dose exported from the treatment planning system, and MDose distribution extracted from the verification system. Adam algorithm was used for first-order gradient-based optimization of stochastic objective functions. The IVPSQA model obtained high-quality 3D prePSQA dose distribution maps in head and neck, chest, and abdomen cases, and outperformed the existing U-Net-based prediction approaches in terms of dose difference maps and horizontal profiles comparison. Moreover, quantitative evaluation metrics including SSIM, MSE, and MAE demonstrated that the proposed approach achieved a good agreement with ground truth and yield promising gains over other advanced methods. This study presented the first work on predicting 3D prePSQA dose distribution by using the IVPSQA model. The proposed method could be taken as a clinical guidance tool and help medical physicists to reduce the measurement work of prePSQA.
Collapse
Affiliation(s)
- Zhongsheng Zou
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Changfei Gong
- Department of Radiation Oncology, 1st Affiliated Hospital of Nanchang University, Nanchang, China
| | - Lingpeng Zeng
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Yu Guan
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Bin Huang
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Xiuwen Yu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Qiegen Liu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China.
| | - Minghui Zhang
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China.
| |
Collapse
|
18
|
Kawamura M, Kamomae T, Yanagawa M, Kamagata K, Fujita S, Ueda D, Matsui Y, Fushimi Y, Fujioka T, Nozaki T, Yamada A, Hirata K, Ito R, Fujima N, Tatsugami F, Nakaura T, Tsuboyama T, Naganawa S. Revolutionizing radiation therapy: the role of AI in clinical practice. JOURNAL OF RADIATION RESEARCH 2024; 65:1-9. [PMID: 37996085 PMCID: PMC10803173 DOI: 10.1093/jrr/rrad090] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 09/25/2023] [Accepted: 10/16/2023] [Indexed: 11/25/2023]
Abstract
This review provides an overview of the application of artificial intelligence (AI) in radiation therapy (RT) from a radiation oncologist's perspective. Over the years, advances in diagnostic imaging have significantly improved the efficiency and effectiveness of radiotherapy. The introduction of AI has further optimized the segmentation of tumors and organs at risk, thereby saving considerable time for radiation oncologists. AI has also been utilized in treatment planning and optimization, reducing the planning time from several days to minutes or even seconds. Knowledge-based treatment planning and deep learning techniques have been employed to produce treatment plans comparable to those generated by humans. Additionally, AI has potential applications in quality control and assurance of treatment plans, optimization of image-guided RT and monitoring of mobile tumors during treatment. Prognostic evaluation and prediction using AI have been increasingly explored, with radiomics being a prominent area of research. The future of AI in radiation oncology offers the potential to establish treatment standardization by minimizing inter-observer differences in segmentation and improving dose adequacy evaluation. RT standardization through AI may have global implications, providing world-standard treatment even in resource-limited settings. However, there are challenges in accumulating big data, including patient background information and correlating treatment plans with disease outcomes. Although challenges remain, ongoing research and the integration of AI technology hold promise for further advancements in radiation oncology.
Collapse
Affiliation(s)
- Mariko Kawamura
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumaicho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| | - Takeshi Kamomae
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumaicho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| | - Masahiro Yanagawa
- Department of Radiology, Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, 565-0871, Japan
| | - Koji Kamagata
- Department of Radiology, Juntendo University Graduate School of Medicine, 2-1-1 Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan
| | - Shohei Fujita
- Department of Radiology, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Daiju Ueda
- Department of Diagnostic and Interventional Radiology, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3, Asahi-machi, Abeno-ku, Osaka, 545-8585, Japan
| | - Yusuke Matsui
- Department of Radiology, Faculty of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, 2-5-1 Shikata-cho, Kitaku, Okayama, 700-8558, Japan
| | - Yasutaka Fushimi
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Shogoin Kawaharacho, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Tomoyuki Fujioka
- Department of Diagnostic Radiology, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo, 113-8510, Japan
| | - Taiki Nozaki
- Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Akira Yamada
- Department of Radiology, Shinshu University School of Medicine, 3-1-1 Asahi, Matsumoto, Nagano, 390-8621, Japan
| | - Kenji Hirata
- Department of Diagnostic Imaging, Faculty of Medicine, Hokkaido University, Kita15, Nishi7, Kita-Ku, Sapporo, Hokkaido, 060-8638, Japan
| | - Rintaro Ito
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumaicho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| | - Noriyuki Fujima
- Department of Diagnostic and Interventional Radiology, Hokkaido University Hospital, Kita15, Nishi7, Kita-Ku, Sapporo, Hokkaido, 060-8638, Japan
| | - Fuminari Tatsugami
- Department of Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Takeshi Nakaura
- Department of Diagnostic Radiology, Kumamoto University Graduate School of Medicine, 1-1-1 Honjo, Chuo-ku, Kumamoto, 860-8556, Japan
| | - Takahiro Tsuboyama
- Department of Radiology, Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, 565-0871, Japan
| | - Shinji Naganawa
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumaicho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| |
Collapse
|
19
|
Miao Y, Ge R, Xie C, Dai X, Liu Y, Qu B, Li X, Zhang G, Xu S. Three-dimensional dose prediction based on deep convolutional neural networks for brain cancer in CyberKnife: accurate beam modelling of homogeneous tissue. BJR Open 2024; 6:tzae023. [PMID: 39220325 PMCID: PMC11364489 DOI: 10.1093/bjro/tzae023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Revised: 10/23/2023] [Accepted: 08/13/2024] [Indexed: 09/04/2024] Open
Abstract
Objectives Accurate beam modelling is essential for dose calculation in stereotactic radiation therapy (SRT), such as CyberKnife treatment. However, the present deep learning methods only involve patient anatomical images and delineated masks for training. These studies generally focus on traditional intensity-modulated radiation therapy (RT) plans. Nevertheless, this paper aims to develop a deep CNN-based method for CyberKnife plan dose prediction about brain cancer patients. It utilized modelled beam information, target delineation, and patient anatomical information. Methods This study proposes a method that adds beam information to predict the dose distribution of CyberKnife in brain cases. A retrospective dataset of 88 brain and abdominal cancer patients treated with the Ray-tracing algorithm was performed. The datasets include patients' anatomical information (planning CT), binary masks for organs at risk (OARs) and targets, and clinical plans (containing beam information). The datasets were randomly split into 68, 6, and 14 brain cases for training, validation, and testing, respectively. Results Our proposed method performs well in SRT dose prediction. First, for the gamma passing rates in brain cancer cases, with the 2 mm/2% criteria, we got 96.7% ± 2.9% for the body, 98.3% ± 3.0% for the planning target volume, and 100.0% ± 0.0% for the OARs with small volumes referring to the clinical plan dose. Secondly, the model predictions matched the clinical plan's dose-volume histograms reasonably well for those cases. The differences in key metrics at the target area were generally below 1.0 Gy (approximately a 3% difference relative to the prescription dose). Conclusions The preliminary results for selected 14 brain cancer cases suggest that accurate 3-dimensional dose prediction for brain cancer in CyberKnife can be accomplished based on accurate beam modelling for homogeneous tumour tissue. More patients and other cancer sites are needed in a further study to validate the proposed method fully. Advances in knowledge With accurate beam modelling, the deep learning model can quickly generate the dose distribution for CyberKnife cases. This method accelerates the RT planning process, significantly improves its operational efficiency, and optimizes it.
Collapse
Affiliation(s)
- Yuchao Miao
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
- Department of Radiation Oncology, Fujian Medical University Union Hospital, Fuzhou, Fujian, 350001, China
| | - Ruigang Ge
- Department of Radiation Oncology, the First Medical Center of the People’s Liberation Army General Hospital, Beijing, 100853, China
| | - Chuanbin Xie
- Department of Radiation Oncology, the First Medical Center of the People’s Liberation Army General Hospital, Beijing, 100853, China
| | - Xiangkun Dai
- Department of Radiation Oncology, the First Medical Center of the People’s Liberation Army General Hospital, Beijing, 100853, China
| | - Yaoying Liu
- School of Physics, Beihang University, Beijing, 102206, China
| | - Baolin Qu
- Department of Radiation Oncology, the First Medical Center of the People’s Liberation Army General Hospital, Beijing, 100853, China
| | - Xiaobo Li
- Department of Radiation Oncology, Fujian Medical University Union Hospital, Fuzhou, Fujian, 350001, China
| | - Gaolong Zhang
- School of Physics, Beihang University, Beijing, 102206, China
| | - Shouping Xu
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| |
Collapse
|
20
|
Ma L, Yang Y, Ma J, Mao L, Li X, Feng L, Abulimiti M, Xiang X, Fu F, Tan Y, Zhang W, Li YX, Jin J, Li N. Correlation between AI-based CT organ features and normal lung dose in adjuvant radiotherapy following breast-conserving surgery: a multicenter prospective study. BMC Cancer 2023; 23:1085. [PMID: 37946125 PMCID: PMC10636953 DOI: 10.1186/s12885-023-11554-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2023] [Accepted: 10/20/2023] [Indexed: 11/12/2023] Open
Abstract
BACKGROUND Radiation pneumonitis (RP) is one of the common side effects after adjuvant radiotherapy in breast cancer. Irradiation dose to normal lung was related to RP. We aimed to propose an organ features based on deep learning (DL) model and to evaluate the correlation between normal lung dose and organ features. METHODS Patients with pathology-confirmed invasive breast cancer treated with adjuvant radiotherapy following breast-conserving surgery in four centers were included. From 2019 to 2020, a total of 230 patients from four nationwide centers in China were screened, of whom 208 were enrolled for DL modeling, and 22 patients from another three centers formed the external testing cohort. The subset of the internal testing cohort (n = 42) formed the internal correlation testing cohort for correlation analysis. The outline of the ipsilateral breast was marked with a lead wire before the scanning. Then, a DL model based on the High-Resolution Net was developed to detect the lead wire marker in each slice of the CT images automatically, and an in-house model was applied to segment the ipsilateral lung region. The mean and standard deviation of the distance error, the average precision, and average recall were used to measure the performance of the lead wire marker detection model. Based on these DL model results, we proposed an organ feature, and the Pearson correlation coefficient was calculated between the proposed organ feature and ipsilateral lung volume receiving 20 Gray (Gy) or more (V20). RESULTS For the lead wire marker detection model, the mean and standard deviation of the distance error, AP (5 mm) and AR (5 mm) reached 3.415 ± 4.529, 0.860, 0.883, and 4.189 ± 8.390, 0.848, 0.830 in the internal testing cohort and external testing cohort, respectively. The proposed organ feature calculated from the detected marker correlated with ipsilateral lung V20 (Pearson correlation coefficient, 0.542 with p < 0.001 in the internal correlation testing cohort and 0.554 with p = 0.008 in the external testing cohort). CONCLUSIONS The proposed artificial Intelligence-based CT organ feature was correlated with normal lung dose in adjuvant radiotherapy following breast-conserving surgery in patients with invasive breast cancer. TRIAL REGISTRATION NCT05609058 (08/11/2022).
Collapse
Affiliation(s)
- Li Ma
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Yongjing Yang
- Department of Radiation Oncology, Jilin Cancer Hospital, Changchun, Jilin, 130012, China
| | - Jiabao Ma
- Department of Radiation Oncology, Sichuan Cancer Hospital & Research Institute, No. 55, the 4Th Section, Renmin South Road, Chengdu, 610041, China
| | - Li Mao
- AI Lab, Deepwise Healthcare, Beijing, 100080, People's Republic of China
| | - Xiuli Li
- AI Lab, Deepwise Healthcare, Beijing, 100080, People's Republic of China
| | - Lingling Feng
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Muyasha Abulimiti
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Xiaoyong Xiang
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Fangmeng Fu
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Yutong Tan
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Wenjue Zhang
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Ye-Xiong Li
- Department of Radiation Oncology, Cancer Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| | - Jing Jin
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China.
- Department of Radiation Oncology, Cancer Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China.
| | - Ning Li
- National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China.
- Department of Radiation Oncology, Cancer Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China.
- Shanxi Province Cancer Hospital/Shanxi Hospital Affiliated to Cancer Hospital, Chinese Academy of Medical Sciences/Cancer Hospital Affiliated to Shanxi Medical University, Jinzhong, China.
| |
Collapse
|
21
|
Ishizawa M, Tanaka S, Takagi H, Kadoya N, Sato K, Umezawa R, Jingu K, Takeda K. Development of a prediction model for head and neck volume reduction by clinical factors, dose-volume histogram parameters and radiomics in head and neck cancer†. JOURNAL OF RADIATION RESEARCH 2023; 64:783-794. [PMID: 37466450 PMCID: PMC10516738 DOI: 10.1093/jrr/rrad052] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 05/05/2023] [Indexed: 07/20/2023]
Abstract
In external radiotherapy of head and neck (HN) cancers, the reduction of irradiation accuracy due to HN volume reduction often causes a problem. Adaptive radiotherapy (ART) can effectively solve this problem; however, its application to all cases is impractical because of cost and time. Therefore, finding priority cases is essential. This study aimed to predict patients with HN cancers are more likely to need ART based on a quantitative measure of large HN volume reduction and evaluate model accuracy. The study included 172 cases of patients with HN cancer who received external irradiation. The HN volume was calculated using cone-beam computed tomography (CT) for irradiation-guided radiotherapy for all treatment fractions and classified into two groups: cases with a large reduction in the HN volume and cases without a large reduction. Radiomic features were extracted from the primary gross tumor volume (GTV) and nodal GTV of the planning CT. To develop the prediction model, four feature selection methods and two machine-learning algorithms were tested. Predictive performance was evaluated by the area under the curve (AUC), accuracy, sensitivity and specificity. Predictive performance was the highest for the random forest, with an AUC of 0.662. Furthermore, its accuracy, sensitivity and specificity were 0.692, 0.700 and 0.813, respectively. Selected features included radiomic features of the primary GTV, human papillomavirus in oropharyngeal cancer and the implementation of chemotherapy; thus, these features might be related to HN volume change. Our model suggested the potential to predict ART requirements based on HN volume reduction .
Collapse
Affiliation(s)
- Miyu Ishizawa
- Department of Radiological Technology, Faculty of Medicine, School of Health Sciences, Tohoku University, 21 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan
| | - Shohei Tanaka
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Hisamichi Takagi
- Department of Radiological Technology, Faculty of Medicine, School of Health Sciences, Tohoku University, 21 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan
| | - Noriyuki Kadoya
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Kiyokazu Sato
- Department of Radiation Technology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Rei Umezawa
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Keiichi Jingu
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Ken Takeda
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
- Department of Radiological Technology, Faculty of Medicine, School of Health Sciences, Tohoku University, 21 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan
| |
Collapse
|
22
|
Kadoya N, Kimura Y, Tozuka R, Tanaka S, Arai K, Katsuta Y, Shimizu H, Sugai Y, Yamamoto T, Umezawa R, Jingu K. Evaluation of deep learning-based deliverable VMAT plan generated by prototype software for automated planning for prostate cancer patients. JOURNAL OF RADIATION RESEARCH 2023; 64:842-849. [PMID: 37607667 PMCID: PMC10516733 DOI: 10.1093/jrr/rrad058] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 05/08/2023] [Indexed: 08/24/2023]
Abstract
This study aims to evaluate the dosimetric accuracy of a deep learning (DL)-based deliverable volumetric arc radiation therapy (VMAT) plan generated using DL-based automated planning assistant system (AIVOT, prototype version) for patients with prostate cancer. The VMAT data (cliDose) of 68 patients with prostate cancer treated with VMAT treatment (70-74 Gy/28-37 fr) at our hospital were used (n = 55 for training and n = 13 for testing). First, a HD-U-net-based 3D dose prediction model implemented in AIVOT was customized using the VMAT data. Thus, a predictive VMAT plan (preDose) comprising AIVOT that predicted the 3D doses was generated. Second, deliverable VMAT plans (deliDose) were created using AIVOT, the radiation treatment planning system Eclipse (version 15.6) and its vender-supplied objective functions. Finally, we compared these two estimated DL-based VMAT treatment plans-i.e. preDose and deliDose-with cliDose. The average absolute dose difference of all DVH parameters for the target tissue between cliDose and deliDose across all patients was 1.32 ± 1.35% (range: 0.04-6.21%), while that for all the organs at risks was 2.08 ± 2.79% (range: 0.00-15.4%). The deliDose was superior to the cliDose in all DVH parameters for bladder and rectum. The blinded plan scoring of deliDose and cliDose was 4.54 ± 0.50 and 5.0 ± 0.0, respectively (All plans scored ≥4 points, P = 0.03.) This study demonstrated that DL-based deliverable plan for prostate cancer achieved the clinically acceptable level. Thus, the AIVOT software exhibited a potential for automated planning with no intervention for patients with prostate cancer.
Collapse
Affiliation(s)
- Noriyuki Kadoya
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Yuto Kimura
- Radiation Oncology Center, Ofuna Chuo Hospital, Ofuna 6-2-24, Kamakura, Kanagawa 247-0056, Japan
| | - Ryota Tozuka
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Shohei Tanaka
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Kazuhiro Arai
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Yoshiyuki Katsuta
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Hidetoshi Shimizu
- Department of Radiation Oncology, Aichi Cancer Center Hospital, Kanokoden 1-1, Chikusa-ku, Nagoya, Aichi, 464-8681, Japan
| | - Yuto Sugai
- Department of Radiological Technology, Keio University, Shinanomachi 35, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Takaya Yamamoto
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Rei Umezawa
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Keiichi Jingu
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| |
Collapse
|
23
|
Villa M, Nasr B, Benoit D, Padoy N, Visvikis D, Bert J. Fast dose calculation in x-ray guided interventions by using deep learning. Phys Med Biol 2023; 68:164001. [PMID: 37433326 DOI: 10.1088/1361-6560/ace678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 07/11/2023] [Indexed: 07/13/2023]
Abstract
Objective.Patient dose estimation in x-ray-guided interventions is essential to prevent radiation-induced biological side effects. Current dose monitoring systems estimate the skin dose based in dose metrics such as the reference air kerma. However, these approximations do not take into account the exact patient morphology and organs composition. Furthermore, accurate organ dose estimation has not been proposed for these procedures. Monte Carlo simulation can accurately estimate the dose by recreating the irradiation process generated during the x-ray imaging, but at a high computation time, limiting an intra-operative application. This work presents a fast deep convolutional neural network trained with MC simulations for patient dose estimation during x-ray-guided interventions.Approach.We introduced a modified 3D U-Net that utilizes a patient's CT scan and the numerical values of imaging settings as input to produce a Monte Carlo dose map. To create a dataset of dose maps, we simulated the x-ray irradiation process for the abdominal region using a publicly available dataset of 82 patient CT scans. The simulation involved varying the angulation, position, and tube voltage of the x-ray source for each scan. We additionally conducted a clinical study during endovascular abdominal aortic repairs to validate the reliability of our Monte Carlo simulation dose maps. Dose measurements were taken at four specific anatomical points on the skin and compared to the corresponding simulated doses. The proposed network was trained using a 4-fold cross-validation approach with 65 patients, and evaluating the performance on the remaining 17 patients during testing.Main results.The clinical validation demonstrated a average error within the anatomical points of 5.1%. The network yielded test errors of 11.5 ± 4.6% and 6.2 ± 1.5% for peak and average skin doses, respectively. Furthermore, the mean errors for the abdominal region and pancreas doses were 5.0 ± 1.4% and 13.1 ± 2.7%, respectively.Significance.Our network can accurately predict a personalized 3D dose map considering the current imaging settings. A short computation time was achieved, making our approach a potential solution for dose monitoring and reporting commercial systems.
Collapse
Affiliation(s)
| | - Bahaa Nasr
- LaTIM, INSERM UMR1101, Brest, France
- Brest University Hospital, France
| | | | - Nicolas Padoy
- ICube, Strasbourg University, CNRS, Strasbourg, France
- IHU Strasbourg, France
| | | | | |
Collapse
|
24
|
Qiu Z, Olberg S, den Hertog D, Ajdari A, Bortfeld T, Pursley J. Online adaptive planning methods for intensity-modulated radiotherapy. Phys Med Biol 2023; 68:10.1088/1361-6560/accdb2. [PMID: 37068488 PMCID: PMC10637515 DOI: 10.1088/1361-6560/accdb2] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 04/17/2023] [Indexed: 04/19/2023]
Abstract
Online adaptive radiation therapy aims at adapting a patient's treatment plan to their current anatomy to account for inter-fraction variations before daily treatment delivery. As this process needs to be accomplished while the patient is immobilized on the treatment couch, it requires time-efficient adaptive planning methods to generate a quality daily treatment plan rapidly. The conventional planning methods do not meet the time requirement of online adaptive radiation therapy because they often involve excessive human intervention, significantly prolonging the planning phase. This article reviews the planning strategies employed by current commercial online adaptive radiation therapy systems, research on online adaptive planning, and artificial intelligence's potential application to online adaptive planning.
Collapse
Affiliation(s)
- Zihang Qiu
- Department of Business Analytics, University of Amsterdam, The Netherlands
- Department of Radiation Oncology, Massachusetts General Hospital and Harvard Medical School, United States of America
| | - Sven Olberg
- Department of Radiation Oncology, Massachusetts General Hospital and Harvard Medical School, United States of America
| | - Dick den Hertog
- Department of Business Analytics, University of Amsterdam, The Netherlands
| | - Ali Ajdari
- Department of Radiation Oncology, Massachusetts General Hospital and Harvard Medical School, United States of America
| | - Thomas Bortfeld
- Department of Radiation Oncology, Massachusetts General Hospital and Harvard Medical School, United States of America
| | - Jennifer Pursley
- Department of Radiation Oncology, Massachusetts General Hospital and Harvard Medical School, United States of America
| |
Collapse
|
25
|
Pastor-Serrano O, Dong P, Huang C, Xing L, Perkó Z. Sub-second photon dose prediction via transformer neural networks. Med Phys 2023; 50:3159-3171. [PMID: 36669122 DOI: 10.1002/mp.16231] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 12/12/2022] [Accepted: 12/18/2022] [Indexed: 01/21/2023] Open
Abstract
BACKGROUND Fast dose calculation is critical for online and real-time adaptive therapy workflows. While modern physics-based dose algorithms must compromise accuracy to achieve low computation times, deep learning models can potentially perform dose prediction tasks with both high fidelity and speed. PURPOSE We present a deep learning algorithm that, exploiting synergies between transformer and convolutional layers, accurately predicts broad photon beam dose distributions in few milliseconds. METHODS The proposed improved Dose Transformer Algorithm (iDoTA) maps arbitrary patient geometries and beam information (in the form of a 3D projected shape resulting from a simple ray tracing calculation) to their corresponding 3D dose distribution. Treating the 3D CT input and dose output volumes as a sequence of 2D slices along the direction of the photon beam, iDoTA solves the dose prediction task as sequence modeling. The proposed model combines a Transformer backbone routing long-range information between all elements in the sequence, with a series of 3D convolutions extracting local features of the data. We train iDoTA on a dataset of 1700 beam dose distributions, using 11 clinical volumetric modulated arc therapy (VMAT) plans (from prostate, lung, and head and neck cancer patients with 194-354 beams per plan) to assess its accuracy and speed. RESULTS iDoTA predicts individual photon beams in ≈50 ms with a high gamma pass rate of97.72 ± 1.93 % $97.72\pm 1.93\%$ (2 mm, 2%). Furthermore, estimating full VMAT dose distributions in 6-12 s, iDoTA achieves state-of-the-art performance with a99.51 ± 0.66 % $99.51\pm 0.66\%$ (2 mm, 2%) pass rate and an average relative dose error of 0.75 ± 0.36%. CONCLUSIONS Offering the millisecond speed prediction per beam angle needed in online and real-time adaptive treatments, iDoTA represents a new state of the art in data-driven photon dose calculation. The proposed model can massively speed-up current photon workflows, reducing calculation times from few minutes to just a few seconds.
Collapse
Affiliation(s)
- Oscar Pastor-Serrano
- Department of Radiation Science & Technology, Delft University of Technology, Delft, Netherlands
- Department of Radiation Oncology, Stanford University, Stanford, California, USA
| | - Peng Dong
- Department of Radiation Oncology, Stanford University, Stanford, California, USA
| | - Charles Huang
- Department of Bioengineering, Stanford University, Stanford, California, USA
| | - Lei Xing
- Department of Radiation Oncology, Stanford University, Stanford, California, USA
| | - Zoltán Perkó
- Department of Radiation Science & Technology, Delft University of Technology, Delft, Netherlands
| |
Collapse
|
26
|
Oh K, Gronberg MP, Netherton TJ, Sengupta B, Cardenas CE, Court LE, Ford EC. A deep-learning-based dose verification tool utilizing fluence maps for a cobalt-60 compensator-based intensity-modulated radiation therapy system. Phys Imaging Radiat Oncol 2023; 26:100440. [PMID: 37342210 PMCID: PMC10277917 DOI: 10.1016/j.phro.2023.100440] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 04/15/2023] [Accepted: 04/17/2023] [Indexed: 06/22/2023] Open
Abstract
Background and purpose A novel cobalt-60 compensator-based intensity-modulated radiation therapy (IMRT) system was developed for a resource-limited environment but lacked an efficient dose verification algorithm. The aim of this study was to develop a deep-learning-based dose verification algorithm for accurate and rapid dose predictions. Materials and methods A deep-learning network was employed to predict the doses from static fields related to beam commissioning. Inputs were a cube-shaped phantom, a beam binary mask, and an intersecting volume of the phantom and beam binary mask, while output was a 3-dimensional (3D) dose. The same network was extended to predict patient-specific doses for head and neck cancers using two different approaches. A field-based method predicted doses for each field and combined all calculated doses into a plan, while the plan-based method combined all nine fluences into a plan to predict doses. Inputs included patient computed tomography (CT) scans, binary beam masks, and fluence maps truncated to the patient's CT in 3D. Results For static fields, predictions agreed well with ground truths with average deviations of less than 0.5% for percent depth doses and profiles. Even though the field-based method showed excellent prediction performance for each field, the plan-based method showed better agreement between clinical and predicted dose distributions. The distributed dose deviations for all planned target volumes and organs at risk were within 1.3 Gy. The calculation speed for each case was within two seconds. Conclusions A deep-learning-based dose verification tool can accurately and rapidly predict doses for a novel cobalt-60 compensator-based IMRT system.
Collapse
Affiliation(s)
- Kyuhak Oh
- Department of Radiation Oncology, University of Washington Medical Center, Seattle, WA 98195, USA
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Mary P. Gronberg
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Tucker J. Netherton
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Bishwambhar Sengupta
- Department of Radiation Oncology, University of Washington Medical Center, Seattle, WA 98195, USA
| | - Carlos E. Cardenas
- Department of Radiation Oncology, University of Alabama, Birmingham, AL 35233, USA
| | - Laurence E. Court
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Eric C. Ford
- Department of Radiation Oncology, University of Washington Medical Center, Seattle, WA 98195, USA
| |
Collapse
|
27
|
Koike Y, Takegawa H, Anetai Y, Ohira S, Nakamura S, Tanigawa N. Patient-specific three-dimensional dose distribution prediction via deep learning for prostate cancer therapy: Improvement with the structure loss. Phys Med 2023; 107:102544. [PMID: 36774846 DOI: 10.1016/j.ejmp.2023.102544] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 01/18/2023] [Accepted: 02/03/2023] [Indexed: 02/12/2023] Open
Abstract
PURPOSE Deep learning (DL)-based dose distribution prediction can potentially reduce the cost of inverse planning process. We developed and introduced a structure-focused loss (Lstruct) for 3D dose prediction to improve prediction accuracy. This study investigated the influence of Lstruct on DL-based dose prediction for patients with prostate cancer. The proposed Lstruct, which is similar in concept to dose-volume histogram (DVH)-based optimization in clinical practice, has the potential to provide more interpretable and accurate DL-based optimization. METHODS This study involved 104 patients who underwent prostate radiotherapy. We used 3D U-Net-based architecture to predict dose distributions from computed tomography and contours of the planning target volume and organs-at-risk. We trained two models using different loss functions: L2 loss and Lstruct. Predicted doses were compared in terms of dose-volume parameters and the Dice similarity coefficient of isodose volume. RESULTS DVH analysis showed that the Lstruct model had smaller errors from the ground truth than the L2 model. The Lstruct model achieved more consistent dose distributions than the L2 model, with errors close to zero. The isodose Dice score of the Lstruct model was greater than that of the L2 model by >20% of the prescribed dose. CONCLUSIONS We developed Lstruct using labels of inputted contours for DL-based dose prediction for prostate radiotherapy. Lstruct can be generalized to any DL architecture, thereby enhancing the dose prediction accuracy.
Collapse
Affiliation(s)
- Yuhei Koike
- Department of Radiology, Kansai Medical University, 2-5-1 Shinmachi, Hirakata, Osaka 573-1010, Japan.
| | - Hideki Takegawa
- Department of Radiology, Kansai Medical University, 2-5-1 Shinmachi, Hirakata, Osaka 573-1010, Japan
| | - Yusuke Anetai
- Department of Radiology, Kansai Medical University, 2-5-1 Shinmachi, Hirakata, Osaka 573-1010, Japan
| | - Shingo Ohira
- Department of Radiation Oncology, Osaka International Cancer Institute, 3-1-69 Otemae, Chuo-ku, Osaka 537-8567, Japan
| | - Satoaki Nakamura
- Department of Radiology, Kansai Medical University, 2-5-1 Shinmachi, Hirakata, Osaka 573-1010, Japan
| | - Noboru Tanigawa
- Department of Radiology, Kansai Medical University, 2-5-1 Shinmachi, Hirakata, Osaka 573-1010, Japan
| |
Collapse
|
28
|
Abstract
Treatment planning in radiation therapy has progressed enormously over the past several decades. Such advancements came in the form of innovative hardware and algorithms, giving rise to modalities such as intensity-modulated radiation therapy and volume modulated arc therapy, greatly improving patient outcome and quality of life. While these developments have improved the overall plan quality, they have also given rise to higher treatment planning complexity. This has resulted in increased treatment planning time and higher variability in the final approved plan quality. Radiation oncology, as an already technologically advanced field, has much research and implementation involving the use of AI. The field has begun to show the efficacy of using such technologies in many of its sub-areas, such as in diagnosis, imaging, segmentation, treatment planning, quality assurance, treatment delivery, and follow-up. Some AI technologies have already been clinically implemented by commercial systems. In this article, we will provide an overview to methods involved with treatment planning in radiation therapy. In particular, we will review the recent research and literature related to automation of the treatment planning process, leading to potentially higher efficiency and higher quality plans. We will then present the current and future challenges, as well as some future perspectives.
Collapse
Affiliation(s)
- Dan Nguyen
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, UT Southwestern Medical Center, Dallas, TX; Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX.
| | - Mu-Han Lin
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, UT Southwestern Medical Center, Dallas, TX; Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX
| | - David Sher
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, UT Southwestern Medical Center, Dallas, TX; Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX
| | - Weiguo Lu
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, UT Southwestern Medical Center, Dallas, TX; Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX
| | - Xun Jia
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, UT Southwestern Medical Center, Dallas, TX; Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX
| | - Steve Jiang
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, UT Southwestern Medical Center, Dallas, TX; Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX
| |
Collapse
|
29
|
A Survey on Deep Learning for Precision Oncology. Diagnostics (Basel) 2022; 12:diagnostics12061489. [PMID: 35741298 PMCID: PMC9222056 DOI: 10.3390/diagnostics12061489] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 06/14/2022] [Accepted: 06/14/2022] [Indexed: 12/27/2022] Open
Abstract
Precision oncology, which ensures optimized cancer treatment tailored to the unique biology of a patient’s disease, has rapidly developed and is of great clinical importance. Deep learning has become the main method for precision oncology. This paper summarizes the recent deep-learning approaches relevant to precision oncology and reviews over 150 articles within the last six years. First, we survey the deep-learning approaches categorized by various precision oncology tasks, including the estimation of dose distribution for treatment planning, survival analysis and risk estimation after treatment, prediction of treatment response, and patient selection for treatment planning. Secondly, we provide an overview of the studies per anatomical area, including the brain, bladder, breast, bone, cervix, esophagus, gastric, head and neck, kidneys, liver, lung, pancreas, pelvis, prostate, and rectum. Finally, we highlight the challenges and discuss potential solutions for future research directions.
Collapse
|
30
|
Tanaka S, Kadoya N, Sugai Y, Umeda M, Ishizawa M, Katsuta Y, Ito K, Takeda K, Jingu K. A deep learning-based radiomics approach to predict head and neck tumor regression for adaptive radiotherapy. Sci Rep 2022; 12:8899. [PMID: 35624113 PMCID: PMC9142601 DOI: 10.1038/s41598-022-12170-z] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Accepted: 05/05/2022] [Indexed: 12/14/2022] Open
Abstract
Early regression—the regression in tumor volume during the initial phase of radiotherapy (approximately 2 weeks after treatment initiation)—is a common occurrence during radiotherapy. This rapid radiation-induced tumor regression may alter target coordinates, necessitating adaptive radiotherapy (ART). We developed a deep learning-based radiomics (DLR) approach to predict early head and neck tumor regression and thereby facilitate ART. Primary gross tumor volume (GTVp) was monitored in 96 patients and nodal GTV (GTVn) in 79 patients during treatment. All patients underwent two computed tomography (CT) scans: one before the start of radiotherapy for initial planning and one during radiotherapy for boost planning. Patients were assigned to regression and nonregression groups according to their median tumor regression rate (ΔGTV/treatment day from initial to boost CT scan). We input a GTV image into the convolutional neural network model, which was pretrained using natural image datasets, via transfer learning. The deep features were extracted from the last fully connected layer. To clarify the prognostic power of the deep features, machine learning models were trained. The models then predicted the regression and nonregression of GTVp and GTVn and evaluated the predictive performance by 0.632 + bootstrap area under the curve (AUC). Predictive performance for GTVp regression was highest using the InceptionResNetv2 model (mean AUC = 0.75) and that for GTVn was highest using NASNetLarge (mean AUC = 0.73). Both models outperformed the handcrafted radiomics features (mean AUC = 0.63 for GTVp and 0.61 for GTVn) or clinical factors (0.64 and 0.67, respectively). DLR may facilitate ART for improved radiation side-effects and target coverage.
Collapse
Affiliation(s)
- Shohei Tanaka
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, 980-8574, Japan
| | - Noriyuki Kadoya
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, 980-8574, Japan.
| | - Yuto Sugai
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, 980-8574, Japan
| | - Mariko Umeda
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, 980-8574, Japan
| | - Miyu Ishizawa
- Department of Radiological Technology, School of Health Sciences, Faculty of Medicine, Tohoku University, Sendai, Japan
| | - Yoshiyuki Katsuta
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, 980-8574, Japan
| | - Kengo Ito
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, 980-8574, Japan
| | - Ken Takeda
- Department of Radiological Technology, School of Health Sciences, Faculty of Medicine, Tohoku University, Sendai, Japan
| | - Keiichi Jingu
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, 1-1 Seiryo-machi, Aoba-ku, Sendai, 980-8574, Japan
| |
Collapse
|
31
|
Pastor-Serrano O, Perkó Z. Millisecond speed deep learning based proton dose calculation with Monte Carlo accuracy. Phys Med Biol 2022; 67. [PMID: 35447605 DOI: 10.1088/1361-6560/ac692e] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2022] [Accepted: 04/21/2022] [Indexed: 11/12/2022]
Abstract
Objective.Next generation online and real-time adaptive radiotherapy workflows require precise particle transport simulations in sub-second times, which is unfeasible with current analytical pencil beam algorithms (PBA) or Monte Carlo (MC) methods. We present a deep learning based millisecond speed dose calculation algorithm (DoTA) accurately predicting the dose deposited by mono-energetic proton pencil beams for arbitrary energies and patient geometries.Approach.Given the forward-scattering nature of protons, we frame 3D particle transport as modeling a sequence of 2D geometries in the beam's eye view. DoTA combines convolutional neural networks extracting spatial features (e.g. tissue and density contrasts) with a transformer self-attention backbone that routes information between the sequence of geometry slices and a vector representing the beam's energy, and is trained to predict low noise MC simulations of proton beamlets using 80 000 different head and neck, lung, and prostate geometries.Main results.Predicting beamlet doses in 5 ± 4.9 ms with a very high gamma pass rate of 99.37 ± 1.17% (1%, 3 mm) compared to the ground truth MC calculations, DoTA significantly improves upon analytical pencil beam algorithms both in precision and speed. Offering MC accuracy 100 times faster than PBAs for pencil beams, our model calculates full treatment plan doses in 10-15 s depending on the number of beamlets (800-2200 in our plans), achieving a 99.70 ± 0.14% (2%, 2 mm) gamma pass rate across 9 test patients.Significance.Outperforming all previous analytical pencil beam and deep learning based approaches, DoTA represents a new state of the art in data-driven dose calculation and can directly compete with the speed of even commercial GPU MC approaches. Providing the sub-second speed required for adaptive treatments, straightforward implementations could offer similar benefits to other steps of the radiotherapy workflow or other modalities such as helium or carbon treatments.
Collapse
Affiliation(s)
- Oscar Pastor-Serrano
- Delft University of Technology, Department of Radiation Science and Technology, Delft, The Netherlands
| | - Zoltán Perkó
- Delft University of Technology, Department of Radiation Science and Technology, Delft, The Netherlands
| |
Collapse
|
32
|
Kajikawa T, Kadoya N, Maehara Y, Miura H, Katsuta Y, Nagasawa S, Suzuki G, Yamazaki H, Tamaki N, Yamada K. A deep learning method for translating 3D-CT to SPECT ventilation imaging: First comparison with 81m Kr-gas SPECT ventilation imaging. Med Phys 2022; 49:4353-4364. [PMID: 35510535 PMCID: PMC9545310 DOI: 10.1002/mp.15697] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 03/29/2022] [Accepted: 04/18/2022] [Indexed: 11/10/2022] Open
Abstract
PURPOSE This study aimed to evaluate the accuracy of deep learning (DL)-based computed tomography (CT) ventilation imaging (CTVI). METHODS A total of 71 cases who underwent single-photon emission CT 81m Kr-gas ventilation (SPECT V) and CT imaging were included. Sixty cases were assigned to the training and validation sets and the remaining 11 cases were assigned to the test set. To directly transform 3DCT (free-breathing CT) images to SPECT V images, a DL-based model was implemented based on the U-Net architecture. The input and output data were 3DCT- and SPECT V-masked, respectively, except for whole-lung volumes. These data were rearranged in voxel size, registered rigidly, cropped, and normalized in pre-processing. In addition to a standard estimation method (i.e., without dropout during the estimation process), a Monte-Carlo Dropout (MCD) method (i.e., with dropout during the estimation process) was used to calculate prediction uncertainty. To evaluate the two models' (CTVIMCD U-Net , CTVIU-Net ) performance, we used five-fold cross-validation for the training and validation sets. To test the final model performances for both approaches, we applied the test set to each trained model and averaged the test prediction results from the five trained models to acquire the mean test result (bagging) for each approach. For the MCD method, the models were predicted repeatedly (sample size = 200), and the average and standard deviation maps were calculated in each voxel from the predicted results: the average maps were defined as test prediction results in each fold. As an evaluation index, the voxel-wise Spearman rank correlation coefficient (Spearman rs ) and dice similarity coefficient (DSC) were calculated. The DSC was calculated for three functional regions (high, moderate, and low) separated by an almost equal volume. The coefficient of variation was defined as prediction uncertainty, and these average values were calculated within three functional regions. The Wilcoxon signed-rank test was used to test for a significant difference between the two DL-based approaches RESULTS: The average indexes with one standard deviation (1SD) between CTVIMCD U-Net and SPECT V were 0.76 ± 0.06, 0.69 ± 0.07, 0.51 ± 0.06, and 0.75 ± 0.04 for Spearman rs , DSChigh , DSCmoderate , and DSClow , respectively. The average indexes with 1SD between CTVIU-Net and SPECT V were 0.72 ± 0.05, 0.66 ± 0.04, 0.48 ± 0.04, and 0.74 ± 0.06 for Spearman rs , DSChigh , DSCmoderate , and DSClow , respectively. These indexes between CTVIMCD U-Net and CTVIU-Net showed no significance difference (Spearman rs , p = 0.175; DSChigh , p = 0.123; DSCmoderate , p = 0.278; DSClow , p = 0.520). The average coefficient of variations with 1SD were 0.27 ± 0.00, 0.27 ± 0.01, and 0.36 ± 0.03 for the high-, moderate-, and low-functional regions, respectively, and the low-functional region showed a tendency to exhibit larger uncertainties than the others. CONCLUSION We evaluated DL-based framework for estimating lung-functional ventilation images only from CT images. The results indicated that the DL-based approach could potentially be used for lung-ventilation estimation. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Tomohiro Kajikawa
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan.,Department of Radiation Oncology, Tohoku University Graduate School of Medicine, Sendai, Japan
| | - Noriyuki Kadoya
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, Sendai, Japan
| | - Yosuke Maehara
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Hiroshi Miura
- Department of Radiology, Japanese Red Cross Kyoto Daiichi Hospital, Kyoto, Japan
| | - Yoshiyuki Katsuta
- Department of Radiation Oncology, Tohoku University Graduate School of Medicine, Sendai, Japan
| | - Shinsuke Nagasawa
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Gen Suzuki
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Hideya Yamazaki
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Nagara Tamaki
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Kei Yamada
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| |
Collapse
|
33
|
Eriksson O, Zhang T. Robust automated radiation therapy treatment planning using scenario-specific dose prediction and robust dose mimicking. Med Phys 2022; 49:3564-3573. [PMID: 35305023 PMCID: PMC9310773 DOI: 10.1002/mp.15622] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Revised: 02/17/2022] [Accepted: 03/14/2022] [Indexed: 12/01/2022] Open
Abstract
Purpose We present a framework for robust automated treatment planning using machine learning, comprising scenario‐specific dose prediction and robust dose mimicking. Methods
The scenario dose prediction pipeline is divided into the prediction of nominal dose from input image and the prediction of scenario dose from nominal dose, each using a deep learning model with U‐net architecture. By using a specially developed dose–volume histogram–based loss function, the predicted scenario doses are ensured sufficient target coverage despite the possibility of the training data being non‐robust. Deliverable plans may then be created by solving a robust dose mimicking problem with the predictions as scenario‐specific reference doses. Results Numerical experiments are performed using a data set of 52 intensity‐modulated proton therapy plans for prostate patients. We show that the predicted scenario doses resemble their respective ground truth well, in particular while having target coverage comparable to that of the nominal scenario. The deliverable plans produced by the subsequent robust dose mimicking were showed to be robust against the same scenario set considered for prediction. Conclusions We demonstrate the feasibility and merits of the proposed methodology for incorporating robustness into automated treatment planning algorithms.
Collapse
Affiliation(s)
- Oskar Eriksson
- RaySearch Laboratories, Eugeniavägen 18, Solna, Stockholm, SE-171 64, Sweden
| | - Tianfang Zhang
- Department of Mathematics, KTH Royal Institute of Technology, Stockholm, SE-100 44, Sweden
| |
Collapse
|
34
|
Qilin Z, Peng B, Ang Q, Weijuan J, Ping J, Hongqing Z, Bin D, Ruijie Y. The feasibility study on the generalization of deep learning dose prediction model for volumetric modulated arc therapy of cervical cancer. J Appl Clin Med Phys 2022; 23:e13583. [PMID: 35262273 PMCID: PMC9195039 DOI: 10.1002/acm2.13583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Revised: 12/23/2021] [Accepted: 02/19/2022] [Indexed: 11/09/2022] Open
Abstract
Purpose To develop a 3D‐Unet dose prediction model to predict the three‐dimensional dose distribution of volumetric modulated arc therapy (VMAT) for cervical cancer and test the dose prediction performance of the model in endometrial cancer to explore the feasibility of model generalization. Methods One hundred and seventeen cases of cervical cancer and 20 cases of endometrial cancer treated with VMAT were used for the model training, validation, and test. The prescribed dose was 50.4 Gy in 28 fractions. Eight independent channels of contoured structures were input to the model, and the dose distribution was used as the output of the model. The 3D‐Unet prediction model was trained and validated on the training set (n = 86) and validation set (n = 11), respectively. Then the model was tested on the test set (n = 20) of cervical cancer and endometrial cancer, respectively. The results between clinical dose distribution and predicted dose distribution were compared in the following aspects: (a) the mean absolute error (MAE) within the body, (b) the Dice similarity coefficients (DSCs) under different isodose volumes, (c) the dosimetric indexes including the mean dose (Dmean), the received dose of 2 cm3 (D2cc), the percentage volume of receiving 40 Gy dose of organs‐at‐risk (V40), planning target volume (PTV) D98%, and homogeneity index (HI), (d) dose–volume histograms (DVHs). Results The model can accurately predict the dose distribution of the VMAT plan for cervical cancer and endometrial cancer. The overall average MAE and maximum MAE for cervical cancer were 2.43 ± 3.17% and 3.16 ± 4.01% of the prescribed dose, respectively, and for endometrial cancer were 2.70 ± 3.54% and 3.85 ± 3.11%. The average DSCs under different isodose volumes is above 0.9. The predicted dosimetric indexes and DVHs are equivalent to the clinical dose for both cervical cancer and endometrial cancer, and there is no statistically significant difference. Conclusion A 3D‐Unet dose prediction model was developed for VMAT of cervical cancer, which can predict the dose distribution accurately for cervical cancer. The model can also be generalized for endometrial cancer with good performance.
Collapse
Affiliation(s)
- Zhang Qilin
- Department of Radiation OncologyPeking University Third HospitalBeijingChina
| | - Bao Peng
- Center for Data ScienceAcademy for Advanced Interdisciplinary StudiesPeking UniversityBeijingChina
| | - Qu Ang
- Department of Radiation OncologyPeking University Third HospitalBeijingChina
| | - Jiang Weijuan
- Department of Radiation OncologyPeking University Third HospitalBeijingChina
| | - Jiang Ping
- Department of Radiation OncologyPeking University Third HospitalBeijingChina
| | - Zhuang Hongqing
- Department of Radiation OncologyPeking University Third HospitalBeijingChina
| | - Dong Bin
- Beijing International Center for Mathematical ResearchPeking UniversityBeijingChina
| | - Yang Ruijie
- Department of Radiation OncologyPeking University Third HospitalBeijingChina
| |
Collapse
|
35
|
Liu Y, Chen Z, Wang J, Wang X, Qu B, Ma L, Zhao W, Zhang G, Xu S. Dose Prediction Using a Three-Dimensional Convolutional Neural Network for Nasopharyngeal Carcinoma With Tomotherapy. Front Oncol 2021; 11:752007. [PMID: 34858825 PMCID: PMC8631763 DOI: 10.3389/fonc.2021.752007] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 10/21/2021] [Indexed: 01/14/2023] Open
Abstract
Purpose This study focused on predicting 3D dose distribution at high precision and generated the prediction methods for nasopharyngeal carcinoma patients (NPC) treated with Tomotherapy based on the patient-specific gap between organs at risk (OARs) and planning target volumes (PTVs). Methods A convolutional neural network (CNN) is trained using the CT and contour masks as the input and dose distributions as output. The CNN is based on the "3D Dense-U-Net", which combines the U-Net and the Dense-Net. To evaluate the model, we retrospectively used 124 NPC patients treated with Tomotherapy, in which 96 and 28 patients were randomly split and used for model training and test, respectively. We performed comparison studies using different training matrix shapes and dimensions for the CNN models, i.e., 128 ×128 ×48 (for Model I), 128 ×128 ×16 (for Model II), and 2D Dense U-Net (for Model III). The performance of these models was quantitatively evaluated using clinically relevant metrics and statistical analysis. Results We found a more considerable height of the training patch size yields a better model outcome. The study calculated the corresponding errors by comparing the predicted dose with the ground truth. The mean deviations from the mean and maximum doses of PTVs and OARs were 2.42 and 2.93%. Error for the maximum dose of right optic nerves in Model I was 4.87 ± 6.88%, compared with 7.9 ± 6.8% in Model II (p=0.08) and 13.85 ± 10.97% in Model III (p<0.01); the Model I performed the best. The gamma passing rates of PTV60 for 3%/3 mm criteria was 83.6 ± 5.2% in Model I, compared with 75.9 ± 5.5% in Model II (p<0.001) and 77.2 ± 7.3% in Model III (p<0.01); the Model I also gave the best outcome. The prediction error of D95 for PTV60 was 0.64 ± 0.68% in Model I, compared with 2.04 ± 1.38% in Model II (p<0.01) and 1.05 ± 0.96% in Model III (p=0.01); the Model I was also the best one. Conclusions It is significant to train the dose prediction model by exploiting deep-learning techniques with various clinical logic concepts. Increasing the height (Y direction) of training patch size can improve the dose prediction accuracy of tiny OARs and the whole body. Our dose prediction network model provides a clinically acceptable result and a training strategy for a dose prediction model. It should be helpful to build automatic Tomotherapy planning.
Collapse
Affiliation(s)
- Yaoying Liu
- Department of Radiation Oncology, the First Medical Center of the People's Liberation Army General Hospital, Beijing, China.,School of Physics, Beihang University, Beijing, China
| | | | - Jinyuan Wang
- Department of Radiation Oncology, the First Medical Center of the People's Liberation Army General Hospital, Beijing, China
| | - Xiaoshen Wang
- Department of Radiation Oncology, the First Medical Center of the People's Liberation Army General Hospital, Beijing, China
| | - Baolin Qu
- Department of Radiation Oncology, the First Medical Center of the People's Liberation Army General Hospital, Beijing, China
| | - Lin Ma
- Department of Radiation Oncology, the First Medical Center of the People's Liberation Army General Hospital, Beijing, China
| | - Wei Zhao
- School of Physics, Beihang University, Beijing, China
| | - Gaolong Zhang
- School of Physics, Beihang University, Beijing, China
| | - Shouping Xu
- Department of Radiation Oncology, the First Medical Center of the People's Liberation Army General Hospital, Beijing, China
| |
Collapse
|
36
|
Sheng Y, Zhang J, Ge Y, Li X, Wang W, Stephens H, Yin FF, Wu Q, Wu QJ. Artificial intelligence applications in intensity modulated radiation treatment planning: an overview. Quant Imaging Med Surg 2021; 11:4859-4880. [PMID: 34888195 PMCID: PMC8611458 DOI: 10.21037/qims-21-208] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Accepted: 07/02/2021] [Indexed: 12/15/2022]
Abstract
Artificial intelligence (AI) refers to methods that improve and automate challenging human tasks by systematically capturing and applying relevant knowledge in these tasks. Over the past decades, a number of approaches have been developed to address different types and needs of system intelligence ranging from search strategies to knowledge representation and inference to robotic planning. In the context of radiation treatment planning, multiple AI approaches may be adopted to improve the planning quality and efficiency. For example, knowledge representation and inference methods may improve dose prescription by integrating and reasoning about the domain knowledge described in many clinical guidelines and clinical trials reports. In this review, we will focus on the most studied AI approach in intensity modulated radiation therapy (IMRT)/volumetric modulated arc therapy (VMAT)-machine learning (ML) and describe our recent efforts in applying ML to improve the quality, consistency, and efficiency of IMRT/VMAT planning. With the available high-quality data, we can build models to accurately predict critical variables for each step of the planning process and thus automate and improve its outcomes. Specific to the IMRT/VMAT planning process, we can build models for each of the four critical components in the process: dose-volume histogram (DVH), Dose, Fluence, and Human Planner. These models can be divided into two general groups. The first group focuses on encoding prior experience and knowledge through ML and more recently deep learning (DL) from prior clinical plans and using these models to predict the optimal DVH (DVH prediction model), or 3D dose distribution (dose prediction model), or fluence map (fluence map model). The goal of these models is to reduce or remove the trial-and-error process and guarantee consistently high-quality plans. The second group of models focuses on mimicking human planners' decision-making process (planning strategy model) during the iterative adjustments/guidance of the optimization engine. Each critical step of the IMRT/VMAT treatment planning process can be improved and automated by AI methods. As more training data becomes available and more sophisticated models are developed, we can expect that the AI methods in treatment planning will continue to improve accuracy, efficiency, and robustness.
Collapse
Affiliation(s)
- Yang Sheng
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Jiahan Zhang
- Department of Radiation Oncology, Emory University Hospital, Atlanta, GA, USA
| | - Yaorong Ge
- Department of Software and Information Systems, University of North Carolina at Charlotte, Charlotte, NC, USA
| | - Xinyi Li
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Wentao Wang
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Hunter Stephens
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Fang-Fang Yin
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Qiuwen Wu
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Q. Jackie Wu
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| |
Collapse
|
37
|
Application of U-Net with Global Convolution Network Module in Computer-Aided Tongue Diagnosis. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:5853128. [PMID: 34840700 PMCID: PMC8616653 DOI: 10.1155/2021/5853128] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Revised: 10/19/2021] [Accepted: 10/25/2021] [Indexed: 11/17/2022]
Abstract
The rapid development of intelligent manufacturing provides strong support for the intelligent medical service ecosystem. Researchers are committed to building Wise Information Technology of 120 (WIT 120) for residents and medical personnel with the concept of simple smart medical care and through core technologies such as Internet of Things, Big Data Analytics, Artificial Intelligence, and microservice framework, to improve patient safety, medical quality, clinical efficiency, and operational benefits. Among them, how to use computers and deep learning technology to assist in the diagnosis of tongue images and realize intelligent tongue diagnosis has become a major trend. Tongue crack is an important feature of tongue states. Not only does change of tongue crack states reflect objectively and accurately changed circumstances of some typical diseases and TCM syndrome but also semantic segmentation of fissured tongue can combine the other features of tongue states to further improve tongue diagnosis systems' identification accuracy. Although computer tongue diagnosis technology has made great progress, there are few studies on the fissured tongue, and most of them focus on the analysis of tongue coating and body. In this paper, we do systematic and in-depth researches and propose an improved U-Net network for image semantic segmentation of fissured tongue. By introducing the Global Convolution Network module into the encoder part of U-Net, it solves the problem that the encoder part is relatively simple and cannot extract relatively abstract high-level semantic features. Finally, the method is verified by experiments. The improved U-Net network has a better segmentation effect and higher segmentation accuracy for fissured tongue image dataset. It can be used to design a computer-aided tongue diagnosis system.
Collapse
|
38
|
Bai X, Zhang J, Wang B, Wang S, Xiang Y, Hou Q. Sharp loss: a new loss function for radiotherapy dose prediction based on fully convolutional networks. Biomed Eng Online 2021; 20:101. [PMID: 34627279 PMCID: PMC8501531 DOI: 10.1186/s12938-021-00937-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 09/22/2021] [Indexed: 11/21/2022] Open
Abstract
Background Neural-network methods have been widely used for the prediction of dose distributions in radiotherapy. However, the prediction accuracy of existing methods may be degraded by the problem of dose imbalance. In this work, a new loss function is proposed to alleviate the dose imbalance and achieve more accurate prediction results. The U-Net architecture was employed to build a prediction model. Our study involved a total of 110 patients with left-breast cancer, who were previously treated by volumetric-modulated arc radiotherapy. The patient dataset was divided into training and test subsets of 100 and 10 cases, respectively. We proposed a novel ‘sharp loss’ function, and a parameter γ was used to adjust the loss properties. The mean square error (MSE) loss and the sharp loss with different γ values were tested and compared using the Wilcoxon signed-rank test. Results The sharp loss achieved superior dose prediction results compared to those of the MSE loss. The best performance with the MSE loss and the sharp loss was obtained when the parameter γ was set to 100. Specifically, the mean absolute difference values for the planning target volume were 318.87 ± 30.23 for the MSE loss versus 144.15 ± 16.27 for the sharp loss with γ = 100 (p < 0.05). The corresponding values for the ipsilateral lung, the heart, the contralateral lung, and the spinal cord were 278.99 ± 51.68 versus 198.75 ± 61.38 (p < 0.05), 216.99 ± 44.13 versus 144.86 ± 43.98 (p < 0.05), 125.96 ± 66.76 versus 111.86 ± 47.19 (p > 0.05), and 194.30 ± 14.51 versus 168.58 ± 25.97 (p < 0.05), respectively. Conclusions The sharp loss function could significantly improve the accuracy of radiotherapy dose prediction.
Collapse
Affiliation(s)
- Xue Bai
- Department of Radiation Physics, Zhejiang Key Laboratory of radiation Oncology, The Cancer Hospital of the University of Chinese Academy of Sciences (Zhejiang Cancer Hospital), Hangzhou, 310022, China. .,Key Laboratory of Radiation Physics and Technology, Ministry of Education, Institute of Nuclear Science and Technology, Sichuan University, Chengdu, 610064, China.
| | - Jie Zhang
- Department of Radiation Physics, Zhejiang Key Laboratory of radiation Oncology, The Cancer Hospital of the University of Chinese Academy of Sciences (Zhejiang Cancer Hospital), Hangzhou, 310022, China
| | - Binbing Wang
- Department of Radiation Physics, Zhejiang Key Laboratory of radiation Oncology, The Cancer Hospital of the University of Chinese Academy of Sciences (Zhejiang Cancer Hospital), Hangzhou, 310022, China
| | - Shengye Wang
- Department of Radiation Physics, Zhejiang Key Laboratory of radiation Oncology, The Cancer Hospital of the University of Chinese Academy of Sciences (Zhejiang Cancer Hospital), Hangzhou, 310022, China
| | - Yida Xiang
- School of Nuclear Science and Technology, University of South China, Hengyang, 421000, China
| | - Qing Hou
- Key Laboratory of Radiation Physics and Technology, Ministry of Education, Institute of Nuclear Science and Technology, Sichuan University, Chengdu, 610064, China.
| |
Collapse
|
39
|
Deep learning method for prediction of patient-specific dose distribution in breast cancer. Radiat Oncol 2021; 16:154. [PMID: 34404441 PMCID: PMC8369791 DOI: 10.1186/s13014-021-01864-9] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Accepted: 07/19/2021] [Indexed: 11/10/2022] Open
Abstract
Background Patient-specific dose prediction improves the efficiency and quality of radiation treatment planning and reduces the time required to find the optimal plan. In this study, a patient-specific dose prediction model was developed for a left-sided breast clinical case using deep learning, and its performance was compared with that of conventional knowledge-based planning using RapidPlan™. Methods Patient-specific dose prediction was performed using a contour image of the planning target volume (PTV) and organs at risk (OARs) with a U-net-based modified dose prediction neural network. A database of 50 volumetric modulated arc therapy (VMAT) plans for left-sided breast cancer patients was utilized to produce training and validation datasets. The dose prediction deep neural network (DpNet) feature weights of the previously learned convolution layers were applied to the test on a cohort of 10 test sets. With the same patient data set, dose prediction was performed for the 10 test sets after training in RapidPlan. The 3D dose distribution, absolute dose difference error, dose-volume histogram, 2D gamma index, and iso-dose dice similarity coefficient were used for quantitative evaluation of the dose prediction. Results The mean absolute error (MAE) and one standard deviation (SD) between the clinical and deep learning dose prediction models were 0.02 ± 0.04%, 0.01 ± 0.83%, 0.16 ± 0.82%, 0.52 ± 0.97, − 0.88 ± 1.83%, − 1.16 ± 2.58%, and − 0.97 ± 1.73% for D95%, Dmean in the PTV, and the OARs of the body, left breast, heart, left lung, and right lung, respectively, and those measured between the clinical and RapidPlan dose prediction models were 0.02 ± 0.14%, 0.87 ± 0.63%, − 0.29 ± 0.98%, 1.30 ± 0.86%, − 0.32 ± 1.10%, 0.12 ± 2.13%, and − 1.74 ± 1.79, respectively. Conclusions In this study, a deep learning method for dose prediction was developed and was demonstrated to accurately predict patient-specific doses for left-sided breast cancer. Using the deep learning framework, the efficiency and accuracy of the dose prediction were compared to those of RapidPlan. The doses predicted by deep learning were superior to the results of the RapidPlan-generated VMAT plan.
Collapse
|
40
|
Momin S, Fu Y, Lei Y, Roper J, Bradley JD, Curran WJ, Liu T, Yang X. Knowledge-based radiation treatment planning: A data-driven method survey. J Appl Clin Med Phys 2021; 22:16-44. [PMID: 34231970 PMCID: PMC8364264 DOI: 10.1002/acm2.13337] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Revised: 04/26/2021] [Accepted: 06/02/2021] [Indexed: 12/18/2022] Open
Abstract
This paper surveys the data-driven dose prediction methods investigated for knowledge-based planning (KBP) in the last decade. These methods were classified into two major categories-traditional KBP methods and deep-learning (DL) methods-according to their techniques of utilizing previous knowledge. Traditional KBP methods include studies that require geometric or anatomical features to either find the best-matched case(s) from a repository of prior treatment plans or to build dose prediction models. DL methods include studies that train neural networks to make dose predictions. A comprehensive review of each category is presented, highlighting key features, methods, and their advancements over the years. We separated the cited works according to the framework and cancer site in each category. Finally, we briefly discuss the performance of both traditional KBP methods and DL methods, then discuss future trends of both data-driven KBP methods to dose prediction.
Collapse
Affiliation(s)
- Shadab Momin
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGAUSA
| | - Yabo Fu
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGAUSA
| | - Yang Lei
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGAUSA
| | - Justin Roper
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGAUSA
| | - Jeffrey D. Bradley
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGAUSA
| | - Walter J. Curran
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGAUSA
| | - Tian Liu
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGAUSA
| | - Xiaofeng Yang
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGAUSA
| |
Collapse
|
41
|
Lempart M, Benedek H, Jamtheim Gustafsson C, Nilsson M, Eliasson N, Bäck S, Munck af Rosenschöld P, Olsson LE. Volumetric modulated arc therapy dose prediction and deliverable treatment plan generation for prostate cancer patients using a densely connected deep learning model. Phys Imaging Radiat Oncol 2021; 19:112-119. [PMID: 34401537 PMCID: PMC8353474 DOI: 10.1016/j.phro.2021.07.008] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Revised: 07/02/2021] [Accepted: 07/14/2021] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND AND PURPOSE Radiation therapy treatment planning is a manual, time-consuming task that might be accelerated using machine learning algorithms. In this study, we aimed to evaluate if a triplet-based deep learning model can predict volumetric modulated arc therapy (VMAT) dose distributions for prostate cancer patients. MATERIALS AND METHODS A modified U-Net was trained on triplets, a combination of three consecutive image slices and corresponding segmentations, from 160 patients, and compared to a baseline U-Net. Dose predictions from 17 test patients were transformed into deliverable treatment plans using a novel planning workflow. RESULTS The model achieved a mean absolute dose error of 1.3%, 1.9%, 1.0% and ≤ 2.6% for clinical target volume (CTV) CTV_D100%, planning target volume (PTV) PTV_D98%, PTV_D95% and organs at risk (OAR) respectively, when compared to the clinical ground truth (GT) dose distributions. All predicted distributions were successfully transformed into deliverable treatment plans and tested on a phantom, resulting in a passing rate of 100% (global gamma, 3%, 2 mm, 15% cutoff). The dose difference between deliverable treatment plans and GT dose distributions was within 4.4%. The difference between the baseline model and our improved model was statistically significant (p < 0.05) for CVT_D100%, PTV_D98% and PTV_D95%. CONCLUSION Triplet-based training improved VMAT dose distribution predictions when compared to 2D. Dose predictions were successfully transformed into deliverable treatment plans using our proposed treatment planning procedure. Our method may automate parts of the workflow for external beam prostate radiation therapy and improve the overall treatment speed and plan quality.
Collapse
Affiliation(s)
- Michael Lempart
- Radiation Physics, Department of Hematology, Oncology, and Radiation Physics, Skåne University Hospital, Lund, Sweden
- Department of Translational Sciences, Medical Radiation Physics, Lund University, Malmö, Sweden
| | - Hunor Benedek
- Radiation Physics, Department of Hematology, Oncology, and Radiation Physics, Skåne University Hospital, Lund, Sweden
- Department of Medical Radiation Physics, Lund University, Lund, Sweden
| | - Christian Jamtheim Gustafsson
- Radiation Physics, Department of Hematology, Oncology, and Radiation Physics, Skåne University Hospital, Lund, Sweden
- Department of Translational Sciences, Medical Radiation Physics, Lund University, Malmö, Sweden
| | - Mikael Nilsson
- Centre for Mathematical Sciences, Lund University, Lund, Sweden
| | - Niklas Eliasson
- Radiation Physics, Department of Hematology, Oncology, and Radiation Physics, Skåne University Hospital, Lund, Sweden
| | - Sven Bäck
- Radiation Physics, Department of Hematology, Oncology, and Radiation Physics, Skåne University Hospital, Lund, Sweden
| | - Per Munck af Rosenschöld
- Radiation Physics, Department of Hematology, Oncology, and Radiation Physics, Skåne University Hospital, Lund, Sweden
- Department of Medical Radiation Physics, Lund University, Lund, Sweden
| | - Lars E. Olsson
- Radiation Physics, Department of Hematology, Oncology, and Radiation Physics, Skåne University Hospital, Lund, Sweden
- Department of Translational Sciences, Medical Radiation Physics, Lund University, Malmö, Sweden
| |
Collapse
|
42
|
Huang D, Bai H, Wang L, Hou Y, Li L, Xia Y, Yan Z, Chen W, Chang L, Li W. The Application and Development of Deep Learning in Radiotherapy: A Systematic Review. Technol Cancer Res Treat 2021; 20:15330338211016386. [PMID: 34142614 PMCID: PMC8216350 DOI: 10.1177/15330338211016386] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023] Open
Abstract
With the massive use of computers, the growth and explosion of data has greatly promoted the development of artificial intelligence (AI). The rise of deep learning (DL) algorithms, such as convolutional neural networks (CNN), has provided radiation oncologists with many promising tools that can simplify the complex radiotherapy process in the clinical work of radiation oncology, improve the accuracy and objectivity of diagnosis, and reduce the workload, thus enabling clinicians to spend more time on advanced decision-making tasks. As the development of DL gets closer to clinical practice, radiation oncologists will need to be more familiar with its principles to properly evaluate and use this powerful tool. In this paper, we explain the development and basic concepts of AI and discuss its application in radiation oncology based on different task categories of DL algorithms. This work clarifies the possibility of further development of DL in radiation oncology.
Collapse
Affiliation(s)
- Danju Huang
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Han Bai
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Li Wang
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Yu Hou
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Lan Li
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Yaoxiong Xia
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Zhirui Yan
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Wenrui Chen
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Li Chang
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| | - Wenhui Li
- Department of Radiation Oncology, 531840The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan, China
| |
Collapse
|
43
|
Deep learning dose prediction for IMRT of esophageal cancer: The effect of data quality and quantity on model performance. Phys Med 2021; 83:52-63. [DOI: 10.1016/j.ejmp.2021.02.026] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/06/2020] [Revised: 02/15/2021] [Accepted: 02/24/2021] [Indexed: 12/15/2022] Open
|
44
|
A tongue features fusion approach to predicting prediabetes and diabetes with machine learning. J Biomed Inform 2021; 115:103693. [PMID: 33540076 DOI: 10.1016/j.jbi.2021.103693] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 01/27/2021] [Accepted: 01/28/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Diabetics has become a serious public health burden in China. Multiple complications appear with the progression of diabetics pose a serious threat to the quality of human life and health. We can prevent the progression of prediabetics to diabetics and delay the progression to diabetics by early identification of diabetics and prediabetics and timely intervention, which have positive significance for improving public health. OBJECTIVE Using machine learning techniques, we establish the noninvasive diabetics risk prediction model based on tongue features fusion and predict the risk of prediabetics and diabetics. METHODS Applying the type TFDA-1 Tongue Diagnosis Instrument, we collect tongue images, extract tongue features including color and texture features using TDAS, and extract the advanced tongue features with ResNet-50, achieve the fusion of the two features with GA_XGBT, finally establish the noninvasive diabetics risk prediction model and evaluate the performance of testing effectiveness. RESULTS Cross-validation suggests the best performance of GA_XGBT model with fusion features, whose average CA is 0.821, the average AUROC is 0.924, the average AUPRC is 0.856, the average Precision is 0.834, the average Recall is 0.822, the average F1-score is 0.813. Test set suggests the best testing performance of GA_XGBT model, whose average CA is 0.81, the average AUROC is 0.918, the average AUPRC is 0.839, the average Precision is 0.821, the average Recall is 0.81, the average F1-score is 0.796. When we test prediabetics with GA_XGBT model, we find that the AUROC is 0.914, the Precision is 0.69, the Recall is 0.952, the F1-score is 0.8. When we test diabetics with GA_XGBT model, we find that the AUROC is 0.984, the Precision is 0.929, the Recall is 0.951, the F1-score is 0.94. CONCLUSIONS Based on tongue features, the study uses classical machine learning algorithm and deep learning algorithm to maximum the respective advantages. We combine the prior knowledge and potential features together, establish the noninvasive diabetics risk prediction model with features fusion algorithm, and detect prediabetics and diabetics noninvasively. Our study presents a feasible method for establishing the association between diabetics and the tongue image information and prove that tongue image information is a potential marker which facilitates effective early diagnosis of prediabetics and diabetics.
Collapse
|
45
|
Bakx N, Bluemink H, Hagelaar E, van der Sangen M, Theuws J, Hurkmans C. Development and evaluation of radiotherapy deep learning dose prediction models for breast cancer. PHYSICS & IMAGING IN RADIATION ONCOLOGY 2021; 17:65-70. [PMID: 33898781 PMCID: PMC8058017 DOI: 10.1016/j.phro.2021.01.006] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 01/21/2021] [Accepted: 01/21/2021] [Indexed: 01/11/2023]
Abstract
Background and purpose Treatment planning of radiotherapy is a time-consuming and planner dependent process that can be automated by dose prediction models. The purpose of this study was to evaluate the performance of two machine learning models for breast cancer radiotherapy before possible clinical implementation. Materials and methods An in-house developed model, based on U-net architecture, and a contextual atlas regression forest (cARF) model integrated in the treatment planning software were trained. Obtained dose distributions were mimicked to create clinically deliverable plans. For training and validation, 90 patients were used, 15 patients were used for testing. Treatment plans were scored on predefined evaluation criteria and percent errors with respect to clinical dose were calculated for doses to planning target volume (PTV) and organs at risk (OARs). Results The U-net plans before mimicking met all criteria for all patients, both models failed one evaluation criterion in three patients after mimicking. No significant differences (p < 0.05) were found between clinical and predicted U-net plans before mimicking. Doses to OARs in plans of both models differed significantly from clinical plans, but no clinically relevant differences were found. After mimicking, both models had a mean percent error within 1.5% for the average dose to PTV and OARs. The mean errors for maximum doses were higher, within 6.6%. Conclusions Differences between predicted doses to OARs of the models were small when compared to clinical plans, and not found to be clinically relevant. Both models show potential in automated treatment planning for breast cancer.
Collapse
Affiliation(s)
- Nienke Bakx
- Catharina Hospital, Radiation Oncology, Eindhoven, The Netherlands
| | - Hanneke Bluemink
- Catharina Hospital, Radiation Oncology, Eindhoven, The Netherlands
| | - Els Hagelaar
- Catharina Hospital, Radiation Oncology, Eindhoven, The Netherlands
| | | | | | - Coen Hurkmans
- Catharina Hospital, Radiation Oncology, Eindhoven, The Netherlands
| |
Collapse
|
46
|
Wang M, Zhang Q, Lam S, Cai J, Yang R. A Review on Application of Deep Learning Algorithms in External Beam Radiotherapy Automated Treatment Planning. Front Oncol 2020; 10:580919. [PMID: 33194711 PMCID: PMC7645101 DOI: 10.3389/fonc.2020.580919] [Citation(s) in RCA: 67] [Impact Index Per Article: 13.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Accepted: 09/16/2020] [Indexed: 01/03/2023] Open
Abstract
Treatment planning plays an important role in the process of radiotherapy (RT). The quality of the treatment plan directly and significantly affects patient treatment outcomes. In the past decades, technological advances in computer and software have promoted the development of RT treatment planning systems with sophisticated dose calculation and optimization algorithms. Treatment planners now have greater flexibility in designing highly complex RT treatment plans in order to mitigate the damage to healthy tissues better while maximizing radiation dose to tumor targets. Nevertheless, treatment planning is still largely a time-inefficient and labor-intensive process in current clinical practice. Artificial intelligence, including machine learning (ML) and deep learning (DL), has been recently used to automate RT treatment planning and has gained enormous attention in the RT community due to its great promises in improving treatment planning quality and efficiency. In this article, we reviewed the historical advancement, strengths, and weaknesses of various DL-based automated RT treatment planning techniques. We have also discussed the challenges, issues, and potential research directions of DL-based automated RT treatment planning techniques.
Collapse
Affiliation(s)
- Mingqing Wang
- Department of Radiation Oncology, Peking University Third Hospital, Beijing, China
| | - Qilin Zhang
- Department of Radiation Oncology, Peking University Third Hospital, Beijing, China
| | - Saikit Lam
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Ruijie Yang
- Department of Radiation Oncology, Peking University Third Hospital, Beijing, China
| |
Collapse
|
47
|
Bohara G, Sadeghnejad Barkousaraie A, Jiang S, Nguyen D. Using deep learning to predict beam-tunable Pareto optimal dose distribution for intensity-modulated radiation therapy. Med Phys 2020; 47:3898-3912. [PMID: 32621789 PMCID: PMC7821384 DOI: 10.1002/mp.14374] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 05/19/2020] [Accepted: 06/23/2020] [Indexed: 12/20/2022] Open
Abstract
PURPOSE Many researchers have developed deep learning models for predicting clinical dose distributions and Pareto optimal dose distributions. Models for predicting Pareto optimal dose distributions have generated optimal plans in real time using anatomical structures and static beam orientations. However, Pareto optimal dose prediction for intensity-modulated radiation therapy (IMRT) prostate planning with variable beam numbers and orientations has not yet been investigated. We propose to develop a deep learning model that can predict Pareto optimal dose distributions by using any given set of beam angles, along with patient anatomy, as input to train the deep neural networks. We implement and compare two deep learning networks that predict with two different beam configuration modalities. METHODS We generated Pareto optimal plans for 70 patients with prostate cancer. We used fluence map optimization to generate 500 IMRT plans that sampled the Pareto surface for each patient, for a total of 35 000 plans. We studied and compared two different models, Models I and II. Although they both used the same anatomical structures - including the planning target volume (PTV), organs at risk (OARs), and body - these models were designed with two different methods for representing beam angles. Model I directly uses beam angles as a second input to the network as a binary vector. Model II converts the beam angles into beam doses that are conformal to the PTV. We divided the 70 patients into 54 training, 6 validation, and 10 testing patients, thus yielding 27 000 training, 3000 validation, and 5000 testing plans. Mean square loss (MSE) was taken as the loss function. We used the Adam optimizer with a default learning rate of 0.01 to optimize the network's performance. We evaluated the models' performance by comparing their predicted dose distributions with the ground truth (Pareto optimal) dose distribution, in terms of dose volume histogram (DVH) plots and evaluation metrics such as PTV D98 , D95 , D50 , D2 , Dmax , Dmean , Paddick Conformation Number, R50, and Homogeneity index. RESULTS Our deep learning models predicted voxel-level dose distributions that precisely matched the ground truth dose distributions. The DVHs generated also precisely matched the ground truth. Evaluation metrics such as PTV statistics, dose conformity, dose spillage (R50), and homogeneity index also confirmed the accuracy of PTV curves on the DVH. Quantitatively, Model I's prediction error of 0.043 (confirmation), 0.043 (homogeneity), 0.327 (R50), 2.80% (D95), 3.90% (D98), 0.6% (D50), and 1.10% (D2) was lower than that of Model II, which obtained 0.076 (confirmation), 0.058 (homogeneity), 0.626 (R50), 7.10% (D95), 6.50% (D98), 8.40% (D50), and 6.30% (D2). Model I also outperformed Model II in terms of the mean dose error and the max dose error on the PTV, bladder, rectum, left femoral head, and right femoral head. CONCLUSIONS Treatment planners who use our models will be able to use deep learning to control the trade-offs between the PTV and OAR weights, as well as the beam number and configurations in real time. Our dose prediction methods provide a stepping stone to building automatic IMRT treatment planning.
Collapse
Affiliation(s)
- Gyanendra Bohara
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Azar Sadeghnejad Barkousaraie
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Steve Jiang
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, 75390, USA
| | - Dan Nguyen
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, 75390, USA
| |
Collapse
|
48
|
Cui L, Taira Y, Matsuo M, Orita M, Yamada Y, Takamura N. Environmental Remediation of the difficult-to-return zone in Tomioka Town, Fukushima Prefecture. Sci Rep 2020; 10:10165. [PMID: 32576864 PMCID: PMC7311413 DOI: 10.1038/s41598-020-66726-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Accepted: 05/26/2020] [Indexed: 11/17/2022] Open
Abstract
Temporal variations in ambient dose rates in a restricted area designated as "difficult-to-return" for residents of Tomioka Town, Fukushima Prefecture were evaluated in a car-borne survey during 2018-2019. The median dose rates in the "Decontaminated area" in the difficult-to-return zone decreased rapidly from 1.0 μSv/h to 0.32 μSv/h; however, the median dose rates in the "Non-decontaminated area" and "Radioactive waste storage area" fluctuated between 1.1-1.4 μSv/h and 0.46-0.61 μSv/h, respectively. The detected rate of the cesium-137 (137Cs) (137Cs-detected points per all measuring points) in the "Decontaminated area" also decreased rapidly from 64% to 6.7%, accompany with decreasing in ambient dose rates. On the other hand, the detection of 137Cs in the "Radioactive waste storage area" and "Non-decontaminated area" decreased from 53% to 17% and 93% to 88%, respectively. We confirmed that the dose rates in the Decontaminated area dramatically decreased due to decontamination work aiming to help residents return home. Moreover, the estimated external exposure dose of workers during the present survey was 0.66 mSv/y in the Decontaminated area and 0.55 mSv/y in the Radioactive waste storage area, respectively. This case of Tomioka Town within the "difficult-to-return zone" may be the first reconstruction model for evaluating environmental contamination and radiation exposure dose rates due to artificial radionuclides derived from the nuclear disaster.
Collapse
Affiliation(s)
- Limeng Cui
- Department of Global Health, Medicine and Welfare, Atomic Bomb Disease Institute, Nagasaki University Graduate School of Biomedical Sciences, 1-12-4 Sakamoto, Nagasaki City, Nagasaki Prefecture, 852-8523, Japan
| | - Yasuyuki Taira
- Department of Global Health, Medicine and Welfare, Atomic Bomb Disease Institute, Nagasaki University Graduate School of Biomedical Sciences, 1-12-4 Sakamoto, Nagasaki City, Nagasaki Prefecture, 852-8523, Japan.
| | - Masahiko Matsuo
- Department of Global Health, Medicine and Welfare, Atomic Bomb Disease Institute, Nagasaki University Graduate School of Biomedical Sciences, 1-12-4 Sakamoto, Nagasaki City, Nagasaki Prefecture, 852-8523, Japan
| | - Makiko Orita
- Department of Global Health, Medicine and Welfare, Atomic Bomb Disease Institute, Nagasaki University Graduate School of Biomedical Sciences, 1-12-4 Sakamoto, Nagasaki City, Nagasaki Prefecture, 852-8523, Japan
| | - Yumiko Yamada
- Department of Global Health, Medicine and Welfare, Atomic Bomb Disease Institute, Nagasaki University Graduate School of Biomedical Sciences, 1-12-4 Sakamoto, Nagasaki City, Nagasaki Prefecture, 852-8523, Japan
| | - Noboru Takamura
- Department of Global Health, Medicine and Welfare, Atomic Bomb Disease Institute, Nagasaki University Graduate School of Biomedical Sciences, 1-12-4 Sakamoto, Nagasaki City, Nagasaki Prefecture, 852-8523, Japan
| |
Collapse
|