1
|
Fechter T, Sachpazidis I, Baltas D. The use of deep learning in interventional radiotherapy (brachytherapy): A review with a focus on open source and open data. Z Med Phys 2024; 34:180-196. [PMID: 36376203 PMCID: PMC11156786 DOI: 10.1016/j.zemedi.2022.10.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Revised: 10/07/2022] [Accepted: 10/10/2022] [Indexed: 11/13/2022]
Abstract
Deep learning advanced to one of the most important technologies in almost all medical fields. Especially in areas, related to medical imaging it plays a big role. However, in interventional radiotherapy (brachytherapy) deep learning is still in an early phase. In this review, first, we investigated and scrutinised the role of deep learning in all processes of interventional radiotherapy and directly related fields. Additionally, we summarised the most recent developments. For better understanding, we provide explanations of key terms and approaches to solving common deep learning problems. To reproduce results of deep learning algorithms both source code and training data must be available. Therefore, a second focus of this work is on the analysis of the availability of open source, open data and open models. In our analysis, we were able to show that deep learning plays already a major role in some areas of interventional radiotherapy, but is still hardly present in others. Nevertheless, its impact is increasing with the years, partly self-propelled but also influenced by closely related fields. Open source, data and models are growing in number but are still scarce and unevenly distributed among different research groups. The reluctance in publishing code, data and models limits reproducibility and restricts evaluation to mono-institutional datasets. The conclusion of our analysis is that deep learning can positively change the workflow of interventional radiotherapy but there is still room for improvements when it comes to reproducible results and standardised evaluation methods.
Collapse
Affiliation(s)
- Tobias Fechter
- Division of Medical Physics, Department of Radiation Oncology, Medical Center University of Freiburg, Germany; Faculty of Medicine, University of Freiburg, Germany; German Cancer Consortium (DKTK), Partner Site Freiburg, Germany.
| | - Ilias Sachpazidis
- Division of Medical Physics, Department of Radiation Oncology, Medical Center University of Freiburg, Germany; Faculty of Medicine, University of Freiburg, Germany; German Cancer Consortium (DKTK), Partner Site Freiburg, Germany
| | - Dimos Baltas
- Division of Medical Physics, Department of Radiation Oncology, Medical Center University of Freiburg, Germany; Faculty of Medicine, University of Freiburg, Germany; German Cancer Consortium (DKTK), Partner Site Freiburg, Germany
| |
Collapse
|
2
|
Liu J, Xiao H, Fan J, Hu W, Yang Y, Dong P, Xing L, Cai J. An overview of artificial intelligence in medical physics and radiation oncology. JOURNAL OF THE NATIONAL CANCER CENTER 2023; 3:211-221. [PMID: 39035195 PMCID: PMC11256546 DOI: 10.1016/j.jncc.2023.08.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2022] [Revised: 05/03/2023] [Accepted: 08/08/2023] [Indexed: 07/23/2024] Open
Abstract
Artificial intelligence (AI) is developing rapidly and has found widespread applications in medicine, especially radiotherapy. This paper provides a brief overview of AI applications in radiotherapy, and highlights the research directions of AI that can potentially make significant impacts and relevant ongoing research works in these directions. Challenging issues related to the clinical applications of AI, such as robustness and interpretability of AI models, are also discussed. The future research directions of AI in the field of medical physics and radiotherapy are highlighted.
Collapse
Affiliation(s)
- Jiali Liu
- Department of Clinical Oncology, The University of Hong Kong-Shenzhen Hospital, Shenzhen, China
- Department of Clinical Oncology, Hong Kong University Li Ka Shing Medical School, Hong Kong, China
| | - Haonan Xiao
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Jiawei Fan
- Department of Radiation Oncology, Fudan University Shanghai Cancer Center, Shanghai, China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
- Shanghai Key Laboratory of Radiation Oncology, Shanghai, China
| | - Weigang Hu
- Department of Radiation Oncology, Fudan University Shanghai Cancer Center, Shanghai, China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
- Shanghai Key Laboratory of Radiation Oncology, Shanghai, China
| | - Yong Yang
- Department of Radiation Oncology, Stanford University, CA, USA
| | - Peng Dong
- Department of Radiation Oncology, Stanford University, CA, USA
| | - Lei Xing
- Department of Radiation Oncology, Stanford University, CA, USA
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| |
Collapse
|
3
|
Flower E, Sykes J, Sullivan E, Busuttil G, Thiruthaneeswaran N, Cosgriff E, Chard J, Salkeld A, Thwaites D. Improving plan quality in cervical brachytherapy using a simple knowledge-based prediction tool for OAR dose (D2cm 3). Brachytherapy 2023; 22:623-629. [PMID: 37296007 DOI: 10.1016/j.brachy.2023.05.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 04/28/2023] [Accepted: 05/06/2023] [Indexed: 06/12/2023]
Abstract
PURPOSE Toxicity from cervical brachytherapy has been demonstrated to correlate with the D2cm3 of the bladder, rectum, and bowel. This suggests a simplified version of knowledge-based planning investigating the relationship of the overlap distance for 2cm3 and the D2cm3 from planning may be possible. This work demonstrates the feasibility of simple knowledge-based planning to predict the D2cm3, detect suboptimal plans, and improve plan quality. METHODS AND MATERIALS The overlap volume histogram (OVH) method was used to determine the distance for 2cm3 of overlap between the OAR and CTV_HR. Linear plots modeled the OAR D2cm3 and 2cm3 overlap distance. Two datasets of 20 patients (plans from 43 insertions in each dataset) were used to create two independent models, and the performance of each model was compared using cross-validation. Doses were scaled to ensure consistent CTV_HR D90 values. The predicted D2cm3 is entered as the maximum constraint in the inverse planning algorithm. RESULTS Mean bladder D2cm3 decreased by 2.9% for the models from each dataset, mean rectal D2cm3 decreased 14.9% for the model from dataset 1 and 6.0% for the model from dataset 2, mean sigmoid D2cm3 decreased 10.7% for the model from dataset 1 and 6.1% for the model from dataset 2, mean bowel D2cm3 decreased 4.1% for the model from dataset 1 but no statistically significant difference was observed for the model from dataset 2. CONCLUSIONS A simplified knowledge-based planning method was used to predict D2cm3 and was able to automate optimization of brachytherapy plans for locally advanced cervical cancer.
Collapse
Affiliation(s)
- Emily Flower
- Sydney West Radiation Oncology Network, Westmead, New South Wales, Australia; School of Physics, University of Sydney, Sydney, Australia.
| | - Jonathan Sykes
- Sydney West Radiation Oncology Network, Westmead, New South Wales, Australia; School of Physics, University of Sydney, Sydney, Australia
| | - Emma Sullivan
- Sydney West Radiation Oncology Network, Westmead, New South Wales, Australia
| | - Gemma Busuttil
- Sydney West Radiation Oncology Network, Westmead, New South Wales, Australia
| | | | - Eireann Cosgriff
- Sydney West Radiation Oncology Network, Westmead, New South Wales, Australia
| | - Jennifer Chard
- Sydney West Radiation Oncology Network, Westmead, New South Wales, Australia
| | - Alison Salkeld
- Sydney West Radiation Oncology Network, Westmead, New South Wales, Australia; School of Medicine, University of Sydney, Sydney, Australia
| | - David Thwaites
- School of Physics, University of Sydney, Sydney, Australia
| |
Collapse
|
4
|
Zhao JZ, Ni R, Chow R, Rink A, Weersink R, Croke J, Raman S. Artificial intelligence applications in brachytherapy: A literature review. Brachytherapy 2023; 22:429-445. [PMID: 37248158 DOI: 10.1016/j.brachy.2023.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 04/02/2023] [Accepted: 04/07/2023] [Indexed: 05/31/2023]
Abstract
PURPOSE Artificial intelligence (AI) has the potential to simplify and optimize various steps of the brachytherapy workflow, and this literature review aims to provide an overview of the work done in this field. METHODS AND MATERIALS We conducted a literature search in June 2022 on PubMed, Embase, and Cochrane for papers that proposed AI applications in brachytherapy. RESULTS A total of 80 papers satisfied inclusion/exclusion criteria. These papers were categorized as follows: segmentation (24), registration and image processing (6), preplanning (13), dose prediction and treatment planning (11), applicator/catheter/needle reconstruction (16), and quality assurance (10). AI techniques ranged from classical models such as support vector machines and decision tree-based learning to newer techniques such as U-Net and deep reinforcement learning, and were applied to facilitate small steps of a process (e.g., optimizing applicator selection) or even automate the entire step of the workflow (e.g., end-to-end preplanning). Many of these algorithms demonstrated human-level performance and offer significant improvements in speed. CONCLUSIONS AI has potential to augment, automate, and/or accelerate many steps of the brachytherapy workflow. We recommend that future studies adhere to standard reporting guidelines. We also stress the importance of using larger sample sizes and reporting results using clinically interpretable measures.
Collapse
Affiliation(s)
- Jonathan Zl Zhao
- Princess Margaret Hospital Cancer Centre, Radiation Medicine Program, Toronto, Canada; Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Ruiyan Ni
- Princess Margaret Hospital Cancer Centre, Radiation Medicine Program, Toronto, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Canada
| | - Ronald Chow
- Princess Margaret Hospital Cancer Centre, Radiation Medicine Program, Toronto, Canada; Temerty Faculty of Medicine, University of Toronto, Toronto, Canada; Institute of Biomedical Engineering, University of Toronto, Toronto, Canada
| | - Alexandra Rink
- Princess Margaret Hospital Cancer Centre, Radiation Medicine Program, Toronto, Canada; Department of Radiation Oncology, University of Toronto, Toronto, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Canada
| | - Robert Weersink
- Princess Margaret Hospital Cancer Centre, Radiation Medicine Program, Toronto, Canada; Department of Radiation Oncology, University of Toronto, Toronto, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Canada; Institute of Biomedical Engineering, University of Toronto, Toronto, Canada
| | - Jennifer Croke
- Princess Margaret Hospital Cancer Centre, Radiation Medicine Program, Toronto, Canada; Department of Radiation Oncology, University of Toronto, Toronto, Canada
| | - Srinivas Raman
- Princess Margaret Hospital Cancer Centre, Radiation Medicine Program, Toronto, Canada; Department of Radiation Oncology, University of Toronto, Toronto, Canada.
| |
Collapse
|
5
|
Kallis K, Moore LC, Cortes KG, Brown D, Mayadev J, Moore KL, Meyers SM. Automated treatment planning framework for brachytherapy of cervical cancer using 3D dose predictions. Phys Med Biol 2023; 68:10.1088/1361-6560/acc37c. [PMID: 36898161 PMCID: PMC10101723 DOI: 10.1088/1361-6560/acc37c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 03/10/2023] [Indexed: 03/12/2023]
Abstract
Objective. To lay the foundation for automated knowledge-based brachytherapy treatment planning using 3D dose estimations, we describe an optimization framework to convert brachytherapy dose distributions directly into dwell times (DTs).Approach. A dose rate kernelḋ(r,θ,φ)was produced by exporting 3D dose for one dwell position from the treatment planning system and normalizing by DT. By translating and rotating this kernel to each dwell position, scaling by DT and summing over all dwell positions, dose was computed (Dcalc). We used a Python-coded COBYLA optimizer to iteratively determine the DTs that minimize the mean squared error betweenDcalcand reference doseDref, computed using voxels withDref80%-120% of prescription. As validation of the optimization, we showed that the optimizer replicates clinical plans whenDref= clinical dose in 40 patients treated with tandem-and-ovoid (T&O) or tandem-and-ring (T&R) and 0-3 needles. Then we demonstrated automated planning in 10 T&O usingDref= dose predicted from a convolutional neural network developed in past work. Validation and automated plans were compared to clinical plans using mean absolute differences (MAD=1N∑n=1Nabsxn-xn') over all voxels (xn= Dose,N= #voxels) and DTs (xn= DT,N= #dwell positions), mean differences (MD) in organD2ccand high-risk CTV D90 over all patients (where positive indicates higher clinical dose), and mean Dice similarity coefficients (DSC) for 100% isodose contours.Main results. Validation plans agreed well with clinical plans (MADdose= 1.1%, MADDT= 4 s or 0.8% of total plan time,D2ccMD = -0.2% to 0.2% and D90 MD = -0.6%, DSC = 0.99). For automated plans, MADdose= 6.5% and MADDT= 10.3 s (2.1%). The slightly higher clinical metrics in automated plans (D2ccMD = -3.8% to 1.3% and D90 MD = -5.1%) were due to higher neural network dose predictions. The overall shape of the automated dose distributions were similar to clinical doses (DSC = 0.91).Significance. Automated planning with 3D dose predictions could provide significant time savings and standardize treatment planning across practitioners, regardless of experience.
Collapse
Affiliation(s)
- Karoline Kallis
- Department of Radiation Medicine and Applied Sciences, University of California, San Diego, La Jolla, CA, United States of America
| | - Lance C Moore
- Department of Radiation Medicine and Applied Sciences, University of California, San Diego, La Jolla, CA, United States of America
| | - Katherina G Cortes
- Department of Radiation Medicine and Applied Sciences, University of California, San Diego, La Jolla, CA, United States of America
| | - Derek Brown
- Department of Radiation Medicine and Applied Sciences, University of California, San Diego, La Jolla, CA, United States of America
| | - Jyoti Mayadev
- Department of Radiation Medicine and Applied Sciences, University of California, San Diego, La Jolla, CA, United States of America
| | - Kevin L Moore
- Department of Radiation Medicine and Applied Sciences, University of California, San Diego, La Jolla, CA, United States of America
| | - Sandra M Meyers
- Department of Radiation Medicine and Applied Sciences, University of California, San Diego, La Jolla, CA, United States of America
| |
Collapse
|
6
|
|
7
|
Chi L, Zhang Q. Application of Wearable Sensors in the Treatment of Cervical Spondylosis Radiculopathy with Acupuncture. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:8428518. [PMID: 35463666 PMCID: PMC9020947 DOI: 10.1155/2022/8428518] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 03/05/2022] [Indexed: 11/17/2022]
Abstract
Research shows that cervical spondylosis radiculopathy (CSR) is the most common type of cervical spondylosis in clinic, and Chinese medicine treatment has obvious advantages, among which acupuncture therapy has received increasing attention. CSR has the characteristics of high incidence, long treatment time, and easy recurrence after treatment. In order to meet the different needs of different patients, this paper uses wearable sensors to collect patient dynamic data, extracts the action features of cervical spondylosis to design a scoring system, analyzes the input feature scores through a convolutional neural network (CNN) model, and then outputs personalized acupuncture treatment plan. The development status of wearable sensors at home and abroad is introduced, and the modules and functions of the wearable sensors are designed. The CNN network is used as the network model for classification and recognition. The experimental results show that the CNN model used in this paper has a high classification accuracy, achieving an accuracy of up to 97%, and can help produce an effective treatment plan. In order to determine whether the treatment plan output by the model is effective, each group of data is handed over to two cervical spondylosis experts for scoring, and then the final treatment plan is determined from 10 acupuncture plans. In our experiments, 9 out of 10 plans generated by the CNN model were the same as generated by the experts, which shows the effectiveness of the model.
Collapse
Affiliation(s)
- Lei Chi
- Department of Acupuncture and Moxibustion, Heilongjiang University of Chinese Medicine Second Affiliated Hospital, Harbin 150000, Heilongjiang, China
| | - Qian Zhang
- Department of Acupuncture and Moxibustion, Heilongjiang University of Chinese Medicine Second Affiliated Hospital, Harbin 150000, Heilongjiang, China
| |
Collapse
|