1
|
Hurkmans C, Bibault JE, Clementel E, Dhont J, van Elmpt W, Kantidakis G, Andratschke N. Assessment of bias in scoring of AI-based radiotherapy segmentation and planning studies using modified TRIPOD and PROBAST guidelines as an example. Radiother Oncol 2024; 194:110196. [PMID: 38432311 DOI: 10.1016/j.radonc.2024.110196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 01/29/2024] [Accepted: 02/26/2024] [Indexed: 03/05/2024]
Abstract
BACKGROUND AND PURPOSE Studies investigating the application of Artificial Intelligence (AI) in the field of radiotherapy exhibit substantial variations in terms of quality. The goal of this study was to assess the amount of transparency and bias in scoring articles with a specific focus on AI based segmentation and treatment planning, using modified PROBAST and TRIPOD checklists, in order to provide recommendations for future guideline developers and reviewers. MATERIALS AND METHODS The TRIPOD and PROBAST checklist items were discussed and modified using a Delphi process. After consensus was reached, 2 groups of 3 co-authors scored 2 articles to evaluate usability and further optimize the adapted checklists. Finally, 10 articles were scored by all co-authors. Fleiss' kappa was calculated to assess the reliability of agreement between observers. RESULTS Three of the 37 TRIPOD items and 5 of the 32 PROBAST items were deemed irrelevant. General terminology in the items (e.g., multivariable prediction model, predictors) was modified to align with AI-specific terms. After the first scoring round, further improvements of the items were formulated, e.g., by preventing the use of sub-questions or subjective words and adding clarifications on how to score an item. Using the final consensus list to score the 10 articles, only 2 out of the 61 items resulted in a statistically significant kappa of 0.4 or more demonstrating substantial agreement. For 41 items no statistically significant kappa was obtained indicating that the level of agreement among multiple observers is due to chance alone. CONCLUSION Our study showed low reliability scores with the adapted TRIPOD and PROBAST checklists. Although such checklists have shown great value during development and reporting, this raises concerns about the applicability of such checklists to objectively score scientific articles for AI applications. When developing or revising guidelines, it is essential to consider their applicability to score articles without introducing bias.
Collapse
Affiliation(s)
- Coen Hurkmans
- Dept. of Radiation Oncology, Catharina Hospital Eindhoven, the Netherlands; Dept. of Electrical Engineering, Technical University Eindhoven, the Netherlands.
| | - Jean-Emmanuel Bibault
- Dept. of Radiation Oncology, Hôpital Européen Georges Pompidou, Université Paris Cité, Paris, France
| | - Enrico Clementel
- European Organisation for the Research and Treatment of Cancer (EORTC), Brussels, Belgium
| | - Jennifer Dhont
- Université libre de Bruxelles (ULB), Hôpital Universitaire de Bruxelles (H.U.B), Institut Jules Bordet, Department of Medical Physics, Brussels, Belgium; Université Libre De Bruxelles (ULB), Radiophysics and MRI Physics Laboratory, Brussels, Belgium
| | - Wouter van Elmpt
- Department of Radiation Oncology (MAASTRO), GROW - School for Oncology and Reproduction, Maastricht University Medical Center+, Maastricht, the Netherlands
| | - Georgios Kantidakis
- European Organisation for the Research and Treatment of Cancer (EORTC), Brussels, Belgium
| | - Nicolaus Andratschke
- Dept. of Radiation Oncology, University Hospital of Zurich, The University of Zurich, Zurich, Switzerland
| |
Collapse
|
2
|
Irannejad M, Abedi I, Lonbani VD, Hassanvand M. Deep-neural network approaches for predicting 3D dose distribution in intensity-modulated radiotherapy of the brain tumors. J Appl Clin Med Phys 2024; 25:e14197. [PMID: 37933891 PMCID: PMC10962483 DOI: 10.1002/acm2.14197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 09/24/2023] [Accepted: 10/23/2023] [Indexed: 11/08/2023] Open
Abstract
PURPOSE The aim of this study is to reduce treatment planning time by predicting the intensity-modulated radiotherapy 3D dose distribution using deep learning for brain cancer patients. "For this purpose, two different approaches in dose prediction, i.e., first only planning target volume (PTV) and second PTV with organs at risk (OARs) as input of the U-net model, are employed and their results are compared." METHODS AND MATERIALS The data of 99 patients with glioma tumors referred for IMRT treatment were used so that the images of 90 patients were regarded as training datasets and the others were for the test. All patients were manually planned and treated with sixth-field IMRT; the photon energy was 6MV. The treatment plans were done with the Collapsed Cone Convolution algorithm to deliver 60 Gy in 30 fractions. RESULTS The obtained accuracy and similarity for the proposed methods in dose prediction when compared to the clinical dose distributions on test patients according to MSE, dice metric and SSIM for the Only-PTV and PTV-OARs methods are on average (0.05, 0.851, 0.83) and (0.056, 0.842, 0.82) respectively. Also, dose prediction is done in an extremely short time. CONCLUSION The same results of the two proposed methods prove that the presence of OARs in addition to PTV does not provide new knowledge to the network and only by defining the PTV and its location in the imaging slices, does the dose distribution become predictable. Therefore, the Only-PTV method by eliminating the process of introducing OARs can reduce the overall designing time of treatment by IMRT in patients with glioma tumors.
Collapse
Affiliation(s)
- Maziar Irannejad
- Department of Electrical Engineering, Najafabad BranchIslamic Azad UniversityNajafabadIran
| | - Iraj Abedi
- Medical Physics Department, School of MedicineIsfahan University of Medical SciencesIsfahanIran
| | | | | |
Collapse
|
3
|
Tatsugami F, Nakaura T, Yanagawa M, Fujita S, Kamagata K, Ito R, Kawamura M, Fushimi Y, Ueda D, Matsui Y, Yamada A, Fujima N, Fujioka T, Nozaki T, Tsuboyama T, Hirata K, Naganawa S. Recent advances in artificial intelligence for cardiac CT: Enhancing diagnosis and prognosis prediction. Diagn Interv Imaging 2023; 104:521-528. [PMID: 37407346 DOI: 10.1016/j.diii.2023.06.011] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 06/20/2023] [Indexed: 07/07/2023]
Abstract
Recent advances in artificial intelligence (AI) for cardiac computed tomography (CT) have shown great potential in enhancing diagnosis and prognosis prediction in patients with cardiovascular disease. Deep learning, a type of machine learning, has revolutionized radiology by enabling automatic feature extraction and learning from large datasets, particularly in image-based applications. Thus, AI-driven techniques have enabled a faster analysis of cardiac CT examinations than when they are analyzed by humans, while maintaining reproducibility. However, further research and validation are required to fully assess the diagnostic performance, radiation dose-reduction capabilities, and clinical correctness of these AI-driven techniques in cardiac CT. This review article presents recent advances of AI in the field of cardiac CT, including deep-learning-based image reconstruction, coronary artery motion correction, automatic calcium scoring, automatic epicardial fat measurement, coronary artery stenosis diagnosis, fractional flow reserve prediction, and prognosis prediction, analyzes current limitations of these techniques and discusses future challenges.
Collapse
Affiliation(s)
- Fuminari Tatsugami
- Department of Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan.
| | - Takeshi Nakaura
- Department of Diagnostic Radiology, Kumamoto University Graduate School of Medicine, 1-1-1 Honjo Chuo-ku, Kumamoto, 860-8556, Japan
| | - Masahiro Yanagawa
- Department of Radiology, Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita City, Osaka, 565-0871, Japan
| | - Shohei Fujita
- Departmen of Radiology, Graduate School of Medicine and Faculty of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Koji Kamagata
- Department of Radiology, Juntendo University Graduate School of Medicine, Bunkyo-ku, Tokyo 113-8421, Japan
| | - Rintaro Ito
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| | - Mariko Kawamura
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| | - Yasutaka Fushimi
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Shogoin Kawaharacho, Sakyoku, Kyoto, 606-8507, Japan
| | - Daiju Ueda
- Department of Diagnostic and Interventional Radiology, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3 Asahi-machi, Abeno-ku, Osaka, 545-8585, Japan
| | - Yusuke Matsui
- Department of Radiology, Faculty of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, 2-5-1 Shikata-cho, Kita-ku, Okayama, 700-8558, Japan
| | - Akira Yamada
- Department of Radiology, Shinshu University School of Medicine, 3-1-1 Asahi, Matsumoto, Nagano, 390-8621, Japan
| | - Noriyuki Fujima
- Department of Diagnostic and Interventional Radiology, Hokkaido University Hospital N15, W5, Kita-Ku, Sapporo 060-8638, Japan
| | - Tomoyuki Fujioka
- Department of Diagnostic Radiology, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Taiki Nozaki
- Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-0016, Japan
| | - Takahiro Tsuboyama
- Department of Radiology, Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita City, Osaka, 565-0871, Japan
| | - Kenji Hirata
- Department of Diagnostic Imaging, Graduate School of Medicine, Hokkaido University, Kita 15 Nishi 7, Kita-Ku, Sapporo, Hokkaido, 060-8648, Japan
| | - Shinji Naganawa
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| |
Collapse
|
4
|
Huang K, Hernandez S, Wang C, Nguyen C, Briere TM, Cardenas C, Court L, Xiao Y. Automated field-in-field whole brain radiotherapy planning. J Appl Clin Med Phys 2022; 24:e13819. [PMID: 36354957 PMCID: PMC9924111 DOI: 10.1002/acm2.13819] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Revised: 10/03/2022] [Accepted: 10/11/2022] [Indexed: 11/12/2022] Open
Abstract
PURPOSE We developed and tested an automatic field-in-field (FIF) solution for whole-brain radiotherapy (WBRT) planning that creates a homogeneous dose distribution by minimizing hotspots, resulting in clinically acceptable plans. METHODS A configurable auto-planning algorithm was developed to automatically generate FIF WBRT plans independent of the treatment planning system. Configurable parameters include the definition of hotspots, target volume, maximum number of subfields, and minimum number of monitor units per field. This algorithm iteratively identifies a hotspot, creates two opposing subfields, calculates the dose, and optimizes the beam weight based on user-configured constraints of dose-volume histogram coverage and least-squared cost functions. The algorithm was retrospectively tested on 17 whole-brain patients. First, an in-house landmark-based automated beam aperture technique was used to generate the treatment fields and initial plans. Second, the FIF algorithm was employed to optimize the plans using physician-defined goals of 99.9% of the brain volume receiving 100% of the prescription dose (30 Gy in 10 fractions) and a target hotspot definition of 107% of the prescription dose. The final auto-optimized plans were assessed for clinical acceptability by an experienced radiation oncologist using a five-point scale. RESULTS The FIF algorithm reduced the mean (± SD) plan hotspot percentage dose from 35.0 Gy (116.6%) ± 0.6 Gy (2.0%) to 32.6 Gy (108.8%) ± 0.4 Gy (1.2%). Also, it decreased the mean (± SD) hotspot V107% [cm3 ] from 959 ± 498 cm3 to 145 ± 224 cm3 . On average, plans were produced in 16 min without any user intervention. Furthermore, 76.5% of the auto-plans were clinically acceptable (needing no or minor stylistic edits), and all of them were clinically acceptable after minor clinically necessary edits. CONCLUSIONS This algorithm successfully produced high-quality WBRT plans and can improve treatment planning efficiency when incorporated into an automatic planning workflow.
Collapse
Affiliation(s)
- Kai Huang
- The University of Texas MD Anderson Cancer Center UTHealth Graduate School of Biomedical SciencesHoustonTexasUSA,Department of Radiation PhysicsThe University of Texas MD Anderson Cancer CenterHoustonTexasUSA
| | - Soleil Hernandez
- The University of Texas MD Anderson Cancer Center UTHealth Graduate School of Biomedical SciencesHoustonTexasUSA,Department of Radiation PhysicsThe University of Texas MD Anderson Cancer CenterHoustonTexasUSA
| | - Chenyang Wang
- Department of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTexasUSA
| | - Callistus Nguyen
- Department of Radiation PhysicsThe University of Texas MD Anderson Cancer CenterHoustonTexasUSA
| | - Tina Marie Briere
- Department of Radiation PhysicsThe University of Texas MD Anderson Cancer CenterHoustonTexasUSA
| | - Carlos Cardenas
- Department of Radiation OncologyThe University of Alabama at BirminghamBirminghamAlabamaUSA
| | - Laurence Court
- Department of Radiation PhysicsThe University of Texas MD Anderson Cancer CenterHoustonTexasUSA
| | - Yao Xiao
- Department of Radiation PhysicsThe University of Texas MD Anderson Cancer CenterHoustonTexasUSA
| |
Collapse
|
5
|
A Survey on Deep Learning for Precision Oncology. Diagnostics (Basel) 2022; 12:diagnostics12061489. [PMID: 35741298 PMCID: PMC9222056 DOI: 10.3390/diagnostics12061489] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 06/14/2022] [Accepted: 06/14/2022] [Indexed: 12/27/2022] Open
Abstract
Precision oncology, which ensures optimized cancer treatment tailored to the unique biology of a patient’s disease, has rapidly developed and is of great clinical importance. Deep learning has become the main method for precision oncology. This paper summarizes the recent deep-learning approaches relevant to precision oncology and reviews over 150 articles within the last six years. First, we survey the deep-learning approaches categorized by various precision oncology tasks, including the estimation of dose distribution for treatment planning, survival analysis and risk estimation after treatment, prediction of treatment response, and patient selection for treatment planning. Secondly, we provide an overview of the studies per anatomical area, including the brain, bladder, breast, bone, cervix, esophagus, gastric, head and neck, kidneys, liver, lung, pancreas, pelvis, prostate, and rectum. Finally, we highlight the challenges and discuss potential solutions for future research directions.
Collapse
|
6
|
Pokharel S, Pacheco A, Tanner S. Assessment of efficacy in automated plan generation for Varian Ethos intelligent optimization engine. J Appl Clin Med Phys 2022; 23:e13539. [PMID: 35084090 PMCID: PMC8992949 DOI: 10.1002/acm2.13539] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Revised: 12/29/2021] [Accepted: 01/09/2022] [Indexed: 11/19/2022] Open
Abstract
Varian Ethos, a new treatment platform, is capable of automatically generating treatment plans for initial planning and for online, adaptive planning, using an intelligent optimization engine (IOE). The primary purpose of this study is to assess the efficacy of Varian Ethos IOE for auto‐planning and intercompare different treatment modalities within the Ethos treatment planning system (TPS). A total of 36 retrospective prostate and proximal seminal vesicles cases were selected for this study. The prescription dose was 50.4 Gy in 28 fractions to the proximal seminal vesicles, with a simultaneous integrated boost of 70 Gy to the prostate gland. Based on RT intent, three treatment plans were auto‐generated in the Ethos TPS and were exported to the Eclipse TPS for intercomparison with the Eclipse treatment plan. When normalized for the same planning target volume (PTV) coverage, Ethos plans Dmax% were 108.1 ± 1.2%, 108.4 ± 1.6%, and 109.6 ± 2.0%, for the 9‐field IMRT, 12‐field IMRT, and 2‐full arc VMAT plans, respectively. This compared well with Eclipse plan Dmax% values, which was 108.8 ± 1.4%. OAR indices were also evaluated for Ethos plans using Radiation Therapy Oncology Group report 0415 as a guide and were found to be comparable to each other and the Eclipse plans. While all Ethos plans were comparable, we found that, in general, the Ethos 12‐field IMRT plans met most of the dosimetric goals for treatment. Also, Ethos IOE consistently generated dosimetrically hotter VMAT plans versus IMRT plans. On average, Ethos TPS took 13 min to generate 2‐full arc VMAT plans, compared to 5 min for 12‐field IMRT plans. Varian Ethos TPS can generate multiple treatment plans in an efficient time frame and the quality of the plans could be deemed clinically acceptable when compared to manually generated treatment plans.
Collapse
Affiliation(s)
- Shyam Pokharel
- Department of Radiation Oncology, GenesisCare, Naples, Florida, USA.,Department of Radiation Oncology, Boca Raton Regional Hospital, Baptist Health South Florida, Lynn Cancer Institute, Boca Raton, Florida, USA
| | - Abilio Pacheco
- Department of Radiation Oncology, GenesisCare, Naples, Florida, USA
| | - Suzanne Tanner
- Department of Radiation Oncology, GenesisCare, Naples, Florida, USA
| |
Collapse
|