1
|
Church C, Yap M, Bessrour M, Lamey M, Granville D. Automated plan generation for prostate radiotherapy patients using deep learning and scripted optimization. Phys Imaging Radiat Oncol 2024; 32:100641. [PMID: 39310221 PMCID: PMC11415801 DOI: 10.1016/j.phro.2024.100641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Revised: 08/30/2024] [Accepted: 09/04/2024] [Indexed: 09/25/2024] Open
Abstract
Background and Purpose Treatment planning is a time-intensive task that could be automated. We aimed to develop a "single-click" workflow, fully deployed within a commercial treatment planning system (TPS), for autoplanning prostate radiotherapy treatment plans using predictions from a deep learning model (DLM). Materials and Methods Automatically generated treatment plans were created with a single script, executed from within a commercial TPS scripting environment, that performed two stages sequentially. Initially, a 3D dose distribution was predicted with a ResUNet DLM. The DLM was trained and validated using previously treated datasets (n = 120) which used 3D contours as inputs. Following this, dose predictions were converted into treatment plans by extracting dose-volume metrics from the predictions to use as objectives for the inverse optimizer within the TPS. An independent test dataset (n = 20) was used to evaluate the similarity between automated and clinical plans. Results For planning target volumes, the median percentage difference and interquartile range between the automatically generated plans and clinical plans were 0.4% [0.2-1.1%] for the V100%, -0.5% [(-1.0)-(-0.2)%] for D99% and -0.5% [(-1.0)-(-0.2)%] for D95%. Bladder and rectum volume-at-dose objectives agreed within -6.1% [(-12.5)-0.9%]. The conversion of the DLM prediction into a treatment plan took 15 min [13-16 min]. Conclusions An automatic plan generation workflow that uses a DL model with scripted optimization was fully deployed in a commercial TPS. Autoplans were compared to previously treated clinical plans and were found to be non-inferior.
Collapse
Affiliation(s)
- Cody Church
- Department of Medical Physics, The Ottawa Hospital General Campus, Canada
| | - Michelle Yap
- Department of Medical Physics, The Ottawa Hospital General Campus, Canada
| | - Mohamed Bessrour
- Department of Medical Physics, The Ottawa Hospital General Campus, Canada
| | - Michael Lamey
- Department of Medical Physics, The Ottawa Hospital General Campus, Canada
| | - Dal Granville
- Department of Radiation Oncology and Department of Physics and Atmospheric Science, Dalhousie University, Canada
| |
Collapse
|
2
|
Moore LC, Nematollahi F, Li L, Meyers SM, Kisling K. Improving 3D dose prediction for breast radiotherapy using novel glowing masks and gradient-weighted loss functions. Med Phys 2024; 51:7453-7463. [PMID: 39088756 PMCID: PMC11479821 DOI: 10.1002/mp.17326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Revised: 06/17/2024] [Accepted: 07/08/2024] [Indexed: 08/03/2024] Open
Abstract
BACKGROUND The quality of treatment plans for breast cancer can vary greatly. This variation could be reduced by using dose prediction to automate treatment planning. Our work investigates novel methods for training deep-learning models that are capable of producing high-quality dose predictions for breast cancer treatment planning. PURPOSE The goal of this work was to compare the performance impact of two novel techniques for deep learning dose prediction models for tangent field treatments for breast cancer. The first technique, a "glowing" mask algorithm, encodes the distance from a contour into each voxel in a mask. The second, a gradient-weighted mean squared error (MSE) loss function, emphasizes the error in high-dose gradient regions in the predicted image. METHODS Four 3D U-Net deep learning models were trained using the planning CT and contours of the heart, lung, and tumor bed as inputs. The dataset consisted of 305 treatment plans split into 213/46/46 training/validation/test sets using a 70/15/15% split. We compared the impact of novel "glowing" anatomical mask inputs and a novel gradient-weighted MSE loss function to their standard counterparts, binary anatomical masks, and MSE loss, using an ablation study methodology. To assess performance, we examined the mean error and mean absolute error (ME/MAE) in dose across all within-body voxels, the error in mean dose to heart, ipsilateral lung, and tumor bed, dice similarity coefficient (DSC) across isodose volumes defined by 0%-100% prescribed dose thresholds, and gamma analysis (3%/3 mm). RESULTS The combination of novel glowing masks and gradient weighted loss function yielded the best-performing model in this study. This model resulted in a mean ME of 0.40%, MAE of 2.70%, an error in mean dose to heart and lung of -0.10 and 0.01 Gy, and an error in mean dose to the tumor bed of -0.01%. The median DSC at 50/95/100% isodose levels were 0.91/0.87/0.82. The mean 3D gamma pass rate (3%/3 mm) was 93%. CONCLUSIONS This study found the combination of novel anatomical mask inputs and loss function for dose prediction resulted in superior performance to their standard counterparts. These results have important implications for the field of radiotherapy dose prediction, as the methods used here can be easily incorporated into many other dose prediction models for other treatment sites. Additionally, this dose prediction model for breast radiotherapy has sufficient performance to be used in an automated planning pipeline for tangent field radiotherapy and has the major benefit of not requiring a PTV for accurate dose prediction.
Collapse
Affiliation(s)
- Lance C Moore
- Radiation Medicine and Applied Sciences, University of California, La Jolla, San Diego, California, USA
| | - Fatemeh Nematollahi
- Radiation Medicine and Applied Sciences, University of California, La Jolla, San Diego, California, USA
| | - Lingyi Li
- Radiation Medicine and Applied Sciences, University of California, La Jolla, San Diego, California, USA
| | - Sandra M Meyers
- Radiation Medicine and Applied Sciences, University of California, La Jolla, San Diego, California, USA
| | - Kelly Kisling
- Radiation Medicine and Applied Sciences, University of California, La Jolla, San Diego, California, USA
| |
Collapse
|
3
|
Zahra MA, Al-Taher A, Alquhaidan M, Hussain T, Ismail I, Raya I, Kandeel M. The synergy of artificial intelligence and personalized medicine for the enhanced diagnosis, treatment, and prevention of disease. Drug Metab Pers Ther 2024; 39:47-58. [PMID: 38997240 DOI: 10.1515/dmpt-2024-0003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Accepted: 06/17/2024] [Indexed: 07/14/2024]
Abstract
INTRODUCTION The completion of the Human Genome Project in 2003 marked the beginning of a transformative era in medicine. This milestone laid the foundation for personalized medicine, an innovative approach that customizes healthcare treatments. CONTENT Central to the advancement of personalized medicine is the understanding of genetic variations and their impact on drug responses. The integration of artificial intelligence (AI) into drug response trials has been pivotal in this domain. These technologies excel in handling large-scale genomic datasets and patient histories, significantly improving diagnostic accuracy, disease prediction and drug discovery. They are particularly effective in addressing complex diseases such as cancer and genetic disorders. Furthermore, the advent of wearable technology, when combined with AI, propels personalized medicine forward by offering real-time health monitoring, which is crucial for early disease detection and management. SUMMARY The integration of AI into personalized medicine represents a significant advancement in healthcare, promising more accurate diagnoses, effective treatment plans and innovative drug discoveries. OUTLOOK As technology continues to evolve, the role of AI in enhancing personalized medicine and transforming the healthcare landscape is expected to grow exponentially. This synergy between AI and healthcare holds great promise for the future, potentially revolutionizing the way healthcare is delivered and experienced.
Collapse
Affiliation(s)
- Mohammad Abu Zahra
- Department of Biomolecular Sciences, College of Veterinary Medicine, 114800 King Faisal University , Al-Hofuf, Al-Ahsa, Saudi Arabia
| | - Abdulla Al-Taher
- Department of Biomolecular Sciences, College of Veterinary Medicine, 114800 King Faisal University , Al-Hofuf, Al-Ahsa, Saudi Arabia
| | - Mohamed Alquhaidan
- Department of Biomolecular Sciences, College of Veterinary Medicine, 114800 King Faisal University , Al-Hofuf, Al-Ahsa, Saudi Arabia
| | - Tarique Hussain
- Animal Sciences Division, Nuclear Institute for Agriculture and Biology (NIAB), Faisalabad, Pakistan
| | - Izzeldin Ismail
- Department of Biomolecular Sciences, College of Veterinary Medicine, 114800 King Faisal University , Al-Hofuf, Al-Ahsa, Saudi Arabia
| | - Indah Raya
- Department of Chemistry, Faculty of Mathematics, and Natural Science, Hasanuddin University, Makassar, Indonesia
| | - Mahmoud Kandeel
- Department of Biomolecular Sciences, College of Veterinary Medicine, 114800 King Faisal University , Al-Hofuf, Al-Ahsa, Saudi Arabia
- Department of Pharmacology, Faculty of Veterinary Medicine, Kafrelshikh University, Kafrelshikh, Egypt
| |
Collapse
|
4
|
Hurkmans C, Bibault JE, Clementel E, Dhont J, van Elmpt W, Kantidakis G, Andratschke N. Assessment of bias in scoring of AI-based radiotherapy segmentation and planning studies using modified TRIPOD and PROBAST guidelines as an example. Radiother Oncol 2024; 194:110196. [PMID: 38432311 DOI: 10.1016/j.radonc.2024.110196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 01/29/2024] [Accepted: 02/26/2024] [Indexed: 03/05/2024]
Abstract
BACKGROUND AND PURPOSE Studies investigating the application of Artificial Intelligence (AI) in the field of radiotherapy exhibit substantial variations in terms of quality. The goal of this study was to assess the amount of transparency and bias in scoring articles with a specific focus on AI based segmentation and treatment planning, using modified PROBAST and TRIPOD checklists, in order to provide recommendations for future guideline developers and reviewers. MATERIALS AND METHODS The TRIPOD and PROBAST checklist items were discussed and modified using a Delphi process. After consensus was reached, 2 groups of 3 co-authors scored 2 articles to evaluate usability and further optimize the adapted checklists. Finally, 10 articles were scored by all co-authors. Fleiss' kappa was calculated to assess the reliability of agreement between observers. RESULTS Three of the 37 TRIPOD items and 5 of the 32 PROBAST items were deemed irrelevant. General terminology in the items (e.g., multivariable prediction model, predictors) was modified to align with AI-specific terms. After the first scoring round, further improvements of the items were formulated, e.g., by preventing the use of sub-questions or subjective words and adding clarifications on how to score an item. Using the final consensus list to score the 10 articles, only 2 out of the 61 items resulted in a statistically significant kappa of 0.4 or more demonstrating substantial agreement. For 41 items no statistically significant kappa was obtained indicating that the level of agreement among multiple observers is due to chance alone. CONCLUSION Our study showed low reliability scores with the adapted TRIPOD and PROBAST checklists. Although such checklists have shown great value during development and reporting, this raises concerns about the applicability of such checklists to objectively score scientific articles for AI applications. When developing or revising guidelines, it is essential to consider their applicability to score articles without introducing bias.
Collapse
Affiliation(s)
- Coen Hurkmans
- Dept. of Radiation Oncology, Catharina Hospital Eindhoven, the Netherlands; Dept. of Electrical Engineering, Technical University Eindhoven, the Netherlands.
| | - Jean-Emmanuel Bibault
- Dept. of Radiation Oncology, Hôpital Européen Georges Pompidou, Université Paris Cité, Paris, France
| | - Enrico Clementel
- European Organisation for the Research and Treatment of Cancer (EORTC), Brussels, Belgium
| | - Jennifer Dhont
- Université libre de Bruxelles (ULB), Hôpital Universitaire de Bruxelles (H.U.B), Institut Jules Bordet, Department of Medical Physics, Brussels, Belgium; Université Libre De Bruxelles (ULB), Radiophysics and MRI Physics Laboratory, Brussels, Belgium
| | - Wouter van Elmpt
- Department of Radiation Oncology (MAASTRO), GROW - School for Oncology and Reproduction, Maastricht University Medical Center+, Maastricht, the Netherlands
| | - Georgios Kantidakis
- European Organisation for the Research and Treatment of Cancer (EORTC), Brussels, Belgium
| | - Nicolaus Andratschke
- Dept. of Radiation Oncology, University Hospital of Zurich, The University of Zurich, Zurich, Switzerland
| |
Collapse
|
5
|
Witte M, Sonke JJ. A deep learning based dynamic arc radiotherapy photon dose engine trained on Monte Carlo dose distributions. Phys Imaging Radiat Oncol 2024; 30:100575. [PMID: 38644934 PMCID: PMC11031817 DOI: 10.1016/j.phro.2024.100575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 04/03/2024] [Accepted: 04/03/2024] [Indexed: 04/23/2024] Open
Abstract
Background and purpose Despite hardware acceleration, state-of-the-art Monte Carlo (MC) dose engines require considerable computation time to reduce stochastic noise. We developed a deep learning (DL) based dose engine reaching high accuracy at strongly reduced computation times. Materials and methods Radiotherapy treatment plans and computed tomography scans were collected for 350 treatments in a variety of tumor sites. Dose distributions were computed using a MC dose engine for ∼ 30,000 separate segments at 6 MV and 10 MV beam energies, both flattened and flattening filter free. For dynamic arcs these explicitly incorporated the leaf, jaw and gantry motions during dose delivery. A neural network was developed, combining two-dimensional convolution and recurrence using 64 hidden channels. Parameters were trained to minimize the mean squared log error loss between the MC computed dose and the model output. Full dose distributions were reconstructed for 100 additional treatment plans. Gamma analyses were performed to assess accuracy. Results DL dose evaluation was on average 82 times faster than MC computation at a 1 % accuracy setting. In voxels receiving at least 10 % of the maximum dose the overall global gamma pass rate using a 2 % and 2 mm criterion was 99.6 %, while mean local gamma values were accurate within 2 %. In the high dose region over 50 % of maximum the mean local gamma approached a 1 % accuracy. Conclusions A DL based dose engine was implemented, able to accurately reproduce MC computed dynamic arc radiotherapy dose distributions at high speed.
Collapse
Affiliation(s)
- Marnix Witte
- Department of Radiation Oncology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Jan-Jakob Sonke
- Department of Radiation Oncology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| |
Collapse
|
6
|
Buatti JS, Kirby N, Stathakis S, Li R, Sivabhaskar S, de Oliveira M, Duke K, Kabat CN, Papanikolaou N, Paragios N. Standardizing and improving dose predictions for head and neck cancers using complete sets of OAR contours. Med Phys 2024; 51:898-909. [PMID: 38127972 DOI: 10.1002/mp.16898] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 11/04/2023] [Accepted: 12/01/2023] [Indexed: 12/23/2023] Open
Abstract
BACKGROUND Radiotherapy dose predictions have been trained with data from previously treated patients of similar sites and prescriptions. However, clinical datasets are often inconsistent and do not contain the same number of organ at risk (OAR) structures. The effects of missing contour data in deep learning-based dose prediction models have not been studied. PURPOSE The purpose of this study was to investigate the impacts of incomplete contour sets in the context of deep learning-based radiotherapy dose prediction models trained with clinical datasets and to introduce a novel data substitution method that utilizes automated contours for undefined structures. METHODS We trained Standard U-Nets and Cascade U-Nets to predict the volumetric dose distributions of patients with head and neck cancers (HNC) using three input variations to evaluate the effects of missing contours, as well as a novel data substitution method. Each architecture was trained with the original contour (OC) inputs, which included missing information, hybrid contour (HC) inputs, where automated OAR contours generated in software were substituted for missing contour data, and automated contour (AC) inputs containing only automated OAR contours. 120 HNC treatments were used for model training, 30 were used for validation and tuning, and 44 were used for evaluation and testing. Model performance and accuracy were evaluated with global whole body dose agreement, PTV coverage accuracy, and OAR dose agreement. The differences in these values between dataset variations were used to determine the effects of missing data and automated contour substitutions. RESULTS Automated contours used as substitutions for missing data were found to improve dose prediction accuracy in the Standard U-Net and Cascade U-Net, with a statistically significant difference in some global metrics and/or OAR metrics. For both models, PTV coverage between input variations was unaffected by the substitution technique. Automated contours in HC and AC datasets improved mean dose accuracy for some OAR contours, including the mandible and brainstem, with a greater improvement seen with HC datasets. Global dose metrics, including mean absolute error, mean error, and percent error were different for the Standard U-Net but not for the Cascade U-Net. CONCLUSION Automated contours used as a substitution for contour data improved prediction accuracy for some but not all dose prediction metrics. Compared to the Standard U-Net models, the Cascade U-Net achieved greater precision.
Collapse
Affiliation(s)
- Jacob S Buatti
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Neil Kirby
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Sotirios Stathakis
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Ruiqi Li
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Sruthi Sivabhaskar
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Michelle de Oliveira
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Kristen Duke
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Christopher N Kabat
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | - Niko Papanikolaou
- Department of Radiation Oncology, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA
| | | |
Collapse
|
7
|
Kehayias CE, Yan Y, Bontempi D, Quirk S, Bitterman DS, Bredfeldt JS, Aerts HJWL, Mak RH, Guthier CV. Prospective deployment of an automated implementation solution for artificial intelligence translation to clinical radiation oncology. Front Oncol 2024; 13:1305511. [PMID: 38239639 PMCID: PMC10794768 DOI: 10.3389/fonc.2023.1305511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Accepted: 12/11/2023] [Indexed: 01/22/2024] Open
Abstract
Introduction Artificial intelligence (AI)-based technologies embody countless solutions in radiation oncology, yet translation of AI-assisted software tools to actual clinical environments remains unrealized. We present the Deep Learning On-Demand Assistant (DL-ODA), a fully automated, end-to-end clinical platform that enables AI interventions for any disease site featuring an automated model-training pipeline, auto-segmentations, and QA reporting. Materials and methods We developed, tested, and prospectively deployed the DL-ODA system at a large university affiliated hospital center. Medical professionals activate the DL-ODA via two pathways (1): On-Demand, used for immediate AI decision support for a patient-specific treatment plan, and (2) Ambient, in which QA is provided for all daily radiotherapy (RT) plans by comparing DL segmentations with manual delineations and calculating the dosimetric impact. To demonstrate the implementation of a new anatomy segmentation, we used the model-training pipeline to generate a breast segmentation model based on a large clinical dataset. Additionally, the contour QA functionality of existing models was assessed using a retrospective cohort of 3,399 lung and 885 spine RT cases. Ambient QA was performed for various disease sites including spine RT and heart for dosimetric sparing. Results Successful training of the breast model was completed in less than a day and resulted in clinically viable whole breast contours. For the retrospective analysis, we evaluated manual-versus-AI similarity for the ten most common structures. The DL-ODA detected high similarities in heart, lung, liver, and kidney delineations but lower for esophagus, trachea, stomach, and small bowel due largely to incomplete manual contouring. The deployed Ambient QAs for heart and spine sites have prospectively processed over 2,500 cases and 230 cases over 9 months and 5 months, respectively, automatically alerting the RT personnel. Discussion The DL-ODA capabilities in providing universal AI interventions were demonstrated for On-Demand contour QA, DL segmentations, and automated model training, and confirmed successful integration of the system into a large academic radiotherapy department. The novelty of deploying the DL-ODA as a multi-modal, fully automated end-to-end AI clinical implementation solution marks a significant step towards a generalizable framework that leverages AI to improve the efficiency and reliability of RT systems.
Collapse
Affiliation(s)
- Christopher E. Kehayias
- Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
| | - Yujie Yan
- Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
| | - Dennis Bontempi
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
- Radiology and Nuclear Medicine, CARIM & GROW, Maastricht University, Maastricht, Netherlands
| | - Sarah Quirk
- Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
| | - Danielle S. Bitterman
- Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
| | - Jeremy S. Bredfeldt
- Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
| | - Hugo J. W. L. Aerts
- Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
- Radiology and Nuclear Medicine, CARIM & GROW, Maastricht University, Maastricht, Netherlands
| | - Raymond H. Mak
- Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
| | - Christian V. Guthier
- Department of Radiation Oncology, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
8
|
Pinto-Coelho L. How Artificial Intelligence Is Shaping Medical Imaging Technology: A Survey of Innovations and Applications. Bioengineering (Basel) 2023; 10:1435. [PMID: 38136026 PMCID: PMC10740686 DOI: 10.3390/bioengineering10121435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Revised: 12/12/2023] [Accepted: 12/15/2023] [Indexed: 12/24/2023] Open
Abstract
The integration of artificial intelligence (AI) into medical imaging has guided in an era of transformation in healthcare. This literature review explores the latest innovations and applications of AI in the field, highlighting its profound impact on medical diagnosis and patient care. The innovation segment explores cutting-edge developments in AI, such as deep learning algorithms, convolutional neural networks, and generative adversarial networks, which have significantly improved the accuracy and efficiency of medical image analysis. These innovations have enabled rapid and accurate detection of abnormalities, from identifying tumors during radiological examinations to detecting early signs of eye disease in retinal images. The article also highlights various applications of AI in medical imaging, including radiology, pathology, cardiology, and more. AI-based diagnostic tools not only speed up the interpretation of complex images but also improve early detection of disease, ultimately delivering better outcomes for patients. Additionally, AI-based image processing facilitates personalized treatment plans, thereby optimizing healthcare delivery. This literature review highlights the paradigm shift that AI has brought to medical imaging, highlighting its role in revolutionizing diagnosis and patient care. By combining cutting-edge AI techniques and their practical applications, it is clear that AI will continue shaping the future of healthcare in profound and positive ways.
Collapse
Affiliation(s)
- Luís Pinto-Coelho
- ISEP—School of Engineering, Polytechnic Institute of Porto, 4200-465 Porto, Portugal;
- INESCTEC, Campus of the Engineering Faculty of the University of Porto, 4200-465 Porto, Portugal
| |
Collapse
|
9
|
Yan S, Li J, Wu W. Artificial intelligence in breast cancer: application and future perspectives. J Cancer Res Clin Oncol 2023; 149:16179-16190. [PMID: 37656245 DOI: 10.1007/s00432-023-05337-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 08/24/2023] [Indexed: 09/02/2023]
Abstract
Breast cancer is one of the most common cancers and is one of the leading causes of cancer-related deaths in women worldwide. Early diagnosis and treatment are the key for a favorable prognosis. The application of artificial intelligence technology in the medical field is increasingly extensive, including image analysis, automated diagnosis, intelligent pharmaceutical system, personalized treatment and so on. AI-based breast cancer imaging, pathology and adjuvant therapy technology cannot only reduce the workload of clinicians, but also continuously improve the accuracy and sensitivity of breast cancer diagnosis and treatment. This paper reviews the application of AI in breast cancer, as well as looks ahead and poses challenges to the future development of AI for breast cancer detection and therapeutic, so as to provide ideas for future research.
Collapse
Affiliation(s)
- Shuixin Yan
- The Affiliated Lihuili Hospital of Ningbo University, Ningbo, 315000, Zhejiang, China
| | - Jiadi Li
- The Affiliated Lihuili Hospital of Ningbo University, Ningbo, 315000, Zhejiang, China
| | - Weizhu Wu
- The Affiliated Lihuili Hospital of Ningbo University, Ningbo, 315000, Zhejiang, China.
| |
Collapse
|
10
|
Marrazzo L, Redapi L, Pellegrini R, Voet P, Meattini I, Arilli C, Calusi S, Casati M, Chilà D, Compagnucci A, Talamonti C, Zani M, Livi L, Pallotta S. Fully automated volumetric modulated arc therapy technique for radiation therapy of locally advanced breast cancer. Radiat Oncol 2023; 18:176. [PMID: 37904150 PMCID: PMC10617151 DOI: 10.1186/s13014-023-02364-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 10/17/2023] [Indexed: 11/01/2023] Open
Abstract
BACKGROUND This study aimed to evaluate an a-priori multicriteria plan optimization algorithm (mCycle) for locally advanced breast cancer radiation therapy (RT) by comparing automatically generated VMAT (Volumetric Modulated Arc Therapy) plans (AP-VMAT) with manual clinical Helical Tomotherapy (HT) plans. METHODS The study included 25 patients who received postoperative RT using HT. The patient cohort had diverse target selections, including both left and right breast/chest wall (CW) and III-IV node, with or without internal mammary node (IMN) and Simultaneous Integrated Boost (SIB). The Planning Target Volume (PTV) was obtained by applying a 5 mm isotropic expansion to the CTV (Clinical Target Volume), with a 5 mm clip from the skin. Comparisons of dosimetric parameters and delivery/planning times were conducted. Dosimetric verification of the AP-VMAT plans was performed. RESULTS The study showed statistically significant improvements in AP-VMAT plans compared to HT for OARs (Organs At Risk) mean dose, except for the heart and ipsilateral lung. No significant differences in V95% were observed for PTV breast/CW and PTV III-IV, while increased coverage (higher V95%) was seen for PTV IMN in AP-VMAT plans. HT plans exhibited smaller values of PTV V105% for breast/CW and III-IV, with no differences in PTV IMN and boost. HT had an average (± standard deviation) delivery time of (17 ± 8) minutes, while AP-VMAT took (3 ± 1) minutes. The average γ passing rate for AP-VMAT plans was 97%±1%. Planning times reduced from an average of 6 h for HT to about 2 min for AP-VMAT. CONCLUSIONS Comparing AP-VMAT plans with clinical HT plans showed similar or improved quality. The implementation of mCycle demonstrated successful automation of the planning process for VMAT treatment of locally advanced breast cancer, significantly reducing workload.
Collapse
Affiliation(s)
- Livia Marrazzo
- Department of Experimental and Clinical Biomedical Sciences "Mario Serio", University of Florence, Florence, Italy.
- Medical Physics Unit, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy.
| | - Laura Redapi
- Department of Experimental and Clinical Biomedical Sciences "Mario Serio", University of Florence, Florence, Italy
- Medical Physics Unit, Azienda USL Toscana Centro, Pistoia-Prato, Italy
| | - Roberto Pellegrini
- Medical Affairs & Research Clinical Liaison, Elekta AB, Stockholm, Sweden
| | - Peter Voet
- Medical Affairs & Research Clinical Liaison, Elekta AB, Stockholm, Sweden
| | - Icro Meattini
- Department of Experimental and Clinical Biomedical Sciences "Mario Serio", University of Florence, Florence, Italy
- Radiation Oncology Unit, Oncology Department, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy
| | - Chiara Arilli
- Medical Physics Unit, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy
| | - Silvia Calusi
- Medical Physics Unit, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy
| | - Marta Casati
- Medical Physics Unit, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy
| | - Deborah Chilà
- Department of Experimental and Clinical Biomedical Sciences "Mario Serio", University of Florence, Florence, Italy
| | | | - Cinzia Talamonti
- Department of Experimental and Clinical Biomedical Sciences "Mario Serio", University of Florence, Florence, Italy
- Medical Physics Unit, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy
| | - Margherita Zani
- Medical Physics Unit, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy
| | - Lorenzo Livi
- Department of Experimental and Clinical Biomedical Sciences "Mario Serio", University of Florence, Florence, Italy
- Radiation Oncology Unit, Oncology Department, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy
| | - Stefania Pallotta
- Department of Experimental and Clinical Biomedical Sciences "Mario Serio", University of Florence, Florence, Italy
- Medical Physics Unit, Azienda Ospedaliero-Universitaria Careggi, Florence, Italy
| |
Collapse
|
11
|
Zeverino M, Piccolo C, Wuethrich D, Jeanneret-Sozzi W, Marguet M, Bourhis J, Bochud F, Moeckli R. Clinical implementation of deep learning-based automated left breast simultaneous integrated boost radiotherapy treatment planning. Phys Imaging Radiat Oncol 2023; 28:100492. [PMID: 37780177 PMCID: PMC10534254 DOI: 10.1016/j.phro.2023.100492] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 09/15/2023] [Accepted: 09/15/2023] [Indexed: 10/03/2023] Open
Abstract
Background and purpose Automation in radiotherapy treatment planning aims to improve both the quality and the efficiency of the process. The aim of this study was to report on a clinical implementation of a Deep Learning (DL) auto-planning model for left-sided breast cancer. Materials and methods The DL model was developed for left-sided breast simultaneous integrated boost treatments under deep-inspiration breath-hold. Eighty manual dose distributions were revised and used for training. Ten patients were used for model validation. The model was then used to design 17 clinical auto-plans. Manual and auto-plans were scored on a list of clinical goals for both targets and organs-at-risk (OARs). For validation, predicted and mimicked dose (PD and MD, respectively) percent error (PE) was calculated with respect to manual dose. Clinical and validation cohorts were compared in terms of MD only. Results Median values of both PD and MD validation plans fulfilled the evaluation criteria. PE was < 1% for targets for both PD and MD. PD was well aligned to manual dose while MD left lung mean dose was significantly less (median:5.1 Gy vs 6.1 Gy). The left-anterior-descending artery maximum dose was found out of requirements (median values:+5.9 Gy and + 2.9 Gy, for PD and MD respectively) in three validation cases, while it was reduced for clinical cases (median:-1.9 Gy). No other clinically significant differences were observed between clinical and validation cohorts. Conclusion Small OAR differences observed during the model validation were not found clinically relevant. The clinical implementation outcomes confirmed the robustness of the model.
Collapse
Affiliation(s)
- Michele Zeverino
- Institute of Radiation Physics, Lausanne University Hospital and Lausanne University, Lausanne, Switzerland
| | - Consiglia Piccolo
- Institute of Radiation Physics, Lausanne University Hospital and Lausanne University, Lausanne, Switzerland
| | - Diana Wuethrich
- Institute of Radiation Physics, Lausanne University Hospital and Lausanne University, Lausanne, Switzerland
| | - Wendy Jeanneret-Sozzi
- Radiation Oncology Department, Lausanne University Hospital and Lausanne University, Lausanne, Switzerland
| | - Maud Marguet
- Institute of Radiation Physics, Lausanne University Hospital and Lausanne University, Lausanne, Switzerland
| | - Jean Bourhis
- Radiation Oncology Department, Lausanne University Hospital and Lausanne University, Lausanne, Switzerland
| | - Francois Bochud
- Institute of Radiation Physics, Lausanne University Hospital and Lausanne University, Lausanne, Switzerland
| | - Raphael Moeckli
- Institute of Radiation Physics, Lausanne University Hospital and Lausanne University, Lausanne, Switzerland
| |
Collapse
|
12
|
Bakx N, Rijkaart D, van der Sangen M, Theuws J, van der Toorn PP, Verrijssen AS, van der Leer J, Mutsaers J, van Nunen T, Reinders M, Schuengel I, Smits J, Hagelaar E, van Gruijthuijsen D, Bluemink H, Hurkmans C. Clinical evaluation of a deep learning segmentation model including manual adjustments afterwards for locally advanced breast cancer. Tech Innov Patient Support Radiat Oncol 2023; 26:100211. [PMID: 37229460 PMCID: PMC10205480 DOI: 10.1016/j.tipsro.2023.100211] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 04/23/2023] [Accepted: 05/09/2023] [Indexed: 05/27/2023] Open
Abstract
Introduction Deep learning (DL) models are increasingly developed for auto-segmentation in radiotherapy. Qualitative analysis is of great importance for clinical implementation, next to quantitative. This study evaluates a DL segmentation model for left- and right-sided locally advanced breast cancer both quantitatively and qualitatively. Methods For each side a DL model was trained, including primary breast CTV (CTVp), lymph node levels 1-4, heart, lungs, humeral head, thyroid and esophagus. For evaluation, both automatic segmentation, including correction of contours when needed, and manual delineation was performed and both processes were timed. Quantitative scoring with dice-similarity coefficient (DSC), 95% Hausdorff Distance (95%HD) and surface DSC (sDSC) was used to compare both the automatic (not-corrected) and corrected contours with the manual contours. Qualitative scoring was performed by five radiotherapy technologists and five radiation oncologists using a 3-point Likert scale. Results Time reduction was achieved using auto-segmentation in 95% of the cases, including correction. The time reduction (mean ± std) was 42.4% ± 26.5% and 58.5% ± 19.1% for OARs and CTVs, respectively, corresponding to an absolute mean reduction (hh:mm:ss) of 00:08:51 and 00:25:38. Good quantitative results were achieved before correction, e.g. mean DSC for the right-sided CTVp was 0.92 ± 0.06, whereas correction statistically significantly improved this contour by only 0.02 ± 0.05, respectively. In 92% of the cases, auto-contours were scored as clinically acceptable, with or without corrections. Conclusions A DL segmentation model was trained and was shown to be a time-efficient way to generate clinically acceptable contours for locally advanced breast cancer.
Collapse
Affiliation(s)
- Nienke Bakx
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Dorien Rijkaart
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | | | - Jacqueline Theuws
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | | | - An-Sofie Verrijssen
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Jorien van der Leer
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Joline Mutsaers
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Thérèse van Nunen
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Marjon Reinders
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Inge Schuengel
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Julia Smits
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Els Hagelaar
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | | | - Hanneke Bluemink
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
| | - Coen Hurkmans
- Catharina Hospital, Department of Radiation Oncology, Eindhoven, the Netherlands
- Technical University Eindhoven, Faculties of Physics and Electrical Engineering, Eindhoven, the Netherlands
| |
Collapse
|
13
|
Dubey S, Tiwari G, Singh S, Goldberg S, Pinsky E. Using machine learning for healthcare treatment planning. Front Artif Intell 2023; 6:1124182. [PMID: 37181733 PMCID: PMC10167842 DOI: 10.3389/frai.2023.1124182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Accepted: 04/03/2023] [Indexed: 05/16/2023] Open
Abstract
We present a methodology for using machine learning for planning treatments. As a case study, we apply the proposed methodology to Breast Cancer. Most of the application of Machine Learning to breast cancer has been on diagnosis and early detection. By contrast, our paper focuses on applying Machine Learning to suggest treatment plans for patients with different disease severity. While the need for surgery and even its type is often obvious to a patient, the need for chemotherapy and radiation therapy is not as obvious to the patient. With this in mind, the following treatment plans were considered in this study: chemotherapy, radiation, chemotherapy with radiation, and none of these options (only surgery). We use real data from more than 10,000 patients over 6 years that includes detailed cancer information, treatment plans, and survival statistics. Using this data set, we construct Machine Learning classifiers to suggest treatment plans. Our emphasis in this effort is not only on suggesting the treatment plan but on explaining and defending a particular treatment choice to the patient.
Collapse
Affiliation(s)
- Snigdha Dubey
- Department of Computer Science, Metropolitan College, Boston University, Boston, MA, United States
| | - Gaurav Tiwari
- Department of Computer Science, Metropolitan College, Boston University, Boston, MA, United States
| | - Sneha Singh
- Department of Computer Science, Metropolitan College, Boston University, Boston, MA, United States
| | - Saveli Goldberg
- Department of Radiation Oncology Mass General Hospital, Boston, MA, United States
| | - Eugene Pinsky
- Department of Computer Science, Metropolitan College, Boston University, Boston, MA, United States
| |
Collapse
|
14
|
Ali R, Balamurali M, Varamini P. Deep Learning-Based Artificial Intelligence to Investigate Targeted Nanoparticles' Uptake in TNBC Cells. Int J Mol Sci 2022; 23:ijms232416070. [PMID: 36555718 PMCID: PMC9785476 DOI: 10.3390/ijms232416070] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 12/08/2022] [Accepted: 12/11/2022] [Indexed: 12/23/2022] Open
Abstract
Triple negative breast cancer (TNBC) is the most aggressive subtype of breast cancer in women. It has the poorest prognosis along with limited therapeutic options. Smart nano-based carriers are emerging as promising approaches in treating TNBC due to their favourable characteristics such as specifically delivering different cargos to cancer cells. However, nanoparticles' tumour cell uptake, and subsequent drug release, are essential factors considered during the drug development process. Contemporary qualitative analyses based on imaging are cumbersome and prone to human biases. Deep learning-based algorithms have been well-established in various healthcare settings with promising scope in drug discovery and development. In this study, the performance of five different convolutional neural network models was evaluated. In this research, we investigated two sequential models from scratch and three pre-trained models, VGG16, ResNet50, and Inception V3. These models were trained using confocal images of nanoparticle-treated cells loaded with a fluorescent anticancer agent. Comparative and cross-validation analyses were further conducted across all models to obtain more meaningful results. Our models showed high accuracy in predicting either high or low drug uptake and release into TNBC cells, indicating great translational potential into practice to aid in determining cellular uptake at the early stages of drug development in any area of research.
Collapse
Affiliation(s)
- Rafia Ali
- School of Pharmacy, Faculty of Medicine and Health, University of Sydney, Sydney, NSW 2006, Australia
| | - Mehala Balamurali
- Australian Centre for Field Robotics, The University of Sydney, Sydney, NSW 2006, Australia
| | - Pegah Varamini
- School of Pharmacy, Faculty of Medicine and Health, University of Sydney, Sydney, NSW 2006, Australia
- The University of Sydney Nano Institute, The University of Sydney, Sydney, NSW 2006, Australia
- Correspondence: ; Tel.: +61-2-86270809
| |
Collapse
|
15
|
Towards real-time radiotherapy planning: The role of autonomous treatment strategies. Phys Imaging Radiat Oncol 2022; 24:136-137. [DOI: 10.1016/j.phro.2022.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
|
16
|
Muren LP, Redalen KR, Thorwarth D. Five years, 20 volumes and 300 publications of Physics and Imaging in Radiation Oncology. Phys Imaging Radiat Oncol 2022; 21:123-125. [PMID: 35265751 PMCID: PMC8899405 DOI: 10.1016/j.phro.2022.02.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022] Open
|