1
|
Fajemisin JA, Gonzalez G, Rosenberg SA, Ullah G, Redler G, Latifi K, Moros EG, El Naqa I. Magnetic Resonance-Guided Cancer Therapy Radiomics and Machine Learning Models for Response Prediction. Tomography 2024; 10:1439-1454. [PMID: 39330753 PMCID: PMC11435563 DOI: 10.3390/tomography10090107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2024] [Revised: 08/27/2024] [Accepted: 08/28/2024] [Indexed: 09/28/2024] Open
Abstract
Magnetic resonance imaging (MRI) is known for its accurate soft tissue delineation of tumors and normal tissues. This development has significantly impacted the imaging and treatment of cancers. Radiomics is the process of extracting high-dimensional features from medical images. Several studies have shown that these extracted features may be used to build machine-learning models for the prediction of treatment outcomes of cancer patients. Various feature selection techniques and machine models interrogate the relevant radiomics features for predicting cancer treatment outcomes. This study aims to provide an overview of MRI radiomics features used in predicting clinical treatment outcomes with machine learning techniques. The review includes examples from different disease sites. It will also discuss the impact of magnetic field strength, sample size, and other characteristics on outcome prediction performance.
Collapse
Affiliation(s)
- Jesutofunmi Ayo Fajemisin
- Department of Physics, University of South Florida, Tampa, FL 33620, USA
- Machine Learning Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
| | - Glebys Gonzalez
- Machine Learning Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
| | - Stephen A Rosenberg
- Machine Learning Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
- Radiation Oncology Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
| | - Ghanim Ullah
- Department of Physics, University of South Florida, Tampa, FL 33620, USA
| | - Gage Redler
- Radiation Oncology Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
| | - Kujtim Latifi
- Radiation Oncology Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
| | - Eduardo G Moros
- Department of Physics, University of South Florida, Tampa, FL 33620, USA
- Machine Learning Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
- Radiation Oncology Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
| | - Issam El Naqa
- Department of Physics, University of South Florida, Tampa, FL 33620, USA
- Machine Learning Department, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL 33612, USA
| |
Collapse
|
2
|
Niraula D, Cuneo KC, Dinov ID, Gonzalez BD, Jamaluddin JB, Jin JJ, Luo Y, Matuszak MM, Ten Haken RK, Bryant AK, Dilling TJ, Dykstra MP, Frakes JM, Liveringhouse CL, Miller SR, Mills MN, Palm RF, Regan SN, Rishi A, Torres-Roca JF, Yu HHM, El Naqa I. Intricacies of Human-AI Interaction in Dynamic Decision-Making for Precision Oncology: A Case Study in Response-Adaptive Radiotherapy. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.04.27.24306434. [PMID: 38746238 PMCID: PMC11092730 DOI: 10.1101/2024.04.27.24306434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
Background Adaptive treatment strategies that can dynamically react to individual cancer progression can provide effective personalized care. Longitudinal multi-omics information, paired with an artificially intelligent clinical decision support system (AI-CDSS) can assist clinicians in determining optimal therapeutic options and treatment adaptations. However, AI-CDSS is not perfectly accurate, as such, clinicians' over/under reliance on AI may lead to unintended consequences, ultimately failing to develop optimal strategies. To investigate such collaborative decision-making process, we conducted a Human-AI interaction case study on response-adaptive radiotherapy (RT). Methods We designed and conducted a two-phase study for two disease sites and two treatment modalities-adaptive RT for non-small cell lung cancer (NSCLC) and adaptive stereotactic body RT for hepatocellular carcinoma (HCC)-in which clinicians were asked to consider mid-treatment modification of the dose per fraction for a number of retrospective cancer patients without AI-support (Unassisted Phase) and with AI-assistance (AI-assisted Phase). The AI-CDSS graphically presented trade-offs in tumor control and the likelihood of toxicity to organs at risk, provided an optimal recommendation, and associated model uncertainties. In addition, we asked for clinicians' decision confidence level and trust level in individual AI recommendations and encouraged them to provide written remarks. We enrolled 13 evaluators (radiation oncology physicians and residents) from two medical institutions located in two different states, out of which, 4 evaluators volunteered in both NSCLC and HCC studies, resulting in a total of 17 completed evaluations (9 NSCLC, and 8 HCC). To limit the evaluation time to under an hour, we selected 8 treated patients for NSCLC and 9 for HCC, resulting in a total of 144 sets of evaluations (72 from NSCLC and 72 from HCC). Evaluation for each patient consisted of 8 required inputs and 2 optional remarks, resulting in up to a total of 1440 data points. Results AI-assistance did not homogeneously influence all experts and clinical decisions. From NSCLC cohort, 41 (57%) decisions and from HCC cohort, 34 (47%) decisions were adjusted after AI assistance. Two evaluations (12%) from the NSCLC cohort had zero decision adjustments, while the remaining 15 (88%) evaluations resulted in at least two decision adjustments. Decision adjustment level positively correlated with dissimilarity in decision-making with AI [NSCLC: ρ = 0.53 ( p < 0.001); HCC: ρ = 0.60 ( p < 0.001)] indicating that evaluators adjusted their decision closer towards AI recommendation. Agreement with AI-recommendation positively correlated with AI Trust Level [NSCLC: ρ = 0.59 ( p < 0.001); HCC: ρ = 0.7 ( p < 0.001)] indicating that evaluators followed AI's recommendation if they agreed with that recommendation. The correlation between decision confidence changes and decision adjustment level showed an opposite trend [NSCLC: ρ = -0.24 ( p = 0.045), HCC: ρ = 0.28 ( p = 0.017)] reflecting the difference in behavior due to underlying differences in disease type and treatment modality. Decision confidence positively correlated with the closeness of decisions to the standard of care (NSCLC: 2 Gy/fx; HCC: 10 Gy/fx) indicating that evaluators were generally more confident in prescribing dose fractionations more similar to those used in standard clinical practice. Inter-evaluator agreement increased with AI-assistance indicating that AI-assistance can decrease inter-physician variability. The majority of decisions were adjusted to achieve higher tumor control in NSCLC and lower normal tissue complications in HCC. Analysis of evaluators' remarks indicated concerns for organs at risk and RT outcome estimates as important decision-making factors. Conclusions Human-AI interaction depends on the complex interrelationship between expert's prior knowledge and preferences, patient's state, disease site, treatment modality, model transparency, and AI's learned behavior and biases. The collaborative decision-making process can be summarized as follows: (i) some clinicians may not believe in an AI system, completely disregarding its recommendation, (ii) some clinicians may believe in the AI system but will critically analyze its recommendations on a case-by-case basis; (iii) when a clinician finds that the AI recommendation indicates the possibility for better outcomes they will adjust their decisions accordingly; and (iv) When a clinician finds that the AI recommendation indicate a worse possible outcome they will disregard it and seek their own alternative approach.
Collapse
|
3
|
Ruprecht NA, Singhal S, Schaefer K, Panda O, Sens D, Singhal SK. A Review: Multi-Omics Approach to Studying the Association between Ionizing Radiation Effects on Biological Aging. BIOLOGY 2024; 13:98. [PMID: 38392316 PMCID: PMC10886797 DOI: 10.3390/biology13020098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Revised: 01/20/2024] [Accepted: 01/30/2024] [Indexed: 02/24/2024]
Abstract
Multi-omics studies have emerged as powerful tools for tailoring individualized responses to various conditions, capitalizing on genome sequencing technologies' increasing affordability and efficiency. This paper delves into the potential of multi-omics in deepening our understanding of biological age, examining the techniques available in light of evolving technology and computational models. The primary objective is to review the relationship between ionizing radiation and biological age, exploring a wide array of functional, physiological, and psychological parameters. This comprehensive review draws upon an extensive range of sources, including peer-reviewed journal articles, government documents, and reputable websites. The literature review spans from fundamental insights into radiation effects to the latest developments in aging research. Ionizing radiation exerts its influence through direct mechanisms, notably single- and double-strand DNA breaks and cross links, along with other critical cellular events. The cumulative impact of DNA damage forms the foundation for the intricate process of natural aging, intersecting with numerous diseases and pivotal biomarkers. Furthermore, there is a resurgence of interest in ionizing radiation research from various organizations and countries, reinvigorating its importance as a key contributor to the study of biological age. Biological age serves as a vital reference point for the monitoring and mitigation of the effects of various stressors, including ionizing radiation. Ionizing radiation emerges as a potent candidate for modeling the separation of biological age from chronological age, offering a promising avenue for tailoring protocols across diverse fields, including the rigorous demands of space exploration.
Collapse
Affiliation(s)
- Nathan A Ruprecht
- Department of Biomedical Engineering, University of North Dakota, Grand Forks, ND 58202, USA
| | - Sonalika Singhal
- Department of Pathology, University of North Dakota, Grand Forks, ND 58202, USA
| | - Kalli Schaefer
- Department of Biomedical Engineering, University of North Dakota, Grand Forks, ND 58202, USA
| | - Om Panda
- Department of Public Health, University of California Irvine, Irvine, CA 92697, USA
| | - Donald Sens
- Department of Pathology, University of North Dakota, Grand Forks, ND 58202, USA
| | - Sandeep K Singhal
- Department of Biomedical Engineering, University of North Dakota, Grand Forks, ND 58202, USA
- Department of Pathology, University of North Dakota, Grand Forks, ND 58202, USA
| |
Collapse
|
4
|
Cobanaj M, Corti C, Dee EC, McCullum L, Boldrini L, Schlam I, Tolaney SM, Celi LA, Curigliano G, Criscitiello C. Advancing equitable and personalized cancer care: Novel applications and priorities of artificial intelligence for fairness and inclusivity in the patient care workflow. Eur J Cancer 2024; 198:113504. [PMID: 38141549 PMCID: PMC11362966 DOI: 10.1016/j.ejca.2023.113504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 12/13/2023] [Indexed: 12/25/2023]
Abstract
Patient care workflows are highly multimodal and intertwined: the intersection of data outputs provided from different disciplines and in different formats remains one of the main challenges of modern oncology. Artificial Intelligence (AI) has the potential to revolutionize the current clinical practice of oncology owing to advancements in digitalization, database expansion, computational technologies, and algorithmic innovations that facilitate discernment of complex relationships in multimodal data. Within oncology, radiation therapy (RT) represents an increasingly complex working procedure, involving many labor-intensive and operator-dependent tasks. In this context, AI has gained momentum as a powerful tool to standardize treatment performance and reduce inter-observer variability in a time-efficient manner. This review explores the hurdles associated with the development, implementation, and maintenance of AI platforms and highlights current measures in place to address them. In examining AI's role in oncology workflows, we underscore that a thorough and critical consideration of these challenges is the only way to ensure equitable and unbiased care delivery, ultimately serving patients' survival and quality of life.
Collapse
Affiliation(s)
- Marisa Cobanaj
- National Center for Radiation Research in Oncology, OncoRay, Helmholtz-Zentrum Dresden-Rossendorf, Dresden, Germany
| | - Chiara Corti
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA, USA; Harvard Medical School, Boston, MA, USA; Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology, IRCCS, Milan, Italy; Department of Oncology and Hematology-Oncology (DIPO), University of Milan, Milan, Italy.
| | - Edward C Dee
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Lucas McCullum
- Department of Radiation Oncology, MD Anderson Cancer Center, Houston, TX, USA
| | - Laura Boldrini
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology, IRCCS, Milan, Italy; Department of Oncology and Hematology-Oncology (DIPO), University of Milan, Milan, Italy
| | - Ilana Schlam
- Department of Hematology and Oncology, Tufts Medical Center, Boston, MA, USA; Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Sara M Tolaney
- Breast Oncology Program, Dana-Farber Brigham Cancer Center, Boston, MA, USA; Harvard Medical School, Boston, MA, USA; Department of Medical Oncology, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Leo A Celi
- Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA; Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA; Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Giuseppe Curigliano
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology, IRCCS, Milan, Italy; Department of Oncology and Hematology-Oncology (DIPO), University of Milan, Milan, Italy
| | - Carmen Criscitiello
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology, IRCCS, Milan, Italy; Department of Oncology and Hematology-Oncology (DIPO), University of Milan, Milan, Italy
| |
Collapse
|
5
|
Gianoli C, De Bernardi E, Parodi K. "Under the hood": artificial intelligence in personalized radiotherapy. BJR Open 2024; 6:tzae017. [PMID: 39104573 PMCID: PMC11299549 DOI: 10.1093/bjro/tzae017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 05/10/2024] [Accepted: 07/10/2024] [Indexed: 08/07/2024] Open
Abstract
This review presents and discusses the ways in which artificial intelligence (AI) tools currently intervene, or could potentially intervene in the future, to enhance the diverse tasks involved in the radiotherapy workflow. The radiotherapy framework is presented on 2 different levels for the personalization of the treatment, distinct in tasks and methodologies. The first level is the clinically well-established anatomy-based workflow, known as adaptive radiation therapy. The second level is referred to as biology-driven workflow, explored in the research literature and recently appearing in some preliminary clinical trials for personalized radiation treatments. A 2-fold role for AI is defined according to these 2 different levels. In the anatomy-based workflow, the role of AI is to streamline and improve the tasks in terms of time and variability reductions compared to conventional methodologies. The biology-driven workflow instead fully relies on AI, which introduces decision-making tools opening uncharted frontiers that were in the past deemed challenging to explore. These methodologies are referred to as radiomics and dosiomics, handling imaging and dosimetric information, or multiomics, when complemented by clinical and biological parameters (ie, biomarkers). The review explicitly highlights the methodologies that are currently incorporated into clinical practice or still in research, with the aim of presenting the AI's growing role in personalized radiotherapy.
Collapse
Affiliation(s)
- Chiara Gianoli
- Department of Experimental Physics – Medical Physics, Faculty for Physics of the Ludwig-Maximilians-Universität München (LMU Munich), Geschwister-Scholl-Platz 1, München, 80539, Germany
| | - Elisabetta De Bernardi
- School of Medicine and Surgery, Università degli Studi di Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, Milano, 20126, Italy
| | - Katia Parodi
- Department of Experimental Physics – Medical Physics, Faculty for Physics of the Ludwig-Maximilians-Universität München (LMU Munich), Geschwister-Scholl-Platz 1, München, 80539, Germany
| |
Collapse
|
6
|
Kutuva AR, Caudell JJ, Yamoah K, Enderling H, Zahid MU. Mathematical modeling of radiotherapy: impact of model selection on estimating minimum radiation dose for tumor control. Front Oncol 2023; 13:1130966. [PMID: 37901317 PMCID: PMC10600389 DOI: 10.3389/fonc.2023.1130966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2022] [Accepted: 08/28/2023] [Indexed: 10/31/2023] Open
Abstract
Introduction Radiation therapy (RT) is one of the most common anticancer therapies. Yet, current radiation oncology practice does not adapt RT dose for individual patients, despite wide interpatient variability in radiosensitivity and accompanying treatment response. We have previously shown that mechanistic mathematical modeling of tumor volume dynamics can simulate volumetric response to RT for individual patients and estimation personalized RT dose for optimal tumor volume reduction. However, understanding the implications of the choice of the underlying RT response model is critical when calculating personalized RT dose. Methods In this study, we evaluate the mathematical implications and biological effects of 2 models of RT response on dose personalization: (1) cytotoxicity to cancer cells that lead to direct tumor volume reduction (DVR) and (2) radiation responses to the tumor microenvironment that lead to tumor carrying capacity reduction (CCR) and subsequent tumor shrinkage. Tumor growth was simulated as logistic growth with pre-treatment dynamics being described in the proliferation saturation index (PSI). The effect of RT was simulated according to each respective model for a standard schedule of fractionated RT with 2 Gy weekday fractions. Parameter sweeps were evaluated for the intrinsic tumor growth rate and the radiosensitivity parameter for both models to observe the qualitative impact of each model parameter. We then calculated the minimum RT dose required for locoregional tumor control (LRC) across all combinations of the full range of radiosensitvity and proliferation saturation values. Results Both models estimate that patients with higher radiosensitivity will require a lower RT dose to achieve LRC. However, the two models make opposite estimates on the impact of PSI on the minimum RT dose for LRC: the DVR model estimates that tumors with higher PSI values will require a higher RT dose to achieve LRC, while the CCR model estimates that higher PSI values will require a lower RT dose to achieve LRC. Discussion Ultimately, these results show the importance of understanding which model best describes tumor growth and treatment response in a particular setting, before using any such model to make estimates for personalized treatment recommendations.
Collapse
Affiliation(s)
- Achyudhan R. Kutuva
- Department of Integrated Mathematical Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, United States
- Department of Microbiology and Cell Science, University of Florida, Gainesville, FL, United States
| | - Jimmy J. Caudell
- Department of Radiation Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, United States
| | - Kosj Yamoah
- Department of Radiation Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, United States
| | - Heiko Enderling
- Department of Integrated Mathematical Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, United States
- Department of Radiation Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, United States
| | - Mohammad U. Zahid
- Department of Integrated Mathematical Oncology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL, United States
| |
Collapse
|
7
|
Martins JC, Maier J, Gianoli C, Neppl S, Dedes G, Alhazmi A, Veloza S, Reiner M, Belka C, Kachelrieß M, Parodi K. Towards real-time EPID-based 3D in vivo dosimetry for IMRT with Deep Neural Networks: A feasibility study. Phys Med 2023; 114:103148. [PMID: 37801811 DOI: 10.1016/j.ejmp.2023.103148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/12/2023] [Revised: 08/17/2023] [Accepted: 09/22/2023] [Indexed: 10/08/2023] Open
Abstract
We investigate the potential of the Deep Dose Estimate (DDE) neural network to predict 3D dose distributions inside patients with Monte Carlo (MC) accuracy, based on transmitted EPID signals and patient CTs. The network was trained using as input patient CTs and first-order dose approximations (FOD). Accurate dose distributions (ADD) simulated with MC were given as training targets. 83 pelvic CTs were used to simulate ADDs and respective EPID signals for subfields of prostate IMRT plans (gantry at 0∘). FODs were produced as backprojections from the EPID signals. 581 ADD-FOD sets were produced and divided into training and test sets. An additional dataset simulated with gantry at 90∘ (lateral set) was used for evaluating the performance of the DDE at different beam directions. The quality of the FODs and DDE-predicted dose distributions (DDEP) with respect to ADDs, from the test and lateral sets, was evaluated with gamma analysis (3%,2 mm). The passing rates between FODs and ADDs were as low as 46%, while for DDEPs the passing rates were above 97% for the test set. Meaningful improvements were also observed for the lateral set. The high passing rates for DDEPs indicate that the DDE is able to convert FODs into ADDs. Moreover, the trained DDE predicts the dose inside a patient CT within 0.6 s/subfield (GPU), in contrast to 14 h needed for MC (CPU-cluster). 3D in vivo dose distributions due to clinical patient irradiation can be obtained within seconds, with MC-like accuracy, potentially paving the way towards real-time EPID-based in vivo dosimetry.
Collapse
Affiliation(s)
- Juliana Cristina Martins
- Department of Medical Physics, Faculty of Physics, Ludwig-Maximilians-Universität München, Am Coulombwall 1, Garching b. München, 85748, Germany.
| | - Joscha Maier
- German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, Heidelberg, 69120, Germany.
| | - Chiara Gianoli
- Department of Medical Physics, Faculty of Physics, Ludwig-Maximilians-Universität München, Am Coulombwall 1, Garching b. München, 85748, Germany.
| | - Sebastian Neppl
- Department of Radiation Oncology, University Hospital, LMU Munich, Marchioninistraße 15, Munich, 81377, Germany.
| | - George Dedes
- Department of Medical Physics, Faculty of Physics, Ludwig-Maximilians-Universität München, Am Coulombwall 1, Garching b. München, 85748, Germany.
| | - Abdulaziz Alhazmi
- Department of Medical Physics, Faculty of Physics, Ludwig-Maximilians-Universität München, Am Coulombwall 1, Garching b. München, 85748, Germany.
| | - Stella Veloza
- Department of Medical Physics, Faculty of Physics, Ludwig-Maximilians-Universität München, Am Coulombwall 1, Garching b. München, 85748, Germany.
| | - Michael Reiner
- Department of Radiation Oncology, University Hospital, LMU Munich, Marchioninistraße 15, Munich, 81377, Germany.
| | - Claus Belka
- Department of Radiation Oncology, University Hospital, LMU Munich, Marchioninistraße 15, Munich, 81377, Germany.
| | - Marc Kachelrieß
- German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, Heidelberg, 69120, Germany; Heidelberg University, Grabengasse 1, Heidelberg, 69117, Germany.
| | - Katia Parodi
- Department of Medical Physics, Faculty of Physics, Ludwig-Maximilians-Universität München, Am Coulombwall 1, Garching b. München, 85748, Germany.
| |
Collapse
|
8
|
Ger RB, Wei L, Naqa IE, Wang J. The Promise and Future of Radiomics for Personalized Radiotherapy Dosing and Adaptation. Semin Radiat Oncol 2023; 33:252-261. [PMID: 37331780 PMCID: PMC11214660 DOI: 10.1016/j.semradonc.2023.03.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/20/2023]
Abstract
Quantitative image analysis, also known as radiomics, aims to analyze large-scale quantitative features extracted from acquired medical images using hand-crafted or machine-engineered feature extraction approaches. Radiomics has great potential for a variety of clinical applications in radiation oncology, an image-rich treatment modality that utilizes computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET) for treatment planning, dose calculation, and image guidance. A promising application of radiomics is in predicting treatment outcomes after radiotherapy such as local control and treatment-related toxicity using features extracted from pretreatment and on-treatment images. Based on these individualized predictions of treatment outcomes, radiotherapy dose can be sculpted to meet the specific needs and preferences of each patient. Radiomics can aid in tumor characterization for personalized targeting, especially for identifying high-risk regions within a tumor that cannot be easily discerned based on size or intensity alone. Radiomics-based treatment response prediction can aid in developing personalized fractionation and dose adjustments. In order to make radiomics models more applicable across different institutions with varying scanners and patient populations, further efforts are needed to harmonize and standardize the acquisition protocols by minimizing uncertainties within the imaging data.
Collapse
Affiliation(s)
- Rachel B Ger
- Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins Medicine, Baltimore, MD
| | - Lise Wei
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI
| | - Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center and Research Institute, Tampa, FL
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX..
| |
Collapse
|
9
|
Niraula D, Sun W, Jin J, Dinov ID, Cuneo K, Jamaluddin J, Matuszak MM, Luo Y, Lawrence TS, Jolly S, Ten Haken RK, El Naqa I. A clinical decision support system for AI-assisted decision-making in response-adaptive radiotherapy (ARCliDS). Sci Rep 2023; 13:5279. [PMID: 37002296 PMCID: PMC10066294 DOI: 10.1038/s41598-023-32032-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 03/21/2023] [Indexed: 04/03/2023] Open
Abstract
Involvement of many variables, uncertainty in treatment response, and inter-patient heterogeneity challenge objective decision-making in dynamic treatment regime (DTR) in oncology. Advanced machine learning analytics in conjunction with information-rich dense multi-omics data have the ability to overcome such challenges. We have developed a comprehensive artificial intelligence (AI)-based optimal decision-making framework for assisting oncologists in DTR. In this work, we demonstrate the proposed framework to Knowledge Based Response-Adaptive Radiotherapy (KBR-ART) applications by developing an interactive software tool entitled Adaptive Radiotherapy Clinical Decision Support (ARCliDS). ARCliDS is composed of two main components: Artifcial RT Environment (ARTE) and Optimal Decision Maker (ODM). ARTE is designed as a Markov decision process and modeled via supervised learning. Given a patient's pre- and during-treatment information, ARTE can estimate treatment outcomes for a selected daily dosage value (radiation fraction size). ODM is formulated using reinforcement learning and is trained on ARTE. ODM can recommend optimal daily dosage adjustments to maximize the tumor local control probability and minimize the side effects. Graph Neural Networks (GNN) are applied to exploit the inter-feature relationships for improved modeling performance and a novel double GNN architecture is designed to avoid nonphysical treatment response. Datasets of size 117 and 292 were available from two clinical trials on adaptive RT in non-small cell lung cancer (NSCLC) patients and adaptive stereotactic body RT (SBRT) in hepatocellular carcinoma (HCC) patients, respectively. For training and validation, dense data with 297 features were available for 67 NSCLC patients and 110 features for 71 HCC patients. To increase the sample size for ODM training, we applied Generative Adversarial Networks to generate 10,000 synthetic patients. The ODM was trained on the synthetic patients and validated on the original dataset. We found that, Double GNN architecture was able to correct the nonphysical dose-response trend and improve ARCliDS recommendation. The average root mean squared difference (RMSD) between ARCliDS recommendation and reported clinical decisions using double GNNs were 0.61 [0.03] Gy/frac (mean [sem]) for adaptive RT in NSCLC patients and 2.96 [0.42] Gy/frac for adaptive SBRT HCC compared to the single GNN's RMSDs of 0.97 [0.12] Gy/frac and 4.75 [0.16] Gy/frac, respectively. Overall, For NSCLC and HCC, ARCliDS with double GNNs was able to reproduce 36% and 50% of the good clinical decisions (local control and no side effects) and improve 74% and 30% of the bad clinical decisions, respectively. In conclusion, ARCliDS is the first web-based software dedicated to assist KBR-ART with multi-omics data. ARCliDS can learn from the reported clinical decisions and facilitate AI-assisted clinical decision-making for improving the outcomes in DTR.
Collapse
Affiliation(s)
- Dipesh Niraula
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA.
| | - Wenbo Sun
- University of Michigan Transport Research Institute, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Jionghua Jin
- Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Ivo D Dinov
- Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Kyle Cuneo
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Jamalina Jamaluddin
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Martha M Matuszak
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Yi Luo
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Theodore S Lawrence
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Shruti Jolly
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Randall K Ten Haken
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA
| |
Collapse
|
10
|
Niraula D, Jamaluddin J, Matuszak MM, Haken RKT, Naqa IE. Quantum deep reinforcement learning for clinical decision support in oncology: application to adaptive radiotherapy. Sci Rep 2021; 11:23545. [PMID: 34876609 PMCID: PMC8651664 DOI: 10.1038/s41598-021-02910-y] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Accepted: 11/24/2021] [Indexed: 01/31/2023] Open
Abstract
Subtle differences in a patient's genetics and physiology may alter radiotherapy (RT) treatment responses, motivating the need for a more personalized treatment plan. Accordingly, we have developed a novel quantum deep reinforcement learning (qDRL) framework for clinical decision support that can estimate an individual patient's dose response mid-treatment and recommend an optimal dose adjustment. Our framework considers patients' specific information including biological, physical, genetic, clinical, and dosimetric factors. Recognizing that physicians must make decisions amidst uncertainty in RT treatment outcomes, we employed indeterministic quantum states to represent human decision making in a real-life scenario. We paired quantum decision states with a model-based deep q-learning algorithm to optimize the clinical decision-making process in RT. We trained our proposed qDRL framework on an institutional dataset of 67 stage III non-small cell lung cancer (NSCLC) patients treated on prospective adaptive protocols and independently validated our framework in an external multi-institutional dataset of 174 NSCLC patients. For a comprehensive evaluation, we compared three frameworks: DRL, qDRL trained in a Qiskit quantum computing simulator, and qDRL trained in an IBM quantum computer. Two metrics were considered to evaluate our framework: (1) similarity score, defined as the root mean square error between retrospective clinical decisions and the AI recommendations, and (2) self-evaluation scheme that compares retrospective clinical decisions and AI recommendations based on the improvement in the observed clinical outcomes. Our analysis shows that our framework, which takes into consideration individual patient dose response in its decision-making, can potentially improve clinical RT decision-making by at least about 10% compared to unaided clinical practice. Further validation of our novel quantitative approach in a prospective study will provide a necessary framework for improving the standard of care in personalized RT.
Collapse
Affiliation(s)
- Dipesh Niraula
- Department of Machine Learning, H. Lee Moffitt Cancer Center and Research Institute, Tampa, FL, 33612, USA.
| | - Jamalina Jamaluddin
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Martha M Matuszak
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Randall K Ten Haken
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Issam El Naqa
- Department of Machine Learning, H. Lee Moffitt Cancer Center and Research Institute, Tampa, FL, 33612, USA
| |
Collapse
|
11
|
Pakela JM, Matuszak MM, Ten Haken RK, McShan DL, El Naqa I. Dynamic stochastic deep learning approaches for predicting geometric changes in head and neck cancer. Phys Med Biol 2021; 66. [PMID: 34587597 DOI: 10.1088/1361-6560/ac2b80] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 09/29/2021] [Indexed: 01/01/2023]
Abstract
Objective.Modern radiotherapy stands to benefit from the ability to efficiently adapt plans during treatment in response to setup and geometric variations such as those caused by internal organ deformation or tumor shrinkage. A promising strategy is to develop a framework, which given an initial state defined by patient-attributes, can predict future states based on pre-learned patterns from a well-defined patient population.Approach.Here, we investigate the feasibility of predicting patient anatomical changes, defined as a joint state of volume and daily setup changes, across a fractionated treatment schedule using two approaches. The first is based on a new joint framework employing quantum mechanics in combination with deep recurrent neural networks, denoted QRNN. The second approach is developed based on a classical framework, which models patient changes as a Markov process, denoted MRNN. We evaluated the performance characteristics of these two approaches on a dataset of 125 head and neck cancer patients, which was supplemented by synthetic data generated using a generative adversarial network. Model performance was evaluated using area under the receiver operating characteristic curve (AUC) scores.Main results.The MRNN framework had slightly better performance than the QRNN framework, with MRNN (QRNN) validation AUC scores of 0.742±0.021 (0.675±0.036), 0.709±0.026 (0.656±0.021), 0.724±0.036 (0.652±0.044), and 0.698±0.016 (0.605±0.035) for system state vector sizes of 4, 6, 8, and 10, respectively. Of these, only the results from the two higher order states had statistically significant differences(p<0.05).A similar trend was also observed when the models were applied to an external testing dataset of 20 patients, yielding MRNN (QRNN) AUC scores of 0.707 (0.623), 0.687 (0.608), 0.723 (0.669), and 0.697 (0.609) for states vectors sizes of 4, 6, 8, and 10, respectively.Significance.These results suggest that both stochastic models have potential value in predicting patient changes during the course of adaptive radiotherapy.
Collapse
Affiliation(s)
- Julia M Pakela
- Applied Physics Program, University of Michigan, Ann Arbor, MI, United States of America.,Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, United States of America
| | - Martha M Matuszak
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, United States of America
| | - Randall K Ten Haken
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, United States of America
| | - Daniel L McShan
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, United States of America
| | - Issam El Naqa
- Applied Physics Program, University of Michigan, Ann Arbor, MI, United States of America.,Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, United States of America
| |
Collapse
|
12
|
El Naqa I. Prospective clinical deployment of machine learning in radiation oncology. Nat Rev Clin Oncol 2021; 18:605-606. [PMID: 34244694 DOI: 10.1038/s41571-021-00541-w] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, USA.
| |
Collapse
|
13
|
Luo Y, Jolly S, Palma D, Lawrence TS, Tseng HH, Valdes G, McShan D, Ten Haken RK, Ei Naqa I. A situational awareness Bayesian network approach for accurate and credible personalized adaptive radiotherapy outcomes prediction in lung cancer patients. Phys Med 2021; 87:11-23. [PMID: 34091197 DOI: 10.1016/j.ejmp.2021.05.032] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Revised: 05/20/2021] [Accepted: 05/22/2021] [Indexed: 11/26/2022] Open
Abstract
PURPOSE A situational awareness Bayesian network (SA-BN) approach is developed to improve physicians' trust in the prediction of radiation outcomes and evaluate its performance for personalized adaptive radiotherapy (pART). METHODS 118 non-small-cell lung cancer patients with their biophysical features were employed for discovery (n = 68) and validation (n = 50) of radiation outcomes prediction modeling. Patients' important characteristics identified by radiation experts to predict individual's tumor local control (LC) or radiation pneumonitis with grade ≥ 2 (RP2) were incorporated as expert knowledge (EK). Besides generating an EK-based naïve BN (EK-NBN), an SA-BN was developed by incorporating the EK features into pure data-driven BN (PD-BN) methods to improve the credibility of LC or / and RP2 prediction. After using area under the free-response receiver operating characteristics curve (AU-FROC) to assess the joint prediction of these outcomes, their prediction performances were compared with a regression approach based on the expert yielded estimates (EYE) penalty and its variants. RESULTS In addition to improving the credibility of radiation outcomes prediction, the SA-BN approach outperformed the EYE penalty and its variants in terms of the joint prediction of LC and RP2. The value of AU-FROC improves from 0.70 (95% CI: 0.54-0.76) using EK-NBN, to 0.75 (0.65-0.82) using a variant of EYE penalty, to 0.83 (0.75-0.93) using PD-BN and 0.83 (0.77-0.90) using SA-BN; with similar trends in the validation cohort. CONCLUSIONS The SA-BN approach can provide an accurate and credible human-machine interface to gain physicians' trust in clinical decision-making, which has the potential to be an important component of pART.
Collapse
Affiliation(s)
- Yi Luo
- Department of Radiation Oncology, The University of Michigan, Ann Arbor, MI, USA.
| | - Shruti Jolly
- Department of Radiation Oncology, The University of Michigan, Ann Arbor, MI, USA
| | - David Palma
- London Health Sciences Centre, Western University, London, ON, Canada
| | - Theodore S Lawrence
- Department of Radiation Oncology, The University of Michigan, Ann Arbor, MI, USA
| | - Huan-Hsin Tseng
- Department of Radiation Oncology, The University of Michigan, Ann Arbor, MI, USA
| | - Gilmer Valdes
- Department of Radiation Oncology, UCSF Medical Center at Mission Bay, San Francisco, CA, USA
| | - Daniel McShan
- Department of Radiation Oncology, The University of Michigan, Ann Arbor, MI, USA
| | - Randall K Ten Haken
- Department of Radiation Oncology, The University of Michigan, Ann Arbor, MI, USA
| | - Issam Ei Naqa
- Department of Radiation Oncology, The University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
14
|
Xu H, Zhang B, Guerrero M, Lee SW, Lamichhane N, Chen S, Yi B. Toward automation of initial chart check for photon/electron EBRT: the clinical implementation of new AAPM task group reports and automation techniques. J Appl Clin Med Phys 2021; 22:234-245. [PMID: 33705604 PMCID: PMC7984492 DOI: 10.1002/acm2.13200] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Revised: 12/01/2020] [Accepted: 01/21/2021] [Indexed: 11/22/2022] Open
Abstract
Purpose The recently published AAPM TG‐275 and the public review version of TG‐315 list new recommendations for comprehensive and minimum physics initial chart checks, respectively. This article addresses the potential development and benefit of initial chart check automation when these recommendations are implemented for clinical photon/electron EBRT. Methods Eight board‐certified physicists with 2–20 years of clinical experience performed initial chart checks using checklists from TG‐275 and TG‐315. Manual check times were estimated for three types of plans (IMRT/VMAT, 3D, and 2D) and for prostate, whole pelvis, lung, breast, head and neck, and brain cancers. An expert development team of three physicists re‐evaluated the automation feasibility of TG‐275 checklist based on their experience of developing and implementing the in‐house and the commercial automation tools in our institution. Three levels of initial chart check automation were simulated: (1) Auto_UMMS_tool (which consists of in‐house program and commercially available software); (2) Auto_TG275 (with full and partial automation as indicated in TG‐275); and (3) Auto_UMMS_exp (with full and partial automation as determined by our experts’ re‐evaluation). Results With no automation of initial chart checks, the ranges of manual check times were 29–56 min (full TG‐315 list) and 102–163 min (full TG‐275 list), which varied significantly with physicists but varied little at different tumor sites. The 69 of 71 checks which were considered as “not fully automated” in TG‐275 were re‐evaluated with more automation feasibility. Compared to no automation, the higher levels of automation yielded a great reduction in both manual check times (by 44%–98%) and potentially residual detectable errors (by 15–85%). Conclusion The initial chart check automation greatly improves the practicality and efficiency of implementing the new TG recommendations. Revisiting the TG reports with new technology/practice updates may help develop and utilize more automation clinically.
Collapse
Affiliation(s)
- Huijun Xu
- University of Maryland School of Medicine, Baltimore, MD, USA
| | - Baoshe Zhang
- University of Maryland School of Medicine, Baltimore, MD, USA
| | | | - Sung-Woo Lee
- University of Maryland School of Medicine, Baltimore, MD, USA
| | | | - Shifeng Chen
- University of Maryland School of Medicine, Baltimore, MD, USA
| | - Byongyong Yi
- University of Maryland School of Medicine, Baltimore, MD, USA
| |
Collapse
|
15
|
Grand challenges for medical physics in radiation oncology. Radiother Oncol 2020; 153:7-14. [DOI: 10.1016/j.radonc.2020.10.001] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Revised: 10/02/2020] [Accepted: 10/02/2020] [Indexed: 12/12/2022]
|
16
|
Deiter N, Chu F, Lenards N, Hunzeker A, Lang K, Mundy D. Evaluation of replanning in intensity-modulated proton therapy for oropharyngeal cancer: Factors influencing plan robustness. Med Dosim 2020; 45:384-392. [PMID: 32660887 DOI: 10.1016/j.meddos.2020.06.002] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Revised: 05/07/2020] [Accepted: 06/03/2020] [Indexed: 12/01/2022]
Abstract
The head and neck (H&N) region is frequently replanned during intensity-modulated proton therapy (IMPT), but replanning disrupts clinical workflow and presents additional burden on patients. The purpose of this study was to establish a standard treatment planning approach to minimize H&N replanning by identifying a correlation between dosimetric variables and replan frequency. In a retrospective study of 27 bilateral oropharyngeal cancer patients treated with IMPT at a single institution, cases were evaluated using Fisher's exact tests and logistic regression for a significant relationship between replan frequency and the following variables: beam number, clinical target volume (CTV) coverage, presence of dental fillings, and robustness. The reason and timing for replan initiation, and patient immobilization was also recorded to identify trends. Results suggested that beam number, CTV coverage, presence of dental fillings, and the initial robustness curve on the high-dose CTV did not individually contribute to replanning frequency. Setup variation in the soft tissue of the neck was the most prominent reason for replanning. A lack of correlation between the number of replans and the studied dosimetric variables highlights the necessity of verification CT and adaptive replanning in IMPT of H&N cancer. Departments may therefore benefit from a methodical replan workflow. One development showing potential to enhance clinical replan processes is machine learning-based automatic adaptive replanning.
Collapse
Affiliation(s)
- Noelle Deiter
- Medical Dosimetry Program, University of Wisconsin, La Crosse, WI, USA
| | - Felicia Chu
- Medical Dosimetry Program, University of Wisconsin, La Crosse, WI, USA.
| | - Nishele Lenards
- Medical Dosimetry Program, University of Wisconsin, La Crosse, WI, USA
| | - Ashley Hunzeker
- Medical Dosimetry Program, University of Wisconsin, La Crosse, WI, USA
| | - Karen Lang
- Medical Dosimetry Program, University of Wisconsin, La Crosse, WI, USA
| | - Daniel Mundy
- Medical Dosimetry Program, University of Wisconsin, La Crosse, WI, USA
| |
Collapse
|
17
|
Cui S, Tseng HH, Pakela J, Ten Haken RK, Naqa IE. Introduction to machine and deep learning for medical physicists. Med Phys 2020; 47:e127-e147. [PMID: 32418339 PMCID: PMC7331753 DOI: 10.1002/mp.14140] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2019] [Revised: 01/23/2020] [Accepted: 03/03/2020] [Indexed: 01/01/2023] Open
Abstract
Recent years have witnessed tremendous growth in the application of machine learning (ML) and deep learning (DL) techniques in medical physics. Embracing the current big data era, medical physicists equipped with these state-of-the-art tools should be able to solve pressing problems in modern radiation oncology. Here, a review of the basic aspects involved in ML/DL model building, including data processing, model training, and validation for medical physics applications is presented and discussed. Machine learning can be categorized based on the underlying task into supervised learning, unsupervised learning, or reinforcement learning; each of these categories has its own input/output dataset characteristics and aims to solve different classes of problems in medical physics ranging from automation of processes to predictive analytics. It is recognized that data size requirements may vary depending on the specific medical physics application and the nature of the algorithms applied. Data processing, which is a crucial step for model stability and precision, should be performed before training the model. Deep learning as a subset of ML is able to learn multilevel representations from raw input data, eliminating the necessity for hand crafted features in classical ML. It can be thought of as an extension of the classical linear models but with multilayer (deep) structures and nonlinear activation functions. The logic of going "deeper" is related to learning complex data structures and its realization has been aided by recent advancements in parallel computing architectures and the development of more robust optimization methods for efficient training of these algorithms. Model validation is an essential part of ML/DL model building. Without it, the model being developed cannot be easily trusted to generalize to unseen data. Whenever applying ML/DL, one should keep in mind, according to Amara's law, that humans may tend to overestimate the ability of a technology in the short term and underestimate its capability in the long term. To establish ML/DL role into standard clinical workflow, models considering balance between accuracy and interpretability should be developed. Machine learning/DL algorithms have potential in numerous radiation oncology applications, including automatizing mundane procedures, improving efficiency and safety of auto-contouring, treatment planning, quality assurance, motion management, and outcome predictions. Medical physicists have been at the frontiers of technology translation into medicine and they ought to be prepared to embrace the inevitable role of ML/DL in the practice of radiation oncology and lead its clinical implementation.
Collapse
Affiliation(s)
- Sunan Cui
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI 48103, USA; Applied Physics Program, University of Michigan, Ann Arbor, MI 48109, USA
| | - Huan-Hsin Tseng
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI 48103, USA
| | - Julia Pakela
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI 48103, USA; Applied Physics Program, University of Michigan, Ann Arbor, MI 48109, USA
| | - Randall K. Ten Haken
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI 48103, USA
| | - Issam El Naqa
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI 48103, USA
| |
Collapse
|
18
|
Chin S, Eccles CL, McWilliam A, Chuter R, Walker E, Whitehurst P, Berresford J, Van Herk M, Hoskin PJ, Choudhury A. Magnetic resonance-guided radiation therapy: A review. J Med Imaging Radiat Oncol 2020; 64:163-177. [PMID: 31646742 DOI: 10.1111/1754-9485.12968] [Citation(s) in RCA: 91] [Impact Index Per Article: 22.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2019] [Accepted: 09/24/2019] [Indexed: 12/11/2022]
Abstract
Magnetic resonance-guided radiation therapy (MRgRT) is a promising approach to improving clinical outcomes for patients treated with radiation therapy. The roles of image guidance, adaptive planning and magnetic resonance imaging in radiation therapy have been increasing over the last two decades. Technical advances have led to the feasible combination of magnetic resonance imaging and radiation therapy technologies, leading to improved soft-tissue visualisation, assessment of inter- and intrafraction motion, motion management, online adaptive radiation therapy and the incorporation of functional information into treatment. MRgRT can potentially transform radiation oncology by improving tumour control and quality of life after radiation therapy and increasing convenience of treatment by shortening treatment courses for patients. Multiple groups have developed clinical implementations of MRgRT predominantly in the abdomen and pelvis, with patients having been treated since 2014. While studies of MRgRT have primarily been dosimetric so far, an increasing number of trials are underway examining the potential clinical benefits of MRgRT, with coordinated efforts to rigorously evaluate the benefits of the promising technology. This review discusses the current implementations, studies, potential benefits and challenges of MRgRT.
Collapse
Affiliation(s)
- Stephen Chin
- Department of Clinical Oncology, The Christie NHS Foundation Trust, Manchester, UK
- Westmead Clinical School, University of Sydney, Sydney, New South Wales, Australia
| | - Cynthia L Eccles
- Department of Radiotherapy, The Christie NHS Foundation Trust, Manchester, UK
- Division of Cancer Sciences, The University of Manchester, Manchester, UK
| | - Alan McWilliam
- Division of Cancer Sciences, The University of Manchester, Manchester, UK
- Christie Medical Physics and Engineering, The Christie NHS Foundation Trust, Manchester, UK
| | - Robert Chuter
- Division of Cancer Sciences, The University of Manchester, Manchester, UK
- Christie Medical Physics and Engineering, The Christie NHS Foundation Trust, Manchester, UK
| | - Emma Walker
- Christie Medical Physics and Engineering, The Christie NHS Foundation Trust, Manchester, UK
| | - Philip Whitehurst
- Christie Medical Physics and Engineering, The Christie NHS Foundation Trust, Manchester, UK
| | - Joseph Berresford
- Christie Medical Physics and Engineering, The Christie NHS Foundation Trust, Manchester, UK
| | - Marcel Van Herk
- Division of Cancer Sciences, The University of Manchester, Manchester, UK
- Christie Medical Physics and Engineering, The Christie NHS Foundation Trust, Manchester, UK
| | - Peter J Hoskin
- Department of Clinical Oncology, The Christie NHS Foundation Trust, Manchester, UK
- Division of Cancer Sciences, The University of Manchester, Manchester, UK
| | - Ananya Choudhury
- Department of Clinical Oncology, The Christie NHS Foundation Trust, Manchester, UK
- Division of Cancer Sciences, The University of Manchester, Manchester, UK
| |
Collapse
|
19
|
El Naqa I, Haider MA, Giger ML, Ten Haken RK. Artificial Intelligence: reshaping the practice of radiological sciences in the 21st century. Br J Radiol 2020; 93:20190855. [PMID: 31965813 PMCID: PMC7055429 DOI: 10.1259/bjr.20190855] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Revised: 01/12/2020] [Accepted: 01/13/2020] [Indexed: 12/15/2022] Open
Abstract
Advances in computing hardware and software platforms have led to the recent resurgence in artificial intelligence (AI) touching almost every aspect of our daily lives by its capability for automating complex tasks or providing superior predictive analytics. AI applications are currently spanning many diverse fields from economics to entertainment, to manufacturing, as well as medicine. Since modern AI's inception decades ago, practitioners in radiological sciences have been pioneering its development and implementation in medicine, particularly in areas related to diagnostic imaging and therapy. In this anniversary article, we embark on a journey to reflect on the learned lessons from past AI's chequered history. We further summarize the current status of AI in radiological sciences, highlighting, with examples, its impressive achievements and effect on re-shaping the practice of medical imaging and radiotherapy in the areas of computer-aided detection, diagnosis, prognosis, and decision support. Moving beyond the commercial hype of AI into reality, we discuss the current challenges to overcome, for AI to achieve its promised hope of providing better precision healthcare for each patient while reducing cost burden on their families and the society at large.
Collapse
Affiliation(s)
- Issam El Naqa
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, USA
| | - Masoom A Haider
- Department of Medical Imaging and Lunenfeld-Tanenbaum Research Institute, University of Toronto, Toronto, ON, Canada
| | | | - Randall K Ten Haken
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
20
|
Pillai M, Adapa K, Das SK, Mazur L, Dooley J, Marks LB, Thompson RF, Chera BS. Using Artificial Intelligence to Improve the Quality and Safety of Radiation Therapy. J Am Coll Radiol 2019; 16:1267-1272. [DOI: 10.1016/j.jacr.2019.06.001] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Accepted: 06/03/2019] [Indexed: 02/06/2023]
|
21
|
Current issues regarding artificial intelligence in cancer and health care. Implications for medical physicists and biomedical engineers. HEALTH AND TECHNOLOGY 2019. [DOI: 10.1007/s12553-019-00348-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|
22
|
Luo Y, Tseng HH, Cui S, Wei L, Ten Haken RK, El Naqa I. Balancing accuracy and interpretability of machine learning approaches for radiation treatment outcomes modeling. BJR Open 2019; 1:20190021. [PMID: 33178948 PMCID: PMC7592485 DOI: 10.1259/bjro.20190021] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Revised: 06/18/2019] [Accepted: 06/25/2019] [Indexed: 12/17/2022] Open
Abstract
Radiation outcomes prediction (ROP) plays an important role in personalized prescription and adaptive radiotherapy. A clinical decision may not only depend on an accurate radiation outcomes’ prediction, but also needs to be made based on an informed understanding of the relationship among patients’ characteristics, radiation response and treatment plans. As more patients’ biophysical information become available, machine learning (ML) techniques will have a great potential for improving ROP. Creating explainable ML methods is an ultimate task for clinical practice but remains a challenging one. Towards complete explainability, the interpretability of ML approaches needs to be first explored. Hence, this review focuses on the application of ML techniques for clinical adoption in radiation oncology by balancing accuracy with interpretability of the predictive model of interest. An ML algorithm can be generally classified into an interpretable (IP) or non-interpretable (NIP) (“black box”) technique. While the former may provide a clearer explanation to aid clinical decision-making, its prediction performance is generally outperformed by the latter. Therefore, great efforts and resources have been dedicated towards balancing the accuracy and the interpretability of ML approaches in ROP, but more still needs to be done. In this review, current progress to increase the accuracy for IP ML approaches is introduced, and major trends to improve the interpretability and alleviate the “black box” stigma of ML in radiation outcomes modeling are summarized. Efforts to integrate IP and NIP ML approaches to produce predictive models with higher accuracy and interpretability for ROP are also discussed.
Collapse
Affiliation(s)
- Yi Luo
- Department of Radiation Oncology, University of Michigan, 519 W William Street, Ann Arbor, MI, USA
| | - Huan-Hsin Tseng
- Department of Radiation Oncology, University of Michigan, 519 W William Street, Ann Arbor, MI, USA
| | - Sunan Cui
- Department of Radiation Oncology, University of Michigan, 519 W William Street, Ann Arbor, MI, USA
| | - Lise Wei
- Department of Radiation Oncology, University of Michigan, 519 W William Street, Ann Arbor, MI, USA
| | - Randall K Ten Haken
- Department of Radiation Oncology, University of Michigan, 519 W William Street, Ann Arbor, MI, USA
| | - Issam El Naqa
- Department of Radiation Oncology, University of Michigan, 519 W William Street, Ann Arbor, MI, USA
| |
Collapse
|
23
|
Jarrett D, Stride E, Vallis K, Gooding MJ. Applications and limitations of machine learning in radiation oncology. Br J Radiol 2019; 92:20190001. [PMID: 31112393 PMCID: PMC6724618 DOI: 10.1259/bjr.20190001] [Citation(s) in RCA: 76] [Impact Index Per Article: 15.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
Machine learning approaches to problem-solving are growing rapidly within healthcare, and radiation oncology is no exception. With the burgeoning interest in machine learning comes the significant risk of misaligned expectations as to what it can and cannot accomplish. This paper evaluates the role of machine learning and the problems it solves within the context of current clinical challenges in radiation oncology. The role of learning algorithms within the workflow for external beam radiation therapy are surveyed, considering simulation imaging, multimodal fusion, image segmentation, treatment planning, quality assurance, and treatment delivery and adaptation. For each aspect, the clinical challenges faced, the learning algorithms proposed, and the successes and limitations of various approaches are analyzed. It is observed that machine learning has largely thrived on reproducibly mimicking conventional human-driven solutions with more efficiency and consistency. On the other hand, since algorithms are generally trained using expert opinion as ground truth, machine learning is of limited utility where problems or ground truths are not well-defined, or if suitable measures of correctness are not available. As a result, machines may excel at replicating, automating and standardizing human behaviour on manual chores, meanwhile the conceptual clinical challenges relating to definition, evaluation, and judgement remain in the realm of human intelligence and insight.
Collapse
Affiliation(s)
- Daniel Jarrett
- 1 Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, UK.,2 Mirada Medical Ltd, Oxford, UK
| | - Eleanor Stride
- 1 Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, UK
| | - Katherine Vallis
- 3 Department of Oncology, Oxford Institute for Radiation Oncology, University of Oxford, UK
| | | |
Collapse
|
24
|
Rattan R, Kataria T, Banerjee S, Goyal S, Gupta D, Pandita A, Bisht S, Narang K, Mishra SR. Artificial intelligence in oncology, its scope and future prospects with specific reference to radiation oncology. BJR Open 2019; 1:20180031. [PMID: 33178922 PMCID: PMC7592433 DOI: 10.1259/bjro.20180031] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2018] [Revised: 04/01/2019] [Accepted: 04/12/2019] [Indexed: 01/02/2023] Open
Abstract
OBJECTIVE Artificial intelligence (AI) seems to be bridging the gap between the acquisition of data and its meaningful interpretation. These approaches, have shown outstanding capabilities, outperforming most classification and regression methods to date and the ability to automatically learn the most suitable data representation for the task at hand and present it for better correlation. This article tries to sensitize the practising radiation oncologists to understand where the potential role of AI lies and what further can be achieved with it. METHODS AND MATERIALS Contemporary literature was searched and the available literature was sorted and an attempt at writing a comprehensive non-systematic review was made. RESULTS The article addresses various areas in oncology, especially in the field of radiation oncology, where the work based on AI has been done. Whether it's the screening modalities, or diagnosis or the prognostic assays, AI has come with more accurately defining results and survival of patients. Various steps and protocols in radiation oncology are now using AI-based methods, like in the steps of planning, segmentation and delivery of radiation. Benefit of AI across all the platforms of health sector may lead to a more refined and personalized medicine in near future. CONCLUSION AI with the use of machine learning and artificial neural networks has come up with faster and more accurate solutions for the problems faced by oncologist. The uses of AI,are likely to get increased exponentially . However, concerns regarding demographic discrepancies in relation to patients, disease and their natural history and reports of manipulation of AI, the ultimate responsibility will rest on the treating physicians.
Collapse
Affiliation(s)
- Rajit Rattan
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Tejinder Kataria
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Susovan Banerjee
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Shikha Goyal
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Deepak Gupta
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | - Akshi Pandita
- Department of Dermatology, P. N. Behl Skin Institute, New Delhi, India
| | - Shyam Bisht
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
- Department of Dermatology, P. N. Behl Skin Institute, New Delhi, India
| | - Kushal Narang
- Division of Radiation Oncology, Medanta- The Medicity, Gurgaon, Haryana, India
| | | |
Collapse
|
25
|
Kalet AM, Luk SMH, Phillips MH. Radiation Therapy Quality Assurance Tasks and Tools: The Many Roles of Machine Learning. Med Phys 2019; 47:e168-e177. [DOI: 10.1002/mp.13445] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2018] [Revised: 01/14/2019] [Accepted: 02/02/2019] [Indexed: 12/12/2022] Open
Affiliation(s)
- Alan M. Kalet
- Department of Radiation Oncology University of Washington Medical Center Seattle WA 98195 USA
| | - Samuel M. H. Luk
- Department of Radiation Oncology University of Washington Medical Center Seattle WA 98195 USA
| | - Mark H. Phillips
- Department of Radiation Oncology University of Washington Medical Center Seattle WA 98195 USA
| |
Collapse
|