1
|
Hurkmans C, Bibault JE, Brock KK, van Elmpt W, Feng M, David Fuller C, Jereczek-Fossa BA, Korreman S, Landry G, Madesta F, Mayo C, McWilliam A, Moura F, Muren LP, El Naqa I, Seuntjens J, Valentini V, Velec M. A joint ESTRO and AAPM guideline for development, clinical validation and reporting of artificial intelligence models in radiation therapy. Radiother Oncol 2024; 197:110345. [PMID: 38838989 DOI: 10.1016/j.radonc.2024.110345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 05/23/2024] [Indexed: 06/07/2024]
Abstract
BACKGROUND AND PURPOSE Artificial Intelligence (AI) models in radiation therapy are being developed with increasing pace. Despite this, the radiation therapy community has not widely adopted these models in clinical practice. A cohesive guideline on how to develop, report and clinically validate AI algorithms might help bridge this gap. METHODS AND MATERIALS A Delphi process with all co-authors was followed to determine which topics should be addressed in this comprehensive guideline. Separate sections of the guideline, including Statements, were written by subgroups of the authors and discussed with the whole group at several meetings. Statements were formulated and scored as highly recommended or recommended. RESULTS The following topics were found most relevant: Decision making, image analysis, volume segmentation, treatment planning, patient specific quality assurance of treatment delivery, adaptive treatment, outcome prediction, training, validation and testing of AI model parameters, model availability for others to verify, model quality assurance/updates and upgrades, ethics. Key references were given together with an outlook on current hurdles and possibilities to overcome these. 19 Statements were formulated. CONCLUSION A cohesive guideline has been written which addresses main topics regarding AI in radiation therapy. It will help to guide development, as well as transparent and consistent reporting and validation of new AI tools and facilitate adoption.
Collapse
Affiliation(s)
- Coen Hurkmans
- Department of Radiation Oncology, Catharina Hospital, Eindhoven, the Netherlands; Department of Electrical Engineering, Technical University Eindhoven, Eindhoven, the Netherlands.
| | | | - Kristy K Brock
- Departments of Imaging Physics and Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Wouter van Elmpt
- Department of Radiation Oncology (MAASTRO), GROW - School for Oncology and Reproduction, Maastricht University Medical Centre+, Maastricht, the Netherlands
| | - Mary Feng
- University of California San Francisco, San Francisco, CA, USA
| | - Clifton David Fuller
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer, Houston, TX
| | - Barbara A Jereczek-Fossa
- Dept. of Oncology and Hemato-oncology, University of Milan, Milan, Italy; Dept. of Radiation Oncology, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Stine Korreman
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark; Danish Center for Particle Therapy, Aarhus University Hospital, Aarhus, Denmark
| | - Guillaume Landry
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Munich, Germany; German Cancer Consortium (DKTK), Partner Site Munich, a Partnership between DKFZ and LMU University Hospital Munich, Germany; Bavarian Cancer Research Center (BZKF), Partner Site Munich, Munich, Germany
| | - Frederic Madesta
- Department of Computational Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany; Institute for Applied Medical Informatics, University Medical Center Hamburg-Eppendorf, Hamburg, Germany; Center for Biomedical Artificial Intelligence (bAIome), University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Chuck Mayo
- Institute for Healthcare Policy and Innovation, University of Michigan, USA
| | - Alan McWilliam
- Division of Cancer Sciences, The University of Manchester, Manchester, UK
| | - Filipe Moura
- CrossI&D Lisbon Research Center, Portuguese Red Cross Higher Health School Lisbon, Portugal
| | - Ludvig P Muren
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark; Danish Center for Particle Therapy, Aarhus University Hospital, Aarhus, Denmark
| | - Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL 33612, USA
| | - Jan Seuntjens
- Princess Margaret Cancer Centre, Radiation Medicine Program, University Health Network & Departments of Radiation Oncology and Medical Biophysics, University of Toronto, Toronto, Canada
| | - Vincenzo Valentini
- Department of Diagnostic Imaging, Oncological Radiotherapy and Hematology, Fondazione Policlinico Universitario "Agostino Gemelli" IRCCS, Rome, Italy; Università Cattolica del Sacro Cuore, Rome, Italy
| | - Michael Velec
- Radiation Medicine Program, Princess Margaret Cancer Centre and Department of Radiation Oncology, University of Toronto, Toronto, Canada
| |
Collapse
|
2
|
Baydoun A, Jia AY, Zaorsky NG, Kashani R, Rao S, Shoag JE, Vince RA, Bittencourt LK, Zuhour R, Price AT, Arsenault TH, Spratt DE. Artificial intelligence applications in prostate cancer. Prostate Cancer Prostatic Dis 2024; 27:37-45. [PMID: 37296271 DOI: 10.1038/s41391-023-00684-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Revised: 05/05/2023] [Accepted: 05/30/2023] [Indexed: 06/12/2023]
Abstract
Artificial intelligence (AI) applications have enabled remarkable advancements in healthcare delivery. These AI tools are often aimed to improve accuracy and efficiency of histopathology assessment and diagnostic imaging interpretation, risk stratification (i.e., prognostication), and prediction of therapeutic benefit for personalized treatment recommendations. To date, multiple AI algorithms have been explored for prostate cancer to address automation of clinical workflow, integration of data from multiple domains in the decision-making process, and the generation of diagnostic, prognostic, and predictive biomarkers. While many studies remain within the pre-clinical space or lack validation, the last few years have witnessed the emergence of robust AI-based biomarkers validated on thousands of patients, and the prospective deployment of clinically-integrated workflows for automated radiation therapy design. To advance the field forward, multi-institutional and multi-disciplinary collaborations are needed in order to prospectively implement interoperable and accountable AI technology routinely in clinic.
Collapse
Affiliation(s)
- Atallah Baydoun
- Department of Radiation Oncology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Angela Y Jia
- Department of Radiation Oncology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Nicholas G Zaorsky
- Department of Radiation Oncology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Rojano Kashani
- Department of Radiation Oncology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Santosh Rao
- Department of Medicine, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Jonathan E Shoag
- Department of Urology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Randy A Vince
- Department of Urology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Leonardo Kayat Bittencourt
- Department of Radiology, University Hospitals Cleveland Medical Center Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Raed Zuhour
- Department of Radiation Oncology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Alex T Price
- Department of Radiation Oncology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Theodore H Arsenault
- Department of Radiation Oncology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Daniel E Spratt
- Department of Radiation Oncology, University Hospitals Seidman Cancer Center, Case Western Reserve University, Cleveland, OH, 44106, USA.
| |
Collapse
|
3
|
Teng L, Wang B, Xu X, Zhang J, Mei L, Feng Q, Shen D. Beam-wise dose composition learning for head and neck cancer dose prediction in radiotherapy. Med Image Anal 2024; 92:103045. [PMID: 38071865 DOI: 10.1016/j.media.2023.103045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Revised: 10/12/2023] [Accepted: 11/27/2023] [Indexed: 01/12/2024]
Abstract
Automatic and accurate dose distribution prediction plays an important role in radiotherapy plan. Although previous methods can provide promising performance, most methods did not consider beam-shaped radiation of treatment delivery in clinical practice. This leads to inaccurate prediction, especially on beam paths. To solve this problem, we propose a beam-wise dose composition learning (BDCL) method for dose prediction in the context of head and neck (H&N) radiotherapy plan. Specifically, a global dose network is first utilized to predict coarse dose values in the whole-image space. Then, we propose to generate individual beam masks to decompose the coarse dose distribution into multiple field doses, called beam voters, which are further refined by a subsequent beam dose network and reassembled to form the final dose distribution. In particular, we design an overlap consistency module to keep the similarity of high-level features in overlapping regions between different beam voters. To make the predicted dose distribution more consistent with the real radiotherapy plan, we also propose a dose-volume histogram (DVH) calibration process to facilitate feature learning in some clinically concerned regions. We further apply an edge enhancement procedure to enhance the learning of the extracted feature from the dose falloff regions. Experimental results on a public H&N cancer dataset from the AAPM OpenKBP challenge show that our method achieves superior performance over other state-of-the-art approaches by significant margins. Source code is released at https://github.com/TL9792/BDCLDosePrediction.
Collapse
Affiliation(s)
- Lin Teng
- School of Biomedical Engineering, ShanghaiTech University, Shanghai 201210, China; School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Bin Wang
- School of Biomedical Engineering, ShanghaiTech University, Shanghai 201210, China
| | - Xuanang Xu
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180, USA
| | - Jiadong Zhang
- School of Biomedical Engineering, ShanghaiTech University, Shanghai 201210, China
| | - Lanzhuju Mei
- School of Biomedical Engineering, ShanghaiTech University, Shanghai 201210, China
| | - Qianjin Feng
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Dinggang Shen
- School of Biomedical Engineering, ShanghaiTech University, Shanghai 201210, China; Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai 200230, China; Shanghai Clinical Research and Trial Center, Shanghai 201210, China.
| |
Collapse
|
4
|
Cella L, Monti S, Pacelli R, Palma G. Modeling frameworks for radiation induced lymphopenia: A critical review. Radiother Oncol 2024; 190:110041. [PMID: 38042499 DOI: 10.1016/j.radonc.2023.110041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 11/17/2023] [Accepted: 11/25/2023] [Indexed: 12/04/2023]
Abstract
Radiation-induced lymphopenia (RIL) is a frequent, and often considered unavoidable, side effect of radiation therapy (RT), whether or not chemotherapy is included. However, in the last few years several studies have demonstrated the detrimental effect of RIL on therapeutic outcomes, with conflicting findings concerning possible inferior patient survival. In addition, since immunotherapeutic treatment has become an integral part of cancer therapy, preserving the immune system is recognized as crucial. Given this background, various research groups have reported on different frameworks for modelling RIL, frequently based on different definitions of RIL itself, and discordant results have been reported. Our aim is to critically review the current literature on RIL modelling and summarize the different approaches recently proposed to improve the prediction of RIL after RT and aimed at immunity-sparing RT. A detailed description of these approaches will be outlined and illustrated through their applications as found in the literature from the last five years. Such a critical analysis represents the necessary starting step to develop an effective strategy that ultimately could harmonize the diverse modelling methods.
Collapse
Affiliation(s)
- Laura Cella
- Institute of Biostructures and Bioimaging, National Research Council, Naples, Italy.
| | - Serena Monti
- Institute of Biostructures and Bioimaging, National Research Council, Naples, Italy
| | - Roberto Pacelli
- Department of Advanced Biomedical Sciences, Federico II School of Medicine, Naples, Italy
| | - Giuseppe Palma
- Institute of Nanotechnology, National Research Council, Lecce, Italy
| |
Collapse
|
5
|
El Naqa I, Karolak A, Luo Y, Folio L, Tarhini AA, Rollison D, Parodi K. Translation of AI into oncology clinical practice. Oncogene 2023; 42:3089-3097. [PMID: 37684407 DOI: 10.1038/s41388-023-02826-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Revised: 08/23/2023] [Accepted: 08/25/2023] [Indexed: 09/10/2023]
Abstract
Artificial intelligence (AI) is a transformative technology that is capturing popular imagination and can revolutionize biomedicine. AI and machine learning (ML) algorithms have the potential to break through existing barriers in oncology research and practice such as automating workflow processes, personalizing care, and reducing healthcare disparities. Emerging applications of AI/ML in the literature include screening and early detection of cancer, disease diagnosis, response prediction, prognosis, and accelerated drug discovery. Despite this excitement, only few AI/ML models have been properly validated and fewer have become regulated products for routine clinical use. In this review, we highlight the main challenges impeding AI/ML clinical translation. We present different clinical use cases from the domains of radiology, radiation oncology, immunotherapy, and drug discovery in oncology. We dissect the unique challenges and opportunities associated with each of these cases. Finally, we summarize the general requirements for successful AI/ML implementation in the clinic, highlighting specific examples and points of emphasis including the importance of multidisciplinary collaboration of stakeholders, role of domain experts in AI augmentation, transparency of AI/ML models, and the establishment of a comprehensive quality assurance program to mitigate risks of training bias and data drifts, all culminating toward safer and more beneficial AI/ML applications in oncology labs and clinics.
Collapse
Affiliation(s)
- Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA.
| | - Aleksandra Karolak
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Yi Luo
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Les Folio
- Diagnostic Imaging & Interventional Radiology, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Ahmad A Tarhini
- Cutaneous Oncology and Immunology, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Dana Rollison
- Department of Cancer Epidemiology, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Katia Parodi
- Department of Medical Physics, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
6
|
Drabiak K, Kyzer S, Nemov V, El Naqa I. AI and machine learning ethics, law, diversity, and global impact. Br J Radiol 2023; 96:20220934. [PMID: 37191072 PMCID: PMC10546451 DOI: 10.1259/bjr.20220934] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 03/20/2023] [Accepted: 03/29/2023] [Indexed: 05/17/2023] Open
Abstract
Artificial intelligence (AI) and its machine learning (ML) algorithms are offering new promise for personalized biomedicine and more cost-effective healthcare with impressive technical capability to mimic human cognitive capabilities. However, widespread application of this promising technology has been limited in the medical domain and expectations have been tampered by ethical challenges and concerns regarding patient privacy, legal responsibility, trustworthiness, and fairness. To balance technical innovation with ethical applications of AI/ML, developers must demonstrate the AI functions as intended and adopt strategies to minimize the risks for failure or bias. This review describes the new ethical challenges created by AI/ML for clinical care and identifies specific considerations for its practice in medicine. We provide an overview of regulatory and legal issues applicable in Europe and the United States, a description of technical aspects to consider, and present recommendations for trustworthy AI/ML that promote transparency, minimize risks of bias or error, and protect the patient well-being.
Collapse
Affiliation(s)
- Katherine Drabiak
- Colleges of Public Health and Medicine, University of South Florida, Tampa, FL, USA
| | - Skylar Kyzer
- Colleges of Public Health and Medicine, University of South Florida, Tampa, FL, USA
| | - Valerie Nemov
- Colleges of Public Health and Medicine, University of South Florida, Tampa, FL, USA
| | - Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, USA
| |
Collapse
|
7
|
Ger RB, Wei L, Naqa IE, Wang J. The Promise and Future of Radiomics for Personalized Radiotherapy Dosing and Adaptation. Semin Radiat Oncol 2023; 33:252-261. [PMID: 37331780 PMCID: PMC11214660 DOI: 10.1016/j.semradonc.2023.03.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/20/2023]
Abstract
Quantitative image analysis, also known as radiomics, aims to analyze large-scale quantitative features extracted from acquired medical images using hand-crafted or machine-engineered feature extraction approaches. Radiomics has great potential for a variety of clinical applications in radiation oncology, an image-rich treatment modality that utilizes computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET) for treatment planning, dose calculation, and image guidance. A promising application of radiomics is in predicting treatment outcomes after radiotherapy such as local control and treatment-related toxicity using features extracted from pretreatment and on-treatment images. Based on these individualized predictions of treatment outcomes, radiotherapy dose can be sculpted to meet the specific needs and preferences of each patient. Radiomics can aid in tumor characterization for personalized targeting, especially for identifying high-risk regions within a tumor that cannot be easily discerned based on size or intensity alone. Radiomics-based treatment response prediction can aid in developing personalized fractionation and dose adjustments. In order to make radiomics models more applicable across different institutions with varying scanners and patient populations, further efforts are needed to harmonize and standardize the acquisition protocols by minimizing uncertainties within the imaging data.
Collapse
Affiliation(s)
- Rachel B Ger
- Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins Medicine, Baltimore, MD
| | - Lise Wei
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI
| | - Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center and Research Institute, Tampa, FL
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX..
| |
Collapse
|
8
|
Mattonen S, Naqa IE, Hu W, Troost E. "Evolving role of AI in radiation oncology"- special collection - introductory Editorial. BJR Open 2022; 4:20229002. [PMID: 38525171 PMCID: PMC10958999 DOI: 10.1259/bjro.20229002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Affiliation(s)
| | | | - Weigang Hu
- Fudan University Shanghai Cancer Center, Shanghai, China
| | | |
Collapse
|
9
|
Artificial Intelligence for Outcome Modeling in Radiotherapy. Semin Radiat Oncol 2022; 32:351-364. [DOI: 10.1016/j.semradonc.2022.06.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
10
|
Zhang X, Zhang Y, Zhang G, Qiu X, Tan W, Yin X, Liao L. Prospective clinical research of radiomics and deep learning in oncology: A translational review. Crit Rev Oncol Hematol 2022; 179:103823. [PMID: 36152912 DOI: 10.1016/j.critrevonc.2022.103823] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 09/13/2022] [Accepted: 09/20/2022] [Indexed: 10/31/2022] Open
Abstract
Radiomics and deep learning (DL) hold transformative promise and substantial and significant advances in oncology; however, most methods have been tested in retrospective or simulated settings. There is considerable interest in the biomarker validation, clinical utility, and methodological robustness of these studies and their deployment in real-world settings. This review summarizes the characteristics of studies, the level of prospective validation, and the overview of research on different clinical endpoints. The discussion of methodological robustness shows the potential for independent external replication of prospectively reported results. These in-depth analyses further describe the barriers limiting the translation of radiomics and DL into primary care options and provide specific recommendations regarding clinical deployment. Finally, we propose solutions for integrating novel approaches into the treatment environment to unravel the critical process of translating AI models into the clinical routine and explore strategies to improve personalized medicine.
Collapse
Affiliation(s)
- Xingping Zhang
- Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou 510006, China; Department of New Networks, Peng Cheng Laboratory, Shenzhen 518000, China
| | - Yanchun Zhang
- Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou 510006, China; Department of New Networks, Peng Cheng Laboratory, Shenzhen 518000, China; Institute for Sustainable Industries & Liveable Cities, Victoria University, Melbourne, VIC 8001, Australia.
| | - Guijuan Zhang
- Department of Respiratory Medicine, First Affiliated Hospital of Gannan Medical University, Ganzhou 341000, China
| | - Xingting Qiu
- Department of Radiology, First Affiliated Hospital of Gannan Medical University, Ganzhou 341000, China
| | - Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang 110189, China
| | - Xiaoxia Yin
- Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou 510006, China
| | - Liefa Liao
- School of Software Engineering, Jiangxi University of Science and Technology, Nanchang 330000, China; School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou 341000, China
| |
Collapse
|
11
|
Pettit RW, Fullem R, Cheng C, Amos CI. Artificial intelligence, machine learning, and deep learning for clinical outcome prediction. Emerg Top Life Sci 2021; 5:ETLS20210246. [PMID: 34927670 PMCID: PMC8786279 DOI: 10.1042/etls20210246] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 12/03/2021] [Accepted: 12/07/2021] [Indexed: 12/12/2022]
Abstract
AI is a broad concept, grouping initiatives that use a computer to perform tasks that would usually require a human to complete. AI methods are well suited to predict clinical outcomes. In practice, AI methods can be thought of as functions that learn the outcomes accompanying standardized input data to produce accurate outcome predictions when trialed with new data. Current methods for cleaning, creating, accessing, extracting, augmenting, and representing data for training AI clinical prediction models are well defined. The use of AI to predict clinical outcomes is a dynamic and rapidly evolving arena, with new methods and applications emerging. Extraction or accession of electronic health care records and combining these with patient genetic data is an area of present attention, with tremendous potential for future growth. Machine learning approaches, including decision tree methods of Random Forest and XGBoost, and deep learning techniques including deep multi-layer and recurrent neural networks, afford unique capabilities to accurately create predictions from high dimensional, multimodal data. Furthermore, AI methods are increasing our ability to accurately predict clinical outcomes that previously were difficult to model, including time-dependent and multi-class outcomes. Barriers to robust AI-based clinical outcome model deployment include changing AI product development interfaces, the specificity of regulation requirements, and limitations in ensuring model interpretability, generalizability, and adaptability over time.
Collapse
Affiliation(s)
- Rowland W. Pettit
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
| | - Robert Fullem
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, U.S.A
| | - Chao Cheng
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
- Section of Epidemiology and Population Sciences, Department of Medicine, Baylor College of Medicine, Houston, TX, U.S.A
| | - Christopher I. Amos
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
- Section of Epidemiology and Population Sciences, Department of Medicine, Baylor College of Medicine, Houston, TX, U.S.A
- Dan L Duncan Comprehensive Cancer Center, Baylor College of Medicine, Houston, TX, U.S.A
| |
Collapse
|
12
|
Niraula D, Jamaluddin J, Matuszak MM, Haken RKT, Naqa IE. Quantum deep reinforcement learning for clinical decision support in oncology: application to adaptive radiotherapy. Sci Rep 2021; 11:23545. [PMID: 34876609 PMCID: PMC8651664 DOI: 10.1038/s41598-021-02910-y] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Accepted: 11/24/2021] [Indexed: 01/31/2023] Open
Abstract
Subtle differences in a patient's genetics and physiology may alter radiotherapy (RT) treatment responses, motivating the need for a more personalized treatment plan. Accordingly, we have developed a novel quantum deep reinforcement learning (qDRL) framework for clinical decision support that can estimate an individual patient's dose response mid-treatment and recommend an optimal dose adjustment. Our framework considers patients' specific information including biological, physical, genetic, clinical, and dosimetric factors. Recognizing that physicians must make decisions amidst uncertainty in RT treatment outcomes, we employed indeterministic quantum states to represent human decision making in a real-life scenario. We paired quantum decision states with a model-based deep q-learning algorithm to optimize the clinical decision-making process in RT. We trained our proposed qDRL framework on an institutional dataset of 67 stage III non-small cell lung cancer (NSCLC) patients treated on prospective adaptive protocols and independently validated our framework in an external multi-institutional dataset of 174 NSCLC patients. For a comprehensive evaluation, we compared three frameworks: DRL, qDRL trained in a Qiskit quantum computing simulator, and qDRL trained in an IBM quantum computer. Two metrics were considered to evaluate our framework: (1) similarity score, defined as the root mean square error between retrospective clinical decisions and the AI recommendations, and (2) self-evaluation scheme that compares retrospective clinical decisions and AI recommendations based on the improvement in the observed clinical outcomes. Our analysis shows that our framework, which takes into consideration individual patient dose response in its decision-making, can potentially improve clinical RT decision-making by at least about 10% compared to unaided clinical practice. Further validation of our novel quantitative approach in a prospective study will provide a necessary framework for improving the standard of care in personalized RT.
Collapse
Affiliation(s)
- Dipesh Niraula
- Department of Machine Learning, H. Lee Moffitt Cancer Center and Research Institute, Tampa, FL, 33612, USA.
| | - Jamalina Jamaluddin
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Martha M Matuszak
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Randall K Ten Haken
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Issam El Naqa
- Department of Machine Learning, H. Lee Moffitt Cancer Center and Research Institute, Tampa, FL, 33612, USA
| |
Collapse
|
13
|
El Naqa I, Li H, Fuhrman J, Hu Q, Gorre N, Chen W, Giger ML. Lessons learned in transitioning to AI in the medical imaging of COVID-19. J Med Imaging (Bellingham) 2021; 8:010902-10902. [PMID: 34646912 PMCID: PMC8488974 DOI: 10.1117/1.jmi.8.s1.010902] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Accepted: 09/20/2021] [Indexed: 12/12/2022] Open
Abstract
The coronavirus disease 2019 (COVID-19) pandemic has wreaked havoc across the world. It also created a need for the urgent development of efficacious predictive diagnostics, specifically, artificial intelligence (AI) methods applied to medical imaging. This has led to the convergence of experts from multiple disciplines to solve this global pandemic including clinicians, medical physicists, imaging scientists, computer scientists, and informatics experts to bring to bear the best of these fields for solving the challenges of the COVID-19 pandemic. However, such a convergence over a very brief period of time has had unintended consequences and created its own challenges. As part of Medical Imaging Data and Resource Center initiative, we discuss the lessons learned from career transitions across the three involved disciplines (radiology, medical imaging physics, and computer science) and draw recommendations based on these experiences by analyzing the challenges associated with each of the three associated transition types: (1) AI of non-imaging data to AI of medical imaging data, (2) medical imaging clinician to AI of medical imaging, and (3) AI of medical imaging to AI of COVID-19 imaging. The lessons learned from these career transitions and the diffusion of knowledge among them could be accomplished more effectively by recognizing their associated intricacies. These lessons learned in the transitioning to AI in the medical imaging of COVID-19 can inform and enhance future AI applications, making the whole of the transitions more than the sum of each discipline, for confronting an emergency like the COVID-19 pandemic or solving emerging problems in biomedicine.
Collapse
Affiliation(s)
- Issam El Naqa
- Moffitt Cancer Center, Department of Machine Learning, Tampa, Florida, United States
- The University of Chicago, Medical Imaging Data and Resource Center, Chicago, Illinois, United States
| | - Hui Li
- The University of Chicago, Medical Imaging Data and Resource Center, Chicago, Illinois, United States
- The University of Chicago, Department of Radiology, Chicago, Illinois, United States
| | - Jordan Fuhrman
- The University of Chicago, Medical Imaging Data and Resource Center, Chicago, Illinois, United States
- The University of Chicago, Department of Radiology, Chicago, Illinois, United States
| | - Qiyuan Hu
- The University of Chicago, Medical Imaging Data and Resource Center, Chicago, Illinois, United States
- The University of Chicago, Department of Radiology, Chicago, Illinois, United States
| | - Naveena Gorre
- Moffitt Cancer Center, Department of Machine Learning, Tampa, Florida, United States
- The University of Chicago, Medical Imaging Data and Resource Center, Chicago, Illinois, United States
| | - Weijie Chen
- The University of Chicago, Medical Imaging Data and Resource Center, Chicago, Illinois, United States
- US FDA, CDRH, Office of Science and Engineering Laboratories, Division of Imaging, Diagnosis, and Software Reliability, Silver Spring, Maryland, United States
| | - Maryellen L. Giger
- The University of Chicago, Medical Imaging Data and Resource Center, Chicago, Illinois, United States
- The University of Chicago, Department of Radiology, Chicago, Illinois, United States
| |
Collapse
|