1
|
Tompkins A, Gray ZN, Dadey RE, Zenkin S, Batavani N, Newman S, Amouzegar A, Ak M, Ak N, Pak TY, Peddagangireddy V, Mamindla P, Behr S, Goodman A, Ploucha DL, Kirkwood JM, Zarour HM, Najjar YG, Davar D, Colen R, Luke JJ, Bao R. Radiomic analysis of patient and inter-organ heterogeneity in response to immunotherapies and BRAF targeted therapy in metastatic melanoma. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.04.26.24306411. [PMID: 38712112 PMCID: PMC11071587 DOI: 10.1101/2024.04.26.24306411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
Background Variability in treatment response may be attributable to organ-level heterogeneity in tumor lesions. Radiomic analysis of medical images can elucidate non-invasive biomarkers of clinical outcome. Organ-specific radiomic comparison across immunotherapies and targeted therapies has not been previously reported. Methods We queried UPMC Hillman Cancer Center registry for patients with metastatic melanoma (MEL) treated with immune checkpoint inhibitors (ICI) (anti-PD1/CTLA4 [ipilimumab+nivolumab; I+N] or anti-PD1 monotherapy) or BRAF targeted therapy. Best overall response was measured using RECIST v1.1. Lesions were segmented into discrete volume-of-interest with 400 radiomics features extracted. Overall and organ-specific machine-learning models were constructed to predict disease control (DC) versus progressive disease (PD) using XGBoost. Results 291 MEL patients were identified, including 242 ICI (91 I+N, 151 PD1) and 49 BRAF. 667 metastases were analyzed, including 541 ICI (236 I+N, 305 PD1) and 126 BRAF. Across cohorts, baseline demographics included 39-47% female, 24-29% M1C, 24-46% M1D, and 61-80% with elevated LDH. Among patients experiencing DC, the organs with the greatest reduction were liver (-88%±12%, I+N; mean±S.E.M.) and lung (-72%±8%, I+N). For patients with multiple same-organ target lesions, the highest inter-lesion heterogeneity was observed in brain among patients who received ICI while no intra-organ heterogeneity was observed in BRAF. 267 patients were kept for radiomic modeling, including 221 ICI (86 I+N, 135 PD1) and 46 BRAF. Models consisting of optimized radiomic signatures classified DC/PD across I+N (AUC=0.85) and PD1 (0.71) and within individual organ sites (AUC=0.72∼0.94). Integration of clinical variables improved the models' performance. Comparison of models between treatments and across organ sites suggested mostly non-overlapping DC or PD features. Skewness, kurtosis, and informational measure of correlation (IMC) were among the radiomic features shared between overall response models. Kurtosis and IMC were also utilized by multiple organ-site models. Conclusions Differential organ-specific response was observed across BRAF and ICI with within organ heterogeneity observed for ICI but not for BRAF. Radiomic features of organ-specific response demonstrated little overlap. Integrating clinical factors with radiomics improves the prediction of disease course outcome and prediction of tumor heterogeneity.
Collapse
|
2
|
Du G, Zhang P, Guo J, Zhou X, Kan G, Jia J, Chen X, Liang J, Zhan Y. Exploring Radiomics Features Based on H&E Images as Potential Biomarkers for Evaluating Muscle Atrophy: A Preliminary Study. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01122-w. [PMID: 38653909 DOI: 10.1007/s10278-024-01122-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 04/11/2024] [Accepted: 04/12/2024] [Indexed: 04/25/2024]
Abstract
Radiomics features have been widely used as novel biomarkers in the diagnosis of various diseases, but whether radiomics features derived from hematoxylin and eosin (H&E) images can evaluate muscle atrophy has not been studied. Therefore, this study aims to establish a new biomarker based on H&E images using radiomics methods to quantitatively analyze H&E images, which is crucial for improving the accuracy of muscle atrophy assessment. Firstly, a weightless muscle atrophy model was established by laying macaques in bed, and H&E images of the shank muscle fibers of the control and bed rest (BR) macaques were collected. Muscle fibers were accurately segmented by designing a semi-supervised segmentation framework based on contrastive learning. Then, 77 radiomics features were extracted from the segmented muscle fibers, and a stable subset of features was selected through the LASSO method. Finally, the correlation between radiomics features and muscle atrophy was analyzed using a support vector machine (SVM) classifier. The semi-supervised segmentation results show that the proposed method had an average Spearman's and intra-class correlation coefficient (ICC) of 88% and 86% compared to manually extracted features, respectively. Radiomics analysis showed that the AUC of the muscle atrophy evaluation model based on H&E images was 96.87%. For individual features, GLSZM_SZE outperformed other features in terms of AUC (91.5%) and ACC (84.4%). In summary, the feature extraction based on the semi-supervised segmentation method is feasible and reliable for subsequent radiomics research. Texture features have greater advantages in evaluating muscle atrophy compared to other features. This study provides important biomarkers for accurate diagnosis of muscle atrophy.
Collapse
Affiliation(s)
- Getao Du
- School of Life Science and Technology, & Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xidian University, Xi'an, Shaanxi, 710126, China
| | - Peng Zhang
- National Key Laboratory of Space Medicine, China Astronaut Research and Training Center, Beijing, 100094, People's Republic of China
| | - Jianzhong Guo
- Institute of Applied Acoustics, School of Physics and Information Technology, Shaanxi Normal University, Xi'an, 710062, China
| | - Xu Zhou
- National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing, 100094, People's Republic of China
| | - Guanghan Kan
- National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing, 100094, People's Republic of China
| | - Jiajie Jia
- National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing, 100094, People's Republic of China
| | - Xiaoping Chen
- National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing, 100094, People's Republic of China.
| | - Jimin Liang
- School of Electronic Engineering, Xidian University, Xi'an, Shaanxi, 710071, China.
| | - Yonghua Zhan
- School of Life Science and Technology, & Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xidian University, Xi'an, Shaanxi, 710126, China.
| |
Collapse
|
3
|
Yee J, Rosendahl C, Aoude LG. The role of artificial intelligence and convolutional neural networks in the management of melanoma: a clinical, pathological, and radiological perspective. Melanoma Res 2024; 34:96-104. [PMID: 38141179 PMCID: PMC10906187 DOI: 10.1097/cmr.0000000000000951] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 11/29/2023] [Indexed: 12/25/2023]
Abstract
Clinical dermatoscopy and pathological slide assessment are essential in the diagnosis and management of patients with cutaneous melanoma. For those presenting with stage IIC disease and beyond, radiological investigations are often considered. The dermatoscopic, whole slide and radiological images used during clinical care are often stored digitally, enabling artificial intelligence (AI) and convolutional neural networks (CNN) to learn, analyse and contribute to the clinical decision-making. A keyword search of the Medline database was performed to assess the progression, capabilities and limitations of AI and CNN and its use in diagnosis and management of cutaneous melanoma. Full-text articles were reviewed if they related to dermatoscopy, pathological slide assessment or radiology. Through analysis of 95 studies, we demonstrate that diagnostic accuracy of AI/CNN can be superior (or at least equal) to clinicians. However, variability in image acquisition, pre-processing, segmentation, and feature extraction remains challenging. With current technological abilities, AI/CNN and clinicians synergistically working together are better than one another in all subspecialty domains relating to cutaneous melanoma. AI has the potential to enhance the diagnostic capabilities of junior dermatology trainees, primary care skin cancer clinicians and general practitioners. For experienced clinicians, AI provides a cost-efficient second opinion. From a pathological and radiological perspective, CNN has the potential to improve workflow efficiency, allowing clinicians to achieve more in a finite amount of time. Until the challenges of AI/CNN are reliably met, however, they can only remain an adjunct to clinical decision-making.
Collapse
Affiliation(s)
- Joshua Yee
- Faculty of Medicine, University of Queensland, St Lucia
| | - Cliff Rosendahl
- Primary Care Clinical Unit, Medical School, The University of Queensland, Herston
| | - Lauren G. Aoude
- Frazer Institute, The University of Queensland, Woolloongabba, QLD, Australia
| |
Collapse
|
4
|
Lu W, Wu G, Miao X, Ma J, Wang Y, Xu H, Shentu D, Xue S, Xia Q, Wang Y, Wang L. The radiomics nomogram predicts the prognosis of pancreatic cancer patients with hepatic metastasis after chemoimmunotherapy. Cancer Immunol Immunother 2024; 73:87. [PMID: 38554161 PMCID: PMC10981596 DOI: 10.1007/s00262-024-03644-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 01/29/2024] [Indexed: 04/01/2024]
Abstract
OBJECTIVE To construct a prognostic model based on MR features and clinical data to evaluate the progression free survival (PFS), overall survival (OS) and objective response rate (ORR) of pancreatic cancer patients with hepatic metastases who received chemoimmunotherapy. METHODS 105 pancreatic cancer patients with hepatic metastases who received chemoimmunotherapy were assigned to the training set (n = 52), validation set (n = 22), and testing set (n = 31). Multi-lesion volume of interest were delineated, multi-sequence radiomics features were extracted, and the radiomics models for predicting PFS, OS and ORR were constructed, respectively. Clinical variables were extracted, and the clinical models for predicting PFS, OS and ORR were constructed, respectively. The nomogram was jointly constructed by radiomics model and clinical model. RESULT The ORR exhibits no significant correlation with either PFS or OS. The area under the curve (AUC) of nomogram for predicting 6-month PFS reached 0.847 (0.737-0.957), 0.786 (0.566-1.000) and 0.864 (0.735-0.994) in the training set, validation set and testing set, respectively. The AUC of nomogram for predicting 1-year OS reached 0.770 (0.635-0.906), 0.743 (0.479-1.000) and 0.818 (0.630-1.000), respectively. The AUC of nomogram for predicting ORR reached 0.914 (0.828-1.00), 0.938 (0.840-1.00) and 0.846 (0.689-1.00), respectively. CONCLUSION The prognostic models based on MR imaging features and clinical data are effective in predicting the PFS, OS and ORR of chemoimmunotherapy in pancreatic cancer patients with hepatic metastasis, and can be used to evaluate the prognosis of patients.
Collapse
Affiliation(s)
- Wenxin Lu
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China
| | - Guangyu Wu
- Department of Radiology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China
| | - Xianyuan Miao
- Department of Oncology, Ning Bo Hangzhou Bay Hospital, Ningbo, 315336, China
| | - Jingyu Ma
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China
| | - Yanling Wang
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China
| | - Haiyan Xu
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China
| | - Daiyuan Shentu
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China
| | - Shengbai Xue
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China
| | - Qing Xia
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China
| | - Yu Wang
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China.
| | - Liwei Wang
- Department of Oncology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China.
- State Key Laboratory of Systems Medicine for Cancer of Shanghai Cancer Institute, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200127, China.
| |
Collapse
|
5
|
Ligero M, Gielen B, Navarro V, Cresta Morgado P, Prior O, Dienstmann R, Nuciforo P, Trebeschi S, Beets-Tan R, Sala E, Garralda E, Perez-Lopez R. A whirl of radiomics-based biomarkers in cancer immunotherapy, why is large scale validation still lacking? NPJ Precis Oncol 2024; 8:42. [PMID: 38383736 PMCID: PMC10881558 DOI: 10.1038/s41698-024-00534-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Accepted: 01/26/2024] [Indexed: 02/23/2024] Open
Abstract
The search for understanding immunotherapy response has sparked interest in diverse areas of oncology, with artificial intelligence (AI) and radiomics emerging as promising tools, capable of gathering large amounts of information to identify suitable patients for treatment. The application of AI in radiology has grown, driven by the hypothesis that radiology images capture tumor phenotypes and thus could provide valuable insights into immunotherapy response likelihood. However, despite the rapid growth of studies, no algorithms in the field have reached clinical implementation, mainly due to the lack of standardized methods, hampering study comparisons and reproducibility across different datasets. In this review, we performed a comprehensive assessment of published data to identify sources of variability in radiomics study design that hinder the comparison of the different model performance and, therefore, clinical implementation. Subsequently, we conducted a use-case meta-analysis using homogenous studies to assess the overall performance of radiomics in estimating programmed death-ligand 1 (PD-L1) expression. Our findings indicate that, despite numerous attempts to predict immunotherapy response, only a limited number of studies share comparable methodologies and report sufficient data about cohorts and methods to be suitable for meta-analysis. Nevertheless, although only a few studies meet these criteria, their promising results underscore the importance of ongoing standardization and benchmarking efforts. This review highlights the importance of uniformity in study design and reporting. Such standardization is crucial to enable meaningful comparisons and demonstrate the validity of biomarkers across diverse populations, facilitating their implementation into the immunotherapy patient selection process.
Collapse
Affiliation(s)
- Marta Ligero
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Bente Gielen
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Victor Navarro
- Oncology Data Science (ODysSey) Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Pablo Cresta Morgado
- Oncology Data Science (ODysSey) Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
- Department of Medical Oncology, Vall d'Hebron University Hospital and Institute of Oncology (VHIO), Barcelona, Spain
- Prostate Cancer Translational Research Group, Institute of Oncology (VHIO), Vall d'Hebron University Hospital, Barcelona, Spain
| | - Olivia Prior
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Rodrigo Dienstmann
- Oncology Data Science (ODysSey) Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Paolo Nuciforo
- Molecular Oncology Group, Vall d'Hebron University Hospital and Institute of Oncology (VHIO), Barcelona, Spain
| | - Stefano Trebeschi
- Department of Radiology, Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Reproduction, Maastricht University, Maastricht, The Netherlands
| | - Regina Beets-Tan
- Department of Radiology, Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Reproduction, Maastricht University, Maastricht, The Netherlands
- Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Evis Sala
- Dipartimento Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
- Dipartimento di Scienze Radiologiche ed Ematologiche, Universita Cattolica del Sacro Cuore, Rome, Italy
| | - Elena Garralda
- Department of Medical Oncology, Vall d'Hebron University Hospital and Institute of Oncology (VHIO), Barcelona, Spain
| | - Raquel Perez-Lopez
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain.
| |
Collapse
|
6
|
Peisen F, Gerken A, Dahm I, Nikolaou K, Eigentler T, Amaral T, Moltz JH, Othman AE, Gatidis S. Pre-treatment 18F-FDG-PET/CT parameters as biomarkers for progression free survival, best overall response and overall survival in metastatic melanoma patients undergoing first-line immunotherapy. PLoS One 2024; 19:e0296253. [PMID: 38180971 PMCID: PMC10769042 DOI: 10.1371/journal.pone.0296253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 12/08/2023] [Indexed: 01/07/2024] Open
Abstract
BACKGROUND Checkpoint inhibitors have drastically improved the therapy of patients with advanced melanoma. 18F-FDG-PET/CT parameters might act as biomarkers for response and survival and thus can identify patients that do not benefit from immunotherapy. However, little literature exists on the association of baseline 18F-FDG-PET/CT parameters with progression free survival (PFS), best overall response (BOR), and overall survival (OS). MATERIALS AND METHODS Using a whole tumor volume segmentation approach, we investigated in a retrospective registry study (n = 50) whether pre-treatment 18F-FDG-PET/CT parameters of three subgroups (tumor burden, tumor glucose uptake and non-tumoral hematopoietic tissue metabolism), can act as biomarkers for the primary endpoints PFS and BOR as well as for the secondary endpoint OS. RESULTS Compared to the sole use of clinical parameters, baseline 18F-FDG-PET/CT parameters did not significantly improve a Cox proportional-hazard model for PFS (C-index/AIC: 0.70/225.17 and 0.68/223.54, respectively; p = 0.14). A binomial logistic regression analysis for BOR was not statistically significant (χ2(15) = 16.44, p = 0.35), with a low amount of explained variance (Nagelkerke's R2 = 0.38). Mean FDG uptake of the spleen contributed significantly to a Cox proportional-hazard model for OS (HR 3.55, p = 0.04). CONCLUSIONS The present study could not confirm the capability of the pre-treatment 18F-FDG-PET/CT parameters tumor burden, tumor glucose uptake and non-tumoral hematopoietic tissue metabolism to act as biomarkers for PFS and BOR in metastatic melanoma patients receiving first-line immunotherapy. The documented potential of 18F-FDG uptake by immune-mediating tissues such as the spleen to act as a biomarker for OS has been reproduced.
Collapse
Affiliation(s)
- Felix Peisen
- Department of Diagnostic and Interventional Radiology, Eberhard Karls University, Tuebingen University Hospital, Tuebingen, Germany
| | | | - Isabel Dahm
- Department of Diagnostic and Interventional Radiology, Eberhard Karls University, Tuebingen University Hospital, Tuebingen, Germany
| | - Konstantin Nikolaou
- Department of Diagnostic and Interventional Radiology, Eberhard Karls University, Tuebingen University Hospital, Tuebingen, Germany
- Image-guided and Functionally Instructed Tumor Therapies (iFIT), The Cluster of Excellence (EXC 2180), Tuebingen, Germany
| | - Thomas Eigentler
- Center of Dermato-Oncology, Department of Dermatology, Eberhard Karls University, Tuebingen University Hospital, Tuebingen, Germany
- Department of Dermatology, Venereology and Allergology, Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humbolt-Universität zu Berlin, Berlin, Germany
| | - Teresa Amaral
- Center of Dermato-Oncology, Department of Dermatology, Eberhard Karls University, Tuebingen University Hospital, Tuebingen, Germany
| | | | - Ahmed E. Othman
- Department of Diagnostic and Interventional Radiology, Eberhard Karls University, Tuebingen University Hospital, Tuebingen, Germany
- Institute of Neuroradiology, Johannes Gutenberg University Hospital Mainz, Mainz, Germany
| | - Sergios Gatidis
- Department of Diagnostic and Interventional Radiology, Eberhard Karls University, Tuebingen University Hospital, Tuebingen, Germany
- Max Planck Institute for Intelligent Systems, Tuebingen, Germany
| |
Collapse
|
7
|
Poletto S, Paruzzo L, Nepote A, Caravelli D, Sangiolo D, Carnevale-Schianca F. Predictive Factors in Metastatic Melanoma Treated with Immune Checkpoint Inhibitors: From Clinical Practice to Future Perspective. Cancers (Basel) 2023; 16:101. [PMID: 38201531 PMCID: PMC10778365 DOI: 10.3390/cancers16010101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 12/11/2023] [Accepted: 12/21/2023] [Indexed: 01/12/2024] Open
Abstract
The introduction of immunotherapy revolutionized the treatment landscape in metastatic melanoma. Despite the impressive results associated with immune checkpoint inhibitors (ICIs), only a portion of patients obtain a response to this treatment. In this scenario, the research of predictive factors is fundamental to identify patients who may have a response and to exclude patients with a low possibility to respond. These factors can be host-associated, immune system activation-related, and tumor-related. Patient-related factors can vary from data obtained by medical history (performance status, age, sex, body mass index, concomitant medications, and comorbidities) to analysis of the gut microbiome from fecal samples. Tumor-related factors can reflect tumor burden (metastatic sites, lactate dehydrogenase, C-reactive protein, and circulating tumor DNA) or can derive from the analysis of tumor samples (driver mutations, tumor-infiltrating lymphocytes, and myeloid cells). Biomarkers evaluating the immune system activation, such as IFN-gamma gene expression profile and analysis of circulating immune cell subsets, have emerged in recent years as significantly correlated with response to ICIs. In this manuscript, we critically reviewed the most updated literature data on the landscape of predictive factors in metastatic melanoma treated with ICIs. We focus on the principal limits and potentiality of different methods, shedding light on the more promising biomarkers.
Collapse
Affiliation(s)
- Stefano Poletto
- Department of Oncology, University of Turin, AOU S. Luigi Gonzaga, 10043 Orbassano, Italy;
| | - Luca Paruzzo
- Department of Oncology, University of Turin, 10124 Turin, Italy; (L.P.); (D.S.)
- Division of Hematology and Oncology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Alessandro Nepote
- Department of Oncology, University of Turin, AOU S. Luigi Gonzaga, 10043 Orbassano, Italy;
| | - Daniela Caravelli
- Medical Oncology Division, Candiolo Cancer Institute, FPO-IRCCs, 10060 Candiolo, Italy; (D.C.); (F.C.-S.)
| | - Dario Sangiolo
- Department of Oncology, University of Turin, 10124 Turin, Italy; (L.P.); (D.S.)
| | | |
Collapse
|
8
|
Abbas E, Fanni SC, Bandini C, Francischello R, Febi M, Aghakhanyan G, Ambrosini I, Faggioni L, Cioni D, Lencioni RA, Neri E. Delta-radiomics in cancer immunotherapy response prediction: A systematic review. Eur J Radiol Open 2023; 11:100511. [PMID: 37520768 PMCID: PMC10371799 DOI: 10.1016/j.ejro.2023.100511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 07/11/2023] [Accepted: 07/12/2023] [Indexed: 08/01/2023] Open
Abstract
Background The new immunotherapies have not only changed the oncological therapeutic approach but have also made it necessary to develop new imaging methods for assessing the response to treatment. Delta radiomics consists of the analysis of radiomic features variation between different medical images, usually before and after therapy. Purpose This review aims to evaluate the role of delta radiomics in the immunotherapy response assessment. Methods A systematic search was performed in PubMed, Scopus, and Web Of Science using "delta radiomics AND immunotherapy" as search terms. The included articles' methodological quality was measured using the Radiomics Quality Score (RQS) tool. Results Thirteen articles were finally included in the systematic review. Overall, the RQS of the included studies ranged from 4 to 17, with a mean RQS total of 11,15 ± 4,18 with a corresponding percentage of 30.98 ± 11.61 %. Eleven articles out of 13 performed imaging at multiple time points. All the included articles performed feature reduction. No study carried out prospective validation, decision curve analysis, or cost-effectiveness analysis. Conclusions Delta radiomics has been demonstrated useful in evaluating the response in oncologic patients undergoing immunotherapy. The overall quality was found law, due to the lack of prospective design and external validation. Thus, further efforts are needed to bring delta radiomics a step closer to clinical implementation.
Collapse
Affiliation(s)
- Engy Abbas
- The Joint Department of Medical Imaging, University of Toronto, University Health Network, Sinai Health System, Women’s College Hospital, 610 University Ave, Toronto, ON, Canada M5G 2M9
| | | | - Claudio Bandini
- Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
| | - Roberto Francischello
- Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
| | - Maria Febi
- Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
| | - Gayane Aghakhanyan
- Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
| | - Ilaria Ambrosini
- Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
| | - Lorenzo Faggioni
- Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
| | - Dania Cioni
- Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
| | | | - Emanuele Neri
- The Joint Department of Medical Imaging, University of Toronto, University Health Network, Sinai Health System, Women’s College Hospital, 610 University Ave, Toronto, ON, Canada M5G 2M9
- Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
| |
Collapse
|
9
|
Peisen F, Gerken A, Hering A, Dahm I, Nikolaou K, Gatidis S, Eigentler TK, Amaral T, Moltz JH, Othman AE. Can Whole-Body Baseline CT Radiomics Add Information to the Prediction of Best Response, Progression-Free Survival, and Overall Survival of Stage IV Melanoma Patients Receiving First-Line Targeted Therapy: A Retrospective Register Study. Diagnostics (Basel) 2023; 13:3210. [PMID: 37892030 PMCID: PMC10605712 DOI: 10.3390/diagnostics13203210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Revised: 10/06/2023] [Accepted: 10/12/2023] [Indexed: 10/29/2023] Open
Abstract
BACKGROUND The aim of this study was to investigate whether the combination of radiomics and clinical parameters in a machine-learning model offers additive information compared with the use of only clinical parameters in predicting the best response, progression-free survival after six months, as well as overall survival after six and twelve months in patients with stage IV malignant melanoma undergoing first-line targeted therapy. METHODS A baseline machine-learning model using clinical variables (demographic parameters and tumor markers) was compared with an extended model using clinical variables and radiomic features of the whole tumor burden, utilizing repeated five-fold cross-validation. Baseline CTs of 91 stage IV malignant melanoma patients, all treated in the same university hospital, were identified in the Central Malignant Melanoma Registry and all metastases were volumetrically segmented (n = 4727). RESULTS Compared with the baseline model, the extended radiomics model did not add significantly more information to the best-response prediction (AUC [95% CI] 0.548 (0.188, 0.808) vs. 0.487 (0.139, 0.743)), the prediction of PFS after six months (AUC [95% CI] 0.699 (0.436, 0.958) vs. 0.604 (0.373, 0.867)), or the overall survival prediction after six and twelve months (AUC [95% CI] 0.685 (0.188, 0.967) vs. 0.766 (0.433, 1.000) and AUC [95% CI] 0.554 (0.163, 0.781) vs. 0.616 (0.271, 1.000), respectively). CONCLUSIONS The results showed no additional value of baseline whole-body CT radiomics for best-response prediction, progression-free survival prediction for six months, or six-month and twelve-month overall survival prediction for stage IV melanoma patients receiving first-line targeted therapy. These results need to be validated in a larger cohort.
Collapse
Affiliation(s)
- Felix Peisen
- Department of Diagnostic and Interventional Radiology, Tuebingen University Hospital, Eberhard Karls University, Hoppe-Seyler-Straße 3, 72076 Tuebingen, Germany; (I.D.); (K.N.); (S.G.); (A.E.O.)
| | - Annika Gerken
- Fraunhofer MEVIS, Max-von-Laue-Straße 2, 28359 Bremen, Germany; (A.G.); (A.H.); (J.H.M.)
| | - Alessa Hering
- Fraunhofer MEVIS, Max-von-Laue-Straße 2, 28359 Bremen, Germany; (A.G.); (A.H.); (J.H.M.)
- Diagnostic Image Analysis Group, Radboud University Medical Center (Radboudumc), Geert Grooteplein Zuid 10, 6525 GA Nijmegen, The Netherlands
| | - Isabel Dahm
- Department of Diagnostic and Interventional Radiology, Tuebingen University Hospital, Eberhard Karls University, Hoppe-Seyler-Straße 3, 72076 Tuebingen, Germany; (I.D.); (K.N.); (S.G.); (A.E.O.)
| | - Konstantin Nikolaou
- Department of Diagnostic and Interventional Radiology, Tuebingen University Hospital, Eberhard Karls University, Hoppe-Seyler-Straße 3, 72076 Tuebingen, Germany; (I.D.); (K.N.); (S.G.); (A.E.O.)
- Image-Guided and Functionally Instructed Tumor Therapies (iFIT), The Cluster of Excellence (EXC 2180), 72076 Tuebingen, Germany
| | - Sergios Gatidis
- Department of Diagnostic and Interventional Radiology, Tuebingen University Hospital, Eberhard Karls University, Hoppe-Seyler-Straße 3, 72076 Tuebingen, Germany; (I.D.); (K.N.); (S.G.); (A.E.O.)
- Max Planck Institute for Intelligent Systems, Max-Planck-Ring 4, 72076 Tuebingen, Germany
| | - Thomas K. Eigentler
- Center of Dermato-Oncology, Department of Dermatology, Tuebingen University Hospital, Eberhard Karls University, Liebermeisterstraße 25, 72076 Tuebingen, Germany; (T.K.E.); (T.A.)
- Department of Dermatology, Venereology and Allergology, Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humbolt-Universität zu Berlin, Luisenstraße 2, 10117 Berlin, Germany
| | - Teresa Amaral
- Center of Dermato-Oncology, Department of Dermatology, Tuebingen University Hospital, Eberhard Karls University, Liebermeisterstraße 25, 72076 Tuebingen, Germany; (T.K.E.); (T.A.)
| | - Jan H. Moltz
- Fraunhofer MEVIS, Max-von-Laue-Straße 2, 28359 Bremen, Germany; (A.G.); (A.H.); (J.H.M.)
| | - Ahmed E. Othman
- Department of Diagnostic and Interventional Radiology, Tuebingen University Hospital, Eberhard Karls University, Hoppe-Seyler-Straße 3, 72076 Tuebingen, Germany; (I.D.); (K.N.); (S.G.); (A.E.O.)
- Institute of Neuroradiology, Johannes Gutenberg University Hospital Mainz, Langenbeckstraße 1, 55131 Mainz, Germany
| |
Collapse
|
10
|
McGale J, Hama J, Yeh R, Vercellino L, Sun R, Lopci E, Ammari S, Dercle L. Artificial Intelligence and Radiomics: Clinical Applications for Patients with Advanced Melanoma Treated with Immunotherapy. Diagnostics (Basel) 2023; 13:3065. [PMID: 37835808 PMCID: PMC10573034 DOI: 10.3390/diagnostics13193065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Revised: 09/01/2023] [Accepted: 09/06/2023] [Indexed: 10/15/2023] Open
Abstract
Immunotherapy has greatly improved the outcomes of patients with metastatic melanoma. However, it has also led to new patterns of response and progression, creating an unmet need for better biomarkers to identify patients likely to achieve a lasting clinical benefit or experience immune-related adverse events. In this study, we performed a focused literature survey covering the application of artificial intelligence (AI; in the form of radiomics, machine learning, and deep learning) to patients diagnosed with melanoma and treated with immunotherapy, reviewing 12 studies relevant to the topic published up to early 2022. The most commonly investigated imaging modality was CT imaging in isolation (n = 9, 75.0%), while patient cohorts were most frequently recruited retrospectively and from single institutions (n = 7, 58.3%). Most studies concerned the development of AI tools to assist in prognostication (n = 5, 41.7%) or the prediction of treatment response (n = 6, 50.0%). Validation methods were disparate, with two studies (16.7%) performing no validation and equal numbers using cross-validation (n = 3, 25%), a validation set (n = 3, 25%), or a test set (n = 3, 25%). Only one study used both validation and test sets (n = 1, 8.3%). Overall, promising results have been observed for the application of AI to immunotherapy-treated melanoma. Further improvement and eventual integration into clinical practice may be achieved through the implementation of rigorous validation using heterogeneous, prospective patient cohorts.
Collapse
Affiliation(s)
- Jeremy McGale
- Department of Radiology, New York-Presbyterian Hospital, New York, NY 10032, USA
| | - Jakob Hama
- Queens Hospital Center, Icahn School of Medicine at Mt. Sinai, Queens, NY 10029, USA
| | - Randy Yeh
- Molecular Imaging and Therapy Service, Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Laetitia Vercellino
- Nuclear Medicine Department, INSERM UMR S942, Hôpital Saint-Louis, Assistance-Publique, Hôpitaux de Paris, Université Paris Cité, 75010 Paris, France
| | - Roger Sun
- Department of Radiation Oncology, Gustave Roussy, 94800 Villejuif, France
| | - Egesta Lopci
- Nuclear Medicine Unit, IRCCS—Humanitas Research Hospital, 20089 Rozzano, MI, Italy
| | - Samy Ammari
- Department of Medical Imaging, BIOMAPS, UMR1281 INSERM, CEA, CNRS, Gustave Roussy, Université Paris-Saclay, 94800 Villejuif, France
- ELSAN Department of Radiology, Institut de Cancérologie Paris Nord, 95200 Sarcelles, France
| | - Laurent Dercle
- Department of Radiology, New York-Presbyterian Hospital, New York, NY 10032, USA
| |
Collapse
|
11
|
Tabari A, Cox M, D'Amore B, Mansur A, Dabbara H, Boland G, Gee MS, Daye D. Machine Learning Improves the Prediction of Responses to Immune Checkpoint Inhibitors in Metastatic Melanoma. Cancers (Basel) 2023; 15:2700. [PMID: 37345037 DOI: 10.3390/cancers15102700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Revised: 04/12/2023] [Accepted: 04/27/2023] [Indexed: 06/23/2023] Open
Abstract
Pretreatment LDH is a standard prognostic biomarker for advanced melanoma and is associated with response to ICI. We assessed the role of machine learning-based radiomics in predicting responses to ICI and in complementing LDH for prognostication of metastatic melanoma. From 2008-2022, 79 patients with 168 metastatic hepatic lesions were identified. All patients had arterial phase CT images 1-month prior to initiation of ICI. Response to ICI was assessed on follow-up CT at 3 months using RECIST criteria. A machine learning algorithm was developed using radiomics. Maximum relevance minimum redundancy (mRMR) was used to select features. ROC analysis and logistic regression analyses evaluated performance. Shapley additive explanations were used to identify the variables that are the most important in predicting a response. mRMR selection revealed 15 features that are associated with a response to ICI. The machine learning model combining both radiomics features and pretreatment LDH resulted in better performance for response prediction compared to models that included radiomics or LDH alone (AUC of 0.89 (95% CI: [0.76-0.99]) vs. 0.81 (95% CI: [0.65-0.94]) and 0.81 (95% CI: [0.72-0.91]), respectively). Using SHAP analysis, LDH and two GLSZM were the most predictive of the outcome. Pre-treatment CT radiomic features performed equally well to serum LDH in predicting treatment response.
Collapse
Affiliation(s)
- Azadeh Tabari
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02215, USA
| | | | - Brian D'Amore
- Harvard Medical School, Boston, MA 02215, USA
- Department of Surgery, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | | | - Harika Dabbara
- Boston University Chobanian & Avedisian School of Medicine, 72 East Concord Street, Boston, MA 02118, USA
| | - Genevieve Boland
- Harvard Medical School, Boston, MA 02215, USA
- Department of Surgery, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Michael S Gee
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02215, USA
| | - Dania Daye
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02215, USA
| |
Collapse
|
12
|
Metastatic Melanoma: Liquid Biopsy as a New Precision Medicine Approach. Int J Mol Sci 2023; 24:ijms24044014. [PMID: 36835424 PMCID: PMC9962821 DOI: 10.3390/ijms24044014] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 02/13/2023] [Accepted: 02/14/2023] [Indexed: 02/19/2023] Open
Abstract
Precision medicine has driven a major change in the treatment of many forms of cancer. The discovery that each patient is different and each tumor mass has its own characteristics has shifted the focus of basic and clinical research to the singular individual. Liquid biopsy (LB), in this sense, presents new scenarios in personalized medicine through the study of molecules, factors, and tumor biomarkers in blood such as circulating tumor cells (CTCs), circulating tumor DNA (ctDNA), exosomes and circulating tumor microRNAs (ct-miRNAs). Moreover, its easy application and complete absence of contraindications for the patient make this method applicable in a great many fields. Melanoma, given its highly heterogeneous characteristics, is a cancer form that could significantly benefit from the information linked to liquid biopsy, especially in the treatment management. In this review, we will focus our attention on the latest applications of liquid biopsy in metastatic melanoma and possible developments in the clinical setting.
Collapse
|
13
|
McCague C, Ramlee S, Reinius M, Selby I, Hulse D, Piyatissa P, Bura V, Crispin-Ortuzar M, Sala E, Woitek R. Introduction to radiomics for a clinical audience. Clin Radiol 2023; 78:83-98. [PMID: 36639175 DOI: 10.1016/j.crad.2022.08.149] [Citation(s) in RCA: 25] [Impact Index Per Article: 25.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 08/31/2022] [Indexed: 01/12/2023]
Abstract
Radiomics is a rapidly developing field of research focused on the extraction of quantitative features from medical images, thus converting these digital images into minable, high-dimensional data, which offer unique biological information that can enhance our understanding of disease processes and provide clinical decision support. To date, most radiomics research has been focused on oncological applications; however, it is increasingly being used in a raft of other diseases. This review gives an overview of radiomics for a clinical audience, including the radiomics pipeline and the common pitfalls associated with each stage. Key studies in oncology are presented with a focus on both those that use radiomics analysis alone and those that integrate its use with other multimodal data streams. Importantly, clinical applications outside oncology are also presented. Finally, we conclude by offering a vision for radiomics research in the future, including how it might impact our practice as radiologists.
Collapse
Affiliation(s)
- C McCague
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK.
| | - S Ramlee
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - M Reinius
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - I Selby
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - D Hulse
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - P Piyatissa
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - V Bura
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Department of Radiology and Medical Imaging, County Clinical Emergency Hospital, Cluj-Napoca, Romania
| | - M Crispin-Ortuzar
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Department of Oncology, University of Cambridge, Cambridge, UK
| | - E Sala
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - R Woitek
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Research Centre for Medical Image Analysis and Artificial Intelligence (MIAAI), Department of Medicine, Faculty of Medicine and Dentistry, Danube Private University, Krems, Austria
| |
Collapse
|
14
|
Guerrisi A, Falcone I, Valenti F, Rao M, Gallo E, Ungania S, Maccallini MT, Fanciulli M, Frascione P, Morrone A, Caterino M. Artificial Intelligence and Advanced Melanoma: Treatment Management Implications. Cells 2022; 11:cells11243965. [PMID: 36552729 PMCID: PMC9777238 DOI: 10.3390/cells11243965] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 11/29/2022] [Accepted: 12/06/2022] [Indexed: 12/13/2022] Open
Abstract
Artificial intelligence (AI), a field of research in which computers are applied to mimic humans, is continuously expanding and influencing many aspects of our lives. From electric cars to search motors, AI helps us manage our daily lives by simplifying functions and activities that would be more complex otherwise. Even in the medical field, and specifically in oncology, many studies in recent years have highlighted the possible helping role that AI could play in clinical and therapeutic patient management. In specific contexts, clinical decisions are supported by "intelligent" machines and the development of specific softwares that assist the specialist in the management of the oncology patient. Melanoma, a highly heterogeneous disease influenced by several genetic and environmental factors, to date is still difficult to manage clinically in its advanced stages. Therapies often fail, due to the establishment of intrinsic or secondary resistance, making clinical decisions complex. In this sense, although much work still needs to be conducted, numerous evidence shows that AI (through the processing of large available data) could positively influence the management of the patient with advanced melanoma, helping the clinician in the most favorable therapeutic choice and avoiding unnecessary treatments that are sure to fail. In this review, the most recent applications of AI in melanoma will be described, focusing especially on the possible finding of this field in the management of drug treatments.
Collapse
Affiliation(s)
- Antonino Guerrisi
- Radiology and Diagnostic Imaging Unit, Department of Clinical and Dermatological Research, San Gallicano Dermatological Institute IRCCS, 00144 Rome, Italy
| | - Italia Falcone
- SAFU, Department of Research, Advanced Diagnostics, and Technological Innovation, IRCCS-Regina Elena National Cancer Institute, 00144 Rome, Italy
- Correspondence:
| | - Fabio Valenti
- UOC Oncological Translational Research, IRCCS-Regina Elena National Cancer Institute, 00144 Rome, Italy
| | - Marco Rao
- Enea-FSN-TECFIS-APAM, C.R. Frascati, via Enrico Fermi, 45, 00146 Rome, Italy
| | - Enzo Gallo
- Pathology Unit, IRCCS-Regina Elena National Cancer Institute, 00144 Rome, Italy
| | - Sara Ungania
- Medical Physics and Expert Systems Laboratory, Department of Research and Advanced Technologies, IRCCS-Regina Elena Institute, 00144 Rome, Italy
| | - Maria Teresa Maccallini
- Departement of Clinical and Molecular Medicine, Università La Sapienza di Roma, 00185 Rome, Italy
| | - Maurizio Fanciulli
- SAFU, Department of Research, Advanced Diagnostics, and Technological Innovation, IRCCS-Regina Elena National Cancer Institute, 00144 Rome, Italy
| | - Pasquale Frascione
- Oncologic and Preventative Dermatology, IFO-San Gallicano Dermatological Institute-IRCCS, 00144 Rome, Italy
| | - Aldo Morrone
- Scientific Direction, San Gallicano Dermatological Institute IRCCS, 00144 Rome, Italy
| | - Mauro Caterino
- Radiology and Diagnostic Imaging Unit, Department of Clinical and Dermatological Research, San Gallicano Dermatological Institute IRCCS, 00144 Rome, Italy
| |
Collapse
|
15
|
Artificial intelligence for prediction of response to cancer immunotherapy. Semin Cancer Biol 2022; 87:137-147. [PMID: 36372326 DOI: 10.1016/j.semcancer.2022.11.008] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 11/02/2022] [Accepted: 11/08/2022] [Indexed: 11/13/2022]
Abstract
Artificial intelligence (AI) indicates the application of machines to imitate intelligent behaviors for solving complex tasks with minimal human intervention, including machine learning and deep learning. The use of AI in medicine improves health-care systems in multiple areas such as diagnostic confirmation, risk stratification, analysis, prognosis prediction, treatment surveillance, and virtual health support, which has considerable potential to revolutionize and reshape medicine. In terms of immunotherapy, AI has been applied to unlock underlying immune signatures to associate with responses to immunotherapy indirectly as well as predict responses to immunotherapy responses directly. The AI-based analysis of high-throughput sequences and medical images can provide useful information for management of cancer immunotherapy considering the excellent abilities in selecting appropriate subjects, improving therapeutic regimens, and predicting individualized prognosis. In present review, we aim to evaluate a broad framework about AI-based computational approaches for prediction of response to cancer immunotherapy on both indirect and direct manners. Furthermore, we summarize our perspectives about challenges and opportunities of further AI applications on cancer immunotherapy relating to clinical practicability.
Collapse
|
16
|
Yang L, Du D, Zheng T, Liu L, Wang Z, Du J, Yi H, Cui Y, Liu D, Fang Y. Deep learning and radiomics to predict the mitotic index of gastrointestinal stromal tumors based on multiparametric MRI. Front Oncol 2022; 12:948557. [PMID: 36505814 PMCID: PMC9727176 DOI: 10.3389/fonc.2022.948557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Accepted: 11/02/2022] [Indexed: 11/24/2022] Open
Abstract
Introduction Preoperative evaluation of the mitotic index (MI) of gastrointestinal stromal tumors (GISTs) represents the basis of individualized treatment of patients. However, the accuracy of conventional preoperative imaging methods is limited. The aim of this study was to develop a predictive model based on multiparametric MRI for preoperative MI prediction. Methods A total of 112 patients who were pathologically diagnosed with GIST were enrolled in this study. The dataset was subdivided into the development (n = 81) and test (n = 31) sets based on the time of diagnosis. With the use of T2-weighted imaging (T2WI) and apparent diffusion coefficient (ADC) map, a convolutional neural network (CNN)-based classifier was developed for MI prediction, which used a hybrid approach based on 2D tumor images and radiomics features from 3D tumor shape. The trained model was tested on an internal test set. Then, the hybrid model was comprehensively tested and compared with the conventional ResNet, shape radiomics classifier, and age plus diameter classifier. Results The hybrid model showed good MI prediction ability at the image level; the area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), and accuracy in the test set were 0.947 (95% confidence interval [CI]: 0.927-0.968), 0.964 (95% CI: 0.930-0.978), and 90.8 (95% CI: 88.0-93.0), respectively. With the average probabilities from multiple samples per patient, good performance was also achieved at the patient level, with AUROC, AUPRC, and accuracy of 0.930 (95% CI: 0.828-1.000), 0.941 (95% CI: 0.792-1.000), and 93.6% (95% CI: 79.3-98.2) in the test set, respectively. Discussion The deep learning-based hybrid model demonstrated the potential to be a good tool for the operative and non-invasive prediction of MI in GIST patients.
Collapse
Affiliation(s)
- Linsha Yang
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China
| | - Dan Du
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China
| | - Tao Zheng
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China
| | - Lanxiang Liu
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China
| | - Zhanqiu Wang
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China
| | - Juan Du
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China
| | - Huiling Yi
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China
| | - Yujie Cui
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China
| | - Defeng Liu
- Medical Imaging Center, The First Hospital of Qinhuangdao, Qinhuangdao, China,*Correspondence: Defeng Liu, ; Yuan Fang,
| | - Yuan Fang
- Medical Imaging Center, Chongqing Yubei District People’s Hospital, Chongqing, China,*Correspondence: Defeng Liu, ; Yuan Fang,
| |
Collapse
|
17
|
Dercle L, McGale J, Sun S, Marabelle A, Yeh R, Deutsch E, Mokrane FZ, Farwell M, Ammari S, Schoder H, Zhao B, Schwartz LH. Artificial intelligence and radiomics: fundamentals, applications, and challenges in immunotherapy. J Immunother Cancer 2022; 10:jitc-2022-005292. [PMID: 36180071 PMCID: PMC9528623 DOI: 10.1136/jitc-2022-005292] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/01/2022] [Indexed: 11/04/2022] Open
Abstract
Immunotherapy offers the potential for durable clinical benefit but calls into question the association between tumor size and outcome that currently forms the basis for imaging-guided treatment. Artificial intelligence (AI) and radiomics allow for discovery of novel patterns in medical images that can increase radiology’s role in management of patients with cancer, although methodological issues in the literature limit its clinical application. Using keywords related to immunotherapy and radiomics, we performed a literature review of MEDLINE, CENTRAL, and Embase from database inception through February 2022. We removed all duplicates, non-English language reports, abstracts, reviews, editorials, perspectives, case reports, book chapters, and non-relevant studies. From the remaining articles, the following information was extracted: publication information, sample size, primary tumor site, imaging modality, primary and secondary study objectives, data collection strategy (retrospective vs prospective, single center vs multicenter), radiomic signature validation strategy, signature performance, and metrics for calculation of a Radiomics Quality Score (RQS). We identified 351 studies, of which 87 were unique reports relevant to our research question. The median (IQR) of cohort sizes was 101 (57–180). Primary stated goals for radiomics model development were prognostication (n=29, 33.3%), treatment response prediction (n=24, 27.6%), and characterization of tumor phenotype (n=14, 16.1%) or immune environment (n=13, 14.9%). Most studies were retrospective (n=75, 86.2%) and recruited patients from a single center (n=57, 65.5%). For studies with available information on model testing, most (n=54, 65.9%) used a validation set or better. Performance metrics were generally highest for radiomics signatures predicting treatment response or tumor phenotype, as opposed to immune environment and overall prognosis. Out of a possible maximum of 36 points, the median (IQR) of RQS was 12 (10–16). While a rapidly increasing number of promising results offer proof of concept that AI and radiomics could drive precision medicine approaches for a wide range of indications, standardizing the data collection as well as optimizing the methodological quality and rigor are necessary before these results can be translated into clinical practice.
Collapse
Affiliation(s)
- Laurent Dercle
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Jeremy McGale
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Shawn Sun
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Aurelien Marabelle
- Therapeutic Innovation and Early Trials, Gustave Roussy, Villejuif, Île-de-France, France
| | - Randy Yeh
- Molecular Imaging and Therapy Service, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Eric Deutsch
- Radiation Oncology, Gustave Roussy, Villejuif, Île-de-France, France
| | | | - Michael Farwell
- Division of Nuclear Medicine and Molecular Imaging, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Samy Ammari
- Radiation Oncology, Gustave Roussy, Villejuif, Île-de-France, France.,Radiology, Institut de Cancérologie Paris Nord, Sarcelles, France
| | - Heiko Schoder
- Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Binsheng Zhao
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Lawrence H Schwartz
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| |
Collapse
|
18
|
Combination of Whole-Body Baseline CT Radiomics and Clinical Parameters to Predict Response and Survival in a Stage-IV Melanoma Cohort Undergoing Immunotherapy. Cancers (Basel) 2022; 14:cancers14122992. [PMID: 35740659 PMCID: PMC9221470 DOI: 10.3390/cancers14122992] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Revised: 06/13/2022] [Accepted: 06/15/2022] [Indexed: 11/17/2022] Open
Abstract
Simple Summary The use of immunotherapeutic agents significantly improved stage-IV melanoma patients’ overall progression-free survival. To identify patients who do not benefit from immunotherapy, both clinical parameters and experimental biomarkers such as radiomics are currently being evaluated. However, no radiomic biomarker is widely accepted for routine clinical use. In a large cohort of 262 stage-IV melanoma patients given first-line immunotherapy treatment, we investigated whether radiomics—based on the segmentation of all baseline metastases in the whole body—in combination with clinical parameters offered added value compared to the usage of clinical parameters alone in a machine-learning prediction model. The primary endpoints were response at three months, and survival rates at six and twelve months. The study indicated a potential, but non-significant, added value of radiomics for six-month and twelve-month survival prediction, thus underlining the relevance of clinical parameters. Abstract Background: This study investigated whether a machine-learning-based combination of radiomics and clinical parameters was superior to the use of clinical parameters alone in predicting therapy response after three months, and overall survival after six and twelve months, in stage-IV malignant melanoma patients undergoing immunotherapy with PD-1 checkpoint inhibitors and CTLA-4 checkpoint inhibitors. Methods: A random forest model using clinical parameters (demographic variables and tumor markers = baseline model) was compared to a random forest model using clinical parameters and radiomics (extended model) via repeated 5-fold cross-validation. For this purpose, the baseline computed tomographies of 262 stage-IV malignant melanoma patients treated at a tertiary referral center were identified in the Central Malignant Melanoma Registry, and all visible metastases were three-dimensionally segmented (n = 6404). Results: The extended model was not significantly superior compared to the baseline model for survival prediction after six and twelve months (AUC (95% CI): 0.664 (0.598, 0.729) vs. 0.620 (0.545, 0.692) and AUC (95% CI): 0.600 (0.526, 0.667) vs. 0.588 (0.481, 0.629), respectively). The extended model was not significantly superior compared to the baseline model for response prediction after three months (AUC (95% CI): 0.641 (0.581, 0.700) vs. 0.656 (0.587, 0.719)). Conclusions: The study indicated a potential, but non-significant, added value of radiomics for six-month and twelve-month survival prediction of stage-IV melanoma patients undergoing immunotherapy.
Collapse
|
19
|
Roelofsen L, Kaptein P, Thommen D. Multimodal predictors for precision immunotherapy. IMMUNO-ONCOLOGY TECHNOLOGY 2022; 14:100071. [PMID: 35755892 PMCID: PMC9216437 DOI: 10.1016/j.iotech.2022.100071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Immune checkpoint blockade (ICB) unleashes immune cells to attack tumors, thereby inducing durable clinical responses in many cancer types. The number of patients responding to ICB is modest, however, and combination treatments are likely needed to overcome the multifaceted suppressive pathways active in the tumor microenvironment (TME). The development of precision immuno-oncology (IO) strategies allowing to identify the optimal treatment of each patient upfront is therefore a pivotal question in the field of cancer immunotherapy. Although single-parameter biomarkers can enrich for response to ICB, their predictive capacity is far from perfect and their clinical utility is complicated by their continuous nature and the difficulty to determine cut-offs that reliably distinguish responding patients from those without clinical benefit. The antitumor immune response that is induced or reinvigorated by immunotherapy is a complex cascade of events requiring the interplay of multiple cell types. To move towards precision IO, it is therefore essential to understand for each individual patient at which level(s) the antitumor immune response failed and how it can be therapeutically restored. Holistic approaches to profile human tumor microenvironments and treatment-induced responses may help to identify critical rate-limiting factors of antitumor immunity. These factors need to be translated into clinically applicable multimodal predictors that allow for the selection of the best IO treatment. This review discusses strategies to (i) create such holistic views of antitumor immunity, (ii) identify measurable parameters capturing the complexity of a patient's immune status, and (iii) facilitate the incorporation of precision IO research in the clinic.
Collapse
Affiliation(s)
| | | | - D.S. Thommen
- Division of Molecular Oncology & Immunology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| |
Collapse
|