1
|
Ligero M, Gielen B, Navarro V, Cresta Morgado P, Prior O, Dienstmann R, Nuciforo P, Trebeschi S, Beets-Tan R, Sala E, Garralda E, Perez-Lopez R. A whirl of radiomics-based biomarkers in cancer immunotherapy, why is large scale validation still lacking? NPJ Precis Oncol 2024; 8:42. [PMID: 38383736 PMCID: PMC10881558 DOI: 10.1038/s41698-024-00534-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Accepted: 01/26/2024] [Indexed: 02/23/2024] Open
Abstract
The search for understanding immunotherapy response has sparked interest in diverse areas of oncology, with artificial intelligence (AI) and radiomics emerging as promising tools, capable of gathering large amounts of information to identify suitable patients for treatment. The application of AI in radiology has grown, driven by the hypothesis that radiology images capture tumor phenotypes and thus could provide valuable insights into immunotherapy response likelihood. However, despite the rapid growth of studies, no algorithms in the field have reached clinical implementation, mainly due to the lack of standardized methods, hampering study comparisons and reproducibility across different datasets. In this review, we performed a comprehensive assessment of published data to identify sources of variability in radiomics study design that hinder the comparison of the different model performance and, therefore, clinical implementation. Subsequently, we conducted a use-case meta-analysis using homogenous studies to assess the overall performance of radiomics in estimating programmed death-ligand 1 (PD-L1) expression. Our findings indicate that, despite numerous attempts to predict immunotherapy response, only a limited number of studies share comparable methodologies and report sufficient data about cohorts and methods to be suitable for meta-analysis. Nevertheless, although only a few studies meet these criteria, their promising results underscore the importance of ongoing standardization and benchmarking efforts. This review highlights the importance of uniformity in study design and reporting. Such standardization is crucial to enable meaningful comparisons and demonstrate the validity of biomarkers across diverse populations, facilitating their implementation into the immunotherapy patient selection process.
Collapse
Affiliation(s)
- Marta Ligero
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Bente Gielen
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Victor Navarro
- Oncology Data Science (ODysSey) Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Pablo Cresta Morgado
- Oncology Data Science (ODysSey) Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
- Department of Medical Oncology, Vall d'Hebron University Hospital and Institute of Oncology (VHIO), Barcelona, Spain
- Prostate Cancer Translational Research Group, Institute of Oncology (VHIO), Vall d'Hebron University Hospital, Barcelona, Spain
| | - Olivia Prior
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Rodrigo Dienstmann
- Oncology Data Science (ODysSey) Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Paolo Nuciforo
- Molecular Oncology Group, Vall d'Hebron University Hospital and Institute of Oncology (VHIO), Barcelona, Spain
| | - Stefano Trebeschi
- Department of Radiology, Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Reproduction, Maastricht University, Maastricht, The Netherlands
| | - Regina Beets-Tan
- Department of Radiology, Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Reproduction, Maastricht University, Maastricht, The Netherlands
- Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Evis Sala
- Dipartimento Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
- Dipartimento di Scienze Radiologiche ed Ematologiche, Universita Cattolica del Sacro Cuore, Rome, Italy
| | - Elena Garralda
- Department of Medical Oncology, Vall d'Hebron University Hospital and Institute of Oncology (VHIO), Barcelona, Spain
| | - Raquel Perez-Lopez
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain.
| |
Collapse
|
2
|
Lee AS, Valero C, Yoo SK, Vos JL, Chowell D, Morris LGT. Validation of a Machine Learning Model to Predict Immunotherapy Response in Head and Neck Squamous Cell Carcinoma. Cancers (Basel) 2023; 16:175. [PMID: 38201602 PMCID: PMC10778506 DOI: 10.3390/cancers16010175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 12/22/2023] [Accepted: 12/27/2023] [Indexed: 01/12/2024] Open
Abstract
Head and neck squamous-cell carcinoma (HNSCC) is a disease with a generally poor prognosis; half of treated patients eventually develop recurrent and/or metastatic (R/M) disease. Patients with R/M HNSCC generally have incurable disease with a median survival of 10 to 15 months. Although immune-checkpoint blockade (ICB) has improved outcomes in patients with R/M HNSCC, identifying patients who are likely to benefit from ICB remains a challenge. Biomarkers in current clinical use include tumor mutational burden and immunohistochemistry for programmed death-ligand 1, both of which have only modest predictive power. Machine learning (ML) has the potential to aid in clinical decision-making as an approach to estimate a tumor's likelihood of response or a patient's likelihood of experiencing clinical benefit from therapies such as ICB. Previously, we described a random forest ML model that had value in predicting ICB response using 11 or 16 clinical, laboratory, and genomic features in a pan-cancer development cohort. However, its applicability to certain cancer types, such as HNSCC, has been unknown, due to a lack of cancer-type-specific validation. Here, we present the first validation of a random forest ML tool to predict the likelihood of ICB response in patients with R/M HNSCC. The tool had adequate predictive power for tumor response (area under the receiver operating characteristic curve = 0.65) and was able to stratify patients by overall (HR = 0.53 [95% CI 0.29-0.99], p = 0.045) and progression-free (HR = 0.49 [95% CI 0.27-0.87], p = 0.016) survival. The overall accuracy was 0.72. Our study validates an ML predictor in HNSCC, demonstrating promising performance in a novel cohort of patients. Further studies are needed to validate the generalizability of this algorithm in larger patient samples from additional multi-institutional contexts.
Collapse
Affiliation(s)
- Andrew Sangho Lee
- Head and Neck Service and Immunogenomic Oncology Platform, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA; (A.S.L.); (C.V.); (J.L.V.)
| | - Cristina Valero
- Head and Neck Service and Immunogenomic Oncology Platform, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA; (A.S.L.); (C.V.); (J.L.V.)
| | - Seong-keun Yoo
- Department of Oncological Sciences, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (S.-k.Y.); (D.C.)
| | - Joris L. Vos
- Head and Neck Service and Immunogenomic Oncology Platform, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA; (A.S.L.); (C.V.); (J.L.V.)
| | - Diego Chowell
- Department of Oncological Sciences, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; (S.-k.Y.); (D.C.)
| | - Luc G. T. Morris
- Head and Neck Service and Immunogenomic Oncology Platform, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA; (A.S.L.); (C.V.); (J.L.V.)
| |
Collapse
|
3
|
Quantitative Diffusion-Weighted Imaging Analyses to Predict Response to Neoadjuvant Immunotherapy in Patients with Locally Advanced Head and Neck Carcinoma. Cancers (Basel) 2022; 14:cancers14246235. [PMID: 36551718 PMCID: PMC9776484 DOI: 10.3390/cancers14246235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 12/09/2022] [Accepted: 12/13/2022] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND Neoadjuvant immune checkpoint blockade (ICB) prior to surgery may induce early pathological responses in head and neck squamous cell carcinoma (HNSCC) patients. Routine imaging parameters fail to diagnose these responses early on. Magnetic resonance (MR) diffusion-weighted imaging (DWI) has proven to be useful for detecting HNSCC tumor mass after (chemo)radiation therapy. METHODS 32 patients with stage II-IV, resectable HNSCC, treated at a phase Ib/IIa IMCISION trial (NCT03003637), were retrospectively analyzed using MR-imaging before and after two doses of single agent nivolumab (anti-PD-1) (n = 6) or nivolumab with ipilimumab (anti-CTLA-4) ICB (n = 26). The primary tumors were delineated pre- and post-treatment. A total of 32 features were derived from the delineation and correlated with the tumor regression percentage in the surgical specimen. RESULTS MR-DWI data was available for 24 of 32 patients. Smaller baseline tumor diameter (p = 0.01-0.04) and higher sphericity (p = 0.03) were predictive of having a good pathological response to ICB. Post-treatment skewness and the change in skewness between MRIs were negatively correlated with the tumor's regression (p = 0.04, p = 0.02). CONCLUSION Pre-treatment DWI tumor diameter and sphericity may be quantitative biomarkers for the prediction of an early pathological response to ICB. Furthermore, our data indicate that ADC skewness could be a marker for individual response evaluation.
Collapse
|
4
|
Dercle L, McGale J, Sun S, Marabelle A, Yeh R, Deutsch E, Mokrane FZ, Farwell M, Ammari S, Schoder H, Zhao B, Schwartz LH. Artificial intelligence and radiomics: fundamentals, applications, and challenges in immunotherapy. J Immunother Cancer 2022; 10:jitc-2022-005292. [PMID: 36180071 PMCID: PMC9528623 DOI: 10.1136/jitc-2022-005292] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/01/2022] [Indexed: 11/04/2022] Open
Abstract
Immunotherapy offers the potential for durable clinical benefit but calls into question the association between tumor size and outcome that currently forms the basis for imaging-guided treatment. Artificial intelligence (AI) and radiomics allow for discovery of novel patterns in medical images that can increase radiology’s role in management of patients with cancer, although methodological issues in the literature limit its clinical application. Using keywords related to immunotherapy and radiomics, we performed a literature review of MEDLINE, CENTRAL, and Embase from database inception through February 2022. We removed all duplicates, non-English language reports, abstracts, reviews, editorials, perspectives, case reports, book chapters, and non-relevant studies. From the remaining articles, the following information was extracted: publication information, sample size, primary tumor site, imaging modality, primary and secondary study objectives, data collection strategy (retrospective vs prospective, single center vs multicenter), radiomic signature validation strategy, signature performance, and metrics for calculation of a Radiomics Quality Score (RQS). We identified 351 studies, of which 87 were unique reports relevant to our research question. The median (IQR) of cohort sizes was 101 (57–180). Primary stated goals for radiomics model development were prognostication (n=29, 33.3%), treatment response prediction (n=24, 27.6%), and characterization of tumor phenotype (n=14, 16.1%) or immune environment (n=13, 14.9%). Most studies were retrospective (n=75, 86.2%) and recruited patients from a single center (n=57, 65.5%). For studies with available information on model testing, most (n=54, 65.9%) used a validation set or better. Performance metrics were generally highest for radiomics signatures predicting treatment response or tumor phenotype, as opposed to immune environment and overall prognosis. Out of a possible maximum of 36 points, the median (IQR) of RQS was 12 (10–16). While a rapidly increasing number of promising results offer proof of concept that AI and radiomics could drive precision medicine approaches for a wide range of indications, standardizing the data collection as well as optimizing the methodological quality and rigor are necessary before these results can be translated into clinical practice.
Collapse
Affiliation(s)
- Laurent Dercle
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Jeremy McGale
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Shawn Sun
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Aurelien Marabelle
- Therapeutic Innovation and Early Trials, Gustave Roussy, Villejuif, Île-de-France, France
| | - Randy Yeh
- Molecular Imaging and Therapy Service, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Eric Deutsch
- Radiation Oncology, Gustave Roussy, Villejuif, Île-de-France, France
| | | | - Michael Farwell
- Division of Nuclear Medicine and Molecular Imaging, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Samy Ammari
- Radiation Oncology, Gustave Roussy, Villejuif, Île-de-France, France.,Radiology, Institut de Cancérologie Paris Nord, Sarcelles, France
| | - Heiko Schoder
- Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Binsheng Zhao
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Lawrence H Schwartz
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| |
Collapse
|
5
|
Sun R, Henry T, Laville A, Carré A, Hamaoui A, Bockel S, Chaffai I, Levy A, Chargari C, Robert C, Deutsch E. Imaging approaches and radiomics: toward a new era of ultraprecision radioimmunotherapy? J Immunother Cancer 2022; 10:e004848. [PMID: 35793875 PMCID: PMC9260846 DOI: 10.1136/jitc-2022-004848] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/21/2022] [Indexed: 11/17/2022] Open
Abstract
Strong rationale and a growing number of preclinical and clinical studies support combining radiotherapy and immunotherapy to improve patient outcomes. However, several critical questions remain, such as the identification of patients who will benefit from immunotherapy and the identification of the best modalities of treatment to optimize patient response. Imaging biomarkers and radiomics have recently emerged as promising tools for the non-invasive assessment of the whole disease of the patient, allowing comprehensive analysis of the tumor microenvironment, the spatial heterogeneity of the disease and its temporal changes. This review presents the potential applications of medical imaging and the challenges to address, in order to help clinicians choose the optimal modalities of both radiotherapy and immunotherapy, to predict patient's outcomes and to assess response to these promising combinations.
Collapse
Affiliation(s)
- Roger Sun
- Department of Radiation Oncology, Gustave Roussy, Villejuif, France
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
| | - Théophraste Henry
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
- Department of Nuclear Medicine, Gustave Roussy, Villejuif, France
| | - Adrien Laville
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
| | - Alexandre Carré
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
| | - Anthony Hamaoui
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
| | - Sophie Bockel
- Department of Radiation Oncology, Gustave Roussy, Villejuif, France
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
| | - Ines Chaffai
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
| | - Antonin Levy
- Department of Radiation Oncology, Gustave Roussy, Villejuif, France
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
| | - Cyrus Chargari
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
- Department of Radiation Oncology, Brachytherapy Unit, Gustave Roussy, Villejuif, France
| | - Charlotte Robert
- Department of Radiation Oncology, Gustave Roussy, Villejuif, France
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
| | - Eric Deutsch
- Department of Radiation Oncology, Gustave Roussy, Villejuif, France
- Radiothérapie Moléculaire et Innovation Thérapeutique, Université Paris-Saclay, Institut Gustave Roussy, Inserm, Villejuif, France
- INSERM U1030, Gustave Roussy, Villejuif, France
| |
Collapse
|