Combination of Whole-Body Baseline CT Radiomics and Clinical Parameters to Predict Response and Survival in a Stage-IV Melanoma Cohort Undergoing Immunotherapy

Integrated noninvasive diagnostics for prediction of survival in immunotherapy

Background

Integrating complementary diagnostic data sources promises enhanced robustness in the predictive performance of artificial intelligence (AI) models, a crucial requirement for future clinical validation/implementation. In this study, we investigate the potential value of integrating data from noninvasive diagnostic modalities, including chest computed tomography (CT) imaging, routine laboratory blood tests, and clinical parameters, to retrospectively predict 1-year survival in a cohort of patients with advanced non-small-cell lung cancer, melanoma, and urothelial cancer treated with immunotherapy.

Patients and methods

The study included 475 patients, of whom 444 had longitudinal CT scans and 475 had longitudinal laboratory data. An ensemble of AI models was trained on data from each diagnostic modality, and subsequently, a model-agnostic integration approach was adopted for combining the prediction probabilities of each modality and producing an integrated decision.

Results

Integrating different diagnostic data demonstrated a modest increase in predictive performance. The highest area under the curve (AUC) was achieved by CT and laboratory data integration (AUC of 0.83, 95% confidence interval 0.81-0.85, P < 0.001), whereas the performance of individual models trained on laboratory and CT data independently yielded AUCs of 0.81 and 0.73, respectively.

Conclusions

In our retrospective cohort, integrating different noninvasive data modalities improved performance.

Can Delta Radiomics Improve the Prediction of Best Overall Response, Progression-Free Survival, and Overall Survival of Melanoma Patients Treated with Immune Checkpoint Inhibitors?

BACKGROUND

The prevalence of metastatic melanoma is increasing, necessitating the identification of patients who do not benefit from immunotherapy. This study aimed to develop a radiomic biomarker based on the segmentation of all metastases at baseline and the first follow-up CT for the endpoints best overall response (BOR), progression-free survival (PFS), and overall survival (OS), encompassing various immunotherapies. Additionally, this study investigated whether reducing the number of segmented metastases per patient affects predictive capacity.

METHODS

The total tumour load, excluding cerebral metastases, from 146 baseline and 146 first follow-up CTs of melanoma patients treated with first-line immunotherapy was volumetrically segmented. Twenty-one random forest models were trained and compared for the endpoints BOR; PFS at 6, 9, and 12 months; and OS at 6, 9, and 12 months, using as input either only clinical parameters, whole-tumour-load delta radiomics plus clinical parameters, or delta radiomics from the largest ten metastases plus clinical parameters.

RESULTS

The whole-tumour-load delta radiomics model performed best for BOR (AUC 0.81); PFS at 6, 9, and 12 months (AUC 0.82, 0.80, and 0.77); and OS at 6 months (AUC 0.74). The model using delta radiomics from the largest ten metastases performed best for OS at 9 and 12 months (AUC 0.71 and 0.75). Although the radiomic models were numerically superior to the clinical model, statistical significance was not reached.

CONCLUSIONS

The findings indicate that delta radiomics may offer additional value for predicting BOR, PFS, and OS in metastatic melanoma patients undergoing first-line immunotherapy. Despite its complexity, volumetric whole-tumour-load segmentation could be advantageous.

Review on radiomic analysis in 18F-fluorodeoxyglucose positron emission tomography for prediction of melanoma outcomes

Over the past decade, several strategies have revolutionized the clinical management of patients with cutaneous melanoma (CM), including immunotherapy and targeted tyrosine kinase inhibitor (TKI)-based therapies. Indeed, immune checkpoint inhibitors (ICIs), alone or in combination, represent the standard of care for patients with advanced disease without an actionable mutation. Notably BRAF combined with MEK inhibitors represent the therapeutic standard for disease disclosing BRAF mutation. At the same time, FDG PET/CT has become part of the routine staging and evaluation of patients with cutaneous melanoma. There is growing interest in using FDG PET/CT measurements to predict response to ICI therapy and/or target therapy. While semiquantitative values such as standardized uptake value (SUV) are limited for predicting outcome, new measures including tumor metabolic volume, total lesion glycolysis and radiomics seem promising as potential imaging biomarkers for nuclear medicine. The aim of this review, prepared by an interdisciplinary group of experts, is to take stock of the current literature on radiomics approaches that could improve outcomes in CM.

Machine learning in the prediction of immunotherapy response and prognosis of melanoma: a systematic review and meta-analysis

Background

The emergence of immunotherapy has changed the treatment modality for melanoma and prolonged the survival of many patients. However, a handful of patients remain unresponsive to immunotherapy and effective tools for early identification of this patient population are still lacking. Researchers have developed machine learning algorithms for predicting immunotherapy response in melanoma, but their predictive accuracy has been inconsistent. Therefore, the present systematic review and meta-analysis was performed to comprehensively evaluate the predictive accuracy of machine learning in melanoma response to immunotherapy.

Methods

Relevant studies were searched in PubMed, Web of Sciences, Cochrane Library, and Embase from their inception to July 30, 2022. The risk of bias and applicability of the included studies were assessed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). Meta-analysis was performed on R4.2.0.

Results

A total of 36 studies consisting of 30 cohort studies and 6 case-control studies were included. These studies were mainly published between 2019 and 2022 and encompassed 75 models. The outcome measures of this study were progression-free survival (PFS), overall survival (OS), and treatment response. The pooled c-index was 0.728 (95%CI: 0.629-0.828) for PFS in the training set, 0.760 (95%CI: 0.728-0.792) and 0.819 (95%CI: 0.757-0.880) for treatment response in the training and validation sets, respectively, and 0.746 (95%CI: 0.721-0.771) and 0.700 (95%CI: 0.677-0.724) for OS in the training and validation sets, respectively.

Conclusion

Machine learning has considerable predictive accuracy in melanoma immunotherapy response and prognosis, especially in the former. However, due to the lack of external validation and the scarcity of certain types of models, further studies are warranted.

The role of artificial intelligence and convolutional neural networks in the management of melanoma: a clinical, pathological, and radiological perspective

Clinical dermatoscopy and pathological slide assessment are essential in the diagnosis and management of patients with cutaneous melanoma. For those presenting with stage IIC disease and beyond, radiological investigations are often considered. The dermatoscopic, whole slide and radiological images used during clinical care are often stored digitally, enabling artificial intelligence (AI) and convolutional neural networks (CNN) to learn, analyse and contribute to the clinical decision-making. A keyword search of the Medline database was performed to assess the progression, capabilities and limitations of AI and CNN and its use in diagnosis and management of cutaneous melanoma. Full-text articles were reviewed if they related to dermatoscopy, pathological slide assessment or radiology. Through analysis of 95 studies, we demonstrate that diagnostic accuracy of AI/CNN can be superior (or at least equal) to clinicians. However, variability in image acquisition, pre-processing, segmentation, and feature extraction remains challenging. With current technological abilities, AI/CNN and clinicians synergistically working together are better than one another in all subspecialty domains relating to cutaneous melanoma. AI has the potential to enhance the diagnostic capabilities of junior dermatology trainees, primary care skin cancer clinicians and general practitioners. For experienced clinicians, AI provides a cost-efficient second opinion. From a pathological and radiological perspective, CNN has the potential to improve workflow efficiency, allowing clinicians to achieve more in a finite amount of time. Until the challenges of AI/CNN are reliably met, however, they can only remain an adjunct to clinical decision-making.

A whirl of radiomics-based biomarkers in cancer immunotherapy, why is large scale validation still lacking?

The search for understanding immunotherapy response has sparked interest in diverse areas of oncology, with artificial intelligence (AI) and radiomics emerging as promising tools, capable of gathering large amounts of information to identify suitable patients for treatment. The application of AI in radiology has grown, driven by the hypothesis that radiology images capture tumor phenotypes and thus could provide valuable insights into immunotherapy response likelihood. However, despite the rapid growth of studies, no algorithms in the field have reached clinical implementation, mainly due to the lack of standardized methods, hampering study comparisons and reproducibility across different datasets. In this review, we performed a comprehensive assessment of published data to identify sources of variability in radiomics study design that hinder the comparison of the different model performance and, therefore, clinical implementation. Subsequently, we conducted a use-case meta-analysis using homogenous studies to assess the overall performance of radiomics in estimating programmed death-ligand 1 (PD-L1) expression. Our findings indicate that, despite numerous attempts to predict immunotherapy response, only a limited number of studies share comparable methodologies and report sufficient data about cohorts and methods to be suitable for meta-analysis. Nevertheless, although only a few studies meet these criteria, their promising results underscore the importance of ongoing standardization and benchmarking efforts. This review highlights the importance of uniformity in study design and reporting. Such standardization is crucial to enable meaningful comparisons and demonstrate the validity of biomarkers across diverse populations, facilitating their implementation into the immunotherapy patient selection process.

Pre-treatment 18F-FDG-PET/CT parameters as biomarkers for progression free survival, best overall response and overall survival in metastatic melanoma patients undergoing first-line immunotherapy

BACKGROUND

Checkpoint inhibitors have drastically improved the therapy of patients with advanced melanoma. 18F-FDG-PET/CT parameters might act as biomarkers for response and survival and thus can identify patients that do not benefit from immunotherapy. However, little literature exists on the association of baseline 18F-FDG-PET/CT parameters with progression free survival (PFS), best overall response (BOR), and overall survival (OS).

MATERIALS AND METHODS

Using a whole tumor volume segmentation approach, we investigated in a retrospective registry study (n = 50) whether pre-treatment 18F-FDG-PET/CT parameters of three subgroups (tumor burden, tumor glucose uptake and non-tumoral hematopoietic tissue metabolism), can act as biomarkers for the primary endpoints PFS and BOR as well as for the secondary endpoint OS.

RESULTS

Compared to the sole use of clinical parameters, baseline 18F-FDG-PET/CT parameters did not significantly improve a Cox proportional-hazard model for PFS (C-index/AIC: 0.70/225.17 and 0.68/223.54, respectively; p = 0.14). A binomial logistic regression analysis for BOR was not statistically significant (χ2(15) = 16.44, p = 0.35), with a low amount of explained variance (Nagelkerke's R2 = 0.38). Mean FDG uptake of the spleen contributed significantly to a Cox proportional-hazard model for OS (HR 3.55, p = 0.04).

CONCLUSIONS

The present study could not confirm the capability of the pre-treatment 18F-FDG-PET/CT parameters tumor burden, tumor glucose uptake and non-tumoral hematopoietic tissue metabolism to act as biomarkers for PFS and BOR in metastatic melanoma patients receiving first-line immunotherapy. The documented potential of 18F-FDG uptake by immune-mediating tissues such as the spleen to act as a biomarker for OS has been reproduced.

Artificial intelligence for predictive biomarker discovery in immuno-oncology: a systematic review

BACKGROUND

The widespread use of immune checkpoint inhibitors (ICIs) has revolutionised treatment of multiple cancer types. However, selecting patients who may benefit from ICI remains challenging. Artificial intelligence (AI) approaches allow exploitation of high-dimension oncological data in research and development of precision immuno-oncology.

MATERIALS AND METHODS

We conducted a systematic literature review of peer-reviewed original articles studying the ICI efficacy prediction in cancer patients across five data modalities: genomics (including genomics, transcriptomics, and epigenomics), radiomics, digital pathology (pathomics), and real-world and multimodality data.

RESULTS

A total of 90 studies were included in this systematic review, with 80% published in 2021-2022. Among them, 37 studies included genomic, 20 radiomic, 8 pathomic, 20 real-world, and 5 multimodal data. Standard machine learning (ML) methods were used in 72% of studies, deep learning (DL) methods in 22%, and both in 6%. The most frequently studied cancer type was non-small-cell lung cancer (36%), followed by melanoma (16%), while 25% included pan-cancer studies. No prospective study design incorporated AI-based methodologies from the outset; rather, all implemented AI as a post hoc analysis. Novel biomarkers for ICI in radiomics and pathomics were identified using AI approaches, and molecular biomarkers have expanded past genomics into transcriptomics and epigenomics. Finally, complex algorithms and new types of AI-based markers, such as meta-biomarkers, are emerging by integrating multimodal/multi-omics data.

CONCLUSION

AI-based methods have expanded the horizon for biomarker discovery, demonstrating the power of integrating multimodal data from existing datasets to discover new meta-biomarkers. While most of the included studies showed promise for AI-based prediction of benefit from immunotherapy, none provided high-level evidence for immediate practice change. A priori planned prospective trial designs are needed to cover all lifecycle steps of these software biomarkers, from development and validation to integration into clinical practice.

Radiomics based predictive modeling of rectal toxicity in prostate cancer patients undergoing radiotherapy: CT and MRI comparison

BACKGROUND

Rectal toxicity is one of the common side effects after radiotherapy in prostate cancer patients. Radiomics is a non-invasive and low-cost method for developing models of predicting radiation toxicity that does not have the limitations of previous methods. These models have been developed using individual patients' information and have reliable and acceptable performance. This study was conducted by evaluating the radiomic features of computed tomography (CT) and magnetic resonance (MR) images and using machine learning (ML) methods to predict radiation-induced rectal toxicity.

METHODS

Seventy men with pathologically confirmed prostate cancer, eligible for three-dimensional radiation therapy (3DCRT) participated in this prospective trial. Rectal wall CT and MR images were used to extract first-order, shape-based, and textural features. The least absolute shrinkage and selection operator (LASSO) was used for feature selection. Classifiers such as Random Forest (RF), Decision Tree (DT), Logistic Regression (LR), and K-Nearest Neighbors (KNN) were used to create models based on radiomic, dosimetric, and clinical data alone or in combination. The area under the curve (AUC) of the receiver operating characteristic curve (ROC), accuracy, sensitivity, and specificity were used to assess each model's performance.

RESULTS

The best outcomes were achieved by the radiomic features of MR images in conjunction with clinical and dosimetric data, with a mean of AUC: 0.79, accuracy: 77.75%, specificity: 82.15%, and sensitivity: 67%.

CONCLUSIONS

This research showed that as radiomic signatures for predicting radiation-induced rectal toxicity, MR images outperform CT images.

Can Whole-Body Baseline CT Radiomics Add Information to the Prediction of Best Response, Progression-Free Survival, and Overall Survival of Stage IV Melanoma Patients Receiving First-Line Targeted Therapy: A Retrospective Register Study

BACKGROUND

The aim of this study was to investigate whether the combination of radiomics and clinical parameters in a machine-learning model offers additive information compared with the use of only clinical parameters in predicting the best response, progression-free survival after six months, as well as overall survival after six and twelve months in patients with stage IV malignant melanoma undergoing first-line targeted therapy.

METHODS

A baseline machine-learning model using clinical variables (demographic parameters and tumor markers) was compared with an extended model using clinical variables and radiomic features of the whole tumor burden, utilizing repeated five-fold cross-validation. Baseline CTs of 91 stage IV malignant melanoma patients, all treated in the same university hospital, were identified in the Central Malignant Melanoma Registry and all metastases were volumetrically segmented (n = 4727).

RESULTS

Compared with the baseline model, the extended radiomics model did not add significantly more information to the best-response prediction (AUC [95% CI] 0.548 (0.188, 0.808) vs. 0.487 (0.139, 0.743)), the prediction of PFS after six months (AUC [95% CI] 0.699 (0.436, 0.958) vs. 0.604 (0.373, 0.867)), or the overall survival prediction after six and twelve months (AUC [95% CI] 0.685 (0.188, 0.967) vs. 0.766 (0.433, 1.000) and AUC [95% CI] 0.554 (0.163, 0.781) vs. 0.616 (0.271, 1.000), respectively).

CONCLUSIONS

The results showed no additional value of baseline whole-body CT radiomics for best-response prediction, progression-free survival prediction for six months, or six-month and twelve-month overall survival prediction for stage IV melanoma patients receiving first-line targeted therapy. These results need to be validated in a larger cohort.

Machine Learning Improves the Prediction of Responses to Immune Checkpoint Inhibitors in Metastatic Melanoma

Pretreatment LDH is a standard prognostic biomarker for advanced melanoma and is associated with response to ICI. We assessed the role of machine learning-based radiomics in predicting responses to ICI and in complementing LDH for prognostication of metastatic melanoma. From 2008-2022, 79 patients with 168 metastatic hepatic lesions were identified. All patients had arterial phase CT images 1-month prior to initiation of ICI. Response to ICI was assessed on follow-up CT at 3 months using RECIST criteria. A machine learning algorithm was developed using radiomics. Maximum relevance minimum redundancy (mRMR) was used to select features. ROC analysis and logistic regression analyses evaluated performance. Shapley additive explanations were used to identify the variables that are the most important in predicting a response. mRMR selection revealed 15 features that are associated with a response to ICI. The machine learning model combining both radiomics features and pretreatment LDH resulted in better performance for response prediction compared to models that included radiomics or LDH alone (AUC of 0.89 (95% CI: [0.76-0.99]) vs. 0.81 (95% CI: [0.65-0.94]) and 0.81 (95% CI: [0.72-0.91]), respectively). Using SHAP analysis, LDH and two GLSZM were the most predictive of the outcome. Pre-treatment CT radiomic features performed equally well to serum LDH in predicting treatment response.

Artificial intelligence-assisted selection and efficacy prediction of antineoplastic strategies for precision cancer therapy

The rapid development of artificial intelligence (AI) technologies in the context of the vast amount of collectable data obtained from high-throughput sequencing has led to an unprecedented understanding of cancer and accelerated the advent of a new era of clinical oncology with a tone of precision treatment and personalized medicine. However, the gains achieved by a variety of AI models in clinical oncology practice are far from what one would expect, and in particular, there are still many uncertainties in the selection of clinical treatment options that pose significant challenges to the application of AI in clinical oncology. In this review, we summarize emerging approaches, relevant datasets and open-source software of AI and show how to integrate them to address problems from clinical oncology and cancer research. We focus on the principles and procedures for identifying different antitumor strategies with the assistance of AI, including targeted cancer therapy, conventional cancer therapy, and cancer immunotherapy. In addition, we also highlight the current challenges and directions of AI in clinical oncology translation. Overall, we hope this article will provide researchers and clinicians with a deeper understanding of the role and implications of AI in precision cancer therapy, and help AI move more quickly into accepted cancer guidelines.

CT radiomics compared to a clinical model for predicting checkpoint inhibitor treatment outcomes in patients with advanced melanoma

INTRODUCTION

Predicting checkpoint inhibitors treatment outcomes in melanoma is a relevant task, due to the unpredictable and potentially fatal toxicity and high costs for society. However, accurate biomarkers for treatment outcomes are lacking. Radiomics are a technique to quantitatively capture tumour characteristics on readily available computed tomography (CT) imaging. The purpose of this study was to investigate the added value of radiomics for predicting clinical benefit from checkpoint inhibitors in melanoma in a large, multicenter cohort.

METHODS

Patients who received first-line anti-PD1±anti-CTLA4 treatment for advanced cutaneous melanoma were retrospectively identified from nine participating hospitals. For every patient, up to five representative lesions were segmented on baseline CT, and radiomics features were extracted. A machine learning pipeline was trained on the radiomics features to predict clinical benefit, defined as stable disease for more than 6 months or response per RECIST 1.1 criteria. This approach was evaluated using a leave-one-centre-out cross validation and compared to a model based on previously discovered clinical predictors. Lastly, a combination model was built on the radiomics and clinical model.

RESULTS

A total of 620 patients were included, of which 59.2% experienced clinical benefit. The radiomics model achieved an area under the receiver operator characteristic curve (AUROC) of 0.607 [95% CI, 0.562-0.652], lower than that of the clinical model (AUROC=0.646 [95% CI, 0.600-0.692]). The combination model yielded no improvement over the clinical model in terms of discrimination (AUROC=0.636 [95% CI, 0.592-0.680]) or calibration. The output of the radiomics model was significantly correlated with three out of five input variables of the clinical model (p < 0.001).

DISCUSSION

The radiomics model achieved a moderate predictive value of clinical benefit, which was statistically significant. However, a radiomics approach was unable to add value to a simpler clinical model, most likely due to the overlap in predictive information learned by both models. Future research should focus on the application of deep learning, spectral CT-derived radiomics, and a multimodal approach for accurately predicting benefit to checkpoint inhibitor treatment in advanced melanoma.