Development of Radiomic-Based Model to Predict Clinical Outcomes in Non-Small Cell Lung Cancer Patients Treated with Immunotherapy

Integrating radiomic and 3D autoencoder-based features for Non-Small Cell Lung Cancer survival analysis

BACKGROUND AND OBJECTIVES

The aim of this study is to develop a radiomic and deep learning-based signature for survival analysis of patients with Non-Small Cell Lung Cancer.

METHODS

Four-hundred twenty-two patients from "Lung1" dataset were included in the study. A 3D convolutional autoencoder (AE) was built and features from the latent space extracted for further analysis. Radiomic features were derived from the 3D volume of the tumor region using PyRadiomics. Both radiomic and AE-based features underwent feature selection, by removing: i) highly correlated and ii) constant features. The selected variables were then used to derive both mono-domain (radiomics, AE and clinic) and multi-domain signatures fitting a Cox Proportional Hazard model with LASSO penalization and evaluated considering the concordance (C)-index as performance metric.

RESULTS

Both mono-domain and multi-domain signatures could significantly differentiate high risk from low risk patients. Among the mono-domain signatures, the highest hazard ratio (HR) in the test set was obtained using radiomics (HR = 1.5428) followed by the AE-based signature (HR = 1.5012) and the clinical signature (HR = 1.4770). The best overall performance was achieved by combining all three signatures, resulting in the highest HR (HR = 1.7383), while the combination of AE-based and clinical signatures yielded the highest C-index (C-index = 0.6309).

CONCLUSIONS

These preliminary results show that combining information carried by AE, radiomic and clinical domain shows potential for improving the prediction of overall survival in NSCLC patients.

Prognostic nomogram combining 18F-FDG PET/CT radiomics and clinical data for stage III NSCLC survival prediction

The aim of this study was to establish and validate the precision of a novel radiomics approach that integrates 18Fluorine-fluorodeoxyglucose (18F-FDG) positron emission tomography (PET)-computed tomography (CT) scan data with clinical information to improve the prognostication of survival rates in patients diagnosed with stage III Non-Small Cell Lung Cancer (NSCLC) who are not candidates for surgery. We evaluated pretreatment 18F-FDG PET-CT scans from 156 individuals diagnosed with stage III inoperable NSCLC at Shandong Cancer Hospital. These individuals were divided into two groups: a training set comprising 110 patients and an internal validation set consisting of 46 patients. By employing random forest classifier and cox proportional hazards model , we identified and utilized relevant features to create predictive models and a nomogram. The effectiveness of these models was assessed through the use of the receiver operating characteristics(ROC) curves, Kaplan-Meier (KM) curves, and the application of the nomogram. Our findings showed that the combined model, which integrates both clinical and radiomic data, outperformed those based solely on clinical or radiomic features in predicting 3-year overall survival(OS). Furthermore, calibration plots revealed a high level of agreement between predicted and actual survival times. The research successfully established a predictive radiomics model that integrates 18F-FDG PET/CT imaging with clinical indicators to enhance survival predictions for patients with stage III inoperable NSCLC.

Delta radiomics: an updated systematic review

BACKGROUND

Radiomics can provide quantitative features from medical imaging that can be correlated with various biological features and diverse clinical endpoints. Delta radiomics, on the other hand, consists in the analysis of feature variation at different acquisition time points, usually before and after therapy. The aim of this study was to provide a systematic review of the different delta radiomics approaches.

METHODS

Eligible articles were searched in Embase, Pubmed, and ScienceDirect using a search string that included free text and/or Medical Subject Headings (MeSH) with 3 key search terms: 'radiomics,' 'texture,' and 'delta.' Studies were analyzed using QUADAS-2 and the RQS tool.

RESULTS

Forty-eight studies were finally included. The studies were divided into preclinical/methodological (5 studies, 10.4%); rectal cancer (6 studies, 12.5%); lung cancer (12 studies, 25%); sarcoma (5 studies, 10.4%); prostate cancer (3 studies, 6.3%), head and neck cancer (6 studies, 12.5%); gastrointestinal malignancies excluding rectum (7 studies, 14.6%) and other disease sites (4 studies, 8.3%). The median RQS of all studies was 25% (mean 21% ± 12%), with 13 studies (30.2%) achieving a quality score < 10% and 22 studies (51.2%) < 25%.

CONCLUSIONS

Delta radiomics shows potential benefit for several clinical endpoints in oncology, such asdifferential diagnosis, prognosis and prediction of treatment response, evaluation of side effects. Nevertheless, the studies included in this systematic review suffer from the bias of overall low methodological rigor, so that the conclusions are currently heterogeneous, not robust and hardly replicable. Further research with prospective and multicenter studies is needed for the clinical validation of delta radiomics approaches.

Delta-radiomics features for predicting the major pathological response to neoadjuvant chemoimmunotherapy in non-small cell lung cancer

OBJECTIVES

To investigate if delta-radiomics features have the potential to predict the major pathological response (MPR) to neoadjuvant chemoimmunotherapy in non-small cell lung cancer (NSCLC) patients.

METHODS

Two hundred six stage IIA-IIIB NSCLC patients from three institutions (Database1 = 164; Database2 = 21; Database3 = 21) who received neoadjuvant chemoimmunotherapy and surgery were included. Patients in Database1 were randomly assigned to the training dataset and test dataset, with a ratio of 0.7:0.3. Patients in Database2 and Database3 were used as two independent external validation datasets. Contrast-enhanced CT scans were obtained at baseline and before surgery. The delta-radiomics features were defined as the relative net change of radiomics features between baseline and preoperative. The delta-radiomics model and pre-treatment radiomics model were established. The performance of Immune-Related Response Evaluation Criteria in Solid Tumors (iRECIST) for predicting MPR was also evaluated.

RESULTS

Half of the patients (106/206, 51.5%) showed MPR after neoadjuvant chemoimmunotherapy. For predicting MPR, the delta-radiomics model achieved a satisfying area under the curves (AUCs) values of 0.768, 0.732, 0.833, and 0.716 in the training, test, and two external validation databases, respectively, which showed a superior predictive performance than the pre-treatment radiomics model (0.644, 0.616, 0.475, and 0.608). Compared with iRECIST criteria (0.624, 0.572, 0.650, and 0.466), a mixed model that combines delta-radiomics features and iRECIST had higher AUC values for MPR prediction of 0.777, 0.761, 0.850, and 0.670 in four sets.

CONCLUSION

The delta-radiomics model demonstrated superior diagnostic performance compared to pre-treatment radiomics model and iRECIST criteria in predicting MPR preoperatively in neoadjuvant chemoimmunotherapy for stage II-III NSCLC.

CLINICAL RELEVANCE STATEMENT

Delta-radiomics features based on the relative net change of radiomics features between baseline and preoperative CT scans serve a vital support tool in accurately identifying responses to neoadjuvant chemoimmunotherapy, which can help physicians make more appropriate treatment decisions.

KEY POINTS

• The performances of pre-treatment radiomics model and iRECIST model in predicting major pathological response of neoadjuvant chemoimmunotherapy were unsatisfactory. • The delta-radiomics features based on relative net change of radiomics features between baseline and preoperative CT scans may be used as a noninvasive biomarker for predicting major pathological response of neoadjuvant chemoimmunotherapy. • Combining delta-radiomics features and iRECIST can further improve the predictive performance of responses to neoadjuvant chemoimmunotherapy.

Open science practices need substantial improvement in prognostic model studies in oncology using machine learning

OBJECTIVE

To describe the frequency of open science practices in a contemporary sample of studies developing prognostic models using machine learning methods in the field of oncology.

STUDY DESIGN AND SETTING

We conducted a systematic review, searching the MEDLINE database between December 1, 2022, and December 31, 2022, for studies developing a multivariable prognostic model using machine learning methods (as defined by the authors) in oncology. Two authors independently screened records and extracted open science practices.

RESULTS

We identified 46 publications describing the development of a multivariable prognostic model. The adoption of open science principles was poor. Only one study reported availability of a study protocol, and only one study was registered. Funding statements and conflicts of interest statements were common. Thirty-five studies (76%) provided data sharing statements, with 21 (46%) indicating data were available on request to the authors and seven declaring data sharing was not applicable. Two studies (4%) shared data. Only 12 studies (26%) provided code sharing statements, including 2 (4%) that indicated the code was available on request to the authors. Only 11 studies (24%) provided sufficient information to allow their model to be used in practice. The use of reporting guidelines was rare: eight studies (18%) mentioning using a reporting guideline, with 4 (10%) using the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis Or Diagnosis statement, 1 (2%) using Minimum Information About Clinical Artificial Intelligence Modeling and Consolidated Standards Of Reporting Trials-Artificial Intelligence, 1 (2%) using Strengthening The Reporting Of Observational Studies In Epidemiology, 1 (2%) using Standards for Reporting Diagnostic Accuracy Studies, and 1 (2%) using Transparent Reporting of Evaluations with Nonrandomized Designs.

CONCLUSION

The adoption of open science principles in oncology studies developing prognostic models using machine learning methods is poor. Guidance and an increased awareness of benefits and best practices of open science are needed for prediction research in oncology.

Methodological evaluation of original articles on radiomics and machine learning for outcome prediction based on positron emission tomography (PET)

AIM

Despite a vast number of articles on radiomics and machine learning in positron emission tomography (PET) imaging, clinical applicability remains limited, partly owing to poor methodological quality. We therefore systematically investigated the methodology described in publications on radiomics and machine learning for PET-based outcome prediction.

METHODS

A systematic search for original articles was run on PubMed. All articles were rated according to 17 criteria proposed by the authors. Criteria with >2 rating categories were binarized into "adequate" or "inadequate". The association between the number of "adequate" criteria per article and the date of publication was examined.

RESULTS

One hundred articles were identified (published between 07/2017 and 09/2023). The median proportion of articles per criterion that were rated "adequate" was 65% (range: 23-98%). Nineteen articles (19%) mentioned neither a test cohort nor cross-validation to separate training from testing. The median number of criteria with an "adequate" rating per article was 12.5 out of 17 (range, 4-17), and this did not increase with later dates of publication (Spearman's rho, 0.094; p = 0.35). In 22 articles (22%), less than half of the items were rated "adequate". Only 8% of articles published the source code, and 10% made the dataset openly available.

CONCLUSION

Among the articles investigated, methodological weaknesses have been identified, and the degree of compliance with recommendations on methodological quality and reporting shows potential for improvement. Better adherence to established guidelines could increase the clinical significance of radiomics and machine learning for PET-based outcome prediction and finally lead to the widespread use in routine clinical practice.

Delta-radiomics in cancer immunotherapy response prediction: A systematic review

Background

The new immunotherapies have not only changed the oncological therapeutic approach but have also made it necessary to develop new imaging methods for assessing the response to treatment. Delta radiomics consists of the analysis of radiomic features variation between different medical images, usually before and after therapy.

Purpose

This review aims to evaluate the role of delta radiomics in the immunotherapy response assessment.

Methods

A systematic search was performed in PubMed, Scopus, and Web Of Science using "delta radiomics AND immunotherapy" as search terms. The included articles' methodological quality was measured using the Radiomics Quality Score (RQS) tool.

Results

Thirteen articles were finally included in the systematic review. Overall, the RQS of the included studies ranged from 4 to 17, with a mean RQS total of 11,15 ± 4,18 with a corresponding percentage of 30.98 ± 11.61 %. Eleven articles out of 13 performed imaging at multiple time points. All the included articles performed feature reduction. No study carried out prospective validation, decision curve analysis, or cost-effectiveness analysis.

Conclusions

Delta radiomics has been demonstrated useful in evaluating the response in oncologic patients undergoing immunotherapy. The overall quality was found law, due to the lack of prospective design and external validation. Thus, further efforts are needed to bring delta radiomics a step closer to clinical implementation.

Clinical applications of radiomics in non-small cell lung cancer patients with immune checkpoint inhibitor-related pneumonitis

Immune checkpoint inhibitors (ICIs) modulate the body's immune function to treat tumors but may also induce pneumonitis. Immune checkpoint inhibitor-related pneumonitis (ICIP) is a serious immune-related adverse event (irAE). Immunotherapy is currently approved as a first-line treatment for non-small cell lung cancer (NSCLC), and the incidence of ICIP in NSCLC patients can be as high as 5%-19% in clinical practice. ICIP can be severe enough to lead to the death of NSCLC patients, but there is a lack of a gold standard for the diagnosis of ICIP. Radiomics is a method that uses computational techniques to analyze medical images (e.g., CT, MRI, PET) and extract important features from them, which can be used to solve classification and regression problems in the clinic. Radiomics has been applied to predict and identify ICIP in NSCLC patients in the hope of transforming clinical qualitative problems into quantitative ones, thus improving the diagnosis and treatment of ICIP. In this review, we summarize the pathogenesis of ICIP and the process of radiomics feature extraction, review the clinical application of radiomics in ICIP of NSCLC patients, and discuss its future application prospects.

PET Radiomics and Response to Immunotherapy in Lung Cancer: A Systematic Review of the Literature

The aim of this review is to provide a comprehensive overview of the existing literature concerning the applications of positron emission tomography (PET) radiomics in lung cancer patient candidates or those undergoing immunotherapy.

MATERIALS AND METHODS

A systematic review was conducted on databases and web sources. English-language original articles were considered. The title and abstract were independently reviewed to evaluate study inclusion. Duplicate, out-of-topic, and review papers, or editorials, articles, and letters to editors were excluded. For each study, the radiomics analysis was assessed based on the radiomics quality score (RQS 2.0). The review was registered on the PROSPERO database with the number CRD42023402302.

RESULTS

Fifteen papers were included, thirteen were qualified as using conventional radiomics approaches, and two used deep learning radiomics. The content of each study was different; indeed, seven papers investigated the potential ability of radiomics to predict PD-L1 expression and tumor microenvironment before starting immunotherapy. Moreover, two evaluated the prediction of response, and four investigated the utility of radiomics to predict the response to immunotherapy. Finally, two papers investigated the prediction of adverse events due to immunotherapy.

CONCLUSIONS

Radiomics is promising for the evaluation of TME and for the prediction of response to immunotherapy, but some limitations should be overcome.

Radiomic biomarkers from chest computed tomography are assistive in immunotherapy response prediction for non-small cell lung cancer

Background

Immunotherapies, such as programmed death 1/programmed death ligand 1 (PD-1/PD-L1) antibodies have been shown to improve overall and progression-free survival (PFS) in patients with locally advanced or metastatic non-small cell lung cancer (NSCLC). However, not all patients derive a meaningful clinical benefit. Additionally, patients receiving anti-PD-1/PD-L1 therapy can experience immune-related adverse events (irAEs). Clinically significant irAEs may require temporary pause or discontinuation of treatment. Having a tool to identify patients who may not benefit and/or are at risk for developing severe irAEs from immunotherapy will aid in an informed decision-making process for the patients and their physicians.

Methods

Computed tomography (CT) scans and clinical data were retrospectively collected for this study to develop three prediction models using (I) radiomic features, (II) clinical features, and (III) radiomic and clinical features combined. Each subject had 6 clinical features and 849 radiomic features extracted. Selected features were run through an artificial neural network (NN) trained on 70% of the cohort, maintaining the case and control ratio. The NN was assessed by calculating the area-under-the-receiver-operating-characteristic curve (AUC-ROC), area-under-the-precision-recall curve (AUC-PR), sensitivity, and specificity.

Results

A cohort of 132 subjects, of which 43 (33%) had a PFS ≤90 days and 89 (67%) of which had a PFS >90 days was used to develop the prediction models. The radiomic model was able to predict progression-free survival with a training AUC-ROC of 87% and testing AUC-ROC, sensitivity, and specificity of 83%, 75%, and 81%, respectively. In this cohort, the clinical and radiomic combined features did add a slight increase in the specificity (85%) but with a decrease in sensitivity (75%) and AUC-ROC (81%).

Conclusions

Whole lung segmentation and feature extraction can identify those that would see a benefit from anti-PD-1/PD-L1 therapy.