Development and evaluation of a venous computed tomography radiomics model to predict lymph node metastasis from non-small cell lung cancer

Diagnostic accuracy of CT and PET/CT radiomics in predicting lymph node metastasis in non-small cell lung cancer

OBJECTIVES

This study evaluates the accuracy of radiomics in predicting lymph node metastasis in non-small cell lung cancer, which is crucial for patient management and prognosis.

METHODS

Adhering to PRISMA and AMSTAR guidelines, we systematically reviewed literature from March 2012 to December 2023 using databases including PubMed, Web of Science, and Embase. Radiomics studies utilizing computed tomography (CT) and positron emission tomography (PET)/CT imaging were included. The quality of studies was appraised with QUADAS-2 and RQS tools, and the TRIPOD checklist assessed model transparency. Sensitivity, specificity, and AUC values were synthesized to determine diagnostic performance, with subgroup and sensitivity analyses probing heterogeneity and a Fagan plot evaluating clinical applicability.

RESULTS

Our analysis incorporated 42 cohorts from 22 studies. CT-based radiomics demonstrated a sensitivity of 0.84 (95% CI: 0.79-0.88, p < 0.01) and specificity of 0.82 (95% CI: 0.75-0.87, p < 0.01), with an AUC of 0.90 (95% CI: 0.87-0.92), indicating no publication bias (p-value = 0.54 > 0.05). PET/CT radiomics showed a sensitivity of 0.82 (95% CI: 0.76-0.86, p < 0.01) and specificity of 0.86 (95% CI: 0.81-0.90, p < 0.01), with an AUC of 0.90 (95% CI: 0.87-0.93), with a slight publication bias (p-value = 0.03 < 0.05). Despite high clinical utility, subgroup analysis did not clarify heterogeneity sources, suggesting influences from possible factors like lymph node location and small subgroup sizes.

CONCLUSIONS

Radiomics models show accuracy in predicting lung cancer lymph node metastasis, yet further validation with larger, multi-center studies is necessary.

CLINICAL RELEVANCE STATEMENT

Radiomics models using CT and PET/CT imaging may improve the prediction of lung cancer lymph node metastasis, aiding personalized treatment strategies.

RESEARCH REGISTRATION UNIQUE IDENTIFYING NUMBER (UIN)

International Prospective Register of Systematic Reviews (PROSPERO), CRD42023494701. This study has been registered on the PROSPERO platform with a registration date of 18 December 2023. https://www.crd.york.ac.uk/prospero/ KEY POINTS: The study explores radiomics for lung cancer lymph node metastasis detection, impacting surgery and prognosis. Radiomics improves the accuracy of lymph node metastasis prediction in lung cancer. Radiomics can aid in the prediction of lymph node metastasis in lung cancer and personalized treatment.

An [18F]FDG PET/3D-ultrashort echo time MRI-based radiomics model established by machine learning facilitates preoperative assessment of lymph node status in non-small cell lung cancer

OBJECTIVES

To develop an [18F]FDG PET/3D-UTE model based on clinical factors, three-dimensional ultrashort echo time (3D-UTE), and PET radiomics features via machine learning for the assessment of lymph node (LN) status in non-small cell lung cancer (NSCLC).

METHODS

A total of 145 NSCLC patients (training, 101 cases; test, 44 cases) underwent whole-body [18F]FDG PET/CT and chest [18F]FDG PET/MRI were enrolled. Preoperative clinical factors and 3D-UTE, CT, and PET radiomics features were analyzed. The Mann-Whitney U test, LASSO regression, and SelectKBest were used for feature extraction. Five machine learning algorithms were used to establish prediction models, which were evaluated by the area under receiver-operator characteristic (ROC), DeLong test, calibration curves, and decision curve analysis (DCA).

RESULTS

A prediction model based on random forest, consisting of four clinical factors, six 3D-UTE, and six PET radiomics features, was used as the final model for PET/3D-UTE. The AUCs of this model were 0.912 and 0.791 in the training and test sets, respectively, which not only showed different degrees of improvement over individual models such as clinical, 3D-UTE, and PET (AUC-training = 0.838, 0.834, and 0.828, AUC-test = 0.756, 0.745, and 0.768, respectively) but also achieved the similar diagnostic efficacy as the optimal PET/CT model (AUC-training = 0.890, AUC-test = 0.793). The calibration curves and DCA indicated good consistency (C-index, 0.912) and clinical utility of this model, respectively.

CONCLUSION

The [18F]FDG PET/3D-UTE model based on clinical factors, 3D-UTE, and PET radiomics features using machine learning methods could noninvasively assess the LN status of NSCLC.

CLINICAL RELEVANCE STATEMENT

A machine learning model of 18F-fluorodeoxyglucose positron emission tomography/ three-dimensional ultrashort echo time could noninvasively assess the lymph node status of non-small cell lung cancer, which provides a novel method with less radiation burden for clinical practice.

KEY POINTS

• The 3D-UTE radiomics model using the PLS-DA classifier was significantly associated with LN status in NSCLC and has similar diagnostic performance as the clinical, CT, and PET models. • The [18F]FDG PET/3D-UTE model based on clinical factors, 3D-UTE, and PET radiomics features using the RF classifier could noninvasively assess the LN status of NSCLC and showed improved diagnostic performance compared to the clinical, 3D-UTE, and PET models. • In the assessment of LN status in NSCLC, the [18F]FDG PET/3D-UTE model has similar diagnostic efficacy as the [18F]FDG PET/CT model that incorporates clinical factors and CT and PET radiomics features.

External Validation of Robust Radiomic Signature to Predict 2-Year Overall Survival in Non-Small-Cell Lung Cancer

Lung cancer is the second most fatal disease worldwide. In the last few years, radiomics is being explored to develop prediction models for various clinical endpoints in lung cancer. However, the robustness of radiomic features is under question and has been identified as one of the roadblocks in the implementation of a radiomic-based prediction model in the clinic. Many past studies have suggested identifying the robust radiomic feature to develop a prediction model. In our earlier study, we identified robust radiomic features for prediction model development. The objective of this study was to develop and validate the robust radiomic signatures for predicting 2-year overall survival in non-small cell lung cancer (NSCLC). This retrospective study included a cohort of 300 stage I-IV NSCLC patients. Institutional 200 patients' data were included for training and internal validation and 100 patients' data from The Cancer Image Archive (TCIA) open-source image repository for external validation. Radiomic features were extracted from the CT images of both cohorts. The feature selection was performed using hierarchical clustering, a Chi-squared test, and recursive feature elimination (RFE). In total, six prediction models were developed using random forest (RF-Model-O, RF-Model-B), gradient boosting (GB-Model-O, GB-Model-B), and support vector(SV-Model-O, SV-Model-B) classifiers to predict 2-year overall survival (OS) on original data as well as balanced data. Model validation was performed using 10-fold cross-validation, internal validation, and external validation. Using a multistep feature selection method, the overall top 10 features were chosen. On internal validation, the two random forest models (RF-Model-O, RF-Model-B) displayed the highest accuracy; their scores on the original and balanced datasets were 0.81 and 0.77 respectively. During external validation, both the random forest models' accuracy was 0.68. In our study, robust radiomic features showed promising predictive performance to predict 2-year overall survival in NSCLC.

Application of radiomics in diagnosis and treatment of lung cancer

Radiomics has become a research field that involves the process of converting standard nursing images into quantitative image data, which can be combined with other data sources and subsequently analyzed using traditional biostatistics or artificial intelligence (Al) methods. Due to the capture of biological and pathophysiological information by radiomics features, these quantitative radiomics features have been proven to provide fast and accurate non-invasive biomarkers for lung cancer risk prediction, diagnosis, prognosis, treatment response monitoring, and tumor biology. In this review, radiomics has been emphasized and discussed in lung cancer research, including advantages, challenges, and drawbacks.

Efficacy of radiomics model based on the concept of gross tumor volume and clinical target volume in predicting occult lymph node metastasis in non-small cell lung cancer

Objective

This study aimed to establish a predictive model for occult lymph node metastasis (LNM) in patients with clinical stage I-A non-small cell lung cancer (NSCLC) based on contrast-enhanced CT.

Methods

A total of 598 patients with stage I-IIA NSCLC from different hospitals were randomized into the training and validation group. The "Radiomics" tool kit of AccuContour software was employed to extract the radiomics features of GTV and CTV from chest-enhanced CT arterial phase pictures. Then, the least absolute shrinkage and selection operator (LASSO) regression analysis was applied to reduce the number of variables and develop GTV, CTV, and GTV+CTV models for predicting occult lymph node metastasis (LNM).

Results

Eight optimal radiomics features related to occult LNM were finally identified. The receiver operating characteristic (ROC) curves of the three models showed good predictive effects. The area under the curve (AUC) value of GTV, CTV, and GTV+CTV model in the training group was 0.845, 0.843, and 0.869, respectively. Similarly, the corresponding AUC values in the validation group were 0.821, 0.812, and 0.906. The combined GTV+CTV model exhibited a better predictive performance in the training and validation group by the Delong test (p<0.05). Moreover, the decision curve showed that the combined GTV+CTV predictive model was superior to the GTV or CTV model.

Conclusion

The radiomics prediction models based on GTV and CTV can predict occult LNM in patients with clinical stage I-IIA NSCLC preoperatively, and the combined GTV+CTV model is the optimal strategy for clinical application.

Feature selection methods and predictive models in CT lung cancer radiomics

Radiomics is a technique that extracts quantitative features from medical images using data-characterization algorithms. Radiomic features can be used to identify tissue characteristics and radiologic phenotyping that is not observable by clinicians. A typical workflow for a radiomics study includes cohort selection, radiomic feature extraction, feature and predictive model selection, and model training and validation. While there has been increasing attention given to radiomic feature extraction, standardization, and reproducibility, currently, there is a lack of rigorous evaluation of feature selection methods and predictive models. Herein, we review the published radiomics investigations in CT lung cancer and provide an overview of the commonly used radiomic feature selection methods and predictive models. We also compare limitations of various methods in clinical applications and present sources of uncertainty associated with those methods. This review is expected to help raise awareness of the impact of radiomic feature and model selection methods on the integrity of radiomics studies.

Developing a primary tumor and lymph node 18F-FDG PET/CT-clinical (TLPC) model to predict lymph node metastasis of resectable T2-4 NSCLC

PURPOSE

The goal of this study was to investigate whether the combined PET/CT radiomic features of the primary tumor and lymph node could predict lymph node metastasis (LNM) of resectable non-small cell lung cancer (NSCLC) in stage T2-4.

METHODS

This retrospective study included 192 NSCLC patients who underwent tumor and node dissection between August 2016 and December 2017 and underwent ¹⁸F-fluorodeoxyglucose (¹⁸F-FDG) PET/CT scanning 1-3 weeks before surgery. In total, 192 primary tumors (> 3 cm) and 462 lymph nodes (LN > 0.5 cm) were analyzed. The pretreatment clinical features of these patients were recorded, and the radiomic features of their primary tumor and lymph node were extracted from PET/CT imaging. The Spearman's relevance combined with the least absolute shrinkage and selection operator was used for radiomic feature selection. Five independent machine learning models (multi-layer perceptron, extreme Gradient Boosting, light gradient boosting machine, gradient boosting decision tree, and support vector machine) were tested as classifiers for model development. We developed the following three models to predict LNM: tumor PET/CT-clinical (TPC), lymph PET/CT-clinical (LPC), and tumor and lymph PET/CT-clinical (TLPC). The performance of the models and the clinical node (cN) staging was evaluated using the ROC curve and confusion matrix analysis.

RESULTS

The ROC analysis showed that among the three models, the TLPC model had better predictive clinical utility and efficiency in predicting LNM of NSCLC (AUC = 0.93, accuracy = 85%; sensitivity = 0.93; specificity = 0.75) than both the TPC model (AUC = 0.54, accuracy = 50%; specificity = 0.38; sensitivity = 0.59) and the LPC model (AUC = 0.82, accuracy = 70%; specificity = 0.41; sensitivity = 0.92). The TLPC model also exhibited great potential in predicting the N2 stage in NSCLC (AUC = 0.94, accuracy = 79%; specificity = 0.64; sensitivity = 0.91).

CONCLUSION

The combination of CT and PET radiomic features of the primary tumor and lymph node showed great potential for predicting LNM of resectable T2-4 NSCLC. The TLPC model can non-invasively predict lymph node metastasis in NSCLC, which may be helpful for clinicians to develop more rational therapeutic strategies.

Diagnostic Accuracy of Deep Learning and Radiomics in Lung Cancer Staging: A Systematic Review and Meta-Analysis

Background

Artificial intelligence has far surpassed previous related technologies in image recognition and is increasingly used in medical image analysis. We aimed to explore the diagnostic accuracy of the models based on deep learning or radiomics for lung cancer staging.

Methods

Studies were systematically reviewed using literature searches from PubMed, EMBASE, Web of Science, and Wanfang Database, according to PRISMA guidelines. Studies about the diagnostic accuracy of radiomics and deep learning, including the identifications of lung cancer, tumor types, malignant lung nodules and lymph node metastase, were included. After identifying the articles, the methodological quality was assessed using the QUADAS-2 checklist. We extracted the characteristic of each study; the sensitivity, specificity, and AUROC for lung cancer diagnosis were summarized for subgroup analysis.

Results

The systematic review identified 19 eligible studies, of which 14 used radiomics models and 5 used deep learning models. The pooled AUROC of 7 studies to determine whether patients had lung cancer was 0.83 (95% CI 0.78–0.88). The pooled AUROC of 9 studies to determine whether patients had NSCLC was 0.78 (95% CI 0.73–0.83). The pooled AUROC of the 6 studies that determined patients had malignant lung nodules was 0.79 (95% CI 0.77–0.82). The pooled AUROC of the other 6 studies that determined whether patients had lymph node metastases was 0.74 (95% CI 0.66–0.82).

Conclusion

The models based on deep learning or radiomics have the potential to improve diagnostic accuracy for lung cancer staging.

Systematic Review Registration

https://inplasy.com/inplasy-2022-3-0167/, identifier: INPLASY202230167.

Nomogram based on prognostic nutrition index and Chest CT imaging signs predicts lymph node metastasis in NSCLC patients

OBJECTIVE

To establish and validate a model capable of predicting lymph node metastasis (LNM) of non-small cell lung cancer (NSCLC) patients.

METHODS

Preoperative clinical and CT imaging data on patients with NSCLC undergoing surgery were retrospectively analyzed. A model was developed using a training cohort of 290 patients. The univariate analysis followed by dichotomous logistic regression was performed to estimate different risk factors of lymph node metastasis, and a nomogram was constructed. Using another testing cohort of 120 patients, the performance of the nomogram was validated using several evaluation methods and indices and evaluated including via the area under the curve (AUC), calibration curve, Hosmer-Lemeshow test and decision curve analysis (DCA).

RESULTS

CT-based imaging signs were important independent risk factors for lymph node metastasis in NSCLC patients. The possible risk factors also included four other independent risk factors through dichotomous logistic regression, i.e., age, SIRI, PNI and CEA, which were filtered and included in the nomogram. Nomogram yields AUC values of 0.828 [95% confidence interval (CI): 0.778-0.877] in the training cohort and 0.816 (95% CI: 0.737-0.895) in the validation cohort, respectively. The calibration curves showed high agreement in both the training and validation cohorts. At the threshold probability of 0-0.8, the nomogram increases the net outcomes compared to the treat-none and treat-all lines in the decision curve.

CONCLUSIONS

The nomogram based on the PNI and CT images signs holds promise as a novel and accurate tool for predicting the LNM in NSCLC patients and guiding intraoperative lymph node dissection.

Development and Validation of a Combined Model for Preoperative Prediction of Lymph Node Metastasis in Peripheral Lung Adenocarcinoma

Background

Based on the “seed and soil” theory proposed by previous studies, we aimed to develop and validate a combined model of machine learning for predicting lymph node metastasis (LNM) in patients with peripheral lung adenocarcinoma (PLADC).

Methods

Radiomics models were developed in a primary cohort of 390 patients (training cohort) with pathologically confirmed PLADC from January 2016 to August 2018. The patients were divided into the LNM (−) and LNM (+) groups. Thereafter, the patients were subdivided according to TNM stages N0, N1, N2, and N3. Radiomic features from unenhanced computed tomography (CT) were extracted. Radiomic signatures of the primary tumor (R1) and adjacent pleura (R2) were built as predictors of LNM. CT morphological features and clinical characteristics were compared between both groups. A combined model incorporating R1, R2, and CT morphological features, and clinical risk factors was developed by multivariate analysis. The combined model’s performance was assessed by receiver operating characteristic (ROC) curve. An internal validation cohort containing 166 consecutive patients from September 2018 to November 2019 was also assessed.

Results

Thirty-one radiomic features of R1 and R2 were significant predictors of LNM (all P < 0.05). Sex, smoking history, tumor size, density, air bronchogram, spiculation, lobulation, necrosis, pleural effusion, and pleural involvement also differed significantly between the groups (all P < 0.05). R1, R2, tumor size, and spiculation in the combined model were independent risk factors for predicting LNM in patients with PLADC, with area under the ROC curves (AUCs) of 0.897 and 0.883 in the training and validation cohorts, respectively. The combined model identified N0, N1, N2, and N3, with AUCs ranging from 0.691–0.927 in the training cohort and 0.700–0.951 in the validation cohort, respectively, thereby indicating good performance.

Conclusion

CT phenotypes of the primary tumor and adjacent pleura were significantly associated with LNM. A combined model incorporating radiomic signatures, CT morphological features, and clinical risk factors can assess LNM of patients with PLADC accurately and non-invasively.