Prediction of pathological nodal involvement by CT-based Radiomic features of the primary tumor in patients with clinically node-negative peripheral lung adenocarcinomas

Deep learning model based on primary tumor to predict lymph node status in clinical stage IA lung adenocarcinoma: a multicenter study

Objective

To develop a deep learning model to predict lymph node (LN) status in clinical stage IA lung adenocarcinoma patients.

Methods

This diagnostic study included 1,009 patients with pathologically confirmed clinical stage T1N0M0 lung adenocarcinoma from two independent datasets (699 from Cancer Hospital of Chinese Academy of Medical Sciences and 310 from PLA General Hospital) between January 2005 and December 2019. The Cancer Hospital dataset was randomly split into a training cohort (559 patients) and a validation cohort (140 patients) to train and tune a deep learning model based on a deep residual network (ResNet). The PLA Hospital dataset was used as a testing cohort to evaluate the generalization ability of the model. Thoracic radiologists manually segmented tumors and interpreted high-resolution computed tomography (HRCT) features for the model. The predictive performance was assessed by area under the curves (AUCs), accuracy, precision, recall, and F1 score. Subgroup analysis was performed to evaluate the potential bias of the study population.

Results

A total of 1,009 patients were included in this study; 409 (40.5%) were male and 600 (59.5%) were female. The median age was 57.0 years (inter-quartile range, IQR: 50.0-64.0). The deep learning model achieved AUCs of 0.906 (95% CI: 0.873-0.938) and 0.893 (95% CI: 0.857-0.930) for predicting pN0 disease in the testing cohort and a non-pure ground glass nodule (non-pGGN) testing cohort, respectively. No significant difference was detected between the testing cohort and the non-pGGN testing cohort (P = 0.622). The precisions of this model for predicting pN0 disease were 0.979 (95% CI: 0.963-0.995) and 0.983 (95% CI: 0.967-0.998) in the testing cohort and the non-pGGN testing cohort, respectively. The deep learning model achieved AUCs of 0.848 (95% CI: 0.798-0.898) and 0.831 (95% CI: 0.776-0.887) for predicting pN2 disease in the testing cohort and the non-pGGN testing cohort, respectively. No significant difference was detected between the testing cohort and the non-pGGN testing cohort (P = 0.657). The recalls of this model for predicting pN2 disease were 0.903 (95% CI: 0.870-0.936) and 0.931 (95% CI: 0.901-0.961) in the testing cohort and the non-pGGN testing cohort, respectively.

Conclusions

The superior performance of the deep learning model will help to target the extension of lymph node dissection and reduce the ineffective lymph node dissection in early-stage lung adenocarcinoma patients.

Value of CT-Based Deep Learning Model in Differentiating Benign and Malignant Solid Pulmonary Nodules ≤ 8 mm

RATIONALE AND OBJECTIVES

We examined the effectiveness of computed tomography (CT)-based deep learning (DL) models in differentiating benign and malignant solid pulmonary nodules (SPNs) ≤ 8 mm.

MATERIALS AND METHODS

The study patients (n = 719) were divided into internal training, internal validation, and external validation cohorts; all had small SPNs and had undergone preoperative chest CTs and surgical resection. We developed five DL models incorporating features of the nodule and five different peri-nodular regions with the Multiscale Dual Attention Network (MDANet) to differentiate benign and malignant SPNs. We selected the best-performing model, which was then compared to four conventional algorithms (VGG19, ResNet50, ResNeXt50, and DenseNet121). Furthermore, another five DL models were constructed using MDANet to distinguish benign tumors from inflammatory nodules and the one performed best was selected out.

RESULTS

Model 4, which incorporated the nodule and 15 mm peri-nodular region, best differentiated benign and malignant SPNs. The model had an area under the curve (AUC), accuracy, recall, precision, and F1-score of 0.730, 0.724, 0.711, 0.705, and 0.707 in the external validation cohort. Model 4 also performed better than the other four conventional algorithms. Model 8, which incorporated the nodule and 10 mm peri-nodular region, was the best model for distinguishing benign tumors from inflammatory nodules. The model had an AUC, accuracy, recall, precision, and F1-score of 0.871, 0.938, 0.863, 0.904, and 0.882 in the external validation cohort.

CONCLUSION

The study concludes that CT-based DL models built with MDANet can accurately discriminate among small benign and malignant SPNs, benign tumors and inflammatory nodules.

Predictive value of radiomic features extracted from primary lung adenocarcinoma in forecasting thoracic lymph node metastasis: a systematic review and meta-analysis

BACKGROUND

The application of radiomics in thoracic lymph node metastasis (LNM) of lung adenocarcinoma is increasing, but diagnostic performance of radiomics from primary tumor to predict LNM has not been systematically reviewed. Therefore, this study sought to provide a general overview regarding the methodological quality and diagnostic performance of using radiomic approaches to predict the likelihood of LNM in lung adenocarcinoma.

METHODS

Studies were gathered from literature databases such as PubMed, Embase, the Web of Science Core Collection, and the Cochrane library. The Radiomic Quality Score (RQS) and the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) were both used to assess the quality of each study. The pooled sensitivity, specificity, and area under the curve (AUC) of the best radiomics models in the training and validation cohorts were calculated. Subgroup and meta-regression analyses were also conducted.

RESULTS

Seventeen studies with 159 to 1202 patients each were enrolled between the years of 2018 to 2022, of which ten studies had sufficient data for the quantitative evaluation. The percentage of RQS was between 11.1% and 44.4% and most of the studies were considered to have a low risk of bias and few applicability concerns in QUADAS-2. Pyradiomics and logistic regression analysis were the most commonly used software and methods for radiomics feature extraction and selection, respectively. In addition, the best prediction models in seventeen studies were mainly based on radiomics features combined with non-radiomics features (semantic features and/or clinical features). The pooled sensitivity, specificity, and AUC of the training cohorts were 0.84 (95% confidence interval (CI) [0.73-0.91]), 0.88 (95% CI [0.81-0.93]), and 0.93(95% CI [0.90-0.95]), respectively. For the validation cohorts, the pooled sensitivity, specificity, and AUC were 0.89 (95% CI [0.82-0.94]), 0.86 (95% CI [0.74-0.93]) and 0.94 (95% CI [0.91-0.96]), respectively.

CONCLUSIONS

Radiomic features based on the primary tumor have the potential to predict preoperative LNM of lung adenocarcinoma. However, radiomics workflow needs to be standardized to better promote the applicability of radiomics.

TRIAL REGISTRATION

CRD42022375712.

Development and validation of a deep learning signature for predicting lymph node metastasis in lung adenocarcinoma: comparison with radiomics signature and clinical-semantic model

OBJECTIVE

To develop and validate a deep learning (DL) signature for predicting lymph node (LN) metastasis in patients with lung adenocarcinoma.

METHODS

A total of 612 patients with pathologically-confirmed lung adenocarcinoma were retrospectively enrolled and were randomly divided into training cohort (n = 489) and internal validation cohort (n = 123). Besides, 108 patients were enrolled and constituted an independent test cohort (n = 108). Patients' clinical characteristics and CT semantic features were collected. The radiomics features were derived from contrast-enhanced CT images. The clinical-semantic model and radiomics signature were built to predict LN metastasis. Furthermore, Swin Transformer was adopted to develop a DL signature predictive of LN metastasis. Model performance was evaluated by area under the receiver operating characteristic curve (AUC), sensitivity, specificity, calibration curve, and decision curve analysis. The comparisons of AUC were conducted by the DeLong test.

RESULTS

The proposed DL signature yielded an AUC of 0.948-0.961 across all three cohorts, significantly superior to both clinical-semantic model and radiomics signature (all p < 0.05). The calibration curves show that DL signature predicted probabilities fit well the actual observed probabilities of LN metastasis. DL signature gained a higher net benefit than both clinical-semantic model and radiomics signature. The incorporation of radiomics signature or clinical-semantic risk predictors failed to reveal an incremental value over the DL signature.

CONCLUSIONS

The proposed DL signature based on Swin Transformer achieved a promising performance in predicting LN metastasis and could confer important information in noninvasive mediastinal LN staging and individualized therapeutic options.

KEY POINTS

• Accurate prediction for lymph node metastasis is crucial to formulate individualized therapeutic options for patients with lung adenocarcinoma. • The deep learning signature yielded an AUC of 0.948-0.961 across all three cohorts in predicting lymph node metastasis, superior to both radiomics signature and clinical-semantic model. • The incorporation of radiomics signature or clinical-semantic risk predictors into deep learning signature failed to reveal an incremental value over deep learning signature.

Predictive value of peritumour radiomics in the diagnosis of benign and malignant pulmonary nodules with halo sign

AIM

To evaluate peritumour radiomics in predicting benign and malignant pulmonary nodules with halo sign.

MATERIALS AND METHODS

In this retrospective study, 305 pulmonary nodules with halo sign (benign, 120; adenocarcinoma, 185) were collected. Manual segmentation was used to mark the gross tumour volume (GTV) and the peritumour volume (PTV) was established by uniform dilation (1 cm) of the tumour area in three dimensions. The GTV and PTV radiomic features were combined to produce the gross tumour and peritumour volume (GPTV). The minimum-redundancy maximum-relevance (mRMR) feature ranking method and least absolute shrinkage and selection operator (LASSO) algorithm were used to eliminate redundant radiomic features. Predictive models combined with clinical features and radiomic signatures were established. Multivarible logistic regression analysis was used to establish the combined model and develop a nomogram. Receiver operating characteristic (ROC) curve analysis was used to evaluate the predictive performance of the model.

RESULTS

In the testing cohort, the area under the ROC curve (AUC) of the GTV, PTV, and GPTV radiomic models was 0.701 (95% CI: 0.589-0.814), 0.674 (95% CI: 0.557-0.791) and 0.755 (95% CI: 0.643-0.867), respectively. The AUC of the nomogram model based on clinical and GPTV radiomic signatures was 0.804 (95% CI: 0.707-0.901).

CONCLUSION

The nomogram model based on clinical and GPTV radiomic signatures can better predict benign and malignant pulmonary nodules with halo signs, demonstrating that the model has potential as a convenient and effective auxiliary diagnostic tool for radiologists.

Feature selection methods and predictive models in CT lung cancer radiomics

Radiomics is a technique that extracts quantitative features from medical images using data-characterization algorithms. Radiomic features can be used to identify tissue characteristics and radiologic phenotyping that is not observable by clinicians. A typical workflow for a radiomics study includes cohort selection, radiomic feature extraction, feature and predictive model selection, and model training and validation. While there has been increasing attention given to radiomic feature extraction, standardization, and reproducibility, currently, there is a lack of rigorous evaluation of feature selection methods and predictive models. Herein, we review the published radiomics investigations in CT lung cancer and provide an overview of the commonly used radiomic feature selection methods and predictive models. We also compare limitations of various methods in clinical applications and present sources of uncertainty associated with those methods. This review is expected to help raise awareness of the impact of radiomic feature and model selection methods on the integrity of radiomics studies.

Predicting N2 lymph node metastasis in presurgical stage I-II non-small cell lung cancer using multiview radiomics and deep learning method

BACKGROUND

Accurate diagnosis of N2 lymph node status of the resectable stage I-II non-small cell lung cancer (NSCLC) before surgery is crucial, while there is lack of corresponding method clinically.

PURPOSE

To develop and validate a model to quantitively predict the N2 lymph node metastasis in presurgical clinical stage I-II NSCLC using multiview radiomics and deep learning method.

METHODS

In this study, 140 NSCLC patients were enrolled and randomly divided into training and test sets. Univariate and multiple analysis method were used step by step to establish the clinical model; Then a multiview radiomics modeling scheme was designed, in which the optimal input feature set was determined by subcategorizing radiomics features (C1: original; C2: LoG and C3: wavelet) and comparison of corresponding radiomics model. The minimum-redundancy maximum-relevance (mRMR) selection and the least absolute shrinkage and selection operator (LASSO) algorithm were used for the feature selection and construction of each radiomics model (Rad). Next, an end-to-end ResNet18 architecture and transfer learning techniques were designed to construct a deep learning model (DL). Subsequently, the screened clinical risk factors and constructed Rad and DL models were combined and compared and a nomogram was constructed. Finally, the diagnostic performance of all constructed models were evaluated and compared using receiver operating characteristic curve (ROC) analysis, Delong test, Calibration analysis, Hosmer-Lemeshow test, and decision curves, respectively.

RESULTS

Carcinoma embryonic antigen (CEA) level and spiculation were screened to make up the Clinical model, while seven radiomics features in the optimal input feature set C2 + C3 were selected to construct the Rad. DL was constructed by training on 1.8 million natural images and small sample data of our N2 lymph node volume of interest (VOI) images. Except for the Clinical model, all other models showed good predictive accuracy and consistency in both training set and test set. DL (area under curve (AUC): 0.83) was better than Rad (AUC: 0.76) in predictive accuracy, but their difference was not significant (p = 0.45). The combined models showed better diagnostic performance than the model only clinical or image risk factors were used (AUC for Clinical, Rad + DL, Rad + Clinical, DL + Clinical, and Rad + DL + Clinical were respectively 0.66, 0.86, 0.82, 0.86, and 0.88). Finally, the Rad + DL + Clinical model with the best diagnostic performance was selected to draw the final nomogram for clinical use.

CONCLUSION

This study proposes a nomogram based on multiview radiomics, deep learning, and clinical features that can be efficiently used to quantitively predict presurgical N2 diseases in patients with clinical stage I-II NSCLC.

18F-FDG PET/CT radiomics nomogram for predicting occult lymph node metastasis of non-small cell lung cancer

Purpose

To investigate the ability of a PET/CT-based radiomics nomogram to predict occult lymph node metastasis in patients with clinical stage N0 non-small cell lung cancer (NSCLC).

Materials and methods

This retrospective study included 228 patients with surgically confirmed NSCLC (training set, 159 patients; testing set, 69 patients). ITKsnap3.8.0 was used for image(CT and PET images) segmentation, AK version 3.2.0 was used for radiomics feature extraction, and Python3.7.0 was used for radiomics feature screening. A radiomics model for predicting occult lymph node metastasis was established using a logistic regression algorithm. A nomogram was constructed by combining radiomics scores with selected clinical predictors. Receiver operating characteristic (ROC) curves were used to verify the performance of the radiomics model and nomogram in the training and testing sets.

Results

The radiomics nomogram comprising six selected features achieved good prediction efficiency, including radiomics characteristics and tumor location information (central or peripheral), which demonstrated good calibration and discrimination ability in the training (area under the ROC curve [AUC] = 0.884, 95% confidence interval [CI]: 0.826-0.941) and testing (AUC = 0.881, 95% CI: 0.8031-0.959) sets. Clinical decision curves demonstrated that the nomogram was clinically useful.

Conclusion

The PET/CT-based radiomics nomogram is a noninvasive tool for predicting occult lymph node metastasis in NSCLC.

The impact of inter-observer variation in delineation on robustness of radiomics features in non-small cell lung cancer

Artificial intelligence and radiomics have the potential to revolutionise cancer prognostication and personalised treatment. Manual outlining of the tumour volume for extraction of radiomics features (RF) is a subjective process. This study investigates robustness of RF to inter-observer variation (IOV) in contouring in lung cancer. We utilised two public imaging datasets: ‘NSCLC-Radiomics’ and ‘NSCLC-Radiomics-Interobserver1’ (‘Interobserver’). For ‘NSCLC-Radiomics’, we created an additional set of manual contours for 92 patients, and for ‘Interobserver’, there were five manual and five semi-automated contours available for 20 patients. Dice coefficients (DC) were calculated for contours. 1113 RF were extracted including shape, first order and texture features. Intraclass correlation coefficient (ICC) was computed to assess robustness of RF to IOV. Cox regression analysis for overall survival (OS) was performed with a previously published radiomics signature. The median DC ranged from 0.81 (‘NSCLC-Radiomics’) to 0.85 (‘Interobserver’—semi-automated). The median ICC for the ‘NSCLC-Radiomics’, ‘Interobserver’ (manual) and ‘Interobserver’ (semi-automated) were 0.90, 0.88 and 0.93 respectively. The ICC varied by feature type and was lower for first order and gray level co-occurrence matrix (GLCM) features. Shape features had a lower median ICC in the ‘NSCLC-Radiomics’ dataset compared to the ‘Interobserver’ dataset. Survival analysis showed similar separation of curves for three of four RF apart from ‘original_shape_Compactness2’, a feature with low ICC (0.61). The majority of RF are robust to IOV, with first order, GLCM and shape features being the least robust. Semi-automated contouring improves feature stability. Decreased robustness of a feature is significant as it may impact upon the features’ prognostic capability.

Performance of machine learning algorithms for glioma segmentation of brain MRI: a systematic literature review and meta-analysis

OBJECTIVES

Different machine learning algorithms (MLAs) for automated segmentation of gliomas have been reported in the literature. Automated segmentation of different tumor characteristics can be of added value for the diagnostic work-up and treatment planning. The purpose of this study was to provide an overview and meta-analysis of different MLA methods.

METHODS

A systematic literature review and meta-analysis was performed on the eligible studies describing the segmentation of gliomas. Meta-analysis of the performance was conducted on the reported dice similarity coefficient (DSC) score of both the aggregated results as two subgroups (i.e., high-grade and low-grade gliomas). This study was registered in PROSPERO prior to initiation (CRD42020191033).

RESULTS

After the literature search (n = 734), 42 studies were included in the systematic literature review. Ten studies were eligible for inclusion in the meta-analysis. Overall, the MLAs from the included studies showed an overall DSC score of 0.84 (95% CI: 0.82-0.86). In addition, a DSC score of 0.83 (95% CI: 0.80-0.87) and 0.82 (95% CI: 0.78-0.87) was observed for the automated glioma segmentation of the high-grade and low-grade gliomas, respectively. However, heterogeneity was considerably high between included studies, and publication bias was observed.

CONCLUSION

MLAs facilitating automated segmentation of gliomas show good accuracy, which is promising for future implementation in neuroradiology. However, before actual implementation, a few hurdles are yet to be overcome. It is crucial that quality guidelines are followed when reporting on MLAs, which includes validation on an external test set.

KEY POINTS

• MLAs from the included studies showed an overall DSC score of 0.84 (95% CI: 0.82-0.86), indicating a good performance. • MLA performance was comparable when comparing the segmentation results of the high-grade gliomas and the low-grade gliomas. • For future studies using MLAs, it is crucial that quality guidelines are followed when reporting on MLAs, which includes validation on an external test set.

A Radiomics Nomogram for Preoperative Prediction of Clinical Occult Lymph Node Metastasis in cT1-2N0M0 Solid Lung Adenocarcinoma

Background

Clinical occult lymph node metastasis (cOLNM) means that the lymph node is negatively diagnosed by preoperative computed tomography (CT), but has been proven to be positive by postoperative pathology. The aim of this study was to establish and validate a nomogram based on radiomics features for the preoperative prediction of cOLNM in early-stage solid lung adenocarcinoma patients.

Methods

A total of 244 patients with clinical T1-2N0M0 solid lung adenocarcinoma who underwent preoperative contrast-enhanced chest CT were divided into a primary group (n = 160) and an independent validation group from another hospital (n = 84). The records of 851 radiomics features of each primary tumor were extracted. LASSO analysis was used to reduce the data dimensionality and select features. Multivariable logistic regression was utilized to identify independent predictors of cOLNM and develop a predictive nomogram. The performance of the predictive model was assessed by its calibration and discrimination. Decision curve analysis (DCA) was performed to estimate the clinical usefulness of the nomogram.

Results

The predictive model consisted of a clinical factor (CT-reported tumor size) and a radiomics feature (Rad-score). The nomogram presented good discrimination, with a C-index of 0.782 (95% CI, 0.768–0.796) in the primary cohort and 0.813 (95% CI, 0.787–0.839) in the validation cohort, and good calibration. DCA showed that the radiomics nomogram was clinically useful.

Conclusion

This study develops and validates a nomogram that incorporates clinical and radiomics factors. It can be tailored for the individualized preoperative prediction of cOLNM in early-stage solid lung adenocarcinoma patients.

Contemporary issues in the implementation of lung cancer screening

Lung cancer screening with low-dose computed tomography can reduce death from lung cancer by 20-24% in high-risk smokers. National lung cancer screening programmes have been implemented in the USA and Korea and are being implemented in Europe, Canada and other countries. Lung cancer screening is a process, not a test. It requires an organised programmatic approach to replicate the lung cancer mortality reduction and safety of pivotal clinical trials. Cost-effectiveness of a screening programme is strongly influenced by screening sensitivity and specificity, age to stop screening, integration of smoking cessation intervention for current smokers, screening uptake, nodule management and treatment costs. Appropriate management of screen-detected lung nodules has significant implications for healthcare resource utilisation and minimising harm from radiation exposure related to imaging studies, invasive procedures and clinically significant distress. This review focuses on selected contemporary issues in the path to implement a cost-effective lung cancer screening at the population level. The future impact of emerging technologies such as deep learning and biomarkers are also discussed.

Integrative nomogram of intratumoral, peritumoral, and lymph node radiomic features for prediction of lymph node metastasis in cT1N0M0 lung adenocarcinomas

Radiomics studies to predict lymph node (LN) metastasis has only focused on either primary tumor or LN alone. However, combining radiomics features from multiple sources may reflect multiple characteristic of the lesion thereby increasing the discriminative performance of the radiomic model. Therefore, the present study intends to evaluate the efficiency of integrative nomogram, created by combining clinical parameters and radiomics features extracted from gross tumor volume (GTV), peritumoral volume (PTV) and LN, for the preoperative prediction of LN metastasis in clinical cT1N0M0 adenocarcinoma. A primary cohort of 163 patients (training cohort, 113; and internal validation cohort, 50) and an external validation cohort of 53 patients with clinical stage cT1N0M0 were retrospectively included. Features were extracted from three regions of interests (ROIs): GTV; PTV (5.0 mm around the tumor) and LN on pre-operative contrast enhanced computed tomography (CT). LASSO logistic regression method was used to build radiomic signatures. Multivariable regression analysis was used to build a nomogram. The performance of the nomogram was assessed with respect to its calibration, discrimination, and clinical usefulness. The discriminative performance of nomogram was validated both internally and externally. The radiomic signatures using the features of GTV, PTV and LN showed a good ability in predicting LN metastasis with an area under the curve (AUC) of 0.74 (95% CI 0.60–0.88), 0.72 (95% CI 0.57–0.87) and 0.64 (95% CI 0.48–0.80) respectively in external validation cohort. The integration of different signature together further increases the discriminatory ability: GTV + PTV (GPTV): AUC 0.75 (95% CI 0.61–0.89) and GPTV + LN: AUC 0.76 (95% CI 0.61–0.91) in external validation cohort. An integrative nomogram of clinical parameters and radiomic features demonstrated further increase in discriminatory ability with AUC of 0.79 (95% CI 0.66–0.93) in external validation cohort. The nomogram showed good calibration. Decision curve analysis demonstrated that the radiomic nomogram was clinically useful. The integration of information from clinical parameters along with CT radiomics information from GTV, PTV and LN was feasible and increases the predictive performance of the nomogram in predicting LN status in cT1N0M0 adenocarcinoma patients suggesting merit of information integration from multiple sources in building prediction model.

Development and Validation of a Combined Model for Preoperative Prediction of Lymph Node Metastasis in Peripheral Lung Adenocarcinoma

Background

Based on the “seed and soil” theory proposed by previous studies, we aimed to develop and validate a combined model of machine learning for predicting lymph node metastasis (LNM) in patients with peripheral lung adenocarcinoma (PLADC).

Methods

Radiomics models were developed in a primary cohort of 390 patients (training cohort) with pathologically confirmed PLADC from January 2016 to August 2018. The patients were divided into the LNM (−) and LNM (+) groups. Thereafter, the patients were subdivided according to TNM stages N0, N1, N2, and N3. Radiomic features from unenhanced computed tomography (CT) were extracted. Radiomic signatures of the primary tumor (R1) and adjacent pleura (R2) were built as predictors of LNM. CT morphological features and clinical characteristics were compared between both groups. A combined model incorporating R1, R2, and CT morphological features, and clinical risk factors was developed by multivariate analysis. The combined model’s performance was assessed by receiver operating characteristic (ROC) curve. An internal validation cohort containing 166 consecutive patients from September 2018 to November 2019 was also assessed.

Results

Thirty-one radiomic features of R1 and R2 were significant predictors of LNM (all P < 0.05). Sex, smoking history, tumor size, density, air bronchogram, spiculation, lobulation, necrosis, pleural effusion, and pleural involvement also differed significantly between the groups (all P < 0.05). R1, R2, tumor size, and spiculation in the combined model were independent risk factors for predicting LNM in patients with PLADC, with area under the ROC curves (AUCs) of 0.897 and 0.883 in the training and validation cohorts, respectively. The combined model identified N0, N1, N2, and N3, with AUCs ranging from 0.691–0.927 in the training cohort and 0.700–0.951 in the validation cohort, respectively, thereby indicating good performance.

Conclusion

CT phenotypes of the primary tumor and adjacent pleura were significantly associated with LNM. A combined model incorporating radiomic signatures, CT morphological features, and clinical risk factors can assess LNM of patients with PLADC accurately and non-invasively.

Assessment of Clinical Stage IA Lung Adenocarcinoma with pN1/N2 Metastasis Using CT Quantitative Texture Analysis

OBJECTIVE

To explore the application of texture analysis basing on computed tomography (CT) images in predicting lymph-node metastasis in patients with clinical stage IA lung adenocarcinoma.

METHODS

In total, 256 patients with clinical stage IA lung adenocarcinoma who had underwentgone preoperative CT examinations were enrolled. A total of 25 texture features using MaZda (version 4.6) software and conventional radiological features were extracted from raw CT data sets. Based on surgical results, patients were stratified into lymph node metastasis-positive and -negative groups. Independent-sample t-tests and Mann-Whitney U tests were used to compare continuous variables between the groups. Continuity-correction and χ2 tests were used for categorical variable comparison. Univariate and multivariate logistic regression analyses were performed to identify independent predictors of lymph-node metastasis.

RESULTS

In total, 256 clinical stage IA lung adenocarcinoma cases were proved by pathology: 39 (15.23%) cases with lymph-node metastasis (14 N1a, seven N1b, six N2a1, ten N2a2, and two N2b) and 217 (84.77%) cases without lymph-node metastasis. Univariate and multivariate logistic regression analyses demonstrated that total volume (OR 3.777, p=0.015), average CT value of whole tumor (OR 16.271, p<0.001), three texture parameters (mean OR 8.473, p<0.001; skewness OR 6.393, p=0.001; and entropy OR 0.343, p=0.049) were independent factors associated with lymph-node status. As such, early-stage lung adenocarcinoma with higher total volume (>4.05 cm3), average CT value of whole tumor (>-70 HU), mean (>133.79), entropy (>1.98), and lower skewness (≤0.02) pointed to positive lymph-node metastasis.

CONCLUSION

Texture parameters were independent factors associated with lymph-node status in clinical stage IA lung adenocarcinoma.

Association of a CT-Based Clinical and Radiomics Score of Non-Small Cell Lung Cancer (NSCLC) with Lymph Node Status and Overall Survival

Background: To evaluate whether a model based on radiomic and clinical features may be associated with lymph node (LN) status and overall survival (OS) in lung cancer (LC) patients; to evaluate whether CT reconstruction algorithms may influence the model performance. Methods: patients operated on for LC with a pathological stage up to T3N1 were retrospectively selected and divided into training and validation sets. For the prediction of positive LNs and OS, the Least Absolute Shrinkage and Selection Operator (LASSO) logistic regression model was used; univariable and multivariable logistic regression analysis assessed the association of clinical-radiomic variables and endpoints. All tests were repeated after dividing the groups according to the CT reconstruction algorithm. p-values < 0.05 were considered significant. Results: 270 patients were included and divided into training (n = 180) and validation sets (n = 90). Transfissural extension was significantly associated with positive LNs. For OS prediction, high- and low-risk groups were different according to the radiomics score, also after dividing the two groups according to reconstruction algorithms. Conclusions: a combined clinical–radiomics model was not superior to a single clinical or single radiomics model to predict positive LNs. A radiomics model was able to separate high-risk and low-risk patients for OS; CTs reconstructed with Iterative Reconstructions (IR) algorithm showed the best model performance.

Development and evaluation of a venous computed tomography radiomics model to predict lymph node metastasis from non-small cell lung cancer

The objective of this study was to develop a venous computed tomography (CT)-based radiomics model to predict the lymph node metastasis (LNM) in patients with non-small cell lung cancer (NSCLC). A total of 411 consecutive patients with NSCLC underwent tumor resection and lymph node (LN) dissection from January 2018 to September 2018 in our hospital. A radiologist with 20 years of diagnostic experience retrospectively reviewed all CT scans and classified all visible LNs into LNM and non-LNM groups without the knowledge of pathological diagnosis. A logistic regression model (radiomics model) in classification of pathology-confirmed NSCLC patients with and without LNM was developed on radiomics features for NSCLC patients. A morphology model was also developed on qualitative morphology features in venous CT scans. A training group included 288 patients (99 with and 189 without LNM) and a validation group included 123 patients (42 and 81, respectively). The receiver operating characteristic curve was performed to discriminate LNM (+) from LNM (-) for CT-reported status, the morphology model and the radiomics model. The area under the curve value in LNM classification on the training group was significantly greater at 0.79 (95% confidence interval [CI]: 0.77-0.81) by use of the radiomics model (build by best 10 features in predicting LNM) compared with 0.51 by CT-reported LN status (P < .001) or 0.66 (95% CI: 0.64-0.68) by morphology model (build by tumor size and spiculation) (P < .001). Similarly, the area under the curve value on the validation group was 0.73 (95% CI: 0.70-0.76) by the radiomics model, compared with 0.52 or 0.63 (95% CI: 0.60-0.66) by the other 2 (both P < .001). A radiomics model shows excellent performance for predicting LNM in NSCLC patients. This predictive radiomics model may benefit patients to get better treatments such as an appropriate surgery.

Interdisciplinarity: An essential requirement for translation of radiomics research into clinical practice -a systematic review focused on thoracic oncology

BACKGROUND

Recently, evidence has accumulated that demonstrates the potential for future applications of radiomics in many clinical settings, including thoracic oncology. Methodological reasons for the immaturity of image mining (radiomics and artificial intelligence-based) studies have been identified. However, data on the influence of the composition of the research team on the quality of investigations in radiomics are lacking.

AIM

This review aims to evaluate the interdisciplinarity within studies on radiomics in thoracic oncology in order to assess its influence on the quality of research (QUADAS-2 score) in the image mining field.

METHODS

We considered for inclusion radiomics investigations with objectives relating to clinical practice in thoracic oncology. Subsequently, we interviewed the corresponding authors. The field of expertise and/or educational degree was then used to assess interdisciplinarity. Subsequently, all studies were evaluated applying the QUADAS-2 score and assigned to a research phase from 0 to IV.

RESULTS

Overall, 27 studies were included. The study quality according to the QUADAS-2 score was low (score ≤5) in 8, moderate (=6) in 12, and high (≥7) in 7 papers. An interdisciplinary team (at least 3 different expertise categories) was involved in half of the papers without any type of validation and in all papers with independent validation. Clinicians were not involved in phase 0 studies while they contributed to all papers classified as phase I and to 4/5 papers classified as phase II with independent validation.

CONCLUSIONS

The composition of the research team influences the quality of investigations in radiomics. Also, growth in interdisciplinarity appears to reflect research development from the early phase to a more mature, clinically oriented stage of investigation.

CT Radiomics Signature of Tumor and Peritumoral Lung Parenchyma to Predict Nonsmall Cell Lung Cancer Postsurgical Recurrence Risk

RATIONALE AND OBJECTIVES

To estimate recurrence risk after surgery in nonsmall cell lung cancer (NSCLC) patients by employing tumoral and peritumoral radiomics analysis.

MATERIALS AND METHODS

One-hundred twenty-four surgically treated stage IA-IIB NSCLC patients' data from 2008 to 2013 were retrospectively collected. Patient outcome was defined as local recurrence (LR), distant metastasis (DM), and (sum of LR and DM) total recurrence (TR) at follow-up. Volumetric region of interests (ROIs) were drawn for the tumor, peritumoral lung parenchyma (2 cm around the tumor) and involved lobe on CT images. Ninety-four (morphological, first-order, textural, fractal-based) radiomics features were extracted from the ROIs and datasets were created from single or combined ROIs. Predictive models were built with radiomics signature (RS) and clinicopathological data, and the area under the curve (AUC) was used to evaluate the performance. Radiomics score was calculated with the best models' feature coefficients, low- and high-risk groups of patients defined accordingly. Kaplan-Meier curves were built, and the log-rank test was used for comparison among low- and high-risk groups. Differences in recurrence risk among the two risk groups were calculated (chi-square test).

RESULTS

Fifty-six patients developed TR (25 LR, 31 DM). The tumor-node-metastasis (TNM) stage recurrence predictability (AUC_TR 0.680; AUC_DM 0.672; AUC_LR 0.580) was substantially improved when RS was added to the predictive model (AUC_TR 0.760; AUC_DM 0.759; AUC_LR 0.750). Seventy-five percent of high-risk patients developed TR. Recurrence risk of the high-risk group was 16-fold higher than that of the low-risk group (p < 0.001).

CONCLUSION

Combination of the tumoral and peritumoral RS with TNM staging system outperformed TNM staging alone in individualized recurrence risk estimation of patients with surgically treated NSCLC.

Use CT Imaging to Predict the Short-Term Outcome of Concurrent Chemoradiotherapy in Patients With Locally Advanced Esophageal Squamous Cell Carcinoma

Objective:

To extract the computed tomography (CT) imaging features of the primary lesions in patients with advanced esophageal squamous cell carcinoma (ESCC) and to study whether these imaging features can predict the short-term outcome after concurrent chemoradiotherapy (CCRT).

Methods:

From January 2014 to December 2015, a total of 49 patients with locally advanced ESCC who underwent CCRT were analyzed retrospectively. They were randomly categorized into the training and validation groups. Collection of CT imaging of patients before and intermediate stage undergoing radiotherapy. The correlations between imaging characteristics and short-term outcome were analyzed. The accuracy of cutoff value was verified by imaging characteristics of patients in validation group.

Result:

There were 38 patients in the training group and 11 patients in the validation group. 13 patients in the training group were classified as responders and 25 patients as nonresponders. According to the CT imaging before radiotherapy, there are no significant differences between responders and nonresponders. According to the CT imaging in the middle stage of radiotherapy, responders showed significantly higher Roundness than nonresponders (P = .004, 95% confidence interval [CI] = 0.0419-0.212). The areas under the ROC curves for the ability to predict significantly tumor response were 0.768 for Roundness (P = .001, 95% CI = 0.603-0.889). The cutoff value of Roundness is 0.3099. Roundness showed no significant associations with survival parameters.

Conclusions:

Computed tomography imaging in the middle stage of radiotherapy can predict the short-term outcome of concurrent chemoradiotherapy for patients with locally advanced ESCC but have no predictive effect on the total survival time.

Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics

PURPOSE

The aim of this systematic review was to analyse literature on artificial intelligence (AI) and radiomics, including all medical imaging modalities, for oncological and non-oncological applications, in order to assess how far the image mining research stands from routine medical application. To do this, we applied a trial phases classification inspired from the drug development process.

METHODS

Among the articles we considered for inclusion from PubMed were multimodality AI and radiomics investigations, with a validation analysis aimed at relevant clinical objectives. Quality assessment of selected papers was performed according to the QUADAS-2 criteria. We developed the phases classification criteria for image mining studies.

RESULTS

Overall 34,626 articles were retrieved, 300 were selected applying the inclusion/exclusion criteria, and 171 high-quality papers (QUADAS-2 ≥ 7) were identified and analysed. In 27/171 (16%), 141/171 (82%), and 3/171 (2%) studies the development of an AI-based algorithm, radiomics model, and a combined radiomics/AI approach, respectively, was described. A total of 26/27(96%) and 1/27 (4%) AI studies were classified as phase II and III, respectively. Consequently, 13/141 (9%), 10/141 (7%), 111/141 (79%), and 7/141 (5%) radiomics studies were classified as phase 0, I, II, and III, respectively. All three radiomics/AI studies were categorised as phase II trials.

CONCLUSIONS

The results of the studies are promising but still not mature enough for image mining tools to be implemented in the clinical setting and be widely used. The transfer learning from the well-known drug development process, with some specific adaptations to the image mining discipline could represent the most effective way for radiomics and AI algorithms to become the standard of care tools.

Development of a predictive radiomics model for lymph node metastases in pre-surgical CT-based stage IA non-small cell lung cancer

OBJECTIVES

To develop and validate predictive models using clinical parameters, radiomic features and a combination of both for lymph node metastasis (LNM) in pre-surgical CT-based stage IA non-small cell lung cancer (NSCLC) patients.

METHODS

This retrospective study included 649 pre-surgical CT-based stage IA NSCLC patients from our hospital. One hundred and thirty-eight (21 %) of the 649 patients had LNM after surgery. A total of 396 radiomic features were extracted from the venous phase contrast enhanced computed tomography (CECT). The training group included 455 patients (97 with and 358 without LNM) and the testing group included 194 patients (41 with and 153 without LNM). The least absolute shrinkage and selection operator (LASSO) algorithm was used for radiomic feature selection. The random forest (RF) was used for model development. Three models (a clinical model, a radiomics model, and a combined model) were developed to predict LNM in early stage NSCLC patients. The area under the receiver operating characteristic (ROC) curve (AUC) value and decision curve analysis were used to evaluate the performance in LNM status (with or without LNM) using the three models.

RESULTS

The ROC analysis (also decision curve analysis) showed predictive performance for LNM of the radiomics model (AUC values for training and testing, respectively 0.898 and 0.851) and of the combined model (0.911 and 0.860, respectively). Both performed better than the clinical model (0.739 and 0.614, respectively; delong test p-values both<0.001).

CONCLUSION

A radiomics model using the venous phase of CE-CT has potential for predicting LNM in pre-surgical CT-based stage IA NSCLC patients.

MRI-based radiomics signature is a quantitative prognostic biomarker for nasopharyngeal carcinoma

This study aimed to develop prognosis signatures through a radiomics analysis for patients with nasopharyngeal carcinoma (NPC) by their pretreatment diagnosis magnetic resonance imaging (MRI). A total of 208 radiomics features were extracted for each patient from a database of 303 patients. The patients were split into the training and validation cohorts according to their pretreatment diagnosis date. The radiomics feature analysis consisted of cluster analysis and prognosis model analysis for disease free-survival (DFS), overall survival (OS), distant metastasis-free survival (DMFS) and locoregional recurrence-free survival (LRFS). Additionally, two prognosis models using clinical features only and combined radiomics and clinical features were generated to estimate the incremental prognostic value of radiomics features. Patients were clustered by non-negative matrix factorization (NMF) into two groups. It showed high correspondence with patients' T stage (p < 0.00001) and overall stage information (p < 0.00001) by chi-squared tests. There were significant differences in DFS (p = 0.0052), OS (p = 0.033), and LRFS (p = 0.037) between the two clustered groups but not in DMFS (p = 0.11) by log-rank tests. Radiomics nomograms that incorporated radiomics and clinical features could estimate DFS with the C-index of 0.751 [0.639, 0.863] and OS with the C-index of 0.845 [0.752, 0.939] in the validation cohort. The nomograms improved the prediction accuracy with the C-index value of 0.029 for DFS and 0.107 for OS compared with clinical features only. The DFS and OS radiomics nomograms developed in our study demonstrated the excellent prognostic estimation for NPC patients with a noninvasive way of MRI. The combination of clinical and radiomics features can provide more information for precise treatment decision.

Can peritumoral radiomics increase the efficiency of the prediction for lymph node metastasis in clinical stage T1 lung adenocarcinoma on CT?

OBJECTIVES

To evaluate the efficiency of radiomics model on CT images of intratumoral and peritumoral lung parenchyma for preoperative prediction of lymph node (LN) metastasis in clinical stage T1 peripheral lung adenocarcinoma patients.

METHODS

Three hundred sixty-six peripheral lung adenocarcinoma patients with clinical stage T1 were evaluated using five CT scanners. For each patient, two volumes of interest (VOIs) on CT were defined as the gross tumor volume (GTV) and the peritumoral volume (PTV, 1.5 cm around the tumor). One thousand nine hundred forty-six radiomic features were obtained from each VOI, and then refined for reproducibility and redundancy. The refined features were investigated for usefulness in building radiomic signatures by mRMR feature ranking method and LASSO classifier. Multivariable logistic regression analysis was used to develop a radiomic nomogram incorporating the radiomic signature and clinical parameters. The prediction performance was evaluated on the validation cohort.

RESULTS

The radiomic signatures using the features of GTV and PTV showed a good ability in predicting LN metastasis with an AUC of 0.829 (95% CI, 0.745-0.913) and 0.825 (95% CI, 0.733-0.918), respectively. By incorporating the features of GTV and PTV, the AUC of radiomic signature increased to 0.843 (95% CI, 0.770-0.916). The AUC of radiomic nomogram was 0.869 (95% CI, 0.800-0.938).

CONCLUSIONS

Radiomic signatures of GTV and PTV both had a good prediction ability in the prediction of LN metastasis, and there is no significant difference of AUC between the two groups. The proposed nomogram can be conveniently used to facilitate the preoperative prediction of LN metastasis in T1 peripheral lung adenocarcinomas.

KEY POINTS

• Radiomics from peritumoral lung parenchyma increase the efficiency of the prediction for lymph node metastasis in clinical stage T1 lung adenocarcinoma on CT. • A radiomic nomogram was developed and validated to predict LN metastasis. • Different scan parameters on CT showed that radiomics signature had good predictive performance.

Relationship between Circulating Inflammation Proteins and Lung Cancer Diagnosis in the National Lung Screening Trial

BACKGROUND

Previously, we observed a strong relationship between circulating serum inflammation proteins in relation to lung cancer diagnosis and risk, both in case-control and prospective cohorts. Low-dose computed tomography (LDCT) screening has a high prevalence of false-positive nodules, thus companion noninvasive biomarkers that can distinguish between benign and malignant nodules could have clinical utility and positive impact on patient outcomes.

METHODS

We conducted a nested case-control study within the National Lung Screening Trial. Concentrations of 30 inflammation proteins were measured on plasma samples of 262 cases and 528 controls using a highly sensitive and analytically validated electrochemiluminescence V-PLEX immunoassay.

RESULTS

Comparing the fourth quartile with the first quartile, we found increased IFNγ and IL12/IL23p40 associated with increased odds of a lung cancer diagnosis [OR 1.89, 95% confidence intervals (CI), 1.16-3.09; OR 2.49, 95% CI, 1.46-4.23, respectively]. Confirming our previous observations, we also detected a relationship between increased IL6, IL8, and C-reactive protein (CRP) with lung cancer diagnosis. These relationships were significant after adjustment for age, gender, race, smoking, body mass index (BMI), family history of lung cancer, and previous diagnoses of inflammatory conditions. However, none of these proteins could distinguish between a benign and malignant lung nodule (IL6: OR 1.25, 95% CI, 0.59-2.64; IL8: OR 1.40, 95% CI, 0.70-2.81; CRP: OR 0.98, 95% CI, 0.45-2.12).

CONCLUSIONS

We have discovered new associations for IFNγ and IL12/IL23p40 with lung cancer but have no evidence that these proteins can distinguish between benign and malignant lung nodules.

IMPACT

Circulating inflammation proteins are unlikely to have utility as companion LDCT biomarkers.