A quantitative imaging biomarker for predicting disease-free-survival-associated histologic subgroups in lung adenocarcinoma

AI/ML advances in non-small cell lung cancer biomarker discovery

Lung cancer is the leading cause of cancer deaths among both men and women, representing approximately 25% of cancer fatalities each year. The treatment landscape for non-small cell lung cancer (NSCLC) is rapidly evolving due to the progress made in biomarker-driven targeted therapies. While advancements in targeted treatments have improved survival rates for NSCLC patients with actionable biomarkers, long-term survival remains low, with an overall 5-year relative survival rate below 20%. Artificial intelligence/machine learning (AI/ML) algorithms have shown promise in biomarker discovery, yet NSCLC-specific studies capturing the clinical challenges targeted and emerging patterns identified using AI/ML approaches are lacking. Here, we employed a text-mining approach and identified 215 studies that reported potential biomarkers of NSCLC using AI/ML algorithms. We catalogued these studies with respect to BEST (Biomarkers, EndpointS, and other Tools) biomarker sub-types and summarized emerging patterns and trends in AI/ML-driven NSCLC biomarker discovery. We anticipate that our comprehensive review will contribute to the current understanding of AI/ML advances in NSCLC biomarker research and provide an important catalogue that may facilitate clinical adoption of AI/ML-derived biomarkers.

Computed Tomography Radiomics-based Prediction Model for Gender-Age-Physiology Staging of Connective Tissue Disease-associated Interstitial Lung Disease

PURPOSE

To analyze the feasibility of predicting gender-age-physiology (GAP) staging in patients with connective tissue disease-associated interstitial lung disease (CTD-ILD) by radiomics based on computed tomography (CT) of the chest.

MATERIALS AND METHODS

Chest CT images of 184 patients with CTD-ILD were retrospectively analyzed. GAP staging was performed on the basis of gender, age, and pulmonary function test results. GAP I, II, and III have 137, 36, and 11 cases, respectively. The cases in GAP Ⅱ and Ⅲ were then combined into one group, and the two groups of patients were randomly divided into the training and testing groups with a 7:3 ratio. The radiomics features were extracted using AK software. Multivariate logistic regression analysis was then conducted to establish a radiomics model. A nomogram model was established on the basis of Rad-score and clinical factors (age and gender).

RESULTS

For the radiomics model, four significant radiomics features were selected to construct the model and showed excellent ability to differentiate GAP I from GAP Ⅱ and Ⅲ in both the training group (the area under the curve [AUC] = 0.803, 95% confidence interval [CI]: 0.724-0.874) and testing group (AUC = 0.801, 95% CI:0.663-0.912). The nomogram model that combined clinical factors and radiomics features improved higher accuracy of both training (88.4% vs. 82.1%) and testing (83.3% vs. 79.2%).

CONCLUSION

The disease severity assessment of patients with CTD-ILD can be evaluated by applying the radiomics method based on CT images. The nomogram model demonstrates better performance for predicting the GAP staging.

Convolutional Neural Network Addresses the Confounding Impact of CT Reconstruction Kernels on Radiomics Studies

Achieving high feature reproducibility while preserving biological information is one of the main challenges for the generalizability of current radiomics studies. Non-clinical imaging variables, such as reconstruction kernels, have shown to significantly impact radiomics features. In this study, we retrain an open-source convolutional neural network (CNN) to harmonize computerized tomography (CT) images with various reconstruction kernels to improve feature reproducibility and radiomic model performance using epidermal growth factor receptor (EGFR) mutation prediction in lung cancer as a paradigm. In the training phase, the CNN was retrained and tested on 32 lung cancer patients’ CT images between two different groups of reconstruction kernels (smooth and sharp). In the validation phase, the retrained CNN was validated on an external cohort of 223 lung cancer patients’ CT images acquired using different CT scanners and kernels. The results showed that the retrained CNN could be successfully applied to external datasets with different CT scanner parameters, and harmonization of reconstruction kernels from sharp to smooth could significantly improve the performance of radiomics model in predicting EGFR mutation status in lung cancer. In conclusion, the CNN based method showed great potential in improving feature reproducibility and generalizability by harmonizing medical images with heterogeneous reconstruction kernels.

Effect of CT image acquisition parameters on diagnostic performance of radiomics in predicting malignancy of pulmonary nodules of different sizes

OBJECTIVES

To investigate the effect of CT image acquisition parameters on the performance of radiomics in classifying benign and malignant pulmonary nodules (PNs) with respect to nodule size.

METHODS

We retrospectively collected CT images of 696 patients with PNs from March 2015 to March 2018. PNs were grouped by nodule diameter: T1a (diameter ≤ 1.0 cm), T1b (1.0 cm < diameter ≤ 2.0 cm), and T1c (2.0 cm < diameter ≤ 3.0 cm). CT images were divided into four settings according to slice-thickness-convolution-kernels: setting 1 (slice thickness/reconstruction type: 1.25 mm sharp), setting 2 (5 mm sharp), setting 3 (5 mm smooth), and random setting. We created twelve groups from two interacting conditions. Each PN was segmented and had 1160 radiomics features extracted. Non-redundant features with high predictive ability in training were selected to build a distinct model under each of the twelve subsets.

RESULTS

The performance (AUCs) on predicting PN malignancy were as follows: T1a group: 0.84, 0.64, 0.68, and 0.68; T1b group: 0.68, 0.74, 0.76, and 0.70; T1c group: 0.66, 0.64, 0.63, and 0.70, for the setting 1, setting 2, setting 3, and random setting, respectively. In the T1a group, the AUC of radiomics model in setting 1 was statistically significantly higher than all others; In the T1b group, AUCs of radiomics models in setting 3 were statistically significantly higher than some; and in the T1c group, there were no statistically significant differences among models.

CONCLUSIONS

For PNs less than 1 cm, CT image acquisition parameters have a significant influence on diagnostic performance of radiomics in predicting malignancy, and a model created using images reconstructed with thin section and a sharp kernel algorithm achieved the best performance. For PNs larger than 1 cm, CT reconstruction parameters did not affect diagnostic performance substantially.

KEY POINTS

• CT image acquisition parameters have a significant influence on the diagnostic performance of radiomics in pulmonary nodules less than 1 cm. • In pulmonary nodules less than 1 cm, a radiomics model created by using images reconstructed with thin section and a sharp kernel algorithm achieved the best diagnostic performance. • For PNs larger than 1 cm, CT image acquisition parameters do not affect diagnostic performance substantially.

Radiomics Prediction of EGFR Status in Lung Cancer-Our Experience in Using Multiple Feature Extractors and The Cancer Imaging Archive Data

We investigated the performance of multiple radiomics feature extractors/software on predicting epidermal growth factor receptor mutation status in 228 patients with non–small cell lung cancer from publicly available data sets in The Cancer Imaging Archive. The imaging and clinical data were split into training (n = 105) and validation cohorts (n = 123). Two of the most cited open-source feature extractors, IBEX (1563 features) and Pyradiomics (1319 features), and our in-house software, Columbia Image Feature Extractor (CIFE) (1160 features), were used to extract radiomics features. Univariate and multivariate analyses were performed sequentially to predict EGFR mutation status using each individual feature extractor. Our univariate analysis integrated an unsupervised clustering method to identify nonredundant and informative candidate features for the creation of prediction models by multivariate analyses. In training, unsupervised clustering-based univariate analysis identified 5, 6, and 4 features from IBEX, Pyradiomics, and CIFE as candidate features, respectively. Multivariate prediction models using these features from IBEX, Pyradiomics, and CIFE yielded similar areas under the receiver operating characteristic curve of 0.68, 0.67, and 0.69. However, in validation, areas under the receiver operating characteristic curve of multivariate prediction models from IBEX, Pyradiomics, and CIFE decreased to 0.54, 0.56 and 0.64, respectively. Different feature extractors select different radiomics features, which leads to prediction models with varying performance. However, correlation between those selected features from different extractors may indicate these features measure similar imaging phenotypes associated with similar biological characteristics. Overall, attention should be paid to the generalizability of individual radiomics features and radiomics prediction models.

Uncontrolled Confounders May Lead to False or Overvalued Radiomics Signature: A Proof of Concept Using Survival Analysis in a Multicenter Cohort of Kidney Cancer

Purpose

We aimed to explore potential confounders of prognostic radiomics signature predicting survival outcomes in clear cell renal cell carcinoma (ccRCC) patients and demonstrate how to control for them.

Materials and Methods

Preoperative contrast enhanced abdominal CT scan of ccRCC patients along with pathological grade/stage, gene mutation status, and survival outcomes were retrieved from The Cancer Imaging Archive (TCIA)/The Cancer Genome Atlas-Kidney Renal Clear Cell Carcinoma (TCGA-KIRC) database, a publicly available dataset. A semi-automatic segmentation method was applied to segment ccRCC tumors, and 1,160 radiomics features were extracted from each segmented tumor on the CT images. Non-parametric principal component decomposition (PCD) and unsupervised hierarchical clustering were applied to build the radiomics signature models. The factors confounding the radiomics signature were investigated and controlled sequentially. Kaplan-Meier curves and Cox regression analyses were performed to test the association between radiomics signatures and survival outcomes.

Results

183 patients of TCGA-KIRC cohort with available imaging, pathological, and clinical outcomes were included in this study. All 1,160 radiomics features were included in the first radiomics signature. Three additional radiomics signatures were then modelled in successive steps removing redundant radiomics features first, removing radiomics features biased by CT slice thickness second, and removing radiomics features dependent on tumor size third. The final radiomics signature model was the most parsimonious, unbiased by CT slice thickness, and independent of tumor size. This final radiomics signature stratified the cohort into radiomics phenotypes that are different by cancer-specific and recurrence-free survival; HR (95% CI) = 3.0 (1.5-5.7), p <0.05 and HR (95% CI) = 6.6 (3.1-14.1), p <0.05, respectively.

Conclusion

Radiomics signature can be confounded by multiple factors, including feature redundancy, image acquisition parameters like slice thickness, and tumor size. Attention to and proper control for these potential confounders are necessary for a reliable and clinically valuable radiomics signature.

Understanding Sources of Variation to Improve the Reproducibility of Radiomics

Radiomics is the method of choice for investigating the association between cancer imaging phenotype, cancer genotype and clinical outcome prediction in the era of precision medicine. The fast dispersal of this new methodology has benefited from the existing advances of the core technologies involved in radiomics workflow: image acquisition, tumor segmentation, feature extraction and machine learning. However, despite the rapidly increasing body of publications, there is no real clinical use of a developed radiomics signature so far. Reasons are multifaceted. One of the major challenges is the lack of reproducibility and generalizability of the reported radiomics signatures (features and models). Sources of variation exist in each step of the workflow; some are controllable or can be controlled to certain degrees, while others are uncontrollable or even unknown. Insufficient transparency in reporting radiomics studies further prevents translation of the developed radiomics signatures from the bench to the bedside. This review article first addresses sources of variation, which is illustrated using demonstrative examples. Then, it reviews a number of published studies and progresses made to date in the investigation and improvement of feature reproducibility and model performance. Lastly, it discusses potential strategies and practical considerations to reduce feature variability and improve the quality of radiomics study. This review focuses on CT image acquisition, tumor segmentation, quantitative feature extraction, and the disease of lung cancer.

Identifying Robust Radiomics Features for Lung Cancer by Using In-Vivo and Phantom Lung Lesions

We propose a novel framework for determining radiomics feature robustness by considering the effects of both biological and noise signals. This framework is preliminarily tested in a study predicting the epidermal growth factor receptor (EGFR) mutation status in non-small cell lung cancer (NSCLC) patients. Pairs of CT images (baseline, 3-week post therapy) of 46 NSCLC patients with known EGFR mutation status were collected and a FDA-customized anthropomorphic thoracic phantom was scanned on two vendors' scanners at four different tube currents. Delta radiomics features were extracted from the NSCLC patient CTs and reproducible, non-redundant, and informative features were identified. The feature value differences between EGFR mutant and EGFR wildtype patients were quantitatively measured as the biological signal. Similarly, radiomics features were extracted from the phantom CTs. A pairwise comparison between settings resulted in a feature value difference that was quantitatively measured as the noise signal. Biological signals were compared to noise signals at each setting to determine if the distributions were significantly different by two-sample t-test, and thus robust. Four optimal features were selected to predict EGFR mutation status, Tumor-Mass, Sigmoid-Offset-Mean, Gabor-Energy and DWT-Energy, which quantified tumor mass, tumor-parenchyma density transition at boundary, line-like pattern inside tumor and intratumoral heterogeneity, respectively. The first three variables showed robustness across the majority of studied CT acquisition parameters. The textual feature DWT-Energy was less robust. The proposed framework was able to determine robustness of radiomics features at specific settings by comparing biological signal to noise signal. Identification of robust radiomics features may improve the generalizability of radiomics models in future studies.

Lung Cancer and Granuloma Identification Using a Deep Learning Model to Extract 3-Dimensional Radiomics Features in CT Imaging

BACKGROUND

We aimed to evaluate a deep learning (DL) model combining perinodular and intranodular radiomics features and clinical features for preoperative differentiation of solitary granuloma nodules (GNs) from solid lung cancer nodules in patients with spiculation, lobulation, or pleural indentation on CT.

PATIENTS AND METHODS

We retrospectively recruited 915 patients with solitary solid pulmonary nodules and suspicious signs of malignancy. Data including clinical characteristics and subjective CT findings were obtained. A 3-dimensional U-Net-based DL model was used for tumor segmentation and extraction of 3-dimensional radiomics features. We used the Maximum Relevance and Minimum Redundancy (mRMR) algorithm and the eXtreme Gradient Boosting (XGBoost) algorithm to select the intranodular, perinodular, and gross nodular radiomics features. We propose a medical image DL (IDL) model, a clinical image DL (CIDL) model, a radiomics DL (RDL) model, and a clinical image radiomics DL (CIRDL) model to preoperatively differentiate GNs from solid lung cancer. Five-fold cross-validation was used to select and evaluate the models. The prediction performance of the models was evaluated using receiver operating characteristic and calibration curves.

RESULTS

The CIRDL model achieved the best performance in differentiating between GNs and solid lung cancer (area under the curve [AUC] = 0.9069), which was significantly higher compared with the IDL (AUC = 0.8322), CIDL (AUC = 0.8652), intra-RDL (AUC = 0.8583), peri-RDL (AUC = 0.8259), and gross-RDL (AUC = 0.8705) models.

CONCLUSION

The proposed CIRDL model is a noninvasive diagnostic tool to differentiate between granuloma nodules and solid lung cancer nodules and reduce the need for invasive diagnostic and surgical procedures.