A Comparative Study of Radiomics and Deep-Learning Based Methods for Pulmonary Nodule Malignancy Prediction in Low Dose CT Images

Prospective external validation of radiomics-based predictive model of distant metastasis after dynamic tumor tracking stereotactic body radiation therapy in patients with non-small-cell lung cancer: A multi-institutional analysis

BACKGROUND AND PURPOSE

This study aims to externally validate a predictive model for distant metastasis (DM) with computed tomography (CT)-based radiomics features in prospectively enrolled non-small-cell lung cancer patients undergoing dynamic tumor-tracking stereotactic body radiation therapy (DTT-SBRT).

MATERIALS AND METHODS

The study collected retrospective data from 567 patients across 11 institutions as the training dataset and prospectively enrolled 42 patients from four institutions as the external test dataset. Four clinical features were collected, and 944 CT-based radiomic features were extracted from gross tumor volumes. After standardization and feature selection, DM predictive models were developed using fine and gray regression (FG) and random survival forest (RSF), incorporating clinical and radiomic features, and their combinations within the training dataset. Then, the model was applied to the test dataset, dividing patients into high- and low-risk groups based on medians of risk scores. Model performance was assessed using the concordance index (C-index), and the statistical significance between groups was evaluated using Gray's test.

RESULTS

In the training dataset, 122 of 567 patients (21.5%) developed DM, compared to 9 of 42 patients (21.4%) in the test dataset. In the test dataset, the C-indices of the clinical, radiomics, and hybrid models with FG were 0.559, 0.544, and 0.560, respectively, whereas those with RSF were 0.576, 0.604, and 0.627, respectively. The hybrid model with RSF, which exhibited the best predictive performance of all models, identified 7 of 23 patients (30.4%) as high risk and 2 of 19 patients (10.5%) as low risk for DM incidence in the test dataset (p = 0.116).

CONCLUSION

Although predictive models for DM lack significance when applied to prospectively enrolled cases undergoing DTT-lung SBRT, the model with RSF exhibits a consistent capacity to effectively classify patients at a high risk of developing DM.

EfficientNet-Based System for Detecting EGFR-Mutant Status and Predicting Prognosis of Tyrosine Kinase Inhibitors in Patients with NSCLC

We aimed to develop and validate a deep learning-based system using pre-therapy computed tomography (CT) images to detect epidermal growth factor receptor (EGFR)-mutant status in patients with non-small cell lung cancer (NSCLC) and predict the prognosis of advanced-stage patients with EGFR mutations treated with EGFR tyrosine kinase inhibitors (TKI). This retrospective, multicenter study included 485 patients with NSCLC from four hospitals. Of them, 339 patients from three centers were included in the training dataset to develop an EfficientNetV2-L-based model (EME) for predicting EGFR-mutant status, and the remaining patients were assigned to an independent test dataset. EME semantic features were extracted to construct an EME-prognostic model to stratify the prognosis of EGFR-mutant NSCLC patients receiving EGFR-TKI. A comparison of EME and radiomics was conducted. Additionally, we included patients from The Cancer Genome Atlas lung adenocarcinoma dataset with both CT images and RNA sequencing data to explore the biological associations between EME score and EGFR-related biological processes. EME obtained an area under the curve (AUC) of 0.907 (95% CI 0.840-0.926) on the test dataset, superior to the radiomics model (P = 0.007). The EME and radiomics fusion model showed better (AUC, 0.941) but not significantly increased performance (P = 0.895) compared with EME. In prognostic stratification, the EME-prognostic model achieved the best performance (C-index, 0.711). Moreover, the EME-prognostic score showed strong associations with biological pathways related to EGFR expression and EGFR-TKI efficacy. EME demonstrated a non-invasive and biologically interpretable approach to predict EGFR status, stratify survival prognosis, and correlate biological pathways in patients with NSCLC.

A Multichannel CT and Radiomics-Guided CNN-ViT (RadCT-CNNViT) Ensemble Network for Diagnosis of Pulmonary Sarcoidosis

Pulmonary sarcoidosis is a multisystem granulomatous interstitial lung disease (ILD) with a variable presentation and prognosis. The early accurate detection of pulmonary sarcoidosis may prevent progression to pulmonary fibrosis, a serious and potentially life-threatening form of the disease. However, the lack of a gold-standard diagnostic test and specific radiographic findings poses challenges in diagnosing pulmonary sarcoidosis. Chest computed tomography (CT) imaging is commonly used but requires expert, chest-trained radiologists to differentiate pulmonary sarcoidosis from lung malignancies, infections, and other ILDs. In this work, we develop a multichannel, CT and radiomics-guided ensemble network (RadCT-CNNViT) with visual explainability for pulmonary sarcoidosis vs. lung cancer (LCa) classification using chest CT images. We leverage CT and hand-crafted radiomics features as input channels, and a 3D convolutional neural network (CNN) and vision transformer (ViT) ensemble network for feature extraction and fusion before a classification head. The 3D CNN sub-network captures the localized spatial information of lesions, while the ViT sub-network captures long-range, global dependencies between features. Through multichannel input and feature fusion, our model achieves the highest performance with accuracy, sensitivity, specificity, precision, F1-score, and combined AUC of 0.93 ± 0.04, 0.94 ± 0.04, 0.93 ± 0.08, 0.95 ± 0.05, 0.94 ± 0.04, and 0.97, respectively, in a five-fold cross-validation study with pulmonary sarcoidosis (n = 126) and LCa (n = 93) cases. A detailed ablation study showing the impact of CNN + ViT compared to CNN or ViT alone, and CT + radiomics input, compared to CT or radiomics alone, is also presented in this work. Overall, the AI model developed in this work offers promising potential for triaging the pulmonary sarcoidosis patients for timely diagnosis and treatment from chest CT.

Development and external validation of a multimodal integrated feature neural network (MIFNN) for the diagnosis of malignancy in small pulmonary nodules (≤10 mm)

Objectives. Current lung cancer screening protocols primarily evaluate pulmonary nodules, yet often neglect the malignancy risk associated with small nodules (≤10 mm). This study endeavors to optimize the management of pulmonary nodules in this population by devising and externally validating a Multimodal Integrated Feature Neural Network (MIFNN). We hypothesize that the fusion of deep learning algorithms with morphological nodule features will significantly enhance diagnostic accuracy.Materials and Methods. Data were retrospectively collected from the Lung Nodule Analysis 2016 (LUNA16) dataset and four local centers in Beijing, China. The study includes patients with small pulmonary nodules (≤10 mm). We developed a neural network, termed MIFNN, that synergistically combines computed tomography (CT) images and morphological characteristics of pulmonary nodules. The network is designed to acquire clinically relevant deep learning features, thereby elevating the diagnostic accuracy of existing models. Importantly, the network's simple architecture and use of standard screening variables enable seamless integration into standard lung cancer screening protocols.Results. In summary, the study analyzed a total of 382 small pulmonary nodules (85 malignant) from the LUNA16 dataset and 101 small pulmonary nodules (33 malignant) obtained from four specialized centers in Beijing, China, for model training and external validation. Both internal and external validation metrics indicate that the MIFNN significantly surpasses extant state-of-the-art models, achieving an internal area under the curve (AUC) of 0.890 (95% CI: 0.848-0.932) and an external AUC of 0.843 (95% CI: 0.784-0.891).Conclusion. The MIFNN model significantly enhances the diagnostic accuracy of small pulmonary nodules, outperforming existing benchmarks by Zhanget alwith a 6.34% improvement for nodules less than 10 mm. Leveraging advanced integration techniques for imaging and clinical data, MIFNN increases the efficiency of lung cancer screenings and optimizes nodule management, potentially reducing false positives and unnecessary biopsies.Clinical relevance statement. The MIFNN enhances lung cancer screening efficiency and patient management for small pulmonary nodules, while seamlessly integrating into existing workflows due to its reliance on standard screening variables.

Automatic Osteoporosis Screening System Using Radiomics and Deep Learning from Low-Dose Chest CT Images

OBJECTIVE

Develop two fully automatic osteoporosis screening systems using deep learning (DL) and radiomics (Rad) techniques based on low-dose chest CT (LDCT) images and evaluate their diagnostic effectiveness.

METHODS

In total, 434 patients who underwent LDCT and bone mineral density (BMD) examination were retrospectively enrolled and divided into the development set (n = 333) and temporal validation set (n = 101). An automatic thoracic vertebra cancellous bone (TVCB) segmentation model was developed. The Dice similarity coefficient (DSC) was used to evaluate the segmentation performance. Furthermore, the three-class Rad and DL models were developed to distinguish osteoporosis, osteopenia, and normal bone mass. The diagnostic performance of these models was evaluated using the receiver operating characteristic (ROC) curve and decision curve analysis (DCA).

RESULTS

The automatic segmentation model achieved excellent segmentation performance, with a mean DSC of 0.96 ± 0.02 in the temporal validation set. The Rad model was used to identify osteoporosis, osteopenia, and normal BMD in the temporal validation set, with respective area under the receiver operating characteristic curve (AUC) values of 0.943, 0.801, and 0.932. The DL model achieved higher AUC values of 0.983, 0.906, and 0.969 for the same categories in the same validation set. The Delong test affirmed that both models performed similarly in BMD assessment. However, the accuracy of the DL model is 81.2%, which is better than the 73.3% accuracy of the Rad model in the temporal validation set. Additionally, DCA indicated that the DL model provided a greater net benefit compared to the Rad model across the majority of the reasonable threshold probabilities Conclusions: The automated segmentation framework we developed can accurately segment cancellous bone on low-dose chest CT images. These predictive models, which are based on deep learning and radiomics, provided comparable diagnostic performance in automatic BMD assessment. Nevertheless, it is important to highlight that the DL model demonstrates higher accuracy and precision than the Rad model.

Expanding Role of Advanced Image Analysis in CT-detected Indeterminate Pulmonary Nodules and Early Lung Cancer Characterization

The implementation of low-dose chest CT for lung screening presents a crucial opportunity to advance lung cancer care through early detection and interception. In addition, millions of pulmonary nodules are incidentally detected annually in the United States, increasing the opportunity for early lung cancer diagnosis. Yet, realization of the full potential of these opportunities is dependent on the ability to accurately analyze image data for purposes of nodule classification and early lung cancer characterization. This review presents an overview of traditional image analysis approaches in chest CT using semantic characterization as well as more recent advances in the technology and application of machine learning models using CT-derived radiomic features and deep learning architectures to characterize lung nodules and early cancers. Methodological challenges currently faced in translating these decision aids to clinical practice, as well as the technical obstacles of heterogeneous imaging parameters, optimal feature selection, choice of model, and the need for well-annotated image data sets for the purposes of training and validation, will be reviewed, with a view toward the ultimate incorporation of these potentially powerful decision aids into routine clinical practice.

PET Radiomics and Response to Immunotherapy in Lung Cancer: A Systematic Review of the Literature

The aim of this review is to provide a comprehensive overview of the existing literature concerning the applications of positron emission tomography (PET) radiomics in lung cancer patient candidates or those undergoing immunotherapy.

MATERIALS AND METHODS

A systematic review was conducted on databases and web sources. English-language original articles were considered. The title and abstract were independently reviewed to evaluate study inclusion. Duplicate, out-of-topic, and review papers, or editorials, articles, and letters to editors were excluded. For each study, the radiomics analysis was assessed based on the radiomics quality score (RQS 2.0). The review was registered on the PROSPERO database with the number CRD42023402302.

RESULTS

Fifteen papers were included, thirteen were qualified as using conventional radiomics approaches, and two used deep learning radiomics. The content of each study was different; indeed, seven papers investigated the potential ability of radiomics to predict PD-L1 expression and tumor microenvironment before starting immunotherapy. Moreover, two evaluated the prediction of response, and four investigated the utility of radiomics to predict the response to immunotherapy. Finally, two papers investigated the prediction of adverse events due to immunotherapy.

CONCLUSIONS

Radiomics is promising for the evaluation of TME and for the prediction of response to immunotherapy, but some limitations should be overcome.

Differential diagnosis of benign and malignant vertebral compression fractures: Comparison and correlation of radiomics and deep learning frameworks based on spinal CT and clinical characteristics

PURPOSE

Differentiating benign from malignant vertebral compression fractures (VCFs) is a diagnostic dilemma in clinical practice. To improve the accuracy and efficiency of diagnosis, we evaluated the performance of deep learning and radiomics methods based on computed tomography (CT) and clinical characteristics in differentiating between Osteoporosis VCFs (OVCFs) and malignant VCFs (MVCFs).

METHODS

We enrolled a total of 280 patients (155 with OVCFs and 125 with MVCFs) and randomly divided them into a training set (80%, n = 224) and a validation set (20%, n = 56). We developed three predictive models: a deep learning (DL) model, a radiomics (Rad) model, and a combined DL_Rad model, using CT and clinical characteristics data. The Inception_V3 served as the backbone of the DL model. The input data for the DL_Rad model consisted of the combined features of Rad and DCNN features. We calculated the receiver operating characteristic curve, area under the curve (AUC), and accuracy (ACC) to assess the performance of the models. Additionally, we calculated the correlation between Rad features and DCNN features.

RESULTS

For the training set, the DL_Rad model achieved the best results, with an AUC of 0.99 and ACC of 0.99, followed by the Rad model (AUC: 0.99, ACC: 0.97) and DL model (AUC: 0.99, ACC: 0.94). For the validation set, the DL_Rad model (with an AUC of 0.97 and ACC of 0.93) outperformed the Rad model (with an AUC: 0.93 and ACC: 0.91) and the DL model (with an AUC: 0.89 and ACC: 0.88). Rad features achieved better classifier performance than the DCNN features, and their general correlations were weak.

CONCLUSIONS

The Deep learnig model, Radiomics model, and Deep learning Radiomics model achieved promising results in discriminating MVCFs from OVCFs, and the DL_Rad model performed the best.

Efficient pulmonary nodules classification using radiomics and different artificial intelligence strategies

OBJECTIVES

This study aimed to explore and develop artificial intelligence approaches for efficient classification of pulmonary nodules based on CT scans.

MATERIALS AND METHODS

A number of 1007 nodules were obtained from 551 patients of LIDC-IDRI dataset. All nodules were cropped into 64 × 64 PNG images , and preprocessing was carried out to clean the image from surrounding non-nodular structure. In machine learning method, texture Haralick and local binary pattern features were extracted. Four features were selected using principal component analysis (PCA) algorithm before running classifiers. In deep learning, a simple CNN model was constructed and transfer learning was applied using VGG-16 and VGG-19, DenseNet-121 and DenseNet-169 and ResNet as pre-trained models with fine tuning.

RESULTS

In statistical machine learning method, the optimal AUROC was 0.885 ± 0.024 with random forest classifier and the best accuracy was 0.819 ± 0.016 with support vector machine. In deep learning, the best accuracy reached 90.39% with DenseNet-121 model and the best AUROC was 96.0%, 95.39% and 95.69% with simple CNN, VGG-16 and VGG-19, respectively. The best sensitivity reached 90.32% using DenseNet-169 and the best specificity attained was 93.65% when applying the DenseNet-121 and ResNet-152V2.

CONCLUSION

Deep learning methods with transfer learning showed several benefits over statistical learning in terms of nodule prediction performance and saving efforts and time in training large datasets. SVM and DenseNet-121 showed the best performance when compared with their counterparts. There is still more room for improvement, especially when more data can be trained and lesion volume is represented in 3D.

CLINICAL RELEVANCE STATEMENT

Machine learning methods offer unique opportunities and open new venues in clinical diagnosis of lung cancer. The deep learning approach has been more accurate than statistical learning methods. SVM and DenseNet-121 showed superior performance in pulmonary nodule classification.

Radiomics and Artificial Intelligence Can Predict Malignancy of Solitary Pulmonary Nodules in the Elderly

Solitary pulmonary nodules (SPNs) are a diagnostic and therapeutic challenge for thoracic surgeons. Although such lesions are usually benign, the risk of malignancy remains significant, particularly in elderly patients, who represent a large segment of the affected population. Surgical treatment in this subset, which usually presents several comorbidities, requires careful evaluation, especially when pre-operative biopsy is not feasible and comorbidities may jeopardize the outcome. Radiomics and artificial intelligence (AI) are progressively being applied in predicting malignancy in suspicious nodules and assisting the decision-making process. In this study, we analyzed features of the radiomic images of 71 patients with SPN aged more than 75 years (median 79, IQR 76-81) who had undergone upfront pulmonary resection based on CT and PET-CT findings. Three different machine learning algorithms were applied-functional tree, Rep Tree and J48. Histology was malignant in 64.8% of nodules and the best predictive value was achieved by the J48 model (AUC 0.9). The use of AI analysis of radiomic features may be applied to the decision-making process in elderly frail patients with suspicious SPNs to minimize the false positive rate and reduce the incidence of unnecessary surgery.

Clinical radiomics-based machine learning versus three-dimension convolutional neural network analysis for differentiation of thymic epithelial tumors from other prevascular mediastinal tumors on chest computed tomography scan

Purpose

To compare the diagnostic performance of radiomic analysis with machine learning (ML) model with a convolutional neural network (CNN) in differentiating thymic epithelial tumors (TETs) from other prevascular mediastinal tumors (PMTs).

Methods

A retrospective study was performed in patients with PMTs and undergoing surgical resection or biopsy in National Cheng Kung University Hospital, Tainan, Taiwan, E-Da Hospital, Kaohsiung, Taiwan, and Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan between January 2010 and December 2019. Clinical data including age, sex, myasthenia gravis (MG) symptoms and pathologic diagnosis were collected. The datasets were divided into UECT (unenhanced computed tomography) and CECT (enhanced computed tomography) for analysis and modelling. Radiomics model and 3D CNN model were used to differentiate TETs from non-TET PMTs (including cyst, malignant germ cell tumor, lymphoma and teratoma). The macro F1-score and receiver operating characteristic (ROC) analysis were performed to evaluate the prediction models.

Result

In the UECT dataset, there were 297 patients with TETs and 79 patients with other PMTs. The performance of radiomic analysis with machine learning model using LightGBM with Extra Tree (macro F1-Score = 83.95%, ROC-AUC = 0.9117) had better performance than the 3D CNN model (macro F1-score = 75.54%, ROC-AUC = 0.9015). In the CECT dataset, there were 296 patients with TETs and 77 patients with other PMTs. The performance of radiomic analysis with machine learning model using LightGBM with Extra Tree (macro F1-Score = 85.65%, ROC-AUC = 0.9464) had better performance than the 3D CNN model (macro F1-score = 81.01%, ROC-AUC = 0.9275).

Conclusion

Our study revealed that the individualized prediction model integrating clinical information and radiomic features using machine learning demonstrated better predictive performance in the differentiation of TETs from other PMTs at chest CT scan than 3D CNN model.

Radiomics in Early Lung Cancer Diagnosis: From Diagnosis to Clinical Decision Support and Education

Lung cancer is the most frequent cause of cancer-related death around the world. With the recent introduction of low-dose lung computed tomography for lung cancer screening, there has been an increasing number of smoking- and non-smoking-related lung cancer cases worldwide that are manifesting with subsolid nodules, especially in Asian populations. However, the pros and cons of lung cancer screening also follow the implementation of lung cancer screening programs. Here, we review the literature related to radiomics for early lung cancer diagnosis. There are four main radiomics applications: the classification of lung nodules as being malignant/benign; determining the degree of invasiveness of the lung adenocarcinoma; histopathologic subtyping; and prognostication in lung cancer prediction models. In conclusion, radiomics offers great potential to improve diagnosis and personalized risk stratification in early lung cancer diagnosis through patient–doctor cooperation and shared decision making.

A Review of Convolutional Neural Network Development in Computer Vision

Convolutional neural networks have made admirable progress in computer vision. As a fast-growing computer field, CNNs are one of the classical and widely used network structures. The Internet of Things (IoT) has gotten a lot of attention in recent years. This has directly led to the vigorous development of AI technology, such as the intelligent luggage security inspection system developed by the IoT, intelligent fire alarm system, driverless car, drone technology, and other cutting-edge directions. This paper first outlines the structure of CNNs, including the convolutional layer, the downsampling layer, and the fully connected layer, all of which play an important role. Then some different modules of classical networks are described, and these modules are rapidly driving the development of CNNs. And then the current state of CNNs research in image classification, object segmentation, and object detection is discussed.