A radiomics model that predicts lymph node status in pancreatic cancer to guide clinical decision making: A retrospective study

Contrast-enhanced CT radiomics combined with multiple machine learning algorithms for preoperative identification of lymph node metastasis in pancreatic ductal adenocarcinoma

Objectives

This research aimed to assess the value of radiomics combined with multiple machine learning algorithms in the diagnosis of pancreatic ductal adenocarcinoma (PDAC) lymph node (LN) metastasis, which is expected to provide clinical treatment strategies.

Methods

A total of 128 patients with pathologically confirmed PDAC and who underwent surgical resection were randomized into training (n=93) and validation (n=35) groups. This study incorporated a total of 13 distinct machine learning algorithms and explored 85 unique combinations of these algorithms. The area under the curve (AUC) of each model was computed. The model with the highest mean AUC was selected as the best model which was selected to determine the radiomics score (Radscore). The clinical factors were examined by the univariate and multivariate analysis, which allowed for the identification of factors suitable for clinical modeling. The multivariate logistic regression was used to create a combined model using Radscore and clinical variables. The diagnostic performance was assessed by receiver operating characteristic curves, calibration curves, and decision curve analysis (DCA).

Results

Among the 233 models constructed using arterial phase (AP), venous phase (VP), and AP+VP radiomics features, the model built by applying AP+VP radiomics features and a combination of Lasso+Logistic algorithm had the highest mean AUC. A clinical model was eventually constructed using CA199 and tumor size. The combined model consisted of AP+VP-Radscore and two clinical factors that showed the best diagnostic efficiency in the training (AUC = 0.920) and validation (AUC = 0.866) cohorts. Regarding preoperative diagnosis of LN metastasis, the calibration curve and DCA demonstrated that the combined model had a good consistency and greatest net benefit.

Conclusions

Combining radiomics and machine learning algorithms demonstrated the potential for identifying the LN metastasis of PDAC. As a non-invasive and efficient preoperative prediction tool, it can be beneficial for decision-making in clinical practice.

Feasibility and effectiveness of automatic deep learning network and radiomics models for differentiating tumor stroma ratio in pancreatic ductal adenocarcinoma

OBJECTIVE

This study aims to compare the feasibility and effectiveness of automatic deep learning network and radiomics models in differentiating low tumor stroma ratio (TSR) from high TSR in pancreatic ductal adenocarcinoma (PDAC).

METHODS

A retrospective analysis was conducted on a total of 207 PDAC patients from three centers (training cohort: n = 160; test cohort: n = 47). TSR was assessed on hematoxylin and eosin-stained specimens by experienced pathologists and divided as low TSR and high TSR. Deep learning and radiomics models were developed including ShuffulNetV2, Xception, MobileNetV3, ResNet18, support vector machine (SVM), k-nearest neighbor (KNN), random forest (RF), and logistic regression (LR). Additionally, the clinical models were constructed through univariate and multivariate logistic regression. Kaplan-Meier survival analysis and log-rank tests were conducted to compare the overall survival time between different TSR groups.

RESULTS

To differentiate low TSR from high TSR, the deep learning models based on ShuffulNetV2, Xception, MobileNetV3, and ResNet18 achieved AUCs of 0.846, 0.924, 0.930, and 0.941, respectively, outperforming the radiomics models based on SVM, KNN, RF, and LR with AUCs of 0.739, 0.717, 0.763, and 0.756, respectively. Resnet 18 achieved the best predictive performance. The clinical model based on T stage alone performed worse than deep learning models and radiomics models. The survival analysis based on 142 of the 207 patients demonstrated that patients with low TSR had longer overall survival.

CONCLUSIONS

Deep learning models demonstrate feasibility and superiority over radiomics in differentiating TSR in PDAC. The tumor stroma ratio in the PDAC microenvironment plays a significant role in determining prognosis.

CRITICAL RELEVANCE STATEMENT

The objective was to compare the feasibility and effectiveness of automatic deep learning networks and radiomics models in identifying the tumor-stroma ratio in pancreatic ductal adenocarcinoma. Our findings demonstrate deep learning models exhibited superior performance compared to traditional radiomics models.

KEY POINTS

• Deep learning demonstrates better performance than radiomics in differentiating tumor-stroma ratio in pancreatic ductal adenocarcinoma. • The tumor-stroma ratio in the pancreatic ductal adenocarcinoma microenvironment plays a protective role in prognosis. • Preoperative prediction of tumor-stroma ratio contributes to clinical decision-making and guiding precise medicine.

Predictive role of radiomics features extracted from preoperative cross-sectional imaging of pancreatic ductal adenocarcinoma in detecting lymph node metastasis: a systemic review and meta-analysis

Lymph node metastases are associated with poor clinical outcomes in pancreatic ductal adenocarcinoma (PDAC). In preoperative imaging, conventional diagnostic modalities do not provide the desired accuracy in diagnosing lymph node metastasis. The current review aims to determine the pooled diagnostic profile of studies examining the role of radiomics features in detecting lymph node metastasis in PDAC. PubMed, Google Scholar, and Embase databases were searched for relevant articles. The quality of the studies was examined using the Radiomics Quality Score and Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tools. Pooled results for sensitivity, specificity, likelihood, and odds ratios with the corresponding 95% confidence intervals (CIs) were calculated using a random-effect model (DerSimonian-Liard method). No significant publication bias was detected among the studies included in this meta-analysis. The pooled sensitivity of the validation datasets included in the study was 77.4% (72.7%, 81.5%) and pooled specificity was 72.4% (63.8, 79.6%). The diagnostic odds ratio of the validation datasets was 9.6 (6.0, 15.2). No statistically significant heterogeneity was detected for sensitivity and odds ratio (P values of 0.3 and 0.08, respectively). However, there was significant heterogeneity concerning specificity (P = 0.003). The pretest probability of having lymph node metastasis in the pooled databases was 52% and a positive post-test probability was 76% after the radiomics features were used, showing a net benefit of 24%. Classifiers trained on radiomics features extracted from preoperative images can improve the sensitivity and specificity of conventional cross-sectional imaging in detecting lymph node metastasis in PDAC.

CT-measured body composition radiomics predict lymph node metastasis in localized pancreatic ductal adenocarcinoma

BACKGROUND

To explored the value of CT-measured body composition radiomics in preoperative evaluation of lymph node metastasis (LNM) in localized pancreatic ductal adenocarcinoma (LPDAC).

METHODS

We retrospectively collected patients with LPDAC who underwent surgical resection from January 2016 to June 2022. According to whether there was LNM after operation, the patients were divided into LNM group and non-LNM group in both male and female patients. The patient's body composition was measured by CT images at the level of the L3 vertebral body before surgery, and the radiomics features of adipose tissue and muscle were extracted. Multivariate logistic regression (forward LR) analyses were used to determine the predictors of LNM from male and female patient, respectively. Sexual dimorphism prediction signature using adipose tissue radiomics features, muscle tissue radiomics features and combined signature of both were developed and compared. The model performance is evaluated on discrimination and validated through a leave-one-out cross-validation method.

RESULTS

A total of 196 patients (mean age, 60 years ± 9 [SD]; 117 men) were enrolled, including 59 LNM in male and 36 LNM in female. Both male and female CT-measured body composition radiomics signatures have a certain predictive power on LNM of LPDAC. Among them, the female adipose tissue signature showed the highest performance (area under the ROC curve (AUC), 0.895), and leave one out cross validation (LOOCV) indicated that the signature could accurately classify 83.5% of cases; The prediction efficiency of the signature can be further improved after adding the muscle radiomics features (AUC, 0.924, and the accuracy of the LOOCV was 87.3%); The abilities of male adipose tissue and muscle tissue radiomics signatures in predicting LNM of LPDAC was similar, AUC was 0.735 and 0.773, respectively, and the accuracy of LOOCV was 62.4% and 68.4%, respectively.

CONCLUSIONS

CT-measured body composition Radiomics strategy showed good performance for predicting LNM in LPDAC, and has sexual dimorphism. It may provide a reference for individual treatment of LPDAC and related research about body composition in the future.

Artificial Intelligence to Predict Lymph Node Metastasis at CT in Pancreatic Ductal Adenocarcinoma

Background Although deep learning has brought revolutionary changes in health care, reliance on manually selected cross-sectional images and segmentation remain methodological barriers. Purpose To develop and validate an automated preoperative artificial intelligence (AI) algorithm for tumor and lymph node (LN) segmentation with CT imaging for prediction of LN metastasis in patients with pancreatic ductal adenocarcinoma (PDAC). Materials and Methods In this retrospective study, patients with surgically resected, pathologically confirmed PDAC underwent multidetector CT from January 2015 to April 2020. Three models were developed, including an AI model, a clinical model, and a radiomics model. CT-determined LN metastasis was diagnosed by radiologists. Multivariable logistic regression analysis was conducted to develop the clinical and radiomics models. The performance of the models was determined on the basis of their discrimination and clinical utility. Kaplan-Meier curves, the log-rank test, or Cox regression were used for survival analysis. Results Overall, 734 patients (mean age, 62 years ± 9 [SD]; 453 men) were evaluated. All patients were split into training (n = 545) and validation (n = 189) sets. Patients who had LN metastasis (LN-positive group) accounted for 340 of 734 (46%) patients. In the training set, the AI model showed the highest performance (area under the receiver operating characteristic curve [AUC], 0.91) in the prediction of LN metastasis, whereas the radiologists and the clinical and radiomics models had AUCs of 0.58, 0.76, and 0.71, respectively. In the validation set, the AI model showed the highest performance (AUC, 0.92) in the prediction of LN metastasis, whereas the radiologists and the clinical and radiomics models had AUCs of 0.65, 0.77, and 0.68, respectively (P < .001). AI model-predicted positive LN metastasis was associated with worse survival (hazard ratio, 1.46; 95% CI: 1.13, 1.89; P = .004). Conclusion An artificial intelligence model outperformed radiologists and clinical and radiomics models for prediction of lymph node metastasis at CT in patients with pancreatic ductal adenocarcinoma. © RSNA, 2022 Online supplemental material is available for this article. See also the editorial by Chu and Fishman in this issue.

Radiomics Signature Using Manual Versus Automated Segmentation for Lymph Node Staging of Bladder Cancer

BACKGROUND

Bladder cancer (BC) treatment algorithms depend on accurate tumor staging. To date, computed tomography (CT) is recommended for assessment of lymph node (LN) metastatic spread in muscle-invasive and high-risk BC. However, the diagnostic efficacy of radiologist-evaluated CT imaging studies is limited.

OBJECTIVE

To evaluate the performance of quantitative radiomics signatures for detection of LN metastases in BC.

DESIGN, SETTING, AND PARTICIPANTS

Of 1354 patients with BC who underwent radical cystectomy (RC) with lymphadenectomy who were screened, 391 with pathological nodal staging (pN0: n = 297; pN+: n = 94) were included and randomized into training (n = 274) and test (n = 117) cohorts. Pelvic LNs were segmented manually and automatically. A total of 1004 radiomics features were extracted from each LN and a machine learning model was trained to assess pN status using histopathology labels as the ground truth.

OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS

Radiologist assessment was compared to radiomics-based analysis using manual and automated LN segmentations for detection of LN metastases in BC. Statistical analysis was performed using the receiver operating characteristics curve method and evaluated in terms of sensitivity, specificity, and area under the curve (AUC).

RESULTS AND LIMITATIONS

In total, 1845 LNs were manually segmented. Automated segmentation correctly located 361/557 LNs in the test cohort. Manual and automatic masks achieved an AUC of 0.80 (95% confidence interval [CI] 0.69-0.91; p = 0.64) and 0.70 (95% CI: 0.58-0.82; p = 0.17), respectively, in the test cohort compared to radiologist assessment, with an AUC of 0.78 (95% CI 0.67-0.89). A combined model of a manually segmented radiomics signature and radiologist assessment reached an AUC of 0.81 (95% CI 0.71-0.92; p = 0.63).

CONCLUSIONS

A radiomics signature allowed discrimination of nodal status with high diagnostic accuracy. The model based on manual LN segmentation outperformed the fully automated approach.

PATIENT SUMMARY

For patients with bladder cancer, evaluation of computed tomography (CT) scans before surgery using a computer-based method for image analysis, called radiomics, may help in standardizing and improving the accuracy of assessment of lymph nodes. This could be a valuable tool for optimizing treatment options.

Artificial intelligence in pancreatic cancer

Pancreatic cancer is the deadliest disease, with a five-year overall survival rate of just 11%. The pancreatic cancer patients diagnosed with early screening have a median overall survival of nearly ten years, compared with 1.5 years for those not diagnosed with early screening. Therefore, early diagnosis and early treatment of pancreatic cancer are particularly critical. However, as a rare disease, the general screening cost of pancreatic cancer is high, the accuracy of existing tumor markers is not enough, and the efficacy of treatment methods is not exact. In terms of early diagnosis, artificial intelligence technology can quickly locate high-risk groups through medical images, pathological examination, biomarkers, and other aspects, then screening pancreatic cancer lesions early. At the same time, the artificial intelligence algorithm can also be used to predict the survival time, recurrence risk, metastasis, and therapy response which could affect the prognosis. In addition, artificial intelligence is widely used in pancreatic cancer health records, estimating medical imaging parameters, developing computer-aided diagnosis systems, etc. Advances in AI applications for pancreatic cancer will require a concerted effort among clinicians, basic scientists, statisticians, and engineers. Although it has some limitations, it will play an essential role in overcoming pancreatic cancer in the foreseeable future due to its mighty computing power.

One 3D VOI-based deep learning radiomics strategy, clinical model and radiologists for predicting lymph node metastases in pancreatic ductal adenocarcinoma based on multiphasic contrast-enhanced computer tomography

Purpose

We designed to construct one 3D VOI-based deep learning radiomics strategy for identifying lymph node metastases (LNM) in pancreatic ductal adenocarcinoma on the basis of multiphasic contrast-enhanced computer tomography and to assist clinical decision-making.

Methods

This retrospective research enrolled 139 PDAC patients undergoing pre-operative arterial phase and venous phase scanning examination between 2015 and 2021. A primary group (training group and validation group) and an independent test group were divided. The DLR strategy included three sections. (1) Residual network three dimensional-18 (Resnet 3D-18) architecture was constructed for deep learning feature extraction. (2) Least absolute shrinkage and selection operator model was used for feature selection. (3) Fully connected network served as the classifier. The DLR strategy was applied for constructing different 3D CNN models using 5-fold cross-validation. Radiomics scores (Rad score) were calculated for distinguishing the statistical difference between negative and positive lymph nodes. A clinical model was constructed by combining significantly different clinical variables using univariate and multivariable logistic regression. The manifestation of two radiologists was detected for comparing with computer-developed models. Receiver operating characteristic curves, the area under the curve, accuracy, precision, recall, and F1 score were used for evaluating model performance.

Results

A total of 45, 49, and 59 deep learning features were selected via LASSO model. No matter in which 3D CNN model, Rad score demonstrated the deep learning features were significantly different between non-LNM and LNM groups. The AP+VP DLR model yielded the best performance in predicting status of lymph node in PDAC with an AUC of 0.995 (95% CI:0.989-1.000) in training group; an AUC of 0.940 (95% CI:0.910-0.971) in validation group; and an AUC of 0.949 (95% CI:0.914-0.984) in test group. The clinical model enrolled the histological grade, CA19-9 level and CT-reported tumor size. The AP+VP DLR model outperformed AP DLR model, VP DLR model, clinical model, and two radiologists.

Conclusions

The AP+VP DLR model based on Resnet 3D-18 demonstrated excellent ability for identifying LNM in PDAC, which could act as a non-invasive and accurate guide for clinical therapeutic strategies. This 3D CNN model combined with 3D tumor segmentation technology is labor-saving, promising, and effective.

Pancreatic cancer, radiomics and artificial intelligence

Patients with pancreatic ductal adenocarcinoma (PDAC) are generally classified into four categories based on contrast-enhanced CT at diagnosis: resectable, borderline resectable, unresectable, and metastatic disease. In the initial grading and staging of PDAC, structured radiological templates are useful but limited, as there is a need to define the aggressiveness and microscopic disease stage of these tumours to ensure adequate treatment allocation. Quantitative imaging analysis allows radiomics and dynamic imaging features to provide information of clinical outcomes, and to construct clinical models based on radiomics signatures or imaging phenotypes. These quantitative features may be used as prognostic and predictive biomarkers in clinical decision-making, enabling personalised management of advanced PDAC. Deep learning and convolutional neural networks also provide high level bioinformatics tools that can help define features associated with a given aspect of PDAC biology and aggressiveness, paving the way to define outcomes based on these features. Thus, the prediction of tumour phenotype, treatment response and patient prognosis may be feasible by using such comprehensive and integrated radiomics models. Despite these promising results, quantitative imaging is not ready for clinical implementation in PDAC. Limitations include the instability of metrics and lack of external validation. Large properly annotated datasets, including relevant semantic features (demographics, blood markers, genomics), image harmonisation, robust radiomics analysis, clinically significant tasks as outputs, comparisons with gold-standards (such as TNM or pretreatment classifications) and fully independent validation cohorts, will be required for the development of trustworthy radiomics and artificial intelligence solutions to predict PDAC aggressiveness in a clinical setting.

Preoperative Prediction of Lymph Node Metastasis of Pancreatic Ductal Adenocarcinoma Based on a Radiomics Nomogram of Dual-Parametric MRI Imaging

Purpose

This study aims to uncover and validate an MRI-based radiomics nomogram for detecting lymph node metastasis (LNM) in pancreatic ductal adenocarcinoma (PDAC) patients prior to surgery.

Materials and Methods

We retrospectively collected 141 patients with pathologically confirmed PDAC who underwent preoperative T2-weighted imaging (T2WI) and portal venous phase (PVP) contrast-enhanced T1-weighted imaging (T1WI) scans between January 2017 and December 2021. The patients were randomly divided into training (n = 98) and validation (n = 43) cohorts at a ratio of 7:3. For each sequence, 1037 radiomics features were extracted and analyzed. After applying the gradient-boosting decision tree (GBDT), the key MRI radiomics features were selected. Three radiomics scores (rad-score 1 for PVP, rad-score 2 for T2WI, and rad-score 3 for T2WI combined with PVP) were calculated. Rad-score 3 and clinical independent risk factors were combined to construct a nomogram for the prediction of LNM of PDAC by multivariable logistic regression analysis. The predictive performances of the rad-scores and the nomogram were assessed by the area under the operating characteristic curve (AUC), and the clinical utility of the radiomics nomogram was assessed by decision curve analysis (DCA).

Results

Six radiomics features of T2WI, eight radiomics features of PVP and ten radiomics features of T2WI combined with PVP were found to be associated with LNM. Multivariate logistic regression analysis showed that rad-score 3 and MRI-reported LN status were independent predictors. In the training and validation cohorts, the AUCs of rad-score 1, rad-score 2 and rad-score 3 were 0.769 and 0.751, 0.807 and 0.784, and 0.834 and 0.807, respectively. The predictive value of rad-score 3 was similar to that of rad-score 1 and rad-score 2 in both the training and validation cohorts (P &gt; 0.05). The radiomics nomogram constructed by rad-score 3 and MRI-reported LN status showed encouraging clinical benefit, with an AUC of 0.845 for the training cohort and 0.816 for the validation cohort.

Conclusions

The radiomics nomogram derived from the rad-score based on MRI features and MRI-reported lymph status showed outstanding performance for the preoperative prediction of LNM of PDAC.