Evaluation of Cervical Lymph Node Metastasis in Papillary Thyroid Carcinoma Using Clinical-Ultrasound Radiomic Machine Learning-Based Model

Predictive Values of Clinical Features and Multimodal Ultrasound for Central Lymph Node Metastases in Papillary Thyroid Carcinoma

Papillary thyroid carcinoma (PTC), the predominant pathological type among thyroid malignancies, is responsible for the sharp increase in thyroid cancer. Although PTC is an indolent tumor with good prognosis, 60-70% of patients still have early cervical lymph node metastasis, typically in the central compartment. Whether there is central lymph node metastasis (CLNM) or not directly affects the formulation of preoperative surgical procedures, given that such metastases have been tied to compromised overall survival and local recurrence. However, detecting CLNM before operation can be challenging due to the limited sensitivity of preoperative approaches. Prophylactic central lymph node dissection (PCLND) in the absence of clinical evidence of CLNM poses additional surgical risks. This study aims to provide a comprehensive review of the risk factors related to CLNM in PTC patients. A key focus is on utilizing multimodal ultrasound (US) for accurate prognosis of preoperative CLNM and to highlight the distinctive role of US-based characteristics for predicting CLNM.

Ultrasound-Base Radiomics for Discerning Lymph Node Metastasis in Thyroid Cancer: A Systematic Review and Meta-analysis

PURPOSE

Ultrasound is the imaging modality of choice for preoperative diagnosis of lymph node metastasis (LNM) in thyroid cancer (TC), yet its efficacy remains suboptimal. As radiomics gains traction in tumor diagnosis, its integration with ultrasound for LNM differentiation in TC has emerged, but its diagnostic merit is debated. This study assesses the accuracy of ultrasound-integrated radiomics in preoperatively diagnosing LNM in TC.

METHODS

Literatures were searched in PubMed, Embase, Cochrane, and Web of Science until July 11, 2023. Quality of the studies was assessed by the radiomics quality score (RQS). A meta-analysis was executed using a bivariate mixed effects model, with a subgroup analysis based on modeling variables (clinical features, radiomics features, or their combination).

RESULTS

Among 27 articles (16,410 TC patients, 6356 with LNM), the average RQS was 16.5 (SD:5.47). Sensitivity of the models based on clinical features, radiomics features, and radiomics features plus clinical features were 0.64, 0.76 and 0.69. Specificities were 0.77, 0.78 and 0.82. SROC values were 0.76, 0.84 and 0.81.

CONCLUSION

Ultrasound-based radiomics effectively evaluates LNM in TC preoperatively. Adding clinical features does not notably enhance the model's performance. Some radiomics studies showed high bias, possibly due to the absence of standard application guidelines.

Prediction of central lymph node metastasis in patients with papillary thyroid microcarcinoma by gradient-boosting decision tree model based on ultrasound radiomics and clinical features

Background

In recent years, the study of radiomics in thyroid diseases has developed rapidly. This study aimed to establish a preoperative radiomics prediction model for central compartment lymph node metastases (CLNMs) in papillary thyroid microcarcinoma (PTMC) patients using gradient-boosting decision tree (GBDT) model and evaluate the performance of the model.

Methods

A total of 274 patients with PTMC admitted for thyroid surgery at China-Japan Union Hospital of Jilin University from January 2020 to July 2022 were retrospectively analyzed. Patients were randomized into training and validation cohorts according to a ratio of 8:2. Radiomics features were extracted from the ultrasound (US) images of PTMC lesions. The open-source software Pyradiomics was used to extract radiomics features, and WEKA software was used to select CLNM-related radiomics features. Clinical risk factors for CLNM were screened by statistical methods. The GBDT model was constructed by combining radiomics features and clinical risk factors, and compared with the diagnostic efficacy of US-reported cervical lymph node status. Shapley Additive exPlanations (SHAP) was applied to visualize and analyze the GBDT model globally and locally.

Results

A total of seven radiomics features were significantly correlated with central lymph node status in the training and validation cohorts. The predictors in the GBDT model included the radiomics features, sex, age, and body mass index (BMI). The area under the curve (AUC) values of the GBDT model in the training and validation cohorts were 0.946 [95% confidence interval (CI): 0.920-0.972] and 0.845 (95% CI: 0.714-0.976), respectively, compared with 0.583 (95% CI: 0.508-0.659) and 0.582 (95% CI: 0.430-0.736) for US-reported lymph node status alone. The Delong test showed a significant difference between AUS in the training and validation cohorts (P<0.001, respectively). SHAP visual analysis showed the effect of each parameter on the GBDT model globally and locally. Decision curve analysis demonstrated the clinical utility of the GBDT model.

Conclusions

The prediction of CLNM by the GBDT model, based on US radiomics features and clinical factors, can be better than that by using US alone in patients with PTMC. Furthermore, the GBDT model may serve a guidance of clinical decision for patient's treatment strategy.

Radiomics diagnostic performance in predicting lymph node metastasis of papillary thyroid carcinoma: A systematic review and meta-analysis

PURPOSE

To evaluate the diagnostic performance of radiomics in lymph node metastasis (LNM) prediction in patients with papillary thyroid carcinoma (PTC) through a systematic review and meta-analysis.

METHOD

A literature search of PubMed, EMBASE, and Web of Science was conducted to find relevant studies published until February 18th, 2023. Studies that reported the accuracy of radiomics in different imaging modalities for LNM prediction in PTC patients were selected. The methodological quality of included studies was evaluated by radiomics quality score (RQS) and quality assessment of diagnostic accuracy studies (QUADAS-2) tools. General characteristics and radiomics accuracy were extracted. Overall sensitivity, specificity, and area under the curve (AUC) were calculated for diagnostic accuracy evaluation. Spearman correlation coefficient and subgroup analysis were performed for heterogeneity exploration.

RESULTS

In total, 25 studies were included, of which 22 studies provided adequate data for meta-analysis. We conducted two types of meta-analysis: one focused solely on radiomics features models and the other combined radiomics and non-radiomics features models in the analysis. The pooled sensitivity, specificity, and AUC of radiomics and combined models were 0.75 [0.68, 0.80] vs. 0.77 [0.74, 0.80], 0.77 [0.74, 0.81] vs. 0.83 [0.78, 0.87] and 0.80 [0.73, 0.85] vs 0.82 [0.75, 0.88], respectively. The analysis showed a high heterogeneity level among the included studies. There was no threshold effect. The subgroup analysis demonstrated that utilizing ultrasonography, 2D segmentation, central and lateral LNM detection, automatic segmentation, and PyRadiomics software could slightly improve diagnostic accuracy.

CONCLUSIONS

Our meta-analysis shows that the radiomics has the potential for pre-operative LNM prediction in PTC patients. Although methodological quality is sufficient but we still need more prospective studies with larger sample sizes from different centers.

Nomogram for preoperative estimation risk of lateral cervical lymph node metastasis in papillary thyroid carcinoma: a multicenter study

BACKGROUND

Lateral lymph node metastasis (LLNM) is frequent in papillary thyroid carcinoma (PTC) and is associated with a poor prognosis. This study aimed to developed a clinical-ultrasound (Clin-US) nomogram to predict LLNM in patients with PTC.

METHODS

In total, 2612 PTC patients from two hospitals (H1: 1732 patients in the training cohort and 578 patients in the internal testing cohort; H2: 302 patients in the external testing cohort) were retrospectively enrolled. The associations between LLNM and preoperative clinical and sonographic characteristics were evaluated by the univariable and multivariable logistic regression analysis. The Clin-US nomogram was built basing on multivariate logistic regression analysis. The predicting performance of Clin-US nomogram was evaluated by calibration, discrimination and clinical usefulness.

RESULTS

The age, gender, maximum diameter of tumor (tumor size), tumor position, internal echo, microcalcification, vascularization, mulifocality, and ratio of abutment/perimeter (A/P) > 0.25 were independently associated with LLNM metastatic status. In the multivariate analysis, gender, tumor size, mulifocality, position, microcacification, and A/P > 0.25 were independent correlative factors. Comparing the Clin-US nomogram and US features, Clin-US nomogram had the highest AUC both in the training cohort and testing cohorts. The Clin‑US model revealed good discrimination between PTC with LLNM and without LLNM in the training cohort (AUC = 0.813), internal testing cohort (AUC = 0.815) and external testing cohort (AUC = 0.870).

CONCLUSION

Our findings suggest that the ClinUS nomogram we newly developed can effectively predict LLNM in PTC patients and could help clinicians choose appropriate surgical procedures.

Predicting Extrathyroidal Extension in Papillary Thyroid Carcinoma Using a Clinical-Radiomics Nomogram Based on B-Mode and Contrast-Enhanced Ultrasound

Papillary thyroid carcinoma (PTC) is the most common pathological type of thyroid cancer. PTC patients with extrathyroidal extension (ETE) are associated with poor prognoses. The preoperative accurate prediction of ETE is crucial for helping the surgeon decide on the surgical plan. This study aimed to establish a novel clinical-radiomics nomogram based on B-mode ultrasound (BMUS) and contrast-enhanced ultrasound (CEUS) for the prediction of ETE in PTC. A total of 216 patients with PTC between January 2018 and June 2020 were collected and divided into the training set (n = 152) and the validation set (n = 64). The least absolute shrinkage and selection operator (LASSO) algorithm was applied for radiomics feature selection. Univariate analysis was performed to find clinical risk factors for predicting ETE. The BMUS Radscore, CEUS Radscore, clinical model, and clinical-radiomics model were established using multivariate backward stepwise logistic regression (LR) based on BMUS radiomics features, CEUS radiomics features, clinical risk factors, and the combination of those features, respectively. The diagnostic efficacy of the models was assessed using receiver operating characteristic (ROC) curves and the DeLong test. The model with the best performance was then selected to develop a nomogram. The results show that the clinical-radiomics model, which is constructed by age, CEUS-reported ETE, BMUS Radscore, and CEUS Radscore, showed the best diagnostic efficiency in both the training set (AUC = 0.843) and validation set (AUC = 0.792). Moreover, a clinical-radiomics nomogram was established for easier clinical practices. The Hosmer-Lemeshow test and the calibration curves demonstrated satisfactory calibration. The decision curve analysis (DCA) showed that the clinical-radiomics nomogram had substantial clinical benefits. The clinical-radiomics nomogram constructed from the dual-modal ultrasound can be exploited as a promising tool for the pre-operative prediction of ETE in PTC.

Clinical-Radiomics Nomogram Based on Contrast-Enhanced Ultrasound for Preoperative Prediction of Cervical Lymph Node Metastasis in Papillary Thyroid Carcinoma

This study aimed to establish a new clinical-radiomics nomogram based on ultrasound (US) for cervical lymph node metastasis (LNM) in papillary thyroid carcinoma (PTC). We collected 211 patients with PTC between June 2018 and April 2020, then we randomly divided these patients into the training set (n = 148) and the validation set (n = 63). 837 radiomics features were extracted from B-mode ultrasound (BMUS) images and contrast-enhanced ultrasound (CEUS) images. The maximum relevance minimum redundancy (mRMR) algorithm, least absolute shrinkage and selection operator (LASSO) algorithm, and backward stepwise logistic regression (LR) were applied to select key features and establish a radiomics score (Radscore), including BMUS Radscore and CEUS Radscore. The clinical model and clinical-radiomics model were established using the univariate analysis and multivariate backward stepwise LR. The clinical-radiomics model was finally presented as a clinical-radiomics nomogram, the performance of which was evaluated by the receiver operating characteristic curves, Hosmer-Lemeshow test, calibration curves, and decision curve analysis (DCA). The results show that the clinical-radiomics nomogram was constructed by four predictors, including gender, age, US-reported LNM, and CEUS Radscore. The clinical-radiomics nomogram performed well in both the training set (AUC = 0.820) and the validation set (AUC = 0.814). The Hosmer-Lemeshow test and the calibration curves demonstrated good calibration. The DCA showed that the clinical-radiomics nomogram had satisfactory clinical utility. The clinical-radiomics nomogram constructed by CEUS Radscore and key clinical features can be used as an effective tool for individualized prediction of cervical LNM in PTC.