Accuracy of the European Thyroid Imaging Reporting and Data System (EU-TIRADS) in the valuation of thyroid nodule malignancy in reference to the post-surgery histological results

The European Thyroid Imaging and Reporting Data System as a Remedy for the Overdiagnosis and Overtreatment of Thyroid Cancer: Results from the EUROCRINE Surgical Registry

BACKGROUND

The European Thyroid Imaging and Reporting Data System (EU-TIRADS) aims to reduce the overdiagnosis of thyroid cancer (TC) by guiding the selection of nodules for fine-needle aspiration biopsy (FNAB). This study sought to validate EU-TIRADS nodule selection criteria using data from EUROCRINE, an extensive international endocrine surgery registry.

METHOD

We reviewed indications for FNAB among patients with TC compared to those with benign disease who underwent surgery between March 2020 and March 2022, considering preoperative EU-TIRADS scores and dominant nodule size (FNAB is recommended in Category 5 (˃10 mm or ˂10 mm with suspicious lymph nodes), 4 (˃15 mm), and 3 (˃20 mm)). Patients were categorized into three risk groups: minimal risk (patients with papillary microcarcinoma), high risk (patients with pT3b stage or higher, pN1b, or pM1), and low-moderate risk (all other patients). We conducted a Receiver Operating Characteristic (ROC) analysis to assess the diagnostic accuracy of the EU-TIRADS.

RESULTS

We analyzed 32,008 operations. Approximately 68% of the surgical records included EU-TIRADS classifications. The EU-TIRADS exhibited diagnostic accuracy across high-volume sites, with a median ROC Area Under the ROC Curve (AUC) of 0.752, indicating its effectiveness in identifying malignancy. Among the cases, 7907 patients had TC. Notably, 55% of patients with TC underwent FNAB despite not initially meeting the EU-TIRADS criteria. These patients were distributed across the minimal- (58%), low-moderate- (36%), and high-risk (5.8%) categories. Of the patients with TC recommended for FNAB, 78% were deemed low-moderate risk, 21% high risk, and only 0.7% minimal risk.

CONCLUSION

The EU-TIRADS offers effective preoperative malignancy risk stratification. Promoting the proper use of the EU-TIRADS in clinical practice is essential to mitigate the overdiagnosis and overtreatment of low-risk TC.

Hyperfunctioning papillary thyroid carcinoma - a case report and literature review

BACKGROUND

Malignant hyperfunctioning thyroid nodules are rare and more likely to occur in follicular cancer types rather than papillary variants. The authors present a case of a papillary thyroid carcinoma associated with a hyperfunctioning nodule.

METHODS

A single adult patient submitted to total thyroidectomy with the presence of thyroid carcinoma within hyperfunctioning nodules was selected. Additionally, brief literature was conducted.

RESULTS

An asymptomatic 58-year-old male was subjected to routine blood analysis and a TSH level of <0.003 mIU/L was found. Ultrasonography revealed a 21 mm solid, hypoechoic, and heterogenous nodule with microcalcifications in the right lobe. A fine needle aspiration guided by ultrasound resulted in a follicular lesion of undetermined significance. A 99mTc thyroid scintigram was followed and identified a right-sided hyperfunctioning nodule. Another cytology was performed and a papillary thyroid carcinoma was derived as a result. The patient underwent a total thyroidectomy. Postoperative histology confirmed the diagnosis and a tumor-free margin with no vascular or capsular invasions.

CONCLUSION

Hyperfunctioning malignant nodules are a rare association, although a careful approach should be led since major clinical implications arise. Selective fine needle aspiration in all suspicious ≥1 cm nodules should be considered.

Diagnostic efficiency among Eu-/C-/ACR-TIRADS and S-Detect for thyroid nodules: a systematic review and network meta-analysis

Background

The performance in evaluating thyroid nodules on ultrasound varies across different risk stratification systems, leading to inconsistency and uncertainty regarding diagnostic sensitivity, specificity, and accuracy.

Objective

Comparing diagnostic performance of detecting thyroid cancer among distinct ultrasound risk stratification systems proposed in the last five years.

Evidence acquisition

Systematic search was conducted on PubMed, EMBASE, and Web of Science databases to find relevant research up to December 8, 2022, whose study contents contained elucidation of diagnostic performance of any one of the above ultrasound risk stratification systems (European Thyroid Imaging Reporting and Data System[Eu-TIRADS]; American College of Radiology TIRADS [ACR TIRADS]; Chinese version of TIRADS [C-TIRADS]; Computer-aided diagnosis system based on deep learning [S-Detect]). Based on golden diagnostic standard in histopathology and cytology, single meta-analysis was performed to obtain the optimal cut-off value for each system, and then network meta-analysis was conducted on the best risk stratification category in each system.

Evidence synthesis

This network meta-analysis included 88 studies with a total of 59,304 nodules. The most accurate risk category thresholds were TR5 for Eu-TIRADS, TR5 for ACR TIRADS, TR4b and above for C-TIRADS, and possible malignancy for S-Detect. At the best thresholds, sensitivity of these systems ranged from 68% to 82% and specificity ranged from 71% to 81%. It identified the highest sensitivity for C-TIRADS TR4b and the highest specificity for ACR TIRADS TR5. However, sensitivity for ACR TIRADS TR5 was the lowest. The diagnostic odds ratio (DOR) and area under curve (AUC) were ranked first in C-TIRADS.

Conclusion

Among four ultrasound risk stratification options, this systemic review preliminarily proved that C-TIRADS possessed favorable diagnostic performance for thyroid nodules.

Systematic review registration

https://www.crd.york.ac.uk/prospero, CRD42022382818.

Considerable interobserver variation calls for unambiguous definitions of thyroid nodule ultrasound characteristics

Objective

Thyroid nodule ultrasound characteristics are used as an indication for fine-needle aspiration cytology, usually as the basis for Thyroid Imaging Reporting and Data System (TIRADS) score calculation. Few studies on interobserver variation are available, all of which are based on analysis of preselected still ultrasound images and often lack surgical confirmation.

Methods

After the blinded online evaluation of video recordings of the ultrasound examinations of 47 consecutive malignant and 76 consecutive benign thyroid lesions, 7 experts from 7 thyroid centers answered 17 TIRADS-related questions. Surgical histology was the reference standard. Interobserver variations of each ultrasound characteristic were compared using Gwet's AC1 inter-rater coefficients; higher values mean better concordance, the maximum being 1.0.

Results

On a scale from 0.0 to 1.0, the Gwet's AC1 values were 0.34, 0.53, 0.72, and 0.79 for the four most important features in decision-making, i.e. irregular margins, microcalcifications, echogenicity, and extrathyroidal extension, respectively. The concordance in the discrimination between mildly/moderately and very hypoechogenic nodules was 0.17. The smaller the nodule size the better the agreement in echogenicity, and the larger the nodule size the better the agreement on the presence of microcalcifications. Extrathyroidal extension was correctly identified in just 45.8% of the cases.

Conclusions

Examination of video recordings, closely simulating the real-world situation, revealed substantial interobserver variation in the interpretation of each of the four most important ultrasound characteristics. In view of the importance for the management of thyroid nodules, unambiguous and widely accepted definitions of each nodule characteristic are warranted, although it remains to be investigated whether this diminishes observer variation.

Evaluation of the efficacy of EU-TIRADS and ACR-TIRADS in risk stratification of pediatric patients with thyroid nodules

BACKGROUND

Pediatric thyroid nodules have a lower prevalence but a higher rate of malignancy (ROM) than those in adults. Ultrasound features suspected of malignancy lead to fine needle aspiration biopsy (FNAB) and subsequent cytological determination, upon which management is decided. Based on the characteristics of ultrasound, to standardize clinician decisions and avoid unnecessary FNAB, the European Thyroid Association and the American Radiology College have established guidelines for Thyroid Imaging, Reporting and Data System (EU-TIRADS and ACR-TIRADS) for ROM stratification of thyroid nodules. The aim of this study is to evaluate the diagnostic performance of ACR-TIRADS and EU-TIRADS in pediatric age.

MATERIALS AND METHODS

Subjects younger than 18 years of age with thyroid nodules greater than 0.5 cm observed in the 2000-2020 period were included.

RESULTS

Data from 200 subjects were collected. The overall ROM was 13%, rising to 26% if nodules with a diameter >1 cm were considered. Patients with a malignant nodule were more likely to have a higher EU-TIRADS score (p=0.03). Missed cancer diagnoses were 26.9%. Using the EU-TIRADS system, 40% of FNABs could have been avoided, while this scoring system would have resulted in FNAB being performed in 12% of cases where the assessment of ultrasound features would not recommend FNAB. Sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) were 73.1%, 57.1%, 73.1%, and 50%, respectively. Even considering the ACR-TIRADS, a higher score correlated with a higher ROM (p<0.001). This system missed 6 diagnoses of cancer (23.1%). Using the ACR-TIRADS system, 45.3% of FNABs could have been avoided, while FNAB should have been performed in 12% of cases where it was not recommended by ultrasound characteristics. Sensitivity, specificity, PPV and NPV were 76.9%, 50%, 76.9%, and 42.9%, respectively.

CONCLUSION

The present study confirms the correspondence of the EU-TIRADS and ACR-TIRADS categories with respect to malignancy but indicates not entirely satisfactory performance compared to FNAB alone. However, the use of the two TIRADS systems should be encouraged in multicentre studies to increase their performance and establish paediatric-specific points in the scoring criteria.

Ultrasound-Based Indications for Thyroid Fine-Needle Aspiration: Outcome of a TIRADS-Based Approach versus Operators' Expertise

BACKGROUND

Thyroid nodule image reporting and data systems (TIRADS) provide the indications for fine-needle aspiration (FNA) based on a combination of nodule sonographic features and size. We compared the TIRADS-based recommendations for FNA with those based on the personal expertise of qualified US investigators in the diagnosis of thyroid malignancy.

METHODS

Seven highly experienced ultrasound (US) investigators from 4 countries evaluated, online, the US video recordings of 123 histologically verified thyroid nodules. Technical resources provided the operators with a diagnostic approach close to the real-world practice. Altogether, 4,305 TIRADS scores were computed. The combined diagnostic potential of TIRADS (TIRSYS) and the personal recommendations of the investigators (PERS) were compared against 3 possible goals: to recognize all malignant lesions (allCA), nonpapillary plus non-pT1 papillary cancers (nPnT1PCA), or stage II-IV cancers (st2-4CA).

RESULTS

For allCA and nPnT1PCA, TIRSYS had lower sensitivity than PERS (69.8 vs. 87.2 and 83.5 vs. 92.6%, respectively, p <0.01), while in st2-4CA the sensitivities were the same (99.1 vs. 98.6% and TIRSYS vs. PERS, respectively). TIRSYS had a higher specificity than PERS in all 3 types of cancers (p < 0.001). PERS recommended FNA in a similar proportion of lesions smaller or larger than 1 cm (76.9 vs. 82.7%; ns).

CONCLUSIONS

Recommendations for FNA based on the investigators' US expertise demonstrated a better sensitivity for thyroid cancer in the 2 best prognostic groups, while TIRADS methodology showed superior specificity over the full prognostic range of cancers. Thus, personal experience provided more accurate diagnoses of malignancy, missing a lower number of small thyroid cancers, but the TIRADS approach resulted in a similar accuracy for the diagnosis of potentially aggressive lesions while sparing a relevant number of FNAs. Until it is not clearly stated what the goal of the US evaluation is, that is to diagnose all or only clinically relevant thyroid cancers, it cannot be determined whether one diagnostic approach is superior to the other for recommending FNA.

Reproducibility and Interobserver Agreement of Different Thyroid Imaging and Reporting Data Systems (TIRADS)

INTRODUCTION

A number of classification systems (TIRADS) have been developed to estimate the likelihood of malignancy in thyroid nodules, but their reproducibility is yet to be assessed. We evaluated the interobserver variability and diagnostic performance of the TIRADS in Kwak's modification (Kw-TIRADS) and European TIRADS (EU-TIRADS).

METHODS

Two independent specialists, blinded concerning the morphology of the nodules, evaluated ultrasound images of 153 thyroid nodules identified in 149 patients at multiple time points.

RESULTS

The interobserver agreement (Cohen's κ) was 0.52 and 0.67 for Kw-TIRADS and EU-TIRADS, respectively, and rated as substantial. There were strong correlations between Kw-TIRADS and EU-TIRADS for the two observers with Spearman's coefficients of 0.731 (p = 0.00025) and 0.661 (p = 0.0012), respectively. Sensitivity of Kw-TIRADS for the diagnosis of thyroid cancer was 95-92.31% and that of EU-TIRADS was 92.31-89.74%, with specificity of about 60% for both TIRADS.

CONCLUSION

Despite the wide variability in the description of single ultrasonographic features, both Kw-TIRADS and EU-TIRADS may be a useful diagnostic tool in clinical practice.

S-Detect Software vs. EU-TIRADS Classification: A Dual-Center Validation of Diagnostic Performance in Differentiation of Thyroid Nodules

Computer-aided diagnosis (CAD) and other risk stratification systems may improve ultrasound image interpretation. This prospective study aimed to compare the diagnostic performance of CAD and the European Thyroid Imaging Reporting and Data System (EU-TIRADS) classification applied by physicians with S-Detect 2 software CAD based on Korean Thyroid Imaging Reporting and Data System (K-TIRADS) and combinations of both methods (MODELs 1 to 5). In all, 133 nodules from 88 patients referred to thyroidectomy with available histopathology or with unambiguous results of cytology were included. The S-Detect system, EU-TIRADS, and mixed MODELs 1–5 for the diagnosis of thyroid cancer showed a sensitivity of 89.4%, 90.9%, 84.9%, 95.5%, 93.9%, 78.9% and 93.9%; a specificity of 80.6%, 61.2%, 88.1%, 53.7%, 73.1%, 89.6% and 80.6%; a positive predictive value of 81.9%, 69.8%, 87.5%, 67%, 77.5%, 88.1% and 82.7%; a negative predictive value of 88.5%, 87.2%, 85.5%, 92.3%, 92.5%, 81.1% and 93.1%; and an accuracy of 85%, 75.9%, 86.5%, 74.4%, 83.5%, 84.2%, and 87.2%, respectively. Comparison showed superiority of the similar MODELs 1 and 5 over other mixed models as well as EU-TIRADS and S-Detect used alone (p-value < 0.05). S-Detect software is characterized with high sensitivity and good specificity, whereas EU-TIRADS has high sensitivity, but rather low specificity. The best diagnostic performance in malignant thyroid nodule (TN) risk stratification was obtained for the combined model of S-Detect (“possibly malignant” nodule) and simultaneously obtaining 4 or 5 points (MODEL 1) or exactly 5 points (MODEL 5) on the EU-TIRADS scale.

Diagnostic Performance of Four Ultrasound Risk Stratification Systems: A Systematic Review and Meta-Analysis

Background: Several ultrasound (US)-based risk stratification systems have been increasingly used for the optimal management of thyroid nodules. However, there are considerable discrepancies across these systems. This study aimed to summarize and compare the category-based diagnostic performance in the detection of thyroid cancer of different US-based risk stratification systems from four societies: the American College of Radiology-Thyroid Imaging Reporting and Data System (ACR-TIRADS), the American Thyroid Association (ATA), the Korean Thyroid Association/Korean Society of Thyroid Radiology (KTA/KSThR; K-TIRADS), and the European Thyroid Association (EU-TIRADS). Methods: MEDLINE/PubMed and EMBASE databases were searched to identify original articles investigating the category-based diagnostic performance according to at least one of the following guidelines: ACR-TIRADS, ATA, K-TIRADS, and EU-TIRADS. Pooled sensitivity and specificity were calculated using a bivariate random-effects model. A subgroup analysis on nodules of 1 cm or larger and a meta-regression analysis to identify factors associated with the diagnostic performance were performed. Results: A total of 29 articles including 33,748 thyroid nodules met the eligibility criteria and were included in the analysis. For ACR-TIRADS, the pooled sensitivity and specificity were, respectively, 66% and 91% for category 5 and 95% and 55% for category 4 or 5. For ATA, the pooled sensitivity and specificity were, respectively, 74% and 88% for category 5 and 91% and 64% for category 4 or 5. For K-TIRADS, the pooled sensitivity and specificity were, respectively, 55% and 95% for category 5 and 89% and 64% for category 4 or 5. For EU-TIRADS, the pooled sensitivity and specificity were, respectively, 82% and 90% for category 5 and 96% and 52% for category 4 or 5. Study location, proportion of female patients and malignant nodules, and study design were associated with study heterogeneity. Conclusions: The overall diagnostic performance of the four US-based risk stratification systems was comparable.

Accuracy of thyroid imaging reporting and data system category 4 or 5 for diagnosing malignancy: a systematic review and meta-analysis

OBJECTIVES

To determine the accuracies of the American College of Radiology (ACR)-thyroid imaging reporting and data systems (TIRADS), Korean (K)-TIRADS, and European (EU)-TIRADS for diagnosing malignancy in thyroid nodules.

METHODS

Original studies reporting the diagnostic accuracy of TIRADS for determining malignancy on ultrasound were identified in MEDLINE and EMBASE up to June 23, 2019. The meta-analytic summary sensitivity and specificity were obtained for TIRADS category 5 (TR-5) and category 4 or 5 (TR-4/5), using a bivariate random effects model. To explore study heterogeneity, meta-regression analyses were performed.

RESULTS

Of the 34 eligible articles (37,585 nodules), 25 used ACR-TIRADS, 12 used K-TIRADS, and seven used EU-TIRADS. For TR-5, the meta-analytic sensitivity was highest for EU-TIRADS (78% [95% confidence interval, 64-88%]), followed by ACR-TIRADS (70% [61-79%]) and K-TIRADS (64% [58-70%]), although the differences were not significant. K-TIRADS showed the highest meta-analytic specificity (93% [91-95%]), which was similar to ACR-TIRADS (89% [85-92%]) and EU-TIRADS (89% [77-95%]). For TR-4/5, all three TIRADS systems had sensitivities higher than 90%. K-TIRADS had the highest specificity (61% [50-72%]), followed by ACR-TIRADS (49% [43-56%]) and EU-TIRADS (48% [35-62%]), although the differences were not significant. Considerable threshold effects were noted with ACR- and K-TIRADS (p ≤ 0.01), with subject enrollment, country of origin, experience level of reviewer, number of patients, and clarity of blinding in review being the main causes of heterogeneity (p ≤ 0.05).

CONCLUSIONS

There was no significant difference among these three international TIRADS, but the trend toward higher sensitivity with EU-TIRADS and higher specificity with K-TIRADS.

KEY POINTS

• For TIRADS category 5, the meta-analytic sensitivity was highest for the EU-TIRADS, followed by the ACR-TIRADS and the K-TIRADS, although the differences were not significant. • For TIRADS category 5, K-TIRADS showed the highest meta-analytic specificity, which was similar to ACR-TIRADS and EU-TIRADS. • Considerable threshold effects were noted with ACR- and K-TIRADS, with subject enrollment, country of origin, experience level of reviewer, number of patients, and clarity of blinding in review being the main causes of heterogeneity.

Histopathological Verification of the Diagnostic Performance of the EU-TIRADS Classification of Thyroid Nodules-Results of a Multicenter Study Performed in a Previously Iodine-Deficient Region

Background: To validate the European Thyroid Imaging and Reporting Data System EU-TIRADS classification in a multi-institutional database of thyroid nodules by analyzing the obtained scores and histopathology results. Methods: A total of 842 thyroid lesions (613 benign, 229 malignant) were identified in 428 patients (mean age 62.7 years) and scored according to EU-TIRADS, using ultrasound examination. In all tumors, histopathological verification was performed. Results: In EU-TIRADS 2 (154 nodules) all nodules were benign; in EU-TIRADS 3, only 3/93 malignancies were identified. In EU-TIRADS 4, 12/103 were malignant, and in EU-TIRADS 5 (278 benign vs. 214 malignant). The malignant nodules that would not have qualified for biopsy were: EU-TIRADS 3, 2/3 (67%) malignancies were <20 mm, in EU-TIRADS 4, 7/12 (58%) were <15 mm. In EU-TIRADS 5, 72/214 (34%) were <10 mm; in total, 81/229 (36%) malignant lesions would have been missed. The cutoff between EU-TIRADS 3/4 had sensitivity of 100%, specificity of 25.1%. Using cutoff for EU-TIRADS 5, 93.4%, 54.6%, respectively. Conclusion: The application of EU-TIRADS guidelines allowed us to achieve moderate specificity. The vast majority of malignancies in EU-TIRADS 3, 4, and 5 would not have been recommended for biopsy because having a smaller size than that proposed classification.