Incomplete Thyroid Ultrasound Reports for Patients With Thyroid Nodules: Implications Regarding Risk Assessment and Management

Deep learning approaches for differentiating thyroid nodules with calcification: a two-center study

BACKGROUND

Calcification is a common phenomenon in both benign and malignant thyroid nodules. However, the clinical significance of calcification remains unclear. Therefore, we explored a more objective method for distinguishing between benign and malignant thyroid calcified nodules.

METHODS

This retrospective study, conducted at two centers, involved a total of 631 thyroid nodules, all of which were pathologically confirmed. Ultrasound image sets were employed for analysis. The primary evaluation index was the area under the receiver-operator characteristic curve (AUROC). We compared the diagnostic performance of deep learning (DL) methods with that of radiologists and determined whether DL could enhance the diagnostic capabilities of radiologists.

RESULTS

The Xception classification model exhibited the highest performance, achieving an AUROC of up to 0.970, followed by the DenseNet169 model, which attained an AUROC of up to 0.959. Notably, both DL models outperformed radiologists (P < 0.05). The success of the Xception model can be attributed to its incorporation of deep separable convolution, which effectively reduces the model's parameter count. This feature enables the model to capture features more effectively during the feature extraction process, resulting in superior performance, particularly when dealing with limited data.

CONCLUSIONS

This study conclusively demonstrated that DL outperformed radiologists in differentiating between benign and malignant calcified thyroid nodules. Additionally, the diagnostic capabilities of radiologists could be enhanced with the aid of DL.

Inter-Rater Reliability of Thyroid Ultrasound Risk Criteria: A Systematic Review and Meta-Analysis

OBJECTIVE

The most commonly employed diagnostic criteria for identifying thyroid nodules include Thyroid Imaging and Reporting Data System (TI-RADS) and American Thyroid Association (ATA) guidelines. The purpose of this systematic review and meta-analysis is to determine the inter-rater reliability of thyroid ultrasound criteria.

METHODS

We performed a library search of MEDLINE (Ovid), EMBASE (Ovid), and Web of Science for full-text articles published from January 2005 to June 2022. We included full-text primary research articles that used TI-RADS and/or ATA guidelines to evaluate thyroid nodules in adults. These included studies must have calculated inter-rater reliability using any validated metric. The Quality Appraisal for Reliability Studies (QAREL) was used to assess study quality. We planned for a random-effects meta-analysis, in addition to covariate and publication bias analyses. This study was performed in accordance with Preferred Reporting Items for a Systematic Review and Meta-analysis guidelines and registered prior to conduction (International prospective register of systematic reviews-PROSPERO: CRD42021275072).

RESULTS

Of the 951 articles identified via the database search, 35 met eligibility criteria. All studies were observational. The most commonly utilized criteria were ACR Thyroid Imaging and Reporting Data System (TI-RADS) and/or ATA criteria, while the majority of studies employed Κ statistics. For ACR TI-RADS, the pooled Κ was 0.51 (95% confidence interval [CI]: 0.42, 0.57; n = 7) while for ATA, the pooled Κ was 0.52 (95% CI: 0.37, 0.67; n = 3). Due to the small number of studies, covariate or publication bias analyses were not performed.

CONCLUSION

Ultrasound criteria demonstrate moderate inter-rater reliability, but these findings are impacted by poor study quality and a lack of standardization. Laryngoscope, 133:485-493, 2023.

The Future of Thyroid Nodule Risk Stratification

Clinical evidence supports the association of ultrasound features with benign or malignant thyroid nodules and serves as the basis for sonographic stratification of thyroid nodules, according to an estimated thyroid cancer risk. Contemporary guidelines recommend management strategies according to thyroid cancer risk, thyroid nodule size, and the clinical scenario. Yet, reproducible and accurate thyroid nodule risk stratification requires expertise, time, and understanding of the weight different ultrasound features have on thyroid cancer risk. The application of artificial intelligence to overcome these limitations is promising and has the potential to improve the care of patients with thyroid nodules.

A new prediction model for lateral cervical lymph node metastasis in patients with papillary thyroid carcinoma: Based on dual-energy CT

PURPOSE

The current study aimed to develop and validate a prediction model to estimate the independent risk factors for lateral cervical lymph node metastasis (LLNM) in papillary thyroid carcinoma (PTC) patients based on dual-energy computed tomography (DECT).

METHOD

This study retrospectively conducted 406 consecutive patients from July 2015 to June 2019 to form the derivation cohorts and performed internal validation. 101 consecutive patients from July 2019 to June 2020 were included to create the external validation cohort. Univariable and multivariable logistic regression analyses were used to evaluate independent risk factors for LLNM. A prediction model based on DECT parameters was built and presented on a nomogram. The internal and external validations were performed.

RESULTS

Iodine concentration (IC) in the arterial phase (OR 2.761, 95% CI 1.028-7.415, P 0.044), IC in venous phase (OR 3.820, 95% CI 1.430-10.209, P 0.008), located in the superior pole (OR 4.181, 95% CI 2.645-6.609, P 0.000), and extrathyroidal extension (OR 4.392, 95% CI 2.142-9.004, P 0.000) were independently associated with LLNM in the derivation cohort. These four predictors were incorporated into the nomogram. The model showed good discrimination in the derivation (AUC, 0.899), internal (AUC, 0.905), and external validation (AUC, 0.912) cohorts. The decision curve revealed that more advantages would be added using the nomogram to estimate LLNM, which implied that the lateral lymph node dissection was recommended.

CONCLUSIONS

DECT parameters could provide independent indicators of LLNM in PTC patients, and the nomogram based on them may be helpful in treatment decision-making.

Association of the Implementation of a Standardized Thyroid Ultrasonography Reporting Program With Documentation of Nodule Characteristics

Importance

Although most thyroid nodules are benign, the potential for malignant neoplasms is associated with unnecessary workup in the form of imaging, fine-needle aspiration, and diagnostic surgery. The American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) is commonly used to assess the malignant neoplasm risk potential of thyroid nodules imaged by ultrasonography. However, standardized reporting of ACR TI-RADS descriptors is inconsistent.

Objective

To increase the documentation rate of ACR TI-RADS thyroid nodule characteristics to 80% in 18 months.

Design, Setting, and Participants

This prospective interrupted time series quality improvement study was conducted from December 1, 2018, to March 31, 2020, at a tertiary outpatient head and neck clinic among 229 patients who had at least 1 documented thyroid nodule identified on bedside clinic ultrasonography. Data analysis was performed throughout the entire study period because this was a quality improvement study with iterative small cycle changes; final analysis of the data was performed in April 2020.

Main Outcomes and Measures

The primary outcome was the documentation rates of 6 ACR TI-RADS ultrasonographic descriptors. Secondary outcomes included nodule fine-needle aspiration biopsy rate and physician-reported clinic flow efficiency.

Results

A total of 229 patients had at least 1 documented thyroid nodule and were included in the analysis. Size was the most frequently documented nodule characteristic (72 of 74 [97.3%]) at baseline, followed by echogenic foci (31 of 74 [41.9%]), composition (23 of 74 [31.1%]), echogenicity (17 of 74 [23.0%]), margin (6 of 74 [8.1%]), and shape (1 of 74 [1.4%]). After 3 Plan, Do, Study, Act (PDSA) cycles, the final intervention consisted of a standardized ultrasonography reporting form and educational initiatives for surgical trainees. After the third PDSA cycle (n = 36), reporting of nodule size, echogenic foci, and composition increased to 100%. Similarly, reporting of echogenicity (34 of 36 [94.4%]), shape (28 of 36 [77.8%]), and margin (25 of 36 [69.4%]) all increased. This represented a cumulative 90.3% documentation rate (195 of 216), a 56.5% increase from baseline (95% CI, 50.0%-61.9%). The standardized reporting form was used in 83.3% of eligible thyroid ultrasonography cases (30 of 36) after PDSA cycle 3, demonstrating good fidelity of implementation. There were no unintended consequences associated with clinic workflow, as a balancing measure, reported by staff surgeons.

Conclusions and Relevance

This study suggests that implementation of an ACR TI-RADS-based reporting form in conjunction with educational initiatives improved documentation of ultrasonographic thyroid nodule characteristics, potentially allowing for improved bedside risk stratification and communication among clinicians.

Different sonographic features of peripheral thyroid nodule calcification and risk of malignancy: a prospective observational study

Purpose

To investigate the association of peripheral calcification, as well as its sonographic features, with thyroid nodule malignancy.

Material and methods

This study was prospectively conducted during 2015-2020 on patients diagnosed with thyroid nodule undergoing ultrasound-guided fine-needle aspiration in Shahid Beheshti teaching hospital or private offices in Babol, northern Iran. The ultrasonographic characteristics of the nodules, as well as the cytological findings, were recorded. Regression analysis was used to assess the relationship between sonographic results and malignancy. We also used receiver operator characteristics (ROC) analysis to estimate the ability of ultrasound to predict the characteristic features of malignancy, as estimated by the area under the curve (AUC).

Results

A total of 1857 thyroid nodules were finally included, of which 84 were peripherally calcified nodules. There was a significant positive association between the nodule malignancy and peripheral calcification (OR = 2.23, 95% CI: 1.13-4.35). In the nodules with peripheral calcification, significant positive associations were seen between malignancy and lobulated margin (OR = 3.85, 95% CI: 1.02-14.54) and solid composition (OR = 4.05, 95% CI: 0.99-16.53). The ROC analysis indicated that AUC for lobulated margin and solid composition was 63.8% and 66.5%, respectively, in predicting malignant thyroid nodules.

Conclusion

The findings showed that peripheral calcification on sonography can be a potential indicator of malignant thyroid nodules. Also, the presence of lobulated margin and/or solid composition, besides peripheral calcification, can be helpful in better distinguishing malignant from benign nodules.

Integrity of clinical information in radiology reports documenting pulmonary nodules

OBJECTIVE

Quantify the integrity, measured as completeness and concordance with a thoracic radiologist, of documenting pulmonary nodule characteristics in CT reports and assess impact on making follow-up recommendations.

MATERIALS AND METHODS

This Institutional Review Board-approved, retrospective cohort study was performed at an academic medical center. Natural language processing was performed on radiology reports of CT scans of chest, abdomen, or spine completed in 2016 to assess presence of pulmonary nodules, excluding patients with lung cancer, of which 300 reports were randomly sampled to form the study cohort. Documentation of nodule characteristics were manually extracted from reports by 2 authors with 20% overlap. CT images corresponding to 60 randomly selected reports were further reviewed by a thoracic radiologist to record nodule characteristics. Documentation completeness for all characteristics were reported in percentage and compared using χ2 analysis. Concordance with a thoracic radiologist was reported as percentage agreement; impact on making follow-up recommendations was assessed using kappa.

RESULTS

Documentation completeness for pulmonary nodule characteristics differed across variables (range = 2%-90%, P < .001). Concordance with a thoracic radiologist was 75% for documenting nodule laterality and 29% for size. Follow-up recommendations were in agreement in 67% and 49% of reports when there was lack of completeness and concordance in documenting nodule size, respectively.

DISCUSSION

Essential pulmonary nodule characteristics were under-reported, potentially impacting recommendations for pulmonary nodule follow-up.

CONCLUSION

Lack of documentation of pulmonary nodule characteristics in radiology reports is common, with potential for compromising patient care and clinical decision support tools.

Thyroid Ultrasound Reports: Will the Thyroid Imaging, Reporting, and Data System Improve Natural Language Processing Capture of Critical Thyroid Nodule Features?

BACKGROUND

Critical thyroid nodule features are contained in unstructured ultrasound (US) reports. The Thyroid Imaging, Reporting, and Data System (TI-RADS) uses five key features to risk stratify nodules and recommend appropriate intervention. This study aims to analyze the quality of US reporting and the potential benefit of Natural Language Processing (NLP) systems in efficiently capturing TI-RADS features from text reports.

MATERIALS AND METHOD

This retrospective study used free-text thyroid US reports from an academic center (A) and community hospital (B). Physicians created "gold standard" annotations by manually extracting TI-RADS features and clinical recommendations from reports to determine how often they were included. Similar annotations were created using an automated NLP system and compared with the gold standard.

RESULTS

Two hundred eighty-two reports contained 409 nodules at least 1-cm in maximum diameter. The gold standard identified three nodules (0.7%) which contained enough information to calculate a complete TI-RADS score. Shape was described most often (92.7% of nodules), whereas margins were described least often (11%). A median number of two TI-RADS features are reported per nodule. The NLP system was significantly less accurate than the gold standard in capturing echogenicity (27.5%) and margins (58.9%). One hundred eight nodule reports (26.4%) included clinical management recommendations, which were included more often at site A than B (33.9 versus 17%, P < 0.05).

CONCLUSIONS

These results suggest a gap between current US reporting styles and those needed to implement TI-RADS and achieve NLP accuracy. Synoptic reporting should prompt more complete thyroid US reporting, improved recommendations for intervention, and better NLP performance.

Ultrasonographic characteristics of thyroid metastasis from clear cell renal cell carcinoma: A case report

INTRODUCTION

Thyroid metastasis from clear cell renal cell carcinoma (ccRCC) is a very rare condition, and its ultrasonographic characteristics have not been summarized in the literature. We herein report a case of thyroid metastasis from ccRCC that occurred 11 years after the surgery and the ultrasonographic characteristics of it are described.

PATIENT CONCERNS

A 57-year-old male patient was admitted to our hospital in September 2018 due to discomfort in the neck. No other abnormalities were found during laboratory examination of thyroid function. The previous medical history of the patient included a right nephrectomy for the treatment of ccRCC in June 2007.

DIAGNOSIS

Ultrasound examinations revealed multiple thyroid nodules. After nephrectomy, there was no obvious abnormality in the right renal area. Computed tomography (CT) showed an oval lesion with slightly lower density in the right lobe of the thyroid, and the patient was initially diagnosed with nodular goiter.

INTERVENTIONS

Bilateral partial thyroidectomy under general anesthesia was conducted. Intraoperative frozen pathological examination showed clear cell carcinoma in the right lobe of the thyroid gland. Therefore, total thyroidectomy and lymph node dissection in the central neck area were performed.

OUTCOMES

The patient underwent surgical treatment and recovered successfully. The patient was followed up for 2 years with no further metastasis.

CONCLUSION

Ultrasound examination is a safe and convenient screening method. For patients with a renal malignant tumor, if the ultrasound image of thyroid nodule is found to have the characteristics of malignant tumors, the occurrence of metastasis of renal cancer to the thyroid should be highly suspected. Core needle biopsy (CNB) and histopathological diagnosis should be conducted subsequently for early diagnosis.

Thyroid Ultrasound Reports: Deficiencies and Recommendations

OBJECTIVE

Thyroid ultrasound plays a major role in the clinical management of patients with thyroid nodules. Comprehensive reporting enables malignant risk stratification and biopsy decisions. In this study, we aimed at a systematic evaluation of the content and completeness of thyroid radiology reports.

METHODS

A retrospective study was undertaken. A total of 200 thyroid ultrasound reports of examinations performed over a 1-year period were reviewed. After excluding 18 reports, the remaining 182 were evaluated for the inclusion of the following nodule characteristics: size, 3-axis dimensions, location, presence or absence of five signs suspicious of malignancy, namely microcalcification, hypoechogenecity, irregular margin, height-to-width ratio, and intranodular vascularity.

RESULTS

While all reported nodules could be stratified easily as being more or less than 1 cm in size, only 23.6% of these nodules were reported in 3 dimensions, and 33.5% of the nodules were specifically localized. For any described nodule, the frequency of reporting on echogenicity was 50%, on vascularity 19.2%, on margin 10.4%, on calcifications 9.3%, and no report contained a description of the height-to-width ratio. The cumulative frequency of reporting on one characteristic per nodule was 84%, of two characteristics 27%, three characteristics 4.4%, and no report included ≥4 characteristics per nodule.

CONCLUSION

Despite easily accessible templates, reporting of thyroid nodule sonogram continues to be incomplete and inconsistent. This in turn constitutes a waste of a significant tool that could otherwise help in making timely informed medical decisions and in providing a significant platform for patients' future follow-up.