A computer-aided diagnosis system for the assessment and characterization of low-to-high suspicion thyroid nodules on ultrasound

An Improved k-Nearest Neighbor Algorithm for Recognition and Classification of Thyroid Nodules

OBJECTIVES

To complete the task of automatic recognition and classification of thyroid nodules and solve the problem of high classification error rates when the samples are imbalanced.

METHODS

An improved k-nearest neighbor (KNN) algorithm is proposed and a method for automatic thyroid nodule classification based on the improved KNN algorithm is established. In the improved KNN algorithm, we consider not only the number of class labels for various classes of data in KNNs, but also the corresponding weights. And we use the Minkowski distance measure instead of the Euclidean distance measure.

RESULTS

A total of 508 ultrasound images of thyroid nodules, including 415 benign nodules and 93 malignant nodules, were used in the paper. Experimental results show the improved KNN has 0.872549 accuracy, 0.867347 precision, 1 recall, and 0.928962 F1-score. At the same time, we also considered the influence of different distance weights, the value of k, different distance measures on the classification results.

CONCLUSIONS

A comparison result shows that our method has a better performance than the traditional KNN and other classical machine learning methods.

Benign thyroid nodules classified as ACR TI-RADS 4 or 5: Imaging and histological features

BACKGROUND

American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) being most widely applied in clinical practice, there is an overlap in US imaging manifestations between benign and malignant thyroid nodules.

OBJECTIVES

To analyze the imaging and histological characteristics of pathological benign thyroid nodules categorized as American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) 4 or 5, and to explore the correlation between the suspicious sonographic signs resulting in the misdiagnoses and the histopathological features.

MATERIALS AND METHODS

Overall, 227 benign thyroid nodules (215 patients) in ACR TI-RADS 4 or 5 sampled through surgical excision were analyzed between December 2020 and August 2022. We retrospectively reread the ultrasound (US) images of the pathological discordant cases, after which we performed a systematic analysis focusing on the histopathological characteristics of thyroid lesions and recorded the findings. Qualitative US features and pathological significance of the thyroid nodules were analyzed using the chi-square and Fisher's exact tests.

RESULTS

The pathological type of 227 thyroid nodules (n = 103 in ACR TI-RADS 4 and n = 124 in ACR TI-RADS 5) was nodular goiter together with other histopathological features, namely, fibrosis (n = 103, 45.4 %), calcification (n = 70, 30.8 %), adenomatous hyperplasia (n = 31, 13.7 %), follicular epithelial hyperplasia (n = 23, 10.1 %), Hashimoto's thyroiditis (n = 18, 7.9 %), and cystic degeneration (n = 16, 7.1 %). Fibrosis was the most common histopathological feature in both ACR TI-RADS 4 (n = 42, 40.8 %) and 5 (n = 61, 49.2 %) categories of benign thyroid nodules. Thyroid nodules with fibrosis demonstrated sonographic features of "taller than wide" (p < 0.05), while lesions with follicular epithelial hyperplasia were likely to be detected with irregular and/or lobulated margins and very hypoechoic on US (p < 0.05 for both).

CONCLUSION

Benign thyroid nodules with histopathological findings such as fibrosis are associated with suspicious US features, which may give inappropriately higher TIRADS stratification.

Self-supervised enhanced thyroid nodule detection in ultrasound examination video sequences with multi-perspective evaluation

Objective.Ultrasound is the most commonly used examination for the detection and identification of thyroid nodules. Since manual detection is time-consuming and subjective, attempts to introduce machine learning into this process are ongoing. However, the performance of these methods is limited by the low signal-to-noise ratio and tissue contrast of ultrasound images. To address these challenges, we extend thyroid nodule detection from image-based to video-based using the temporal context information in ultrasound videos.Approach.We propose a video-based deep learning model with adjacent frame perception (AFP) for accurate and real-time thyroid nodule detection. Compared to image-based methods, AFP can aggregate semantically similar contextual features in the video. Furthermore, considering the cost of medical image annotation for video-based models, a patch scale self-supervised model (PASS) is proposed. PASS is trained on unlabeled datasets to improve the performance of the AFP model without additional labelling costs.Main results.The PASS model is trained by 92 videos containing 23 773 frames, of which 60 annotated videos containing 16 694 frames were used to train and evaluate the AFP model. The evaluation is performed from the video, frame, nodule, and localization perspectives. In the evaluation of the localization perspective, we used the average precision metric with the intersection-over-union threshold set to 50% (AP@50), which is the area under the smoothed Precision-Recall curve. Our proposed AFP improved AP@50 from 0.256 to 0.390, while the PASS-enhanced AFP further improved the AP@50 to 0.425. AFP and PASS also improve the performance in the valuations of other perspectives based on the localization results.Significance.Our video-based model can mitigate the effects of low signal-to-noise ratio and tissue contrast in ultrasound images and enable the accurate detection of thyroid nodules in real-time. The evaluation from multiple perspectives of the ablation experiments demonstrates the effectiveness of our proposed AFP and PASS models.

Artificial intelligence in thyroid ultrasound

Artificial intelligence (AI), particularly deep learning (DL) algorithms, has demonstrated remarkable progress in image-recognition tasks, enabling the automatic quantitative assessment of complex medical images with increased accuracy and efficiency. AI is widely used and is becoming increasingly popular in the field of ultrasound. The rising incidence of thyroid cancer and the workload of physicians have driven the need to utilize AI to efficiently process thyroid ultrasound images. Therefore, leveraging AI in thyroid cancer ultrasound screening and diagnosis cannot only help radiologists achieve more accurate and efficient imaging diagnosis but also reduce their workload. In this paper, we aim to present a comprehensive overview of the technical knowledge of AI with a focus on traditional machine learning (ML) algorithms and DL algorithms. We will also discuss their clinical applications in the ultrasound imaging of thyroid diseases, particularly in differentiating between benign and malignant nodules and predicting cervical lymph node metastasis in thyroid cancer. Finally, we will conclude that AI technology holds great promise for improving the accuracy of thyroid disease ultrasound diagnosis and discuss the potential prospects of AI in this field.

Diagnostic Performance of Various Ultrasound Risk Stratification Systems for Benign and Malignant Thyroid Nodules: A Meta-Analysis

BACKGROUND

To evaluate the diagnostic performance of ultrasound risk-stratification systems for the discrimination of benign and malignant thyroid nodules and to determine the optimal cutoff values of individual risk-stratification systems.

METHODS

PubMed, Embase, SCOPUS, Web of Science, and Cochrane library databases were searched up to August 2022. Sensitivity and specificity data were collected along with the characteristics of each study related to ultrasound risk stratification systems.

RESULTS

Sixty-seven studies involving 76,512 thyroid nodules were included in this research. The sensitivity, specificity, diagnostic odds ratios, and area under the curves by K-TIRADS (4), ACR-TIRADS (TR5), ATA (high suspicion), EU-TIRADS (5), and Kwak-TIRADS (4b) for malignancy risk stratification of thyroid nodules were 92.5%, 63.5%, 69.8%, 70.6%, and 95.8%, respectively; 62.8%, 89.6%, 87.2%, 83.9%, and 63.8%, respectively; 20.7111, 16.8442, 15.7398, 12.2986, and 38.0578, respectively; and 0.792, 0.882, 0.859, 0.843, and 0.929, respectively.

CONCLUSION

All ultrasound-based risk-stratification systems had good diagnostic performance. Although this study determined the best cutoff values in individual risk-stratification systems based on statistical assessment, clinicians could adjust or alter cutoff values based on the clinical purpose of the ultrasound and the reciprocal changes in sensitivity and specificity.

Ultrasound-based computer-aided diagnosis for cytologically indeterminate thyroid nodules with different radiologists

PURPOSE

To evaluate a computer-aided diagnosis (CAD) technique in predicting malignancy for cytologically indeterminate thyroid nodules (TNs) as compared with different experienced radiologists.

METHOD

436 patients with 436 cytologically indeterminate TNs on fine-needle aspiration cytology (FNAC) were included and all were confirmed by surgical pathology. They were retrospectively analyzed with respect to ultrasound (US) characteristics using a commercially available CAD system (AmCAD-UT; AmCad BioMed, Taiwan, China) and reviewed by one junior and one senior radiologists.The CAD system and different experienced radiologists stratified the risk of malignancy using ACR TI-RADS category. The diagnostic performance by different experienced radiologists independently and after consulting the CAD (different experienced radiologists + CAD) and by the CAD alone were compared.

RESULTS

The different experienced radiologists showed significantly higher specificities than the CAD system alone. The combination of radiologist and CAD system showed improved diagnostic performance with an AUC (Area under the curve) of 0.740 in the senior radiologist and 0.677 in the junior radiologist, as compared with CAD (AUC: 0.585) alone (all P < 0.05). The combination of senior radiologist and CAD system had the highest diagnostic performance (AUC: 0.740) and specificity (68.9%) compared to the others (all P < 0.05).

CONCLUSION

The CAD system may play the potential role as a decision-making assistant alongside radiologists for differential diagnosis of TNs with indeterminate cytology.

Ultrasonic S-Detect mode for the evaluation of thyroid nodules: A meta-analysis

OBJECTIVES

This meta-analysis aimed to evaluate the value of ultrasonic S-Detect mode for the evaluation of thyroid nodules.

METHODS

We searched PubMed, Cochrane Library, and Chinese biomedical databases from inception to August 31, 2021. Meta-analysis was conducted using STATA version 14.0 and Meta-Disc version 1.4 software. We calculated the summary statistics for sensitivity (Sen), specificity (Spe), summary receiver operating characteristic curve, and the area under the curve, and compared the area under the curve between ultrasonic S-Detect mode and thyroid imaging report and data system (TI-RADS) for the diagnosis of thyroid nodules. As a systematic review summarizing the results of previous studies, this study does not need the informed consent of patients or the approval of the ethics review committee.

RESULTS

Fifteen studies that met all inclusion criteria were included in this meta-analysis. A total of 924 thyroid malignant nodules and 1228 thyroid benign nodules were assessed. All thyroid nodules were histologically confirmed after examination. The pooled Sen and Spe of TI-RADS were 0.89 (95% confidence interval [CI] = 0.85-0.91) and 0.85 (95% CI = 0.78-0.90), respectively; the pooled Sen and Spe of S-Detect were 0.88 (95% CI = 0.85-0.90) and 0.73 (95% CI = 0.63-0.81), respectively. The areas under the summary receiver operating characteristic curve of TI-RADS and S-Detect were 0.9370 (standard error [SE] = 0.0110) and 0.9128 (SE = 0.0147), respectively, between which there was no significant difference (Z = 1.318; SE = 0.0184; P = .1875). We found no evidence of publication bias (t = 0.36, P = .72).

CONCLUSIONS

Our meta-analysis indicates that ultrasonic S-Detect mode may have high diagnostic accuracy and may have certain clinical application value, especially for young doctors.

A comparison of artificial intelligence versus radiologists in the diagnosis of thyroid nodules using ultrasonography: a systematic review and meta-analysis

BACKGROUND

Thyroid nodules are common. Ultrasonography (US) is the first investigation for thyroid nodules. Artificial Intelligence (AI) is widely integrated into medical diagnosis to provide additional information. The primary objective of this study was to accumulate the pooled sensitivity and specificity between all available AI and radiologists using thyroid US imaging. The secondary objective was to compare AI's diagnostic performance to that of radiologists.

MATERIALS AND METHODS

A systematic review meta-analysis. PubMed, Scopus, Web of Science, and Cochrane Library data were searched for studies from inception until June 11, 2020.

RESULTS

Twenty five studies were included in this meta-analysis. The pooled sensitivity and specificity of AI were 0.86 (95% CI 0.81-0.91) and 0.78 (95% CI 0.73-0.83), respectively. The pooled sensitivity and specificity of radiologists were 0.85 (95% CI 0.80-0.89) and 0.82 (95% CI 0.77-0.86), respectively. The accuracy of AI and radiologists is equivalent in terms of AUC [AI 0.89 (95% CI 0.86-0.92), radiologist 0.91 (95% CI 0.88-0.93)]. The diagnostic odd ratio (DOR) between AI 23.10 (95% CI 14.20-37.58) and radiologists 27.12 (95% CI 17.45-42.16) had no statistically significant difference (P = 0.56). Meta-regression analysis revealed that Deep Learning AI had significantly greater sensitivity and specificity than classic machine learning AI (P < 0.001).

CONCLUSION

AI demonstrated comparable performance to radiologists in diagnosing benign and malignant thyroid nodules using ultrasonography. Additional research to establish its equivalency should be conducted.

The Value of Thyroid Ultrasound Computer-Aided Diagnosis System in the Evaluation of Thyroid Nodules With Concurrent Hashimoto's Thyroiditis

OBJECTIVE

To investigate the value of computer-aided diagnosis (CAD) system in assessing thyroid nodules concurrent with Hashimoto's thyroiditis (HT).

METHODS

Totally 148 patients with 193 thyroid nodules were enrolled. A radiologist assessed the nodules using a thyroid ultrasound CAD system. Additionally, the nodules were evaluated by one experienced radiologist alone, and one training radiologist without and with CAD assistance. The diagnostic performance was compared between the CAD system and the experienced radiologist, and the training radiologist without and with CAD assistance.

RESULTS

The CAD system demonstrated a similar sensitivity to that of the experienced radiologist in diagnosing thyroid cancers (89.8% versus 92.4%, P > .05). The specificity and accuracy of the CAD system were lower than that of the experienced radiologist in assessing the nodules with diffusedly altered glands (specificity, 60.0% versus 81.7%, P = .007; accuracy, 77.5% versus 88.1%, P = .011). With CAD assistance, the training radiologist had improved sensitivity and accuracy that increased to 87.9% and 86.8% in classifying nodules with sonographically evident HT (both P = .012).

CONCLUSION

The CAD system has comparable sensitivity, but lower specificity compared with the experienced radiologist in diagnosing thyroid malignancies concurrent with HT. For a radiologist with less experience, the CAD system can help improve the diagnostic performance by increasing sensitivity and accuracy in assessing thyroid nodules with diffusely altered parenchyma.

Evaluation of ACR TI-RADS cytologically indeterminate thyroid nodules and molecular profiles: a single-institutional experience

INTRODUCTION

The American College of Radiology (ACR) Thyroid Imaging Reporting and Data Systems (TI-RADS) was developed to standardize thyroid ultrasound reports and predict the likelihood of malignancy. In our study, we aimed to correlate indeterminate thyroid fine needle aspiration cytology cases with preceding ultrasound (US) ACR TI-RADS scores and concurrent molecular testing results to examine how well the use of the ACR TI-RADS in our institution predicted which patients with indeterminate cytology might harbor molecular alterations.

MATERIALS AND METHODS

We performed a retrospective review of thyroid nodules. Patients with US reports that included TI-RADS scores, fine needle aspiration specimens with indeterminate cytology (Bethesda class III-V), and molecular testing results were included.

RESULTS

A total of 46 indeterminate cytology cases had had preceding US reports with TI-RADS scores and molecular testing (Bethesda class III, n = 37; Bethesda class IV, n = 6; Bethesda class V, n = 3). Most of the indeterminate cases had had a TI-RADS score of TR4 (31 of 46; 67.39%) or TR5 (9 of 46; 19.57%). RAS mutations were the most common alteration (n = 12). Of the 46 cases, 22 (47.85%) showed no alterations. Ten cases proceeded to surgery, of which seven displayed malignancies.

CONCLUSIONS

Molecular testing in cytologically indeterminate thyroid nodules provided valuable information for TR4 and TR5 lesions; however, the TR2 and TR3 lesions often had no molecular alterations. These findings highlight the potential value of including US imaging features when assessing the significance of indeterminate cytology findings.

Artificial Intelligence (AI) Tools for Thyroid Nodules on Ultrasound, From the AJR Special Series on AI Applications

Artificial intelligence (AI) methods for evaluating thyroid nodules on ultrasound have been widely described in the literature, with reported performance of AI tools matching or in some instances surpassing radiologists. As these data have accumulated, products for classification and risk stratification of thyroid nodules on ultrasound have become commercially available. This article reviews FDA-approved products currently on the market, with a focus on product features, reported performance, and considerations for implementation. The products perform risk stratification primarily using the Thyroid Imaging Reporting and Data System (TI-RADS), though may provide additional prediction tools independent of TI-RADS. Key issues in implementation include integration with radiologist interpretation, impact on workflow and efficiency, and performance monitoring. AI applications beyond nodule classification, including report construction and incidental findings follow-up, are also described. Anticipated future directions of research and development in AI tools for thyroid nodules are highlighted.

Radiomic Detection of Malignancy within Thyroid Nodules Using Ultrasonography-A Systematic Review and Meta-Analysis

Background: Despite investigation, 95% of thyroid nodules are ultimately benign. Radiomics is a field that uses radiological features to inform individualized patient care. We aimed to evaluate the diagnostic utility of radiomics in classifying undetermined thyroid nodules into benign and malignant using ultrasonography (US). Methods: A diagnostic test accuracy systematic review and meta-analysis was performed in accordance with PRISMA guidelines. Sensitivity, specificity, and area under curve (AUC) delineating benign and malignant lesions were recorded. Results: Seventy-five studies including 26,373 patients and 46,175 thyroid nodules met inclusion criteria. Males accounted for 24.6% of patients, while 75.4% of patients were female. Radiomics provided a pooled sensitivity of 0.87 (95% CI: 0.86−0.87) and a pooled specificity of 0.84 (95% CI: 0.84−0.85) for characterizing benign and malignant lesions. Using convolutional neural network (CNN) methods, pooled sensitivity was 0.85 (95% CI: 0.84−0.86) and pooled specificity was 0.82 (95% CI: 0.82−0.83); significantly lower than studies using non-CNN: sensitivity 0.90 (95% CI: 0.89−0.90) and specificity 0.88 (95% CI: 0.87−0.89) (p < 0.05). The diagnostic ability of radiologists and radiomics were comparable for both sensitivity (OR 0.98) and specificity (OR 0.95). Conclusions: Radiomic analysis using US provides a reproducible, reliable evaluation of undetermined thyroid nodules when compared to current best practice.

Multi-channel convolutional neural network architectures for thyroid cancer detection

Early detection of malignant thyroid nodules leading to patient-specific treatments can reduce morbidity and mortality rates. Currently, thyroid specialists use medical images to diagnose then follow the treatment protocols, which have limitations due to unreliable human false-positive diagnostic rates. With the emergence of deep learning, advances in computer-aided diagnosis techniques have yielded promising earlier detection and prediction accuracy; however, clinicians' adoption is far lacking. The present study adopts Xception neural network as the base structure and designs a practical framework, which comprises three adaptable multi-channel architectures that were positively evaluated using real-world data sets. The proposed architectures outperform existing statistical and machine learning techniques and reached a diagnostic accuracy rate of 0.989 with ultrasound images and 0.975 with computed tomography scans through the single input dual-channel architecture. Moreover, the patient-specific design was implemented for thyroid cancer detection and has obtained an accuracy of 0.95 for double inputs dual-channel architecture and 0.94 for four-channel architecture. Our evaluation suggests that ultrasound images and computed tomography (CT) scans yield comparable diagnostic results through computer-aided diagnosis applications. With ultrasound images obtained slightly higher results, CT, on the other hand, can achieve the patient-specific diagnostic design. Besides, with the proposed framework, clinicians can select the best fitting architecture when making decisions regarding a thyroid cancer diagnosis. The proposed framework also incorporates interpretable results as evidence, which potentially improves clinicians' trust and hence their adoption of the computer-aided diagnosis techniques proposed with increased efficiency and accuracy.

Reliability of a computer-aided system in the evaluation of indeterminate ultrasound images of thyroid nodules

INTRODUCTION

Computer-aided diagnostic (CAD) programs for malignancy risk stratification from ultrasound (US) imaging of thyroid nodules are being validated both experimentally and in real-world practice. However, they have not been tested for reliability in analyzing difficult or unclear images.

METHODS

US images with indeterminate characteristics were evaluated by five observers with different experience in US examination and by a commercial CAD program. The nodules, on which the observers widely agreed, were considered concordant and, if there was little agreement, not concordant or difficult to assess. The diagnostic performance of the readers and the CAD program was calculated and compared in both groups of nodule images.

RESULTS

In the group of concordant thyroid nodules (n = 37), the clinicians and the CAD system obtained similar levels of accuracy (77.0% vs 74.2%, respectively; P = 0.7) and no differences were found in sensitivity (SEN) (95.0% vs 87.5%, P = 0.2), specificity (SPE) (45.5 vs 49.4, respectively; P = 0.7), positive predictive value (PPV) (75.2% vs 77.7%, respectively; P = 0.8), nor negative predictive value (NPV) (85.6 vs 77.7, respectively; P = 0.3). When analyzing the non-concordant nodules (n = 43), the CAD system presented a decrease in accuracy of 4.2%, which was significantly lower than that observed by the experts (19.9%, P = 0.02).

CONCLUSIONS

Clinical observers are similar to the CAD system in the US assessment of the risk of thyroid nodules. However, the AI system for thyroid nodules AmCAD-UT® showed more reliability in the analysis of unclear or misleading images.

Do ACR TI-RADS scores demonstrate unique thyroid molecular profiles?

Purpose

The present study aimed to examine the molecular profiles of cytologically indeterminate thyroid nodules stratified by American College of Radiology Thyroid Imaging Reporting and Data System (TI-RADS) categories and to determine whether certain ultrasonographic features display particular molecular alterations.

Methods

A retrospective review was conducted of cases from January 1, 2016 to April 1, 2018. Cases with in-house ultrasonography, fine-needle aspiration Bethesda System for Reporting Thyroid Cytopathology (TBSRTC) diagnoses, molecular testing, and surgery were included. All cases were diagnosed as TBSRTC indeterminate categories. The ultrasound studies were retrospectively reviewed and assigned TI-RADS scores (TR1-TR5) by board-certified radiologists. The final diagnoses were determined based on the surgical resection pathology. Binary logistic regression analysis was used to study whether demographic characteristics, TI-RADS levels, and TBSRTC diagnoses were associated with ThyroSeq molecular results.

Results

Eighty-one cases met the inclusion criteria. RAS mutations were the most common alteration across all TI-RADS categories (TR2 2/2; TR3 10/19, TR4 13/44, and TR5 8/16), and did not stratify with any particular TI-RADS category. Only TR4 and TR5 categories displayed more aggressive mutations such as BRAF^V600E; and TERT. ThyroSeq results were positively correlated with thyroid malignancy when non-invasive follicular thyroid neoplasm with papillary-like nuclear features (NIFTP) was categorized in the malignant category (odds ratio [OR], 6.859; P<0.01), but not when NIFTP was removed from the malignancy category. Echogenicity scores were found to be negatively correlated with ThyroSeq results in thyroid nodules (OR, 0.162; P<0.01).

Conclusion

Higher-risk molecular alterations tended to stratify with the higher TI-RADS categories.

Radiomics as a New Frontier of Imaging for Cancer Prognosis: A Narrative Review

The evaluation of the efficacy of different therapies is of paramount importance for the patients and the clinicians in oncology, and it is usually possible by performing imaging investigations that are interpreted, taking in consideration different response evaluation criteria. In the last decade, texture analysis (TA) has been developed in order to help the radiologist to quantify and identify parameters related to tumor heterogeneity, which cannot be appreciated by the naked eye, that can be correlated with different endpoints, including cancer prognosis. The aim of this work is to analyze the impact of texture in the prediction of response and in prognosis stratification in oncology, taking into consideration different pathologies (lung cancer, breast cancer, gastric cancer, hepatic cancer, rectal cancer). Key references were derived from a PubMed query. Hand searching and clinicaltrials.gov were also used. This paper contains a narrative report and a critical discussion of radiomics approaches related to cancer prognosis in different fields of diseases.

Thyroid Nodule Characterization: How to Assess the Malignancy Risk. Update of the Literature

Ultrasound (US) is the first imaging modality for thyroid parenchyma evaluation. In the last decades, the role of ultrasound has been improved with the introduction of new US software, such as contrast-enhanced ultrasound (CEUS) and US-elastography (USE). USE is nowadays recognized as an essential part of the multiparametric ultrasound (MPUS) examination, in particular for the indeterminate thyroid nodule with possible fine-needle aspiration cytology (FNAC) number reduction; even if further and larger studies are needed to validate it. More controversial is the role of CEUS in thyroid evaluation, due to its high variability in sensitivity and specificity. Semi-automatic US systems based on the computer-aided diagnosis (CAD) system are producing interesting results, especially as an aid to less experienced operators. New knowledge on the molecular mechanisms involved in thyroid cancer is allowing practitioners to identify new genomic thyroid markers that could reduce the number of "diagnostic" thyroidectomies. We have therefore drawn up an updated representation of the current evidence in the literature for thyroid nodule multiparametric ultrasound (MPUS) evaluation with particular regard to USE, the US CAD system and CEUS.

TIRADS, SRE and SWE in INDETERMINATE thyroid nodule characterization: Which has better diagnostic performance?

Purpose

To assess Strain Ratio (SRE) and Shear Wave Elastography (SWE) accuracy alone and with TIRADS classification, for the risk stratification of indeterminate thyroid nodules.

Materials and methods

128 Patients with 128 indeterminate nodules candidates for thyroidectomy underwent preoperative staging neck ultrasound and were classified according to K-TIRADS score. After TIRADS evaluation, semi-quantitative (SRE) and quantitative (SWE expressed in kPa) elastosonography were performed and relative diagnostic performances, alone and in combination, were compared through ROC curves analysis. In order to maximize the SRE and SWE sensitivity and specificity, their cut-off values were calculated using the Liu test. Bonferroni test was used to evaluate statistically significant differences with a p value < 0.05.

Results

Sensitivity, specificity, PPV and NPV were, respectively, 71.4%, 82.4%, 62.5%, 87.5% for K-TIRADS baseline US, 85.7%, 94.1%, 85.7%, 94.1% for SRE and 57.1%, 79.4%, 53.3%, 81.8% for SWE (kPa expressed). SRE evaluation showed the best diagnostic accuracy compared to the SWE (kPa expressed) (p < 0.05) and to the K-TIRADS (p > 0.05). The association of SRE with conventional ultrasound with K-TIRADS score increased sensitivity (92.9% vs 71.4%) but decreased the specificity than conventional US alone (76.5% vs 82.4%).

Conclusion

Strain Elastosonography can be associated with K-TIRADS US examination in the thyroid nodule characterization with indeterminate cytology; in fact, adding the SRE to K-TIRADS assessment significantly increases its sensitivity and negative predictive value. However, further multicenter studies on larger population are warranted.

The value of the Demetics ultrasound-assisted diagnosis system in the differential diagnosis of benign from malignant thyroid nodules and analysis of the influencing factors

OBJECTIVES

To evaluate the value of Demetics and to explore whether Demetics can help radiologists with varying years of experience in the differential diagnosis of benign from malignant thyroid nodules.

METHODS

The clinical application value of Demetics was assessed by comparing the diagnostic accuracy of radiologists before and after applying Demetics. This retrospective analysis included 284 thyroid nodules that underwent pathological examinations. Two different combined methods were applied. Using method 1: the original TI-RADS classification was forcibly upgraded or downgraded by one level when Demetics classified the thyroid nodules as malignant or benign. Using method 2: the TI-RADS and benign or malignant classification of the thyroid nodules were flexibly adjusted after the physician learned the Demetics' results.

RESULTS

Demetics exhibited a higher sensitivity than did junior radiologist 1 (p_D1 = 0.029) and was similar in sensitivity to the two senior radiologists. Demetics had a higher AUC than both junior radiologists (p_D1 = 0.042, p_D2 = 0.038) and an AUC similar to that of the senior radiologists. The sensitivity (p = 0.035) and AUC (p = 0.031) of junior radiologist 1 and the specificity (p < 0.001) and AUC (p = 0.026) of junior radiologist 2 improved with combined method 1. The AUC of junior radiologist 2 improved with combined method 2 (p = 0.045). The factors influencing the diagnostic results of Demetics include sonographic signs (echogenicity and echogenic foci), contrast of the image, and nodule size.

CONCLUSION

Demetics exhibited high sensitivity and accuracy in the differential diagnosis of benign from malignant thyroid nodules. Demetics could improve the diagnostic accuracy of junior radiologists.

KEY POINTS

• Demetics exhibited a high sensitivity and accuracy in the differential diagnosis of benign from malignant thyroid nodules. • Demetics could improve the diagnostic accuracy of junior radiologists in the differential diagnosis of benign from malignant thyroid nodules. • Factors influencing the diagnostic results of Demetics include the sonographic signs (echogenicity and echogenic foci), contrast of the image, and nodule size.

Dual energy CT in gland tumors: a comprehensive narrative review and differential diagnosis

Dual energy CT (DECT)with image acquisition at two different photon X-ray levels allows the characterization of a specific tissue or material/elements, the extrapolation of virtual unenhanced and monoenergetic images, and the quantification of iodine uptake; such special capabilities make the DECT the perfect technique to support oncological imaging for tumor detection and characterization and treatment monitoring, while concurrently reducing the dose of radiation and iodine and improving the metal artifact reduction. Even though its potential in the field of oncology has not been fully explored yet, DECT is already widely used today thanks to the availability of different CT technologies, such as dual-source, single-source rapid-switching, single-source sequential, single-source twin-beam and dual-layer technologies. Moreover DECT technology represents the future of the imaging innovation and it is subject to ongoing development that increase according its clinical potentiality, in particular in the field of oncology. This review points out recent state-of-the-art in DECT applications in gland tumors, with special focus on its potential uses in the field of oncological imaging of endocrine and exocrine glands.

Narrative review of multiparametric ultrasound in parotid gland evaluation

Disorders affecting parotid gland represent a heterogeneous group comprising congenital, inflammatory and neoplastic diseases which show a focal or diffuse pattern of appearance. The differentiation of neoplastic from non-neoplastic conditions of parotid glands is pivotal for the diagnostic imaging. Frequently there is evidence of overlapping between the clinical and the imaging appearance of the various pathologies. The parotid gland is also often object of study with the combination of different techniques [ultrasound-computed tomography-magnetic resonance imaging (US-CT-MRI), ex.]. Compared to other dominant methods of medical imaging, US has several advantages providing images in real-time at lower cost, and without harmful use of ionizing radiation and of contrast enhancement. B-mode US, and the microvascular pattern color Doppler are usually used as first step evaluation of parotid lesions. Elastography and contrast-enhanced US (CEUS) has opened further possible perspectives to improve the differentiation between benign and malignant parotid lesions. The characterization of the parotid tumors plays a crucial role for their treatment planning and for the prediction of possible surgical complications. We present, here an updated review of the most recurrent pathologies of parotid gland focusing on the diagnostic power of multiparametric US including CEUS and ultrasound elastography (USE); limitations, advantages and the main key-points will be presented.

Computer-Aided Diagnosis System for the Evaluation of Thyroid Nodules on Ultrasonography: Prospective Non-Inferiority Study according to the Experience Level of Radiologists

Objective

To determine whether a computer-aided diagnosis (CAD) system for the evaluation of thyroid nodules is non-inferior to radiologists with different levels of experience.

Materials and Methods

Patients with thyroid nodules with a decisive diagnosis of benign or malignant nodule were consecutively enrolled from November 2017 to September 2018. Three radiologists with different levels of experience (1 month, 4 years, and 7 years) in thyroid ultrasound (US) reviewed the thyroid US with and without using the CAD system. Statistical analyses included non-inferiority testing of the diagnostic accuracy for malignant thyroid nodules between the CAD system and the three radiologists with a non-inferiority margin of 10%, comparison of the diagnostic performance, and the added value of the CAD system to the radiologists.

Results

Altogether, 197 patients were included in the study cohort. The diagnostic accuracy of the CAD system (88.48%, 95% confidence interval [CI] = 82.65–92.53) was non-inferior to that of the radiologists with less experience (1 month and 4 year) of thyroid US (83.03%, 95% CI = 76.52–88.02; p < 0.001), whereas it was inferior to that of the experienced radiologist (7 years) (95.76%, 95% CI = 91.37–97.96; p = 0.138). The sensitivity and negative predictive value of the CAD system were significantly higher than those of the less-experienced radiologists were, whereas no significant difference was found with those of the experienced radiologist. A combination of US and the CAD system significantly improved sensitivity and negative predictive value, although the specificity and positive predictive value deteriorated for the less-experienced radiologists.

Conclusion

The CAD system may offer support for decision-making in the diagnosis of malignant thyroid nodules for operators who have less experience with thyroid US.

A Clinical Assessment of an Ultrasound Computer-Aided Diagnosis System in Differentiating Thyroid Nodules With Radiologists of Different Diagnostic Experience

Introduction

This study aimed to assess the diagnostic performance and the added value to radiologists of different levels of a computer-aided diagnosis (CAD) system for the detection of thyroid cancers.

Methods

303 patients who underwent thyroidectomy from October 2018 to July 2019 were retrospectively reviewed. The diagnostic performance of the senior radiologist, the junior radiologist, and the CAD system were compared. The added value of the CAD system was assessed and subgroup analyses were performed according to the size of thyroid nodules.

Results

In total, 186 malignant thyroid nodules, and 179 benign thyroid nodules were included; 168 were papillary thyroid carcinoma (PTC), 7 were medullary thyroid carcinoma (MTC), 11 were follicular carcinoma (FTC), 127 were follicular adenoma (FA) and 52 were nodular goiters. The CAD system showed a comparable specificity as the senior radiologist (86.0% vs. 86.0%, p > 0.99), but a lower sensitivity and a lower area under the receiver operating characteristic (AUROC) curve (sensitivity: 71.5% vs. 95.2%, p < 0.001; AUROC: 0.788 vs. 0.906, p < 0.001). The CAD system improved the diagnostic sensitivities of both the senior and the junior radiologists (97.8% vs. 95.2%, p = 0.063; 88.2% vs. 75.3%, p < 0.001).

Conclusion

The use of the CAD system using artificial intelligence is a potential tool to distinguish malignant thyroid nodules and is preferable to serve as a second opinion for less experienced radiologists to improve their diagnosis performance.

S-Detect Software vs. EU-TIRADS Classification: A Dual-Center Validation of Diagnostic Performance in Differentiation of Thyroid Nodules

Computer-aided diagnosis (CAD) and other risk stratification systems may improve ultrasound image interpretation. This prospective study aimed to compare the diagnostic performance of CAD and the European Thyroid Imaging Reporting and Data System (EU-TIRADS) classification applied by physicians with S-Detect 2 software CAD based on Korean Thyroid Imaging Reporting and Data System (K-TIRADS) and combinations of both methods (MODELs 1 to 5). In all, 133 nodules from 88 patients referred to thyroidectomy with available histopathology or with unambiguous results of cytology were included. The S-Detect system, EU-TIRADS, and mixed MODELs 1–5 for the diagnosis of thyroid cancer showed a sensitivity of 89.4%, 90.9%, 84.9%, 95.5%, 93.9%, 78.9% and 93.9%; a specificity of 80.6%, 61.2%, 88.1%, 53.7%, 73.1%, 89.6% and 80.6%; a positive predictive value of 81.9%, 69.8%, 87.5%, 67%, 77.5%, 88.1% and 82.7%; a negative predictive value of 88.5%, 87.2%, 85.5%, 92.3%, 92.5%, 81.1% and 93.1%; and an accuracy of 85%, 75.9%, 86.5%, 74.4%, 83.5%, 84.2%, and 87.2%, respectively. Comparison showed superiority of the similar MODELs 1 and 5 over other mixed models as well as EU-TIRADS and S-Detect used alone (p-value < 0.05). S-Detect software is characterized with high sensitivity and good specificity, whereas EU-TIRADS has high sensitivity, but rather low specificity. The best diagnostic performance in malignant thyroid nodule (TN) risk stratification was obtained for the combined model of S-Detect (“possibly malignant” nodule) and simultaneously obtaining 4 or 5 points (MODEL 1) or exactly 5 points (MODEL 5) on the EU-TIRADS scale.

Computer-Aided Diagnosis Systems in Diagnosing Malignant Thyroid Nodules on Ultrasonography: A Systematic Review and Meta-Analysis

BACKGROUND

Computer-aided diagnosis (CAD) systems are being applied to the ultrasonographic diagnosis of malignant thyroid nodules, but it remains controversial whether the systems add any accuracy for radiologists.

OBJECTIVE

To determine the accuracy of CAD systems in diagnosing malignant thyroid nodules.

METHODS

PubMed, EMBASE, and the Cochrane Library were searched for studies on the diagnostic performance of CAD systems. The diagnostic performance was assessed by pooled sensitivity and specificity, and their accuracy was compared with that of radiologists. The present systematic review was registered in PROSPERO (CRD42019134460).

RESULTS

Nineteen studies with 4,781 thyroid nodules were included. Both the classic machine learning- and the deep learning-based CAD system had good performance in diagnosing malignant thyroid nodules (classic machine learning: sensitivity 0.86 [95% CI 0.79-0.92], specificity 0.85 [95% CI 0.77-0.91], diagnostic odds ratio (DOR) 37.41 [95% CI 24.91-56.20]; deep learning: sensitivity 0.89 [95% CI 0.81-0.93], specificity 0.84 [95% CI 0.75-0.90], DOR 40.87 [95% CI 18.13-92.13]). The diagnostic performance of the deep learning-based CAD system was comparable to that of the radiologists (sensitivity 0.87 [95% CI 0.78-0.93] vs. 0.87 [95% CI 0.85-0.89], specificity 0.85 [95% CI 0.76-0.91] vs. 0.87 [95% CI 0.81-0.91], DOR 40.12 [95% CI 15.58-103.33] vs. DOR 44.88 [95% CI 30.71-65.57]).

CONCLUSIONS

The CAD systems demonstrated good performance in diagnosing malignant thyroid nodules. However, experienced radiologists may still have an advantage over CAD systems during real-time diagnosis.

False-Positive Malignant Diagnosis of Nodule Mimicking Lesions by Computer-Aided Thyroid Nodule Analysis in Clinical Ultrasonography Practice

This study aims to test computer-aided diagnosis (CAD) for thyroid nodules in clinical ultrasonography (US) practice with a focus towards identifying thyroid entities associated with CAD system misdiagnoses. Two-hundred patients referred to thyroid US were prospectively enrolled. An experienced radiologist evaluated the thyroid nodules and saved axial images for further offline blinded analysis using a commercially available CAD system. To represent clinical practice, not only true nodules, but mimicking lesions were also included. Fine needle aspiration biopsy (FNAB) was performed according to present guidelines. US features and thyroid entities significantly associated with CAD system misdiagnosis were identified along with the diagnostic accuracy of the radiologist and the CAD system. Diagnostic specificity regarding the radiologist was significantly (p < 0.05) higher than when compared with the CAD system (88.1% vs. 40.5%) while no significant difference was found in the sensitivity (88.6% vs. 80%). Focal inhomogeneities and true nodules in thyroiditis, nodules with coarse calcification and inspissated colloid cystic nodules were significantly (p < 0.05) associated with CAD system misdiagnosis as false-positives. The commercially available CAD system is promising when used to exclude thyroid malignancies, however, it currently may not be able to reduce unnecessary FNABs, mainly due to the false-positive diagnoses of nodule mimicking lesions.

Use of the Thyroid Imaging Reporting and Data System (TIRADS) in clinical practice: an Italian survey

PURPOSE

To perform an online survey about the use of Thyroid Imaging Reporting and Data System (TIRADS) classification in Italy.

METHODS

An online questionnaire was administered to all members of the Italian Society of Medical and Interventional Radiology (Società Italiana di Radiologia Medica ed Interventistica, SIRM) and Italian Society of Ultrasound in Medicine and Biology (Società Italiana di Ultrasonologia in Medicina e Biologia, SIUMB). The survey consisted of 14 questions about demographics, knowledge, and the use of TIRADS classification, current job, expertize in thyroid ultrasound and fine needle aspiration biopsy, and work environment. Descriptive and nonparametric statistics were used, with P < 0.05 indicating statistical significance.

RESULTS

A total of 1544 answers (9.8% out of 15,836) were received. The participants were 45 (36-59) years old [median (25th-75th percentiles)] and mostly (53.6%) familiar with TIRADS classification. Structured reporting (P < 0.001), expertize in thyroid ultrasound (P = 0.005) and fine needle aspiration biopsy (P < 0.001), and work in a multidisciplinary team (P < 0.001) were associated with the use of TIRADS classification. Physicians working in other fields than radiology were more prone to using TIRADS classification than radiologists and radiologists-in-training (P < 0.001).

CONCLUSION

Most physicians adopt TIRADS classification when performing thyroid ultrasound. TIRADS classification provides recommendations for the management of thyroid nodules and its use has to be encouraged.

Computer-aided diagnostic system for thyroid nodule sonographic evaluation outperforms the specificity of less experienced examiners

PURPOSE

Computer-aided diagnosis (CAD) may improve interobserver agreement in the risk stratification of thyroid nodules. This study aims to evaluate the performance of the Korean Thyroid Imaging Reporting and Data System (K-TIRADS) classification as estimated by an expert radiologist, a senior resident, a medical student, and a CAD system, as well as the interobserver agreement among them.

METHODS

Between July 2016 and 2018, 107 nodules (size 5-40 mm, 27 malignant) were classified according to the K-TIRADS by an expert radiologist and CAD software. A third-year resident and a medical student with basic imaging training, both blinded to previous findings, retrospectively estimated the K-TIRADS classification. The diagnostic performance was calculated, including sensitivity, specificity, positive and negative predictive values, and the area under the receiver operating characteristic curve.

RESULTS

The CAD system and the expert achieved a sensitivity of 70.37% (95% CI 49.82-86.25%) and 81.48% (61.92-93.7%) and a specificity of 87.50% (78.21-93.84%) and 88.75% (79.72-94.72%), respectively. The specificity of the student was significantly lower (76.25% [65.42-85.05%], p = 0.02).

CONCLUSION

In our opinion, the CAD evaluation of thyroid nodules stratification risk has a potential role in a didactic field and does not play a real and effective role in the clinical field, where not only images but also specialistic medical practice is fundamental to achieve a diagnosis based on family history, genetics, lab tests, and so on. The CAD system may be useful for less experienced operators as its specificity was significantly higher.

Clinical validation of S-DetectTM mode in semi-automated ultrasound classification of thyroid lesions in surgical office

Background

In recent years well-recognized scientific societies introduced guidelines for ultrasound (US) malignancy risk stratification of thyroid nodules. These guidelines categorize the risk of malignancy in relation to a combination of several US features. Based on these US image lexicons an US-based computer-aided diagnosis (CAD) systems were developed. Nevertheless, their clinical utility has not been evaluated in any study of surgeon-performed office US of the thyroid. Hence, the aim of this pilot study was to validate s-Detect^TM mode in semi-automated US classification of thyroid lesions during surgeon-performed office US.

Methods

This is a prospective study of 50 patients who underwent surgeon-performed thyroid US (basic US skills without CAD vs. with CAD vs. expert US skills without CAD) in the out-patient office as part of the preoperative workup. The real-time CAD system software using artificial intelligence (S-Detect^TM for Thyroid; Samsung Medison Co.) was integrated into the RS85 US system. Primary outcome was CAD system added-value to the surgeon-performed office US evaluation. Secondary outcomes were: diagnostic accuracy of CAD system, intra and interobserver variability in the US assessment of thyroid nodules. Surgical pathology report was used to validate the pre-surgical diagnosis.

Results

CAD system added-value to thyroid assessment by a surgeon with basic US skills was equal to 6% (overall accuracy of 82% for evaluation with CAD vs. 76% for evaluation without CAD system; P<0.001), and final diagnosis was different than predicted by US assessment in 3 patients (1 more true-positive and 2 more true-negative results). However, CAD system was inferior to thyroid assessment by a surgeon with expert US skills in 6 patients who had false-positive results (P<0.001).

Conclusions

The sensitivity and negative predictive value of CAD system for US classification of thyroid lesions were similar as surgeon with expert US skills whereas specificity and positive predictive value were significantly inferior but markedly better than judgement of a surgeon with basic US skills alone.

Ultrasound Computer-Aided Diagnosis (CAD) Based on the Thyroid Imaging Reporting and Data System (TI-RADS) to Distinguish Benign from Malignant Thyroid Nodules and the Diagnostic Performance of Radiologists with Different Diagnostic Experience

<strong>BACKGROUND</strong> The diagnosis of thyroid cancer and distinguishing benign from malignant thyroid nodules by junior radiologists can be challenging. This study aimed to develop a computer-aided diagnosis (CAD) system based on the Thyroid Imaging Reporting and Data System (TI-RADS) to distinguish benign from malignant thyroid nodules by analyzing ultrasound images to improve the diagnostic performance of junior radiologists. <strong>MATERIAL AND METHODS</strong> A modified TI-RADS based on a convolutional neural network (CNN) was used to develop the CAD system. This retrospective study reviewed 789 thyroid nodules from 695 patients and included radiologists with different diagnostic experience. Five study groups included the CAD group, the junior radiologist group, the intermediate-level radiologist group, the senior radiologist group, and the group in which the junior radiologist used the CAD system. The ultrasound findings were reviewed and compared with the histopathology diagnosis. <strong>RESULTS</strong> The CAD system for the diagnosis of thyroid cancer showed an accuracy of 80.35%, a sensitivity of 80.64%, a specificity of 80.13%, a positive predictive value (PPV) of 76.02%, a negative predictive value (NPV) of 84.12%, and an area under the receiver operating characteristic (ROC) curve (AUC) of 0.87. The accuracy of the junior radiologists in diagnosing thyroid cancer using CAD was similar to that of intermediate-level radiologists (79.21% <i>vs</i>. 77.57%; P=0.427). <strong>CONCLUSIONS</strong> The use of ultrasound CAD based on the TI-RADS showed potential for distinguishing between benign and malignant thyroid nodules and improved the diagnostic performance of junior radiologists.

Interobserver agreement and efficacy of consensus reading in Kwak-, EU-, and ACR-thyroid imaging recording and data systems and ATA guidelines for the ultrasound risk stratification of thyroid nodules

PURPOSE

To investigate the interobserver agreement (IA) and the impact of consensus reading using four risk stratification systems for thyroid nodules (TN).

METHODS

Four experienced specialists independently rated US images of 80 TN according to the Kwak-TIRADS, EU-TIRADS, ACR TI-RADS, and ATA Guidelines. The cases were randomly extracted from a prospectively acquired database (n > 1500 TN). The observers were blinded to clinical data. This study was divided into two sessions (S1 and S2) with 40 image sets each. After every session, a consensus reading was carried out (C1, C2). Subsequently, the effect of C1 was tested in S2 with 40 new cases followed by C2. Fleiss' kappa (κ) was calculated for S1 and S2 to estimate the IA and learning curves. The results of C1 and C2 were used as reference for diagnostic accuracy calculations.

RESULTS

IA significantly increased (p < 0.01) after C1 with κ values of 0.375 (0.615), 0.411 (0.596), 0.321 (0.569), and 0.410 (0.583) for the Kwak-TIRADS, EU-TIRADS, ACR TI-RADS, and ATA Guidelines in S1 (S2), respectively. ROC analysis (C1 + C2) revealed similar areas under the curve (AUC) for the Kwak-TIRADS, EU-TIRADS, ACR TI-RADS, and ATA Guidelines (0.635, 0.675, 0.694, and 0.654, respectively, n.s.). AUC did not increase from C1 (0.677 ± 0.010) to C2 (0.632 ± 0.052, n.s.). ATA Guidelines were not applicable in five cases.

CONCLUSIONS

IA and diagnostic accuracy were very similar for the four investigated risk stratification systems. Consensus reading sessions significantly improved the IA but did not affect the diagnostic accuracy.

Diagnosis of Thyroid Nodules: Performance of a Deep Learning Convolutional Neural Network Model vs. Radiologists

Computer-aided diagnosis (CAD) systems hold potential to improve the diagnostic accuracy of thyroid ultrasound (US). We aimed to develop a deep learning-based US CAD system (dCAD) for the diagnosis of thyroid nodules and compare its performance with those of a support vector machine (SVM)-based US CAD system (sCAD) and radiologists. dCAD was developed by using US images of 4919 thyroid nodules from three institutions. Its diagnostic performance was prospectively evaluated between June 2016 and February 2017 in 286 nodules, and was compared with those of sCAD and radiologists, using logistic regression with the generalized estimating equation. Subgroup analyses were performed according to experience level and separately for small thyroid nodules 1–2 cm. There was no difference in overall sensitivity, specificity, positive predictive value (PPV), negative predictive value and accuracy (all p > 0.05) between radiologists and dCAD. Radiologists and dCAD showed higher specificity, PPV, and accuracy than sCAD (all p < 0.001). In small nodules, experienced radiologists showed higher specificity, PPV and accuracy than sCAD (all p < 0.05). In conclusion, dCAD showed overall comparable diagnostic performance with radiologists and assessed thyroid nodules more effectively than sCAD, without loss of sensitivity.

The Diagnostic Efficiency of Ultrasound Computer-Aided Diagnosis in Differentiating Thyroid Nodules: A Systematic Review and Narrative Synthesis

Computer-aided diagnosis (CAD) techniques have emerged to complement qualitative assessment in the diagnosis of benign and malignant thyroid nodules. The aim of this review was to summarize the current evidence on the diagnostic performance of various ultrasound CAD in characterizing thyroid nodules. PUBMED, EMBASE and Cochrane databases were searched for studies published until August 2019. The Quality Assessment of Studies of Diagnostic Accuracy included in Systematic Review 2 (QUADAS-2) tool was used to assess the methodological quality of the studies. Reported diagnostic performance data were analyzed and discussed. Fourteen studies with 2232 patients and 2675 thyroid nodules met the inclusion criteria. The study quality based on QUADAS-2 assessment was moderate. At best performance, grey scale CAD had a sensitivity of 96.7% while Doppler CAD was 90%. Combined techniques of qualitative grey scale features and Doppler CAD assessment resulted in overall increased sensitivity (92%) and optimal specificity (85.1%). The experience of the CAD user, nodule size and the thyroid malignancy risk stratification system used for interpretation were the main potential factors affecting diagnostic performance outcomes. The diagnostic performance of CAD of thyroid ultrasound is comparable to that of qualitative visual assessment; however, combined techniques have the potential for better optimized diagnostic accuracy.

Clinical Value of a Computer-Aided Diagnosis System in Thyroid Nodules: Analysis of a Reading Map Competition

We evaluated the accuracy of human and computer-aided diagnosis (CAD) in a reading map diagnosis competition for detection of thyroid cancers via ultrasonography (US). The competition comprised 33 thyroid nodule images randomly chosen between 2015 and 2017. One hundred seventy-seven contestants including one operator using CAD participated in the competition. The competition was separated into an online part and a live part. We compared the average accuracy of contestants and CAD in the detection of thyroid cancers. The accuracy of contestants and the CAD system was 60.3% and 84.8%, respectively. The accuracy of the CAD system was higher than that of the contestants with different technical titles. The areas under the curve for CAD and contestants were 0.985 (0.881-1.00) and 0.659 (0.645-0.673) (Z = 7.55, p < 0.01). The CAD system had high accuracy in this thyroid nodule reading map competition, and may be an adjuvant tool for radiologists.

Clinical practice guidelines on ultrasound-guided fine needle aspiration biopsy of thyroid nodules: a critical appraisal using AGREE II

PURPOSE

To appraise the quality of current guidelines on fine needle aspiration biopsy (FNAB) of thyroid nodules for adults using the AGREE II quality assessment tool.

METHODS

We conducted an online search for guidelines on FNAB of thyroid nodules published between 2013 and October 2018. They were evaluated by four independent reviewers previously trained to apply the AGREE II instrument, which is organized into items and domains. A fifth independent reviewer calculated scores for each domain and guideline as well as inter-appraiser agreement.

RESULTS

Six sets of guidelines were included, respectively, provided by the American Thyroid Association (ATA), the American Association of Clinical Endocrinologists/American College of Endocrinology/Associazione Medici Endocrinologi (AACE/ACE/AME), the Korean Society of Thyroid Radiology (KSThR), the European Thyroid Association (ETA), the American College of Radiology (ACR) and the Korean Society of Radiology and National Evidence-Based Healthcare Collaborating Agency (KSR/NECA). Five out of the six guidelines (ATA, AACE/ACE/AME, ETA, ACR and KSR/NECA) reached a high level of overall quality, having at least five domain scores >60%. An average level of overall quality was achieved in one case (KSThR recommendations). Inter-appraiser agreement ranged from moderate to excellent.

CONCLUSIONS

Overall, the quality of guidelines on FNAB of thyroid nodules is satisfactory when evaluated using the AGREE II instrument.

Effectiveness evaluation of computer-aided diagnosis system for the diagnosis of thyroid nodules on ultrasound: A systematic review and meta-analysis

BACKGROUND

More and more automated efficient ultrasound image analysis techniques, such as ultrasound-based computer-aided diagnosis system (CAD), were developed to obtain accurate, reproducible, and more objective diagnosis results for thyroid nodules. So far, whether the diagnostic performance of existing CAD systems can reach the diagnostic level of experienced radiologists is still controversial. The aim of the meta-analysis was to evaluate the accuracy of CAD for thyroid nodules' diagnosis by reviewing current literatures and summarizing the research status.

METHODS

A detailed literature search on PubMed, Embase, and Cochrane Libraries for articles published until December 2018 was carried out. The diagnostic performances of CAD systems vs radiologist were evaluated by meta-analysis. We determined the sensitivity and the specificity across studies, calculated positive and negative likelihood ratios and constructed summary receiver-operating characteristic (SROC) curves. Meta-analysis of studies was performed using a mixed-effect, hierarchical logistic regression model.

RESULTS

Five studies with 536 patients and 723 thyroid nodules were included in this meta-analysis. The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio (DOR) for CAD system were 0.87 (95% confidence interval [CI], 0.73-0.94), 0.79 (95% CI 0.63-0.89), 4.1 (95% CI 2.5-6.9), 0.17 (95% CI 0.09-0.32), and 25 (95% CI 15-42), respectively. The SROC curve indicated that the area under the curve was 0.90 (95% CI 0.87-0.92). The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and DOR for experienced radiologists were 0.82 (95% CI 0.69-0.91), 0.83 (95% CI 0.76-0.89), 4.9 (95% CI 3.4-7.0), 0.22 (95% CI 0.12-0.38), and 23 (95% CI 11-46), respectively. The SROC curve indicated that the area under the curve was 0.96 (95% CI 0.94-0.97).

CONCLUSION

The sensitivity of the CAD system in the diagnosis of thyroid nodules was similar to that of experienced radiologists. However, the CAD system had lower specificity and DOR than experienced radiologists. The CAD system may play the potential role as a decision-making assistant alongside radiologists in the thyroid nodules' diagnosis. Future technical improvements would be helpful to increase the accuracy as well as diagnostic efficiency.

Diagnostic accuracy of different computer-aided diagnostic systems for malignant and benign thyroid nodules classification in ultrasound images: A systematic review and meta-analysis protocol

OBJECTIVE

The aim of this study was to determine the diagnostic accuracy of different computer-aided diagnostic (CAD) systems for thyroid nodules classification.

METHODS

A systematic search of the literature was conducted from inception until March, 2019 using the PubMed, EMBASE, Web of science, and Cochrane library. Literature selection and data extraction were conducted by 2 independent reviewers. Numerical values for sensitivity and specificity were obtained from false negative (FN), false positive (FP), true negative (TN), and true positive (TP) rates, presented alongside graphical representations with boxes marking the values and horizontal lines showing the confidence intervals (CIs). Summary receiver operating characteristic (SROC) curves were applied to assess the performance of diagnostic tests. Data were processed using Review Manager 5.3 and Stata 15. The methodological quality of included studies was assessed using Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool.

TRIAL REGISTRATION NUMBER

PROSPERO CRD42019132540.

A computer-aided diagnosis system for the assessment and characterization of low-to-high suspicion thyroid nodules on ultrasound

AIM OF THE STUDY

To compare the diagnostic performance of a commercially available computer-aided diagnosis (CAD) system for thyroid ultrasound (US) with that of a non-computer-aided radiologist in the characterization of low-to-high suspicion thyroid nodules.

METHODS

This retrospective study included a consecutive series of adult patients referred for US-guided fine-needle aspiration biopsy (FNAB) of a thyroid nodule. All patients were eligible for thyroid nodule FNAB according to the current international guidelines. An interventional radiologist experienced in thyroid imaging acquired the US images subsequently used for post-processing, performed FNAB and provided the US features of each nodule. A radiology resident and an endocrinology resident in consensus performed post-processing using the CAD system to assess the same nodule characteristics. The diagnostic performance and agreement of US features between the CAD system and the radiologist were compared.

RESULTS

Sixty-two patients (50 F; age 60 ± 12 years) were enrolled: 77.4% (48/62) of thyroid nodules were benign, 22.6% (14/62) were undetermined to malignant and required follow-up or surgery. Interobserver agreement between the CAD system and the radiologist was substantial for orientation (K = 0.69), fair for composition (K = 0.36), echogenicity (K = 0.36), K-TIRADS (K = 0.29), and slight for margins (K = 0.03). The radiologist demonstrated a significantly higher sensitivity than the CAD system (78.6% vs. 21.4%; P = 0.008), while there was no statistical difference in specificity (66.7% vs. 81.3%; P = 0.065).

CONCLUSION

This CAD system is less sensitive than an experienced radiologist and showed slight-to-substantial agreement with the radiologist for the characterization of thyroid nodules. Although it is an innovative tool with good potential, additional efforts are needed to improve its diagnostic performance.