Deep learning-based artificial intelligence model to assist thyroid nodule diagnosis and management: a multicentre diagnostic study

Toward Reduction in False-Positive Thyroid Nodule Biopsies with a Deep Learning-based Risk Stratification System Using US Cine-Clip Images

PURPOSE

To develop a deep learning-based risk stratification system for thyroid nodules using US cine images.

MATERIALS AND METHODS

In this retrospective study, 192 biopsy-confirmed thyroid nodules (175 benign, 17 malignant) in 167 unique patients (mean age, 56 years ± 16 [SD], 137 women) undergoing cine US between April 2017 and May 2018 with American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS)-structured radiology reports were evaluated. A deep learning-based system that exploits the cine images obtained during three-dimensional volumetric thyroid scans and outputs malignancy risk was developed and compared, using fivefold cross-validation, against a two-dimensional (2D) deep learning-based model (Static-2DCNN), a radiomics-based model using cine images (Cine-Radiomics), and the ACR TI-RADS level, with histopathologic diagnosis as ground truth. The system was used to revise the ACR TI-RADS recommendation, and its diagnostic performance was compared against the original ACR TI-RADS.

RESULTS

The system achieved higher average area under the receiver operating characteristic curve (AUC, 0.88) than Static-2DCNN (0.72, P = .03) and tended toward higher average AUC than Cine-Radiomics (0.78, P = .16) and ACR TI-RADS level (0.80, P = .21). The system downgraded recommendations for 92 benign and two malignant nodules and upgraded none. The revised recommendation achieved higher specificity (139 of 175, 79.4%) than the original ACR TI-RADS (47 of 175, 26.9%; P < .001), with no difference in sensitivity (12 of 17, 71% and 14 of 17, 82%, respectively; P = .63).

CONCLUSION

The risk stratification system using US cine images had higher diagnostic performance than prior models and improved specificity of ACR TI-RADS when used to revise ACR TI-RADS recommendation.Keywords: Neural Networks, US, Abdomen/GI, Head/Neck, Thyroid, Computer Applications-3D, Oncology, Diagnosis, Supervised Learning, Transfer Learning, Convolutional Neural Network (CNN) Supplemental material is available for this article. © RSNA, 2022.

Personalized Diagnosis in Differentiated Thyroid Cancers by Molecular and Functional Imaging Biomarkers: Present and Future

Personalized diagnosis can save unnecessary thyroid surgeries, in cases of indeterminate thyroid nodules, when clinicians tend to aggressively treat all these patients. Personalized diagnosis benefits from a combination of imagery and molecular biomarkers, as well as artificial intelligence algorithms, which are used more and more in our timeline. Functional imaging diagnosis such as SPECT, PET, or fused images (SPECT/CT, PET/CT, PET/MRI), is exploited at maximum in thyroid nodules, with a long history in the past and a bright future with many suitable radiotracers that could properly contribute to diagnosing malignancy in thyroid nodules. In this way, patients will be spared surgery complications, and apparently more expensive diagnostic workouts will financially compensate each patient and also the healthcare system. In this review we will summarize essential available diagnostic tools for malignant and benignant thyroid nodules, beginning with functional imaging, molecular analysis, and combinations of these two and other future strategies, including AI or NIS targeted gene therapy for thyroid carcinoma diagnosis and treatment as well.

A new magnetic resonance imaging tumour response grading scheme for locally advanced rectal cancer

BACKGROUND

The potential of using magnetic resonance image tumour-regression grading (MRI-TRG) system to predict pathological TRG is debatable for locally advanced rectal cancer treated by neoadjuvant radiochemotherapy.

METHODS

Referring to the American Joint Committee on Cancer/College of American Pathologists (AJCC/CAP) TRG classification scheme, a new four-category MRI-TRG system based on the volumetric analysis of the residual tumour and radiochemotherapy induced anorectal fibrosis was established. The agreement between them was evaluated by Kendall's tau-b test, while Kaplan-Meier analysis was used to calculate survival outcomes.

RESULTS

In total, 1033 patients were included. Good agreement between MRI-TRG and AJCC/CAP TRG classifications was observed (k = 0.671). Particularly, as compared with other pairs, MRI-TRG 0 displayed the highest sensitivity [90.1% (95% CI: 84.3-93.9)] and specificity [92.8% (95% CI: 90.4-94.7)] in identifying AJCC/CAP TRG 0 category patients. Except for the survival ratios that were comparable between the MRI-TRG 0 and MRI-TRG 1 categories, any two of the four categories had distinguished 3-year prognosis (all P < 0.05). Cox regression analysis further proved that the MRI-TRG system was an independent prognostic factor (all P < 0.05).

CONCLUSION

The new MRI-TRG system might be a surrogate for AJCC/CAP TRG classification scheme. Importantly, the system is a reliable and non-invasive way to identify patients with complete pathological responses.

Risk stratification of indeterminate thyroid nodules using ultrasound and machine learning algorithms

BACKGROUND

Indeterminate thyroid nodules (Bethesda III) are challenging to characterize without diagnostic surgery. Auxiliary strategies including molecular analysis, machine learning models, and ultrasound grading with Thyroid Imaging, Reporting and Data System (TI-RADS) can help to triage accordingly, but further refinement is needed to prevent unnecessary surgeries and increase positive predictive values.

DESIGN

Retrospective review of 88 patients with Bethesda III nodules who had diagnostic surgery with final pathological diagnosis.

MEASUREMENTS

Each nodule was retrospectively scored through TI-RADS. Two deep learning models were tested, one previously developed and trained on another data set, mainly containing determinate cases and then validated on our data set while the other one trained and tested on our data set (indeterminate cases).

RESULTS

The mean TI-RADS score was 3 for benign and 4 for malignant nodules (p = .0022). Radiological high risk (TI-RADS 4,5) and low risk (TI-RADS 2,3) categories were established. The PPV for the high radiological risk category in those with >10 mm nodules was 85% (CI: 70%-93%). The NPV for low radiological risk in patients >60 years (mean age was 100% (CI: 83%-100%). The area under the curve (AUC) value of our novel classifier was 0.75 (CI: 0.62-0.84) and differed significantly from the chance-level (p < .00001).

CONCLUSIONS

Novel radiomic and radiologic strategies can be employed to assist with preoperative diagnosis of indeterminate thyroid nodules.

Artificial Intelligence in Head and Neck Imaging

Artificial intelligence (AI) can be applied to head and neck imaging to augment image quality and various clinical tasks including segmentation of tumor volumes, tumor characterization, tumor prognostication and treatment response, and prediction of metastatic lymph node disease. Head and neck oncology care is well positioned for the application of AI since treatment is guided by a wealth of information derived from CT, MRI, and PET imaging data. AI-based methods can integrate complex imaging, histologic, molecular, and clinical data to model tumor biology and behavior, and potentially identify associations, far beyond what conventional qualitative imaging can provide alone.

Cost-Effectiveness of Artificial Intelligence Support in Computed Tomography-Based Lung Cancer Screening

BACKGROUND

Lung cancer screening is already implemented in the USA and strongly recommended by European Radiological and Thoracic societies as well. Upon implementation, the total number of thoracic computed tomographies (CT) is likely to rise significantly. As shown in previous studies, modern artificial intelligence-based algorithms are on-par or even exceed radiologist's performance in lung nodule detection and classification. Therefore, the aim of this study was to evaluate the cost-effectiveness of an AI-based system in the context of baseline lung cancer screening.

METHODS

In this retrospective study, a decision model based on Markov simulation was developed to estimate the quality-adjusted life-years (QALYs) and lifetime costs of the diagnostic modalities. Literature research was performed to determine model input parameters. Model uncertainty and possible costs of the AI-system were assessed using deterministic and probabilistic sensitivity analysis.

RESULTS

In the base case scenario CT + AI resulted in a negative incremental cost-effectiveness ratio (ICER) as compared to CT only, showing lower costs and higher effectiveness. Threshold analysis showed that the ICER remained negative up to a threshold of USD 68 for the AI support. The willingness-to-pay of USD 100,000 was crossed at a value of USD 1240. Deterministic and probabilistic sensitivity analysis showed model robustness for varying input parameters.

CONCLUSION

Based on our results, the use of an AI-based system in the initial low-dose CT scan of lung cancer screening is a feasible diagnostic strategy from a cost-effectiveness perspective.

Radiomic Detection of Malignancy within Thyroid Nodules Using Ultrasonography-A Systematic Review and Meta-Analysis

Background: Despite investigation, 95% of thyroid nodules are ultimately benign. Radiomics is a field that uses radiological features to inform individualized patient care. We aimed to evaluate the diagnostic utility of radiomics in classifying undetermined thyroid nodules into benign and malignant using ultrasonography (US). Methods: A diagnostic test accuracy systematic review and meta-analysis was performed in accordance with PRISMA guidelines. Sensitivity, specificity, and area under curve (AUC) delineating benign and malignant lesions were recorded. Results: Seventy-five studies including 26,373 patients and 46,175 thyroid nodules met inclusion criteria. Males accounted for 24.6% of patients, while 75.4% of patients were female. Radiomics provided a pooled sensitivity of 0.87 (95% CI: 0.86−0.87) and a pooled specificity of 0.84 (95% CI: 0.84−0.85) for characterizing benign and malignant lesions. Using convolutional neural network (CNN) methods, pooled sensitivity was 0.85 (95% CI: 0.84−0.86) and pooled specificity was 0.82 (95% CI: 0.82−0.83); significantly lower than studies using non-CNN: sensitivity 0.90 (95% CI: 0.89−0.90) and specificity 0.88 (95% CI: 0.87−0.89) (p < 0.05). The diagnostic ability of radiologists and radiomics were comparable for both sensitivity (OR 0.98) and specificity (OR 0.95). Conclusions: Radiomic analysis using US provides a reproducible, reliable evaluation of undetermined thyroid nodules when compared to current best practice.

GAN-guided Deformable Attention Network for Identifying Thyroid Nodules in Ultrasound Images

Early detection and identification of malignant thyroid nodules, a vital precursory to the treatment, is a difficult task even for experienced clinicians. Many Computer-Aided Diagnose (CAD) systems have been developed to assist clinicians in performing this task on ultrasonic images. Learning-based CAD systems for thyroid nodules generally accommodate both nodule detection/segmentation and fine-grained classification for its malignancy, and prior researches often treat aforementioned tasks in separate stages, leading to additional computational costs. In this paper, we utilize an online class activation mapping (CAM) mechanism to guide the network to learn discriminative features for identifying thyroid nodules in ultrasound images, called \textit{CAM attention network}. It takes nodule masks as localization cues for direct spatial attention of the classification module, thereby avoiding isolated training for classification. Meanwhile, we propose a deformable convolution module to add offsets to the regular grid sampling locations in the standard convolution, guiding the network to capture more discriminative features of nodule areas. Furthermore, we use a generative adversarial network (GAN) [1] to ensure reliable deformations of nodules from the deformable convolution module. Our proposed CAM attention network has already achieved the 2nd place in the classification task of TN-SCUI 2020, a MICCAI 2020 Challenge with the largest set of thyroid nodule ultrasound images according to our knowledge. The further inclusion of our proposed GAN-guided deformable module allows for capturing more fine-grained features between benign and malignant nodules, and further improves the classification accuracy to a new state-of-the-art level.

Thyroid Cancer Diagnostics Related to Occupational and Environmental Risk Factors: An Integrated Risk Assessment Approach

There are still many questions remaining about the etiopathogenesis of thyroid cancer, the most common type of endocrine neoplasia. Numerous occupational and environmental exposures have been shown to represent important risk factors that increase its incidence. Updated information about thyroid cancer diagnostics related to occupational and environmental risk factors is reviewed here, considering an integrated risk assessment approach; new data concerning thyroid cancer etiology and pathogenesis mechanisms, diagnostic biomarkers and methodologies, and risk factors involved in its pathogenesis are presented. A special emphasis is dedicated to specific occupational risk factors and to the association between environmental risk agents and thyroid cancer development. The occupational environment is taken into consideration, i.e., the current workplace and previous jobs, as well as data regarding risk factors, e.g., age, gender, family history, lifestyle, use of chemicals, or radiation exposure outside the workplace. Finally, an integrative approach is presented, underlying the need for an accurate Risk Assessment Matrix based on a systematic questionnaire. We propose a complex experimental design that contains different inclusion and exclusion criteria for patient groups, detailed working protocols for achieving coherent and sustainable, well-defined research stages from sample collection to the identification of biomarkers, with correlations between specific oncometabolites integrated into the Risk Assessment Matrix.

An artificial intelligence ultrasound system's ability to distinguish benign from malignant follicular-patterned lesions

OBJECTIVES

To evaluate the application value of a generally trained artificial intelligence (AI) automatic diagnosis system in the malignancy diagnosis of follicular-patterned thyroid lesions (FPTL), including follicular thyroid carcinoma (FTC), adenomatoid hyperplasia nodule (AHN) and follicular thyroid adenoma (FTA) and compare the diagnostic performance with radiologists of different experience levels.

METHODS

We retrospectively reviewed 607 patients with 699 thyroid nodules that included 168 malignant nodules by using postoperative pathology as the gold standard, and compared the diagnostic performances of three radiologists (one junior, two senior) and that of AI automatic diagnosis system in malignancy diagnosis of FPTL in terms of sensitivity, specificity and accuracy, respectively. Pairwise t-test was used to evaluate the statistically significant difference.

RESULTS

The accuracy of the AI system in malignancy diagnosis was 0.71, which was higher than the best radiologist in this study by a margin of 0.09 with a p-value of 2.08×10^-5. Two radiologists had higher sensitivity (0.84 and 0.78) than that of the AI system (0.69) at the cost of having much lower specificity (0.35, 0.57 versus 0.71). One senior radiologist showed balanced sensitivity and specificity (0.62 and 0.54) but both were lower than that of the AI system.

CONCLUSIONS

The generally trained AI automatic diagnosis system can potentially assist radiologists for distinguishing FTC from other FPTL cases that share poorly distinguishable ultrasonographical features.

Ultrasound for the Diagnosis of Biliary Atresia: From Conventional Ultrasound to Artificial Intelligence

Biliary atresia is an aggressive liver disease of infancy and can cause death without timely surgical intervention. Early diagnosis of biliary atresia is critical to the recovery of bile drainage and long-term transplant-free survival. Ultrasound is recommended as the initial imaging strategy for the diagnosis of biliary atresia. Numerous ultrasound features have been proved helpful for the diagnosis of biliary atresia. In recent years, with the help of new technologies such as elastography ultrasound, contrast-enhanced ultrasound and artificial intelligence, the diagnostic performance of ultrasound has been significantly improved. In this review, various ultrasound features in the diagnosis of biliary atresia are summarized. A diagnostic decision flow chart for biliary atresia is proposed on the basis of the hybrid technologies, combining conventional ultrasound, elastography and contrast-enhanced ultrasound. In addition, the application of artificial intelligence in the diagnosis of biliary atresia with ultrasound images is also introduced.

Performance of Contrast-Enhanced Ultrasound in Thyroid Nodules: Review of Current State and Future Perspectives

Ultrasound has been established as a baseline imaging technique for thyroid nodules. The main advantage of adding CEUS is the ability to assess the sequence and intensity of vascular perfusion and hemodynamics in the thyroid nodule, thus providing real-time characterization of nodule features, considered a valuable new approach in the determination of benign vs. malignant nodules. Original studies, reviews and six meta-analyses were included in this article. A total of 624 studies were retrieved, and 107 were included in the study. As recognized for thyroid nodule malignancy risk stratification by US, for acceptable accuracy in malignancy a combination of several CEUS parameters should be applied: hypo-enhancement, heterogeneous, peripheral irregular enhancement in combination with internal enhancement patterns, and slow wash-in and wash-out curve lower than in normal thyroid tissue. In contrast, homogeneous, intense enhancement with smooth rim enhancement and "fast-in and slow-out" are indicative of the benignity of the thyroid nodule. Even though overlapping features require standardization, with further research, CEUS may achieve reliable performance in detecting or excluding thyroid cancer. It can also play an operative role in guiding ablation procedures of benign and malignant thyroid nodules and metastatic lymph nodes, and providing accurate follow-up imaging to assess treatment efficacy.

Classification and Diagnosis of Residual Thyroid Tissue in SPECT Images Based on Fine-Tuning Deep Convolutional Neural Network

Patients with thyroid cancer will take a small dose of 131I after undergoing a total thyroidectomy. Single-photon emission computed tomography (SPECT) is used to diagnose whether thyroid tissue remains in the body. However, it is difficult for human eyes to observe the specificity of SPECT images in different categories, and it is difficult for doctors to accurately diagnose the residual thyroid tissue in patients based on SPECT images. At present, the research on the classification of thyroid tissue residues after thyroidectomy is still in a blank state. This paper proposes a ResNet-18 fine-tuning method based on the convolutional neural network model. First, preprocess the SPECT images to improve the image quality and remove background interference. Secondly, use the preprocessed image samples to fine-tune the pretrained ResNet-18 model to obtain better features and finally use the Softmax classifier to diagnose the residual thyroid tissue. The method has been tested on SPECT images of 446 patients collected by local hospital and compared with the widely used lightweight network SqueezeNet model and ShuffleNetV2 model. Due to the small data set, this paper conducted 10 random grouping experiments. Each experiment divided the data set into training set and test set at a ratio of 3:1. The accuracy and sensitivity rates of the model proposed in this paper are 96.69% and 94.75%, which are significantly higher than other models (p < 0.05). The specificity and precision rates are 99.6% and 99.96%, respectively, and there is no significant difference compared with other models. (p > 0.05). The area under the curve of the proposed model, SqueezeNet, and ShuffleNetv2 are 0.988 (95% CI, 0.941-1.000), 0.898 (95% CI, 0.819-0.951) (p = 0.0257), and 0.885 (95% CI, 0.803-0.941) (p = 0.0057) (p < 0.05). We prove that this thyroid tissue residue classification system can be used as a computer-aided diagnosis method to effectively improve the diagnostic accuracy of thyroid tissue residues. While more accurately diagnosing patients with residual thyroid tissue in the body, we try our best to avoid the occurrence of overtreatment, which reflects its potential clinical application value.

Artificial Intelligence in Thyroid Field-A Comprehensive Review

Simple Summary

The incidence of thyroid pathologies has been increasing worldwide. Historically, the detection of thyroid neoplasms relies on medical imaging analysis, depending mainly on the experience of clinicians. The advent of artificial intelligence (AI) techniques led to a remarkable progress in image-recognition tasks. AI represents a powerful tool that may facilitate understanding of thyroid pathologies, but actually, the diagnostic accuracy is uncertain. This article aims to provide an overview of the basic aspects, limitations and open issues of the AI methods applied to thyroid images. Medical experts should be familiar with the workflow of AI techniques in order to avoid misleading outcomes.

Abstract

Artificial intelligence (AI) uses mathematical algorithms to perform tasks that require human cognitive abilities. AI-based methodologies, e.g., machine learning and deep learning, as well as the recently developed research field of radiomics have noticeable potential to transform medical diagnostics. AI-based techniques applied to medical imaging allow to detect biological abnormalities, to diagnostic neoplasms or to predict the response to treatment. Nonetheless, the diagnostic accuracy of these methods is still a matter of debate. In this article, we first illustrate the key concepts and workflow characteristics of machine learning, deep learning and radiomics. We outline considerations regarding data input requirements, differences among these methodologies and their limitations. Subsequently, a concise overview is presented regarding the application of AI methods to the evaluation of thyroid images. We developed a critical discussion concerning limits and open challenges that should be addressed before the translation of AI techniques to the broad clinical use. Clarification of the pitfalls of AI-based techniques results crucial in order to ensure the optimal application for each patient.