1
|
Xu Y, Xu M, Geng Z, Liu J, Meng B. Thyroid nodule classification in ultrasound imaging using deep transfer learning. BMC Cancer 2025; 25:544. [PMID: 40133868 PMCID: PMC11938658 DOI: 10.1186/s12885-025-13917-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Accepted: 03/11/2025] [Indexed: 03/27/2025] Open
Abstract
BACKGROUND The accurate diagnosis of thyroid nodules represents a critical and frequently encountered challenge in clinical practice, necessitating enhanced precision in diagnostic methodologies. In this study, we investigate the predictive efficacy of distinguishing between benign and malignant thyroid nodules by employing traditional machine learning algorithms and a deep transfer learning model, aiming to advance the diagnostic paradigm in this field. METHODS In this retrospective study, ITK-Snap software was utilized for image preprocessing and feature extraction from thyroid nodules. Feature screening and dimensionality reduction were conducted using the least absolute shrinkage and selection operator (LASSO) regression method. To identify the optimal model, both traditional machine learning and transfer learning approaches were employed, followed by model fusion using post-fusion techniques. The performance of the model was rigorously evaluated through the area under the curve (AUC), calibration curve analysis, and decision curve analysis (DCA). RESULTS A total of 1134 images from 630 cases of thyroid nodules were included in this study, comprising 589 benign nodules and 545 malignant nodules. Through comparative analysis, the support vector machine (SVM), which demonstrated the best diagnostic performance among traditional machine learning models, and the Inception V3 convolutional neural network model, based on transfer learning, were selected for model construction. The SVM model achieved an AUC of 0.748 (95% CI: 0.684-0.811) for diagnosing malignant thyroid nodules, while the Inception V3 transfer learning model yielded an AUC of 0.763 (95% CI: 0.702-0.825). Following model fusion, the AUC improved to 0.783 (95% CI: 0.724-0.841). The difference in performance between the fusion model and the traditional machine learning model was statistically significant (p = 0.036). Decision curve analysis (DCA) further confirmed that the fusion model exhibits superior clinical utility, highlighting its potential for practical application in thyroid nodule diagnosis. CONCLUSION Our findings demonstrate that the fusion model, which integrates a convolutional neural network (CNN) with traditional machine learning and deep transfer learning techniques, can effectively differentiate between benign and malignant thyroid nodules through the analysis of ultrasound images. This model fusion approach significantly optimizes and enhances diagnostic performance, offering a robust and intelligent tool for the clinical detection of thyroid diseases.
Collapse
Affiliation(s)
- Yan Xu
- Department of Ultrasound, Zhejiang Rongjun Hospital, No.309 Shuangyuan Road, Jiaxing, 314001, China
| | - Mingmin Xu
- Department of Ultrasound, Zhejiang Rongjun Hospital, No.309 Shuangyuan Road, Jiaxing, 314001, China
| | - Zhe Geng
- Department of Ultrasound, Zhejiang Rongjun Hospital, No.309 Shuangyuan Road, Jiaxing, 314001, China
| | - Jie Liu
- Interventional Cancer Institute of Chinese Integrative Medicine, Putuo Hospital, Shanghai University of Traditional Chinese Medicine, Shanghai, 200062, China.
- Department of Clinical Center, Jiaxing Hospital of Traditional Chinese Medicine, Jiaxing, 314001, China.
| | - Bin Meng
- Department of Ultrasound, Zhejiang Rongjun Hospital, No.309 Shuangyuan Road, Jiaxing, 314001, China.
| |
Collapse
|
2
|
Barzegar-Golmoghani E, Mohebi M, Gohari Z, Aram S, Mohammadzadeh A, Firouznia S, Shakiba M, Naghibi H, Moradian S, Ahmadi M, Almasi K, Issaiy M, Anjomrooz M, Tavangar SM, Javadi S, Bitarafan-Rajabi A, Davoodi M, Sharifian H, Mohammadzadeh M. ELTIRADS framework for thyroid nodule classification integrating elastography, TIRADS, and radiomics with interpretable machine learning. Sci Rep 2025; 15:8763. [PMID: 40082527 PMCID: PMC11906654 DOI: 10.1038/s41598-025-93226-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2024] [Accepted: 03/05/2025] [Indexed: 03/16/2025] Open
Abstract
Early detection of malignant thyroid nodules is crucial for effective treatment, but traditional diagnostic methods face challenges such as variability in expert opinions and limited integration of advanced imaging techniques. This prospective cohort study investigates a novel multimodal approach, integrating traditional methods with advanced machine learning techniques. We studied 181 patients who underwent fine-needle aspiration (FNA) biopsy, each contributing one nodule, resulting in a total of 181 nodules for our analysis. Data collection included sex, age, and ultrasound imaging, which incorporated elastography. Features extracted from these images included Thyroid Imaging Reporting and Data System (TIRADS) scores, elastography parameters, and radiomic features. The pathological results based on the FNA biopsy, provided by the pathologists, served as our gold standard for nodule classification. Our methodology, termed ELTIRADS, combines these features with interpretable machine learning techniques. Performance evaluation showed that a Support Vector Machine (SVM) classifier using TIRADS, elastography data, and radiomic features achieved high accuracy (0.92), with sensitivity (0.89), specificity (0.94), precision (0.89), and F1 score (0.89). To enhance interpretability, we used hierarchical clustering, shapley additive explanations (SHAP), and partial dependence plots (PDP). This combined approach holds promise for enhancing the accuracy of thyroid nodule malignancy detection, thereby contributing to advancements in personalized and precision medicine in the field of thyroid cancer research.
Collapse
Affiliation(s)
| | - Mobin Mohebi
- Department of Biomedical Engineering, Tarbiat Modares University, Tehran, Iran
- Institut de Biologie Valrose (IBV), Université Côte d'Azur, CNRS, Inserm, Nice, France
| | - Zahra Gohari
- Department of Radiology, Tehran University of Medical Science, Tehran, Iran
| | - Sadaf Aram
- Department of Biomedical Engineering, Tarbiat Modares University, Tehran, Iran
| | - Ali Mohammadzadeh
- Department of Radiology, Iran University of Medical Sciences, Tehran, Iran
| | - Sina Firouznia
- Second Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Madjid Shakiba
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Iran
| | - Hamed Naghibi
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Iran
| | - Sadegh Moradian
- Department of Radiology, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Maryam Ahmadi
- Department of Biomedical Engineering, Tarbiat Modares University, Tehran, Iran
| | - Kazhal Almasi
- Department of Biomedical Engineering, Tarbiat Modares University, Tehran, Iran
| | - Mahbod Issaiy
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Iran
| | - Mehran Anjomrooz
- Department of Radiology, Tehran University of Medical Science, Tehran, Iran
| | | | - Sheida Javadi
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Iran
| | - Ahmad Bitarafan-Rajabi
- Rajaie Cardiovascular Medical and Research Institute, Iran University of Medical Sciences, Tehran, Iran
| | - Mohammad Davoodi
- Department of Radiology, Tehran University of Medical Science, Tehran, Iran.
| | - Hashem Sharifian
- Department of Radiology, Tehran University of Medical Science, Tehran, Iran.
| | | |
Collapse
|
3
|
Hosseini Sarkhosh SM, Shirzad N, Taghvaei M, Tavangar SM, Farhat S, Ebrahiminik H, Hemmatabadi M. Prediction of thyroid malignancy risk using clinical and ultrasonography features and a machine learning approach. Eur Radiol 2025:10.1007/s00330-025-11434-2. [PMID: 39948211 DOI: 10.1007/s00330-025-11434-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Revised: 12/17/2024] [Accepted: 01/15/2025] [Indexed: 03/06/2025]
Abstract
OBJECTIVE This study aims to develop and validate a predictive model for thyroid nodule malignancy risks using clinical and ultrasonography features and a machine learning (ML) approach. METHODS This retrospective study is based on the clinical and ultrasound characteristics of 1035 thyroid nodules (845 benign and 190 malignant) to develop and validate the risk prediction model. Employing multiple logistic regression, key features were selected in developing the model. Eight ML algorithms were evaluated for predicting the risks of malignancy. Finally, the predictive ability of the best-performing algorithm was compared against American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) and American Thyroid Association (ATA) guidelines. RESULTS Based on AUC criteria (88.3, 95% CI: 81.2-94.2), sensitivity (84.2, 95% CI: 71.1-94.7), specificity (92.3, 95% CI: 88.2-95.9), positive predictive value, (71.4, 95% CI: 60.4-83.3) and negative predictive value (96.3, 95% CI: 93.5-98.8), the XGBoost algorithm exhibited superior performance over the other ML algorithms and ACR TI-RADS and ATA. These criteria were obtained for ACR TI-RADS at 54.2%, 63.2%, 48.5%, 21.1%, and 84.8%, while for ATA, they were 44.3%, 76.3%, 27.2%, 18.4%, and 81.6%. In addition, the unnecessary fine-needle aspiration (FNA) rate with ACR TI-RADS and ATA was 43% and 63%, respectively-significantly higher than the 7% obtained with XGBoost. CONCLUSIONS This study demonstrated the capability of ML approaches in enhancing the accuracy of predicting thyroid malignancy risks as well as their potential benefits in optimizing healthcare resources by reducing unnecessary FNA rates. Using the proposed model through a web-based tool can facilitate clinical judgments in thyroid nodule management and personalized treatment. KEY POINTS Question Current risk assessment systems have limitations, with high unnecessary FNA rates compared to machine learning (ML) models. Findings The XGBoost algorithm was compared to other ML algorithms, ACR TI-RADS, and ATA and demonstrated superior performance. Clinical relevance This study demonstrated the capability of ML approaches in enhancing the accuracy of predicting thyroid malignancy. The proposed web-based tool to facilitate the prediction of thyroid nodule risk is available at https://aimedlab.ir/tnr .
Collapse
Affiliation(s)
| | - Nooshin Shirzad
- Endocrinology and Metabolism Research Center (EMRC), Vali-Asr Hospital, Tehran University of Medical Sciences, Tehran, Iran
- Endocrinology and Metabolism Research Center, Endocrinology and Metabolism Clinical Sciences Institute, Tehran University of Medical Sciences, Tehran, Iran
| | - Mahdieh Taghvaei
- Endocrinology and Metabolism Research Center (EMRC), Vali-Asr Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyed Mohammad Tavangar
- Department of Pathology, Dr. Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Sara Farhat
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Hojat Ebrahiminik
- Department of Interventional Radiology and Radiation, Sciences Research Center, AJA University of Medical Sciences, Tehran, Iran.
| | - Mahboobeh Hemmatabadi
- Endocrinology and Metabolism Research Center (EMRC), Vali-Asr Hospital, Tehran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
4
|
Ahmad IS, Dai J, Xie Y, Liang X. Deep learning models for CT image classification: a comprehensive literature review. Quant Imaging Med Surg 2025; 15:962-1011. [PMID: 39838987 PMCID: PMC11744119 DOI: 10.21037/qims-24-1400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Accepted: 10/18/2024] [Indexed: 01/23/2025]
Abstract
Background and Objective Computed tomography (CT) imaging plays a crucial role in the early detection and diagnosis of life-threatening diseases, particularly in respiratory illnesses and oncology. The rapid advancement of deep learning (DL) has revolutionized CT image analysis, enhancing diagnostic accuracy and efficiency. This review explores the impact of advanced DL methodologies in CT imaging, with a particular focus on their applications in coronavirus disease 2019 (COVID-19) detection and lung nodule classification. Methods A comprehensive literature search was conducted, examining the evolution of DL architectures in medical imaging from conventional convolutional neural networks (CNNs) to sophisticated foundational models (FMs). We reviewed publications from major databases, focusing on developments in CT image analysis using DL from 2013 to 2023. Our search criteria included all types of articles, with a focus on peer-reviewed research papers and review articles in English. Key Content and Findings The review reveals that DL, particularly advanced architectures like FMs, has transformed CT image analysis by streamlining interpretation processes and enhancing diagnostic capabilities. We found significant advancements in addressing global health challenges, especially during the COVID-19 pandemic, and in ongoing efforts for lung cancer screening. The review also addresses technical challenges in CT image analysis, including data variability, the need for large high-quality datasets, and computational demands. Innovative strategies such as transfer learning, data augmentation, and distributed computing are explored as solutions to these challenges. Conclusions This review underscores the pivotal role of DL in advancing CT image analysis, particularly for COVID-19 and lung nodule detection. The integration of DL models into clinical workflows shows promising potential to enhance diagnostic accuracy and efficiency. However, challenges remain in areas of interpretability, validation, and regulatory compliance. The review advocates for continued research, interdisciplinary collaboration, and ethical considerations as DL technologies become integral to clinical practice. While traditional imaging techniques remain vital, the integration of DL represents a significant advancement in medical diagnostics, with far-reaching implications for future research, clinical practice, and healthcare policy.
Collapse
Affiliation(s)
- Isah Salim Ahmad
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Jingjing Dai
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Yaoqin Xie
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xiaokun Liang
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
5
|
Bandi S, K P R, H S MR. SPGAN Optimized by Piranha Foraging Optimization for Thyroid Nodule Classification in Ultrasound Images. ULTRASONIC IMAGING 2024; 46:342-356. [PMID: 39257166 DOI: 10.1177/01617346241271240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/12/2024]
Abstract
In this research work, Semantic-Preserved Generative Adversarial Network optimized by Piranha Foraging Optimization for Thyroid Nodule Classification in Ultrasound Images (SPGAN-PFO-TNC-UI) is proposed. Initially, ultrasound images are gathered from the DDTI dataset. Then the input image is sent to the pre-processing step. During pre-processing stage, the Multi-Window Savitzky-Golay Filter (MWSGF) is employed to reduce the noise and improve the quality of the ultrasound (US) images. The pre-processed output is supplied to the Generalized Intuitionistic Fuzzy C-Means Clustering (GIFCMC). Here, the ultrasound image's Region of Interest (ROI) is segmented. The segmentation output is supplied to the Fully Numerical Laplace Transform (FNLT) to extract the features, such as geometric features like solidity, orientation, roundness, main axis length, minor axis length, bounding box, convex area, and morphological features, like area, perimeter, aspect ratio, and AP ratio. The Semantic-Preserved Generative Adversarial Network (SPGAN) separates the image as benign or malignant nodules. Generally, SPGAN does not express any optimization adaptation methodologies for determining the best parameters to ensure the accurate classification of thyroid nodules. Therefore, the Piranha Foraging Optimization (PFO) algorithm is proposed to improve the SPGAN classifier and accurately identify the thyroid nodules. The metrics, like F-score, accuracy, error rate, precision, sensitivity, specificity, ROC, computing time is examined. The proposed SPGAN-PFO-TNC-UI method attains 30.54%, 21.30%, 27.40%, and 18.92% higher precision and 26.97%, 20.41%, 15.09%, and 18.27% lower error rate compared with existing techniques, like Thyroid detection and classification using DNN with Hybrid Meta-Heuristic and LSTM (TD-DL-HMH-LSTM), Quantum-Inspired convolutional neural networks for optimized thyroid nodule categorization (QCNN-OTNC), Thyroid nodules classification under Follow the Regularized Leader Optimization based Deep Neural Networks (CTN-FRL-DNN), Automatic classification of ultrasound thyroids images using vision transformers and generative adversarial networks (ACUTI-VT-GAN) respectively.
Collapse
Affiliation(s)
- Siddalingesh Bandi
- Department of Electronics and Communication Engineering, Global academy of Technology, Bengaluru, Karnataka, India
| | - Ravikumar K P
- Department of Electronics and Communication Engineering, JSS Academy of Technical Education, Bengaluru, Karnataka, India
| | - Manjunatha Reddy H S
- Department of Electronics and Communication Engineering, Global academy of Technology, Bengaluru, Karnataka, India
| |
Collapse
|
6
|
Wang Z, Wang X, Wang T, Qiu J, Lu W. Localization and Risk Stratification of Thyroid Nodules in Ultrasound Images Through Deep Learning. ULTRASOUND IN MEDICINE & BIOLOGY 2024; 50:882-887. [PMID: 38494413 DOI: 10.1016/j.ultrasmedbio.2024.02.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 01/03/2024] [Accepted: 02/20/2024] [Indexed: 03/19/2024]
Abstract
OBJECTIVE Deep learning algorithms have commonly been used for the differential diagnosis between benign and malignant thyroid nodules. The aim of the study described here was to develop an integrated system that combines a deep learning model and a clinical standard Thyroid Imaging Reporting and Data System (TI-RADS) for the simultaneous segmentation and risk stratification of thyroid nodules. METHODS Three hundred four ultrasound images from two independent sites with TI-RADS 4 thyroid nodules were collected. The edge connection and Criminisi algorithm were used to remove manually induced markers in ultrasound images. An integrated system based on TI-RADS and a mask region-based convolution neural network (Mask R-CNN) was proposed to stratify subclasses of TI-RADS 4 thyroid nodules and to segment thyroid nodules in the ultrasound images. Accuracy and the precision-recall curve were used to evaluate stratification performance, and the Dice similarity coefficient (DSC) between the segmentation of Mask R-CNN and the radiologist's contour was used to evaluate the segmentation performance of the model. RESULTS The combined approach could significantly enhance the performance of the proposed integrated system. Overall stratification accuracy of TI-RADS 4 thyroid nodules, mean average precision and mean DSC of the proposed model in the independent test set was 90.79%, 0.8579 and 0.83, respectively. Specifically, stratification accuracy values for TI-RADS 4a, 4b and 4c thyroid nodules were 95.83%, 84.21% and 77.78%, respectively. CONCLUSION An integrated system combining TI-RADS and a deep learning model was developed. The system can provide clinicians with not only diagnostic assistance from TI-RADS but also accurate segmentation of thyroid nodules, which improves the applicability of the system in clinical practice.
Collapse
Affiliation(s)
- Zhipeng Wang
- Department of Radiology, Second Affiliated Hospital of Shandong First Medical University, Tai'an, China; School of Radiology, Shandong First Medical University and Shandong Academy of Medical Sciences, Tai'an, China
| | - Xiuzhu Wang
- Department of Obstetrics, Tai'an City Central Hospital, Tai'an, China
| | - Ting Wang
- Department of Ultrasound, Zoucheng Maternity and Child Healthcare Hospital, Jining, China
| | - Jianfeng Qiu
- Department of Radiology, Second Affiliated Hospital of Shandong First Medical University, Tai'an, China; School of Radiology, Shandong First Medical University and Shandong Academy of Medical Sciences, Tai'an, China
| | - Weizhao Lu
- Department of Radiology, Second Affiliated Hospital of Shandong First Medical University, Tai'an, China.
| |
Collapse
|
7
|
Chen JH, Zhang YQ, Zhu TT, Zhang Q, Zhao AX, Huang Y. Applying machine-learning models to differentiate benign and malignant thyroid nodules classified as C-TIRADS 4 based on 2D-ultrasound combined with five contrast-enhanced ultrasound key frames. Front Endocrinol (Lausanne) 2024; 15:1299686. [PMID: 38633756 PMCID: PMC11021584 DOI: 10.3389/fendo.2024.1299686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 03/21/2024] [Indexed: 04/19/2024] Open
Abstract
Objectives To apply machine learning to extract radiomics features from thyroid two-dimensional ultrasound (2D-US) combined with contrast-enhanced ultrasound (CEUS) images to classify and predict benign and malignant thyroid nodules, classified according to the Chinese version of the thyroid imaging reporting and data system (C-TIRADS) as category 4. Materials and methods This retrospective study included 313 pathologically diagnosed thyroid nodules (203 malignant and 110 benign). Two 2D-US images and five CEUS key frames ("2nd second after the arrival time" frame, "time to peak" frame, "2nd second after peak" frame, "first-flash" frame, and "second-flash" frame) were selected to manually label the region of interest using the "Labelme" tool. A total of 7 images of each nodule and their annotates were imported into the Darwin Research Platform for radiomics analysis. The datasets were randomly split into training and test cohorts in a 9:1 ratio. Six classifiers, namely, support vector machine, logistic regression, decision tree, random forest (RF), gradient boosting decision tree and extreme gradient boosting, were used to construct and test the models. Performance was evaluated using a receiver operating characteristic curve analysis. The area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy (ACC), and F1-score were calculated. One junior radiologist and one senior radiologist reviewed the 2D-US image and CEUS videos of each nodule and made a diagnosis. We then compared their AUC and ACC with those of our best model. Results The AUC of the diagnosis of US, CEUS and US combined CEUS by junior radiologist and senior radiologist were 0.755, 0.750, 0.784, 0.800, 0.873, 0.890, respectively. The RF classifier performed better than the other five, with an AUC of 1 for the training cohort and 0.94 (95% confidence interval 0.88-1) for the test cohort. The sensitivity, specificity, accuracy, PPV, NPV, and F1-score of the RF model in the test cohort were 0.82, 0.93, 0.90, 0.85, 0.92, and 0.84, respectively. The RF model with 2D-US combined with CEUS key frames achieved equivalent performance as the senior radiologist (AUC: 0.94 vs. 0.92, P = 0.798; ACC: 0.90 vs. 0.92) and outperformed the junior radiologist (AUC: 0.94 vs. 0.80, P = 0.039, ACC: 0.90 vs. 0.81) in the test cohort. Conclusions Our model, based on 2D-US and CEUS key frames radiomics features, had good diagnostic efficacy for thyroid nodules, which are classified as C-TIRADS 4. It shows promising potential in assisting less experienced junior radiologists.
Collapse
Affiliation(s)
| | | | | | | | | | - Ying Huang
- Department of Ultrasound, Shengjing Hospital of China Medical University, Shenyang, China
| |
Collapse
|
8
|
Wang Y, Yu M, He M, Zhang G, Zhang L, Zhang B. Diagnostic value of a computer-assisted diagnosis system for the ultrasound features in thyroid nodules. ARCHIVES OF ENDOCRINOLOGY AND METABOLISM 2023; 68:e220501. [PMID: 37948567 PMCID: PMC10916796 DOI: 10.20945/2359-4292-2022-0501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Accepted: 03/15/2023] [Indexed: 11/12/2023]
Abstract
Objective To explore the diagnostic value of the TUIAS (SW_TH01/II) computer-aided diagnosis (CAD) software system for the ultrasound Thyroid Imaging Reporting and Data System (TI-RADS) features in thyroid nodules. Materials and methods This retrospective study enrolled patients with thyroid nodules in Shanghai East Hospital between January 2017 and October 2021. The novel CAD software (SW_TH01/II) and three sonographers performed a qualitative analysis of the ultrasound TI-RADS features in aspect ratio, margin irregularity, margin smoothness, calcification, and echogenicity of the thyroid nodules. Results A total of 225 patients were enrolled. The accuracy, sensitivity, and specificity of the CAD software in "aspect ratio" were 95.6%, 96.2%, and 95.4%, in "margin irregularity" were 90.7%, 90.5%, and 90.9%, in "margin smoothness" were 85.8%, 88.5%, and 83.0%, in "calcification" were 83.6%, 81.7%, and 82.0%, in "homogeneity" were 88.9%, 90.6%, and 82.2%, in "major echo" were 85.3%, 88.0%, and 85.4%, and in "contains very hypoechoic echo" were 92.0%, 90.0%, and 92.4%. The analysis time of the CAD software was significantly shorter than for the sonographers (2.7 ± 1.6 vs. 29.7 ± 12.7 s, P < 0.001). Conclusion The CAD system achieved high accuracy in describing thyroid nodule features. It might assist in clinical thyroid nodule analysis.
Collapse
Affiliation(s)
- Yiwei Wang
- Graduate School of Dalian Medical University, Dalian, Liaoning, China,
| | - Ming Yu
- Tend. AI Medical Technology, China
| | | | | | - Libo Zhang
- Shanghai East Hospital, Department of Ultrasound in Medicine, Shanghai, China
| | - Bo Zhang
- Shanghai East Hospital, Tongji University School of Medicine, Department of Ultrasound in Medicine, Shanghai, China
| |
Collapse
|
9
|
Gomes Ataide EJ, Jabaraj MS, Schenke S, Petersen M, Haghghi S, Wuestemann J, Illanes A, Friebe M, Kreissl MC. Thyroid Nodule Detection and Region Estimation in Ultrasound Images: A Comparison between Physicians and an Automated Decision Support System Approach. Diagnostics (Basel) 2023; 13:2873. [PMID: 37761240 PMCID: PMC10529523 DOI: 10.3390/diagnostics13182873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 08/27/2023] [Accepted: 09/05/2023] [Indexed: 09/29/2023] Open
Abstract
BACKGROUND Thyroid nodules are very common. In most cases, they are benign, but they can be malignant in a low percentage of cases. The accurate assessment of these nodules is critical to choosing the next diagnostic steps and potential treatment. Ultrasound (US) imaging, the primary modality for assessing these nodules, can lack objectivity due to varying expertise among physicians. This leads to observer variability, potentially affecting patient outcomes. PURPOSE This study aims to assess the potential of a Decision Support System (DSS) in reducing these variabilities for thyroid nodule detection and region estimation using US images, particularly in lesser experienced physicians. METHODS Three physicians with varying levels of experience evaluated thyroid nodules on US images, focusing on nodule detection and estimating cystic and solid regions. The outcomes were compared to those obtained from a DSS for comparison. Metrics such as classification match percentage and variance percentage were used to quantify differences. RESULTS Notable disparities exist between physician evaluations and the DSS assessments: the overall classification match percentage was just 19.2%. Individually, Physicians 1, 2, and 3 had match percentages of 57.6%, 42.3%, and 46.1% with the DSS, respectively. Variances in assessments highlight the subjectivity and observer variability based on physician experience levels. CONCLUSIONS The evident variability among physician evaluations underscores the need for supplementary decision-making tools. Given its consistency, the CAD offers potential as a reliable "second opinion" tool, minimizing human-induced variabilities in the critical diagnostic process of thyroid nodules using US images. Future integration of such systems could bolster diagnostic precision and improve patient outcomes.
Collapse
Affiliation(s)
- Elmer Jeto Gomes Ataide
- Division of Nuclear Medicine, Department of Radiology and Nuclear Medicine, University Hospital Magdeburg, 39120 Magdeburg, Germany; (S.S.); (M.C.K.)
| | | | - Simone Schenke
- Division of Nuclear Medicine, Department of Radiology and Nuclear Medicine, University Hospital Magdeburg, 39120 Magdeburg, Germany; (S.S.); (M.C.K.)
- Department of Nuclear Medicine, Klinikum Bayreuth, 95445 Bayreuth, Germany
| | - Manuela Petersen
- Department of General, Visceral, Vascular and Transplant Surgery, University Hospital Magdeburg, 39120 Magdeburg, Germany
| | - Sarvar Haghghi
- Division of Nuclear Medicine, Department of Radiology and Nuclear Medicine, University Hospital Magdeburg, 39120 Magdeburg, Germany; (S.S.); (M.C.K.)
- Department of Nuclear Medicine, University Hospital Frankfurt, 60590 Frankfurt, Germany
| | - Jan Wuestemann
- Division of Nuclear Medicine, Department of Radiology and Nuclear Medicine, University Hospital Magdeburg, 39120 Magdeburg, Germany; (S.S.); (M.C.K.)
| | | | - Michael Friebe
- Surag Medical GmbH, 39118 Magdeburg, Germany
- Department of Biocybernetics and Biomedical Engineering, AGH University of Science and Technology, 30-059 Krakow, Poland
- Center for Innovation, Business Development and Entrepreneurship (CIBE), FOM University of Applied Science, 45127 Essen, Germany
| | - Michael C. Kreissl
- Division of Nuclear Medicine, Department of Radiology and Nuclear Medicine, University Hospital Magdeburg, 39120 Magdeburg, Germany; (S.S.); (M.C.K.)
- STIMULATE Research Campus, 39106 Magdeburg, Germany
- Center for Advanced Medical Engineering (CAME), Otto-von-Guericke University Magdeburg, 39106 Magdeburg, Germany
| |
Collapse
|
10
|
Toro-Tobon D, Loor-Torres R, Duran M, Fan JW, Singh Ospina N, Wu Y, Brito JP. Artificial Intelligence in Thyroidology: A Narrative Review of the Current Applications, Associated Challenges, and Future Directions. Thyroid 2023; 33:903-917. [PMID: 37279303 PMCID: PMC10440669 DOI: 10.1089/thy.2023.0132] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Background: The use of artificial intelligence (AI) in health care has grown exponentially with the promise of facilitating biomedical research and enhancing diagnosis, treatment, monitoring, disease prevention, and health care delivery. We aim to examine the current state, limitations, and future directions of AI in thyroidology. Summary: AI has been explored in thyroidology since the 1990s, and currently, there is an increasing interest in applying AI to improve the care of patients with thyroid nodules (TNODs), thyroid cancer, and functional or autoimmune thyroid disease. These applications aim to automate processes, improve the accuracy and consistency of diagnosis, personalize treatment, decrease the burden for health care professionals, improve access to specialized care in areas lacking expertise, deepen the understanding of subtle pathophysiologic patterns, and accelerate the learning curve of less experienced clinicians. There are promising results for many of these applications. Yet, most are in the validation or early clinical evaluation stages. Only a few are currently adopted for risk stratification of TNODs by ultrasound and determination of the malignant nature of indeterminate TNODs by molecular testing. Challenges of the currently available AI applications include the lack of prospective and multicenter validations and utility studies, small and low diversity of training data sets, differences in data sources, lack of explainability, unclear clinical impact, inadequate stakeholder engagement, and inability to use outside of the research setting, which might limit the value of their future adoption. Conclusions: AI has the potential to improve many aspects of thyroidology; however, addressing the limitations affecting the suitability of AI interventions in thyroidology is a prerequisite to ensure that AI provides added value for patients with thyroid disease.
Collapse
Affiliation(s)
- David Toro-Tobon
- Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Ricardo Loor-Torres
- Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Mayra Duran
- Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Jungwei W. Fan
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minnesota, USA
| | - Naykky Singh Ospina
- Division of Endocrinology, Department of Medicine, University of Florida, Gainesville, Florida, USA
| | - Yonghui Wu
- Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, USA
| | - Juan P. Brito
- Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| |
Collapse
|
11
|
Guetari R, Ayari H, Sakly H. Computer-aided diagnosis systems: a comparative study of classical machine learning versus deep learning-based approaches. Knowl Inf Syst 2023; 65:1-41. [PMID: 37361377 PMCID: PMC10205571 DOI: 10.1007/s10115-023-01894-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 04/23/2023] [Accepted: 04/25/2023] [Indexed: 06/28/2023]
Abstract
The diagnostic phase of the treatment process is essential for patient guidance and follow-up. The accuracy and effectiveness of this phase can determine the life or death of a patient. For the same symptoms, different doctors may come up with different diagnoses whose treatments may, instead of curing a patient, be fatal. Machine learning (ML) brings new solutions to healthcare professionals to save time and optimize the appropriate diagnosis. ML is a data analysis method that automates the creation of analytical models and promotes predictive data. There are several ML models and algorithms that rely on features extracted from, for example, a patient's medical images to indicate whether a tumor is benign or malignant. The models differ in the way they operate and the method used to extract the discriminative features of the tumor. In this article, we review different ML models for tumor classification and COVID-19 infection to evaluate the different works. The computer-aided diagnosis (CAD) systems, which we referred to as classical, are based on accurate feature identification, usually performed manually or with other ML techniques that are not involved in classification. The deep learning-based CAD systems automatically perform the identification and extraction of discriminative features. The results show that the two types of DAC have quite close performances but the use of one or the other type depends on the datasets. Indeed, manual feature extraction is necessary when the size of the dataset is small; otherwise, deep learning is used.
Collapse
Affiliation(s)
- Ramzi Guetari
- SERCOM Laboratory, Polytechnic School of Tunisia, University of Carthage, PO Box 743, La Marsa, 2078 Tunisia
| | - Helmi Ayari
- SERCOM Laboratory, Polytechnic School of Tunisia, University of Carthage, PO Box 743, La Marsa, 2078 Tunisia
| | - Houneida Sakly
- RIADI Laboratory, National School of Computer Sciences, University of Manouba, Manouba, 2010 Tunisia
| |
Collapse
|
12
|
Xiang Z, Zhuo Q, Zhao C, Deng X, Zhu T, Wang T, Jiang W, Lei B. Self-supervised multi-modal fusion network for multi-modal thyroid ultrasound image diagnosis. Comput Biol Med 2022; 150:106164. [PMID: 36240597 DOI: 10.1016/j.compbiomed.2022.106164] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 09/11/2022] [Accepted: 10/01/2022] [Indexed: 12/07/2022]
Abstract
Ultrasound is a typical non-invasive diagnostic method often used to detect thyroid cancer lesions. However, due to the limitations of the information provided by ultrasound images, shear wave elastography (SWE) and color doppler ultrasound (CDUS) are also used clinically to assist in diagnosis, which makes the diagnosis time-consuming, labor-intensive, and highly subjective process. Therefore, automatic diagnosis of benign and malignant thyroid nodules is beneficial for the clinical diagnosis of the thyroid. To this end, based on three modalities of gray-scale ultrasound images(US), SWE, and CDUS, we propose a deep learning-based multi-modal feature fusion network for the automatic diagnosis of thyroid disease based on the ultrasound images. First, three ResNet18s initialized by self-supervised learning are used as branches to extract the image information of each modality, respectively. Then, a multi-modal multi-head attention branch is used to remove the common information of three modalities, and the knowledge of each modal is combined for thyroid diagnosis. At the same time, to better integrate the features between modalities, a multi-modal feature guidance module is also proposed to guide the feature extraction of each branch and reduce the difference between each-modal feature. We verify the multi-modal thyroid ultrasound image diagnosis method on the self-collected dataset, and the results prove that this method could provide fast and accurate assistance for sonographers in diagnosing thyroid nodules.
Collapse
Affiliation(s)
- Zhuo Xiang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Centre, Shenzhen University, Shenzhen, China
| | - Qiuluan Zhuo
- Huazhong University of Science and Technology Union Shenzhen Hospital, Department of Ultrasound, China
| | - Cheng Zhao
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Centre, Shenzhen University, Shenzhen, China
| | - Xiaofei Deng
- Huazhong University of Science and Technology Union Shenzhen Hospital, Department of Ultrasound, China
| | - Ting Zhu
- Huazhong University of Science and Technology Union Shenzhen Hospital, Department of Ultrasound, China
| | - Tianfu Wang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Centre, Shenzhen University, Shenzhen, China
| | - Wei Jiang
- Huazhong University of Science and Technology Union Shenzhen Hospital, Department of Ultrasound, China.
| | - Baiying Lei
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Centre, Shenzhen University, Shenzhen, China.
| |
Collapse
|
13
|
Sorrenti S, Dolcetti V, Radzina M, Bellini MI, Frezza F, Munir K, Grani G, Durante C, D’Andrea V, David E, Calò PG, Lori E, Cantisani V. Artificial Intelligence for Thyroid Nodule Characterization: Where Are We Standing? Cancers (Basel) 2022; 14:cancers14143357. [PMID: 35884418 PMCID: PMC9315681 DOI: 10.3390/cancers14143357] [Citation(s) in RCA: 47] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 06/24/2022] [Accepted: 07/08/2022] [Indexed: 12/12/2022] Open
Abstract
Simple Summary In the present review, an up-to-date summary of the state of the art of artificial intelligence (AI) implementation for thyroid nodule characterization and cancer is provided. The opinion on the real effectiveness of AI systems remains controversial. Taking into consideration the largest and most scientifically valid studies, it is possible to state that AI provides results that are comparable or inferior to expert ultrasound specialists and radiologists. Promising data approve AI as a support tool and simultaneously highlight the need for a radiologist supervisory framework for AI provided results. Therefore, current solutions might be more suitable for educational purposes. Abstract Machine learning (ML) is an interdisciplinary sector in the subset of artificial intelligence (AI) that creates systems to set up logical connections using algorithms, and thus offers predictions for complex data analysis. In the present review, an up-to-date summary of the current state of the art regarding ML and AI implementation for thyroid nodule ultrasound characterization and cancer is provided, highlighting controversies over AI application as well as possible benefits of ML, such as, for example, training purposes. There is evidence that AI increases diagnostic accuracy and significantly limits inter-observer variability by using standardized mathematical algorithms. It could also be of aid in practice settings with limited sub-specialty expertise, offering a second opinion by means of radiomics and computer-assisted diagnosis. The introduction of AI represents a revolutionary event in thyroid nodule evaluation, but key issues for further implementation include integration with radiologist expertise, impact on workflow and efficiency, and performance monitoring.
Collapse
Affiliation(s)
- Salvatore Sorrenti
- Department of Surgical Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (S.S.); (V.D.); (E.L.)
| | - Vincenzo Dolcetti
- Department of Radiological, Anatomo-Pathological Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (V.D.); (V.C.)
| | - Maija Radzina
- Radiology Research Laboratory, Riga Stradins University, LV-1007 Riga, Latvia;
- Medical Faculty, University of Latvia, Diagnostic Radiology Institute, Paula Stradina Clinical University Hospital, LV-1007 Riga, Latvia
| | - Maria Irene Bellini
- Department of Surgical Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (S.S.); (V.D.); (E.L.)
- Correspondence:
| | - Fabrizio Frezza
- Department of Information Engineering, Electronics and Telecommunications, “Sapienza” University of Rome, 00184 Rome, Italy; (F.F.); (K.M.)
- Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT), Viale G.P. Usberti 181/A Sede Scientifica di Ingegneria-Palazzina 3, 43124 Parma, Italy
| | - Khushboo Munir
- Department of Information Engineering, Electronics and Telecommunications, “Sapienza” University of Rome, 00184 Rome, Italy; (F.F.); (K.M.)
| | - Giorgio Grani
- Department of Translational and Precision Medicine, “Sapienza” University of Rome, 00161 Rome, Italy; (G.G.); (C.D.); (E.D.)
| | - Cosimo Durante
- Department of Translational and Precision Medicine, “Sapienza” University of Rome, 00161 Rome, Italy; (G.G.); (C.D.); (E.D.)
| | - Vito D’Andrea
- Department of Surgical Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (S.S.); (V.D.); (E.L.)
| | - Emanuele David
- Department of Translational and Precision Medicine, “Sapienza” University of Rome, 00161 Rome, Italy; (G.G.); (C.D.); (E.D.)
| | - Pietro Giorgio Calò
- Department of Surgical Sciences, “Policlinico Universitario Duilio Casula”, University of Cagliari, 09042 Monserrato, Italy;
| | - Eleonora Lori
- Department of Surgical Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (S.S.); (V.D.); (E.L.)
| | - Vito Cantisani
- Department of Radiological, Anatomo-Pathological Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (V.D.); (V.C.)
| |
Collapse
|
14
|
Gruson D, Dabla P, Stankovic S, Homsak E, Gouget B, Bernardini S, Macq B. Artificial intelligence and thyroid disease management: considerations for thyroid function tests. Biochem Med (Zagreb) 2022; 32:020601. [PMID: 35799984 PMCID: PMC9195598 DOI: 10.11613/bm.2022.020601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Accepted: 04/05/2022] [Indexed: 12/07/2022] Open
Abstract
Artificial intelligence (AI) is transforming healthcare and offers new tools in clinical research, personalized medicine, and medical diagnostics. Thyroid function tests represent an important asset for physicians in the diagnosis and monitoring of pathologies. Artificial intelligence tools can clearly assist physicians and specialists in laboratory medicine to optimize test prescription, tests interpretation, decision making, process optimization, and assay design. Our article is reviewing several of these aspects. As thyroid AI models rely on large data sets, which often requires distributed learning from multi-center contributions, this article also briefly discusses this issue.
Collapse
Affiliation(s)
- Damien Gruson
- Department of Clinical Biochemistry, Cliniques Universitaires Saint-Luc, Université catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium
| | - Pradeep Dabla
- Department of Biochemistry, Pant Institute of Postgraduate Medical Education & Research, Delhi, India
| | - Sanja Stankovic
- Center for Medical Biochemistry, University Clinical Center of Serbia, Beograd, Serbia
| | - Evgenija Homsak
- Department for Laboratory Diagnostics, University Clinical Center Maribor, Maribor, Slovenia
| | - Bernard Gouget
- Healthcare Division Committee, Comité Français d’accréditation, Paris, France
| | - Sergio Bernardini
- Department of Experimental Medicine, University of Tor Vergata, Rome, Italy
| | - Benoit Macq
- Institute of Information and Communication Technologies, UCLouvain, Ottignies-Louvain-la-Neuve, Belgium
| |
Collapse
|
15
|
Abstract
Machine learning (ML) methods are pervading an increasing number of fields of application because of their capacity to effectively solve a wide variety of challenging problems. The employment of ML techniques in ultrasound imaging applications started several years ago but the scientific interest in this issue has increased exponentially in the last few years. The present work reviews the most recent (2019 onwards) implementations of machine learning techniques for two of the most popular ultrasound imaging fields, medical diagnostics and non-destructive evaluation. The former, which covers the major part of the review, was analyzed by classifying studies according to the human organ investigated and the methodology (e.g., detection, segmentation, and/or classification) adopted, while for the latter, some solutions to the detection/classification of material defects or particular patterns are reported. Finally, the main merits of machine learning that emerged from the study analysis are summarized and discussed.
Collapse
|
16
|
Cleere EF, Davey MG, O’Neill S, Corbett M, O’Donnell JP, Hacking S, Keogh IJ, Lowery AJ, Kerin MJ. Radiomic Detection of Malignancy within Thyroid Nodules Using Ultrasonography-A Systematic Review and Meta-Analysis. Diagnostics (Basel) 2022; 12:diagnostics12040794. [PMID: 35453841 PMCID: PMC9027085 DOI: 10.3390/diagnostics12040794] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 03/22/2022] [Accepted: 03/22/2022] [Indexed: 02/04/2023] Open
Abstract
Background: Despite investigation, 95% of thyroid nodules are ultimately benign. Radiomics is a field that uses radiological features to inform individualized patient care. We aimed to evaluate the diagnostic utility of radiomics in classifying undetermined thyroid nodules into benign and malignant using ultrasonography (US). Methods: A diagnostic test accuracy systematic review and meta-analysis was performed in accordance with PRISMA guidelines. Sensitivity, specificity, and area under curve (AUC) delineating benign and malignant lesions were recorded. Results: Seventy-five studies including 26,373 patients and 46,175 thyroid nodules met inclusion criteria. Males accounted for 24.6% of patients, while 75.4% of patients were female. Radiomics provided a pooled sensitivity of 0.87 (95% CI: 0.86−0.87) and a pooled specificity of 0.84 (95% CI: 0.84−0.85) for characterizing benign and malignant lesions. Using convolutional neural network (CNN) methods, pooled sensitivity was 0.85 (95% CI: 0.84−0.86) and pooled specificity was 0.82 (95% CI: 0.82−0.83); significantly lower than studies using non-CNN: sensitivity 0.90 (95% CI: 0.89−0.90) and specificity 0.88 (95% CI: 0.87−0.89) (p < 0.05). The diagnostic ability of radiologists and radiomics were comparable for both sensitivity (OR 0.98) and specificity (OR 0.95). Conclusions: Radiomic analysis using US provides a reproducible, reliable evaluation of undetermined thyroid nodules when compared to current best practice.
Collapse
Affiliation(s)
- Eoin F. Cleere
- The Lambe Institute for Translational Research, National University of Ireland, H91 YR71 Galway, Ireland; (M.G.D.); (A.J.L.); (M.J.K.)
- Department of Otolaryngology, Galway University Hospitals, H91 YR71 Galway, Ireland; (M.C.); (I.J.K.)
- Correspondence:
| | - Matthew G. Davey
- The Lambe Institute for Translational Research, National University of Ireland, H91 YR71 Galway, Ireland; (M.G.D.); (A.J.L.); (M.J.K.)
| | - Shane O’Neill
- Department of Breast and Endocrine Surgery, Galway University Hospitals, H91 YR71 Galway, Ireland;
| | - Mel Corbett
- Department of Otolaryngology, Galway University Hospitals, H91 YR71 Galway, Ireland; (M.C.); (I.J.K.)
| | - John P O’Donnell
- Department of Radiology, Galway University Hospitals, H91 YR71 Galway, Ireland;
| | - Sean Hacking
- Department of Pathology and Laboratory Medicine, Warren Alpert Medical School of Brown University, Providence, RI 02903, USA;
| | - Ivan J. Keogh
- Department of Otolaryngology, Galway University Hospitals, H91 YR71 Galway, Ireland; (M.C.); (I.J.K.)
| | - Aoife J. Lowery
- The Lambe Institute for Translational Research, National University of Ireland, H91 YR71 Galway, Ireland; (M.G.D.); (A.J.L.); (M.J.K.)
- Department of Breast and Endocrine Surgery, Galway University Hospitals, H91 YR71 Galway, Ireland;
| | - Michael J. Kerin
- The Lambe Institute for Translational Research, National University of Ireland, H91 YR71 Galway, Ireland; (M.G.D.); (A.J.L.); (M.J.K.)
- Department of Breast and Endocrine Surgery, Galway University Hospitals, H91 YR71 Galway, Ireland;
| |
Collapse
|
17
|
Diagnosis of Thyroid Nodules Based on Image Enhancement and Deep Neural Networks. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5582029. [PMID: 35211165 PMCID: PMC8863471 DOI: 10.1155/2022/5582029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Accepted: 01/24/2022] [Indexed: 12/07/2022]
Abstract
The diagnosis of thyroid nodules at an early stage is a challenging task. Manual diagnosis of thyroid nodules is labor-intensive and time-consuming. Meanwhile, due to the difference of instruments and technical personnel, the original thyroid nodule ultrasound images collected are very different. In order to make better use of ultrasound image information of thyroid nodules, some image processing methods are indispensable. In this paper, we developed a method for automatic thyroid nodule classification based on image enhancement and deep neural networks. The selected image enhancement method is histogram equalization, and the neural networks have four-layer network nodes in our experiments. The dataset in this paper consists of thyroid nodule images of 508 patients. The data are divided into 80% training and 20% validation sets. A comparison result demonstrates that our method can achieve a better performance than other normal machine learning methods. The experimental results show that our method has achieved 0.901961 accuracy, 0.894737 precision, 1 recall, and 0.944444 F1-score. At the same time, we also considered the influence of network structure, activation function of network nodes, number of training iterations, and other factors on the classification results. The experimental results show that the optimal network structure is 2500-40-2-1, the optimal activation function is logistic function, and the best number of training iterations is 500.
Collapse
|
18
|
Song R, Zhu C, Zhang L, Zhang T, Luo Y, Liu J, Yang J. Dual-branch network via pseudo-label training for thyroid nodule detection in ultrasound image. APPL INTELL 2022. [DOI: 10.1007/s10489-021-02967-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
19
|
Zhao D, Jing Y, Lin X, Zhang B. The value of color Doppler ultrasound in the diagnosis of thyroid nodules: a systematic review and meta-analysis. Gland Surg 2021; 10:3369-3377. [PMID: 35070897 PMCID: PMC8749106 DOI: 10.21037/gs-21-752] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Accepted: 12/10/2021] [Indexed: 10/13/2023]
Abstract
BACKGROUND This study aimed to analyze the value of color Doppler ultrasound in the diagnosis of thyroid nodules. METHODS We searched the PubMed, Web of Science, Embase, and Cochrane Library databases for randomized controlled trials (RCTs) on using color Doppler ultrasound, thyroid nodules, thyroid tumors, and Doppler ultrasound to diagnose the thyroid nodules. The outcome indicators in the articles had to include the numbers of true positives (TP), false positives (FP), false negatives (FN), and true negatives (TN). Subsequently, the Jadad tool was adopted to evaluate the quality of the included articles, and Review Manager 5.3 software was used to conduct a meta-analysis of the experimental data. RESULTS A total of eight suitable articles were selected. The results showed that the estimated sensitivity and specificity of color Doppler ultrasound for the diagnostic of thyroid nodules were 0.46-0.89 and 0.00-1.00, respectively. The pooled estimate of sensitivity for the different articles was 0.71 [95% confidence interval (CI): 0.46-0.89], and the pooled estimate of specificity was 0.77 (95% CI: 0.00-1.00). The area under the summary receiver operating characteristic (SROC) curve (AUC) was 0.917, which was larger than 0.9, signifying high diagnostic accuracy. This suggests that color doppler ultrasound can realize the clinical diagnosis of thyroid nodules. DISCUSSION In summary, the results of this study could provide a clinical data for the promotion and application of color Doppler ultrasound in the clinical diagnosis of thyroid nodules, as well as further reliable data for follow-up clinical research on the diagnosis and treatment of thyroid nodules.
Collapse
Affiliation(s)
- Danbo Zhao
- Ultrasonic Image Center, The First People’s Hospital of Wenling, Wenling, China
| | - Yi Jing
- Ultrasonic Image Center, The First People’s Hospital of Wenling, Wenling, China
| | - Xiaoyi Lin
- Ultrasonography Lab, Taizhou Central Hospital (Taizhou University Hospital), Taizhou, China
| | - Bixia Zhang
- Ultrasonic Image Center, The First People’s Hospital of Wenling, Wenling, China
| |
Collapse
|
20
|
Vadhiraj VV, Simpkin A, O’Connell J, Singh Ospina N, Maraka S, O’Keeffe DT. Ultrasound Image Classification of Thyroid Nodules Using Machine Learning Techniques. MEDICINA (KAUNAS, LITHUANIA) 2021; 57:527. [PMID: 34074037 PMCID: PMC8225215 DOI: 10.3390/medicina57060527] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 05/10/2021] [Accepted: 05/18/2021] [Indexed: 02/07/2023]
Abstract
Background and Objectives: Thyroid nodules are lumps of solid or liquid-filled tumors that form inside the thyroid gland, which can be malignant or benign. Our aim was to test whether the described features of the Thyroid Imaging Reporting and Data System (TI-RADS) could improve radiologists' decision making when integrated into a computer system. In this study, we developed a computer-aided diagnosis system integrated into multiple-instance learning (MIL) that would focus on benign-malignant classification. Data were available from the Universidad Nacional de Colombia. Materials and Methods: There were 99 cases (33 Benign and 66 malignant). In this study, the median filter and image binarization were used for image pre-processing and segmentation. The grey level co-occurrence matrix (GLCM) was used to extract seven ultrasound image features. These data were divided into 87% training and 13% validation sets. We compared the support vector machine (SVM) and artificial neural network (ANN) classification algorithms based on their accuracy score, sensitivity, and specificity. The outcome measure was whether the thyroid nodule was benign or malignant. We also developed a graphic user interface (GUI) to display the image features that would help radiologists with decision making. Results: ANN and SVM achieved an accuracy of 75% and 96% respectively. SVM outperformed all the other models on all performance metrics, achieving higher accuracy, sensitivity, and specificity score. Conclusions: Our study suggests promising results from MIL in thyroid cancer detection. Further testing with external data is required before our classification model can be employed in practice.
Collapse
Affiliation(s)
- Vijay Vyas Vadhiraj
- School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland; (J.O.); (D.T.O.)
- Health Innovation Via Engineering Laboratory, Cúram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland
| | - Andrew Simpkin
- School of Mathematics, Statistics and Applied Maths, National University of Ireland, H91 TK33 Galway, Ireland;
| | - James O’Connell
- School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland; (J.O.); (D.T.O.)
- Health Innovation Via Engineering Laboratory, Cúram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland
| | - Naykky Singh Ospina
- Division of Endocrinology, Department of Medicine, University of Florida, Gainesville, FL 3210, USA;
| | - Spyridoula Maraka
- Division of Endocrinology and Metabolism, University of Arkansas for Medical Sciences, Little Rock, AR 72205, USA;
- Medicine Section, Central Arkansas Veterans Healthcare System, Little Rock, AR 72205, USA
| | - Derek T. O’Keeffe
- School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland; (J.O.); (D.T.O.)
- Health Innovation Via Engineering Laboratory, Cúram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland
- Lero, SFI Centre for Software Research, National University of Ireland Galway, H91 TK33 Galway, Ireland
| |
Collapse
|