1
|
Tai HC, Chen KY, Wu MH, Chang KJ, Chen CN, Chen A. Assessing Detection Accuracy of Computerized Sonographic Features and Computer-Assisted Reading Performance in Differentiating Thyroid Cancers. Biomedicines 2022; 10:biomedicines10071513. [PMID: 35884818 PMCID: PMC9313277 DOI: 10.3390/biomedicines10071513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Revised: 06/20/2022] [Accepted: 06/24/2022] [Indexed: 11/16/2022] Open
Abstract
For ultrasound imaging of thyroid nodules, medical guidelines are all based on findings of sonographic features to provide clinicians management recommendations. Due to the recent development of artificial intelligence and machine learning (AI/ML) technologies, there have been computer-assisted detection (CAD) software devices available for clinical use to detect and quantify the sonographic features of thyroid nodules. This study is to validate the accuracy of the computerized sonographic features (CSF) by a CAD software device, namely, AmCAD-UT, and then to assess how the reading performance of clinicians (readers) can be improved providing the computerized features. The feature detection accuracy is tested against the ground truth established by a panel of thyroid specialists and a multiple-reader multiple-case (MRMC) study is performed to assess the sequential reading performance with the assistance of the CSF. Five computerized features, including anechoic area, hyperechoic foci, hypoechoic pattern, heterogeneous texture, and indistinct margin, were tested, with AUCs ranging from 0.888~0.946, 0.825~0.913, 0.812~0.847, 0.627~0.77, and 0.676~0.766, respectively. With the five CSFs, the sequential reading performance of 18 clinicians is found significantly improved, with the AUC increasing from 0.720 without CSF to 0.776 with CSF. Our studies show that the computerized features are consistent with the clinicians’ findings and provide additional value in assisting sonographic diagnosis.
Collapse
Affiliation(s)
- Hao-Chih Tai
- Department of Surgery, National Taiwan University Hospital and College of Medicine, Taipei 100225, Taiwan; (H.-C.T.); (K.-Y.C.); (M.-H.W.); (K.-J.C.)
| | - Kuen-Yuan Chen
- Department of Surgery, National Taiwan University Hospital and College of Medicine, Taipei 100225, Taiwan; (H.-C.T.); (K.-Y.C.); (M.-H.W.); (K.-J.C.)
| | - Ming-Hsun Wu
- Department of Surgery, National Taiwan University Hospital and College of Medicine, Taipei 100225, Taiwan; (H.-C.T.); (K.-Y.C.); (M.-H.W.); (K.-J.C.)
| | - King-Jen Chang
- Department of Surgery, National Taiwan University Hospital and College of Medicine, Taipei 100225, Taiwan; (H.-C.T.); (K.-Y.C.); (M.-H.W.); (K.-J.C.)
| | - Chiung-Nien Chen
- Department of Surgery, National Taiwan University Hospital and College of Medicine, Taipei 100225, Taiwan; (H.-C.T.); (K.-Y.C.); (M.-H.W.); (K.-J.C.)
- Correspondence: (C.-N.C.); (A.C.)
| | - Argon Chen
- Graduate Institute of Industrial Engineering, National Taiwan University, Taipei 106216, Taiwan
- Correspondence: (C.-N.C.); (A.C.)
| |
Collapse
|
2
|
Liang X, Huang Y, Cai Y, Liao J, Chen Z. A Computer-Aided Diagnosis System and Thyroid Imaging Reporting and Data System for Dual Validation of Ultrasound-Guided Fine-Needle Aspiration of Indeterminate Thyroid Nodules. Front Oncol 2021; 11:611436. [PMID: 34692466 PMCID: PMC8529148 DOI: 10.3389/fonc.2021.611436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Accepted: 09/16/2021] [Indexed: 12/02/2022] Open
Abstract
Purpose The fully automatic AI-Sonic computer-aided design (CAD) system was employed for the detection and diagnosis of benign and malignant thyroid nodules. The aim of this study was to investigate the efficiency of the AI-Sonic CAD system with the use of a deep learning algorithm to improve the diagnostic accuracy of ultrasound-guided fine-needle aspiration (FNA). Methods A total of 138 thyroid nodules were collected from 124 patients and diagnosed by an expert, a novice, and the Thyroid Imaging Reporting and Data System (TI-RADS). Diagnostic efficiency and feasibility were compared among the expert, novice, and CAD system. The application of the CAD system to enhance the diagnostic efficiency of novices was assessed. Moreover, with the experience of the expert as the gold standard, the values of features detected by the CAD system were also analyzed. The efficiency of FNA was compared among the expert, novice, and CAD system to determine whether the CAD system is helpful for the management of FNA. Result In total, 56 malignant and 82 benign thyroid nodules were collected from the 124 patients (mean age, 46.4 ± 12.1 years; range, 12–70 years). The diagnostic area under the curve of the CAD system, expert, and novice were 0.919, 0.891, and 0.877, respectively (p < 0.05). In regard to feature detection, there was no significant differences in the margin and composition between the benign and malignant nodules (p > 0.05), while echogenicity and the existence of echogenic foci were of great significance (p < 0.05). For the recommendation of FNA, the results showed that the CAD system had better performance than the expert and novice (p < 0.05). Conclusions Precise diagnosis and recommendation of FNA are continuing hot topics for thyroid nodules. The CAD system based on deep learning had better accuracy and feasibility for the diagnosis of thyroid nodules, and was useful to avoid unnecessary FNA. The CAD system is potentially an effective auxiliary approach for diagnosis and asymptomatic screening, especially in developing areas.
Collapse
Affiliation(s)
- Xiaowen Liang
- Department of Ultrasound Medicine, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Yingmin Huang
- Department of Ultrasound Medicine, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Yongyi Cai
- Department of Ultrasound, Liwan Center Hospital of Guangzhou, Guangzhou, China
| | - Jianyi Liao
- Department of Ultrasound Medicine, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Zhiyi Chen
- Department of Ultrasound Medicine, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.,The First Affiliated Hospital, Medical Imaging Centre, Hengyang Medical School, University of South China, Hengyang, China
| |
Collapse
|
3
|
Wu MH, Chen KY, Chen A, Chen CN. Differences in the ultrasonographic appearance of thyroid nodules after radiofrequency ablation. Clin Endocrinol (Oxf) 2021; 95:489-497. [PMID: 33938024 DOI: 10.1111/cen.14480] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Revised: 04/03/2021] [Accepted: 04/05/2021] [Indexed: 01/07/2023]
Abstract
CONTEXT Radiofrequency ablation (RFA) is a well-tolerated approach to treating benign thyroid nodules (TNs), but no index can predict its success. Other than size decrease, little is known about TN appearance on ultrasonography (US) after RFA. OBJECTIVE This study aimed to (a) assess the effectiveness of single-session RFA treatment, (b) determine whether pre-ablation US characteristics correlate with its effectiveness, and (c) demonstrate TN characteristics on baseline and follow-up US. DESIGN Retrospective cohort study among the patients who underwent single-session RFA for the treatment of benign TNs at a referral medical center between January 2018 and April 2019. PATIENTS A total of 116 patients (137 nodules) were included in the study. MEASUREMENTS Characteristics were quantified using commercial software. TNs were classified into 2015 American Thyroid Association (ATA) sonographic patterns and American College of Radiology Thyroid Imaging Reporting and Data System (ACR-TI-RADS) categories. RESULTS The average volume reduction ratio (VRR) was 74.51% in 1 year (95% confidence interval, 70.63%-78.39%). The only pre-ablation US feature significantly different between nodules with VRR <50% and VRR >50% was the cyst composition (0.05 vs. 0.02, p-value = .02). The VRR and margin change in the first 3 months after ablation were found to be leading indicators significantly correlated to the VRR in 6 months with correlation coefficients (r) = .72 and -.28 (p-value < .0001 and = .0008) and VRR in 1 year with r = .65 and -.17 (p-value < .0001 and = .046), respectively. After RFA, more TNs became ATA high suspicion (2.9% vs. 19.7%, p < .0001) and more appeared to be the non-ATA patterns (12.4% vs. 23.4%, p < .0001). Also, a greater number of post-RFA TNs were classified as ACR-TI-RADS categories 4 and 5 (40.1% vs. 70.1%, p < .0001). CONCLUSIONS Radiofrequency ablation therapy is effective for treating TNs. Pre-ablation cyst components, 3-month post-ablation volume reduction and margin change of TNs were related to the 6-month and 1-year response. Clinicians should consider that TNs would appear peculiar on US after RFA, mistakenly suggesting malignant potential.
Collapse
Affiliation(s)
- Ming-Hsun Wu
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Kuen-Yuan Chen
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Argon Chen
- Graduate Institute of Industrial Engineering, National Taiwan University, Taipei, Taiwan
| | - Chiung-Nien Chen
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| |
Collapse
|
4
|
Wu MH, Chen KY, Chen A, Chen CN. Software-Based Analysis of the Taller-Than-Wide Feature of High-Risk Thyroid Nodules. Ann Surg Oncol 2021; 28:4347-4357. [PMID: 33393024 DOI: 10.1245/s10434-020-09463-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Accepted: 11/25/2020] [Indexed: 12/13/2022]
Abstract
BACKGROUND Shape is one of the most important features in the diagnosis of malignant thyroid nodules. This characteristic has been described qualitatively, but only shapes that appear markedly different can be easily differentiated at first interpretation. This study sought to clarify whether software-based shape indexes are useful for the detection of thyroid cancers. METHODS In the final analysis, 200 participants with 231 pathologically proven nodules participated in the study. Ultrasound features were assessed by clinicians. The tumor contour was auto-defined, and shape indexes were calculated using commercial software. RESULTS Of the 231 nodules, 134 were benign and 97 were malignant. The presence of taller-than-wide (TTW) dimensions differed significantly between the benign and malignant thyroid tumors. Designation of TTW assessed by the software had a higher kappa value and proportional agreement than TTW assessed by clinicians. Disagreement between the clinician and software in designating nodules as TTW occurred for 28 nodules. The presence of other ultrasonic characteristics and small differences in the height and width measurements were causes for the incorrect interpretation of the TTW feature. CONCLUSION The proposed software-based quantitative analysis of tumor shape seems to be promising as an important advance compared with conventional TTW features evaluated by operators because it allows for a more reliable and consistent distinction and is less influenced by other ultrasonic features.
Collapse
Affiliation(s)
- Ming-Hsun Wu
- Department of Surgery, National Taiwan University Hospital, No. 7, Chun Shan South Road, Taipei, Taiwan
| | - Kuen-Yuan Chen
- Department of Surgery, National Taiwan University Hospital, No. 7, Chun Shan South Road, Taipei, Taiwan
| | - Argon Chen
- Graduate Institute of Industrial Engineering, National Taiwan University, Taipei, Taiwan.
| | - Chiung-Nien Chen
- Department of Surgery, National Taiwan University Hospital, No. 7, Chun Shan South Road, Taipei, Taiwan.
| |
Collapse
|
5
|
Wu MH, Chen KY, Hsieh MS, Chen A, Chen CN. Risk Stratification in Patients With Follicular Neoplasm on Cytology: Use of Quantitative Characteristics and Sonographic Patterns. Front Endocrinol (Lausanne) 2021; 12:614630. [PMID: 33995270 PMCID: PMC8120278 DOI: 10.3389/fendo.2021.614630] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Accepted: 03/22/2021] [Indexed: 12/15/2022] Open
Abstract
OBJECTIVES Differentiating thyroid nodules with a cytological diagnosis of follicular neoplasm remains an issue. The goal of this study was to determine whether ultrasonographic (US) findings obtained preoperatively from the computer-aided detection (CAD) system are sufficient to further stratify the risk of malignancy for this diagnostic cytological category. METHODS From September 2016 to September 2018 in our hospital, patients diagnosed with Bethesda category IV (follicular neoplasm or suspicion of follicular neoplasm) thyroid nodules and underwent surgical excisions were include in the study. Quantification and analysis of tumor features were performed using CAD software. The US findings of the region of interest, including index of composition, margin, echogenicity, texture, echogenic dots indicative of calcifications, tall and wide orientation, and margin were calculated into computerized values. The nodules were further classified into American Thyroid Association (ATA) and American College of Radiology Thyroid Imaging Reporting & Data System (TI-RADS) categories. RESULTS 92 (10.1%) of 913 patients were diagnosed with Bethesda category IV thyroid nodules. In 65 patients, the histological type of the nodule was identified. The quantitative features between patients with benign and malignant conditions differed significantly. The presence of heterogeneous echotexture, blurred margins, or irregular margins was shown to have the highest diagnostic value. The risks of malignancy for nodules classified as having very low to intermediate suspicion ATA, non-ATA, and high suspicion ATA patterns were 9%, 35.7%, and 51.7%, respectively. Meanwhile, the risks of malignancy were 12.5%, 26.1%, and 53.8% for nodules classified as TIRADS 3, 4, and 5, respectively. When compared to human observers, among whom poor agreement was noticeable, the CAD software has shown a higher average accuracy. CONCLUSIONS For patients with nodules diagnosed as Bethesda category IV, the software-based characterizations of US features, along with the associated ATA patterns and TIRADS system, were shown helpful in the risk stratification of malignancy.
Collapse
Affiliation(s)
- Ming-Hsun Wu
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Kuen-Yuan Chen
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Min-Shu Hsieh
- Department of Pathology, National Taiwan University Hospital, Taipei, Taiwan
| | - Argon Chen
- Graduate Institute of Industrial Engineering, National Taiwan University, Taipei, Taiwan
- *Correspondence: Argon Chen,
| | - Chiung-Nien Chen
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| |
Collapse
|
6
|
Ye FY, Lyu GR, Li SQ, You JH, Wang KJ, Cai ML, Su QC. Diagnostic Performance of Ultrasound Computer-Aided Diagnosis Software Compared with That of Radiologists with Different Levels of Expertise for Thyroid Malignancy: A Multicenter Prospective Study. ULTRASOUND IN MEDICINE & BIOLOGY 2021; 47:114-124. [PMID: 33239154 DOI: 10.1016/j.ultrasmedbio.2020.09.019] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Revised: 09/19/2020] [Accepted: 09/22/2020] [Indexed: 06/11/2023]
Abstract
The aim of the work described here was to evaluate the diagnostic performance of ultrasound thyroid computer-aided diagnosis (CAD) software. This multicenter prospective study included 494 patients (565 thyroid nodules) who underwent surgery or biopsy after ultrasonography at four hospitals from January 2019 to September 2019. The diagnostic performance metrics of different readers were calculated and compared with the pathologic results. The sensitivity of CAD was outstanding and was equivalent to that of a senior radiologist (90.51% vs. 88.47%, p > 0.05). The area under the curve of CAD was equivalent to that of a junior radiologist (0.748 vs. 0.739, p > 0.05). However, the specificity was only 49.63%, which was lower than those of the three radiologists (75.56%, 85.93% and 90.37% for the junior, intermediate and senior radiologists, respectively). The diagnostic performance of the junior radiologist was significantly improved with the aid of CAD (junior + CAD). The sensitivity and area under the curve of junior + CAD were improved from 72.20% to 89.93% and from 0.739 to 0.816, respectively (both p values <0.05), and the positive predictive value, negative predictive value and κ coefficient improved from 76.3% to 78.6%, 82.0% to 86.8% and 0.394 to 0.511, respectively. Though specificity slightly decreased from 75.56% to 73.33%, the difference was not statistically significant (p > 0.05). In general, the clinical application value of CAD is promising, and its instrumental value for junior radiologists is significant.
Collapse
Affiliation(s)
- Feng-Ying Ye
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Guo-Rong Lyu
- Department of Clinical Medicine, Quanzhou Medical College, Quanzhou, China.
| | - Shang-Qing Li
- Department of Clinical Medicine, Quanzhou Medical College, Quanzhou, China
| | - Jian-Hong You
- Department of Ultrasound, Zhongshan Hospital Affiliated to Xiamen University, Xiamen, China
| | - Kang-Jian Wang
- Department of Ultrasound, Zhangzhou Affiliated Hospital of Fujian Medical University, Zhangzhou, China
| | - Ming-Li Cai
- Department of Ultrasound, Jinjiang City Hospital, Jinjiang, China
| | - Qi-Chen Su
- Department of Ultrasound, Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| |
Collapse
|
7
|
Mao Y, Zhang F, He L, Luo F, Li L, Huo Y, Kang Z. Added value of circulating miRNA expression profiling to sonographic TI-RADS classification in the diagnosis of thyroid nodules. Exp Ther Med 2020; 20:1589-1595. [PMID: 32765676 PMCID: PMC7388447 DOI: 10.3892/etm.2020.8870] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Accepted: 02/12/2020] [Indexed: 11/05/2022] Open
Abstract
Potential use of sonographic TI-RADS classification combined with circulating miRNA expression profiling in the diagnosis of thyroid nodules was explored. Retrospective analysis was performed on clinical data of 121 patients with thyroid nodules. The biopsy specimens of patients obtained through ultrasound-guided aspiration and blood specimens were evaluated in Zhengzhou Central Hospital Affiliated to Zhengzhou University from June 2018 to June 2019. In addition, the blood specimen test results of 121 healthy volunteers (control group) who underwent physical examination were retrospectively analyzed. Results of sonographic TI-RADS classification and circulating miRNA expression profiling were compared with the pathological results. Of the 212 nodules, 2 fell into TI-RADS category 2 and were diagnosed as benign. Malignant nodules accounted for 4.35, 37.14, 84.78, 93.33 and 96.77% of those nodules that fell into TI-RADS categories 3, 4a, 4b, 4c and 5, respectively. Of the 121 patients, 92.55% had with nodular goiter, 3.31% had inflammatory nodules, 2.48% toxic nodular goiter, 0.83% thyroid cysts and 0.83% thyroid tumors. A nodule that fell into a higher TI-RADS classification category had a higher risk of malignancy. The expression levels of miRNA146b, miRNA187, miRNA375, miRNA-222-3p and miRNA-151a-5p were higher, while the level of miRNA138 was lower, in patients with either benign or malignant thyroid nodules compaed to those in the control group. The expression levels of miRNA146b, miRNA187, miRNA375, miRNA-222-3p and miRNA-151a-5p were higher, while the level of miRNA138 was lower, in patients with malignant thyroid nodules than those in patients with benign thyroid nodule (P<0.05). The AUC of the combined diagnostic method was 0.973, which was significantly different from the AUCs of the individual diagnostic method (P<0.05). In conclusion, sonographic TI-RADS classification combined with circulating miRNA expression profiling can improve the diagnosis of thyroid nodules.
Collapse
Affiliation(s)
- Yu Mao
- Department of Endocrinology, Zhengzhou Central Hospital Affiliated to Zhengzhou University, Zhengzhou, Henan 450007, P.R. China
| | - Fengjiao Zhang
- Department of Endocrinology, Zhengzhou Central Hospital Affiliated to Zhengzhou University, Zhengzhou, Henan 450007, P.R. China
| | - Li He
- Department of Endocrinology, Zhengzhou Central Hospital Affiliated to Zhengzhou University, Zhengzhou, Henan 450007, P.R. China
| | - Fang Luo
- Department of Endocrinology, Zhengzhou Central Hospital Affiliated to Zhengzhou University, Zhengzhou, Henan 450007, P.R. China
| | - Lei Li
- Department of Endocrinology, Zhengzhou Central Hospital Affiliated to Zhengzhou University, Zhengzhou, Henan 450007, P.R. China
| | - Yajie Huo
- Department of Endocrinology, Zhengzhou Central Hospital Affiliated to Zhengzhou University, Zhengzhou, Henan 450007, P.R. China
| | - Zhiqiang Kang
- Department of Endocrinology, Zhengzhou Central Hospital Affiliated to Zhengzhou University, Zhengzhou, Henan 450007, P.R. China
| |
Collapse
|
8
|
Chen Y, Jiang J, Shi J, Chang W, Shi J, Chen M, Zhang Q. Dual-mode ultrasound radiomics and intrinsic imaging phenotypes for diagnosis of lymph node lesions. ANNALS OF TRANSLATIONAL MEDICINE 2020; 8:742. [PMID: 32647667 PMCID: PMC7333147 DOI: 10.21037/atm-19-4630] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Background The ultrasonic diagnosis of lymph node lesions is usually based on a small number of subjective visual features from a single ultrasonic modality, which limits diagnostic accuracy. Therefore, our study aimed to propose a computerized method for using dual-mode ultrasound radiomics and the intrinsic imaging phenotypes for accurately differentiating benign, lymphomatous, and metastatic lymph nodes. Methods A total of 543 lymph nodes from 538 patients were examined with both B-mode ultrasonography and elastography. The data set was randomly divided into a training set of 407 nodes and a validation set of 136 nodes. First, we extracted 430 radiomic features from dual-mode images. Then, we combined the least absolute shrinkage and selection operator with the analysis of variance to select several typical features. We retrieved the intrinsic imaging phenotypes by using a hierarchical clustering of all radiomics features, and we integrated the phenotypes with the selected features for the classification of benign, lymphomatous, and metastatic nodes. Results The areas under the receiver operating characteristic curves (AUCs) on the validation set were 0.960 for benign vs. lymphomatous, 0.716 for benign vs. metastatic, 0.933 for lymphomatous vs. metastatic, and 0.856 for benign vs. malignant. Conclusions The radiomics features and intrinsic imaging phenotypes derived from the dual-mode ultrasound can capture the distinctions between benign, lymphomatous, and metastatic nodes and are valuable in node differentiation.
Collapse
Affiliation(s)
- Ying Chen
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, China.,The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai, China.,School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Jianwei Jiang
- Department of Ultrasound Medicine, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jie Shi
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, China.,The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai, China.,School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Wanying Chang
- Department of Ultrasound Medicine, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jun Shi
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, China.,School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Man Chen
- Department of Ultrasound Medicine, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qi Zhang
- Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, China.,The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Institute of Biomedical Engineering, Shanghai University, Shanghai, China.,School of Communication and Information Engineering, Shanghai University, Shanghai, China.,Hangzhou YITU Healthcare Technology, Hangzhou, China
| |
Collapse
|
9
|
Li T, Jiang Z, Lu M, Zou S, Wu M, Wei T, Wang L, Li J, Hu Z, Cheng X, Liao J. Computer-aided diagnosis system of thyroid nodules ultrasonography: Diagnostic performance difference between computer-aided diagnosis and 111 radiologists. Medicine (Baltimore) 2020; 99:e20634. [PMID: 32502044 PMCID: PMC7306365 DOI: 10.1097/md.0000000000020634] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
To evaluate the diagnostic efficiency of computer-aided diagnosis (CAD) system and 111 radiologists with different experience in identifying benign and malignant thyroid nodules, and to summarize the ultrasound features that may affect the diagnostic of CAD and radiologists.Fifty thyroid nodules and 111 radiologists were enrolled in this study. All the 50 nodules were diagnosed by the 111 radiologists and the CAD system simultaneously. The diagnostic performance of the CAD system, senior and junior radiologists with the maximum accuracy were calculated and compared. Interobserver agreement for different ultrasound characteristics between the CAD and senior radiologist were analyzed.CAD system showed a higher specificity than junior radiologist (87.5% vs 70.4%, P = .03), and a lower sensitivity than the senior radiologist and junior radiologist but the statistics were not significant (76.9% vs 86.9%, P > .5; 76.9% vs 82.6%, P > .5). The CAD system and senior radiologist got larger AUC than junior radiologist but the differences were not statistically significant (0.82 vs 0.76, respectively; P = .5). The interobserver agreement for the US characteristics between the CAD system and senior radiologist were: substantial agreement for hypoechoic and taller than wide (kappa value = 0.66, 0.78), and moderate agreement for irregular margin and micro-calcifications (kappa value = 0.52, 0.42).The CAD system achieved equal diagnostic accuracy to the senior radiologists and higher accuracy than the junior radiologists. The interobserver agreements in the US features between the CAD system and senior radiologist were substantial agreement for hypoechoic and taller than wide; moderate agreement for irregular margin and micro-calcifications. The location of a thyroid nodule and the feature of macrocalcification with wide acoustic shadow may influence the analysis of the CAD system.
Collapse
Affiliation(s)
- Tingting Li
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Zirui Jiang
- Electrical and computer Engineering, University of Wisconsin Madison, Madison, Wisconsin
| | - Man Lu
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Shibin Zou
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Minggang Wu
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Ting Wei
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Lu Wang
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Juan Li
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Ziyue Hu
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Xueqing Cheng
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Jifen Liao
- Ultrasound Medical Center, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
10
|
Multi-Reader Multi-Case Study for Performance Evaluation of High-Risk Thyroid Ultrasound with Computer-Aided Detection. Cancers (Basel) 2020; 12:cancers12020373. [PMID: 32041119 PMCID: PMC7072687 DOI: 10.3390/cancers12020373] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2020] [Revised: 02/03/2020] [Accepted: 02/04/2020] [Indexed: 12/17/2022] Open
Abstract
Physicians use sonographic characteristics as a reference for the possible diagnosis of thyroid cancers. The purpose of this study was to investigate whether physicians were more effective in their tentative diagnosis based on the information provided by a computer-aided detection (CAD) system. A computer compared software-defined and physician-adjusted tumor loci. A multicenter, multireader, and multicase (MRMC) study was designed to compare clinician performance without and with the use of CAD. Interobserver variability was also analyzed. Excellent, satisfactory, and poor segmentations were observed in 25.3%, 58.9%, and 15.8% of nodules, respectively. There were 200 patients with 265 nodules in the study set. Nineteen physicians scored the malignancy potential of the nodules. The average area under the curve (AUC) of all readers was 0.728 without CAD and significantly increased to 0.792 with CAD. The average standard deviation of the malignant potential score significantly decreased from 18.97 to 16.29. The mean malignant potential score significantly decreased from 35.01 to 31.24 for benign cases. With the CAD system, an additional 7.6% of malignant nodules would be suggested for further evaluation, and biopsy would not be recommended for an additional 10.8% of benign nodules. The results demonstrated that applying a CAD system would improve clinicians’ interpretations and lessen the variability in diagnosis. However, more studies are needed to explore the use of the CAD system in an actual ultrasound diagnostic situation where much more benign thyroid nodules would be seen.
Collapse
|
11
|
Quantitative Framework for Risk Stratification of Thyroid Nodules With Ultrasound: A Step Toward Automated Triage of Thyroid Cancer. AJR Am J Roentgenol 2020; 214:885-892. [PMID: 31967504 DOI: 10.2214/ajr.19.21350] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
OBJECTIVE. The purpose of this study was to explore whether a quantitative framework can be used to sonographically differentiate benign and malignant thyroid nodules at a level comparable to that of experts. MATERIALS AND METHODS. A dataset of ultrasound images of 92 biopsy-confirmed nodules was collected retrospectively. The nodules were delineated and annotated by two expert radiologists using the standardized Thyroid Imaging Reporting and Data System lexicon of the American College of Radiology. In the framework studied, quantitative features of echogenicity, texture, edge sharpness, and margin curvature properties of thyroid nodules were analyzed in a regularized logistic regression model to predict malignancy of a nodule. The framework was validated by leave-one-out cross-validation technique, and ROC AUC, sensitivity, and specificity were used to compare with those obtained with six expert annotation-based classifiers. RESULTS. The AUC of the proposed method was 0.828 (95% CI, 0.715-0.942), which was greater than or comparable to that of the expert classifiers, for which the AUC values ranged from 0.299 to 0.829 (p = 0.99). Use of the proposed framework could have avoided biopsy of 20 of 46 benign nodules in a curative strategy (at sensitivity of 1, statistically significantly higher than three expert classifiers) or helped identify 10 of 46 malignancies in a conservative strategy (at specificity of 1, statistically significantly higher than five expert classifiers). CONCLUSION. When the proposed quantitative framework was used, thyroid nodule malignancy was predicted at the level of expert classifiers. Such a framework may ultimately prove useful as the basis for a fully automated system of thyroid nodule triage.
Collapse
|
12
|
Convolutional Neural Network for Breast and Thyroid Nodules Diagnosis in Ultrasound Imaging. BIOMED RESEARCH INTERNATIONAL 2020; 2020:1763803. [PMID: 32420322 PMCID: PMC7199615 DOI: 10.1155/2020/1763803] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Revised: 11/11/2019] [Accepted: 12/14/2019] [Indexed: 12/12/2022]
Abstract
Objective The incidence of superficial organ diseases has increased rapidly in recent years. New methods such as computer-aided diagnosis (CAD) are widely used to improve diagnostic efficiency. Convolutional neural networks (CNNs) are one of the most popular methods, and further improvements of CNNs should be considered. This paper aims to develop a multiorgan CAD system based on CNNs for classifying both thyroid and breast nodules and investigate the impact of this system on the diagnostic efficiency of different preprocessing approaches. Methods The training and validation sets comprised randomly selected thyroid and breast nodule images. The data were subgrouped into 4 models according to the different preprocessing methods (depending on segmentation and the classification method). A prospective data set was selected to verify the clinical value of the CNN model by comparison with ultrasound guidelines. Diagnostic efficiency was assessed based on receiver operating characteristic (ROC) curves. Results Among the 4 models, the CNN model using segmented images for classification achieved the best result. For the validation set, the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, and area under the curve (AUC) of our CNN model were 84.9%, 69.0%, 62.5%, 88.2%, 75.0%, and 0.769, respectively. There was no statistically significant difference between the CNN model and the ultrasound guidelines. The combination of the two methods achieved superior diagnostic efficiency compared with their use individually. Conclusions The study demonstrates the probability, feasibility, and clinical value of CAD in the ultrasound diagnosis of multiple organs. The use of segmented images and classification by the nature of the disease are the main factors responsible for the improvement of the CNN model. Moreover, the combination of the CNN model and ultrasound guidelines results in better diagnostic performance, which will contribute to the improved diagnostic efficiency of CAD systems.
Collapse
|
13
|
Jin A, Li Y, Shen J, Zhang Y, Wang Y. Clinical Value of a Computer-Aided Diagnosis System in Thyroid Nodules: Analysis of a Reading Map Competition. ULTRASOUND IN MEDICINE & BIOLOGY 2019; 45:2666-2671. [PMID: 31281010 DOI: 10.1016/j.ultrasmedbio.2019.06.405] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2019] [Revised: 05/20/2019] [Accepted: 06/10/2019] [Indexed: 06/09/2023]
Abstract
We evaluated the accuracy of human and computer-aided diagnosis (CAD) in a reading map diagnosis competition for detection of thyroid cancers via ultrasonography (US). The competition comprised 33 thyroid nodule images randomly chosen between 2015 and 2017. One hundred seventy-seven contestants including one operator using CAD participated in the competition. The competition was separated into an online part and a live part. We compared the average accuracy of contestants and CAD in the detection of thyroid cancers. The accuracy of contestants and the CAD system was 60.3% and 84.8%, respectively. The accuracy of the CAD system was higher than that of the contestants with different technical titles. The areas under the curve for CAD and contestants were 0.985 (0.881-1.00) and 0.659 (0.645-0.673) (Z = 7.55, p < 0.01). The CAD system had high accuracy in this thyroid nodule reading map competition, and may be an adjuvant tool for radiologists.
Collapse
Affiliation(s)
- Anqi Jin
- Department of Ultrasound in Medicine, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, China; Shanghai Institute of Ultrasound in Medicine, Shanghai, China
| | - Yi Li
- Department of Ultrasound in Medicine, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, China; Shanghai Institute of Ultrasound in Medicine, Shanghai, China
| | - Jian Shen
- Department of Ultrasound in Medicine, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, China; Shanghai Institute of Ultrasound in Medicine, Shanghai, China
| | - Yichun Zhang
- Department of Ultrasound in Medicine, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, China; Shanghai Institute of Ultrasound in Medicine, Shanghai, China
| | - Yan Wang
- Department of Ultrasound in Medicine, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, China; Shanghai Institute of Ultrasound in Medicine, Shanghai, China.
| |
Collapse
|
14
|
Chiu LY, Chen A. A Variance-reduction Approach to Detection of the Thyroid-nodule Boundary on Ultrasound Images. ULTRASONIC IMAGING 2019; 41:206-230. [PMID: 30990130 DOI: 10.1177/0161734619839648] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
To perform computer-aided diagnosis of the thyroid nodules on ultrasound images, the location and boundary of nodules should be clearly defined. However, the identification of thyroid nodule boundary is a difficult issue due to the biological characteristics of the nodules, the physics and quality of ultrasound imaging, and the subjective factors and operating conditions of the operator. In this study, we propose a novel and semiautomatic method for detecting the boundary of thyroid nodule based on the Variance-Reduction (V-R) statistics without image preprocessing. The region of interest (ROI) is first automatically generated according to the initial inputs of the nodule's major and minor axes. The boundary candidate pixel points are then extracted by using the V-R statistics from the grayscale values of all pixel points in the ROI. Three filtering methods are further applied to eliminate the outlier pixel points to ensure that the remaining candidate pixel points are located on the nodule boundary. Finally, the remaining pixel points are smoothened and linked together to form the final boundary. The proposed method is validated with ultrasound images of 538 thyroid nodules, with manual delineation by experienced radiologist as gold standard. The effectiveness is evaluated and compared with previous publications using boundary error metrics and overlapping area metrics with the same data set. The results show that the normalized average mean boundary error is 1.02%, the true positive overlapping area ratio achieves 93.66% and false positive overlapping area ratio is limited to 7.68%. In conclusion, our proposed method is reliable and effective in detecting thyroid nodule boundary on ultrasound images.
Collapse
Affiliation(s)
- Ling-Ying Chiu
- 1 Institute of Industrial Engineering, National Taiwan University, Taipei
| | - Argon Chen
- 1 Institute of Industrial Engineering, National Taiwan University, Taipei
- 2 Department of Mechanical Engineering, National Taiwan University, Taipei
| |
Collapse
|
15
|
Diagnostic Performance Evaluation of a Computer-Assisted Imaging Analysis System for Ultrasound Risk Stratification of Thyroid Nodules. AJR Am J Roentgenol 2019; 213:169-174. [PMID: 30973776 DOI: 10.2214/ajr.18.20740] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
OBJECTIVE. Ultrasound-based stratification of the malignancy risk of thyroid nodules has potential variability. The purpose of this study is to evaluate the diagnostic effectiveness of the first commercially available system for computer-aided diagnosis (CADx) imaging analysis. MATERIALS AND METHODS. Ultrasound images of 300 thyroid nodules (135 of which were malignant) acquired before surgical treatment were retrospectively reviewed by a thyroid expert, and his classification of each image was then compared with the classification rendered by an image analysis program (AmCAD-UT, AmCAD Biomed). The American Thyroid Association (ATA) classification system, the European Thyroid Imaging Reporting and Data System (EU-TIRADS), and the classification system jointly proposed by American and Italian associations of clinical endocrinologists (the American Association of Clinical Endocrinologists [AACE], the American College of Endocrinology [ACE], and Associazione Medici Endocrinologi [AME]) were used for risk stratification. RESULTS. The diagnostic performance of the thyroid expert when the ATA system was used was as follows: sensitivity, 87.0%; specificity, 91.2%; positive predictive value, 90.5%; and negative predictive value, 90.9%. Compared with the expert, the CADx program, when used with the three classification systems, had a similar sensitivity but a lower specificity and positive predictive value. Regarding the negative predictive value, the results of the expert did not differ from those of the CADx program when it applied the ATA classification system (90.9% vs 86.3%; p = 0.07). The ROC AUC value was 0.88 for the expert clinician and 0.72 for the CADx program when the ATA classification system was used. CONCLUSION. The CADx ultrasound image analysis program described in the present study is useful for risk stratification of thyroid nodules, but it does not perform better than a sonography expert.
Collapse
|
16
|
Lin YH, Tsai YC, Lin KJ, Der Lin J, Wang CC, Chen ST. Computer-Aided Diagnostic Technique in 2-Deoxy-2-[ 18F]fluoro-D-glucose-Positive Thyroid Nodule: Clinical Experience of 74 Non-thyroid Cancer Patients. ULTRASOUND IN MEDICINE & BIOLOGY 2019; 45:108-121. [PMID: 30336966 DOI: 10.1016/j.ultrasmedbio.2018.09.002] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/16/2018] [Revised: 08/01/2018] [Accepted: 09/03/2018] [Indexed: 06/08/2023]
Abstract
This study verified the value of a computer-aided diagnosis (CAD) technique assisting in ultrasonography (US) diagnosis of 2-deoxy-2-[18F]fluoro-D-glucose (18FDG)-avid thyroid incidentalomas on positron emission tomography. A total of 82 18FDG-avid thyroid incidentalomas from 74 non-thyroid cancer patients were retrospectively analyzed with respect to US and CAD parameters (anechoic area, hyper-echoic foci, hypo-echogenicity, heterogeneity, margin, taller-than-wide shape, eccentric area) and were compared with 38 other non-18FDG-avid nodules found in the same patient group. Fine-needle aspiration cytology or surgical intervention pathology was performed for diagnosis. No significant differences in nodule size or CAD parameters were found in 18FDG-avid nodules reported as benign, indeterminate or malignant. Significantly more taller-than-wide nodules were thyroid originating than metastatic (0.30 vs. 0.16, p < 0.05). Nevertheless, combined CAD and positron emission tomography/computed tomography scores and a discrimination point of 4 resulted in a sensitivity of 75% and a specificity of 80% in prediction of incidentaloma benignity.
Collapse
Affiliation(s)
- Yi-Hsuan Lin
- Division of Endocrinology and Metabolism, Department of Internal Medicine, Chang Gung Memorial Hospital, Chang Gung University, College of Medicine, Taoyuan, Taiwan
| | | | - Kun Ju Lin
- Departments of Nuclear Medicine and Molecular Imaging Center, Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Taoyuan, Taiwan
| | - Jen- Der Lin
- Division of Endocrinology and Metabolism, Department of Internal Medicine, Chang Gung Memorial Hospital, Chang Gung University, College of Medicine, Taoyuan, Taiwan
| | - Chih-Ching Wang
- Division of Endocrinology and Metabolism, Department of Internal Medicine, Chang Gung Memorial Hospital, Chang Gung University, College of Medicine, Taoyuan, Taiwan
| | - Szu-Tah Chen
- Division of Endocrinology and Metabolism, Department of Internal Medicine, Chang Gung Memorial Hospital, Chang Gung University, College of Medicine, Taoyuan, Taiwan.
| |
Collapse
|
17
|
Sethna CB, Kee D, Casado P, Murphy M, Palmer LS, Ghorayeb SR, Morganstern B. Renal sonographic changes in heterogeneity index and echogenicity in children with hypertension: a novel assessment. ACTA ACUST UNITED AC 2018; 12:e77-e83. [PMID: 30502313 DOI: 10.1016/j.jash.2018.11.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2018] [Revised: 10/18/2018] [Accepted: 11/09/2018] [Indexed: 11/17/2022]
Abstract
The kidneys are thought to contribute to the pathogenesis of primary hypertension, but hypertension is also known to cause target organ damage in the kidney. Noninvasive methods to capture possible changes in the kidney related to hypertension are limited. A new program that has been used to quantify the heterogeneity and percent echogenicity in renal ultrasound images was implemented to assess patients with hypertension. Children and adolescents <21 years with primary hypertension diagnosed by ambulatory blood pressure monitoring were compared with normotensive age- and sex-matched controls. Renal ultrasound images were evaluated by a technique that measured pixels of gray-scale images and transformed them into a binary map, which was converted to a heterogeneity index (HI) and percent echogenicity score. This study included 99 children with hypertension and 99 control subjects. Body mass index (BMI) was greater in the hypertension group. Average HI for hypertension was significantly higher than in controls (1.37 ± 0.19 vs. 1.2 ± 0.23, P = .001), while echogenicity scores were not different (26.6 ± 8.9 vs. 25.9 ± 10, P = .8). In regression analysis adjusting for BMI z-score and race, hypertension was associated with greater HI compared with controls (β = 0.11, 95% confidence interval 0.03-0.18, P = .005). In a model adjusted for age, sex, and BMI z-score in the hypertension group only, no ambulatory blood pressure monitoring measures were associated with HI or echogenicity scores (P > .05).HI was significantly greater in the hypertension group compared with normotensive controls. HI may be a novel method to detect changes in the kidney related to hypertension.
Collapse
Affiliation(s)
- Christine B Sethna
- Division of Pediatric Nephrology, Cohen Children's Medical Center, New Hyde Park, NY, USA; Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA; Feinstein Institute for Medical Research, Manhasset, NY, USA.
| | - Dustin Kee
- Division of Pediatric Nephrology, Cohen Children's Medical Center, New Hyde Park, NY, USA
| | - Pablo Casado
- Ultrasound Research Lab, DeMatteis School of Engineering and Applied Sciences, Hofstra University, Hempstead, NY, USA
| | - Megan Murphy
- Ultrasound Research Lab, DeMatteis School of Engineering and Applied Sciences, Hofstra University, Hempstead, NY, USA
| | - Lane S Palmer
- Division of Pediatric Urology, Cohen Children's Medical Center, New Hyde Park, NY, USA; Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
| | - Sleiman R Ghorayeb
- Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA; Feinstein Institute for Medical Research, Manhasset, NY, USA; Ultrasound Research Lab, DeMatteis School of Engineering and Applied Sciences, Hofstra University, Hempstead, NY, USA
| | - Bradley Morganstern
- Division of Pediatric Urology, Cohen Children's Medical Center, New Hyde Park, NY, USA
| |
Collapse
|
18
|
Computer-aided diagnosis system for thyroid nodules on ultrasonography: diagnostic performance and reproducibility based on the experience level of operators. Eur Radiol 2018; 29:1978-1985. [DOI: 10.1007/s00330-018-5772-9] [Citation(s) in RCA: 47] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2018] [Revised: 08/24/2018] [Accepted: 09/18/2018] [Indexed: 01/12/2023]
|
19
|
Yu Q, Jiang T, Zhou A, Zhang L, Zhang C, Xu P. Computer-aided diagnosis of malignant or benign thyroid nodes based on ultrasound images. Eur Arch Otorhinolaryngol 2017; 274:2891-2897. [PMID: 28389809 DOI: 10.1007/s00405-017-4562-3] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2017] [Accepted: 04/03/2017] [Indexed: 11/27/2022]
Abstract
The objective of this study is to evaluate the diagnostic value of combination of artificial neural networks (ANN) and support vector machine (SVM)-based CAD systems in differentiating malignant from benign thyroid nodes with gray-scale ultrasound images. Two morphological and 65 texture features extracted from regions of interest in 610 2D-ultrasound thyroid node images from 543 patients (207 malignant, 403 benign) were used to develop the ANN and SVM models. Tenfold cross validation evaluated their performance; the best models showed accuracy of 99% for ANN and 100% for SVM. From 50 thyroid node ultrasound images from 45 prospectively enrolled patients, the ANN model showed sensitivity, specificity, positive and negative predictive values, Youden index, and accuracy of 88.24, 90.91, 83.33, 93.75, 79.14, and 90.00%, respectively, the SVM model 76.47, 90.91, 81.25, 88.24, 67.38, and 86.00%, respectively, and in combination 100.00, 87.88, 80.95, 100.00, 87.88, and 92.00%, respectively. Both ANN and SVM had high value in classifying thyroid nodes. In combination, the sensitivity increased but specificity decreased. This combination might provide a second opinion for radiologists dealing with difficult to diagnose thyroid node ultrasound images.
Collapse
Affiliation(s)
- Qin Yu
- Department of Ultrasonography, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, 330006, China
| | - Tao Jiang
- Department of Ultrasonography, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, 330006, China
| | - Aiyun Zhou
- Department of Ultrasonography, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, 330006, China.
| | - Lili Zhang
- Department of Ultrasonography, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, 330006, China
| | - Cheng Zhang
- Department of Ultrasonography, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, 330006, China
| | - Pan Xu
- Department of Ultrasonography, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, 330006, China
| |
Collapse
|
20
|
Samson P, Hartman C, Palmerola R, Rahman Z, Siev M, Palmer LS, Ghorayeb SR. Ultrasonographic Assessment of Testicular Viability Using Heterogeneity Levels in Torsed Testicles. J Urol 2017; 197:925-930. [DOI: 10.1016/j.juro.2016.09.112] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/13/2016] [Indexed: 11/25/2022]
Affiliation(s)
- Patrick Samson
- Division of Pediatric Urology. Cohen Children’s Medical Center of New York, Hofstra-Northwell School of Medicine, Hempstead, New York
| | - Christopher Hartman
- Division of Pediatric Urology. Cohen Children’s Medical Center of New York, Hofstra-Northwell School of Medicine, Hempstead, New York
| | - Ricardo Palmerola
- Division of Pediatric Urology. Cohen Children’s Medical Center of New York, Hofstra-Northwell School of Medicine, Hempstead, New York
| | - Zara Rahman
- School of Engineering and Applied Sciences, Ultrasound Research Laboratory, Hofstra University, Hempstead, New York
| | - Michael Siev
- Division of Pediatric Urology. Cohen Children’s Medical Center of New York, Hofstra-Northwell School of Medicine, Hempstead, New York
| | - Lane S. Palmer
- Division of Pediatric Urology. Cohen Children’s Medical Center of New York, Hofstra-Northwell School of Medicine, Hempstead, New York
| | - Sleiman R. Ghorayeb
- Departments of Radiology and Molecular Medicine, Hofstra-Northwell School of Medicine, Hempstead, New York
- School of Engineering and Applied Sciences, Ultrasound Research Laboratory, Hofstra University, Hempstead, New York
- Center for Immunology and Inflammation, Feinstein Institute for Medical Research, Northwell Health, Manhasset, New York
| |
Collapse
|
21
|
Wu MH, Chen CN, Chen KY, Ho MC, Tai HC, Wang YH, Chen A, Chang KJ. Quantitative analysis of echogenicity for patients with thyroid nodules. Sci Rep 2016; 6:35632. [PMID: 27762299 PMCID: PMC5071905 DOI: 10.1038/srep35632] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2016] [Accepted: 10/03/2016] [Indexed: 12/16/2022] Open
Abstract
Hypoechogenicity has been described qualitatively and is potentially subject to intra- and inter-observer variability. The aim of this study was to clarify whether quantitative echoic indexes (EIs) are useful for the detection of malignant thyroid nodules. Overall, 333 participants with 411 nodules were included in the final analysis. Quantification of echogenicity was performed using commercial software (AmCAD-UT; AmCad BioMed, Taiwan). The coordinates of three defined regions, the nodule, thyroid parenchyma, and strap muscle regions, were recorded in the database separately for subsequent analysis. And the results showed that ultrasound echogenicity (US-E), as assessed by clinicians, defined hypoechogenicity as an independent factor for malignancy. The EI, adjusted EI (EIN-T; EIN-M) and automatic EI(N-R)/R values between benign and malignant nodules were all significantly different, with lower values for malignant nodules. All of the EIs showed similar percentages of sensitivity and specificity and had better accuracies than US-E. In conclusion, the proposed quantitative EI seems more promising to constitute an important advancement than the conventional qualitative US-E in allowing for a more reliable distinction between benign and malignant thyroid nodules.
Collapse
Affiliation(s)
- Ming-Hsun Wu
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Chiung-Nien Chen
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Kuen-Yuan Chen
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Ming-Chih Ho
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Hao-Chih Tai
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | | | - Argon Chen
- Graduate Institute of Industrial Engineering, National Taiwan University, Taipei, Taiwan
| | - King-Jen Chang
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan.,Department of Surgery, Cheng Ching General Hospital, Taichung City, Taiwan
| |
Collapse
|
22
|
The Role of Computer-aided Detection and Diagnosis System in the Differential Diagnosis of Thyroid Lesions in Ultrasonography. J Med Ultrasound 2015. [DOI: 10.1016/j.jmu.2015.10.002] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
|