1
|
Ma Q, Li Y, Yu G, Liu S, Jiang Y, Duan H, Wang D, He Y, Chen X, Yao N, Lin X, Wan H, Shen J. Sex-Specific Associations of Five Serum Essential Metal Elements with Thyroid Nodules in Euthyroid Adults: a Cross‑sectional Study. Biol Trace Elem Res 2023:10.1007/s12011-023-04024-0. [PMID: 38157093 DOI: 10.1007/s12011-023-04024-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 12/13/2023] [Indexed: 01/03/2024]
Abstract
The association between the serum essential metal elements (magnesium, iron, copper, zinc, and calcium) and thyroid nodules is still inconsistent. The current study aims to investigate the relationship of metal elements with thyroid nodules and their malignant tendency. A total of 6480 Chinese euthyroid adults were included in our study. We collect basic information through questionnaires and medical checkups. We diagnose thyroid nodules by ultrasound and detect serum trace metal concentrations by using an automatic biochemical analyzer. Binary and multinomial logistic regressions were used to investigate the associations. As a result, we found that serum copper concentrations were positively associated with thyroid nodules in the second, third, and fourth quartiles, compared to the first quartile (P = 0.024, P = 0.016, P = 0.032) in women and P for trend is 0.038. There is a significant sex-specific association between copper concentrations and thyroid nodules (P for interaction = 0.009). The results of the multinomial logistic regression analyses indicate high serum calcium and magnesium concentrations emerged as consistent risk factors for thyroid nodules in both genders, whereas low zinc was a sex-specific factor. We also observed significant sex interactions in the relationships of magnesium (P for interaction = 0.043) with thyroid nodules with malignant tendency among participants with thyroid nodules. In conclusion, our study suggests that gender is an important factor when studying the association between serum metals and thyroid nodules. The imbalance of selected metal elements (calcium, copper, zinc, and magnesium) may relate to thyroid nodules and their malignant tendency, and future prospective studies are needed to further confirm the associations.
Collapse
Affiliation(s)
- Qintao Ma
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Ying Li
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Genfeng Yu
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Siyang Liu
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Yuqi Jiang
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Hualin Duan
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Dongmei Wang
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Yajun He
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Xingying Chen
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Nanfang Yao
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Xu Lin
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China
| | - Heng Wan
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China.
| | - Jie Shen
- Department of Endocrinology and Metabolism, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), No.1 of Jiazi Road, Lunjiao, Shunde District, Foshan City, 528308, Guangdong Province, China.
| |
Collapse
|
2
|
Kuang A, Kouznetsova VL, Kesari S, Tsigelny IF. Diagnostics of Thyroid Cancer Using Machine Learning and Metabolomics. Metabolites 2023; 14:11. [PMID: 38248814 PMCID: PMC10818630 DOI: 10.3390/metabo14010011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 12/14/2023] [Accepted: 12/18/2023] [Indexed: 01/23/2024] Open
Abstract
The objective of this research is, with the analysis of existing data of thyroid cancer (TC) metabolites, to develop a machine-learning model that can diagnose TC using metabolite biomarkers. Through data mining, pathway analysis, and machine learning (ML), the model was developed. We identified seven metabolic pathways related to TC: Pyrimidine metabolism, Tyrosine metabolism, Glycine, serine, and threonine metabolism, Pantothenate and CoA biosynthesis, Arginine biosynthesis, Phenylalanine metabolism, and Phenylalanine, tyrosine, and tryptophan biosynthesis. The ML classifications' accuracies were confirmed through 10-fold cross validation, and the most accurate classification was 87.30%. The metabolic pathways identified in relation to TC and the changes within such pathways can contribute to more pattern recognition for diagnostics of TC patients and assistance with TC screening. With independent testing, the model's accuracy for other unique TC metabolites was 92.31%. The results also point to a possibility for the development of using ML methods for TC diagnostics and further applications of ML in general cancer-related metabolite analysis.
Collapse
Affiliation(s)
- Alyssa Kuang
- Haas Business School, University of California at Berkeley, Berkeley, CA 94720, USA;
| | - Valentina L. Kouznetsova
- San Diego Supercomputer Center, University of California at San Diego, La Jolla, CA 92093, USA;
- BiAna, La Jolla, CA 92038, USA
- CureScience Institute, San Diego, CA 92121, USA
| | - Santosh Kesari
- Pacific Neuroscience Institute, Santa Monica, CA 90404, USA;
| | - Igor F. Tsigelny
- San Diego Supercomputer Center, University of California at San Diego, La Jolla, CA 92093, USA;
- BiAna, La Jolla, CA 92038, USA
- CureScience Institute, San Diego, CA 92121, USA
- Department of Neurosciences, University of California at San Diego, La Jolla, CA 92093, USA
| |
Collapse
|
3
|
Rawlani P, Ghosh NK, Kumar A. Role of artificial intelligence in the characterization of indeterminate pancreatic head mass and its usefulness in preoperative diagnosis. Artif Intell Gastroenterol 2023; 4:48-63. [DOI: 10.35712/aig.v4.i3.48] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 09/11/2023] [Accepted: 10/08/2023] [Indexed: 12/07/2023] Open
Abstract
Artificial intelligence (AI) has been used in various fields of day-to-day life and its role in medicine is immense. Understanding of oncology has been improved with the introduction of AI which helps in diagnosis, treatment planning, management, prognosis, and follow-up. It also helps to identify high-risk groups who can be subjected to timely screening for early detection of malignant conditions. It is more important in pancreatic cancer as it is one of the major causes of cancer-related deaths worldwide and there are no specific early features (clinical and radiological) for diagnosis. With improvement in imaging modalities (computed tomography, magnetic resonance imaging, endoscopic ultrasound), most often clinicians were being challenged with lesions that were difficult to diagnose with human competence. AI has been used in various other branches of medicine to differentiate such indeterminate lesions including the thyroid gland, breast, lungs, liver, adrenal gland, kidney, etc. In the case of pancreatic cancer, the role of AI has been explored and is still ongoing. This review article will focus on how AI can be used to diagnose pancreatic cancer early or differentiate it from benign pancreatic lesions, therefore, management can be planned at an earlier stage.
Collapse
Affiliation(s)
- Palash Rawlani
- Department of Surgical Gastroenterology, Sanjay Gandhi Post Graduate Institute of Medical Sciences, Lucknow 226014, Uttar Pradesh, India
| | - Nalini Kanta Ghosh
- Department of Surgical Gastroenterology, Sanjay Gandhi Post Graduate Institute of Medical Sciences, Lucknow 226014, Uttar Pradesh, India
| | - Ashok Kumar
- Department of Surgical Gastroenterology, Sanjay Gandhi Post Graduate Institute of Medical Sciences, Lucknow 226014, Uttar Pradesh, India
| |
Collapse
|
4
|
Dell’Era V, Perotti A, Starnini M, Campagnoli M, Rosa MS, Saino I, Aluffi Valletti P, Garzaro M. Machine Learning Model as a Useful Tool for Prediction of Thyroid Nodules Histology, Aggressiveness and Treatment-Related Complications. J Pers Med 2023; 13:1615. [PMID: 38003930 PMCID: PMC10672369 DOI: 10.3390/jpm13111615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 11/14/2023] [Accepted: 11/15/2023] [Indexed: 11/26/2023] Open
Abstract
Thyroid nodules are very common, 5-15% of which are malignant. Despite the low mortality rate of well-differentiated thyroid cancer, some variants may behave aggressively, making nodule differentiation mandatory. Ultrasound and fine-needle aspiration biopsy are simple, safe, cost-effective and accurate diagnostic tools, but have some potential limits. Recently, machine learning (ML) approaches have been successfully applied to healthcare datasets to predict the outcomes of surgical procedures. The aim of this work is the application of ML to predict tumor histology (HIS), aggressiveness and post-surgical complications in thyroid patients. This retrospective study was conducted at the ENT Division of Eastern Piedmont University, Novara (Italy), and reported data about 1218 patients who underwent surgery between January 2006 and December 2018. For each patient, general information, HIS and outcomes are reported. For each prediction task, we trained ML models on pre-surgery features alone as well as on both pre- and post-surgery data. The ML pipeline included data cleaning, oversampling to deal with unbalanced datasets and exploration of hyper-parameter space for random forest models, testing their stability and ranking feature importance. The main results are (i) the construction of a rich, hand-curated, open dataset including pre- and post-surgery features (ii) the development of accurate yet explainable ML models. Results highlight pre-screening as the most important feature to predict HIS and aggressiveness, and that, in our population, having an out-of-range (Low) fT3 dosage at pre-operative examination is strongly associated with a higher aggressiveness of the disease. Our work shows how ML models can find patterns in thyroid patient data and could support clinicians to refine diagnostic tools and improve their accuracy.
Collapse
Affiliation(s)
- Valeria Dell’Era
- ENT Division, Novara Maggiore Hospital, 28100 Novara, Italy; (M.S.R.); (I.S.)
| | | | - Michele Starnini
- CENTAI Institute, 10138 Turin, Italy; (A.P.)
- Departament de Fisica, Universitat Politecnica de Catalunya, Campus Nord, 08034 Barcelona, Spain
| | - Massimo Campagnoli
- Department of Otorhinolaryngology, Ss. Trinità Hospital, 28021 Borgomanero, Italy;
| | - Maria Silvia Rosa
- ENT Division, Novara Maggiore Hospital, 28100 Novara, Italy; (M.S.R.); (I.S.)
| | - Irene Saino
- ENT Division, Novara Maggiore Hospital, 28100 Novara, Italy; (M.S.R.); (I.S.)
| | - Paolo Aluffi Valletti
- ENT Division, Health Science Department, School of Medicine, Universitá del Piemonte Orientale, 28100 Novara, Italy; (P.A.V.); (M.G.)
| | - Massimiliano Garzaro
- ENT Division, Health Science Department, School of Medicine, Universitá del Piemonte Orientale, 28100 Novara, Italy; (P.A.V.); (M.G.)
| |
Collapse
|
5
|
Toro-Tobon D, Loor-Torres R, Duran M, Fan JW, Singh Ospina N, Wu Y, Brito JP. Artificial Intelligence in Thyroidology: A Narrative Review of the Current Applications, Associated Challenges, and Future Directions. Thyroid 2023; 33:903-917. [PMID: 37279303 PMCID: PMC10440669 DOI: 10.1089/thy.2023.0132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Background: The use of artificial intelligence (AI) in health care has grown exponentially with the promise of facilitating biomedical research and enhancing diagnosis, treatment, monitoring, disease prevention, and health care delivery. We aim to examine the current state, limitations, and future directions of AI in thyroidology. Summary: AI has been explored in thyroidology since the 1990s, and currently, there is an increasing interest in applying AI to improve the care of patients with thyroid nodules (TNODs), thyroid cancer, and functional or autoimmune thyroid disease. These applications aim to automate processes, improve the accuracy and consistency of diagnosis, personalize treatment, decrease the burden for health care professionals, improve access to specialized care in areas lacking expertise, deepen the understanding of subtle pathophysiologic patterns, and accelerate the learning curve of less experienced clinicians. There are promising results for many of these applications. Yet, most are in the validation or early clinical evaluation stages. Only a few are currently adopted for risk stratification of TNODs by ultrasound and determination of the malignant nature of indeterminate TNODs by molecular testing. Challenges of the currently available AI applications include the lack of prospective and multicenter validations and utility studies, small and low diversity of training data sets, differences in data sources, lack of explainability, unclear clinical impact, inadequate stakeholder engagement, and inability to use outside of the research setting, which might limit the value of their future adoption. Conclusions: AI has the potential to improve many aspects of thyroidology; however, addressing the limitations affecting the suitability of AI interventions in thyroidology is a prerequisite to ensure that AI provides added value for patients with thyroid disease.
Collapse
Affiliation(s)
- David Toro-Tobon
- Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Ricardo Loor-Torres
- Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Mayra Duran
- Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Jungwei W. Fan
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minnesota, USA
| | - Naykky Singh Ospina
- Division of Endocrinology, Department of Medicine, University of Florida, Gainesville, Florida, USA
| | - Yonghui Wu
- Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, USA
| | - Juan P. Brito
- Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| |
Collapse
|
6
|
Henry L, Bazin D, Policar C, Haymann JP, Daudon M, Frochot V, Mathonnet M. Characterization through scanning electron microscopy and μFourier transform infrared spectroscopy of microcalcifications present in fine needle aspiration smears. CR CHIM 2022. [DOI: 10.5802/crchim.187] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
7
|
Moore CA, Law JK, Retout M, Pham CT, Chang KCJ, Chen C, Jokerst JV. High-resolution ultrasonography of gingival biomarkers for periodontal diagnosis in healthy and diseased subjects. Dentomaxillofac Radiol 2022; 51:20220044. [PMID: 35522698 PMCID: PMC10043620 DOI: 10.1259/dmfr.20220044] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 04/08/2022] [Accepted: 04/11/2022] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVE To determine the capacity of ultrasonographic image-based measurements of gingival height and alveolar bone level for monitoring periodontal health and disease. METHODS Sixteen subjects were recruited from patients scheduled to receive dental care and classified as periodontally healthy (n = 10) or diseased (n = 6) according to clinical guidelines. A 40-MHz ultrasound system was used to measure gingival recession, gingival height, alveolar bone level, and gingival thickness from 66 teeth for comparison to probing measurements of pocket depth and clinical attachment level. Interexaminer variability and comparison between ultrasound measurements and probing measurements was performed via Bland-Altman analysis. RESULTS Gingival recession and its risk in non-recessed patients could be determined via measurement of the supra- and subgingival cementoenamel junction relative to the gingival margin. Interexaminer bias for ultrasound image analysis was negligible (<0.10 mm) for imaged gingival height (iGH) and 0.45 mm for imaged alveolar bone level (iABL). Diseased subjects had significantly higher imaging measurements (iGH, iABL) and clinical measurements (probing pocket depth, clinical attachment level) than healthy subjects (p < 0.05). Subtraction of the average biologic width from iGH resulted in 83% agreement (≤1 mm difference) between iGH and probing pocket depth measurements. CONCLUSIONS Ultrasonography has an equivalent diagnostic capacity as gold-standard physical probing for periodontal metrics while offering more detailed anatomical information.
Collapse
Affiliation(s)
- Colman A Moore
- Department of NanoEngineering, University of California, San Diego, 9500 Gilman Drive. La Jolla, CA, USA
| | - Jane K Law
- Herman Ostrow School of Dentistry, University of Southern California, 925 West 34th Street, Los Angeles, CA, USA
| | - Maurice Retout
- Department of NanoEngineering, University of California, San Diego, 9500 Gilman Drive. La Jolla, CA, USA
| | - Christopher T Pham
- Herman Ostrow School of Dentistry, University of Southern California, 925 West 34th Street, Los Angeles, CA, USA
| | - Kai Chiao J Chang
- Herman Ostrow School of Dentistry, University of Southern California, 925 West 34th Street, Los Angeles, CA, USA
| | - Casey Chen
- Herman Ostrow School of Dentistry, University of Southern California, 925 West 34th Street, Los Angeles, CA, USA
| | | |
Collapse
|
8
|
Hu TX, Nguyen DT, Patel M, Beckett K, Douek M, Masamed R, Rhyu J, Kim J, Tseng CH, Yeh MW, Livhits MJ. The Effect Modification of Ultrasound Risk Classification on Molecular Testing in Predicting the Risk of Malignancy in Cytologically Indeterminate Thyroid Nodules. Thyroid 2022; 32:905-916. [PMID: 35611970 DOI: 10.1089/thy.2021.0659] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
Background: Thyroid nodules with indeterminate cytology are increasingly subjected to molecular testing. We evaluated the diagnostic performances of Afirma Genomic Sequencing Classifier (GSC) and ThyroSeq v3 in thyroid nodules with high versus low/intermediate suspicion ultrasound classification. Methods: In this prospective cohort study, we analyzed all Bethesda III and IV thyroid nodules that underwent fine-needle aspiration biopsies in the University of California Los Angeles Health System from July 2017 to April 2020. All patients underwent molecular testing with Afirma GSC or ThyroSeq v3 as part of an institutional randomized trial (NCT02681328). Nodules were categorized according to the American Thyroid Association (ATA) ultrasound risk classification. The benign call rate and the positive predictive value of molecular testing were compared between ATA high suspicion versus all other categories. Results: A total of 343 patients with 375 indeterminate thyroid nodules were included. The malignancy rate in ATA high suspicion nodules was not significantly increased by a suspicious Afirma GSC result (77.8% for all ATA high suspicion nodules vs. 87.5% for nodules with ATA high suspicion and suspicious Afirma GSC results, positive likelihood ratio [LR] = 2.0, 95% confidence interval [CI 0.5-8.0], p = 1.0) or by a positive ThyroSeq v3 result (80.0% vs. 80.0%, positive LR = 1.0 [CI 1.0-1.0], p = 1.0). The rate of malignancy in ATA low/intermediate suspicion nodules increased from 21.0% to 56.3% with a suspicious Afirma GSC result (positive LR = 4.8 [CI 3.4-6.9], p < 0.0001) and decreased to 3.8% with a benign Afirma GSC result (negative LR = 0.1 [CI 0.07-0.3], p < 0.0001). Similarly, the rate of malignancy in ATA low/intermediate suspicion nodules increased from 24.3% to 66.7% with a positive ThyroSeq v3 result (positive LR = 6.2 [CI 4.0-9.7], p < 0.0001) and decreased to 2.1% with a negative ThyroSeq v3 result (negative LR = 0.07 [CI 0.02-0.3], p < 0.0001). Conclusions: Afirma GSC and ThyroSeq v3 performed well in ruling out malignancy in sonographically low/intermediate suspicion thyroid nodules but has limited diagnostic value in sonographically high suspicion nodules. Molecular testing can prognosticate more aggressive thyroid cancers, which can inform treatment decisions.
Collapse
Affiliation(s)
- Theodore X Hu
- Section of Endocrine Surgery, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Dalena T Nguyen
- Section of Endocrine Surgery, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Maitraya Patel
- Department of Radiology, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Katrina Beckett
- Department of Radiology, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Michael Douek
- Department of Radiology, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Rinat Masamed
- Department of Radiology, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Jane Rhyu
- Division of Endocrinology, Diabetes, and Metabolism, Department of Medicine, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Jiyoon Kim
- Department of Biostatistics, Fielding School of Public Health at University of California Los Angeles, Los Angeles, California, USA
| | - Chi-Hong Tseng
- Department of Medicine, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Michael W Yeh
- Section of Endocrine Surgery, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| | - Masha J Livhits
- Section of Endocrine Surgery, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, California, USA
| |
Collapse
|
9
|
Sorrenti S, Dolcetti V, Radzina M, Bellini MI, Frezza F, Munir K, Grani G, Durante C, D’Andrea V, David E, Calò PG, Lori E, Cantisani V. Artificial Intelligence for Thyroid Nodule Characterization: Where Are We Standing? Cancers (Basel) 2022; 14:cancers14143357. [PMID: 35884418 PMCID: PMC9315681 DOI: 10.3390/cancers14143357] [Citation(s) in RCA: 39] [Impact Index Per Article: 19.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 06/24/2022] [Accepted: 07/08/2022] [Indexed: 12/12/2022] Open
Abstract
Simple Summary In the present review, an up-to-date summary of the state of the art of artificial intelligence (AI) implementation for thyroid nodule characterization and cancer is provided. The opinion on the real effectiveness of AI systems remains controversial. Taking into consideration the largest and most scientifically valid studies, it is possible to state that AI provides results that are comparable or inferior to expert ultrasound specialists and radiologists. Promising data approve AI as a support tool and simultaneously highlight the need for a radiologist supervisory framework for AI provided results. Therefore, current solutions might be more suitable for educational purposes. Abstract Machine learning (ML) is an interdisciplinary sector in the subset of artificial intelligence (AI) that creates systems to set up logical connections using algorithms, and thus offers predictions for complex data analysis. In the present review, an up-to-date summary of the current state of the art regarding ML and AI implementation for thyroid nodule ultrasound characterization and cancer is provided, highlighting controversies over AI application as well as possible benefits of ML, such as, for example, training purposes. There is evidence that AI increases diagnostic accuracy and significantly limits inter-observer variability by using standardized mathematical algorithms. It could also be of aid in practice settings with limited sub-specialty expertise, offering a second opinion by means of radiomics and computer-assisted diagnosis. The introduction of AI represents a revolutionary event in thyroid nodule evaluation, but key issues for further implementation include integration with radiologist expertise, impact on workflow and efficiency, and performance monitoring.
Collapse
Affiliation(s)
- Salvatore Sorrenti
- Department of Surgical Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (S.S.); (V.D.); (E.L.)
| | - Vincenzo Dolcetti
- Department of Radiological, Anatomo-Pathological Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (V.D.); (V.C.)
| | - Maija Radzina
- Radiology Research Laboratory, Riga Stradins University, LV-1007 Riga, Latvia;
- Medical Faculty, University of Latvia, Diagnostic Radiology Institute, Paula Stradina Clinical University Hospital, LV-1007 Riga, Latvia
| | - Maria Irene Bellini
- Department of Surgical Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (S.S.); (V.D.); (E.L.)
- Correspondence:
| | - Fabrizio Frezza
- Department of Information Engineering, Electronics and Telecommunications, “Sapienza” University of Rome, 00184 Rome, Italy; (F.F.); (K.M.)
- Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT), Viale G.P. Usberti 181/A Sede Scientifica di Ingegneria-Palazzina 3, 43124 Parma, Italy
| | - Khushboo Munir
- Department of Information Engineering, Electronics and Telecommunications, “Sapienza” University of Rome, 00184 Rome, Italy; (F.F.); (K.M.)
| | - Giorgio Grani
- Department of Translational and Precision Medicine, “Sapienza” University of Rome, 00161 Rome, Italy; (G.G.); (C.D.); (E.D.)
| | - Cosimo Durante
- Department of Translational and Precision Medicine, “Sapienza” University of Rome, 00161 Rome, Italy; (G.G.); (C.D.); (E.D.)
| | - Vito D’Andrea
- Department of Surgical Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (S.S.); (V.D.); (E.L.)
| | - Emanuele David
- Department of Translational and Precision Medicine, “Sapienza” University of Rome, 00161 Rome, Italy; (G.G.); (C.D.); (E.D.)
| | - Pietro Giorgio Calò
- Department of Surgical Sciences, “Policlinico Universitario Duilio Casula”, University of Cagliari, 09042 Monserrato, Italy;
| | - Eleonora Lori
- Department of Surgical Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (S.S.); (V.D.); (E.L.)
| | - Vito Cantisani
- Department of Radiological, Anatomo-Pathological Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (V.D.); (V.C.)
| |
Collapse
|
10
|
Abstract
Artificial intelligence (AI) has illuminated a clear path towards an evolving health-care system replete with enhanced precision and computing capabilities. Medical imaging analysis can be strengthened by machine learning as the multidimensional data generated by imaging naturally lends itself to hierarchical classification. In this Review, we describe the role of machine intelligence in image-based endocrine cancer diagnostics. We first provide a brief overview of AI and consider its intuitive incorporation into the clinical workflow. We then discuss how AI can be applied for the characterization of adrenal, pancreatic, pituitary and thyroid masses in order to support clinicians in their diagnostic interpretations. This Review also puts forth a number of key evaluation criteria for machine learning in medicine that physicians can use in their appraisals of these algorithms. We identify mitigation strategies to address ongoing challenges around data availability and model interpretability in the context of endocrine cancer diagnosis. Finally, we delve into frontiers in systems integration for AI, discussing automated pipelines and evolving computing platforms that leverage distributed, decentralized and quantum techniques.
Collapse
Affiliation(s)
| | - Ihab R Kamel
- Department of Imaging & Imaging Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Harrison X Bai
- Department of Imaging & Imaging Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| |
Collapse
|
11
|
AIM in Endocrinology. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
|
12
|
Feng JW, Ye J, Qi GF, Hong LZ, Wang F, Liu SY, Jiang Y. A comparative analysis of eight machine learning models for the prediction of lateral lymph node metastasis in patients with papillary thyroid carcinoma. Front Endocrinol (Lausanne) 2022; 13:1004913. [PMID: 36387877 PMCID: PMC9651942 DOI: 10.3389/fendo.2022.1004913] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 10/14/2022] [Indexed: 12/07/2022] Open
Abstract
BACKGROUND Lateral lymph node metastasis (LLNM) is a contributor for poor prognosis in papillary thyroid cancer (PTC). We aimed to develop and validate machine learning (ML) algorithms-based models for predicting the risk of LLNM in these patients. METHODS This is retrospective study comprising 1236 patients who underwent initial thyroid resection at our institution between January 2019 and March 2022. All patients were randomly split into the training dataset (70%) and the validation dataset (30%). Eight ML algorithms, including the Logistic Regression, Gradient Boosting Machine, Extreme Gradient Boosting, Random Forest (RF), Decision Tree, Neural Network, Support Vector Machine and Bayesian Network were used to evaluate the risk of LLNM. The performance of ML models was evaluated by the area under curve (AUC), sensitivity, specificity, and decision curve analysis. RESULTS Among the eight ML algorithms, RF had the highest AUC (0.975), with sensitivity and specificity of 0.903 and 0.959, respectively. It was therefore used to develop as prediction model. The diagnostic performance of RF algorithm was dependent on the following nine top-rank variables: central lymph node ratio, size, central lymph node metastasis, number of foci, location, body mass index, aspect ratio, sex and extrathyroidal extension. CONCLUSION By combining clinical and sonographic characteristics, ML algorithms can achieve acceptable prediction of LLNM, of which the RF model performs best. ML algorithms can help clinicians to identify the risk probability of LLNM in PTC patients.
Collapse
|
13
|
Feng JW, Ye J, Qi GF, Hong LZ, Wang F, Liu SY, Jiang Y. LASSO-based machine learning models for the prediction of central lymph node metastasis in clinically negative patients with papillary thyroid carcinoma. Front Endocrinol (Lausanne) 2022; 13:1030045. [PMID: 36506061 PMCID: PMC9727241 DOI: 10.3389/fendo.2022.1030045] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/28/2022] [Accepted: 11/07/2022] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND The presence of central lymph node metastasis (CLNM) is crucial for surgical decision-making in clinical N0 (cN0) papillary thyroid carcinoma (PTC) patients. We aimed to develop and validate machine learning (ML) algorithms-based models for predicting the risk of CLNM in cN0 patients. METHODS A total of 1099 PTC patients with cN0 central neck from July 2019 to March 2022 at our institution were retrospectively analyzed. All patients were randomly split into the training dataset (70%) and the validation dataset (30%). Eight ML algorithms, including the Logistic Regression, Gradient Boosting Machine, Extreme Gradient Boosting (XGB), Random Forest (RF), Decision Tree, Neural Network, Support Vector Machine and Bayesian Network were used to evaluate the risk of CLNM. The performance of ML models was evaluated by the area under curve (AUC), sensitivity, specificity, and decision curve analysis (DCA). RESULTS We firstly used the LASSO Logistic regression method to select the most relevant factors for predicting CLNM. The AUC of XGB was slightly higher than RF (0.907 and 0.902, respectively). According to DCA, RF model significantly outperformed XGB model at most threshold points and was therefore used to develop the predictive model. The diagnostic performance of RF algorithm was dependent on the following nine top-rank variables: size, margin, extrathyroidal extension, sex, echogenic foci, shape, number, lateral lymph node metastasis and chronic lymphocytic thyroiditis. CONCLUSION By incorporating clinicopathological and sonographic characteristics, we developed ML-based models, suggesting that this non-invasive method can be applied to facilitate individualized prediction of occult CLNM in cN0 central neck PTC patients.
Collapse
|
14
|
Tahmasebi A, Qu E, Sevrukov A, Liu JB, Wang S, Lyshchik A, Yu J, Eisenbrey JR. Assessment of Axillary Lymph Nodes for Metastasis on Ultrasound Using Artificial Intelligence. ULTRASONIC IMAGING 2021; 43:329-336. [PMID: 34416827 DOI: 10.1177/01617346211035315] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
The purpose of this study was to evaluate an artificial intelligence (AI) system for the classification of axillary lymph nodes on ultrasound compared to radiologists. Ultrasound images of 317 axillary lymph nodes from patients referred for ultrasound guided fine needle aspiration or core needle biopsy and corresponding pathology findings were collected. Lymph nodes were classified into benign and malignant groups with histopathological result serving as the reference. Google Cloud AutoML Vision (Mountain View, CA) was used for AI image classification. Three experienced radiologists also classified the images and gave a level of suspicion score (1-5). To test the accuracy of AI, an external testing dataset of 64 images from 64 independent patients was evaluated by three AI models and the three readers. The diagnostic performance of AI and the humans were then quantified using receiver operating characteristics curves. In the complete set of 317 images, AutoML achieved a sensitivity of 77.1%, positive predictive value (PPV) of 77.1%, and an area under the precision recall curve of 0.78, while the three radiologists showed a sensitivity of 87.8% ± 8.5%, specificity of 50.3% ± 16.4%, PPV of 61.1% ± 5.4%, negative predictive value (NPV) of 84.1% ± 6.6%, and accuracy of 67.7% ± 5.7%. In the three external independent test sets, AI and human readers achieved sensitivity of 74.0% ± 0.14% versus 89.9% ± 0.06% (p = .25), specificity of 64.4% ± 0.11% versus 50.1 ± 0.20% (p = .22), PPV of 68.3% ± 0.04% versus 65.4 ± 0.07% (p = .50), NPV of 72.6% ± 0.11% versus 82.1% ± 0.08% (p = .33), and accuracy of 69.5% ± 0.06% versus 70.1% ± 0.07% (p = .90), respectively. These preliminary results indicate AI has comparable performance to trained radiologists and could be used to predict the presence of metastasis in ultrasound images of axillary lymph nodes.
Collapse
Affiliation(s)
- Aylin Tahmasebi
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Enze Qu
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
- Department of Ultrasound, The Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
| | - Alexander Sevrukov
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Ji-Bin Liu
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Shuo Wang
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Andrej Lyshchik
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - Joshua Yu
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| | - John R Eisenbrey
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
| |
Collapse
|
15
|
Luong G, Idarraga AJ, Hsiao V, Schneider DF. Risk Stratifying Indeterminate Thyroid Nodules With Machine Learning. J Surg Res 2021; 270:214-220. [PMID: 34706298 DOI: 10.1016/j.jss.2021.09.015] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 08/26/2021] [Accepted: 09/21/2021] [Indexed: 12/15/2022]
Abstract
BACKGROUND Up to 30% of thyroid nodules are classified as indeterminate after fine needle aspiration biopsy. These indeterminate thyroid nodules (ITNs) require surgical pathology for definitive diagnosis. Molecular testing provides additional pre-operative cancer risk stratification but adds expense and invasive testing. The purpose of this study is to utilize a machine learning (ML) algorithm to predict malignancy of ITNs using data available from less invasive tests. MATERIALS AND METHODS We conducted a retrospective study using medical records from one academic and one community center. Thyroid nodules with an indeterminate diagnosis on fine needle aspiration biopsy and completed diagnostic pathology were included. Linear, non-linear, and non-linear-ensemble ML methods were tested for accuracy when predicting malignancy using 10-fold cross-validation. Classifiers were evaluated using area under the receiver operating characteristics curve (AUROC). RESULTS A total of 355 nodules met inclusion criteria. Of these, 171 (48.2%) were diagnosed with cancer. A Random Forest classifier performed the best, producing an accuracy of 79.1%, a sensitivity of 75.5%, specificity of 82.4%, positive predicative value of 80.3%, negative predictive value of 79.0%, and an AUROC of 0.859. CONCLUSIONS ML methods accurately risk stratify ITNs using data gathered from existing, non-invasive, and inexpensive diagnostic tests. Applying an ML model with existing data can become a cost-effective alternative to molecular testing. Future studies will prospectively evaluate the performance of this ML approach when combined with expert judgment.
Collapse
Affiliation(s)
- George Luong
- University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | - Alexander J Idarraga
- University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | - Vivian Hsiao
- University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | - David F Schneider
- University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin.
| |
Collapse
|
16
|
Vadhiraj VV, Simpkin A, O’Connell J, Singh Ospina N, Maraka S, O’Keeffe DT. Ultrasound Image Classification of Thyroid Nodules Using Machine Learning Techniques. MEDICINA (KAUNAS, LITHUANIA) 2021; 57:527. [PMID: 34074037 PMCID: PMC8225215 DOI: 10.3390/medicina57060527] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 05/10/2021] [Accepted: 05/18/2021] [Indexed: 02/07/2023]
Abstract
Background and Objectives: Thyroid nodules are lumps of solid or liquid-filled tumors that form inside the thyroid gland, which can be malignant or benign. Our aim was to test whether the described features of the Thyroid Imaging Reporting and Data System (TI-RADS) could improve radiologists' decision making when integrated into a computer system. In this study, we developed a computer-aided diagnosis system integrated into multiple-instance learning (MIL) that would focus on benign-malignant classification. Data were available from the Universidad Nacional de Colombia. Materials and Methods: There were 99 cases (33 Benign and 66 malignant). In this study, the median filter and image binarization were used for image pre-processing and segmentation. The grey level co-occurrence matrix (GLCM) was used to extract seven ultrasound image features. These data were divided into 87% training and 13% validation sets. We compared the support vector machine (SVM) and artificial neural network (ANN) classification algorithms based on their accuracy score, sensitivity, and specificity. The outcome measure was whether the thyroid nodule was benign or malignant. We also developed a graphic user interface (GUI) to display the image features that would help radiologists with decision making. Results: ANN and SVM achieved an accuracy of 75% and 96% respectively. SVM outperformed all the other models on all performance metrics, achieving higher accuracy, sensitivity, and specificity score. Conclusions: Our study suggests promising results from MIL in thyroid cancer detection. Further testing with external data is required before our classification model can be employed in practice.
Collapse
Affiliation(s)
- Vijay Vyas Vadhiraj
- School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland; (J.O.); (D.T.O.)
- Health Innovation Via Engineering Laboratory, Cúram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland
| | - Andrew Simpkin
- School of Mathematics, Statistics and Applied Maths, National University of Ireland, H91 TK33 Galway, Ireland;
| | - James O’Connell
- School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland; (J.O.); (D.T.O.)
- Health Innovation Via Engineering Laboratory, Cúram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland
| | - Naykky Singh Ospina
- Division of Endocrinology, Department of Medicine, University of Florida, Gainesville, FL 3210, USA;
| | - Spyridoula Maraka
- Division of Endocrinology and Metabolism, University of Arkansas for Medical Sciences, Little Rock, AR 72205, USA;
- Medicine Section, Central Arkansas Veterans Healthcare System, Little Rock, AR 72205, USA
| | - Derek T. O’Keeffe
- School of Medicine, College of Medicine Nursing and Health Sciences, National University of Ireland Galway, H91 TK33 Galway, Ireland; (J.O.); (D.T.O.)
- Health Innovation Via Engineering Laboratory, Cúram SFI Research Centre for Medical Devices, Lambe Institute for Translational Research, National University of Ireland Galway, H91 TK33 Galway, Ireland
- Lero, SFI Centre for Software Research, National University of Ireland Galway, H91 TK33 Galway, Ireland
| |
Collapse
|
17
|
Hong N, Park Y, You SC, Rhee Y. AIM in Endocrinology. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_328-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
|
18
|
Bai Z, Chang L, Yu R, Li X, Wei X, Yu M, Liu Z, Gao J, Zhu J, Zhang Y, Wang S, Zhang Z. Thyroid nodules risk stratification through deep learning based on ultrasound images. Med Phys 2020; 47:6355-6365. [PMID: 33089513 DOI: 10.1002/mp.14543] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Revised: 08/31/2020] [Accepted: 09/30/2020] [Indexed: 02/03/2023] Open
Abstract
PURPOSE Clinically, the risk stratification of thyroid nodules is usually used to formulate the next treatment plan. The American College of Radiology (ACR) thyroid imaging reporting and data system (TI-RADS) is a type of medical standard widely used in classification diagnosis. It divides the nodule's ACR TI-RADS level into five levels by quantitative scoring, from benign to high suspicion of malignancy. However, such assessment often relies on the radiologists' experience and is time consuming. So computer-aided diagnosis is necessary. But many deep learning (DL) models are difficult for doctors to understand, limiting their applicability in clinical practice. In this work, we mainly focus on how to achieve automatic thyroid nodules risk stratification based on deep integration of deep learning and clinical experience. METHODS An automatic hierarchical method of thyroid nodules risk based on deep learning is proposed, called risk stratification network (RS-Net). It incorporates medical experience based on ACR TI-RADS. The convolutional neural network (CNN) is used to classify the five categories in ACR TI-RADS and assign their points respectively. According to the point totals, the level of risk can be obtained. In addition, a dataset involving 13 984 thyroid ultrasound images is established to develop and evaluate the proposed method. RESULTS We have extensively compared the results of this paper with the evaluation results of sonographers. The accuracy of the risk stratification (TR1 to TR5) of the proposed method is 65%, and the mean absolute error (MAE) is 0.54. The MAE of the point totals (0 to 13 points) is 1.67. The Pearson's correlation between our method evaluation and doctor evaluation reached 0.84. For the benign and malignant classification, the performance indices accuracy, sensitivity, specificity, PPV, and NPV were 88.0%, 98.1%, 79.1%, 80.5%, and 97.9%, respectively. Our method's level of thyroid nodules risk stratification is comparable to that of a senior doctor. CONCLUSIONS This work provides a way to automate the risk stratification of thyroid nodules. Our method can effectively avoid missed diagnosis and misdiagnosis caused by the difference of observers so as to assist doctors to improve efficiency and diagnosis rate. Compared with the previous benign and malignant classification, the proposed method incorporates clinical experience. So it can greatly increase the clinicians' trust in the DL model, thereby improving the applicability of the model in clinical practice.
Collapse
Affiliation(s)
- Ziyu Bai
- College of Intelligence and Computing, Tianjin University, Tianjin, China.,Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, China.,Tianjin Key Laboratory of Advanced Networking, Tianjin, China
| | - Luchen Chang
- Department of Diagnostic and Therapeutic Ultrasonography, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center of Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Tianjin, China
| | - Ruiguo Yu
- Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, China.,Tianjin Key Laboratory of Advanced Networking, Tianjin, China.,College of Intelligence and Computing, Tianjin University, Tianjin, China
| | - Xuewei Li
- Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, China.,Tianjin Key Laboratory of Advanced Networking, Tianjin, China.,College of Intelligence and Computing, Tianjin University, Tianjin, China
| | - Xi Wei
- Department of Diagnostic and Therapeutic Ultrasonography, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center of Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Tianjin, China
| | - Mei Yu
- Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, China.,Tianjin Key Laboratory of Advanced Networking, Tianjin, China.,College of Intelligence and Computing, Tianjin University, Tianjin, China
| | - Zhiqiang Liu
- Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, China.,Tianjin Key Laboratory of Advanced Networking, Tianjin, China.,College of Intelligence and Computing, Tianjin University, Tianjin, China
| | - Jie Gao
- Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, China.,Tianjin Key Laboratory of Advanced Networking, Tianjin, China.,College of Intelligence and Computing, Tianjin University, Tianjin, China
| | - Jialin Zhu
- Department of Diagnostic and Therapeutic Ultrasonography, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center of Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Tianjin, China
| | - Yulin Zhang
- Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, China.,Tianjin Key Laboratory of Advanced Networking, Tianjin, China.,College of Intelligence and Computing, Tianjin University, Tianjin, China
| | - Shuaijie Wang
- Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, China.,Tianjin Key Laboratory of Advanced Networking, Tianjin, China.,College of Intelligence and Computing, Tianjin University, Tianjin, China
| | - Zhuo Zhang
- Tianjin International Engineering Institute, Tianjin University, Tianjin, China
| |
Collapse
|
19
|
Wang S, Xu J, Tahmasebi A, Daniels K, Liu JB, Curry J, Cottrill E, Lyshchik A, Eisenbrey JR. Incorporation of a Machine Learning Algorithm With Object Detection Within the Thyroid Imaging Reporting and Data System Improves the Diagnosis of Genetic Risk. Front Oncol 2020; 10:591846. [PMID: 33282741 PMCID: PMC7689011 DOI: 10.3389/fonc.2020.591846] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2020] [Accepted: 10/19/2020] [Indexed: 12/16/2022] Open
Abstract
Background The role of next generation sequencing (NGS) for identifying high risk mutations in thyroid nodules following fine needle aspiration (FNA) biopsy continues to grow. However, ultrasound diagnosis even using the American College of Radiology's Thyroid Imaging Reporting and Data System (TI-RADS) has limited ability to stratify genetic risk. The purpose of this study was to incorporate an artificial intelligence (AI) algorithm of thyroid ultrasound with object detection within the TI-RADS scoring system to improve prediction of genetic risk in these nodules. Methods Two hundred fifty-two nodules from 249 patients that underwent ultrasound imaging and ultrasound-guided FNA with NGS with or without resection were retrospectively selected for this study. A machine learning program (Google AutoML) was employed for both automated nodule identification and risk stratification. Two hundred one nodules were used for model training and 51 reserved for testing. Three blinded radiologists scored the images of the test set nodules using TI-RADS and assigned each nodule as high or low risk based on the presence of highly suspicious imaging features on TI-RADS (very hypoechoic, taller-than-wide, extra-thyroidal extension, punctate echogenic foci). Subsequently, the TI-RADS classification was modified to incorporate AI for T4 nodules while treating T1-3 as low risk and T5 as high risk. All diagnostic predictions were compared to the presence of a high-risk mutation and pathology when available. Results The AI algorithm correctly located all nodules in the test dataset (100% object detection). The model predicted the malignancy risk with a sensitivity of 73.9%, specificity of 70.8%, positive predictive value (PPV) of 70.8%, negative predictive value (NPV) of 73.9% and accuracy of 72.4% during the testing. The radiologists performed with a sensitivity of 52.1 ± 4.4%, specificity of 65.2 ± 6.4%, PPV of 59.1 ± 3.5%, NPV of 58.7 ± 1.8%, and accuracy of 58.8 ± 2.5% when using TI-RADS and sensitivity of 53.6 ± 17.6% (p=0.87), specificity of 83.3 ± 7.2% (p=0.06), PPV of 75.7 ± 8.5% (p=0.13), NPV of 66.0 ± 8.8% (p=0.31), and accuracy of 68.7 ± 7.4% (p=0.21) when using AI-modified TI-RADS. Conclusions Incorporation of AI into TI-RADS improved radiologist performance and showed better malignancy risk prediction than AI alone when classifying thyroid nodules. Employing AI in existing thyroid nodule classification systems may help more accurately identifying high-risk nodules.
Collapse
Affiliation(s)
- Shuo Wang
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, United States
| | - Jiajun Xu
- Department of Ultrasound, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Aylin Tahmasebi
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, United States
| | - Kelly Daniels
- Department of Otolaryngology, Thomas Jefferson University, Philadelphia, PA, United States.,Department of Otolaryngology, University of Pittsburgh Medical Center, Pittsburgh, PA, United States
| | - Ji-Bin Liu
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, United States
| | - Joseph Curry
- Department of Otolaryngology, Thomas Jefferson University, Philadelphia, PA, United States
| | - Elizabeth Cottrill
- Department of Otolaryngology, Thomas Jefferson University, Philadelphia, PA, United States
| | - Andrej Lyshchik
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, United States
| | - John R Eisenbrey
- Department of Radiology, Thomas Jefferson University, Philadelphia, PA, United States
| |
Collapse
|
20
|
Tama BA, Kim DH, Kim G, Kim SW, Lee S. Recent Advances in the Application of Artificial Intelligence in Otorhinolaryngology-Head and Neck Surgery. Clin Exp Otorhinolaryngol 2020; 13:326-339. [PMID: 32631041 PMCID: PMC7669308 DOI: 10.21053/ceo.2020.00654] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Revised: 05/24/2020] [Accepted: 06/09/2020] [Indexed: 12/12/2022] Open
Abstract
This study presents an up-to-date survey of the use of artificial intelligence (AI) in the field of otorhinolaryngology, considering opportunities, research challenges, and research directions. We searched PubMed, the Cochrane Central Register of Controlled Trials, Embase, and the Web of Science. We initially retrieved 458 articles. The exclusion of non-English publications and duplicates yielded a total of 90 remaining studies. These 90 studies were divided into those analyzing medical images, voice, medical devices, and clinical diagnoses and treatments. Most studies (42.2%, 38/90) used AI for image-based analysis, followed by clinical diagnoses and treatments (24 studies). Each of the remaining two subcategories included 14 studies. Machine learning and deep learning have been extensively applied in the field of otorhinolaryngology. However, the performance of AI models varies and research challenges remain.
Collapse
Affiliation(s)
- Bayu Adhi Tama
- Department of Mechanical Engineering, Pohang University of Science and Technology, Pohang, Korea
| | - Do Hyun Kim
- Department of Otolaryngology-Head and Neck Surgery, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Gyuwon Kim
- Department of Mechanical Engineering, Pohang University of Science and Technology, Pohang, Korea
| | - Soo Whan Kim
- Department of Otolaryngology-Head and Neck Surgery, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Seungchul Lee
- Department of Mechanical Engineering, Pohang University of Science and Technology, Pohang, Korea
- Graduate School of Artificial Intelligence, Pohang University of Science and Technology, Pohang, Korea
| |
Collapse
|
21
|
Sriharsha GMD, Nirmal P, Haresh NMD, Laurence NMD, Andrej LMDP, Patrick OMD, Jesse CMD, John REP. Automated Machine Learning in the Sonographic Diagnosis of Non-alcoholic Fatty Liver Disease. ADVANCED ULTRASOUND IN DIAGNOSIS AND THERAPY 2020. [DOI: 10.37015/audt.2020.200008] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
|