1
|
Iwai T, Kida M, Okuwaki K, Watanabe M, Adachi K, Ishizaki J, Hanaoka T, Tamaki A, Tadehara M, Imaizumi H, Kusano C. Deep learning analysis for differential diagnosis and risk classification of gastrointestinal tumors. Scand J Gastroenterol 2024; 59:925-932. [PMID: 38950889 DOI: 10.1080/00365521.2024.2368241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Revised: 05/24/2024] [Accepted: 06/08/2024] [Indexed: 07/03/2024]
Abstract
OBJECTIVES Recently, artificial intelligence (AI) has been applied to clinical diagnosis. Although AI has already been developed for gastrointestinal (GI) tract endoscopy, few studies have applied AI to endoscopic ultrasound (EUS) images. In this study, we used a computer-assisted diagnosis (CAD) system with deep learning analysis of EUS images (EUS-CAD) and assessed its ability to differentiate GI stromal tumors (GISTs) from other mesenchymal tumors and their risk classification performance. MATERIALS AND METHODS A total of 101 pathologically confirmed cases of subepithelial lesions (SELs) arising from the muscularis propria layer, including 69 GISTs, 17 leiomyomas and 15 schwannomas, were examined. A total of 3283 EUS images were used for training and five-fold-cross-validation, and 827 images were independently tested for diagnosing GISTs. For the risk classification of 69 GISTs, including very-low-, low-, intermediate- and high-risk GISTs, 2,784 EUS images were used for training and three-fold-cross-validation. RESULTS For the differential diagnostic performance of GIST among all SELs, the accuracy, sensitivity, specificity and area under the receiver operating characteristic (ROC) curve were 80.4%, 82.9%, 75.3% and 0.865, respectively, whereas those for intermediate- and high-risk GISTs were 71.8%, 70.2%, 72.0% and 0.771, respectively. CONCLUSIONS The EUS-CAD system showed a good diagnostic yield in differentiating GISTs from other mesenchymal tumors and successfully demonstrated the GIST risk classification feasibility. This system can determine whether treatment is necessary based on EUS imaging alone without the need for additional invasive examinations.
Collapse
Affiliation(s)
- Tomohisa Iwai
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Mitsuhiro Kida
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Kosuke Okuwaki
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Masafumi Watanabe
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Kai Adachi
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Junro Ishizaki
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Taro Hanaoka
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Akihiro Tamaki
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Masayoshi Tadehara
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Hiroshi Imaizumi
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Chika Kusano
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| |
Collapse
|
2
|
Dong Z, Zhao X, Zheng H, Zheng H, Chen D, Cao J, Xiao Z, Sun Y, Zhuang Q, Wu S, Xia J, Ning M, Qin B, Zhou H, Bao J, Wan X. Efficacy of real-time artificial intelligence-aid endoscopic ultrasonography diagnostic system in discriminating gastrointestinal stromal tumors and leiomyomas: a multicenter diagnostic study. EClinicalMedicine 2024; 73:102656. [PMID: 38828130 PMCID: PMC11137341 DOI: 10.1016/j.eclinm.2024.102656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Revised: 05/03/2024] [Accepted: 05/07/2024] [Indexed: 06/05/2024] Open
Abstract
Background Gastrointestinal stromal tumors (GISTs) represent the most prevalent type of subepithelial lesions (SELs) with malignant potential. Current imaging tools struggle to differentiate GISTs from leiomyomas. This study aimed to create and assess a real-time artificial intelligence (AI) system using endoscopic ultrasonography (EUS) images to differentiate between GISTs and leiomyomas. Methods The AI system underwent development and evaluation using EUS images from 5 endoscopic centers in China between January 2020 and August 2023. EUS images of 1101 participants with SELs were retrospectively collected for AI system development. A cohort of 241 participants with SELs was recruited for external AI system evaluation. Another cohort of 59 participants with SELs was prospectively enrolled to assess the real-time clinical application of the AI system. The AI system's performance was compared to that of endoscopists. This study is registered with Chictr.org.cn, Number ChiCT2000035787. Findings The AI system displayed an area under the curve (AUC) of 0.948 (95% CI: 0.921-0.969) for discriminating GISTs and leiomyomas. The AI system's accuracy (ACC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) reached 91.7% (95% CI 87.5%-94.6%), 90.3% (95% CI 83.4%-94.5%), 93.0% (95% CI 87.2%-96.3%), 91.9% (95% CI 85.3%-95.7%), and 91.5% (95% CI 85.5%-95.2%), respectively. Moreover, the AI system exhibited excellent performance in diagnosing ≤20 mm SELs (ACC 93.5%, 95% CI 0.900-0.969). In a prospective real-time clinical application trial, the AI system achieved an AUC of 0.865 (95% CI 0.764-0.966) and 0.864 (95% CI 0.762-0.966) for GISTs and leiomyomas diagnosis, respectively, markedly surpassing endoscopists [AUC 0.698 (95% CI 0.562-0.834) for GISTs and AUC 0.695 (95% CI 0.546-0.825) for leiomyomas]. Interpretation We successfully developed a real-time AI-assisted EUS diagnostic system. The incorporation of the real-time AI system during EUS examinations can assist endoscopists in rapidly and accurately differentiating various types of SELs in clinical practice, facilitating improved diagnostic and therapeutic decision-making. Funding Science and Technology Commission Foundation of Shanghai Municipality, Science and Technology Commission Foundation of the Xuhui District, the Interdisciplinary Program of Shanghai Jiao Tong University and the Research Funds of Shanghai Sixth people's Hospital.
Collapse
Affiliation(s)
- Zhixia Dong
- Digestive Endoscopic Center, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Xiangyun Zhao
- Digestive Endoscopic Center, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Hangbin Zheng
- College of Mechanical Engineering, Dong Hua University, Shanghai, China
| | - HanYao Zheng
- College of Mechanical Engineering, Dong Hua University, Shanghai, China
| | - Dafan Chen
- Digestive Endoscopic Center, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jia Cao
- Endoscopy Center, Department of Gastroenterology, Shanghai East Hospital, Tongji University School of Medicine, Shanghai, China
| | - Zili Xiao
- Digestive Endoscopic Department, Huadong Hospital Affiliated to Fudan University, Shanghai, China
| | - Yunwei Sun
- Department of Gastroenterology, Shanghai Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qian Zhuang
- Digestive Endoscopic Center, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shan Wu
- Digestive Endoscopic Center, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jie Xia
- Digestive Endoscopic Center, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Min Ning
- Digestive Endoscopic Center, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Binjie Qin
- School of Biomedical Engineering, Shanghai Jiao Tong University, China
| | - Hui Zhou
- Department of Gastroenterology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jinsong Bao
- College of Mechanical Engineering, Dong Hua University, Shanghai, China
| | - Xinjian Wan
- Digestive Endoscopic Center, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
3
|
Liu J, Huang J, Song Y, He Q, Fang W, Wang T, Zheng Z, Liu W. Differentiating Gastrointestinal Stromal Tumors From Leiomyomas of Upper Digestive Tract Using Convolutional Neural Network Model by Endoscopic Ultrasonography. J Clin Gastroenterol 2024; 58:574-579. [PMID: 37646533 DOI: 10.1097/mcg.0000000000001907] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Accepted: 07/16/2023] [Indexed: 09/01/2023]
Abstract
BACKGROUND Gastrointestinal stromal tumors (GISTs) and leiomyomas are the most common submucosal tumors of the upper digestive tract, and the diagnosis of the tumors is essential for their treatment and prognosis. However, the ability of endoscopic ultrasonography (EUS) which could correctly identify the tumor types is limited and closely related to the knowledge, operational level, and experience of the endoscopists. Therefore, the convolutional neural network (CNN) is used to assist endoscopists in determining GISTs or leiomyomas with EUS. MATERIALS AND METHODS A model based on CNN was constructed according to GoogLeNet architecture to distinguish GISTs or leiomyomas. All EUS images collected from this study were randomly sampled and divided into training set (n=411) and testing set (n=103) in a ratio of 4:1. The CNN model was trained by EUS images from the training set, and the testing set was utilized to evaluate the performance of the CNN model. In addition, there were some comparisons between endoscopists and CNN models. RESULTS It was shown that the sensitivity and specificity in identifying leiomyoma were 95.92%, 94.44%, sensitivity and specificity in identifying GIST were 94.44%, 95.92%, and accuracy in total was 95.15% of the CNN model. It indicates that the diagnostic accuracy of the CNN model is equivalent to skilled endoscopists, or even higher than them. CONCLUSION While identifying GIST or leiomyoma, the performance of CNN model was robust, which is highlighting its promising role in supporting less-experienced endoscopists and reducing interobserver agreement.
Collapse
Affiliation(s)
- Jing Liu
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital
| | - Jia Huang
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital
| | - Yan Song
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital
| | - Qi He
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, China
| | - Weili Fang
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital
| | - Tao Wang
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital
| | - Zhongqing Zheng
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital
| | - Wentian Liu
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital
| |
Collapse
|
4
|
Joo DC, Kim GH, Lee MW, Lee BE, Kim JW, Kim KB. Artificial Intelligence-Based Diagnosis of Gastric Mesenchymal Tumors Using Digital Endosonography Image Analysis. J Clin Med 2024; 13:3725. [PMID: 38999291 PMCID: PMC11242784 DOI: 10.3390/jcm13133725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Revised: 06/13/2024] [Accepted: 06/23/2024] [Indexed: 07/14/2024] Open
Abstract
Background/Objectives: Artificial intelligence (AI)-assisted endoscopic ultrasonography (EUS) diagnostic tools have shown excellent performance in diagnosing gastric mesenchymal tumors. This study aimed to assess whether incorporating clinical and endoscopic factors into AI-assisted EUS classification models based on digital image analysis could improve the diagnostic performance of AI-assisted EUS diagnostic tools. Methods: We retrospectively analyzed the data of 464 patients who underwent both EUS and surgical resection of gastric mesenchymal tumors, including 294 gastrointestinal stromal tumors (GISTs), 52 leiomyomas, and 41 schwannomas. AI-assisted classification models for GISTs and non-GIST tumors were developed utilizing clinical and endoscopic factors and digital EUS image analysis. Results: Regarding the baseline EUS classification models, the area under the receiver operating characteristic (AUC) values of the logistic regression, decision tree, random forest, K-nearest neighbor (KNN), and support vector machine (SVM) models were 0.805, 0.673, 0.781, 0.740, and 0.791, respectively. Using the new classification models incorporating clinical and endoscopic factors into the baseline classification models, the AUC values of the logistic regression, decision tree, random forest, KNN, and SVM models increased to 0.853, 0.715, 0.896, 0.825, and 0.794, respectively. In particular, the random forest and KNN models exhibited significant improvement in performance in Delong's test (both p < 0.001). Conclusion: The diagnostic performance of the AI-assisted EUS classification models improved when clinical and endoscopic factors were incorporated. Our results provided direction for developing new AI-assisted EUS models for gastric mesenchymal tumors.
Collapse
Affiliation(s)
- Dong Chan Joo
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan 49241, Republic of Korea
| | - Gwang Ha Kim
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan 49241, Republic of Korea
| | - Moon Won Lee
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan 49241, Republic of Korea
| | - Bong Eun Lee
- Department of Internal Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan 49241, Republic of Korea
| | - Ji Woo Kim
- Department of Convergence Medical Sciences, The Graduate School Pusan National University, Busan 46241, Republic of Korea
| | - Kwang Baek Kim
- Department of Computer Engineering, Silla University, Busan 46958, Republic of Korea
| |
Collapse
|
5
|
Impellizzeri G, Donato G, De Angelis C, Pagano N. Diagnostic Endoscopic Ultrasound (EUS) of the Luminal Gastrointestinal Tract. Diagnostics (Basel) 2024; 14:996. [PMID: 38786295 PMCID: PMC11120241 DOI: 10.3390/diagnostics14100996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Revised: 05/05/2024] [Accepted: 05/08/2024] [Indexed: 05/25/2024] Open
Abstract
The purpose of this review is to focus on the diagnostic endoscopic ultrasound of the gastrointestinal tract. In the last decades, EUS has gained a central role in the staging of epithelial and sub-epithelial lesions of the gastrointestinal tract. With the evolution of imaging, the position of EUS in the diagnostic work-up and the staging flow-chart has continuously changed with two extreme positions: some gastroenterologists think that EUS is absolutely indispensable, and some think it is utterly useless. The truth is, as always, somewhere in between the two extremes. Analyzing the most up-to-date and strong evidence, we will try to give EUS the correct position in our daily practice.
Collapse
Affiliation(s)
| | | | | | - Nico Pagano
- Gastroenterology Unit, Department of Oncological and Specialty Medicine, Azienda Ospedaliero-Universitaria Maggiore della Carità, 28100 Novara, Italy; (G.I.); (C.D.A.)
| |
Collapse
|
6
|
Kuwahara T, Hara K, Mizuno N, Haba S, Okuno N, Fukui T, Urata M, Yamamoto Y. Current status of artificial intelligence analysis for the treatment of pancreaticobiliary diseases using endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography. DEN OPEN 2024; 4:e267. [PMID: 37397344 PMCID: PMC10312781 DOI: 10.1002/deo2.267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 06/18/2023] [Indexed: 07/04/2023]
Abstract
Pancreatic and biliary diseases encompass a range of conditions requiring accurate diagnosis for appropriate treatment strategies. This diagnosis relies heavily on imaging techniques like endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography. Artificial intelligence (AI), including machine learning and deep learning, is becoming integral in medical imaging and diagnostics, such as the detection of colorectal polyps. AI shows great potential in diagnosing pancreatobiliary diseases. Unlike machine learning, which requires feature extraction and selection, deep learning can utilize images directly as input. Accurate evaluation of AI performance is a complex task due to varied terminologies, evaluation methods, and development stages. Essential aspects of AI evaluation involve defining the AI's purpose, choosing appropriate gold standards, deciding on the validation phase, and selecting reliable validation methods. AI, particularly deep learning, is increasingly employed in endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography diagnostics, achieving high accuracy levels in detecting and classifying various pancreatobiliary diseases. The AI often performs better than doctors, even in tasks like differentiating benign from malignant pancreatic tumors, cysts, and subepithelial lesions, identifying gallbladder lesions, assessing endoscopic retrograde cholangiopancreatography difficulty, and evaluating the biliary strictures. The potential for AI in diagnosing pancreatobiliary diseases, especially where other modalities have limitations, is considerable. However, a crucial constraint is the need for extensive, high-quality annotated data for AI training. Future advances in AI, such as large language models, promise further applications in the medical field.
Collapse
Affiliation(s)
| | - Kazuo Hara
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Nobumasa Mizuno
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Shin Haba
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Nozomi Okuno
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Toshitaka Fukui
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Minako Urata
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | | |
Collapse
|
7
|
Chen X, Zhou J, Wang P, Wang P, Wang L, Mu L, Lang C, Mu Y, Wang X, Shang R, Li Q, Lv H, Wu K, Shi N, Jia X, Lai Y, Zhang Y, Li Z, Zhong N. Endoscopic ultrasound-based application system for predicting endoscopic resection-related outcomes and diagnosing subepithelial lesions: Multicenter prospective study. Dig Endosc 2024; 36:141-151. [PMID: 37059698 DOI: 10.1111/den.14568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 04/13/2023] [Indexed: 04/16/2023]
Abstract
OBJECTIVES Subepithelial lesions (SELs) are associated with various endoscopic resection (ER) outcomes and diagnostic challenges. We aimed to establish a tool for predicting ER-related outcomes and diagnosing SELs and to investigate the predictive value of endoscopic ultrasound (EUS). METHODS Phase 1 (system development) was performed in a retrospective cohort (n = 837) who underwent EUS before ER for SELs at eight hospitals. Prediction models for five key outcomes were developed using logistic regression. Models with satisfactory internal validation performance were included in a mobile application system, SEL endoscopic resection predictor (SELERP). In Phase 2, the models were externally validated in a prospective cohort of 200 patients. RESULTS An SELERP was developed using EUS characteristics, which included 10 models for five key outcomes: post-ER ulcer management, short procedure time, long hospital stay, high medication costs, and diagnosis of SELs. In Phase 1, 10 models were derived and validated (C-statistics, 0.67-0.99; calibration-in-the-large, -0.14-0.10; calibration slopes, 0.92-1.08). In Phase 2, the derived risk prediction models showed convincing discrimination (C-statistics, 0.64-0.73) and calibration (calibration-in-the-large, -0.02-0.05; calibration slopes, 1.01-1.09) in the prospective cohort. The sensitivities and specificities of the five diagnostic models were 68.3-95.7% and 64.1-83.3%, respectively. CONCLUSION We developed and prospectively validated an application system for the prediction of ER outcomes and diagnosis of SELs, which could aid clinical decision-making and facilitate patient-physician consultation. EUS features significantly contributed to the prediction. TRIAL REGISTRATION Chinese Clinical Trial Registry, http://www.chictr.org.cn (ChiCTR2000040118).
Collapse
Affiliation(s)
- Xinyu Chen
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Qilu Hospital of Shandong University, Jinan, China
| | - Jiawei Zhou
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Qilu Hospital of Shandong University, Jinan, China
| | - Peizhu Wang
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Qilu Hospital of Shandong University, Jinan, China
| | - Peng Wang
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
| | - Limei Wang
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
| | - Linjun Mu
- Department of Gastroenterology, Weifang People's Hospital, Weifang, China
| | - Cuicui Lang
- Department of Gastroenterology, Liaocheng People's Hospital, Liaocheng, China
| | - Ying Mu
- Department of Gastroenterology, Liaocheng People's Hospital, Liaocheng, China
| | - Xiaohong Wang
- Department of Gastroenterology, The Affiliated Taian City Centeral Hospital of Qingdao University, Taian, China
| | - Ruilian Shang
- Department of Gastroenterology, The 960th Hospital of the PLA Joint Logistics Support Force, Jinan, China
| | - Qun Li
- Department of Gastroenterology, The 960th Hospital of the PLA Joint Logistics Support Force, Jinan, China
| | - Hongna Lv
- Department of Gastroenterology and Hepatology, Binzhou People's Hospital, Binzhou, China
| | - Kangkang Wu
- Department of Gastroenterology, Qilu Hospital of Shandong University (Qingdao), Qingdao, China
| | - Ning Shi
- Department of Gastroenterology, Binzhou Medical University Hospital, Binzhou, China
| | - Xingfang Jia
- Department of Gastroenterology, Binzhou Medical University Hospital, Binzhou, China
| | - Yonghang Lai
- Qingdao Medicon Digital Engineering Co., Ltd., Qingdao, China
| | - Yiyan Zhang
- Qingdao Medicon Digital Engineering Co., Ltd., Qingdao, China
| | - Zhen Li
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
| | - Ning Zhong
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, China
| |
Collapse
|
8
|
Lu Y, Wu J, Hu M, Zhong Q, Er L, Shi H, Cheng W, Chen K, Liu Y, Qiu B, Xu Q, Lai G, Wang Y, Luo Y, Mu J, Zhang W, Zhi M, Sun J. Artificial Intelligence in the Prediction of Gastrointestinal Stromal Tumors on Endoscopic Ultrasonography Images: Development, Validation and Comparison with Endosonographers. Gut Liver 2023; 17:874-883. [PMID: 36700302 PMCID: PMC10651383 DOI: 10.5009/gnl220347] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 09/19/2022] [Accepted: 10/07/2022] [Indexed: 01/27/2023] Open
Abstract
Background/Aims The accuracy of endosonographers in diagnosing gastric subepithelial lesions (SELs) using endoscopic ultrasonography (EUS) is influenced by experience and subjectivity. Artificial intelligence (AI) has achieved remarkable development in this field. This study aimed to develop an AI-based EUS diagnostic model for the diagnosis of SELs, and evaluated its efficacy with external validation. Methods We developed the EUS-AI model with ResNeSt50 using EUS images from two hospitals to predict the histopathology of the gastric SELs originating from muscularis propria. The diagnostic performance of the model was also validated using EUS images obtained from four other hospitals. Results A total of 2,057 images from 367 patients (375 SELs) were chosen to build the models, and 914 images from 106 patients (108 SELs) were chosen for external validation. The sensitivity, specificity, positive predictive value, negative predictive value, and accuracy of the model for differentiating gastrointestinal stromal tumors (GISTs) and non-GISTs in the external validation sets by images were 82.01%, 68.22%, 86.77%, 59.86%, and 78.12%, respectively. The sensitivity, specificity, positive predictive value, negative predictive value, and accuracy in the external validation set by tumors were 83.75%, 71.43%, 89.33%, 60.61%, and 80.56%, respectively. The EUS-AI model showed better performance (especially specificity) than some endosonographers. The model helped improve the sensitivity, specificity, and accuracy of certain endosonographers. Conclusions We developed an EUS-AI model to classify gastric SELs originating from muscularis propria into GISTs and non-GISTs with good accuracy. The model may help improve the diagnostic performance of endosonographers. Further work is required to develop a multi-modal EUS-AI system.
Collapse
Affiliation(s)
- Yi Lu
- Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Jiachuan Wu
- Digestive Endoscopy Center, Guangdong Second Provincial General Hospital, Sun Yat-sen University, Guangzhou, China
| | - Minhui Hu
- Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Qinghua Zhong
- Department of Endoscopic Surgery, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Limian Er
- Department of Endoscopy, The Fourth Hospital of Hebei Medical University, Shijiazhuang, China
| | - Huihui Shi
- Department of Endoscopy, The Fourth Hospital of Hebei Medical University, Shijiazhuang, China
| | - Weihui Cheng
- Department of Gastroenterology, Yangjiang Hospital of Traditional Chinese Medicine, Yangjiang, China
| | - Ke Chen
- Department of Endoscopy, Fudan University Shanghai Cancer Center, Shanghai, China
| | - Yuan Liu
- Department of Endoscopy, Fudan University Shanghai Cancer Center, Shanghai, China
| | - Bingfeng Qiu
- Department of Gastroenterology, Zhoushan Hospital of Zhejiang Province, Zhoushan, China
| | - Qiancheng Xu
- Department of Gastroenterology, Zhoushan Hospital of Zhejiang Province, Zhoushan, China
| | - Guangshun Lai
- Department of Gastroenterology, Lianjiang People’s Hospital, Lianjiang, China
| | - Yufeng Wang
- Tianjin Economic-Technological Development Area (TEDA) Yujin Digestive Health Industry Research Institute, Tianjin, China
| | - Yuxuan Luo
- Tianjin Economic-Technological Development Area (TEDA) Yujin Digestive Health Industry Research Institute, Tianjin, China
| | - Jinbao Mu
- Tianjin Economic-Technological Development Area (TEDA) Yujin Digestive Health Industry Research Institute, Tianjin, China
| | - Wenjie Zhang
- Tianjin Center for Medical Devices Evaluation and Inspection, Tianjin, China
| | - Min Zhi
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- Department of Gastroenterology, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Jiachen Sun
- Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
9
|
Li X, Zhang C, Yao L, Zhang J, Zhang K, Feng H, Yu H. A deep learning-based system to identify originating mural layer of upper gastrointestinal submucosal tumors under EUS. Endosc Ultrasound 2023; 12:465-471. [PMID: 38948124 PMCID: PMC11213599 DOI: 10.1097/eus.0000000000000029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/02/2024] Open
Abstract
Background and Objective EUS is the most accurate procedure to determine the originating mural layer and subsequently select the treatment of submucosal tumors (SMTs). However, it requires superb technical and cognitive skills. In this study, we propose a system named SMT Master to determine the originating mural layer of SMTs under EUS. Materials and Methods We developed 3 models: deep convolutional neural network (DCNN) 1 for lesion segmentation, DCNN2 for mural layer segmentation, and DCNN3 for the originating mural layer classification. A total of 2721 EUS images from 201 patients were used to train the 3 models. We validated our model internally and externally using 283 images from 26 patients and 172 images from 26 patients, respectively. We applied 368 images from 30 patients for the man-machine contest and used 30 video clips to test the originating mural layer classification. Results In the originating mural layer classification task, DCNN3 achieved a classification accuracy of 84.43% and 80.68% at internal and external validations, respectively. In the video test, the accuracy was 80.00%. DCNN1 achieved Dice coefficients of 0.956 and 0.776 for lesion segmentation at internal and external validations, respectively, whereas DCNN2 achieved Dice coefficients of 0.820 and 0.740 at internal and external validations, respectively. The system achieved 90.00% accuracy in classification, which is comparable with that of EUS experts. Conclusions Our proposed system has the potential to solve difficulties in determining the originating mural layer of SMTs in EUS procedures, which relieves the EUS learning pressure of physicians.
Collapse
Affiliation(s)
- Xun Li
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Chenxia Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Liwen Yao
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Jun Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Kun Zhang
- Wuhan Union Hospital, Huazhong University of Science and Technology, Wuhan, Hubei Province, China
| | - Hui Feng
- Information center, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Honggang Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| |
Collapse
|
10
|
Arif AA, Jiang SX, Byrne MF. Artificial intelligence in endoscopy: Overview, applications, and future directions. Saudi J Gastroenterol 2023; 29:269-277. [PMID: 37787347 PMCID: PMC10644999 DOI: 10.4103/sjg.sjg_286_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 08/16/2023] [Indexed: 09/15/2023] Open
Abstract
Since the emergence of artificial intelligence (AI) in medicine, endoscopy applications in gastroenterology have been at the forefront of innovations. The ever-increasing number of studies necessitates the need to organize and classify applications in a useful way. Separating AI capabilities by computer aided detection (CADe), diagnosis (CADx), and quality assessment (CADq) allows for a systematic evaluation of each application. CADe studies have shown promise in accurate detection of esophageal, gastric and colonic neoplasia as well as identifying sources of bleeding and Crohn's disease in the small bowel. While more advanced CADx applications employ optical biopsies to give further information to characterize neoplasia and grade inflammatory disease, diverse CADq applications ensure quality and increase the efficiency of procedures. Future applications show promise in advanced therapeutic modalities and integrated systems that provide multimodal capabilities. AI is set to revolutionize clinical decision making and performance of endoscopy.
Collapse
Affiliation(s)
- Arif A. Arif
- Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Shirley X. Jiang
- Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Michael F. Byrne
- Division of Gastroenterology, Department of Medicine, University of British Columbia, Vancouver, BC, Canada
- Satisfai Health, Vancouver, BC, Canada
| |
Collapse
|
11
|
Zhang R, Zhang F, Qin S, Fan D, Fang C, Ma J, Wan X, Li G, Lin X. Multi-Task Learning With Hierarchical Guidance for Locating and Stratifying Submucosal Tumors. IEEE J Biomed Health Inform 2023; 27:4478-4488. [PMID: 37459259 DOI: 10.1109/jbhi.2023.3291433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/07/2023]
Abstract
Locating and stratifying the submucosal tumor of the digestive tract from endoscopy ultrasound (EUS) images are of vital significance to the preliminary diagnosis of tumors. However, the above problems are challenging, due to the poor appearance contrast between different layers of the digestive tract wall (DTW) and the narrowness of each layer. Few of existing deep-learning based diagnosis algorithms are devised to tackle this issue. In this article, we build a multi-task framework for simultaneously locating and stratifying the submucosal tumor. And considering the awareness of the DTW is critical to the localization and stratification of the tumor, we integrate the DTW segmentation task into the proposed multi-task framework. Except for sharing a common backbone model, the three tasks are explicitly directed with a hierarchical guidance module, in which the probability map of DTW itself is used to locally enhance the feature representation for tumor localization, and the probability maps of DTW and tumor are jointly employed to locally enhance the feature representation for tumor stratification. Moreover, by means of the dynamic class activation map, probability maps of DTW and tumor are reused to enforce the stratification inference process to pay more attention to DTW and tumor regions, contributing to a reliable and interpretable submucosal tumor stratification model. Additionally, considering the relation with respect to other structures is beneficial for stratifying tumors, we devise a graph reasoning module to replenish non-local relation knowledge for the stratification branch. Experiments on a Stomach-Esophagus and an Intestinal EUS dataset prove that our method achieves very appealing performance on both tumor localization and stratification, significantly outperforming state-of-the-art object detection approaches.
Collapse
|
12
|
Huang J, Fan X, Liu W. Applications and Prospects of Artificial Intelligence-Assisted Endoscopic Ultrasound in Digestive System Diseases. Diagnostics (Basel) 2023; 13:2815. [PMID: 37685350 PMCID: PMC10487217 DOI: 10.3390/diagnostics13172815] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 08/22/2023] [Accepted: 08/27/2023] [Indexed: 09/10/2023] Open
Abstract
Endoscopic ultrasound (EUS) has emerged as a widely utilized tool in the diagnosis of digestive diseases. In recent years, the potential of artificial intelligence (AI) in healthcare has been gradually recognized, and its superiority in the field of EUS is becoming apparent. Machine learning (ML) and deep learning (DL) are the two main AI algorithms. This paper aims to outline the applications and prospects of artificial intelligence-assisted endoscopic ultrasound (EUS-AI) in digestive diseases over the past decade. The results demonstrated that EUS-AI has shown superiority or at least equivalence to traditional methods in the diagnosis, prognosis, and quality control of subepithelial lesions, early esophageal cancer, early gastric cancer, and pancreatic diseases including pancreatic cystic lesions, autoimmune pancreatitis, and pancreatic cancer. The implementation of EUS-AI has opened up new avenues for individualized precision medicine and has introduced novel diagnostic and treatment approaches for digestive diseases.
Collapse
Affiliation(s)
| | | | - Wentian Liu
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital, No. 154, Anshan Road, Heping District, Tianjin 300052, China; (J.H.); (X.F.)
| |
Collapse
|
13
|
Gomes RSA, de Oliveira GHP, de Moura DTH, Kotinda APST, Matsubayashi CO, Hirsch BS, Veras MDO, Ribeiro Jordão Sasso JG, Trasolini RP, Bernardo WM, de Moura EGH. Endoscopic ultrasound artificial intelligence-assisted for prediction of gastrointestinal stromal tumors diagnosis: A systematic review and meta-analysis. World J Gastrointest Endosc 2023; 15:528-539. [PMID: 37663113 PMCID: PMC10473903 DOI: 10.4253/wjge.v15.i8.528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 06/15/2023] [Accepted: 07/24/2023] [Indexed: 08/10/2023] Open
Abstract
BACKGROUND Subepithelial lesions (SELs) are gastrointestinal tumors with heterogeneous malignant potential. Endoscopic ultrasonography (EUS) is the leading method for evaluation, but without histopathological analysis, precise differentiation of SEL risk is limited. Artificial intelligence (AI) is a promising aid for the diagnosis of gastrointestinal lesions in the absence of histopathology. AIM To determine the diagnostic accuracy of AI-assisted EUS in diagnosing SELs, especially lesions originating from the muscularis propria layer. METHODS Electronic databases including PubMed, EMBASE, and Cochrane Library were searched. Patients of any sex and > 18 years, with SELs assessed by EUS AI-assisted, with previous histopathological diagnosis, and presented sufficient data values which were extracted to construct a 2 × 2 table. The reference standard was histopathology. The primary outcome was the accuracy of AI for gastrointestinal stromal tumor (GIST). Secondary outcomes were AI-assisted EUS diagnosis for GIST vs gastrointestinal leiomyoma (GIL), the diagnostic performance of experienced endoscopists for GIST, and GIST vs GIL. Pooled sensitivity, specificity, positive, and negative predictive values were calculated. The corresponding summary receiver operating characteristic curve and post-test probability were also analyzed. RESULTS Eight retrospective studies with a total of 2355 patients and 44154 images were included in this meta-analysis. The AI-assisted EUS for GIST diagnosis showed a sensitivity of 92% [95% confidence interval (CI): 0.89-0.95; P < 0.01), specificity of 80% (95%CI: 0.75-0.85; P < 0.01), and area under the curve (AUC) of 0.949. For diagnosis of GIST vs GIL by AI-assisted EUS, specificity was 90% (95%CI: 0.88-0.95; P = 0.02) and AUC of 0.966. The experienced endoscopists' values were sensitivity of 72% (95%CI: 0.67-0.76; P < 0.01), specificity of 70% (95%CI: 0.64-0.76; P < 0.01), and AUC of 0.777 for GIST. Evaluating GIST vs GIL, the experts achieved a sensitivity of 73% (95%CI: 0.65-0.80; P < 0.01) and an AUC of 0.819. CONCLUSION AI-assisted EUS has high diagnostic accuracy for fourth-layer SELs, especially for GIST, demonstrating superiority compared to experienced endoscopists' and improving their diagnostic performance in the absence of invasive procedures.
Collapse
Affiliation(s)
- Rômulo Sérgio Araújo Gomes
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | | | - Diogo Turiani Hourneaux de Moura
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | - Ana Paula Samy Tanaka Kotinda
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | - Carolina Ogawa Matsubayashi
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | - Bruno Salomão Hirsch
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | - Matheus de Oliveira Veras
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | | | - Roberto Paolo Trasolini
- Division of Hepatology and Endoscopy, Department of Gastroenterology, Harvard Medical School, Brigham and Women’s Hospital, Boston, MA 02115, United States
| | - Wanderley Marques Bernardo
- Department of Gastroenterology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo 05403-010, Brazil
| | | |
Collapse
|
14
|
Vasilakis T, Ziogas D, Tziatzios G, Gkolfakis P, Koukoulioti E, Kapizioni C, Triantafyllou K, Facciorusso A, Papanikolaou IS. EUS-Guided Diagnosis of Gastric Subepithelial Lesions, What Is New? Diagnostics (Basel) 2023; 13:2176. [PMID: 37443568 DOI: 10.3390/diagnostics13132176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 06/18/2023] [Accepted: 06/23/2023] [Indexed: 07/15/2023] Open
Abstract
Gastric subepithelial lesions (SELs) are intramural lesions that arise underneath the gastric mucosa. SELs can be benign, but can also be malignant or have malignant potential. Therefore, correct diagnosis is crucial. Endosonography has been established as the diagnostic gold standard. Although the identification of some of these lesions can be carried out immediately, solely based on their echo characteristics, for certain lesions histological examination is necessary. Sometimes histology can be inconclusive, especially for smaller lesions. Therefore, new methods have been developed in recent years to assist decision making, such as contrast enhanced endosonography, EUS elastography, and artificial intelligence systems. In this narrative review we provide a complete overview of the gastric SELs and summarize the new data of the last ten years concerning the diagnostic advances of endosonography on this topic.
Collapse
Affiliation(s)
- Thomas Vasilakis
- Hepatology and Gastroenterology Clinic, Charité Campus Mitte, Charitéplatz 1, 10117 Berlin, Germany
| | - Dimitrios Ziogas
- 1st Department of Internal Medicine, 251 Hellenic Air Force & VA General Hospital, 3 Kanellopoulou Str., 11525 Athens, Greece
| | - Georgios Tziatzios
- Department of Gastroenterology, "Konstantopoulio-Patision" General Hospital, 3-5, Theodorou Konstantopoulou Str., Nea Ionia, 14233 Athens, Greece
| | - Paraskevas Gkolfakis
- Department of Gastroenterology, "Konstantopoulio-Patision" General Hospital, 3-5, Theodorou Konstantopoulou Str., Nea Ionia, 14233 Athens, Greece
| | - Eleni Koukoulioti
- Hepatogastroenterology Unit, Second Department of Internal Medicine-Propaedeutic, Medical School, National and Kapodistrian University of Athens, 12462 Athens, Greece
| | - Christina Kapizioni
- Hepatogastroenterology Unit, Second Department of Internal Medicine-Propaedeutic, Medical School, National and Kapodistrian University of Athens, 12462 Athens, Greece
| | - Konstantinos Triantafyllou
- Hepatogastroenterology Unit, Second Department of Internal Medicine-Propaedeutic, Medical School, National and Kapodistrian University of Athens, 12462 Athens, Greece
| | - Antonio Facciorusso
- Department of Medical Sciences, University of Foggia, Section of Gastroenterology, 71122 Foggia, Italy
| | - Ioannis S Papanikolaou
- Hepatogastroenterology Unit, Second Department of Internal Medicine-Propaedeutic, Medical School, National and Kapodistrian University of Athens, 12462 Athens, Greece
| |
Collapse
|
15
|
Lu Y, Chen L, Wu J, Er L, Shi H, Cheng W, Chen K, Liu Y, Qiu B, Xu Q, Feng Y, Tang N, Wan F, Sun J, Zhi M. Artificial intelligence in endoscopic ultrasonography: risk stratification of gastric gastrointestinal stromal tumors. Therap Adv Gastroenterol 2023; 16:17562848231177156. [PMID: 37274299 PMCID: PMC10233610 DOI: 10.1177/17562848231177156] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Accepted: 05/04/2023] [Indexed: 06/06/2023] Open
Abstract
Background Previous studies have identified useful endoscopic ultrasonography (EUS) features to predict the malignant potential of gastrointestinal stromal tumors (GISTs). However, the results of the studies were not consistent. Artificial intelligence (AI) has shown promising results in medicine. Objectives We aimed to build a risk stratification EUS-AI model to predict the malignancy potential of GISTs. Design This was a retrospective study with external validation. Methods We developed two models using EUS images from two hospitals to predict the GIST risk category. Model 1 was the four-category risk EUS-AI model, and Model 2 was the two-category risk EUS-AI model. The diagnostic performance of the models was validated with external cohorts. Results A total of 1320 images (880 were very low-risk, 269 were low-risk, 68 were intermediate-risk, and 103 were high-risk) were finally chosen for building the models and test sets, and a total of 656 images (211 were very low-risk, 266 were low-risk, 88 were intermediate-risk, and 91 were high-risk) were chosen for external validation. The overall accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) for the four-category risk EUS-AI model in the external validation sets by tumor were 74.50%, 55.00%, 79.05%, 53.49%, and 81.63%, respectively. The accuracy, sensitivity, specificity, PPV, and NPV for the two-category risk EUS-AI model for the prediction of very low-risk GISTs in the external validation sets by tumor were 86.25%, 94.44%, 79.55%, 79.07%, and 94.59%, respectively. Conclusion We developed a EUS-AI model for the risk stratification of GISTs with promising results, which may complement current clinical practice in the management of GISTs. Registration The study has been registered in the Chinese Clinical Trial Registry (No. ChiCTR2100051191).
Collapse
Affiliation(s)
- Yi Lu
- Department of Gastrointestinal Endoscopy,
Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases,
The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, People’s
Republic of China
| | - Lu Chen
- Department of Internal Medicine, Advent Health
Palm Coast, Palm Coast, FL, USA
| | - Jiachuan Wu
- Digestive Endoscopy Center, Guangdong Second
Provincial General Hospital, Guangzhou, People’s Republic of China
| | - Limian Er
- Department of Endoscopy, The Fourth Hospital of
Hebei Medical University, Shijiazhuang, People’s Republic of China
| | - Huihui Shi
- Department of Endoscopy, The Fourth Hospital of
Hebei Medical University, Shijiazhuang, People’s Republic of China
| | - Weihui Cheng
- Department of Gastroenterology, Yangjiang
Hospital of Traditional Chinese Medicine, Yangjiang, People’s Republic of
China
| | - Ke Chen
- Department of Endoscopy, Fudan University
Shanghai Cancer Center, Shanghai, People’s Republic of China
| | - Yuan Liu
- Department of Endoscopy, Fudan University
Shanghai Cancer Center, Shanghai, People’s Republic of China
| | - Bingfeng Qiu
- Department of Gastroenterology, Zhoushan
Hospital of Zhejiang Province, Zhoushan, People’s Republic of China
| | - Qiancheng Xu
- Department of Gastroenterology, Zhoushan
Hospital of Zhejiang Province, Zhoushan, People’s Republic of China
| | - Yue Feng
- Tianjin Economic-Technological Development
Area (TEDA) Yujin Digestive Health Industry Research Institute, Tianjin,
People’s Republic of China
| | - Nan Tang
- Tianjin Center for Medical Devices Evaluation
and Inspection, Tianjin, People’s Republic of China
| | - Fuchuan Wan
- Tianjin Economic-Technological Development
Area (TEDA) Yujin Artificial Intelligence Medical Technology Co, Ltd,
Tianjin, People’s Republic of China
| | - Jiachen Sun
- Department of Gastrointestinal Endoscopy,
Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases,
The Sixth Affiliated Hospital, Sun Yat-sen University, 26 Yuancun Erheng
Road, Guangzhou 510655, People’s Republic of China
| | - Min Zhi
- Department of Gastroenterology, Guangdong
Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth
Affiliated Hospital, Sun Yat-sen University, 26 Yuancun Erheng Road,
Guangzhou 510655, People’s Republic of China
| |
Collapse
|
16
|
Chen X, You G, Chen Q, Zhang X, Wang N, He X, Zhu L, Li Z, Liu C, Yao S, Ge J, Gao W, Yu H. Development and evaluation of an artificial intelligence system for children intussusception diagnosis using ultrasound images. iScience 2023; 26:106456. [PMID: 37063466 PMCID: PMC10090215 DOI: 10.1016/j.isci.2023.106456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 02/16/2023] [Accepted: 03/16/2023] [Indexed: 03/30/2023] Open
Abstract
Accurate identification of intussusception in children is critical for timely non-surgical management. We propose an end-to-end artificial intelligence algorithm, the Children Intussusception Diagnosis Network (CIDNet) system, that utilizes ultrasound images to rapidly diagnose intussusception. 9999 ultrasound images of 4154 pediatric patients were divided into training, validation, test, and independent reader study datasets. The independent reader study cohort was used to compare the diagnostic performance of the CIDNet system to six radiologists. Performance was evaluated using, among others, balance accuracy (BACC) and area under the receiver operating characteristic curve (AUC). The CIDNet system performed the best in diagnosing intussusception with a BACC of 0.8464 and AUC of 0.9716 in the test dataset compared to other deep learning algorithms. The CIDNet system compared favorably with expert radiologists by outstanding identification performance and robustness (BACC:0.9297; AUC:0.9769). CIDNet is a stable and precise technological tool for identifying intussusception in ultrasound scans of children.
Collapse
Affiliation(s)
- Xiong Chen
- Department of Paediatric Urology, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
- Department of Paediatric Surgery, Guangzhou Institute of Paediatrics, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Guochang You
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou 510080, P. R. China
| | - Qinchang Chen
- Department of Pediatric Cardiology, Guangdong Provincial Key Laboratory of Structural Heart Disease, Guangdong Provincial People’s Hospital, Guangdong Academy of Medical Sciences, Guangdong Cardiovascular Institute, Guangzhou 510080, P. R. China
| | - Xiangxiang Zhang
- Department of Ultrasound, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Na Wang
- Department of Ultrasound, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Xuehua He
- Department of Ultrasound, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Liling Zhu
- Department of Ultrasound, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Zhouzhou Li
- Department of Ultrasound, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Chen Liu
- Department of Ultrasound, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Shixiang Yao
- Department of Ultrasound, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Junshuang Ge
- Clinical Data Center, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
| | - Wenjing Gao
- Clinical Data Center, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
- Corresponding author
| | - Hongkui Yu
- Department of Ultrasound, Guangzhou Women and Children’s Medical Center, Guangzhou Medical University, Guangzhou 510623, P. R. China
- Corresponding author
| |
Collapse
|
17
|
Artificial intelligence-assisted endoscopic ultrasound in the diagnosis of gastrointestinal stromal tumors: a meta-analysis. Surg Endosc 2023; 37:1649-1657. [PMID: 36100781 DOI: 10.1007/s00464-022-09597-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Accepted: 08/25/2022] [Indexed: 10/14/2022]
Abstract
BACKGROUND AND AIMS Endoscopic ultrasonography (EUS) is useful for the diagnosis of gastrointestinal stromal tumors (GISTs), but is limited by subjective interpretation. Studies on artificial intelligence (AI)-assisted diagnosis are under development. Here, we used a meta-analysis to evaluate the diagnostic performance of AI in the diagnosis of GISTs using EUS images. METHODS PubMed, Ovid Medline, Embase, Web of science, and the Cochrane Library databases were searched for studies based on the EUS using AI for the diagnosis of GISTs, and a meta-analysis was performed to examine the accuracy. RESULTS Overall, 7 studies were included in our meta-analysis. A total of 2431 patients containing more than 36,186 images were used as the overall dataset, of which 480 patients were used for the final testing. The pooled sensitivity, specificity, positive, and negative likelihood ratio (LR) of AI-assisted EUS for differentiating GISTs from other submucosal tumors (SMTs) were 0.92 (95% confidence interval [CI] 0.89-0.95), 0.82 (95% CI 0.75-0.87), 4.55 (95% CI 2.64-7.84), and 0.12 (95% CI 0.07-0.20), respectively. The summary diagnostic odds ratio (DOR) and the area under the curve were 64.70 (95% CI 23.83-175.69) and 0.950 (Q* = 0.891). CONCLUSIONS AI-assisted EUS showed high accuracy for the automatic endoscopic diagnosis of GISTs, which could be used as a valuable complementary method for the differentiation of SMTs in the future.
Collapse
|
18
|
Pallio S, Crinò SF, Maida M, Sinagra E, Tripodi VF, Facciorusso A, Ofosu A, Conti Bellocchi MC, Shahini E, Melita G. Endoscopic Ultrasound Advanced Techniques for Diagnosis of Gastrointestinal Stromal Tumours. Cancers (Basel) 2023; 15:cancers15041285. [PMID: 36831627 PMCID: PMC9954263 DOI: 10.3390/cancers15041285] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Revised: 02/08/2023] [Accepted: 02/15/2023] [Indexed: 02/22/2023] Open
Abstract
Gastrointestinal Stromal Tumors (GISTs) are subepithelial lesions (SELs) that commonly develop in the gastrointestinal tract. GISTs, unlike other SELs, can exhibit malignant behavior, so differential diagnosis is critical to the decision-making process. Endoscopic ultrasound (EUS) is considered the most accurate imaging method for diagnosing and differentiating SELs in the gastrointestinal tract by assessing the lesions precisely and evaluating their malignant risk. Due to their overlapping imaging characteristics, endosonographers may have difficulty distinguishing GISTs from other SELs using conventional EUS alone, and the collection of tissue samples from these lesions may be technically challenging. Even though it appears to be less effective in the case of smaller lesions, histology is now the gold standard for achieving a final diagnosis and avoiding unnecessary and invasive treatment for benign SELs. The use of enhanced EUS modalities and elastography has improved the diagnostic ability of EUS. Furthermore, recent advancements in artificial intelligence systems that use EUS images have allowed them to distinguish GISTs from other SELs, thereby improving their diagnostic accuracy.
Collapse
Affiliation(s)
- Socrate Pallio
- Department of Clinical and Experimental Medicine, University of Messina, 98100 Messina, Italy
| | | | - Marcello Maida
- Gastroenterology and Endoscopy Unit, S. Elia-Raimondi Hospital, 93100 Caltanissetta, Italy
| | - Emanuele Sinagra
- Gastroenterology and Endoscopy Unit, Fondazione Istituto San Raffaele Giglio, 90015 Cefalù, Italy
| | | | - Antonio Facciorusso
- Gastroenterology Unit, Department of Medical and Surgical Sciences, University of Foggia, 71100 Foggia, Italy
| | - Andrew Ofosu
- Division of Digestive Diseases, University of Cincinnati, Cincinnati, OH 45201, USA
| | | | - Endrit Shahini
- Gastroenterology Unit, National Institute of Gastroenterology—IRCCS “Saverio de Bellis” Castellana Grotte, 70013 Castellana Grotte, Italy
| | - Giuseppinella Melita
- Human Pathology of Adult and Child Department, University of Messina, 98100 Messina, Italy
| |
Collapse
|
19
|
Query 2: Query over queries for improving gastrointestinal stromal tumour detection in an endoscopic ultrasound. Comput Biol Med 2023; 152:106424. [PMID: 36543005 DOI: 10.1016/j.compbiomed.2022.106424] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 11/19/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022]
Abstract
Gastrointestinal stromal tumour (GIST) lesions are mesenchymal neoplasms commonly found in the upper gastrointestinal tract, but non-invasive GIST detection during an endoscopy remains challenging because their ultrasonic images resemble several benign lesions. Techniques for automatic GIST detection and other lesions from endoscopic ultrasound (EUS) images offer great potential to advance the precision and automation of traditional endoscopy and treatment procedures. However, GIST recognition faces several intrinsic challenges, including the input restriction of a single image modality and the mismatch between tasks and models. To address these challenges, we propose a novel Query2 (Query over Queries) framework to identify GISTs from ultrasound images. The proposed Query2 framework applies an anatomical location embedding layer to break the single image modality. A cross-attention module is then applied to query the queries generated from the basic detection head. Moreover, a single-object restricted detection head is applied to infer the lesion categories. Meanwhile, to drive this network, we present GIST514-DB, a GIST dataset that will be made publicly available, which includes the ultrasound images, bounding boxes, categories and anatomical locations from 514 cases. Extensive experiments on the GIST514-DB demonstrate that the proposed Query2 outperforms most of the state-of-the-art methods.
Collapse
|
20
|
Negligible procedure-related dissemination risk of mucosal incision-assisted biopsy for gastrointestinal stromal tumors versus endoscopic ultrasound-guided fine-needle aspiration/biopsy. Surg Endosc 2023; 37:101-108. [PMID: 35840712 DOI: 10.1007/s00464-022-09419-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 06/24/2022] [Indexed: 01/18/2023]
Abstract
BACKGROUND Mucosal incision-assisted biopsy (MIAB) is a valuable alternative to endoscopic ultrasound-guided fine-needle aspiration/biopsy (EUS-FNAB) for sampling gastric subepithelial lesions (SELs). This study aimed to evaluate the potential risk of dissemination and impact on postoperative prognosis associated with MIAB, which has not yet been investigated. METHODS Study 1: A prospective observational study was conducted to examine the presence or absence and growth rate of tumor cells in gastric juice before and after the procedure in patients with SELs who underwent MIAB (n = 25) or EUS-FNAB (n = 22) between September 2018 and August 2021. Study 2: A retrospective study was conducted to examine the impact of MIAB on postoperative prognosis in 107 patients with gastrointestinal stromal tumors diagnosed using MIAB (n = 39) or EUS-FNAB (n = 68) who underwent surgery between January 2001 and July 2020. RESULTS In study 1, although no tumor cells were observed in gastric juice in MIAB before the procedure, they were observed in 64% of patients after obtaining samples (P < 0.001). In contrast, no tumor cells were observed in the gastric juice in EUS-FNAB before and after the procedure. In study 2, there was no significant difference in 5-year disease-free survival between MIAB (100%) and EUS-FNAB (97.1%) (P = 0.27). CONCLUSION MIAB is safe, with little impact on postoperative prognosis, although the procedure releases some tumor cells after damaging the SEL's pseudocapsule.
Collapse
|
21
|
Galati JS, Duve RJ, O'Mara M, Gross SA. Artificial intelligence in gastroenterology: A narrative review. Artif Intell Gastroenterol 2022; 3:117-141. [DOI: 10.35712/aig.v3.i5.117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 11/21/2022] [Accepted: 12/21/2022] [Indexed: 12/28/2022] Open
Abstract
Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.
Collapse
Affiliation(s)
- Jonathan S Galati
- Department of Medicine, NYU Langone Health, New York, NY 10016, United States
| | - Robert J Duve
- Department of Internal Medicine, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY 14203, United States
| | - Matthew O'Mara
- Division of Gastroenterology, NYU Langone Health, New York, NY 10016, United States
| | - Seth A Gross
- Division of Gastroenterology, NYU Langone Health, New York, NY 10016, United States
| |
Collapse
|
22
|
Minoda Y, Ihara E, Fujimori N, Nagatomo S, Esaki M, Hata Y, Bai X, Tanaka Y, Ogino H, Chinen T, Hu Q, Oki E, Yamamoto H, Ogawa Y. Efficacy of ultrasound endoscopy with artificial intelligence for the differential diagnosis of non-gastric gastrointestinal stromal tumors. Sci Rep 2022; 12:16640. [PMID: 36198726 PMCID: PMC9534932 DOI: 10.1038/s41598-022-20863-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Accepted: 09/20/2022] [Indexed: 12/15/2022] Open
Abstract
Gastrointestinal stromal tumors (GISTs) are common subepithelial lesions (SELs) and require treatment considering their malignant potential. We recently developed an endoscopic ultrasound-based artificial intelligence (EUS-AI) system to differentiate GISTs from non-GISTs in gastric SELs, which were used to train the system. We assessed whether the EUS-AI system designed for diagnosing gastric GISTs could be applied to non-gastric GISTs. Between January 2015 and January 2021, 52 patients with non-gastric SELs (esophagus, n = 15; duodenum, n = 26; colon, n = 11) were enrolled. The ability of EUS-AI to differentiate GISTs from non-GISTs in non-gastric SELs was examined. The accuracy, sensitivity, and specificity of EUS-AI for discriminating GISTs from non-GISTs in non-gastric SELs were 94.4%, 100%, and 86.1%, respectively, with an area under the curve of 0.98 based on the cutoff value set using the Youden index. In the subanalysis, the accuracy, sensitivity, and specificity of EUS-AI were highest in the esophagus (100%, 100%, 100%; duodenum, 96.2%, 100%, 0%; colon, 90.9%, 100%, 0%); the cutoff values were determined using the Youden index or the value determined using stomach cases. The diagnostic accuracy of EUS-AI increased as lesion size increased, regardless of lesion location. EUS-AI based on gastric SELs had good diagnostic ability for non-gastric GISTs.
Collapse
Affiliation(s)
- Yosuke Minoda
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan.,Department of Endoscopic Diagnostics and Therapeutics, Kyushu University Hospital, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Eikichi Ihara
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan. .,Department of Gastroenterology and Metabolism, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan.
| | - Nao Fujimori
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Shuzaburo Nagatomo
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Mitsuru Esaki
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Yoshitaka Hata
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Xiaopeng Bai
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Yoshimasa Tanaka
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Haruei Ogino
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Takatoshi Chinen
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Qingjiang Hu
- Department of Surgery and Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Eiji Oki
- Department of Surgery and Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Hidetaka Yamamoto
- Department of Pathological Sciences, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Yoshihiro Ogawa
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| |
Collapse
|
23
|
Du W, Cui G, Wang K, Li S. Clinical significance of 18F-FDG PET/CT imaging in 32 cases of gastrointestinal stromal tumors. Eur J Med Res 2022; 27:182. [PMID: 36114563 PMCID: PMC9479238 DOI: 10.1186/s40001-022-00806-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 09/06/2022] [Indexed: 11/23/2022] Open
Abstract
Objectives To explore the clinical significance of 18F-FDG metabolic imaging in the diagnosis and biological risk assessment of gastrointestinal stromal tumors (GIST). Methods This study is a clinical retrospective study. The research subjects were patients with GIST who were admitted to our hospital from January 2014 to December 2019 and underwent 18F-FDG metabolic imaging, and the relationship between biological risk and FDG metabolism was analyzed retrospectively. Results A total of 32 patients with GIST were included in this study, of which 17 patients had very low and low-risk lesions, and the FDG metabolism level did not increase; five patients had moderate-risk gastric lesions, and the FDG metabolism level was abnormally increased; 10 patients had high-risk lesions, and except for one patient with multiple lesions, the FDG metabolism level of these patients was increased. Conclusions The level of glucose metabolism is abnormally increased in tumor cells with vigorous mitosis and has higher biological risk. The 18F-FDG metabolism level can determine the biological risk of GIST and whether high-risk lesions involve other tissues and organs, as it more comprehensively reflects the distribution of lesions, the activity of tumor cells and the stage of the disease.
Collapse
|
24
|
Seven G, Silahtaroglu G, Seven OO, Senturk H. Differentiating Gastrointestinal Stromal Tumors from Leiomyomas Using a Neural Network Trained on Endoscopic Ultrasonography Images. Dig Dis 2022; 40:427-435. [PMID: 34619683 PMCID: PMC9393815 DOI: 10.1159/000520032] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Accepted: 09/29/2021] [Indexed: 02/02/2023]
Abstract
BACKGROUND Endoscopic ultrasonography (EUS) is crucial to diagnose and evaluate gastrointestinal mesenchymal tumors (GIMTs). However, EUS-guided biopsy does not always differentiate gastrointestinal stromal tumors (GISTs) from leiomyomas. We evaluated the ability of a convolutional neural network (CNN) to differentiate GISTs from leiomyomas using EUS images. The conventional EUS features of GISTs were also compared with leiomyomas. PATIENTS AND METHODS Patients who underwent EUS for evaluation of upper GIMTs between 2010 and 2020 were retrospectively reviewed, and 145 patients (73 women and 72 men; mean age 54.8 ± 13.5 years) with GISTs (n = 109) or leiomyomas (n = 36), confirmed by immunohistochemistry, were included. A total of 978 images collected from 100 patients were used to train and test the CNN system, and 384 images from 45 patients were used for validation. EUS images were also evaluated by an EUS expert for comparison with the CNN system. RESULTS The sensitivity, specificity, and accuracy of the CNN system for diagnosis of GIST were 92.0%, 64.3%, and 86.98% for the validation dataset, respectively. In contrast, the sensitivity, specificity, and accuracy of the EUS expert interpretations were 60.5%, 74.3%, and 63.0%, respectively. Concerning EUS features, only higher echogenicity was an independent and significant factor for differentiating GISTs from leiomyomas (p < 0.05). CONCLUSIONS The CNN system could diagnose GIMTs with higher accuracy than an EUS expert and could be helpful in differentiating GISTs from leiomyomas. A higher echogenicity may also aid in differentiation.
Collapse
Affiliation(s)
- Gulseren Seven
- Division of Gastroenterology, Bezmialem Vakif University, Istanbul, Turkey
| | - Gokhan Silahtaroglu
- Management Information Systems Department, School of Business and Management Science, Istanbul Medipol University, Istanbul, Turkey
| | - Ozden Ozluk Seven
- Division of Gastroenterology, Bezmialem Vakif University, Istanbul, Turkey
| | - Hakan Senturk
- Division of Gastroenterology, Bezmialem Vakif University, Istanbul, Turkey,*Hakan Senturk,
| |
Collapse
|
25
|
Minchenberg SB, Walradt T, Glissen Brown JR. Scoping out the future: The application of artificial intelligence to gastrointestinal endoscopy. World J Gastrointest Oncol 2022; 14:989-1001. [PMID: 35646286 PMCID: PMC9124983 DOI: 10.4251/wjgo.v14.i5.989] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 06/21/2021] [Accepted: 04/21/2022] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) is a quickly expanding field in gastrointestinal endoscopy. Although there are a myriad of applications of AI ranging from identification of bleeding to predicting outcomes in patients with inflammatory bowel disease, a great deal of research has focused on the identification and classification of gastrointestinal malignancies. Several of the initial randomized, prospective trials utilizing AI in clinical medicine have centered on polyp detection during screening colonoscopy. In addition to work focused on colorectal cancer, AI systems have also been applied to gastric, esophageal, pancreatic, and liver cancers. Despite promising results in initial studies, the generalizability of most of these AI systems have not yet been evaluated. In this article we review recent developments in the field of AI applied to gastrointestinal oncology.
Collapse
Affiliation(s)
- Scott B Minchenberg
- Department of Internal Medicine, Beth Israel Deaconess Medical Center, Boston, MA 02130, United States
| | - Trent Walradt
- Department of Internal Medicine, Beth Israel Deaconess Medical Center, Boston, MA 02130, United States
| | - Jeremy R Glissen Brown
- Division of Gastroenterology, Beth Israel Deaconess Medical Center, Boston, MA 02130, United States
| |
Collapse
|
26
|
Tanaka H, Kamata K, Ishihara R, Handa H, Otsuka Y, Yoshida A, Yoshikawa T, Ishikawa R, Okamoto A, Yamazaki T, Nakai A, Omoto S, Minaga K, Yamao K, Takenaka M, Watanabe T, Nishida N, Kudo M. Value of artificial intelligence with novel tumor tracking technology in the diagnosis of gastric submucosal tumors by contrast-enhanced harmonic endoscopic ultrasonography. J Gastroenterol Hepatol 2022; 37:841-846. [PMID: 35043456 DOI: 10.1111/jgh.15780] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 12/01/2021] [Accepted: 01/12/2022] [Indexed: 12/13/2022]
Abstract
BACKGROUND AND AIM Contrast-enhanced harmonic endoscopic ultrasonography (CH-EUS) is useful for the diagnosis of lesions inside and outside the digestive tract. This study evaluated the value of artificial intelligence (AI) in the diagnosis of gastric submucosal tumors by CH-EUS. METHODS This retrospective study included 53 patients with gastrointestinal stromal tumors (GISTs) and leiomyomas, all of whom underwent CH-EUS between June 2015 and February 2020. A novel technology, SiamMask, was used to track and trim the lesions in CH-EUS videos. CH-EUS was evaluated by AI using deep learning involving a residual neural network and leave-one-out cross-validation. The diagnostic accuracy of AI in discriminating between GISTs and leiomyomas was assessed and compared with that of blind reading by two expert endosonographers. RESULTS Of the 53 patients, 42 had GISTs and 11 had leiomyomas. Mean tumor size was 26.4 mm. The consistency rate of the segment range of the tumor image extracted by SiamMask and marked by the endosonographer was 96% with a Dice coefficient. The sensitivity, specificity, and accuracy of AI in diagnosing GIST were 90.5%, 90.9%, and 90.6%, respectively, whereas those of blind reading were 90.5%, 81.8%, and 88.7%, respectively (P = 0.683). The κ coefficient between the two reviewers was 0.713. CONCLUSIONS The diagnostic ability of CH-EUS results evaluated by AI to distinguish between GISTs and leiomyomas was comparable with that of blind reading by expert endosonographers.
Collapse
Affiliation(s)
- Hidekazu Tanaka
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Ken Kamata
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Rika Ishihara
- Department of Informatics, Kindai University, Osaka, Japan
| | - Hisashi Handa
- Department of Informatics, Kindai University, Osaka, Japan.,Cyber Informatics Research Institute, Kindai University, Osaka, Japan.,Research Institute of Science and Technology, Kindai University, Osaka, Japan
| | - Yasuo Otsuka
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Akihiro Yoshida
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Tomoe Yoshikawa
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Rei Ishikawa
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Ayana Okamoto
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Tomohiro Yamazaki
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Atsushi Nakai
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Shunsuke Omoto
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Kosuke Minaga
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Kentaro Yamao
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Mamoru Takenaka
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Tomohiro Watanabe
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Naoshi Nishida
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Masatoshi Kudo
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| |
Collapse
|
27
|
Cazacu IM, Saftoiu A, Bhutani MS. Advanced EUS Imaging Techniques. Dig Dis Sci 2022; 67:1588-1598. [PMID: 35451709 DOI: 10.1007/s10620-022-07486-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/21/2022] [Indexed: 12/09/2022]
Affiliation(s)
- Irina M Cazacu
- Department of Oncology, Fundeni Clinical Institute, Bucharest, Romania.,Faculty of Medicine, Titu Maiorescu University, Bucharest, Romania
| | - Adrian Saftoiu
- Department of Gastroenterology, Elias Emergency University Hospital, Carol Davila University of Medicine and Pharmacy, Bucharest, Romania
| | - Manoop S Bhutani
- Department of Gastroenterology, Hepatology and Nutrition-Unit 1466, University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd., Houston, TX, 77030-4009, USA.
| |
Collapse
|
28
|
Ye XH, Zhao LL, Wang L. Diagnostic accuracy of endoscopic ultrasound with artificial intelligence for gastrointestinal stromal tumors: A meta-analysis. J Dig Dis 2022; 23:253-261. [PMID: 35793389 DOI: 10.1111/1751-2980.13110] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Revised: 05/21/2022] [Accepted: 07/01/2022] [Indexed: 12/11/2022]
Abstract
OBJECTIVES Gastrointestinal stromal tumors (GISTs) are thought to have a malignant potential. However, utilizing endoscopic ultrasound (EUS) to differentiate GISTs from other types of subepithelial lesions (SELs) remains challenging. Artificial intelligence (AI)-based diagnostic systems for EUS have been reported to have a promising performance, although the results of the previous studies remain controversial. In this meta-analysis, we aimed to assess the diagnostic accuracy of AI-based EUS in distinguishing GISTs from other SELs. METHODS A literature search was conducted on MEDLINE and EMBASE databases to identify relevant articles. The sensitivity, specificity, and area under the summary receiver operating characteristic curve (AUROC) of eligible studies were analyzed. RESULTS Seven studies were eligible for the final analysis. The combined sensitivity and specificity of AI-based EUS were 0.93 (95% confidence interval [CI] 0.88-0.96) and 0.78 (95% CI 0.67-0.87), respectively. The overall diagnostic odds ratio of AI-based EUS for GISTs was 36.74 (95% CI 17.69-76.30) with an AUROC of 0.94. CONCLUSIONS AI-based EUS showed high diagnostic ability and might help better differentiate GISTs from other SELs. More prospective studies on the diagnosis of GISTs using AI-based EUS are warranted in clinical setting.
Collapse
Affiliation(s)
- Xiao Hua Ye
- Department of Gastroenterology, Affiliated Jinhua Hospital, Zhejiang University School of Medicine, Jinhua, Zhejiang Province, China
| | - Lin Lin Zhao
- Department of Gastroenterology, Digestive Endoscopy Center, Changhai Hospital, Naval Medical University, Shanghai, China
| | - Lei Wang
- Department of Gastroenterology, Digestive Endoscopy Center, Changhai Hospital, Naval Medical University, Shanghai, China
| |
Collapse
|
29
|
Deprez PH, Moons LMG, OʼToole D, Gincul R, Seicean A, Pimentel-Nunes P, Fernández-Esparrach G, Polkowski M, Vieth M, Borbath I, Moreels TG, Nieveen van Dijkum E, Blay JY, van Hooft JE. Endoscopic management of subepithelial lesions including neuroendocrine neoplasms: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy 2022; 54:412-429. [PMID: 35180797 DOI: 10.1055/a-1751-5742] [Citation(s) in RCA: 109] [Impact Index Per Article: 54.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
1: ESGE recommends endoscopic ultrasonography (EUS) as the best tool to characterize subepithelial lesion (SEL) features (size, location, originating layer, echogenicity, shape), but EUS alone is not able to distinguish among all types of SEL.Strong recommendation, moderate quality evidence. 2: ESGE suggests providing tissue diagnosis for all SELs with features suggestive of gastrointestinal stromal tumor (GIST) if they are of size > 20 mm, or have high risk stigmata, or require surgical resection or oncological treatment.Weak recommendation, very low quality evidence. 3: ESGE recommends EUS-guided fine-needle biopsy (EUS-FNB) or mucosal incision-assisted biopsy (MIAB) equally for tissue diagnosis of SELs ≥ 20 mm in size.Strong recommendation, moderate quality evidence. 4: ESGE recommends against surveillance of asymptomatic gastrointestinal (GI) tract leiomyomas, lipomas, heterotopic pancreas, granular cell tumors, schwannomas, and glomus tumors, if the diagnosis is clear.Strong recommendation, moderate quality evidence. 5: ESGE suggests surveillance of asymptomatic esophageal and gastric SELs without definite diagnosis, with esophagogastroduodenoscopy (EGD) at 3-6 months, and then at 2-3-year intervals for lesions < 10 mm in size, and at 1-2-year intervals for lesions 10-20 mm in size. For asymptomatic SELs > 20 mm in size that are not resected, ESGE suggests surveillance with EGD plus EUS at 6 months and then at 6-12-month intervals.Weak recommendation, very low quality evidence. 6: ESGE recommends endoscopic resection for type 1 gastric neuroendocrine neoplasms (g-NENs) if they grow larger than 10 mm. The choice of resection technique should depend on size, depth of invasion, and location in the stomach.Strong recommendation, low quality evidence. 7: ESGE suggests considering removal of histologically proven gastric GISTs smaller than 20 mm as an alternative to surveillance. The decision to resect should be discussed in a multidisciplinary meeting. The choice of technique should depend on size, location, and local expertise.Weak recommendation, very low quality evidence. 8: ESGE suggests that, to avoid unnecessary follow-up, endoscopic resection is an option for gastric SELs smaller than 20 mm and of unknown histology after failure of attempts to obtain diagnosis.Weak recommendation, very low quality evidence. 9: ESGE recommends basing the surveillance strategy on the type and completeness of resection. After curative resection of benign SELs no follow-up is advised, except for type 1 gastric NEN for which surveillance at 1-2 years is advised.Strong recommendation, low quality evidence. 10: For lower or upper GI NEN with a positive or indeterminate margin at resection, ESGE recommends repeating endoscopy at 3-6 months and another attempt at endoscopic resection in the case of residual disease.Strong recommendation, low quality evidence.
Collapse
Affiliation(s)
- Pierre H Deprez
- Department of Hepatogastroenterology, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain, Brussels, Belgium
| | - Leon M G Moons
- Divisie Interne Geneeskunde en Dermatologie, Maag-, Darm- en Leverziekten, Universitair Medisch Centrum Utrecht, Utrecht, The Netherlands
| | - Dermot OʼToole
- Neuroendocrine Tumor Service, ENETS Centre of Excellence, St. Vincent's University Hospital and Department of Clinical Medicine, Trinity College Dublin, University of Dublin St. James's Hospital, Dublin, Ireland
| | - Rodica Gincul
- Service de Gastroentérologie et Endoscopie Digestive, Hôpital Privé Jean Mermoz, Lyon, France
| | - Andrada Seicean
- Regional Institute of Gastroenterology and Hepatology, Iuliu Hatieganu University of Medicine and Pharmacy, Cluj-Napoca, Romania
| | - Pedro Pimentel-Nunes
- Department of Gastroenterology, Portuguese Oncology Institute of Porto; Department of Surgery and Physiology, Center for Research in Health Technologies and Information Systems (CINTESIS), Faculty of Medicine, University of Porto, Portugal
| | | | - Marcin Polkowski
- Department of Gastroenterology, Hepatology and Clinical Oncology, Center for Postgraduate Medical Education, and Department of Oncological Gastroenterology, Maria Skłodowska-Curie National Research Institute of Oncology, Warsaw, Poland
| | - Michael Vieth
- Institut of Pathology, Friedrich-Alexander University Erlangen-Nuremberg, Klinikum Bayreuth, Bayreuth, Germany
| | - Ivan Borbath
- Department of Hepatogastroenterology, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain, Brussels, Belgium
| | - Tom G Moreels
- Department of Hepatogastroenterology, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain, Brussels, Belgium
| | - Els Nieveen van Dijkum
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, The Netherlands
| | - Jean-Yves Blay
- Centre Léon Bérard, Université Claude Bernard Lyon 1, Lyon, France
| | - Jeanin E van Hooft
- Department of Gastroenterology and Hepatology, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
30
|
Hirai K, Kuwahara T, Furukawa K, Kakushima N, Furune S, Yamamoto H, Marukawa T, Asai H, Matsui K, Sasaki Y, Sakai D, Yamada K, Nishikawa T, Hayashi D, Obayashi T, Komiyama T, Ishikawa E, Sawada T, Maeda K, Yamamura T, Ishikawa T, Ohno E, Nakamura M, Kawashima H, Ishigami M, Fujishiro M. Artificial intelligence-based diagnosis of upper gastrointestinal subepithelial lesions on endoscopic ultrasonography images. Gastric Cancer 2022; 25:382-391. [PMID: 34783924 DOI: 10.1007/s10120-021-01261-x] [Citation(s) in RCA: 27] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Accepted: 10/21/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Endoscopic ultrasonography (EUS) is useful for the differential diagnosis of subepithelial lesions (SELs); however, not all of them are easy to distinguish. Gastrointestinal stromal tumors (GISTs) are the commonest SELs, are considered potentially malignant, and differentiating them from benign SELs is important. Artificial intelligence (AI) using deep learning has developed remarkably in the medical field. This study aimed to investigate the efficacy of an AI system for classifying SELs on EUS images. METHODS EUS images of pathologically confirmed upper gastrointestinal SELs (GIST, leiomyoma, schwannoma, neuroendocrine tumor [NET], and ectopic pancreas) were collected from 12 hospitals. These images were divided into development and test datasets in the ratio of 4:1 using random sampling; the development dataset was divided into training and validation datasets. The same test dataset was diagnosed by two experts and two non-experts. RESULTS A total of 16,110 images were collected from 631 cases for the development and test datasets. The accuracy of the AI system for the five-category classification (GIST, leiomyoma, schwannoma, NET, and ectopic pancreas) was 86.1%, which was significantly higher than that of all endoscopists. The sensitivity, specificity, and accuracy of the AI system for differentiating GISTs from non-GISTs were 98.8%, 67.6%, and 89.3%, respectively. Its sensitivity and accuracy were significantly higher than those of all the endoscopists. CONCLUSION The AI system, classifying SELs, showed higher diagnostic performance than that of the experts and may assist in improving the diagnosis of SELs in clinical practice.
Collapse
Affiliation(s)
- Keiko Hirai
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Takamichi Kuwahara
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan. .,Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan.
| | - Kazuhiro Furukawa
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Naomi Kakushima
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Satoshi Furune
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Hideko Yamamoto
- Department of Gastroenterology, Toyohashi Municipal Hospital, Toyohashi, Japan
| | - Takahiro Marukawa
- Department of Gastroenterology and Hepatology, Japanese Red Cross Aichi Medical Center Nagoya Daiichi Hospital, Nagoya, Japan
| | - Hiromitsu Asai
- Department of Gastroenterology, Handa City Hospital, Handa, Japan
| | - Kenichi Matsui
- Department of Gastroenterology, Toyota Kosei Hospital, Toyota, Japan
| | - Yoji Sasaki
- Department of Gastroenterology, Konan Kosei Hospital, Konan, Japan
| | - Daisuke Sakai
- Department of Gastroenterology, Ichinomiya Municipal Hospital, Ichinomiya, Japan
| | - Koji Yamada
- Department of Gastroenterology, Okazaki City Hospital, Okazaki, Japan
| | | | - Daijuro Hayashi
- Department of Gastroenterology, Anjo Kosei Hospital, Anjo, Japan
| | | | - Takuma Komiyama
- Department of Gastroenterology, Komaki City Hospital, Komaki, Japan
| | - Eri Ishikawa
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Tsunaki Sawada
- Department of Endoscopy, Nagoya University Hospital, Nagoya, Japan
| | - Keiko Maeda
- Department of Endoscopy, Nagoya University Hospital, Nagoya, Japan
| | - Takeshi Yamamura
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Takuya Ishikawa
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Eizaburo Ohno
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Masanao Nakamura
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Hiroki Kawashima
- Department of Endoscopy, Nagoya University Hospital, Nagoya, Japan
| | - Masatoshi Ishigami
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| | - Mitsuhiro Fujishiro
- Department of Gastroenterology and Hepatology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| |
Collapse
|
31
|
Hann A, Meining A. Artificial Intelligence in Endoscopy. Visc Med 2022; 37:471-475. [PMID: 35083312 DOI: 10.1159/000519407] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Accepted: 08/30/2021] [Indexed: 12/23/2022] Open
Abstract
Background Owing to their rapid development, artificial intelligence (AI) technologies offer a great promise for gastroenterology practice and research. At present, AI-guided image interpretation has already been used with success for endoscopic detection of early malignant lesions. Nonetheless, there are complex challenges and possible shortcomings that must be considered before full implementation can be realized. Summary In this review, the current status of AI in endoscopy is summarized. Future perspectives and open questions for further studies are stressed. Key Messages The usage of AI algorithms for polyp detection in screening colonoscopy results in a significant increase in the adenoma detection rate, mainly attributed to the identification of diminutive polyps. Computer-aided characterization of colorectal polyps accompanies the detection, but further studies are needed to evaluate the clinical benefit. In contrast to colonoscopy, usage of AI in gastroscopy is currently rather limited. Regarding other fields of endoscopic imaging, capsule endoscopy is the ideal imaging platform for AI, due to the potential of saving time in the video analysis.
Collapse
Affiliation(s)
- Alexander Hann
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, Gastroenterology, University Hospital Würzburg, Würzburg, Germany
| | - Alexander Meining
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, Gastroenterology, University Hospital Würzburg, Würzburg, Germany
| |
Collapse
|
32
|
Ding W, Wang Z, Liu FY, Cheng ZG, Yu X, Han Z, Zhong H, Yu J, Liang P. A Hybrid Machine Learning Model Based on Semantic Information Can Optimize Treatment Decision for Naïve Single 3-5-cm HCC Patients. Liver Cancer 2022; 11:256-267. [PMID: 35949294 PMCID: PMC9218628 DOI: 10.1159/000522123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Accepted: 11/28/2021] [Indexed: 02/04/2023] Open
Abstract
BACKGROUND Tumor recurrence is an abomination for hepatocellular carcinoma (HCC) patients receiving local treatment. PURPOSE The aim of the study was to build a hybrid machine learning model to recommend optimized first treatment (laparoscopic hepatectomy [LH] or microwave ablation [MWA]) for naïve single 3-5-cm HCC patients based on early recurrence (ER, ≤2 years) probability. METHODS This retrospective study collected 20 semantic variables of 582 patients (LH: 300, MWA: 282) from 13 hospitals with at least 24 months follow-up. Both groups were divided into training, validation, and test set, respectively. Five algorithms (logistics regression, random forest, neural network, stochastic gradient boosting, and eXtreme Gradient Boosting [XGB]) were used for model building. A model with highest area under the receiver operating characteristic curve (AUC) in a validation set of LH and MWA was selected to connect as a hybrid model which made decision based on ER probability. Model testing was performed in a comprehensive set comprising LH and MWA test sets. RESULTS Four variables in each group were selected to build LH and MWA models, respectively. LH-XGB model (AUC = 0.744) and MWA-stochastic gradient method (AUC = 0.750) model were selected for model building. In the comprehensive set, a treatment confusion matrix was established based on recommended and actual treatment. The predicted ER probabilities were comparable with the actual ER rates for various types of patients in matrix (p > 0.05). ER rate of patients whose actual treatment consistent with recommendation was lower than that of inconsistent patients (LH: 21.2% vs. 46.2%, p = 0.042; MWA: 26.3% vs. 54.1%, p = 0.048). By recommending optimal treatment, the hybrid model can significantly reduce ER probability from 38.2% to 25.6% for overall patients (p < 0.001). CONCLUSIONS The hybrid model can accurately predict ER probability of different treatments and thereby provide reliable evidence to make optimal treatment decision for patients with single 3-5-cm HCC.
Collapse
|
33
|
Oh CK, Kim T, Cho YK, Cheung DY, Lee BI, Cho YS, Kim JI, Choi MG, Lee HH, Lee S. Convolutional neural network-based object detection model to identify gastrointestinal stromal tumors in endoscopic ultrasound images. J Gastroenterol Hepatol 2021; 36:3387-3394. [PMID: 34369001 DOI: 10.1111/jgh.15653] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Revised: 07/27/2021] [Accepted: 08/02/2021] [Indexed: 12/20/2022]
Abstract
BACKGROUND AND AIM We aimed to develop a convolutional neural network (CNN)-based object detection model for the discrimination of gastric subepithelial tumors, such as gastrointestinal stromal tumors (GISTs), and leiomyomas, in endoscopic ultrasound (EUS) images. METHODS We used 376 images from 114 patients with histologically confirmed gastric GIST or leiomyoma to train the EUS-CNN. We constructed the EUS-CNN using an EfficientNet CNN model for feature extraction and a weighted bi-directional feature pyramid network for object detection. We assessed the performance of our EUS-CNN by calculating its accuracy, sensitivity, specificity, and area under receiver operating characteristic curve (AUC) using a validation set of 170 images from 54 patients. Four EUS experts and 15 EUS trainees were asked to judge the same validation dataset, and the diagnostic yields were compared between the EUS-CNN and human assessments. RESULTS In the per-image analysis, the sensitivity, specificity, accuracy, and AUC of our EUS-CNN were 95.6%, 82.1%, 91.2%, and 0.9234, respectively. In the per-patient analysis, the sensitivity, specificity, accuracy, and AUC for our object detection model were 100.0%, 85.7%, 96.3%, and 0.9929, respectively. The EUS-CNN outperformed human assessment in terms of accuracy, sensitivity, and negative predictive value. CONCLUSIONS We developed the EUS-CNN system, which demonstrated high diagnostic ability for gastric GIST prediction. This EUS-CNN system can be helpful not only for less-experienced endoscopists but also for experienced ones. Additional EUS image accumulation and prospective studies are required alongside validation in a large multicenter trial.
Collapse
Affiliation(s)
- Chang Kyo Oh
- Division of Gastroenterology, Department of Internal Medicine, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Taewan Kim
- Department of Mechanical Engineering, Pohang University of Science and Technology (POSTECH), Pohang, South Korea.,Postech-Catholic Biomedical Engineering Institute, Pohang University of Science and Technology (POSTECH), Pohang, South Korea
| | - Yu Kyung Cho
- Division of Gastroenterology, Department of Internal Medicine, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Dae Young Cheung
- Division of Gastroenterology, Department of Internal Medicine, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Bo-In Lee
- Division of Gastroenterology, Department of Internal Medicine, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Young-Seok Cho
- Division of Gastroenterology, Department of Internal Medicine, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Jin Il Kim
- Division of Gastroenterology, Department of Internal Medicine, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Myung-Gyu Choi
- Division of Gastroenterology, Department of Internal Medicine, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Han Hee Lee
- Division of Gastroenterology, Department of Internal Medicine, College of Medicine, The Catholic University of Korea, Seoul, South Korea.,Postech-Catholic Biomedical Engineering Institute, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Seungchul Lee
- Department of Mechanical Engineering, Pohang University of Science and Technology (POSTECH), Pohang, South Korea.,Postech-Catholic Biomedical Engineering Institute, Pohang University of Science and Technology (POSTECH), Pohang, South Korea.,Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), Pohang, South Korea.,Institute of Convergence Research and Education in Advanced Technology, Yonsei University, Seoul, South Korea
| |
Collapse
|
34
|
The emerging role of artificial intelligence in gastrointestinal endoscopy: A review. GASTROENTEROLOGIA Y HEPATOLOGIA 2021; 45:492-497. [PMID: 34793895 DOI: 10.1016/j.gastrohep.2021.11.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Revised: 10/15/2021] [Accepted: 11/07/2021] [Indexed: 11/19/2022]
|
35
|
Oka A, Ishimura N, Ishihara S. A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology. Diagnostics (Basel) 2021; 11:1719. [PMID: 34574060 PMCID: PMC8468082 DOI: 10.3390/diagnostics11091719] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Revised: 09/17/2021] [Accepted: 09/17/2021] [Indexed: 12/15/2022] Open
Abstract
Artificial intelligence (AI) is rapidly becoming an essential tool in the medical field as well as in daily life. Recent developments in deep learning, a subfield of AI, have brought remarkable advances in image recognition, which facilitates improvement in the early detection of cancer by endoscopy, ultrasonography, and computed tomography. In addition, AI-assisted big data analysis represents a great step forward for precision medicine. This review provides an overview of AI technology, particularly for gastroenterology, hepatology, and pancreatology, to help clinicians utilize AI in the near future.
Collapse
Affiliation(s)
- Akihiko Oka
- Department of Internal Medicine II, Faculty of Medicine, Shimane University, Izumo 693-8501, Shimane, Japan; (N.I.); (S.I.)
| | | | | |
Collapse
|
36
|
Goto O, Kaise M, Iwakiri K. Advancements in the Diagnosis of Gastric Subepithelial Tumors. Gut Liver 2021; 16:321-330. [PMID: 34456187 PMCID: PMC9099397 DOI: 10.5009/gnl210242] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 06/29/2021] [Accepted: 07/06/2021] [Indexed: 11/04/2022] Open
Abstract
A diagnosis of subepithelial tumors (SETs) is sometimes difficult due to the existence of overlying mucosa on the lesions, which hampers optical diagnosis by conventional endoscopy and tissue sampling with standard biopsy forceps. Imaging modalities, by using computed tomography and endoscopic ultrasonography (EUS) are mandatory to noninvasively collect the target's information and to opt candidates for further evaluation. Particularly, EUS is an indispensable diagnostic modality for assessing the lesions precisely and evaluating the possibility of malignancy. The diagnostic ability of EUS appears increased by the combined use of contrast-enhancement or elastography. Histology is the gold standard for obtaining the final diagnosis. Tissue sampling requires special techniques to break the mucosal barrier. Although EUS-guided fine-needle aspiration (EUS-FNA) is commonly applied, mucosal cutting biopsy and mucosal incision-assisted biopsy are comparable methods to definitively obtain tissues from the exposed surface of lesions and seem more useful than EUS-FNA for small SETs. Recent advancements in artificial intelligence (AI) have a potential to drastically change the diagnostic strategy for SETs. Development and establishment of noninvasive methods including AI-assisted diagnosis are expected to provide an alternative to invasive, histological diagnosis.
Collapse
Affiliation(s)
- Osamu Goto
- Department of Gastroenterology, Graduate School of Medicine, Nippon Medical School, Tokyo, Japan
| | - Mitsuru Kaise
- Department of Gastroenterology, Graduate School of Medicine, Nippon Medical School, Tokyo, Japan
| | - Katsuhiko Iwakiri
- Department of Gastroenterology, Graduate School of Medicine, Nippon Medical School, Tokyo, Japan
| |
Collapse
|
37
|
Ang TL, Wang LM. The evolving role of EUS-guided tissue acquisition. J Dig Dis 2021; 22:204-213. [PMID: 33611846 DOI: 10.1111/1751-2980.12976] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Accepted: 02/19/2021] [Indexed: 12/11/2022]
Abstract
The introduction of endoscopic ultrasound-guided fine-needle aspiration into clinical practice was a pivotal moment for diagnostic gastrointestinal endoscopy. It facilitates the ease of tissue acquisition from previously inaccessible sites. The performance characteristics of cytological diagnosis are excellent. However, there remain areas of inadequacies. These include procedural inefficiencies such as the need for rapid on-site cytological evaluation or macroscopic on-site evaluation, the crucial role of histology for diagnosis in specific conditions, the issue of sampling errors and the need for repeat procedures, and the shift towards personalized medicine, which requires histology, immunohistochemical studies, and molecular analysis. The original Trucut biopsy needle had been cumbersome to use, but the recent introduction of newer-generation biopsy needles has transformed the landscape, such that there is now a greater focus on tissue acquisition for histological assessment. Concomitant technological advances of endoscopic ultrasound processors enabled higher-resolution imaging, and facilitated image enhancement using contrast harmonic endoscopic ultrasound and endoscopic ultrasound elastography. These techniques can be used as an adjunct to guide tissue acquisition in challenging situations. There is ongoing research on the use of artificial intelligence to complement diagnostic endoscopic ultrasound and the early data are promising. Artificial intelligence may be especially important to guide clinical decision-making if biopsy results are nondiagnostic.
Collapse
Affiliation(s)
- Tiing Leong Ang
- Department of Gastroenterology and Hepatology, Changi General Hospital; Medicine Academic Clinical Programme, SingHealth Duke-NUS Academic Medical Centre; Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Lai Mun Wang
- Department of Laboratory Medicine, Section of Pathology, Changi General Hospital; Pathology Academic Clinical Programme, SingHealth Duke-NUS Academic Medical Centre, Singapore
| |
Collapse
|
38
|
Yamamiya A, Irisawa A, Kashima K, Kunogi Y, Nagashima K, Minaguchi T, Izawa N, Yamabe A, Hoshi K, Tominaga K, Iijima M, Goda K. Interobserver Reliability of Endoscopic Ultrasonography: Literature Review. Diagnostics (Basel) 2020; 10:E953. [PMID: 33203069 PMCID: PMC7696989 DOI: 10.3390/diagnostics10110953] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Revised: 11/10/2020] [Accepted: 11/12/2020] [Indexed: 12/12/2022] Open
Abstract
Endoscopic ultrasonography (EUS) has been applied to the diagnosis of various digestive disorders. Although it has been widely accepted and its diagnostic value is high, the dependence of EUS diagnosis on image interpretation done by the endosonographer has persisted as an important difficulty. Consequently, high interobserver reliability (IOR) in EUS diagnosis is important to demonstrate the reliability of EUS diagnosis. We reviewed the literature on the IOR of EUS diagnosis for various diseases such as chronic pancreatitis, pancreatic solid/cystic mass, lymphadenopathy, and gastrointestinal and subepithelial lesions. The IOR of EUS diagnosis differs depending on the disease; moreover, EUS findings with high IOR and those with IOR that was not necessarily high were used as diagnostic criteria. Therefore, to further increase the value of EUS diagnosis, EUS diagnostic criteria with high diagnostic characteristics based on EUS findings with high IOR must be established.
Collapse
Affiliation(s)
| | - Atsushi Irisawa
- Department of Gastroenterology, Dokkyo Medical University School of Medicine, 880 Kitakobayashi Mibu, Tochigi 321-0293, Japan; (A.Y.); (K.K.); (Y.K.); (K.N.); (T.M.); (N.I.); (A.Y.); (K.H.); (K.T.); (M.I.); (K.G.)
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|