51
|
Mitsala A, Tsalikidis C, Pitiakoudis M, Simopoulos C, Tsaroucha AK. Artificial Intelligence in Colorectal Cancer Screening, Diagnosis and Treatment. A New Era. ACTA ACUST UNITED AC 2021; 28:1581-1607. [PMID: 33922402 PMCID: PMC8161764 DOI: 10.3390/curroncol28030149] [Citation(s) in RCA: 125] [Impact Index Per Article: 31.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Revised: 04/09/2021] [Accepted: 04/20/2021] [Indexed: 12/24/2022]
Abstract
The development of artificial intelligence (AI) algorithms has permeated the medical field with great success. The widespread use of AI technology in diagnosing and treating several types of cancer, especially colorectal cancer (CRC), is now attracting substantial attention. CRC, which represents the third most commonly diagnosed malignancy in both men and women, is considered a leading cause of cancer-related deaths globally. Our review herein aims to provide in-depth knowledge and analysis of the AI applications in CRC screening, diagnosis, and treatment based on current literature. We also explore the role of recent advances in AI systems regarding medical diagnosis and therapy, with several promising results. CRC is a highly preventable disease, and AI-assisted techniques in routine screening represent a pivotal step in declining incidence rates of this malignancy. So far, computer-aided detection and characterization systems have been developed to increase the detection rate of adenomas. Furthermore, CRC treatment enters a new era with robotic surgery and novel computer-assisted drug delivery techniques. At the same time, healthcare is rapidly moving toward precision or personalized medicine. Machine learning models have the potential to contribute to individual-based cancer care and transform the future of medicine.
Collapse
Affiliation(s)
- Athanasia Mitsala
- Second Department of Surgery, University General Hospital of Alexandroupolis, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece; (C.T.); (M.P.); (C.S.)
- Correspondence: ; Tel.: +30-6986423707
| | - Christos Tsalikidis
- Second Department of Surgery, University General Hospital of Alexandroupolis, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece; (C.T.); (M.P.); (C.S.)
| | - Michail Pitiakoudis
- Second Department of Surgery, University General Hospital of Alexandroupolis, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece; (C.T.); (M.P.); (C.S.)
| | - Constantinos Simopoulos
- Second Department of Surgery, University General Hospital of Alexandroupolis, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece; (C.T.); (M.P.); (C.S.)
| | - Alexandra K. Tsaroucha
- Laboratory of Experimental Surgery & Surgical Research, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece;
| |
Collapse
|
52
|
Tang CP, Shao PP, Hsieh YH, Leung FW. A review of water exchange and artificial intelligence in improving adenoma detection. Tzu Chi Med J 2021; 33:108-114. [PMID: 33912406 PMCID: PMC8059458 DOI: 10.4103/tcmj.tcmj_88_20] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2020] [Revised: 05/22/2020] [Accepted: 06/06/2020] [Indexed: 12/21/2022] Open
Abstract
Water exchange (WE) and artificial intelligence (AI) have made critical advances during the past decade. WE significantly increases adenoma detection and AI holds the potential to help endoscopists detect more polyps and adenomas. We performed an electronic literature search on PubMed using the following keywords: water-assisted and water exchange colonoscopy, adenoma and polyp detection, artificial intelligence, deep learning, neural networks, and computer-aided colonoscopy. We reviewed relevant articles published in English from 2010 to May 2020. Additional articles were searched manually from the reference lists of the publications reviewed. We discussed recent advances in both WE and AI, including their advantages and limitations. AI may mitigate operator-dependent factors that limit the potential of WE. By increasing bowel cleanliness and improving visualization, WE may provide the platform to optimize the performance of AI for colonoscopies. The strengths of WE and AI may complement each other in spite of their weaknesses to maximize adenoma detection.
Collapse
Affiliation(s)
- Chia-Pei Tang
- Division of Gastroenterology, Department of Internal Medicine, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, Chiayi, Taiwan
- School of Medicine, Tzu Chi University, Hualien, Taiwan
| | - Paul P. Shao
- Sepulveda Ambulatory Care Center, Veterans Affairs Greater Los Angeles Healthcare System, North Hills, CA, USA
- Division of Gastroenterology, Department of Medicine, David Geffen School of Medicine at University of California at Los Angeles, Los Angeles, CA, USA
| | - Yu-Hsi Hsieh
- Division of Gastroenterology, Department of Internal Medicine, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, Chiayi, Taiwan
- School of Medicine, Tzu Chi University, Hualien, Taiwan
| | - Felix W. Leung
- Sepulveda Ambulatory Care Center, Veterans Affairs Greater Los Angeles Healthcare System, North Hills, CA, USA
- Division of Gastroenterology, Department of Medicine, David Geffen School of Medicine at University of California at Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
53
|
Raines DL, Adler DG. The Role of Provocative Testing and Localization of the Video Capsule Endoscope in the Management of Small Intestinal Bleeding. Gastrointest Endosc Clin N Am 2021; 31:317-330. [PMID: 33743928 DOI: 10.1016/j.giec.2021.01.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
The cause of small intestinal bleeding (SIB) may be elusive despite exhaustive testing. This article describes the current understanding of SIB regarding evaluation, with emphasis on the use of video capsule endoscopy (VCE) as a diagnostic procedure. This article addresses the utility of provocative testing in challenging cases and the performance of endoscopic procedures on active antithrombotic therapy. Specific recommendations accompany this article, including use of antithrombotic agents to stimulate bleeding when clearly indicated; performance of endoscopic procedures on active antithrombotic therapy; and progressive adoption of VCE and device-assisted enteroscopy in the inpatient setting.
Collapse
Affiliation(s)
| | - Douglas G Adler
- University of Utah School of Medicine, 30 North 1900 East 4R118, Salt Lake City, UT 84132, USA
| |
Collapse
|
54
|
Artificial Intelligence in Colorectal Cancer Diagnosis Using Clinical Data: Non-Invasive Approach. Diagnostics (Basel) 2021; 11:diagnostics11030514. [PMID: 33799452 PMCID: PMC8001232 DOI: 10.3390/diagnostics11030514] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Revised: 03/10/2021] [Accepted: 03/11/2021] [Indexed: 02/06/2023] Open
Abstract
Colorectal cancer is the third most common and second most lethal tumor globally, causing 900,000 deaths annually. In this research, a computer aided diagnosis system was designed that detects colorectal cancer, using an innovative dataset composing of both numeric (blood and urine analysis) and qualitative data (living environment of the patient, tumor position, T, N, M, Dukes classification, associated pathology, technical approach, complications, incidents, ultrasonography-dimensions as well as localization). The intelligent computer aided colorectal cancer diagnosis system was designed using different machine learning techniques, such as classification and shallow and deep neural networks. The maximum accuracy obtained from solving the binary classification problem with traditional machine learning algorithms was 77.8%. However, the regression problem solved with deep neural networks yielded with significantly better performance in terms of mean squared error minimization, reaching the value of 0.0000529.
Collapse
|
55
|
Maassen O, Fritsch S, Palm J, Deffge S, Kunze J, Marx G, Riedel M, Schuppert A, Bickenbach J. Future Medical Artificial Intelligence Application Requirements and Expectations of Physicians in German University Hospitals: Web-Based Survey. J Med Internet Res 2021; 23:e26646. [PMID: 33666563 PMCID: PMC7980122 DOI: 10.2196/26646] [Citation(s) in RCA: 44] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Revised: 01/29/2021] [Accepted: 02/15/2021] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND The increasing development of artificial intelligence (AI) systems in medicine driven by researchers and entrepreneurs goes along with enormous expectations for medical care advancement. AI might change the clinical practice of physicians from almost all medical disciplines and in most areas of health care. While expectations for AI in medicine are high, practical implementations of AI for clinical practice are still scarce in Germany. Moreover, physicians' requirements and expectations of AI in medicine and their opinion on the usage of anonymized patient data for clinical and biomedical research have not been investigated widely in German university hospitals. OBJECTIVE This study aimed to evaluate physicians' requirements and expectations of AI in medicine and their opinion on the secondary usage of patient data for (bio)medical research (eg, for the development of machine learning algorithms) in university hospitals in Germany. METHODS A web-based survey was conducted addressing physicians of all medical disciplines in 8 German university hospitals. Answers were given using Likert scales and general demographic responses. Physicians were asked to participate locally via email in the respective hospitals. RESULTS The online survey was completed by 303 physicians (female: 121/303, 39.9%; male: 173/303, 57.1%; no response: 9/303, 3.0%) from a wide range of medical disciplines and work experience levels. Most respondents either had a positive (130/303, 42.9%) or a very positive attitude (82/303, 27.1%) towards AI in medicine. There was a significant association between the personal rating of AI in medicine and the self-reported technical affinity level (H4=48.3, P<.001). A vast majority of physicians expected the future of medicine to be a mix of human and artificial intelligence (273/303, 90.1%) but also requested a scientific evaluation before the routine implementation of AI-based systems (276/303, 91.1%). Physicians were most optimistic that AI applications would identify drug interactions (280/303, 92.4%) to improve patient care substantially but were quite reserved regarding AI-supported diagnosis of psychiatric diseases (62/303, 20.5%). Of the respondents, 82.5% (250/303) agreed that there should be open access to anonymized patient databases for medical and biomedical research. CONCLUSIONS Physicians in stationary patient care in German university hospitals show a generally positive attitude towards using most AI applications in medicine. Along with this optimism comes several expectations and hopes that AI will assist physicians in clinical decision making. Especially in fields of medicine where huge amounts of data are processed (eg, imaging procedures in radiology and pathology) or data are collected continuously (eg, cardiology and intensive care medicine), physicians' expectations of AI to substantially improve future patient care are high. In the study, the greatest potential was seen in the application of AI for the identification of drug interactions, assumedly due to the rising complexity of drug administration to polymorbid, polypharmacy patients. However, for the practical usage of AI in health care, regulatory and organizational challenges still have to be mastered.
Collapse
Affiliation(s)
- Oliver Maassen
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| | - Sebastian Fritsch
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
- Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
| | - Julia Palm
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
- Institute of Medical Statistics, Computer and Data Sciences, Jena University Hospital, Jena, Germany
| | - Saskia Deffge
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| | - Julian Kunze
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| | - Gernot Marx
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| | - Morris Riedel
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
- Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
- School of Natural Sciences and Engineering, University of Iceland, Reykjavik, Iceland
| | - Andreas Schuppert
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
- Institute for Computational Biomedicine II, University Hospital RWTH Aachen, Aachen, Germany
| | - Johannes Bickenbach
- Department of Intensive Care Medicine, University Hospital RWTH Aachen, Aachen, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Leipzig, Germany
| |
Collapse
|
56
|
Wang X, Huang J, Ji X, Zhu Z. [Application of artificial intelligence for detection and classification of colon polyps]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2021; 41:310-313. [PMID: 33624608 DOI: 10.12122/j.issn.1673-4254.2021.02.22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 12/09/2022]
Abstract
Colorectal cancer is one of the most common cancers worldwide, and colonoscopy has proven to be a preferable modality for screening and surveillance of colorectal cancer. This review discusses the clinical application of artificial intelligence (AI) and computer-aided diagnosis for automated colonoscopic detection and diagnosis of colorectal polyps for better understanding of the application of AI-based computer-aided diagnosis systems especially in terms of machine learning, deep learning and convolutional neural network for screening and surveillance of colorectal cancer.
Collapse
Affiliation(s)
- X Wang
- Information Center, First Affiliated Hospital of Kunming Medical University, Kunming 65003, China
| | - J Huang
- Department of Oncology, First Affiliated Hospital of Kunming Medical University, Kunming 65003, China
| | - X Ji
- Day Surgery Center, First Affiliated Hospital of Kunming Medical University, Kunming 65003, China
| | - Z Zhu
- Day Surgery Center, First Affiliated Hospital of Kunming Medical University, Kunming 65003, China
| |
Collapse
|
57
|
Parsa N, Rex DK, Byrne MF. Colorectal polyp characterization with standard endoscopy: Will Artificial Intelligence succeed where human eyes failed? Best Pract Res Clin Gastroenterol 2021; 52-53:101736. [PMID: 34172255 DOI: 10.1016/j.bpg.2021.101736] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 02/16/2021] [Accepted: 02/18/2021] [Indexed: 01/31/2023]
Abstract
The American Society for Gastrointestinal Endoscopy (ASGE) has proposed the "resect-and-discard" and "diagnose-and-leave" strategies for diminutive colorectal polyps to reduce the costs of unnecessary polyp resection and pathology evaluation. However, the diagnostic thresholds set by these guidelines are not always met in community practice. To overcome this sub-optimal performance, artificial intelligence (AI) has been applied to the field of endoscopy. The incorporation of deep learning algorithms with AI models resulted in highly accurate systems that match the expert endoscopists' optical biopsy and exceed the ASGE recommended thresholds. Recent studies have demonstrated that the integration of AI in clinical practice results in significant improvement in endoscopists' diagnostic accuracy while reducing the time to make a diagnosis. Yet, several points need to be addressed before AI models can be successfully implemented in clinical practice. In this review, we summarize the recent literature on the application of AI for characterization of colorectal polyps, and review the current limitation and future directions for this field.
Collapse
Affiliation(s)
- Nasim Parsa
- University of Missouri, Department of Medicine, Division of Gastroenterology and Hepatology, Columbia, MO, United States
| | - Douglas K Rex
- Indiana University School of Medicine, Department of Medicine, Division of Gastroenterology and Hepatology, Indianapolis, IN, United States
| | - Michael F Byrne
- University of British Columbia, Department of Medicine, Division of Gastroenterology and Hepatology Vancouver, British Columbia, Canada; Satisfai Health and AI4GI Joint Venture, Vancouver, British Columbia, Canada.
| |
Collapse
|
58
|
Wavelet Transform and Deep Convolutional Neural Network-Based Smart Healthcare System for Gastrointestinal Disease Detection. Interdiscip Sci 2021; 13:212-228. [PMID: 33566337 DOI: 10.1007/s12539-021-00417-8] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Revised: 01/16/2021] [Accepted: 01/23/2021] [Indexed: 12/19/2022]
Abstract
This work presents a smart healthcare system for the detection of various abnormalities present in the gastrointestinal (GI) region with the help of time-frequency analysis and convolutional neural network. In this regard, the KVASIR V2 dataset comprising of eight classes of GI-tract images such as Normal cecum, Normal pylorus, Normal Z-line, Esophagitis, Polyps, Ulcerative Colitis, Dyed and lifted polyp, and Dyed resection margins are used for training and validation. The initial phase of the work involves an image pre-processing step, followed by the extraction of approximate discrete wavelet transform coefficients. Each class of decomposed images is later given as input to a couple of considered convolutional neural network (CNN) models for training and testing in two different classification levels to recognize its predicted value. Afterward, the classification performance is measured through the following measuring indices: accuracy, precision, recall, specificity, and F1 score. The experimental result shows 97.25% and 93.75% of accuracy in the first level and second level of classification, respectively. Lastly, a comparative performance analysis is carried out with several other previously published works on a similar dataset where the proposed approach performs better than its contemporary methods.
Collapse
|
59
|
Barrett esophagus: What to expect from Artificial Intelligence? Best Pract Res Clin Gastroenterol 2021; 52-53:101726. [PMID: 34172253 DOI: 10.1016/j.bpg.2021.101726] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Revised: 01/30/2021] [Accepted: 02/01/2021] [Indexed: 01/31/2023]
Abstract
The evaluation and assessment of Barrett's esophagus is challenging for both expert and nonexpert endoscopists. However, the early diagnosis of cancer in Barrett's esophagus is crucial for its prognosis, and could save costs. Pre-clinical and clinical studies on the application of Artificial Intelligence (AI) in Barrett's esophagus have shown promising results. In this review, we focus on the current challenges and future perspectives of implementing AI systems in the management of patients with Barrett's esophagus.
Collapse
|
60
|
Challenges in Crohn's Disease Management after Gastrointestinal Cancer Diagnosis. Cancers (Basel) 2021; 13:cancers13030574. [PMID: 33540674 PMCID: PMC7867285 DOI: 10.3390/cancers13030574] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2020] [Revised: 01/25/2021] [Accepted: 01/29/2021] [Indexed: 12/14/2022] Open
Abstract
Simple Summary Crohn’s disease (CD) is a chronic inflammatory bowel disease affecting both young and elderly patients, involving the entire gastrointestinal tract from the mouth to anus. The chronic transmural inflammation can lead to several complications, among which gastrointestinal cancers represent one of the most life-threatening, with a higher risk of onset as compared to the general population. Moreover, diagnostic and therapeutic strategies in this subset of patients still represent a significant challenge for physicians. Thus, the aim of this review is to provide a comprehensive overview of the current evidence for an adequate diagnostic pathway and medical and surgical management of CD patients after gastrointestinal cancer onset. Abstract Crohn’s disease (CD) is a chronic inflammatory bowel disease with a progressive course, potentially affecting the entire gastrointestinal tract from mouth to anus. Several studies have shown an increased risk of both intestinal and extra-intestinal cancer in patients with CD, due to long-standing transmural inflammation and damage accumulation. The similarity of symptoms among CD, its related complications and the de novo onset of gastrointestinal cancer raises difficulties in the differential diagnosis. In addition, once a cancer diagnosis in CD patients is made, selecting the appropriate treatment can be particularly challenging. Indeed, both surgical and oncological treatments are not always the same as that of the general population, due to the inflammatory context of the gastrointestinal tract and the potential exacerbation of gastrointestinal symptoms of patients with CD; moreover, the overlap of the neoplastic disease could lead to adjustments in the pharmacological treatment of the underlying CD, especially with regard to immunosuppressive drugs. For these reasons, a case-by-case analysis in a multidisciplinary approach is often appropriate for the best diagnostic and therapeutic evaluation of patients with CD after gastrointestinal cancer onset.
Collapse
|
61
|
Aguila EJT, Cua IHY. Adapting digital technology to the gastroenterology and endoscopy practice in the pandemic era. ADVANCES IN DIGESTIVE MEDICINE 2021. [DOI: 10.1002/aid2.13262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Enrik John T. Aguila
- Institute of Digestive and Liver Diseases St. Luke's Medical Center Global City Taguig Philippines
| | - Ian Homer Y. Cua
- Institute of Digestive and Liver Diseases St. Luke's Medical Center Global City Taguig Philippines
| |
Collapse
|
62
|
Phillips F, Beg S. Video capsule endoscopy: pushing the boundaries with software technology. Transl Gastroenterol Hepatol 2021; 6:17. [PMID: 33409411 DOI: 10.21037/tgh.2020.02.01] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2019] [Accepted: 12/11/2019] [Indexed: 12/14/2022] Open
Abstract
Video capsule endoscopy (VCE) has transformed imaging of the small bowel as it is a non-invasive and well tolerated modality with excellent diagnostic capabilities. The way we read VCE has not changed much since its introduction nearly two decades ago. Reading is still very time intensive and prone to reader error. This review outlines the evidence regarding software enhancements which aim to address these challenges. These include the suspected blood indicator (SBI), automated fast viewing modes including QuickView, lesion characterization tools such Fuji Intelligent Color Enhancement, and three-dimensional (3D) representation tools. We also outline the exciting new evidence of artificial intelligence (AI) and deep learning (DL), which promises to revolutionize capsule reading. DL algorithms have been developed for identifying organs of origin, intestinal motility events, active bleeding, coeliac disease, polyp detection, hookworms and angioectasias, all with impressively high sensitivity and accuracy. More recently, an algorithm has been created to detect multiple abnormalities with a sensitivity of 99.9% and reading time of only 5.9 minutes. These algorithms will need to be validated robustly. However, it will not be long before we see this in clinical practice, aiding the clinician in rapid and accurate diagnosis.
Collapse
Affiliation(s)
- Frank Phillips
- Department of Gastroenterology, NIHR Nottingham Digestive Diseases Biomedical Research Centre, Queens Medical Centre Campus, Nottingham University Hospitals NHS Trust, Nottingham, UK
| | - Sabina Beg
- Department of Gastroenterology, NIHR Nottingham Digestive Diseases Biomedical Research Centre, Queens Medical Centre Campus, Nottingham University Hospitals NHS Trust, Nottingham, UK
| |
Collapse
|
63
|
Marzullo A, Moccia S, Calimeri F, De Momi E. AIM in Endoscopy Procedures. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_164-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
|
64
|
Le A, Salifu MO, McFarlane IM. Artificial Intelligence in Colorectal Polyp Detection and Characterization. INTERNATIONAL JOURNAL OF CLINICAL RESEARCH & TRIALS 2021; 6:157. [PMID: 33884326 PMCID: PMC8057724 DOI: 10.15344/2456-8007/2021/157] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
BACKGROUND Over the past 20 years, the advancement of artificial intelligence (AI) and deep learning (DL) has allowed for fast sorting and analysis of large sets of data. In the field of gastroenterology, colorectal screening procedures produces an abundance of data through video and imaging. With AI and DL, this information can be used to create systems where automatic polyp detection and characterization is possible. Convoluted Neural Networks (CNNs) have proven to be an effective way to increase polyp detection and ultimately adenoma detection rates. Different methods of polyp characterization of being hyperplastic vs. adenomatous or non-neoplastic vs. neoplastic has also been investigated showing promising results. FINDINGS The rate of missed polyps on colonoscopy can be as high as 25%. At the beginning of the 2000s, hand-crafted machine learning (ML) algorithms were created and trained retrospectively on colonoscopy images and videos, achieving high sensitivity, specificity, and accuracy of over 90% in many of the studies. Over time, the advancement of DL and CNNs has allowed algorithms to be trained on non-medical images and applied retrospectively to colonoscopy videos and images with similar results. Within the past few years, these algorithms have been applied in real-time colonoscopies and has shown mixed results, one showing no difference while others showing increased polyp detection.Various methods of polyp characterization have also been investigated. Through AI, DL, and CNNs polyps can be identified has hyperplastic/adenomatous or non-neoplastic/neoplastic with high sensitivity, specificity, and accuracy. One of the research areas in polyp characterization is how to capture the polyp image. This paper looks at different modalities of characterizing polyps such as magnifying narrow band imaging (NBI), endocytoscopy, laser-induced florescent spectroscopy, auto-florescent endoscopy, and white-light endoscopy. CONCLUSIONS Overall, much progress has been made in automatic detection and characterization of polyps in real time. Barring ethical or mass adoption setbacks, it is inevitable that AI will be involved in the field of GI, especially in colorectal polyp detection and identification.
Collapse
Affiliation(s)
| | | | - Isabel M. McFarlane
- Corresponding Author: Dr. Isabel M. McFarlane, Clinical Assistant Professor of Medicine, Director, Third Year Internal Medicine Clerkship, Department of Internal Medicine, Brooklyn, NY 11203, USA Tel: 718-270-2390, Fax: 718-270-1324;
| |
Collapse
|
65
|
Sinonquel P, Eelbode T, Bossuyt P, Maes F, Bisschops R. Artificial intelligence and its impact on quality improvement in upper and lower gastrointestinal endoscopy. Dig Endosc 2021; 33:242-253. [PMID: 33145847 DOI: 10.1111/den.13888] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 10/14/2020] [Accepted: 11/01/2020] [Indexed: 12/24/2022]
Abstract
Artificial intelligence (AI) and its application in medicine has grown large interest. Within gastrointestinal (GI) endoscopy, the field of colonoscopy and polyp detection is the most investigated, however, upper GI follows the lead. Since endoscopy is performed by humans, it is inherently an imperfect procedure. Computer-aided diagnosis may improve its quality by helping prevent missing lesions and supporting optical diagnosis for those detected. An entire evolution in AI systems has been established in the last decades, resulting in optimization of the diagnostic performance with lower variability and matching or even outperformance of expert endoscopists. This shows a great potential for future quality improvement of endoscopy, given the outstanding diagnostic features of AI. With this narrative review, we highlight the potential benefit of AI to improve overall quality in daily endoscopy and describe the most recent developments for characterization and diagnosis as well as the recent conditions for regulatory approval.
Collapse
Affiliation(s)
- Pieter Sinonquel
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, Leuven, Belgium.,Departments of, Department of, Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven, Leuven, Belgium
| | - Tom Eelbode
- Medical Imaging Research Center (MIRC), University Hospitals Leuven, Leuven, Belgium.,Department of Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Peter Bossuyt
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, Leuven, Belgium.,Department of Gastroenterology and Hepatology, Imelda Hospital, Bonheiden, Belgium
| | - Frederik Maes
- Medical Imaging Research Center (MIRC), University Hospitals Leuven, Leuven, Belgium.,Department of Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Raf Bisschops
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, Leuven, Belgium.,Departments of, Department of, Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven, Leuven, Belgium
| |
Collapse
|
66
|
Lei S, Wang Z, Tu M, Liu P, Lei L, Xiao X, Zhou G, Liu X, Li L, Wang P. Adenoma detection rate is not influenced by the time of day in computer-aided detection colonoscopy. Medicine (Baltimore) 2020; 99:e23685. [PMID: 33371110 PMCID: PMC7748207 DOI: 10.1097/md.0000000000023685] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2020] [Accepted: 11/13/2020] [Indexed: 12/29/2022] Open
Abstract
Because of endoscopist fatigue, the time of colonoscopy have been shown to influence adenoma detection rate (ADR). Computer-aided detection (CADe) provides simultaneous visual alerts on polyps during colonoscopy and thus to increase adenoma detection rate. This is attributable to the strengthening of endoscopists diagnostic level and alleviation of fatigue. The aim of the study was to investigate whether CADe colonoscopy could eliminate the influence of the afternoon fatigue on ADR.We retrospectively analyzed the recorded data of patients who were performed CADe colonoscopy from September 2017 to February 2019 in Endoscopy Center of Sichuan Provincial People's Hospital. Patients demographic as well as baseline data recorded during colonoscopy were used for the analysis. Morning colonoscopy was defined as colonoscopic procedures starting between 8:00 am and 12:00 noon. Afternoon colonoscopy was defined as procedures starting at 2:00 pm and thereafter. The primary outcome was ADR. Univariate analysis and multivariate regression analysis were also performed.A total of 484 CADe colonoscopies were performed by 4 endoscopists in the study. The overall polyp detection rate was 52% and overall ADR was 35.5%. The mean number of adenomas detected per colonoscopy (0.62 vs 0.61, P > .05) and ADR (0.36 vs 0.35, P > .05) were similar in the am and pm group. Multivariable analysis shows that the ADR of CADe colonoscopy was influenced by the age (P < .001), gender (P = .004) and withdrawal time (P < .001), no correlation was found regarding bowel preparation (P = .993) and endoscopist experience (P = .804).CADe colonoscopy could eliminate the influence of the afternoon fatigue on ADR. The ADR during CADe colonoscopy is significantly affected by age, gender and withdrawal time.
Collapse
Affiliation(s)
| | | | - Mengtian Tu
- Department of Internal Medicine, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
| | | | - Lei Lei
- Department of Gastroenterology
| | | | | | | | | | - Pu Wang
- Department of Gastroenterology
| |
Collapse
|
67
|
Barua I, Mori Y, Bretthauer M. Colorectal polyp characterization with endocytoscopy: Ready for widespread implementation with artificial intelligence? Best Pract Res Clin Gastroenterol 2020; 52-53:101721. [PMID: 34172248 DOI: 10.1016/j.bpg.2020.101721] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Revised: 12/07/2020] [Accepted: 12/15/2020] [Indexed: 01/31/2023]
Abstract
Endocytoscopy provides an in-vivo visualization of nuclei and micro-vessels at the cellular level in real-time, facilitating so-called "optical biopsy" or "virtual histology" of colorectal polyps/neoplasms. This functionality is enabled by 520-fold magnification power with endocytoscopy and recent breakthroughs in artificial intelligence (AI) allowing a great advance in endocytoscopic imaging; interpretation of images is now fully supported by AI tool which outputs predictions of polyp histopathology during colonoscopy. The advantage of the use of AI during optical biopsy can be appreciated especially by non-expert endoscopists who to increase performance. This paper provides an overview of the latest evidence on colorectal polyp characterization with endocytoscopy combined with AI and identify the barriers to its widespread implementation.
Collapse
Affiliation(s)
- Ishita Barua
- Clinical Effectiveness Research Group, Institute of Health and Society, University of Oslo, and Department of Transplantation Medicine Oslo University Hospital, Oslo, Norway
| | - Yuichi Mori
- Clinical Effectiveness Research Group, Institute of Health and Society, University of Oslo, and Department of Transplantation Medicine Oslo University Hospital, Oslo, Norway; Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan.
| | - Michael Bretthauer
- Clinical Effectiveness Research Group, Institute of Health and Society, University of Oslo, and Department of Transplantation Medicine Oslo University Hospital, Oslo, Norway
| |
Collapse
|
68
|
Liu P, Wang P, Glissen Brown JR, Berzin TM, Zhou G, Liu W, Xiao X, Chen Z, Zhang Z, Zhou C, Lei L, Xiong F, Li L, Liu X. The single-monitor trial: an embedded CADe system increased adenoma detection during colonoscopy: a prospective randomized study. Therap Adv Gastroenterol 2020; 13:1756284820979165. [PMID: 33403003 PMCID: PMC7745558 DOI: 10.1177/1756284820979165] [Citation(s) in RCA: 52] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Accepted: 11/16/2020] [Indexed: 02/04/2023] Open
Abstract
BACKGROUND Computer-aided detection (CADe) of colon polyps has been demonstrated to improve colon polyp and adenoma detection during colonoscopy by indicating the location of a given polyp on a parallel monitor. The aim of this study was to investigate whether embedding the CADe system into the primary colonoscopy monitor may serve to increase polyp and adenoma detection, without increasing physician fatigue level. METHODS Consecutive patients presenting for colonoscopies were prospectively randomized to undergo routine colonoscopy with or without the assistance of a real-time polyp detection CADe system. Fatigue level was evaluated from score 0 to 10 by the performing endoscopists after each colonoscopy procedure. The main outcome was adenoma detection rate (ADR). RESULTS Out of 790 patients analyzed, 397 were randomized to routine colonoscopy (control group), and 393 to a colonoscopy with computer-aided diagnosis (CADe group). The ADRs were 20.91% and 29.01%, respectively (OR = 1.546, 95% CI 1.116-2.141, p = 0.009). The average number of adenomas per colonoscopy (APC) was 0.29 and 0.48, respectively (Change Folds = 1.64, 95% CI 1.299-2.063, p < 0.001). The improvement in polyp detection was mainly due to increased detection of non-advanced diminutive adenomas, serrated adenoma and hyperplastic polyps. The fatigue score for each procedure was 3.28 versus 3.40 for routine and CADe group, p = 0.357. CONCLUSIONS A real-time CADe system employed on the primary endoscopy monitor may lead to improvements in ADR and polyp detection rate without increasing fatigue level during colonoscopy. The integration of a low-latency and high-performance CADe systems may serve as an effective quality assurance tool during colonoscopy. www.chictr.org.cn number, ChiCTR1800018058.
Collapse
Affiliation(s)
- Peixi Liu
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Pu Wang
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, No.32 West Second Section First Ring Road, Chengdu, Sichuan, China
| | - Jeremy R. Glissen Brown
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts, USA
| | - Tyler M. Berzin
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts, USA
| | - Guanyu Zhou
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Weihui Liu
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Xun Xiao
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Ziyang Chen
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Zhihong Zhang
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Chao Zhou
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Lei Lei
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Fei Xiong
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Liangping Li
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| | - Xiaogang Liu
- Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, Sichuan, China
| |
Collapse
|
69
|
Sánchez-Peralta LF, Picón A, Sánchez-Margallo FM, Pagador JB. Unravelling the effect of data augmentation transformations in polyp segmentation. Int J Comput Assist Radiol Surg 2020; 15:1975-1988. [PMID: 32989680 PMCID: PMC7671995 DOI: 10.1007/s11548-020-02262-4] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Accepted: 09/14/2020] [Indexed: 12/27/2022]
Abstract
PURPOSE Data augmentation is a common technique to overcome the lack of large annotated databases, a usual situation when applying deep learning to medical imaging problems. Nevertheless, there is no consensus on which transformations to apply for a particular field. This work aims at identifying the effect of different transformations on polyp segmentation using deep learning. METHODS A set of transformations and ranges have been selected, considering image-based (width and height shift, rotation, shear, zooming, horizontal and vertical flip and elastic deformation), pixel-based (changes in brightness and contrast) and application-based (specular lights and blurry frames) transformations. A model has been trained under the same conditions without data augmentation transformations (baseline) and for each of the transformation and ranges, using CVC-EndoSceneStill and Kvasir-SEG, independently. Statistical analysis is performed to compare the baseline performance against results of each range of each transformation on the same test set for each dataset. RESULTS This basic method identifies the most adequate transformations for each dataset. For CVC-EndoSceneStill, changes in brightness and contrast significantly improve the model performance. On the contrary, Kvasir-SEG benefits to a greater extent from the image-based transformations, especially rotation and shear. Augmentation with synthetic specular lights also improves the performance. CONCLUSION Despite being infrequently used, pixel-based transformations show a great potential to improve polyp segmentation in CVC-EndoSceneStill. On the other hand, image-based transformations are more suitable for Kvasir-SEG. Problem-based transformations behave similarly in both datasets. Polyp area, brightness and contrast of the dataset have an influence on these differences.
Collapse
Affiliation(s)
| | - Artzai Picón
- Tecnalia Research and Innovation, Zamudio, Spain
| | | | - J Blas Pagador
- Jesús Usón Minimally Invasive Surgery Centre, Road N-521, km 41.8, 10071, Cáceres, Spain
| |
Collapse
|
70
|
Tan L, Tivey D, Kopunic H, Babidge W, Langley S, Maddern G. Part 1: Artificial intelligence technology in surgery. ANZ J Surg 2020; 90:2409-2414. [PMID: 33000556 DOI: 10.1111/ans.16343] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2020] [Revised: 08/25/2020] [Accepted: 09/14/2020] [Indexed: 12/21/2022]
Abstract
Artificial intelligence (AI) is one of the disruptive technologies of the fourth Industrial Revolution that is changing our work practices. This technology is in use in highly diverse industries including health care, defence, insurance and e-commerce. This review focuses on the relevance of AI to surgery. AI will aid surgeons with diagnostic decision-making, patient selection for surgery as well as improve patient pre- and post-operative care and management. Ethical considerations of AI with respect to patient rights and data privacy are highlighted. A further challenge is how best to present to national regulators a pragmatic way to assess AI as 'software as a medical device'. This relates to the ramifications for the adoption of AI technology in clinical practice, and its subsequent public funding support and reimbursement. It is evident that AI technology has important applications in surgery in the 21st century. The establishment of a key work programme in this area will be important if surgeons are to fully utilize AI in surgery.
Collapse
Affiliation(s)
- Lorwai Tan
- Research, Audit and Academic Surgery, Royal Australasian College of Surgeons, Adelaide, South Australia, Australia
| | - David Tivey
- Research, Audit and Academic Surgery, Royal Australasian College of Surgeons, Adelaide, South Australia, Australia
- Discipline of Surgery, The Queen Elizabeth Hospital, The University of Adelaide, Adelaide, South Australia, Australia
| | - Helena Kopunic
- Research, Audit and Academic Surgery, Royal Australasian College of Surgeons, Adelaide, South Australia, Australia
| | - Wendy Babidge
- Research, Audit and Academic Surgery, Royal Australasian College of Surgeons, Adelaide, South Australia, Australia
- Discipline of Surgery, The Queen Elizabeth Hospital, The University of Adelaide, Adelaide, South Australia, Australia
| | - Sally Langley
- Plastic and Reconstructive Surgery Department, Christchurch Hospital, Christchurch, New Zealand
| | - Guy Maddern
- Research, Audit and Academic Surgery, Royal Australasian College of Surgeons, Adelaide, South Australia, Australia
- Discipline of Surgery, The Queen Elizabeth Hospital, The University of Adelaide, Adelaide, South Australia, Australia
| |
Collapse
|
71
|
Kohli A, Holzwanger EA, Levy AN. Emerging use of artificial intelligence in inflammatory bowel disease. World J Gastroenterol 2020; 26:6923-6928. [PMID: 33311940 PMCID: PMC7701951 DOI: 10.3748/wjg.v26.i44.6923] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 10/24/2020] [Accepted: 11/12/2020] [Indexed: 02/06/2023] Open
Abstract
Inflammatory bowel disease (IBD) is a complex, immune-mediated gastrointestinal disorder with ill-defined etiology, multifaceted diagnostic criteria, and unpredictable treatment response. Innovations in IBD diagnostics, including developments in genomic sequencing and molecular analytics, have generated tremendous interest in leveraging these large data platforms into clinically meaningful tools. Artificial intelligence, through machine learning facilitates the interpretation of large arrays of data, and may provide insight to improving IBD outcomes. While potential applications of machine learning models are vast, further research is needed to generate standardized models that can be adapted to target IBD populations.
Collapse
Affiliation(s)
- Arushi Kohli
- Department of Internal Medicine, Tufts Medical Center, Boston, MA 02111, United States
| | - Erik A Holzwanger
- Division of Gastroenterology and Hepatology, Tufts Medical Center, Boston, MA 02111, United States
| | - Alexander N Levy
- Division of Gastroenterology and Hepatology, Tufts Medical Center, Boston, MA 02111, United States
| |
Collapse
|
72
|
Wang WA, Dong P, Zhang A, Wang WJ, Guo CA, Wang J, Liu HB. Artificial intelligence: A new budding star in gastric cancer. Artif Intell Gastroenterol 2020; 1:60-70. [DOI: 10.35712/aig.v1.i4.60] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Revised: 11/01/2020] [Accepted: 11/27/2020] [Indexed: 02/06/2023] Open
Abstract
The pursuit of health has always been the driving force for the advancement of human society, and social development will be profoundly affected by every breakthrough in the medical industry. With the arrival of the information technology revolution era, artificial intelligence (AI) technology has been rapidly developed. AI has been combined with medicine but it has been less studied with gastric cancer (GC). AI is a new budding star in GC, and its contribution to GC is mainly focused on diagnosis and treatment. For early GC, AI’s impact is not only reflected in its high accuracy but also its ability to quickly train primary doctors, improve the diagnosis rate of early GC, and reduce missed cases. At the same time, it will also reduce the possibility of missed diagnosis of advanced GC in cardia. Furthermore, it is used to assist imaging doctors to determine the location of lymph nodes and, more importantly, it can more effectively judge the lymph node metastasis of GC, which is conducive to the prognosis of patients. In surgical treatment of GC, it also has great potential. Robotic surgery is the latest technology in GC surgery. It is a bright star for minimally invasive treatment of GC, and together with laparoscopic surgery, it has become a common treatment for GC. Through machine learning, robotic systems can reduce operator errors and trauma of patients, and can predict the prognosis of GC patients. Throughout the centuries of development of surgery, the history gradually changes from traumatic to minimally invasive. In the future, AI will help GC patients reduce surgical trauma and further improve the efficiency of minimally invasive treatment of GC.
Collapse
Affiliation(s)
- Wen-An Wang
- Graduate School, Gansu University of Traditional Chinese Medicine, Lanzhou 730000, Gansu Province, China
- Department of General Surgery, The 940th Hospital of Joint Logistics Support Force of Chinese People’s Liberation Army, Lanzhou 730050, Gansu Province, China
| | - Peng Dong
- Department of General Surgery, Lanzhou University Second Hospital, Lanzhou 730000, Gansu Province, China
| | - An Zhang
- Graduate School, Gansu University of Traditional Chinese Medicine, Lanzhou 730000, Gansu Province, China
- Department of General Surgery, The 940th Hospital of Joint Logistics Support Force of Chinese People’s Liberation Army, Lanzhou 730050, Gansu Province, China
| | - Wen-Jie Wang
- Department of General Surgery, Lanzhou University Second Hospital, Lanzhou 730000, Gansu Province, China
| | - Chang-An Guo
- Department of Emergency Medicine, Lanzhou University Second Hospital, Lanzhou 730000, Gansu Province, China
| | - Jing Wang
- Graduate School, Gansu University of Traditional Chinese Medicine, Lanzhou 730000, Gansu Province, China
- Department of General Surgery, The 940th Hospital of Joint Logistics Support Force of Chinese People’s Liberation Army, Lanzhou 730050, Gansu Province, China
| | - Hong-Bin Liu
- Department of General Surgery, The 940th Hospital of Joint Logistics Support Force of Chinese People’s Liberation Army, Lanzhou 730050, Gansu Province, China
| |
Collapse
|
73
|
Sinagra E, Badalamenti M, Maida M, Spadaccini M, Maselli R, Rossi F, Conoscenti G, Raimondo D, Pallio S, Repici A, Anderloni A. Use of artificial intelligence in improving adenoma detection rate during colonoscopy: Might both endoscopists and pathologists be further helped. World J Gastroenterol 2020; 26:5911-5918. [PMID: 33132644 PMCID: PMC7584058 DOI: 10.3748/wjg.v26.i39.5911] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 08/18/2020] [Accepted: 09/23/2020] [Indexed: 02/06/2023] Open
Abstract
Colonoscopy remains the standard strategy for screening for colorectal cancer around the world due to its efficacy in both detecting adenomatous or pre-cancerous lesions and the capacity to remove them intra-procedurally. Computer-aided detection and diagnosis (CAD), thanks to the brand new developed innovations of artificial intelligence, and especially deep-learning techniques, leads to a promising solution to human biases in performance by guarantying decision support during colonoscopy. The application of CAD on real-time colonoscopy helps increasing the adenoma detection rate, and therefore contributes to reduce the incidence of interval cancers improving the effectiveness of colonoscopy screening on critical outcome such as colorectal cancer related mortality. Furthermore, a significant reduction in costs is also expected. In addition, the assistance of the machine will lead to a reduction of the examination time and therefore an optimization of the endoscopic schedule. The aim of this opinion review is to analyze the clinical applications of CAD and artificial intelligence in colonoscopy, as it is reported in literature, addressing evidence, limitations, and future prospects.
Collapse
Affiliation(s)
- Emanuele Sinagra
- Gastroenterology and Endoscopy Unit, Fondazione Istituto San Raffaele Giglio, Cefalù 90015, Italy
| | - Matteo Badalamenti
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Clinical and Research Center IRCCS, Rozzano 20089, Italy
| | - Marcello Maida
- Gastroenterology and Endoscopy Unit, S. Elia-Raimondi Hospital, Caltanissetta 93100, Italy
| | - Marco Spadaccini
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Clinical and Research Center IRCCS, Rozzano 20089, Italy
| | - Roberta Maselli
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Clinical and Research Center IRCCS, Rozzano 20089, Italy
| | - Francesca Rossi
- Gastroenterology and Endoscopy Unit, Fondazione Istituto San Raffaele Giglio, Cefalù 90015, Italy
| | - Giuseppe Conoscenti
- Gastroenterology and Endoscopy Unit, Fondazione Istituto San Raffaele Giglio, Cefalù 90015, Italy
| | - Dario Raimondo
- Gastroenterology and Endoscopy Unit, Fondazione Istituto San Raffaele Giglio, Cefalù 90015, Italy
| | - Socrate Pallio
- Endoscopy Unit, AOUP Policlinico G. Martino, Messina 98125, Italy
| | - Alessandro Repici
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Clinical and Research Center IRCCS, Rozzano 20089, Italy
| | - Andrea Anderloni
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Clinical and Research Center IRCCS, Rozzano 20089, Italy
| |
Collapse
|
74
|
Hussein M, González-Bueno Puyal J, Mountney P, Lovat LB, Haidry R. Role of artificial intelligence in the diagnosis of oesophageal neoplasia: 2020 an endoscopic odyssey. World J Gastroenterol 2020; 26:5784-5796. [PMID: 33132634 PMCID: PMC7579761 DOI: 10.3748/wjg.v26.i38.5784] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Revised: 08/12/2020] [Accepted: 09/12/2020] [Indexed: 02/06/2023] Open
Abstract
The past decade has seen significant advances in endoscopic imaging and optical enhancements to aid early diagnosis. There is still a treatment gap due to the underdiagnosis of lesions of the oesophagus. Computer aided diagnosis may play an important role in the coming years in providing an adjunct to endoscopists in the early detection and diagnosis of early oesophageal cancers, therefore curative endoscopic therapy can be offered. Research in this area of artificial intelligence is expanding and the future looks promising. In this review article we will review current advances in artificial intelligence in the oesophagus and future directions for development.
Collapse
Affiliation(s)
- Mohamed Hussein
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, Division of Surgery and Interventional Sciences, University College London, London W1W 7TY, United Kingdom
| | - Juana González-Bueno Puyal
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London W1W 7TY, United Kingdom and Odin Vision, London W1W 7TS, United Kingdom
| | | | - Laurence B Lovat
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, Division of Surgery and Interventional Sciences, University College London, London W1W 7TY, United Kingdom
| | - Rehan Haidry
- Department of GI Services, University College London Hospital, London NW1 2BU, United Kingdom
| |
Collapse
|
75
|
Wang P, Liu P, Glissen Brown JR, Berzin TM, Zhou G, Lei S, Liu X, Li L, Xiao X. Lower Adenoma Miss Rate of Computer-Aided Detection-Assisted Colonoscopy vs Routine White-Light Colonoscopy in a Prospective Tandem Study. Gastroenterology 2020; 159:1252-1261.e5. [PMID: 32562721 DOI: 10.1053/j.gastro.2020.06.023] [Citation(s) in RCA: 144] [Impact Index Per Article: 28.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/24/2020] [Revised: 05/10/2020] [Accepted: 06/10/2020] [Indexed: 12/14/2022]
Abstract
BACKGROUND AND AIMS Up to 30% of adenomas might be missed during screening colonoscopy-these could be polyps that appear on-screen but are not recognized by endoscopists or polyps that are in locations that do not appear on the screen at all. Computer-aided detection (CADe) systems, based on deep learning, might reduce rates of missed adenomas by displaying visual alerts that identify precancerous polyps on the endoscopy monitor in real time. We compared adenoma miss rates of CADe colonoscopy vs routine white-light colonoscopy. METHODS We performed a prospective study of patients, 18-75 years old, referred for diagnostic, screening, or surveillance colonoscopies at a single endoscopy center of Sichuan Provincial People's Hospital from June 3, 2019 through September 24, 2019. Same day, tandem colonoscopies were performed for each participant by the same endoscopist. Patients were randomly assigned to groups that received either CADe colonoscopy (n=184) or routine colonoscopy (n=185) first, followed immediately by the other procedure. Endoscopists were blinded to the group each patient was assigned to until immediately before the start of each colonoscopy. Polyps that were missed by the CADe system but detected by endoscopists were classified as missed polyps. False polyps were those continuously traced by the CADe system but then determined not to be polyps by the endoscopists. The primary endpoint was adenoma miss rate, which was defined as the number of adenomas detected in the second-pass colonoscopy divided by the total number of adenomas detected in both passes. RESULTS The adenoma miss rate was significantly lower with CADe colonoscopy (13.89%; 95% CI, 8.24%-19.54%) than with routine colonoscopy (40.00%; 95% CI, 31.23%-48.77%, P<.0001). The polyp miss rate was significantly lower with CADe colonoscopy (12.98%; 95% CI, 9.08%-16.88%) than with routine colonoscopy (45.90%; 95% CI, 39.65%-52.15%) (P<.0001). Adenoma miss rates in ascending, transverse, and descending colon were significantly lower with CADe colonoscopy than with routine colonoscopy (ascending colon 6.67% vs 39.13%; P=.0095; transverse colon 16.33% vs 45.16%; P=.0065; and descending colon 12.50% vs 40.91%, P=.0364). CONCLUSIONS CADe colonoscopy reduced the overall miss rate of adenomas by endoscopists using white-light endoscopy. Routine use of CADe might reduce the incidence of interval colon cancers. chictr.org.cn study no: ChiCTR1900023086.
Collapse
Affiliation(s)
- Pu Wang
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, China
| | - Peixi Liu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, China
| | - Jeremy R Glissen Brown
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts
| | - Tyler M Berzin
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts
| | - Guanyu Zhou
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, China
| | - Shan Lei
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, China
| | - Xiaogang Liu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, China
| | - Liangping Li
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, China
| | - Xun Xiao
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, China.
| |
Collapse
|
76
|
Li T, Glissen Brown JR, Tsourides K, Mahmud N, Cohen JM, Berzin TM. Training a computer-aided polyp detection system to detect sessile serrated adenomas using public domain colonoscopy videos. Endosc Int Open 2020; 8:E1448-E1454. [PMID: 33043112 PMCID: PMC7541193 DOI: 10.1055/a-1229-3927] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
Background Colorectal cancer (CRC) is a major public health burden worldwide, and colonoscopy is the most commonly used CRC screening tool. Still, there is variability in adenoma detection rate (ADR) among endoscopists. Recent studies have reported improved ADR using deep learning models trained on videos curated largely from private in-house datasets. Few have focused on the detection of sessile serrated adenomas (SSAs), which are the most challenging target clinically. Methods We identified 23 colonoscopy videos available in the public domain and for which pathology data were provided, totaling 390 minutes of footage. Expert endoscopists annotated segments of video with adenomatous polyps, from which we captured 509 polyp-positive and 6,875 polyp-free frames. Via data augmentation, we generated 15,270 adenomatous polyp-positive images, of which 2,310 were SSAs, and 20,625 polyp-negative images. We used the CNN AlexNet and fine-tuned its parameters using 90 % of the images, before testing its performance on the remaining 10 % of images unseen by the model. Results We trained the model on 32,305 images and tested performance on 3,590 images with the same proportion of SSA, non-SSA polyp-positive, and polyp-negative images. The overall accuracy of the model was 0.86, with a sensitivity of 0.73 and a specificity of 0.96. Positive predictive value was 0.93 and negative predictive value was 0.96. The area under the curve was 0.94. SSAs were detected in 93 % of SSA-positive images. Conclusions Using a relatively small set of publicly-available colonoscopy data, we obtained sizable training and validation sets of endoscopic images using data augmentation, and achieved an excellent performance in adenomatous polyp detection.
Collapse
Affiliation(s)
- Taibo Li
- Johns Hopkins School of Medicine – MD-PhD Program, Baltimore, Maryland, United States,MIT – Department of Electrical Engineering and Computer Science, Cambridge, Massachusetts, United States
| | - Jeremy R. Glissen Brown
- Center for Advanced Endoscopy, Division of Gastroenterology, Beth Israel Deaconess, Medical Center and Harvard Medical School, Boston, Massachusetts 02130
| | - Kelovoulos Tsourides
- MIT – Department of Brain and Cognitive Sciences, Cambridge, Massachusetts, United States
| | - Nadim Mahmud
- Hospital of the University of Pennsylvania – Division of Gastroenterology, Boston, Massachusetts, United States
| | - Jonah M. Cohen
- Center for Advanced Endoscopy, Division of Gastroenterology, Beth Israel Deaconess, Medical Center and Harvard Medical School, Boston, Massachusetts 02130
| | - Tyler M. Berzin
- Center for Advanced Endoscopy, Division of Gastroenterology, Beth Israel Deaconess, Medical Center and Harvard Medical School, Boston, Massachusetts 02130
| |
Collapse
|
77
|
Wadhwa V, Alagappan M, Gonzalez A, Gupta K, Brown JRG, Cohen J, Sawhney M, Pleskow D, Berzin TM. Physician sentiment toward artificial intelligence (AI) in colonoscopic practice: a survey of US gastroenterologists. Endosc Int Open 2020; 8:E1379-E1384. [PMID: 33015341 PMCID: PMC7508643 DOI: 10.1055/a-1223-1926] [Citation(s) in RCA: 46] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/27/2020] [Accepted: 05/18/2020] [Indexed: 02/06/2023] Open
Abstract
Background and study aims Early studies have shown that artificial intelligence (AI) has the potential to augment the performance of gastroenterologists during endoscopy. Our aim was to determine how gastroenterologists view the potential role of AI in gastrointestinal endoscopy. Methods In this cross-sectional study, an online survey was sent to US gastroenterologists. The survey included questions about physician level of training, experience, and practice characteristics and physician perception of AI. Descriptive statistics were used to summarize sentiment about AI. Univariate and multivariate analyses were used to assess whether background information about physicians correlated to their sentiment. Results Surveys were emailed to 330 gastroenterologists nationwide. Between December 2018 and January 2019, 124 physicians (38 %) completed the survey. Eighty-six percent of physicians reported interest in AI-assisted colonoscopy; 84.7 % agreed that computer-assisted polyp detection (CADe) would improve their endoscopic performance. Of the respondents, 57.2 % felt comfortable using computer-aided diagnosis (CADx) to support a "diagnose and leave" strategy for hyperplastic polyps. Multivariate analysis showed that post-fellowship experience of fewer than 15 years was the most important factor in determining whether physicians were likely to believe that CADe would lead to more removed polyps (odds ratio = 5.09; P = .01). The most common concerns about implementation of AI were cost (75.2 %), operator dependence (62.8 %), and increased procedural time (60.3 %). Conclusions Gastroenterologists have strong interest in the application of AI to colonoscopy, particularly with regard to CADe for polyp detection. The primary concerns were its cost, potential to increase procedural time, and potential to develop operator dependence. Future developments in AI should prioritize mitigation of these concerns.
Collapse
Affiliation(s)
- Vaibhav Wadhwa
- Department of Gastroenterology and Hepatology, Cleveland Clinic Florida, Weston, Florida, United States
| | - Muthuraman Alagappan
- Department of Gastroenterology and Hepatology, Cleveland Clinic Florida, Weston, Florida, United States
| | - Adalberto Gonzalez
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center/Harvard Medical School, Boston, Massachusetts, United States
| | - Kapil Gupta
- University of Miami /JFK Medical Center Palm Beach Regional GME Consortium, Atlantis, Florida, United States
| | - Jeremy R. Glissen Brown
- Department of Gastroenterology and Hepatology, Cleveland Clinic Florida, Weston, Florida, United States
| | - Jonah Cohen
- Department of Gastroenterology and Hepatology, Cleveland Clinic Florida, Weston, Florida, United States
| | - Mandeep Sawhney
- Department of Gastroenterology and Hepatology, Cleveland Clinic Florida, Weston, Florida, United States
| | - Douglas Pleskow
- Department of Gastroenterology and Hepatology, Cleveland Clinic Florida, Weston, Florida, United States
| | - Tyler M. Berzin
- Department of Gastroenterology and Hepatology, Cleveland Clinic Florida, Weston, Florida, United States
| |
Collapse
|
78
|
Mainali G. Artificial Intelligence in Medical Science: Perspective from a Medical Student. JNMA J Nepal Med Assoc 2020; 58:709-711. [PMID: 33068098 PMCID: PMC7580331 DOI: 10.31729/jnma.5257] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Indexed: 11/25/2022] Open
Affiliation(s)
- Gaurab Mainali
- Nepalese Army Institute of Health Sciences, Sanobharyang, Kathmandu, Nepal
| |
Collapse
|
79
|
Balaban DV, Jinga M. Digital histology in celiac disease: A practice changer. Artif Intell Gastroenterol 2020; 1:1-4. [DOI: 10.35712/aig.v1.i1.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 07/18/2020] [Accepted: 07/20/2020] [Indexed: 02/06/2023] Open
|
80
|
Digital histology in celiac disease: A practice changer. Artif Intell Gastroenterol 2020. [DOI: 10.35712/wjg.v1.i1.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
|
81
|
Affiliation(s)
- Mohammad Bilal
- Center for Advanced Endoscopy, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| | - Jeremy R Glissen Brown
- Center for Advanced Endoscopy, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| | - Tyler M Berzin
- Center for Advanced Endoscopy, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
82
|
Hakimian S, Patel K, Cave D. Sending in the ViCE Squad: Evaluation and Management of Patients with Small Intestinal Bleeding. Dig Dis Sci 2020; 65:1307-1314. [PMID: 32162121 DOI: 10.1007/s10620-020-06190-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Bleeding from the small intestine remains a clinically challenging diagnostic and therapeutic problem. It may be minor, requiring only supplemental iron treatment, to patients who have severe overt bleeding that requires multimodal intervention. This article provides an up-to-date review of the state-of-the-art of diagnosis and treatment of small intestinal bleeding.
Collapse
Affiliation(s)
- Shahrad Hakimian
- Division of Gastroenterology, Department of Medicine, UMass Memorial Medical Center, 55 Lake Ave. N., Worcester, MA, 01655, USA
| | - Krunal Patel
- Division of Gastroenterology, Department of Medicine, UMass Memorial Medical Center, 55 Lake Ave. N., Worcester, MA, 01655, USA
| | - David Cave
- Division of Gastroenterology, Department of Medicine, UMass Memorial Medical Center, 55 Lake Ave. N., Worcester, MA, 01655, USA.
| |
Collapse
|
83
|
Zhou G, Xiao X, Tu M, Liu P, Yang D, Liu X, Zhang R, Li L, Lei S, Wang H, Song Y, Wang P. Computer aided detection for laterally spreading tumors and sessile serrated adenomas during colonoscopy. PLoS One 2020; 15:e0231880. [PMID: 32315365 PMCID: PMC7173785 DOI: 10.1371/journal.pone.0231880] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Accepted: 04/02/2020] [Indexed: 12/22/2022] Open
Abstract
Background Evidence has shown that deep learning computer aided detection (CADe) system achieved high overall detection accuracy for polyp detection during colonoscopy. Aim The detection performance of CADe system on non-polypoid laterally spreading tumors (LSTs) and sessile serrated adenomas/polyps (SSA/Ps), with higher risk for malignancy transformation and miss rate, has not been exclusively investigated. Methods A previously validated deep learning CADe system for polyp detection was tested exclusively on LSTs and SSA/Ps. 1451 LST images from 184 patients were collected between July 2015 and January 2019, 82 SSA/Ps videos from 26 patients were collected between September 2018 and January 2019. The per-frame sensitivity and per-lesion sensitivity were calculated. Results (1) For LSTs image dataset, the system achieved an overall per-image sensitivity and per-lesion sensitivity of 94.07% (1365/1451) and 98.99% (197/199) respectively. The per-frame sensitivity for LST-G(H), LST-G(M), LST-NG(F), LST-NG(PD) was 93.97% (343/365), 98.72% (692/701), 85.71% (324/378) and 85.71% (6/7) respectively. The per-lesion sensitivity of each subgroup was 100.00% (71/71), 100.00% (64/64), 98.31% (58/59) and 80.00% (4/5). (2) For SSA/Ps video dataset, the system achieved an overall per-frame sensitivity and per-lesion sensitivity of 84.10% (15883/18885) and 100.00% (42/42), respectively. Conclusions This study demonstrated that a local-feature-prioritized automatic CADe system could detect LSTs and SSA/Ps with high sensitivity. The per-frame sensitivity for non-granular LSTs and small SSA/Ps should be further improved.
Collapse
Affiliation(s)
- Guanyu Zhou
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Xun Xiao
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Mengtian Tu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Peixi Liu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Dan Yang
- Department of Gastroenterology, The Affiliated Hospital of Southwest Medical University, Luzhou, Sichuan, China
| | - Xiaogang Liu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Renyi Zhang
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Liangping Li
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Shan Lei
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Han Wang
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Yan Song
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Pu Wang
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| |
Collapse
|
84
|
Abadir AP, Ali MF, Karnes W, Samarasena JB. Artificial Intelligence in Gastrointestinal Endoscopy. Clin Endosc 2020; 53:132-141. [PMID: 32252506 PMCID: PMC7137570 DOI: 10.5946/ce.2020.038] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/03/2020] [Accepted: 03/17/2020] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) is rapidly integrating into modern technology and clinical practice. Although in its nascency, AI has become a hot topic of investigation for applications in clinical practice. Multiple fields of medicine have embraced the possibility of a future with AI assisting in diagnosis and pathology applications. In the field of gastroenterology, AI has been studied as a tool to assist in risk stratification, diagnosis, and pathologic identification. Specifically, AI has become of great interest in endoscopy as a technology with substantial potential to revolutionize the practice of a modern gastroenterologist. From cancer screening to automated report generation, AI has touched upon all aspects of modern endoscopy. Here, we review landmark AI developments in endoscopy. Starting with broad definitions to develop understanding, we will summarize the current state of AI research and its potential applications. With innovation developing rapidly, this article touches upon the remarkable advances in AI-assisted endoscopy since its initial evaluation at the turn of the millennium, and the potential impact these AI models may have on the modern clinical practice. As with any discussion of new technology, its limitations must also be understood to apply clinical AI tools successfully.
Collapse
Affiliation(s)
- Alexander P Abadir
- Department of Medicine, University of California Irvine, Orange, CA, USA
| | - Mohammed Fahad Ali
- Department of Medicine, University of California Irvine, Orange, CA, USA
| | - William Karnes
- Division of Gastroenterology & Hepatology, Department of Medicine, H. H. Chao Comprehensive Digestive Disease Center, University of California Irvine, Orange, CA, USA
| | - Jason B Samarasena
- Division of Gastroenterology & Hepatology, Department of Medicine, H. H. Chao Comprehensive Digestive Disease Center, University of California Irvine, Orange, CA, USA
| |
Collapse
|
85
|
Zhou J, Wu L, Wan X, Shen L, Liu J, Zhang J, Jiang X, Wang Z, Yu S, Kang J, Li M, Hu S, Hu X, Gong D, Chen D, Yao L, Zhu Y, Yu H. A novel artificial intelligence system for the assessment of bowel preparation (with video). Gastrointest Endosc 2020; 91:428-435.e2. [PMID: 31783029 DOI: 10.1016/j.gie.2019.11.026] [Citation(s) in RCA: 99] [Impact Index Per Article: 19.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/11/2019] [Accepted: 11/19/2019] [Indexed: 02/08/2023]
Abstract
BACKGROUND AND AIMS The quality of bowel preparation is an important factor that can affect the effectiveness of a colonoscopy. Several tools, such as the Boston Bowel Preparation Scale (BBPS) and Ottawa Bowel Preparation Scale, have been developed to evaluate bowel preparation. However, understanding the differences between evaluation methods and consistently applying them can be challenging for endoscopists. There are also subjective biases and differences among endoscopists. Therefore, this study aimed to develop a novel, objective, and stable method for the assessment of bowel preparation through artificial intelligence. METHODS We used a deep convolutional neural network to develop this novel system. First, we retrospectively collected colonoscopy images to train the system and then compared its performance with endoscopists via a human-machine contest. Then, we applied this model to colonoscopy videos and developed a system named ENDOANGEL to provide bowel preparation scores every 30 seconds and to show the cumulative ratio of frames for each score during the withdrawal phase of the colonoscopy. RESULTS ENDOANGEL achieved 93.33% accuracy in the human-machine contest with 120 images, which was better than that of all endoscopists. Moreover, ENDOANGEL achieved 80.00% accuracy among 100 images with bubbles. In 20 colonoscopy videos, accuracy was 89.04%, and ENDOANGEL continuously showed the accumulated percentage of the images for different BBPS scores during the withdrawal phase and prompted us for bowel preparation scores every 30 seconds. CONCLUSIONS We provided a novel and more accurate evaluation method for bowel preparation and developed an objective and stable system-ENDOANGEL-that could be applied reliably and steadily in clinical settings.
Collapse
Affiliation(s)
- Jie Zhou
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Lianlian Wu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xinyue Wan
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Lei Shen
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Jun Liu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Jun Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xiaoda Jiang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Zhengqiang Wang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Shijie Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Jian Kang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Ming Li
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Shan Hu
- School of Resources and Environmental Sciences, Wuhan University, Wuhan, China
| | - Xiao Hu
- School of Resources and Environmental Sciences, Wuhan University, Wuhan, China
| | - Dexin Gong
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Di Chen
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Liwen Yao
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Yijie Zhu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Honggang Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| |
Collapse
|
86
|
Picardo S, Ragunath K. Artificial intelligence in endoscopy: the guardian angel is around the corner. Gastrointest Endosc 2020; 91:340-341. [PMID: 32036941 DOI: 10.1016/j.gie.2019.10.026] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2019] [Accepted: 10/18/2019] [Indexed: 02/07/2023]
Affiliation(s)
- Sherman Picardo
- Department of Gastroenterology and Hepatology, Royal Perth Hospital, Perth, Australia
| | - Krish Ragunath
- Department of Gastroenterology and Hepatology, Royal Perth Hospital, Perth, Australia; Curtain Medical School, Faculty of Health Sciences, Curtin University, Perth, Australia
| |
Collapse
|
87
|
Davaris N, Lux A, Esmaeili N, Illanes A, Boese A, Friebe M, Arens C. Evaluation of Vascular Patterns Using Contact Endoscopy and Narrow-Band Imaging (CE-NBI) for the Diagnosis of Vocal Fold Malignancy. Cancers (Basel) 2020; 12:E248. [PMID: 31968528 PMCID: PMC7016896 DOI: 10.3390/cancers12010248] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2019] [Revised: 01/11/2020] [Accepted: 01/16/2020] [Indexed: 02/06/2023] Open
Abstract
The endoscopic detection of perpendicular vascular changes (PVC) of the vocal folds has been associated with vocal fold cancer, dysplastic lesions, and papillomatosis, according to a classification proposed by the European Laryngological Society (ELS). The combination of contact endoscopy with narrow-band imaging (NBI-CE) allows intraoperatively a highly contrasted, real-time visualization of vascular changes of the vocal folds. Aim of the present study was to determine the association of PVC to specific histological diagnoses, the level of interobserver agreement in the detection of PVC, and their diagnostic effectiveness in diagnosing laryngeal malignancy. The evaluation of our data confirmed the association of PVC to vocal fold cancer, dysplastic lesions, and papillomatosis. The level of agreement between the observers in the identification of PVC was moderate for the less-experienced observers and almost perfect for the experienced observers. The identification of PVC during NBI-CE proved to be a valuable indicator for diagnosing malignant and premalignant lesions.
Collapse
Affiliation(s)
- Nikolaos Davaris
- Department of Otorhinolaryngology, Head and Neck Surgery, Magdeburg University Hospital, 39120 Magdeburg, Germany;
| | - Anke Lux
- Institute of Biometry and Medical Informatics, Otto-von-Guericke University, 39120 Magdeburg, Germany;
| | - Nazila Esmaeili
- Institute of Medical Technology, Otto-von-Guericke University Magdeburg, 39120 Magdeburg, Germany; (N.E.); (A.I.); (A.B.)
| | - Alfredo Illanes
- Institute of Medical Technology, Otto-von-Guericke University Magdeburg, 39120 Magdeburg, Germany; (N.E.); (A.I.); (A.B.)
| | - Axel Boese
- Institute of Medical Technology, Otto-von-Guericke University Magdeburg, 39120 Magdeburg, Germany; (N.E.); (A.I.); (A.B.)
| | - Michael Friebe
- Faculty of Medicine, Otto-von-Guericke-University, 39120 Magdeburg, Germany and IDTM GmbH, 45657 Recklinghausen, Germany;
| | - Christoph Arens
- Department of Otorhinolaryngology, Head and Neck Surgery, Magdeburg University Hospital, 39120 Magdeburg, Germany;
| |
Collapse
|
88
|
Ladabaum U, Dominitz JA, Kahi C, Schoen RE. Strategies for Colorectal Cancer Screening. Gastroenterology 2020; 158:418-432. [PMID: 31394083 DOI: 10.1053/j.gastro.2019.06.043] [Citation(s) in RCA: 393] [Impact Index Per Article: 78.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Revised: 06/06/2019] [Accepted: 06/24/2019] [Indexed: 12/11/2022]
Abstract
The incidence of colorectal cancer (CRC) is increasing worldwide. CRC has high mortality when detected at advanced stages, yet it is also highly preventable. Given the difficulties in implementing major lifestyle changes or widespread primary prevention strategies to decrease CRC risk, screening is the most powerful public health tool to reduce mortality. Screening methods are effective but have limitations. Furthermore, many screen-eligible people remain unscreened. We discuss established and emerging screening methods, and potential strategies to address current limitations in CRC screening. A quantum step in CRC prevention might come with the development of new screening strategies, but great gains can be made by deploying the available CRC screening modalities in ways that optimize outcomes while making judicious use of resources.
Collapse
Affiliation(s)
- Uri Ladabaum
- Division of Gastroenterology and Hepatology, Department of Medicine, Stanford University School of Medicine, Stanford, California.
| | - Jason A Dominitz
- Gastroenterology Section, Veterans Affairs Puget Sound Health Care System, Seattle, Washington; Division of Gastroenterology, Department of Medicine, University of Washington School of Medicine, Seattle, Washington
| | - Charles Kahi
- Indiana University School of Medicine, Indianapolis, Indiana; Richard L. Roudebush Veterans Affairs Medical Center, Indianapolis, Indiana
| | - Robert E Schoen
- Division of Gastroenterology, Hepatology and Nutrition, University of Pittsburgh, Pittsburgh, Pennsylvania
| |
Collapse
|
89
|
Abstract
Artificial intelligence (AI), a discipline encompassed by data science, has seen recent rapid growth in its application to healthcare and beyond, and is now an integral part of daily life. Uses of AI in gastroenterology include the automated detection of disease and differentiation of pathology subtypes and disease severity. Although a majority of AI research in gastroenterology focuses on adult applications, there are a number of pediatric pathologies that could benefit from more research. As new and improved diagnostic tools become available and more information is retrieved from them, AI could provide physicians a method to distill enormous amounts of data into enhanced decision-making and cost saving for children with digestive disorders. This review provides a broad overview of AI and examples of its possible applications in pediatric gastroenterology.
Collapse
|
90
|
Hsieh YH, Leung FW. An overview of deep learning algorithms and water exchange in colonoscopy in improving adenoma detection. Expert Rev Gastroenterol Hepatol 2019; 13:1153-1160. [PMID: 31755802 DOI: 10.1080/17474124.2019.1694903] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/01/2019] [Accepted: 11/15/2019] [Indexed: 02/09/2023]
Abstract
Introduction: Among the Gastrointestinal (GI) Endoscopy Editorial Board top 10 topics in advances in endoscopy in 2018, water exchange colonoscopy and artificial intelligence were both considered important advances. Artificial intelligence holds the potential to increase and water exchange significantly increases adenoma detection.Areas covered: The authors searched MEDLINE (1998-2019) using the following medical subject terms: water-aided, water-assisted and water exchange colonoscopy, adenoma, artificial intelligence, deep learning, computer-assisted detection, and neural networks. Additional related studies were manually searched from the reference lists of publications. Only fully published journal articles in English were reviewed. The latest date of the search was Aug10, 2019. Artificial intelligence, machine learning, and deep learning contribute to the promise of real-time computer-aided detection diagnosis. By emphasizing near-complete suction of infused water during insertion, water exchange provides salvage cleaning and decreases cleaning-related multi-tasking distractions during withdrawal, increasing adenoma detection. The review will address how artificial intelligence and water exchange can complement each other in improving adenoma detection during colonoscopy.Expert opinion: In 5 years, research on artificial intelligence will likely achieve real-time application and evaluation of factors contributing to quality colonoscopy. Better understanding and more widespread use of water exchange will be possible.
Collapse
Affiliation(s)
- Yu-Hsi Hsieh
- Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, Chiayi, Taiwan
- School of Medicine, Tzu Chi University, Hualien City, Taiwan
| | - Felix W Leung
- Sepulveda Ambulatory Care Center, Veterans Affairs Greater Los Angeles Healthcare System, North Hills, CA, USA
- David Geffen School of Medicine, at University of California at Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
91
|
Luo H, Xu G, Li C, He L, Luo L, Wang Z, Jing B, Deng Y, Jin Y, Li Y, Li B, Tan W, He C, Seeruttun SR, Wu Q, Huang J, Huang DW, Chen B, Lin SB, Chen QM, Yuan CM, Chen HX, Pu HY, Zhou F, He Y, Xu RH. Real-time artificial intelligence for detection of upper gastrointestinal cancer by endoscopy: a multicentre, case-control, diagnostic study. Lancet Oncol 2019; 20:1645-1654. [PMID: 31591062 DOI: 10.1016/s1470-2045(19)30637-0] [Citation(s) in RCA: 250] [Impact Index Per Article: 41.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Revised: 08/20/2019] [Accepted: 08/20/2019] [Indexed: 12/11/2022]
Abstract
BACKGROUND Upper gastrointestinal cancers (including oesophageal cancer and gastric cancer) are the most common cancers worldwide. Artificial intelligence platforms using deep learning algorithms have made remarkable progress in medical imaging but their application in upper gastrointestinal cancers has been limited. We aimed to develop and validate the Gastrointestinal Artificial Intelligence Diagnostic System (GRAIDS) for the diagnosis of upper gastrointestinal cancers through analysis of imaging data from clinical endoscopies. METHODS This multicentre, case-control, diagnostic study was done in six hospitals of different tiers (ie, municipal, provincial, and national) in China. The images of consecutive participants, aged 18 years or older, who had not had a previous endoscopy were retrieved from all participating hospitals. All patients with upper gastrointestinal cancer lesions (including oesophageal cancer and gastric cancer) that were histologically proven malignancies were eligible for this study. Only images with standard white light were deemed eligible. The images from Sun Yat-sen University Cancer Center were randomly assigned (8:1:1) to the training and intrinsic verification datasets for developing GRAIDS, and the internal validation dataset for evaluating the performance of GRAIDS. Its diagnostic performance was evaluated using an internal and prospective validation set from Sun Yat-sen University Cancer Center (a national hospital) and additional external validation sets from five primary care hospitals. The performance of GRAIDS was also compared with endoscopists with three degrees of expertise: expert, competent, and trainee. The diagnostic accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of GRAIDS and endoscopists for the identification of cancerous lesions were evaluated by calculating the 95% CIs using the Clopper-Pearson method. FINDINGS 1 036 496 endoscopy images from 84 424 individuals were used to develop and test GRAIDS. The diagnostic accuracy in identifying upper gastrointestinal cancers was 0·955 (95% CI 0·952-0·957) in the internal validation set, 0·927 (0·925-0·929) in the prospective set, and ranged from 0·915 (0·913-0·917) to 0·977 (0·977-0·978) in the five external validation sets. GRAIDS achieved diagnostic sensitivity similar to that of the expert endoscopist (0·942 [95% CI 0·924-0·957] vs 0·945 [0·927-0·959]; p=0·692) and superior sensitivity compared with competent (0·858 [0·832-0·880], p<0·0001) and trainee (0·722 [0·691-0·752], p<0·0001) endoscopists. The positive predictive value was 0·814 (95% CI 0·788-0·838) for GRAIDS, 0·932 (0·913-0·948) for the expert endoscopist, 0·974 (0·960-0·984) for the competent endoscopist, and 0·824 (0·795-0·850) for the trainee endoscopist. The negative predictive value was 0·978 (95% CI 0·971-0·984) for GRAIDS, 0·980 (0·974-0·985) for the expert endoscopist, 0·951 (0·942-0·959) for the competent endoscopist, and 0·904 (0·893-0·916) for the trainee endoscopist. INTERPRETATION GRAIDS achieved high diagnostic accuracy in detecting upper gastrointestinal cancers, with sensitivity similar to that of expert endoscopists and was superior to that of non-expert endoscopists. This system could assist community-based hospitals in improving their effectiveness in upper gastrointestinal cancer diagnoses. FUNDING The National Key R&D Program of China, the Natural Science Foundation of Guangdong Province, the Science and Technology Program of Guangdong, the Science and Technology Program of Guangzhou, and the Fundamental Research Funds for the Central Universities.
Collapse
Affiliation(s)
- Huiyan Luo
- Department of Medical Oncology, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Guoliang Xu
- Department of Endoscopy, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Chaofeng Li
- Artificial Intelligence Laboratory, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Longjun He
- Department of Endoscopy, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Linna Luo
- Department of Medical Oncology, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Zixian Wang
- Department of Medical Oncology, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Bingzhong Jing
- Artificial Intelligence Laboratory, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Yishu Deng
- Artificial Intelligence Laboratory, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Ying Jin
- Department of Medical Oncology, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Yin Li
- Department of Endoscopy, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Bin Li
- Artificial Intelligence Laboratory, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Wencheng Tan
- Department of Endoscopy, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Caisheng He
- Artificial Intelligence Laboratory, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Sharvesh Raj Seeruttun
- Department of Gastric Surgery, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Qiubao Wu
- Department of Endoscopy, Jiangxi Cancer Hospital, Nanchang, China
| | - Jun Huang
- Department of Endoscopy, Jiangxi Cancer Hospital, Nanchang, China
| | - De-Wang Huang
- Department of Digestive Internal, Wuzhou Red Cross Hospital, Wuzhou, China
| | - Bin Chen
- Department of Digestive Internal, The North Guangdong People's Hospital, Shaoguan, China
| | - Shao-Bin Lin
- Department of Digestive Internal, Puning People's Hospital, Puning, China
| | - Qin-Ming Chen
- Department of Digestive Internal, Puning People's Hospital, Puning, China
| | - Chu-Ming Yuan
- Department of Digestive Internal, Jieyang People's Hospital, Jieyang, China
| | - Hai-Xin Chen
- Department of Digestive Internal, Jieyang People's Hospital, Jieyang, China
| | - Heng-Ying Pu
- Medical Administration Department, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Feng Zhou
- Medical Administration Department, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Yun He
- Medical Administration Department, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Rui-Hua Xu
- Department of Medical Oncology, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China.
| |
Collapse
|
92
|
Wang P, Berzin TM, Glissen Brown JR, Bharadwaj S, Becq A, Xiao X, Liu P, Li L, Song Y, Zhang D, Li Y, Xu G, Tu M, Liu X. Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study. Gut 2019; 68:1813-1819. [PMID: 30814121 PMCID: PMC6839720 DOI: 10.1136/gutjnl-2018-317500] [Citation(s) in RCA: 540] [Impact Index Per Article: 90.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/30/2018] [Revised: 02/04/2019] [Accepted: 02/13/2019] [Indexed: 12/12/2022]
Abstract
OBJECTIVE The effect of colonoscopy on colorectal cancer mortality is limited by several factors, among them a certain miss rate, leading to limited adenoma detection rates (ADRs). We investigated the effect of an automatic polyp detection system based on deep learning on polyp detection rate and ADR. DESIGN In an open, non-blinded trial, consecutive patients were prospectively randomised to undergo diagnostic colonoscopy with or without assistance of a real-time automatic polyp detection system providing a simultaneous visual notice and sound alarm on polyp detection. The primary outcome was ADR. RESULTS Of 1058 patients included, 536 were randomised to standard colonoscopy, and 522 were randomised to colonoscopy with computer-aided diagnosis. The artificial intelligence (AI) system significantly increased ADR (29.1%vs20.3%, p<0.001) and the mean number of adenomas per patient (0.53vs0.31, p<0.001). This was due to a higher number of diminutive adenomas found (185vs102; p<0.001), while there was no statistical difference in larger adenomas (77vs58, p=0.075). In addition, the number of hyperplastic polyps was also significantly increased (114vs52, p<0.001). CONCLUSIONS In a low prevalent ADR population, an automatic polyp detection system during colonoscopy resulted in a significant increase in the number of diminutive adenomas detected, as well as an increase in the rate of hyperplastic polyps. The cost-benefit ratio of such effects has to be determined further. TRIAL REGISTRATION NUMBER ChiCTR-DDD-17012221; Results.
Collapse
Affiliation(s)
- Pu Wang
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Tyler M Berzin
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts, USA
| | - Jeremy Romek Glissen Brown
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts, USA
| | - Shishira Bharadwaj
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts, USA
| | - Aymeric Becq
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts, USA
| | - Xun Xiao
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Peixi Liu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Liangping Li
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Yan Song
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Di Zhang
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Yi Li
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Guangre Xu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Mengtian Tu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Xiaogang Liu
- Department of Gastroenterology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| |
Collapse
|
93
|
Ahmed S, Galle PR, Neumann H. Molecular endoscopic imaging: the future is bright. Ther Adv Gastrointest Endosc 2019; 12:2631774519867175. [PMID: 31517311 PMCID: PMC6724493 DOI: 10.1177/2631774519867175] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Accepted: 07/10/2019] [Indexed: 12/24/2022] Open
Abstract
The prediction and final survival rate of gastrointestinal cancers are dependent on the stage of disease. The ideal would be to detect those gastrointestinal lesions at early stage or even premalignant forms which are difficult to detect by conventional endoscopy with white light optical imaging as they show minimum or no changes in morphological characteristics and are thus left untreated. The introduction of molecular imaging has greatly changed the pattern for detecting gastrointestinal lesions from purely macroscopic structural imaging to the molecular level. It allows microscopic examination of the gastrointestinal mucosa with endoscopy after the topical or systemic application of molecular probes. In recent years, major advancements in endoscopic instruments and specific molecular probes have been achieved. This review focuses on the current status of endoscopic imaging and highlights the application of molecular imaging in gastrointestinal and hepatic disease in the context of diagnosis and therapy based on recently published literature in this field. We also discuss the challenges of molecular endoscopic imaging, its future directions and potential that could have a tremendous impact on endoscopic research and clinical practice in future.
Collapse
Affiliation(s)
- Shakil Ahmed
- Department of Interdisciplinary Endoscopy, I. Medical Clinic and Polyclinic, University Hospital Mainz, Johannes Gutenberg University Mainz, Mainz, Germany
| | - Peter R Galle
- Department of Interdisciplinary Endoscopy, I. Medical Clinic and Polyclinic, University Hospital Mainz, Johannes Gutenberg University Mainz, Mainz, Germany
| | - Helmut Neumann
- Department of Interdisciplinary Endoscopy, I. Medical Clinic and Polyclinic, University Hospital Mainz, Johannes Gutenberg University Mainz, Mainz, Germany
| |
Collapse
|
94
|
Yoon HJ, Kim S, Kim JH, Keum JS, Oh SI, Jo J, Chun J, Youn YH, Park H, Kwon IG, Choi SH, Noh SH. A Lesion-Based Convolutional Neural Network Improves Endoscopic Detection and Depth Prediction of Early Gastric Cancer. J Clin Med 2019; 8:jcm8091310. [PMID: 31454949 PMCID: PMC6781189 DOI: 10.3390/jcm8091310] [Citation(s) in RCA: 90] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Revised: 08/22/2019] [Accepted: 08/22/2019] [Indexed: 02/07/2023] Open
Abstract
In early gastric cancer (EGC), tumor invasion depth is an important factor for determining the treatment method. However, as endoscopic ultrasonography has limitations when measuring the exact depth in a clinical setting as endoscopists often depend on gross findings and personal experience. The present study aimed to develop a model optimized for EGC detection and depth prediction, and we investigated factors affecting artificial intelligence (AI) diagnosis. We employed a visual geometry group(VGG)-16 model for the classification of endoscopic images as EGC (T1a or T1b) or non-EGC. To induce the model to activate EGC regions during training, we proposed a novel loss function that simultaneously measured classification and localization errors. We experimented with 11,539 endoscopic images (896 T1a-EGC, 809 T1b-EGC, and 9834 non-EGC). The areas under the curves of receiver operating characteristic curves for EGC detection and depth prediction were 0.981 and 0.851, respectively. Among the factors affecting AI prediction of tumor depth, only histologic differentiation was significantly associated, where undifferentiated-type histology exhibited a lower AI accuracy. Thus, the lesion-based model is an appropriate training method for AI in EGC. However, further improvements and validation are required, especially for undifferentiated-type histology.
Collapse
Affiliation(s)
- Hong Jin Yoon
- Department of Internal Medicine, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea
| | - Seunghyup Kim
- Department of Internal Medicine, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea
| | - Jie-Hyun Kim
- Department of Internal Medicine, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea.
| | | | | | - Junik Jo
- SELVAS AI Inc., Seoul 08594, Korea
| | - Jaeyoung Chun
- Department of Internal Medicine, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea
| | - Young Hoon Youn
- Department of Internal Medicine, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea
| | - Hyojin Park
- Department of Internal Medicine, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea
| | - In Gyu Kwon
- Department of Surgery, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea
| | - Seung Ho Choi
- Department of Surgery, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea
| | - Sung Hoon Noh
- Department of Surgery, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Korea
| |
Collapse
|
95
|
Chao WL, Manickavasagan H, Krishna SG. Application of Artificial Intelligence in the Detection and Differentiation of Colon Polyps: A Technical Review for Physicians. Diagnostics (Basel) 2019; 9:99. [PMID: 31434208 PMCID: PMC6787748 DOI: 10.3390/diagnostics9030099] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Revised: 08/13/2019] [Accepted: 08/19/2019] [Indexed: 12/14/2022] Open
Abstract
Research in computer-aided diagnosis (CAD) and the application of artificial intelligence (AI) in the endoscopic evaluation of the gastrointestinal tract is novel. Since colonoscopy and detection of polyps can decrease the risk of colon cancer, it is recommended by multiple national and international societies. However, the procedure of colonoscopy is performed by humans where there are significant interoperator and interpatient variations, and hence, the risk of missing detection of adenomatous polyps. Early studies involving CAD and AI for the detection and differentiation of polyps show great promise. In this appraisal, we review existing scientific aspects of AI in CAD of colon polyps and discuss the pitfalls and future directions for advancing the science. This review addresses the technical intricacies in a manner that physicians can comprehend to promote a better understanding of this novel application.
Collapse
Affiliation(s)
- Wei-Lun Chao
- Department of Computer Science, Cornell University, New York, NY 14853, USA
- Department of Computer Science and Engineering, Ohio State University, Columbus, OH 43210, USA
| | - Hanisha Manickavasagan
- Division of Gastroenterology, Hepatology and Nutrition, the Ohio State University Wexner Medical Center, Columbus, OH 43210, USA
| | - Somashekar G Krishna
- Division of Gastroenterology, Hepatology and Nutrition, the Ohio State University Wexner Medical Center, Columbus, OH 43210, USA.
| |
Collapse
|
96
|
Allescher HD, Weingart V. Optimizing Screening Colonoscopy: Strategies and Alternatives. Visc Med 2019; 35:215-225. [PMID: 31602382 DOI: 10.1159/000501835] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2019] [Accepted: 06/27/2019] [Indexed: 12/11/2022] Open
Abstract
Screening colonoscopy is the most effective screening procedure for the prevention of colorectal cancer. The efficacy of colonoscopy is highly dependent on the overall quality of how this procedure is indicated, planned, prepared, and performed. The quality is directly linked to the number of polyps and/or adenomas detected or, in other words, to the number of polyps or adenomas missed during the procedure. The quality has a direct impact on the rate of interval carcinoma and on the range of how the incidence and occurrence of colorectal cancer is reduced. This review summarizes the current status on general measures and procedure improvements and standards as well as technical advances which have been suggested and established to improve the quality of polyp and adenoma detection rate. This includes selection and preparation of the patients, planning, methodological and technical performance of the procedure, and technical advances of the endoscope technology in order to improve screening results. It also covers new technologies with wide angle endoscopes (Ewave) and IT-based approaches using artificial intelligence to such as ai4GI for the polyp detection and image analysis.
Collapse
Affiliation(s)
- Hans-Dieter Allescher
- Department of Gastroenterology, Klinikum Garmisch-Partenkirchen, Garmisch-Partenkirchen, Germany
| | - Vincens Weingart
- Department of Gastroenterology, Klinikum Garmisch-Partenkirchen, Garmisch-Partenkirchen, Germany
| |
Collapse
|
97
|
Vinsard DG, Mori Y, Misawa M, Kudo SE, Rastogi A, Bagci U, Rex DK, Wallace MB. Quality assurance of computer-aided detection and diagnosis in colonoscopy. Gastrointest Endosc 2019; 90:55-63. [PMID: 30926431 DOI: 10.1016/j.gie.2019.03.019] [Citation(s) in RCA: 93] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/08/2019] [Accepted: 03/18/2019] [Indexed: 02/05/2023]
Abstract
Recent breakthroughs in artificial intelligence (AI), specifically via its emerging sub-field "deep learning," have direct implications for computer-aided detection and diagnosis (CADe and/or CADx) for colonoscopy. AI is expected to have at least 2 major roles in colonoscopy practice-polyp detection (CADe) and polyp characterization (CADx). CADe has the potential to decrease the polyp miss rate, contributing to improving adenoma detection, whereas CADx can improve the accuracy of colorectal polyp optical diagnosis, leading to reduction of unnecessary polypectomy of non-neoplastic lesions, potential implementation of a resect-and-discard paradigm, and proper application of advanced resection techniques. A growing number of medical-engineering researchers are developing both CADe and CADx systems, some of which allow real-time recognition of polyps or in vivo identification of adenomas, with over 90% accuracy. However, the quality of the developed AI systems as well as that of the study designs vary significantly, hence raising some concerns regarding the generalization of the proposed AI systems. Initial studies were conducted in an exploratory or retrospective fashion by using stored images and likely overestimating the results. These drawbacks potentially hinder smooth implementation of this novel technology into colonoscopy practice. The aim of this article is to review both contributions and limitations in recent machine-learning-based CADe and/or CADx colonoscopy studies and propose some principles that should underlie system development and clinical testing.
Collapse
Affiliation(s)
- Daniela Guerrero Vinsard
- Showa University International Center for Endoscopy, Showa University Northern Yokohama Hospital, Yokohama, Japan; Division of Internal Medicine, University of Connecticut Health Center, Farmington, Connecticut, USA
| | - Yuichi Mori
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Masashi Misawa
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Shin-Ei Kudo
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Amit Rastogi
- Division of Gastroenterology, University of Kansas Medical Center, Kansas City, Kansas
| | - Ulas Bagci
- Center for Research in Computer Vision, University of Central Florida, Orlando, Florida
| | - Douglas K Rex
- Division of Gastroenterology and Hepatology, Indiana University School of Medicine, Indianapolis, Indiana
| | - Michael B Wallace
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, Florida, USA
| |
Collapse
|
98
|
Rishi M, Kaur J, Ulanja M, Manasewitsch N, Svendsen M, Abdalla A, Vemala S, Kewanyama J, Singh K, Singh N, Gullapalli N, Osgard E. Randomized, double-blinded, placebo-controlled trial evaluating simethicone pretreatment with bowel preparation during colonoscopy. World J Gastrointest Endosc 2019; 11:413-423. [PMID: 31236194 PMCID: PMC6580307 DOI: 10.4253/wjge.v11.i6.413] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2019] [Revised: 06/01/2019] [Accepted: 06/10/2019] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND The presence of small air bubbles and foam are an impediment to a successful colonoscopy. They impair an endoscopist’s view and diminish the diagnostic accuracy of the study. This has been particularly noted to be of concern with the switch to lower volume polyethylene glycol (PEG) and bisacodyl combination preparation.
AIM To evaluate the effect of oral simethicone addition to bowel preparation on intraluminal bubbles reduction during colonoscopy.
METHODS Described is a prospective, randomized, multi-center, double-blinded, placebo-controlled study to evaluate the use of premixed simethicone formulation with split-regimen, low-volume PEG-bisacodyl combination bowel preparation for 168 outpatients undergoing screening, surveillance, and diagnostic colonoscopies. Primary outcome includes evaluation of bubbles during colonoscopy graded using the Intraluminal Bubbles Scale. Secondary outcomes include evaluation of the Boston Bowel Preparation Scale (BBPS), total number of polyps, polyp size differentiation, polyp laterality, adenoma detection, mass detection, cecal insertion time, withdrawal time, and patient-reported adverse events.
RESULTS Higher Intraluminal Bubbles grades III and IV (less than 75% of the mucosa cleared of bubbles/foam requiring intervention with simethicone infused wash) were detected in the placebo group [Simethicone n = 4/84 vs Placebo n = 20/84 (P = 0.007)]. BBPS total score was 7.42 [standard deviation (SD) = ± 1.51] in the simethicone group and 7.28 (SD = ± 1.44) in the placebo group (P = 0.542) from a total of 9. Significantly higher number of adenomas were detected in the simethicone group (P = 0.001).
CONCLUSION The addition of simethicone to bowel preparation is well advised for its anti-foaming properties. The results of this study suggest that addition of oral simethicone can improve bowel wall visibility.
Collapse
Affiliation(s)
- Mohit Rishi
- Department of Internal Medicine, University of Nevada, Reno School of Medicine, Renown Regional Medical Center, Reno, NV 89502, United States
| | - Jaskarin Kaur
- Department of Internal Medicine, University of Nevada, Reno School of Medicine, Renown Regional Medical Center, Reno, NV 89502, United States
| | - Mark Ulanja
- Department of Internal Medicine, University of Nevada, Reno School of Medicine, Renown Regional Medical Center, Reno, NV 89502, United States
| | - Nicholas Manasewitsch
- Department of Internal Medicine, University of Nevada, Reno School of Medicine, Renown Regional Medical Center, Reno, NV 89502, United States
| | - Molly Svendsen
- Department of Internal Medicine, University of Nevada, Reno School of Medicine, Renown Regional Medical Center, Reno, NV 89502, United States
| | - Abubaker Abdalla
- Department of Internal Medicine, University of Nevada, Reno School of Medicine, Renown Regional Medical Center, Reno, NV 89502, United States
| | - Shashank Vemala
- Department of Internal Medicine, University of Nevada, Reno School of Medicine, Renown Regional Medical Center, Reno, NV 89502, United States
| | - Julie Kewanyama
- Gastroenterology Consultants, LTD, Reno, NV 89502, United States
| | - Karmjit Singh
- Aureus Univeristy School of Medicine, Oranjestad 31C, Aruba
| | - Nirmal Singh
- American International Medical University, Gross Islet 7610, Saint Lucia
| | - Nageshwara Gullapalli
- Department of Internal Medicine, University of Nevada, Reno School of Medicine, Renown Regional Medical Center, Reno, NV 89502, United States
| | - Eric Osgard
- Gastroenterology Consultants, LTD, Reno, NV 89502, United States
| |
Collapse
|
99
|
Region-Based Automated Localization of Colonoscopy and Wireless Capsule Endoscopy Polyps. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9122404] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
The early detection of polyps could help prevent colorectal cancer. The automated detection of polyps on the colon walls could reduce the number of false negatives that occur due to manual examination errors or polyps being hidden behind folds, and could also help doctors locate polyps from screening tests such as colonoscopy and wireless capsule endoscopy. Losing polyps may result in lesions evolving badly. In this paper, we propose a modified region-based convolutional neural network (R-CNN) by generating masks around polyps detected from still frames. The locations of the polyps in the image are marked, which assists the doctors examining the polyps. The features from the polyp images are extracted using pre-trained Resnet-50 and Resnet-101 models through feature extraction and fine-tuning techniques. Various publicly available polyp datasets are analyzed with various pertained weights. It is interesting to notice that fine-tuning with balloon data (polyp-like natural images) improved the polyp detection rate. The optimum CNN models on colonoscopy datasets including CVC-ColonDB, CVC-PolypHD, and ETIS-Larib produced values (F1 score, F2 score) of (90.73, 91.27), (80.65, 79.11), and (76.43, 78.70) respectively. The best model on the wireless capsule endoscopy dataset gave a performance of (96.67, 96.10). The experimental results indicate the better localization of polyps compared to recent traditional and deep learning methods.
Collapse
|
100
|
Mori Y, Berzin TM, Kudo SE. Artificial intelligence for early gastric cancer: early promise and the path ahead. Gastrointest Endosc 2019; 89:816-817. [PMID: 30902205 DOI: 10.1016/j.gie.2018.12.019] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/08/2018] [Accepted: 12/19/2018] [Indexed: 02/07/2023]
Affiliation(s)
- Yuichi Mori
- Digestive Disease Center, Showa University, Northern Yokohama Hospital, Yokohama, Japan
| | - Tyler M Berzin
- Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| | - Shin-Ei Kudo
- Digestive Disease Center, Showa University, Northern Yokohama Hospital, Yokohama, Japan
| |
Collapse
|