1
|
Lee J, Cho WS, Kim BS, Yoon D, Kim J, Song JH, Yang SY, Lim SH, Chung GE, Choi JM, Han YM, Kong HJ, Lee JC, Kim S, Bae JH. Impact of User's Background Knowledge and Polyp Characteristics in Colonoscopy with Computer-Aided Detection. Gut Liver 2024; 18:857-866. [PMID: 39054913 PMCID: PMC11391145 DOI: 10.5009/gnl240068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Revised: 05/03/2024] [Accepted: 05/09/2024] [Indexed: 07/27/2024] Open
Abstract
Background/Aims We investigated how interactions between humans and computer-aided detection (CADe) systems are influenced by the user's experience and polyp characteristics. Methods We developed a CADe system using YOLOv4, trained on 16,996 polyp images from 1,914 patients and 1,800 synthesized sessile serrated lesion (SSL) images. The performance of polyp detection with CADe assistance was evaluated using a computerized test module. Eighteen participants were grouped by colonoscopy experience (nurses, fellows, and experts). The value added by CADe based on the histopathology and detection difficulty of polyps were analyzed. Results The area under the curve for CADe was 0.87 (95% confidence interval [CI], 0.83 to 0.91). CADe assistance increased overall polyp detection accuracy from 69.7% to 77.7% (odds ratio [OR], 1.88; 95% CI, 1.69 to 2.09). However, accuracy decreased when CADe inaccurately detected a polyp (OR, 0.72; 95% CI, 0.58 to 0.87). The impact of CADe assistance was most and least prominent in the nurses (OR, 1.97; 95% CI, 1.71 to 2.27) and the experts (OR, 1.42; 95% CI, 1.15 to 1.74), respectively. Participants demonstrated better sensitivity with CADe assistance, achieving 81.7% for adenomas and 92.4% for easy-to-detect polyps, surpassing the standalone CADe performance of 79.7% and 89.8%, respectively. For SSLs and difficult-to-detect polyps, participants' sensitivities with CADe assistance (66.5% and 71.5%, respectively) were below those of standalone CADe (81.1% and 74.4%). Compared to the other two groups (56.1% and 61.7%), the expert group showed sensitivity closest to that of standalone CADe in detecting SSLs (79.7% vs 81.1%, respectively). Conclusions CADe assistance boosts polyp detection significantly, but its effectiveness depends on the user's experience, particularly for challenging lesions.
Collapse
Affiliation(s)
- Jooyoung Lee
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Woo Sang Cho
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, Korea
| | - Byeong Soo Kim
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, Korea
| | - Dan Yoon
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, Korea
| | - Jung Kim
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Ji Hyun Song
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Sun Young Yang
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Seon Hee Lim
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Goh Eun Chung
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Ji Min Choi
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Yoo Min Han
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Hyoun-Joong Kong
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, Korea
- Medical Big Data Research Center, Seoul National University College of Medicine, Seoul, Korea
- Artificial Intelligence Institute, Seoul National University, Seoul, Korea
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea
| | - Jung Chan Lee
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, Korea
- Institute of Bioengineering, Seoul National University, Seoul, Korea
| | - Sungwan Kim
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, Korea
- Institute of Bioengineering, Seoul National University, Seoul, Korea
| | - Jung Ho Bae
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| |
Collapse
|
2
|
Cold KM, Vamadevan A, Vilmann AS, Svendsen MBS, Konge L, Bjerrum F. Computer-aided quality assessment of endoscopist competence during colonoscopy: a systematic review. Gastrointest Endosc 2024; 100:167-176.e1. [PMID: 38580134 DOI: 10.1016/j.gie.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2024] [Revised: 03/28/2024] [Accepted: 03/28/2024] [Indexed: 04/07/2024]
Abstract
BACKGROUND AND AIMS Endoscopists' competence can vary widely, as shown in the variation in the adenoma detection rate (ADR). Computer-aided quality assessment (CAQ) can automatically assess performance during individual procedures. In this review we identified and described different CAQ systems for colonoscopy. METHODS A systematic review of the literature was done using MEDLINE, EMBASE, and Scopus based on 3 blocks of terms according to the inclusion criteria: colonoscopy, competence assessment, and automatic evaluation. Articles were systematically reviewed by 2 reviewers, first by abstract and then in full text. The methodological quality was assessed using the Medical Education Research Study Quality Instrument (MERSQI). RESULTS Of 12,575 identified studies, 6831 remained after removal of duplicates and 6806 did not pass the eligibility criteria and were excluded, leaving 25 studies, of which 13 studies were included in the final analysis. Five categories of CAQ systems were identified: withdrawal speedometer (7 studies), endoscope movement analysis (3 studies), effective withdrawal time (1 study), fold examination quality (1 study), and visual gaze pattern (1 study). The withdrawal speedometer was the only CAQ system that tested its feedback by examining changes in ADR. Three studies observed an improvement in ADR, and 2 studies did not. The methodological quality of the studies was high (mean MERSQI, 15.2 points; maximum, 18 points). CONCLUSIONS Thirteen studies developed or tested CAQ systems, most frequently by correlating it to the ADR. Only 5 studies tested feedback by implementing the CAQ system. A meta-analysis was impossible because of the heterogeneous study designs, and more studies are warranted.
Collapse
Affiliation(s)
- Kristoffer Mazanti Cold
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Anishan Vamadevan
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark
| | - Andreas Slot Vilmann
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark; Gastrounit, Surgical Section, Copenhagen University Hospital-Herlev and Gentofte, Herlev, Denmark
| | - Morten Bo Søndergaard Svendsen
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Computer Science, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Lars Konge
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Flemming Bjerrum
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark; Gastrounit, Surgical Section, Copenhagen University Hospital-Amager and Hvidovre, Hvidovre, Denmark
| |
Collapse
|
3
|
Li J, Peng Z, Wang X, Zhang S, Sun J, Li Y, Zhang Q, Shi L, Li H, Tian Z, Feng Y, Mu J, Tang N, Wang X, Li W, Pei Z. Development and validation of a novel colonoscopy withdrawal time indicator based on YOLOv5. J Gastroenterol Hepatol 2024; 39:1613-1622. [PMID: 38710592 DOI: 10.1111/jgh.16596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 04/02/2024] [Accepted: 04/16/2024] [Indexed: 05/08/2024]
Abstract
BACKGROUND AND AIM The study aims to introduce a novel indicator, effective withdrawal time (WTS), which measures the time spent actively searching for suspicious lesions during colonoscopy and to compare WTS and the conventional withdrawal time (WT). METHODS Colonoscopy video data from 472 patients across two hospitals were retrospectively analyzed. WTS was computed through a combination of artificial intelligence (AI) and manual verification. The results obtained through WTS were compared with those generated by the AI system. Patients were categorized into four groups based on the presence of polyps and whether resections or biopsies were performed. Bland Altman plots were utilized to compare AI-computed WTS with manually verified WTS. Scatterplots were used to illustrate WTS within the four groups, among different hospitals, and across various physicians. A parallel box plot was employed to depict the proportions of WTS relative to WT within each of the four groups. RESULTS The study included 472 patients, with a median age of 55 years, and 57.8% were male. A significant correlation with manually verified WTS (r = 0.918) was observed in AI-computed WTS. Significant differences in WTS/WT among the four groups were revealed by the parallel box plot (P < 0.001). The group with no detected polyps had the highest WTS/WT, with a median of 0.69 (interquartile range: 0.40, 0.97). WTS patterns were found to be varied between the two hospitals and among senior and junior physicians. CONCLUSIONS A promising alternative to traditional WT for quality control and training assessment in colonoscopy is offered by AI-assisted computation of WTS.
Collapse
Affiliation(s)
- Jiaxin Li
- Medical School, Tianjin University, Tianjin, China
| | - Ziye Peng
- Medical School, Tianjin University, Tianjin, China
| | - Xiangyu Wang
- Medical School, Tianjin University, Tianjin, China
| | - Shuyi Zhang
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Jiayi Sun
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Yanru Li
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Qi Zhang
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Lei Shi
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Hongzhou Li
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Zhenggang Tian
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Yue Feng
- TEDA Yujin Digestive Health Industry Research Institute. Ltd., Tianjin, China
| | - Jinbao Mu
- TEDA Yujin Digestive Health Industry Research Institute. Ltd., Tianjin, China
| | - Nan Tang
- Tianjin Center for Medical Devices Evaluation and Inspection, Tianjin, China
| | - Ximo Wang
- Tianjin Third Central Hospital, Tianjin, China
| | - Wen Li
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Zhengcun Pei
- Medical School, Tianjin University, Tianjin, China
| |
Collapse
|
4
|
Luo X, Wang J, Tan C, Dou Q, Han Z, Wang Z, Tasnim F, Wang X, Zhan Q, Li X, Zhou Q, Cheng J, Liao F, Yip HC, Jiang J, Tan RT, Liu S, Yu H. Rapid Endoscopic Diagnosis of Benign Ulcerative Colorectal Diseases With an Artificial Intelligence Contextual Framework. Gastroenterology 2024; 167:591-603.e9. [PMID: 38583724 DOI: 10.1053/j.gastro.2024.03.039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 03/22/2024] [Accepted: 03/28/2024] [Indexed: 04/09/2024]
Abstract
BACKGROUND & AIMS Benign ulcerative colorectal diseases (UCDs) such as ulcerative colitis, Crohn's disease, ischemic colitis, and intestinal tuberculosis share similar phenotypes with different etiologies and treatment strategies. To accurately diagnose closely related diseases like UCDs, we hypothesize that contextual learning is critical in enhancing the ability of the artificial intelligence models to differentiate the subtle differences in lesions amidst the vastly divergent spatial contexts. METHODS White-light colonoscopy datasets of patients with confirmed UCDs and healthy controls were retrospectively collected. We developed a Multiclass Contextual Classification (MCC) model that can differentiate among the mentioned UCDs and healthy controls by incorporating the tissue object contexts surrounding the individual lesion region in a scene and spatial information from other endoscopic frames (video-level) into a unified framework. Internal and external datasets were used to validate the model's performance. RESULTS Training datasets included 762 patients, and the internal and external testing cohorts included 257 patients and 293 patients, respectively. Our MCC model provided a rapid reference diagnosis on internal test sets with a high averaged area under the receiver operating characteristic curve (image-level: 0.950 and video-level: 0.973) and balanced accuracy (image-level: 76.1% and video-level: 80.8%), which was superior to junior endoscopists (accuracy: 71.8%, P < .0001) and similar to experts (accuracy: 79.7%, P = .732). The MCC model achieved an area under the receiver operating characteristic curve of 0.988 and balanced accuracy of 85.8% using external testing datasets. CONCLUSIONS These results enable this model to fit in the routine endoscopic workflow, and the contextual framework to be adopted for diagnosing other closely related diseases.
Collapse
Affiliation(s)
- Xiaobei Luo
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China; Department of Gastroenterology, Zhuhai People's Hospital (Zhuhai Clinical Medical College of Jinan University), Zhuhai, Guangdong, China.
| | - Jiahao Wang
- Mechanobiology Institute, National University of Singapore, Singapore; Institute of Bioengineering and Bioimaging, Agency for Science, Technology and Research (A∗STAR), Singapore
| | - Chuanchuan Tan
- The First Hospital of Hunan University of Chinese Medicine, Hunan, China
| | - Qi Dou
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong
| | - Zelong Han
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China
| | - Zhenjiang Wang
- Department of Gastroenterology, Zhuhai People's Hospital (Zhuhai Clinical Medical College of Jinan University), Zhuhai, Guangdong, China
| | - Farah Tasnim
- Institute of Bioengineering and Bioimaging, Agency for Science, Technology and Research (A∗STAR), Singapore
| | - Xiyu Wang
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China
| | - Qiang Zhan
- Department of Gastroenterology, The Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi People's Hospital, Wuxi Medical Center, Nanjing Medical University, Wuxi, Jiangsu, China
| | - Xiang Li
- Digestive Department of The Second Affiliated Hospital, School of Medicine, The Chinese University of Hong Kong, Shenzhen & Longgang District People's Hospital of Shenzhen, Shenzhen, China
| | - Qunyan Zhou
- Department of Gastroenterology, The Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi People's Hospital, Wuxi Medical Center, Nanjing Medical University, Wuxi, Jiangsu, China
| | - Jianbin Cheng
- Department of Gastroenterology, Zhuhai People's Hospital (Zhuhai Clinical Medical College of Jinan University), Zhuhai, Guangdong, China
| | - Fabiao Liao
- Digestive Department of The Second Affiliated Hospital, School of Medicine, The Chinese University of Hong Kong, Shenzhen & Longgang District People's Hospital of Shenzhen, Shenzhen, China
| | - Hon Chi Yip
- Division of Upper Gastrointestinal and Metabolic Surgery, Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong
| | - Jiayi Jiang
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China
| | - Robby T Tan
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore
| | - Side Liu
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China; Department of Gastroenterology, Zhuhai People's Hospital (Zhuhai Clinical Medical College of Jinan University), Zhuhai, Guangdong, China.
| | - Hanry Yu
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China; Mechanobiology Institute, National University of Singapore, Singapore; Institute of Bioengineering and Bioimaging, Agency for Science, Technology and Research (A∗STAR), Singapore; CAMP, Singapore-MIT Alliance for Research and Technology, Singapore; Department of Physiology, The Institute for Digital Medicine (WisDM), Yong Loo Lin School of Medicine, Singapore.
| |
Collapse
|
5
|
Kikuchi R, Okamoto K, Ozawa T, Shibata J, Ishihara S, Tada T. Endoscopic Artificial Intelligence for Image Analysis in Gastrointestinal Neoplasms. Digestion 2024:1-17. [PMID: 39068926 DOI: 10.1159/000540251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Accepted: 07/02/2024] [Indexed: 07/30/2024]
Abstract
BACKGROUND Artificial intelligence (AI) using deep learning systems has recently been utilized in various medical fields. In the field of gastroenterology, AI is primarily implemented in image recognition and utilized in the realm of gastrointestinal (GI) endoscopy. In GI endoscopy, computer-aided detection/diagnosis (CAD) systems assist endoscopists in GI neoplasm detection or differentiation of cancerous or noncancerous lesions. Several AI systems for colorectal polyps have already been applied in colonoscopy clinical practices. In esophagogastroduodenoscopy, a few CAD systems for upper GI neoplasms have been launched in Asian countries. The usefulness of these CAD systems in GI endoscopy has been gradually elucidated. SUMMARY In this review, we outline recent articles on several studies of endoscopic AI systems for GI neoplasms, focusing on esophageal squamous cell carcinoma (ESCC), esophageal adenocarcinoma (EAC), gastric cancer (GC), and colorectal polyps. In ESCC and EAC, computer-aided detection (CADe) systems were mainly developed, and a recent meta-analysis study showed sensitivities of 91.2% and 93.1% and specificities of 80% and 86.9%, respectively. In GC, a recent meta-analysis study on CADe systems demonstrated that their sensitivity and specificity were as high as 90%. A randomized controlled trial (RCT) also showed that the use of the CADe system reduced the miss rate. Regarding computer-aided diagnosis (CADx) systems for GC, although RCTs have not yet been conducted, most studies have demonstrated expert-level performance. In colorectal polyps, multiple RCTs have shown the usefulness of the CADe system for improving the polyp detection rate, and several CADx systems have been shown to have high accuracy in colorectal polyp differentiation. KEY MESSAGES Most analyses of endoscopic AI systems suggested that their performance was better than that of nonexpert endoscopists and equivalent to that of expert endoscopists. Thus, endoscopic AI systems may be useful for reducing the risk of overlooking lesions and improving the diagnostic ability of endoscopists.
Collapse
Affiliation(s)
- Ryosuke Kikuchi
- Department of Surgical Oncology, Faculty of Medicine, The University of Tokyo, Tokyo, Japan
| | - Kazuaki Okamoto
- Department of Surgical Oncology, Faculty of Medicine, The University of Tokyo, Tokyo, Japan
| | - Tsuyoshi Ozawa
- Tomohiro Tada the Institute of Gastroenterology and Proctology, Saitama, Japan
- AI Medical Service Inc., Tokyo, Japan
| | - Junichi Shibata
- Tomohiro Tada the Institute of Gastroenterology and Proctology, Saitama, Japan
- AI Medical Service Inc., Tokyo, Japan
| | - Soichiro Ishihara
- Department of Surgical Oncology, Faculty of Medicine, The University of Tokyo, Tokyo, Japan
| | - Tomohiro Tada
- Department of Surgical Oncology, Faculty of Medicine, The University of Tokyo, Tokyo, Japan
- Tomohiro Tada the Institute of Gastroenterology and Proctology, Saitama, Japan
- AI Medical Service Inc., Tokyo, Japan
| |
Collapse
|
6
|
Wang Y, He C. ENDOANGEL improves detection of missed colorectal adenomas in second colonoscopy: A retrospective study. Medicine (Baltimore) 2024; 103:e38938. [PMID: 38996141 PMCID: PMC11245239 DOI: 10.1097/md.0000000000038938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/14/2024] Open
Abstract
The ENDOANGEL (EN) computer-assisted detection technique has emerged as a promising tool for enhancing the detection rate of colorectal adenomas during colonoscopies. However, its efficacy in identifying missed adenomas during subsequent colonoscopies remains unclear. Thus, we herein aimed to compare the adenoma miss rate (AMR) between EN-assisted and standard colonoscopies. Data from patients who underwent a second colonoscopy (EN-assisted or standard) within 6 months between September 2022 and May 2023 were analyzed. The EN-assisted group exhibited a significantly higher AMR (24.3% vs 11.9%, P = .005) than the standard group. After adjusting for potential confounders, multivariable analysis revealed that the EN-assisted group had a better ability to detect missed adenomas than the standard group (odds ratio = 2.89; 95% confidence interval = 1.14-7.80, P = .029). These findings suggest that EN-assisted colonoscopy represents a valuable advancement in improving AMR compared with standard colonoscopy. The integration of EN-assisted colonoscopy into routine clinical practice may offer significant benefits to patients requiring hospital resection of lesions following adenoma detection during their first colonoscopy.
Collapse
Affiliation(s)
- Yundong Wang
- Department of Gastroenterology, Yijishan Hospital of Wannan Medical College, Wuhu, Anhui, People's Republic of China
| | | |
Collapse
|
7
|
Introzzi L, Zonca J, Cabitza F, Cherubini P, Reverberi C. Enhancing human-AI collaboration: The case of colonoscopy. Dig Liver Dis 2024; 56:1131-1139. [PMID: 37940501 DOI: 10.1016/j.dld.2023.10.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 10/19/2023] [Accepted: 10/23/2023] [Indexed: 11/10/2023]
Abstract
Diagnostic errors impact patient health and healthcare costs. Artificial Intelligence (AI) shows promise in mitigating this burden by supporting Medical Doctors in decision-making. However, the mere display of excellent or even superhuman performance by AI in specific tasks does not guarantee a positive impact on medical practice. Effective AI assistance should target the primary causes of human errors and foster effective collaborative decision-making with human experts who remain the ultimate decision-makers. In this narrative review, we apply these principles to the specific scenario of AI assistance during colonoscopy. By unraveling the neurocognitive foundations of the colonoscopy procedure, we identify multiple bottlenecks in perception, attention, and decision-making that contribute to diagnostic errors, shedding light on potential interventions to mitigate them. Furthermore, we explored how existing AI devices fare in clinical practice and whether they achieved an optimal integration with the human decision-maker. We argue that to foster optimal Human-AI collaboration, future research should expand our knowledge of factors influencing AI's impact, establish evidence-based cognitive models, and develop training programs based on them. These efforts will enhance human-AI collaboration, ultimately improving diagnostic accuracy and patient outcomes. The principles illuminated in this review hold more general value, extending their relevance to a wide array of medical procedures and beyond.
Collapse
Affiliation(s)
- Luca Introzzi
- Department of Psychology, Università Milano - Bicocca, Milano, Italy
| | - Joshua Zonca
- Department of Psychology, Università Milano - Bicocca, Milano, Italy; Milan Center for Neuroscience, Università Milano - Bicocca, Milano, Italy
| | - Federico Cabitza
- Department of Informatics, Systems and Communication, Università Milano - Bicocca, Milano, Italy; IRCCS Istituto Ortopedico Galeazzi, Milano, Italy
| | - Paolo Cherubini
- Department of Brain and Behavioral Sciences, Università Statale di Pavia, Pavia, Italy
| | - Carlo Reverberi
- Department of Psychology, Università Milano - Bicocca, Milano, Italy; Milan Center for Neuroscience, Università Milano - Bicocca, Milano, Italy.
| |
Collapse
|
8
|
Lui TKL, Lam CPM, To EWP, Ko MKL, Tsui VWM, Liu KSH, Hui CKY, Cheung MKS, Mak LLY, Hui RWH, Wong SY, Seto WK, Leung WK. Endocuff With or Without Artificial Intelligence-Assisted Colonoscopy in Detection of Colorectal Adenoma: A Randomized Colonoscopy Trial. Am J Gastroenterol 2024; 119:1318-1325. [PMID: 38305278 PMCID: PMC11208055 DOI: 10.14309/ajg.0000000000002684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 12/19/2023] [Indexed: 02/03/2024]
Abstract
INTRODUCTION Both artificial intelligence (AI) and distal attachment devices have been shown to improve adenoma detection rate and reduce miss rate during colonoscopy. We studied the combined effect of Endocuff and AI on enhancing detection rates of various colonic lesions. METHODS This was a 3-arm prospective randomized colonoscopy study involving patients aged 40 years or older. Participants were randomly assigned in a 1:1:1 ratio to undergo Endocuff with AI, AI alone, or standard high-definition (HD) colonoscopy. The primary outcome was adenoma detection rate (ADR) between the Endocuff-AI and AI groups while secondary outcomes included detection rates of polyp (PDR), sessile serrated lesion (sessile detection rate [SDR]), and advanced adenoma (advanced adenoma detection rate) between the 2 groups. RESULTS A total of 682 patients were included (mean age 65.4 years, 52.3% male), with 53.7% undergoing diagnostic colonoscopy. The ADR for the Endocuff-AI, AI, and HD groups was 58.7%, 53.8%, and 46.3%, respectively, while the corresponding PDR was 77.0%, 74.0%, and 61.2%. A significant increase in ADR, PDR, and SDR was observed between the Endocuff-AI and AI groups (ADR difference: 4.9%, 95% CI: 1.4%-8.2%, P = 0.03; PDR difference: 3.0%, 95% CI: 0.4%-5.8%, P = 0.04; SDR difference: 6.4%, 95% CI: 3.4%-9.7%, P < 0.01). Both Endocuff-AI and AI groups had a higher ADR, PDR, SDR, and advanced adenoma detection rate than the HD group (all P < 0.01). DISCUSSION Endocuff in combination with AI further improves various colonic lesion detection rates when compared with AI alone.
Collapse
Affiliation(s)
- Thomas Ka-Luen Lui
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | | | - Elvis Wai-Pan To
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
- Department of Medicine, Tung Wah Hospital, Hong Kong, China.
| | | | | | | | | | - Michael Ka-Shing Cheung
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Loey Lung-Yi Mak
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Rex Wan-Hin Hui
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Siu-Yin Wong
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Wai Kay Seto
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Wai K. Leung
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| |
Collapse
|
9
|
Davis JMK, Niazi MKK, Ricker AB, Tavolara TE, Robinson JN, Annanurov B, Smith K, Mantha R, Hwang J, Shrestha R, Iannitti DA, Martinie JB, Baker EH, Gurcan MN, Vrochides D. Predicting response to neoadjuvant chemotherapy for colorectal liver metastasis using deep learning on prechemotherapy cross-sectional imaging. J Surg Oncol 2024; 130:93-101. [PMID: 38712939 DOI: 10.1002/jso.27673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 04/13/2024] [Accepted: 04/28/2024] [Indexed: 05/08/2024]
Abstract
BACKGROUND AND OBJECTIVES Deep learning models (DLMs) are applied across domains of health sciences to generate meaningful predictions. DLMs make use of neural networks to generate predictions from discrete data inputs. This study employs DLM on prechemotherapy cross-sectional imaging to predict patients' response to neoadjuvant chemotherapy. METHODS Adult patients with colorectal liver metastasis who underwent surgery after neoadjuvant chemotherapy were included. A DLM was trained on computed tomography images using attention-based multiple-instance learning. A logistic regression model incorporating clinical parameters of the Fong clinical risk score was used for comparison. Both model performances were benchmarked against the Response Evaluation Criteria in Solid Tumors criteria. A receiver operating curve was created and resulting area under the curve (AUC) was determined. RESULTS Ninety-five patients were included, with 33,619 images available for study inclusion. Ninety-five percent of patients underwent 5-fluorouracil-based chemotherapy with oxaliplatin and/or irinotecan. Sixty percent of the patients were categorized as chemotherapy responders (30% reduction in tumor diameter). The DLM had an AUC of 0.77. The AUC for the clinical model was 0.41. CONCLUSIONS Image-based DLM for prediction of response to neoadjuvant chemotherapy in patients with colorectal cancer liver metastases was superior to a clinical-based model. These results demonstrate potential to identify nonresponders to chemotherapy and guide select patients toward earlier curative resection.
Collapse
Affiliation(s)
- Joshua M K Davis
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Muhammad Khalid Khan Niazi
- Center for Artificial Intelligence Research and the Clinical Image Analysis Lab, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Ansley B Ricker
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Thomas E Tavolara
- Center for Artificial Intelligence Research and the Clinical Image Analysis Lab, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Jordan N Robinson
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Bayram Annanurov
- Center for Artificial Intelligence Research and the Clinical Image Analysis Lab, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Kaylee Smith
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Rohit Mantha
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Jimmy Hwang
- Department of Medical Oncology, Atrium Health Carolinas Medical Center, Levine Cancer Institute, Charlotte, North Carolina, USA
| | - Ruchi Shrestha
- Department of Radiology, Atrium Health, Charlotte, North Carolina, USA
| | - David A Iannitti
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - John B Martinie
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Erin H Baker
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Metin N Gurcan
- Center for Artificial Intelligence Research and the Clinical Image Analysis Lab, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Dionisios Vrochides
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| |
Collapse
|
10
|
Spadaccini M, Troya J, Khalaf K, Facciorusso A, Maselli R, Hann A, Repici A. Artificial Intelligence-assisted colonoscopy and colorectal cancer screening: Where are we going? Dig Liver Dis 2024; 56:1148-1155. [PMID: 38458884 DOI: 10.1016/j.dld.2024.01.203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 01/22/2024] [Accepted: 01/23/2024] [Indexed: 03/10/2024]
Abstract
Colorectal cancer is a significant global health concern, necessitating effective screening strategies to reduce its incidence and mortality rates. Colonoscopy plays a crucial role in the detection and removal of colorectal neoplastic precursors. However, there are limitations and variations in the performance of endoscopists, leading to missed lesions and suboptimal outcomes. The emergence of artificial intelligence (AI) in endoscopy offers promising opportunities to improve the quality and efficacy of screening colonoscopies. In particular, AI applications, including computer-aided detection (CADe) and computer-aided characterization (CADx), have demonstrated the potential to enhance adenoma detection and optical diagnosis accuracy. Additionally, AI-assisted quality control systems aim to standardize the endoscopic examination process. This narrative review provides an overview of AI principles and discusses the current knowledge on AI-assisted endoscopy in the context of screening colonoscopies. It highlights the significant role of AI in improving lesion detection, characterization, and quality assurance during colonoscopy. However, further well-designed studies are needed to validate the clinical impact and cost-effectiveness of AI-assisted colonoscopy before its widespread implementation.
Collapse
Affiliation(s)
- Marco Spadaccini
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy.
| | - Joel Troya
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| | - Kareem Khalaf
- Division of Gastroenterology, St. Michael's Hospital, University of Toronto, Toronto, Canada
| | - Antonio Facciorusso
- Gastroenterology Unit, Department of Surgical and Medical Sciences, University of Foggia, Foggia, Italy
| | - Roberta Maselli
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Alexander Hann
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| | - Alessandro Repici
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| |
Collapse
|
11
|
Chow KW, Bell MT, Cumpian N, Amour M, Hsu RH, Eysselein VE, Srivastava N, Fleischman MW, Reicher S. Long-term impact of artificial intelligence on colorectal adenoma detection in high-risk colonoscopy. World J Gastrointest Endosc 2024; 16:335-342. [PMID: 38946853 PMCID: PMC11212514 DOI: 10.4253/wjge.v16.i6.335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 04/16/2024] [Accepted: 04/28/2024] [Indexed: 06/13/2024] Open
Abstract
BACKGROUND Improved adenoma detection rate (ADR) has been demonstrated with artificial intelligence (AI)-assisted colonoscopy. However, data on the real-world application of AI and its effect on colorectal cancer (CRC) screening outcomes is limited. AIM To analyze the long-term impact of AI on a diverse at-risk patient population undergoing diagnostic colonoscopy for positive CRC screening tests or symptoms. METHODS AI software (GI Genius, Medtronic) was implemented into the standard procedure protocol in November 2022. Data was collected on patient demographics, procedure indication, polyp size, location, and pathology. CRC screening outcomes were evaluated before and at different intervals after AI introduction with one year of follow-up. RESULTS We evaluated 1008 colonoscopies (278 pre-AI, 255 early post-AI, 285 established post-AI, and 190 late post-AI). The ADR was 38.1% pre-AI, 42.0% early post-AI (P = 0.77), 40.0% established post-AI (P = 0.44), and 39.5% late post-AI (P = 0.77). There were no significant differences in polyp detection rate (PDR, baseline 59.7%), advanced ADR (baseline 16.2%), and non-neoplastic PDR (baseline 30.0%) before and after AI introduction. CONCLUSION In patients with an increased pre-test probability of having an abnormal colonoscopy, the current generation of AI did not yield enhanced CRC screening metrics over high-quality colonoscopy. Although the potential of AI in colonoscopy is undisputed, current AI technology may not universally elevate screening metrics across all situations and patient populations. Future studies that analyze different AI systems across various patient populations are needed to determine the most effective role of AI in optimizing CRC screening in clinical practice.
Collapse
Affiliation(s)
- Kenneth W Chow
- Department of Medicine, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Matthew T Bell
- Department of Medicine, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Nicholas Cumpian
- Department of Medicine, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Maryanne Amour
- Department of Medicine, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Ryan H Hsu
- Department of Bioengineering, Jacobs School of Engineering, University of California, San Diego, La Jolla, CA 92093, United States
| | - Viktor E Eysselein
- Department of Gastroenterology, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Neetika Srivastava
- Department of Gastroenterology, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Michael W Fleischman
- Department of Gastroenterology, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Sofiya Reicher
- Department of Gastroenterology, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| |
Collapse
|
12
|
Sinonquel P, Eelbode T, Pech O, De Wulf D, Dewint P, Neumann H, Antonelli G, Iacopini F, Tate D, Lemmers A, Pilonis ND, Kaminski MF, Roelandt P, Hassan C, Ingrid D, Maes F, Bisschops R. Clinical consequences of computer-aided colorectal polyp detection. Gut 2024:gutjnl-2024-331943. [PMID: 38876773 DOI: 10.1136/gutjnl-2024-331943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 06/02/2024] [Indexed: 06/16/2024]
Abstract
BACKGROUND AND AIM Randomised trials show improved polyp detection with computer-aided detection (CADe), mostly of small lesions. However, operator and selection bias may affect CADe's true benefit. Clinical outcomes of increased detection have not yet been fully elucidated. METHODS In this multicentre trial, CADe combining convolutional and recurrent neural networks was used for polyp detection. Blinded endoscopists were monitored in real time by a second observer with CADe access. CADe detections prompted reinspection. Adenoma detection rates (ADR) and polyp detection rates were measured prestudy and poststudy. Histological assessments were done by independent histopathologists. The primary outcome compared polyp detection between endoscopists and CADe. RESULTS In 946 patients (51.9% male, mean age 64), a total of 2141 polyps were identified, including 989 adenomas. CADe was not superior to human polyp detection (sensitivity 94.6% vs 96.0%) but outperformed them when restricted to adenomas. Unblinding led to an additional yield of 86 true positive polyp detections (1.1% ADR increase per patient; 73.8% were <5 mm). CADe also increased non-neoplastic polyp detection by an absolute value of 4.9% of the cases (1.8% increase of entire polyp load). Procedure time increased with 6.6±6.5 min (+42.6%). In 22/946 patients, the additional detection of adenomas changed surveillance intervals (2.3%), mostly by increasing the number of small adenomas beyond the cut-off. CONCLUSION Even if CADe appears to be slightly more sensitive than human endoscopists, the additional gain in ADR was minimal and follow-up intervals rarely changed. Additional inspection of non-neoplastic lesions was increased, adding to the inspection and/or polypectomy workload.
Collapse
Affiliation(s)
- Pieter Sinonquel
- Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium
- Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven Biomedical Sciences Group, Leuven, Belgium
| | - Tom Eelbode
- Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Oliver Pech
- Gastroenterology and Hepatology, Krankenhaus Barmherzige Bruder Regensburg, Regensburg, Germany
| | - Dominiek De Wulf
- Gastroenterology and Hepatology, AZ Delta vzw, Roeselare, Belgium
| | - Pieter Dewint
- Gastroenterology and Hepatology, AZ Maria Middelares vzw, Gent, Belgium
| | - Helmut Neumann
- Gastroenterology and Hepatology, Gastrozentrum Lippe, Bad Salzuflen, Germany
| | - Giulio Antonelli
- Gastroenterology and Digestive Endoscopy Unit, Ospedale Nuovo Regina Margherita, Roma, Italy
| | - Federico Iacopini
- Gastroenterology and Digestive endoscopy, Ospedale dei Castelli, Ariccia, Italy
| | - David Tate
- Gastroenterology and Hepatology, UZ Gent, Gent, Belgium
| | - Arnaud Lemmers
- Gastroenterology and Hepatology, ULB Erasme, Bruxelles, Belgium
| | | | - Michal Filip Kaminski
- Department of Gastroenterology, Hepatology and Oncology, Medical Centre fo Postgraduate Education, Warsaw, Poland
- Department of Gastroenterological Oncology, The Maria Sklodowska-Curie Memorial Cancer Centre, Instytute of Oncology, Warsaw, Poland
| | - Philip Roelandt
- Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium
- Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven Biomedical Sciences Group, Leuven, Belgium
| | - Cesare Hassan
- Endoscopy, Humanitas University Hospitals, Humanitas Group, Rozzano, Italy
| | - Demedts Ingrid
- Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium
- Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven Biomedical Sciences Group, Leuven, Belgium
| | - Frederik Maes
- Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Raf Bisschops
- Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium
- Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven Biomedical Sciences Group, Leuven, Belgium
| |
Collapse
|
13
|
Horita K, Hida K, Itatani Y, Fujita H, Hidaka Y, Yamamoto G, Ito M, Obama K. Real-time detection of active bleeding in laparoscopic colectomy using artificial intelligence. Surg Endosc 2024; 38:3461-3469. [PMID: 38760565 DOI: 10.1007/s00464-024-10874-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 04/20/2024] [Indexed: 05/19/2024]
Abstract
BACKGROUND Most intraoperative adverse events (iAEs) result from surgeons' errors, and bleeding is the majority of iAEs. Recognizing active bleeding timely is important to ensure safe surgery, and artificial intelligence (AI) has great potential for detecting active bleeding and providing real-time surgical support. This study aimed to develop a real-time AI model to detect active intraoperative bleeding. METHODS We extracted 27 surgical videos from a nationwide multi-institutional surgical video database in Japan and divided them at the patient level into three sets: training (n = 21), validation (n = 3), and testing (n = 3). We subsequently extracted the bleeding scenes and labeled distinctively active bleeding and blood pooling frame by frame. We used pre-trained YOLOv7_6w and developed a model to learn both active bleeding and blood pooling. The Average Precision at an Intersection over Union threshold of 0.5 (AP.50) for active bleeding and frames per second (FPS) were quantified. In addition, we conducted two 5-point Likert scales (5 = Excellent, 4 = Good, 3 = Fair, 2 = Poor, and 1 = Fail) questionnaires about sensitivity (the sensitivity score) and number of overdetection areas (the overdetection score) to investigate the surgeons' assessment. RESULTS We annotated 34,117 images of 254 bleeding events. The AP.50 for active bleeding in the developed model was 0.574 and the FPS was 48.5. Twenty surgeons answered two questionnaires, indicating a sensitivity score of 4.92 and an overdetection score of 4.62 for the model. CONCLUSIONS We developed an AI model to detect active bleeding, achieving real-time processing speed. Our AI model can be used to provide real-time surgical support.
Collapse
Affiliation(s)
- Kenta Horita
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Koya Hida
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan.
| | - Yoshiro Itatani
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Haruku Fujita
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Yu Hidaka
- Department of Biomedical Statistics and Bioinformatics, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Goshiro Yamamoto
- Division of Medical Information Technology and Administration Planning, Kyoto University, Kyoto, Japan
| | - Masaaki Ito
- Surgical Device Innovation Office, National Cancer Center Hospital East, Chiba, Japan
- Department of Colorectal Surgery, National Cancer Center Hospital East, Chiba, Japan
| | - Kazutaka Obama
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| |
Collapse
|
14
|
Varghese C, Harrison EM, O'Grady G, Topol EJ. Artificial intelligence in surgery. Nat Med 2024; 30:1257-1268. [PMID: 38740998 DOI: 10.1038/s41591-024-02970-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Accepted: 04/03/2024] [Indexed: 05/16/2024]
Abstract
Artificial intelligence (AI) is rapidly emerging in healthcare, yet applications in surgery remain relatively nascent. Here we review the integration of AI in the field of surgery, centering our discussion on multifaceted improvements in surgical care in the preoperative, intraoperative and postoperative space. The emergence of foundation model architectures, wearable technologies and improving surgical data infrastructures is enabling rapid advances in AI interventions and utility. We discuss how maturing AI methods hold the potential to improve patient outcomes, facilitate surgical education and optimize surgical care. We review the current applications of deep learning approaches and outline a vision for future advances through multimodal foundation models.
Collapse
Affiliation(s)
- Chris Varghese
- Department of Surgery, University of Auckland, Auckland, New Zealand
| | - Ewen M Harrison
- Centre for Medical Informatics, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Greg O'Grady
- Department of Surgery, University of Auckland, Auckland, New Zealand
- Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand
| | - Eric J Topol
- Scripps Research Translational Institute, La Jolla, CA, USA.
| |
Collapse
|
15
|
Okumura T, Imai K, Misawa M, Kudo SE, Hotta K, Ito S, Kishida Y, Takada K, Kawata N, Maeda Y, Yoshida M, Yamamoto Y, Minamide T, Ishiwatari H, Sato J, Matsubayashi H, Ono H. Evaluating false-positive detection in a computer-aided detection system for colonoscopy. J Gastroenterol Hepatol 2024; 39:927-934. [PMID: 38273460 DOI: 10.1111/jgh.16491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Revised: 12/21/2023] [Accepted: 01/03/2024] [Indexed: 01/27/2024]
Abstract
BACKGROUND AND AIM Computer-aided detection (CADe) systems can efficiently detect polyps during colonoscopy. However, false-positive (FP) activation is a major limitation of CADe. We aimed to compare the rate and causes of FP using CADe before and after an update designed to reduce FP. METHODS We analyzed CADe-assisted colonoscopy videos recorded between July 2022 and October 2022. The number and causes of FPs and excessive time spent by the endoscopist on FP (ET) were compared pre- and post-update using 1:1 propensity score matching. RESULTS During the study period, 191 colonoscopy videos (94 and 97 in the pre- and post-update groups, respectively) were recorded. Propensity score matching resulted in 146 videos (73 in each group). The mean number of FPs and median ET per colonoscopy were significantly lower in the post-update group than those in the pre-update group (4.2 ± 3.7 vs 18.1 ± 11.1; P < 0.001 and 0 vs 16 s; P < 0.001, respectively). Mucosal tags, bubbles, and folds had the strongest association with decreased FP post-update (pre-update vs post-update: 4.3 ± 3.6 vs 0.4 ± 0.8, 0.32 ± 0.70 vs 0.04 ± 0.20, and 8.6 ± 6.7 vs 1.6 ± 1.7, respectively). There was no significant decrease in the true positive rate (post-update vs pre-update: 95.0% vs 99.2%; P = 0.09) or the adenoma detection rate (post-update vs pre-update: 52.1% vs 49.3%; P = 0.87). CONCLUSIONS The updated CADe can reduce FP without impairing polyp detection. A reduction in FP may help relieve the burden on endoscopists.
Collapse
Affiliation(s)
- Taishi Okumura
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Kenichiro Imai
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Masashi Misawa
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Shin-Ei Kudo
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Kinichi Hotta
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Sayo Ito
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | - Kazunori Takada
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Noboru Kawata
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Yuki Maeda
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Masao Yoshida
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Yoichi Yamamoto
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | | | - Junya Sato
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | - Hiroyuki Ono
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| |
Collapse
|
16
|
Guo F, Meng H. Application of artificial intelligence in gastrointestinal endoscopy. Arab J Gastroenterol 2024; 25:93-96. [PMID: 38228443 DOI: 10.1016/j.ajg.2023.12.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 09/06/2023] [Accepted: 12/30/2023] [Indexed: 01/18/2024]
Abstract
Endoscopy is an important method for diagnosing gastrointestinal (GI) diseases. In this study, we provide an overview of the advances in artificial intelligence (AI) technology in the field of GI endoscopy over recent years, including esophagus, stomach, large intestine, and capsule endoscopy (small intestine). AI-assisted endoscopy shows high accuracy, sensitivity, and specificity in the detection and diagnosis of GI diseases at all levels. Hence, AI will make a breakthrough in the field of GI endoscopy in the near future. However, AI technology currently has some limitations and is still in the preclinical stages.
Collapse
Affiliation(s)
- Fujia Guo
- The first Affiliated Hospital, Dalian Medical University, Dalian 116044, China
| | - Hua Meng
- The first Affiliated Hospital, Dalian Medical University, Dalian 116044, China.
| |
Collapse
|
17
|
Lee MCM, Parker CH, Liu LWC, Farahvash A, Jeyalingam T. Impact of study design on adenoma detection in the evaluation of artificial intelligence-aided colonoscopy: a systematic review and meta-analysis. Gastrointest Endosc 2024; 99:676-687.e16. [PMID: 38272274 DOI: 10.1016/j.gie.2024.01.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/09/2023] [Revised: 12/19/2023] [Accepted: 01/10/2024] [Indexed: 01/27/2024]
Abstract
BACKGROUND AND AIMS Randomized controlled trials (RCTs) have reported that artificial intelligence (AI) improves endoscopic polyp detection. Different methodologies-namely, parallel and tandem designs-have been used to evaluate the efficacy of AI-assisted colonoscopy in RCTs. Systematic reviews and meta-analyses have reported a pooled effect that includes both study designs. However, it is unclear whether there are inconsistencies in the reported results of these 2 designs. Here, we aimed to determine whether study characteristics moderate between-trial differences in outcomes when evaluating the effectiveness of AI-assisted polyp detection. METHODS A systematic search of Ovid MEDLINE, Embase, Cochrane Central, Web of Science, and IEEE Xplore was performed through March 1, 2023, for RCTs comparing AI-assisted colonoscopy with routine high-definition colonoscopy in polyp detection. The primary outcome of interest was the impact of study type on the adenoma detection rate (ADR). Secondary outcomes included the impact of the study type on adenomas per colonoscopy and withdrawal time, as well as the impact of geographic location, AI system, and endoscopist experience on ADR. Pooled event analysis was performed using a random-effects model. RESULTS Twenty-four RCTs involving 17,413 colonoscopies (AI assisted: 8680; non-AI assisted: 8733) were included. AI-assisted colonoscopy improved overall ADR (risk ratio [RR], 1.24; 95% confidence interval [CI], 1.17-1.31; I2 = 53%; P < .001). Tandem studies collectively demonstrated improved ADR in AI-aided colonoscopies (RR, 1.18; 95% CI, 1.08-1.30; I2 = 0%; P < .001), as did parallel studies (RR, 1.26; 95% CI, 1.17-1.35; I2 = 62%; P < .001), with no statistical subgroup difference between study design. Both tandem and parallel study designs revealed improvement in adenomas per colonoscopy in AI-aided colonoscopies, but this improvement was more marked among tandem studies (P < .001). AI assistance significantly increased withdrawal times for parallel (P = .002), but not tandem, studies. ADR improvement was more marked among studies conducted in Asia compared to Europe and North America in a subgroup analysis (P = .007). Type of AI system used or endoscopist experience did not affect overall improvement in ADR. CONCLUSIONS Either parallel or tandem study design can capture the improvement in ADR resulting from the use of AI-assisted polyp detection systems. Tandem studies powered to detect differences in endoscopic performance through paired comparison may be a resource-efficient method of evaluating new AI-assisted technologies.
Collapse
Affiliation(s)
- Michelle C M Lee
- Division of Gastroenterology and Hepatology, Department of Medicine, University Health Network, University of Toronto, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Colleen H Parker
- Division of Gastroenterology and Hepatology, Department of Medicine, University Health Network, University of Toronto, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Louis W C Liu
- Division of Gastroenterology and Hepatology, Department of Medicine, University Health Network, University of Toronto, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Armin Farahvash
- Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Thurarshen Jeyalingam
- Division of Gastroenterology and Hepatology, Department of Medicine, University Health Network, University of Toronto, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
18
|
Parasa S, Berzin T, Leggett C, Gross S, Repici A, Ahmad OF, Chiang A, Coelho-Prabhu N, Cohen J, Dekker E, Keswani RN, Kahn CE, Hassan C, Petrick N, Mountney P, Ng J, Riegler M, Mori Y, Saito Y, Thakkar S, Waxman I, Wallace MB, Sharma P. Consensus statements on the current landscape of artificial intelligence applications in endoscopy, addressing roadblocks, and advancing artificial intelligence in gastroenterology. Gastrointest Endosc 2024:S0016-5107(23)03139-5. [PMID: 38639679 DOI: 10.1016/j.gie.2023.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Accepted: 12/02/2023] [Indexed: 04/20/2024]
Abstract
BACKGROUND AND AIMS The American Society for Gastrointestinal Endoscopy (ASGE) AI Task Force along with experts in endoscopy, technology space, regulatory authorities, and other medical subspecialties initiated a consensus process that analyzed the current literature, highlighted potential areas, and outlined the necessary research in artificial intelligence (AI) to allow a clearer understanding of AI as it pertains to endoscopy currently. METHODS A modified Delphi process was used to develop these consensus statements. RESULTS Statement 1: Current advances in AI allow for the development of AI-based algorithms that can be applied to endoscopy to augment endoscopist performance in detection and characterization of endoscopic lesions. Statement 2: Computer vision-based algorithms provide opportunities to redefine quality metrics in endoscopy using AI, which can be standardized and can reduce subjectivity in reporting quality metrics. Natural language processing-based algorithms can help with the data abstraction needed for reporting current quality metrics in GI endoscopy effortlessly. Statement 3: AI technologies can support smart endoscopy suites, which may help optimize workflows in the endoscopy suite, including automated documentation. Statement 4: Using AI and machine learning helps in predictive modeling, diagnosis, and prognostication. High-quality data with multidimensionality are needed for risk prediction, prognostication of specific clinical conditions, and their outcomes when using machine learning methods. Statement 5: Big data and cloud-based tools can help advance clinical research in gastroenterology. Multimodal data are key to understanding the maximal extent of the disease state and unlocking treatment options. Statement 6: Understanding how to evaluate AI algorithms in the gastroenterology literature and clinical trials is important for gastroenterologists, trainees, and researchers, and hence education efforts by GI societies are needed. Statement 7: Several challenges regarding integrating AI solutions into the clinical practice of endoscopy exist, including understanding the role of human-AI interaction. Transparency, interpretability, and explainability of AI algorithms play a key role in their clinical adoption in GI endoscopy. Developing appropriate AI governance, data procurement, and tools needed for the AI lifecycle are critical for the successful implementation of AI into clinical practice. Statement 8: For payment of AI in endoscopy, a thorough evaluation of the potential value proposition for AI systems may help guide purchasing decisions in endoscopy. Reliable cost-effectiveness studies to guide reimbursement are needed. Statement 9: Relevant clinical outcomes and performance metrics for AI in gastroenterology are currently not well defined. To improve the quality and interpretability of research in the field, steps need to be taken to define these evidence standards. Statement 10: A balanced view of AI technologies and active collaboration between the medical technology industry, computer scientists, gastroenterologists, and researchers are critical for the meaningful advancement of AI in gastroenterology. CONCLUSIONS The consensus process led by the ASGE AI Task Force and experts from various disciplines has shed light on the potential of AI in endoscopy and gastroenterology. AI-based algorithms have shown promise in augmenting endoscopist performance, redefining quality metrics, optimizing workflows, and aiding in predictive modeling and diagnosis. However, challenges remain in evaluating AI algorithms, ensuring transparency and interpretability, addressing governance and data procurement, determining payment models, defining relevant clinical outcomes, and fostering collaboration between stakeholders. Addressing these challenges while maintaining a balanced perspective is crucial for the meaningful advancement of AI in gastroenterology.
Collapse
Affiliation(s)
| | | | | | - Seth Gross
- NYU Langone Health, New York, New York, USA
| | | | | | - Austin Chiang
- Medtronic Gastrointestinal, Santa Clara, California, USA
| | | | | | | | | | - Charles E Kahn
- University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| | - Nicholas Petrick
- Center for Devices and Radiological Health, U.S. Food and Drug Administration
| | | | - Jonathan Ng
- Iterative Health, Boston, Massachusetts, USA
| | | | | | | | - Shyam Thakkar
- West Virginia University Medicine, Morgantown, West Virginia, USA
| | - Irving Waxman
- Rush University Medical Center, Chicago, Illinois, USA
| | | | | |
Collapse
|
19
|
Gangwani MK, Haghbin H, Ishtiaq R, Hasan F, Dillard J, Jaber F, Dahiya DS, Ali H, Salim S, Lee-Smith W, Sohail AH, Inamdar S, Aziz M, Hart B. Single Versus Second Observer vs Artificial Intelligence to Increase the ADENOMA Detection Rate of Colonoscopy-A Network Analysis. Dig Dis Sci 2024; 69:1380-1388. [PMID: 38436866 PMCID: PMC11026252 DOI: 10.1007/s10620-024-08341-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 02/07/2024] [Indexed: 03/05/2024]
Abstract
BACKGROUND AND AIMS Screening colonoscopy has significantly contributed to the reduction of the incidence of colorectal cancer (CRC) and its associated mortality, with adenoma detection rate (ADR) as the quality marker. To increase the ADR, various solutions have been proposed including the utilization of Artificial Intelligence (AI) and employing second observers during colonoscopies. In the interest of AI improving ADR independently, without a second observer, and the operational similarity between AI and second observer, this network meta-analysis aims at evaluating the effectiveness of AI, second observer, and a single observer in improving ADR. METHODS We searched the Medline, Embase, Cochrane, Web of Science Core Collection, Korean Citation Index, SciELO, Global Index Medicus, and Cochrane. A direct head-to-head comparator analysis and network meta-analysis were performed using the random-effects model. The odds ratio (OR) was calculated with a 95% confidence interval (CI) and p-value < 0.05 was considered statistically significant. RESULTS We analyzed 26 studies, involving 22,560 subjects. In the direct comparative analysis, AI demonstrated higher ADR (OR: 0.668, 95% CI 0.595-0.749, p < 0.001) than single observer. Dual observer demonstrated a higher ADR (OR: 0.771, 95% CI 0.688-0.865, p < 0.001) than single operator. In network meta-analysis, results were consistent on the network meta-analysis, maintaining consistency. No statistical difference was noted when comparing AI to second observer. (RR 1.1 (0.9-1.2, p = 0.3). Results were consistent when evaluating only RCTs. Net ranking provided higher score to AI followed by second observer followed by single observer. CONCLUSION Artificial Intelligence and second-observer colonoscopy showed superior success in Adenoma Detection Rate when compared to single-observer colonoscopy. Although not statistically significant, net ranking model favors the superiority of AI to the second observer.
Collapse
Affiliation(s)
| | - Hossein Haghbin
- Department of Gastroenterology and Hepatology, Ascension Providence Hospital, Southfield, MI, USA
| | - Rizwan Ishtiaq
- Department of Medicine, St Francis Hospital and Medical Center, Hartford, CT, USA
| | - Fariha Hasan
- Department of Internal Medicine, Cooper University Hospital, Camden, NJ, USA
| | - Julia Dillard
- Department of Medicine, University of Toledo Medical Center, Toledo, OH, USA
| | - Fouad Jaber
- Department of Internal Medicine, University of Missouri-Kansas City, Kansas City, MO, USA
| | - Dushyant Singh Dahiya
- Department of Medicine, Central Michigan University College of Medicine, Mount Pleasant, MI, USA
| | - Hassam Ali
- Department of Gastroenterology and Hepatology, East Carolina University Health, Greenville, NC, USA
| | - Shaharyar Salim
- Department of Internal Medicine, Aga Khan University Hospital, Karachi, Pakistan
| | - Wade Lee-Smith
- University of Toledo Libraries, University of Toledo, Toledo, OH, USA
| | - Amir Humza Sohail
- Department of General Surgery, New York University Langone Health, Long Island, NY, USA
| | - Sumant Inamdar
- Department of Gastroenterology and Hepatology, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Muhammad Aziz
- Department of Gastroenterology and Hepatology, University of Toledo Medical Center, Toledo, OH, USA
| | - Benjamin Hart
- Depertment of Hepatology and Gastroenterology, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
20
|
Liu X, Reigle J, Prasath VBS, Dhaliwal J. Artificial intelligence image-based prediction models in IBD exhibit high risk of bias: A systematic review. Comput Biol Med 2024; 171:108093. [PMID: 38354499 DOI: 10.1016/j.compbiomed.2024.108093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 01/04/2024] [Accepted: 01/30/2024] [Indexed: 02/16/2024]
Abstract
BACKGROUND There has been an increase in the development of both machine learning (ML) and deep learning (DL) prediction models in Inflammatory Bowel Disease. We aim in this systematic review to assess the methodological quality and risk of bias of ML and DL IBD image-based prediction studies. METHODS We searched three databases, PubMed, Scopus and Embase, to identify ML and DL diagnostic or prognostic predictive models using imaging data in IBD, to Dec 31, 2022. We restricted our search to include studies that primarily used conventional imaging data, were undertaken in human participants, and published in English. Two reviewers independently reviewed the abstracts. The methodological quality of the studies was determined, and risk of bias evaluated using the prediction risk of bias assessment tool (PROBAST). RESULTS Forty studies were included, thirty-nine developed diagnostic models. Seven studies utilized ML approaches, six were retrospective and none used multicenter data for model development. Thirty-three studies utilized DL approaches, ten were prospective, and twelve multicenter studies. Overall, all studies demonstrated high risk of bias. ML studies were evaluated in 4 domains all rated as high risk of bias: participants (6/7), predictors (1/7), outcome (3/7), and analysis (7/7), and DL studies evaluated in 3 domains: participants (24/33), outcome (10/33), and analysis (18/33). The majority of image-based studies used colonoscopy images. CONCLUSION The risk of bias was high in AI IBD image-based prediction models, owing to insufficient sample size, unreported missingness and lack of an external validation cohort. Models with a high risk of bias are unlikely to be generalizable and suitable for clinical implementation.
Collapse
Affiliation(s)
- Xiaoxuan Liu
- Department of Biomedical Informatics, College of Medicine, University of Cincinnati, OH, USA; Department of Pediatrics, University of Cincinnati, College of Medicine, Cincinnati, OH, USA
| | - James Reigle
- Department of Pediatrics, University of Cincinnati, College of Medicine, Cincinnati, OH, USA; Cincinnati Children's Hospital Medical Center, Division of Gastroenterology, Hepatology and Nutrition, USA
| | - V B Surya Prasath
- Department of Biomedical Informatics, College of Medicine, University of Cincinnati, OH, USA; Department of Pediatrics, University of Cincinnati, College of Medicine, Cincinnati, OH, USA; Cincinnati Children's Hospital Medical Center, Division of Gastroenterology, Hepatology and Nutrition, USA
| | - Jasbir Dhaliwal
- Department of Biomedical Informatics, College of Medicine, University of Cincinnati, OH, USA; Department of Pediatrics, University of Cincinnati, College of Medicine, Cincinnati, OH, USA; Cincinnati Children's Hospital Medical Center, Division of Gastroenterology, Hepatology and Nutrition, USA.
| |
Collapse
|
21
|
Lau LHS, Ho JCL, Lai JCT, Ho AHY, Wu CWK, Lo VWH, Lai CMS, Scheppach MW, Sia F, Ho KHK, Xiao X, Yip TCF, Lam TYT, Kwok HYH, Chan HCH, Lui RN, Chan TT, Wong MTL, Ho MF, Ko RCW, Hon SF, Chu S, Futaba K, Ng SSM, Yip HC, Tang RSY, Wong VWS, Chan FKL, Chiu PWY. Effect of Real-Time Computer-Aided Polyp Detection System (ENDO-AID) on Adenoma Detection in Endoscopists-in-Training: A Randomized Trial. Clin Gastroenterol Hepatol 2024; 22:630-641.e4. [PMID: 37918685 DOI: 10.1016/j.cgh.2023.10.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 10/12/2023] [Accepted: 10/19/2023] [Indexed: 11/04/2023]
Abstract
BACKGROUND The effect of computer-aided polyp detection (CADe) on adenoma detection rate (ADR) among endoscopists-in-training remains unknown. METHODS We performed a single-blind, parallel-group, randomized controlled trial in Hong Kong between April 2021 and July 2022 (NCT04838951). Eligible subjects undergoing screening/surveillance/diagnostic colonoscopies were randomized 1:1 to receive colonoscopies with CADe (ENDO-AID[OIP-1]) or not (control) during withdrawal. Procedures were performed by endoscopists-in-training with <500 procedures and <3 years' experience. Randomization was stratified by patient age, sex, and endoscopist experience (beginner vs intermediate level, <200 vs 200-500 procedures). Image enhancement and distal attachment devices were disallowed. Subjects with incomplete colonoscopies or inadequate bowel preparation were excluded. Treatment allocation was blinded to outcome assessors. The primary outcome was ADR. Secondary outcomes were ADR for different adenoma sizes and locations, mean number of adenomas, and non-neoplastic resection rate. RESULTS A total of 386 and 380 subjects were randomized to CADe and control groups, respectively. The overall ADR was significantly higher in the CADe group than in the control group (57.5% vs 44.5%; adjusted relative risk, 1.41; 95% CI, 1.17-1.72; P < .001). The ADRs for <5 mm (40.4% vs 25.0%) and 5- to 10-mm adenomas (36.8% vs 29.2%) were higher in the CADe group. The ADRs were higher in the CADe group in both the right colon (42.0% vs 30.8%) and left colon (34.5% vs 27.6%), but there was no significant difference in advanced ADR. The ADRs were higher in the CADe group among beginner (60.0% vs 41.9%) and intermediate-level (56.5% vs 45.5%) endoscopists. Mean number of adenomas (1.48 vs 0.86) and non-neoplastic resection rate (52.1% vs 35.0%) were higher in the CADe group. CONCLUSIONS Among endoscopists-in-training, the use of CADe during colonoscopies was associated with increased overall ADR. (ClinicalTrials.gov, Number: NCT04838951).
Collapse
Affiliation(s)
- Louis H S Lau
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR; Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; State Key Laboratory of Digestive Disease, Li Ka Shing Institute of Health Sciences, The Chinese University of Hong Kong, Hong Kong SAR
| | - Jacky C L Ho
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Jimmy C T Lai
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Agnes H Y Ho
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Claudia W K Wu
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Vincent W H Lo
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Carol M S Lai
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Markus W Scheppach
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Gastroenterology, Faculty of Medicine, University of Augsburg, Augsburg, Germany
| | - Felix Sia
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR
| | - Kyle H K Ho
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR
| | - Xiang Xiao
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Medical Data Analytic Centre, The Chinese University of Hong Kong, Hong Kong SAR
| | - Terry C F Yip
- Medical Data Analytic Centre, The Chinese University of Hong Kong, Hong Kong SAR
| | - Thomas Y T Lam
- Stanley Ho Big Data Decision Analytics Research Centre, The Chinese University of Hong Kong, Hong Kong SAR
| | - Hanson Y H Kwok
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Heyson C H Chan
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Rashid N Lui
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Ting-Ting Chan
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Marc T L Wong
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Man-Fung Ho
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Rachel C W Ko
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Sok-Fei Hon
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Simon Chu
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Koari Futaba
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Simon S M Ng
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Hon-Chi Yip
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Raymond S Y Tang
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR; Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; State Key Laboratory of Digestive Disease, Li Ka Shing Institute of Health Sciences, The Chinese University of Hong Kong, Hong Kong SAR
| | - Vincent W S Wong
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR; Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; State Key Laboratory of Digestive Disease, Li Ka Shing Institute of Health Sciences, The Chinese University of Hong Kong, Hong Kong SAR
| | - Francis K L Chan
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR; Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; State Key Laboratory of Digestive Disease, Li Ka Shing Institute of Health Sciences, The Chinese University of Hong Kong, Hong Kong SAR
| | - Philip W Y Chiu
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR.
| |
Collapse
|
22
|
Uchikov P, Khalid U, Kraev K, Hristov B, Kraeva M, Tenchev T, Chakarov D, Sandeva M, Dragusheva S, Taneva D, Batashki A. Artificial Intelligence in the Diagnosis of Colorectal Cancer: A Literature Review. Diagnostics (Basel) 2024; 14:528. [PMID: 38472999 DOI: 10.3390/diagnostics14050528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Revised: 02/26/2024] [Accepted: 02/27/2024] [Indexed: 03/14/2024] Open
Abstract
BACKGROUND The aim of this review is to explore the role of artificial intelligence in the diagnosis of colorectal cancer, how it impacts CRC morbidity and mortality, and why its role in clinical medicine is limited. METHODS A targeted, non-systematic review of the published literature relating to colorectal cancer diagnosis was performed with PubMed databases that were scouted to help provide a more defined understanding of the recent advances regarding artificial intelligence and their impact on colorectal-related morbidity and mortality. Articles were included if deemed relevant and including information associated with the keywords. RESULTS The advancements in artificial intelligence have been significant in facilitating an earlier diagnosis of CRC. In this review, we focused on evaluating genomic biomarkers, the integration of instruments with artificial intelligence, MR and hyperspectral imaging, and the architecture of neural networks. We found that these neural networks seem practical and yield positive results in initial testing. Furthermore, we explored the use of deep-learning-based majority voting methods, such as bag of words and PAHLI, in improving diagnostic accuracy in colorectal cancer detection. Alongside this, the autonomous and expansive learning ability of artificial intelligence, coupled with its ability to extract increasingly complex features from images or videos without human reliance, highlight its impact in the diagnostic sector. Despite this, as most of the research involves a small sample of patients, a diversification of patient data is needed to enhance cohort stratification for a more sensitive and specific neural model. We also examined the successful application of artificial intelligence in predicting microsatellite instability, showcasing its potential in stratifying patients for targeted therapies. CONCLUSIONS Since its commencement in colorectal cancer, artificial intelligence has revealed a multitude of functionalities and augmentations in the diagnostic sector of CRC. Given its early implementation, its clinical application remains a fair way away, but with steady research dedicated to improving neural architecture and expanding its applicational range, there is hope that these advanced neural software could directly impact the early diagnosis of CRC. The true promise of artificial intelligence, extending beyond the medical sector, lies in its potential to significantly influence the future landscape of CRC's morbidity and mortality.
Collapse
Affiliation(s)
- Petar Uchikov
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Usman Khalid
- Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Krasimir Kraev
- Department of Propaedeutics of Internal Diseases "Prof. Dr. Anton Mitov", Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Bozhidar Hristov
- Section "Gastroenterology", Second Department of Internal Diseases, Medical Faculty, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Maria Kraeva
- Department of Otorhinolaryngology, Medical Faculty, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Tihomir Tenchev
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Dzhevdet Chakarov
- Department of Propaedeutics of Surgical Diseases, Section of General Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Milena Sandeva
- Department of Midwifery, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Snezhanka Dragusheva
- Department of Nursing Care, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Daniela Taneva
- Department of Nursing Care, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Atanas Batashki
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| |
Collapse
|
23
|
Chen Z, Yang D, Li A, Sun L, Zhao J, Liu J, Liu L, Zhou X, Chen Y, Cai Y, Wu Z, Cheng K, Cai H, Tang M, Peng B, Wang X. Decoding surgical skill: an objective and efficient algorithm for surgical skill classification based on surgical gesture features -experimental studies. Int J Surg 2024; 110:1441-1449. [PMID: 38079605 PMCID: PMC10942222 DOI: 10.1097/js9.0000000000000975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Accepted: 11/21/2023] [Indexed: 03/16/2024]
Abstract
BACKGROUND Various surgical skills lead to differences in patient outcomes and identifying poorly skilled surgeons with constructive feedback contributes to surgical quality improvement. The aim of the study was to develop an algorithm for evaluating surgical skills in laparoscopic cholecystectomy based on the features of elementary functional surgical gestures (Surgestures). MATERIALS AND METHODS Seventy-five laparoscopic cholecystectomy videos were collected from 33 surgeons in five hospitals. The phase of mobilization hepatocystic triangle and gallbladder dissection from the liver bed of each video were annotated with 14 Surgestures. The videos were grouped into competent and incompetent based on the quantiles of modified global operative assessment of laparoscopic skills (mGOALS). Surgeon-related information, clinical data, and intraoperative events were analyzed. Sixty-three Surgesture features were extracted to develop the surgical skill classification algorithm. The area under the receiver operating characteristic curve of the classification and the top features were evaluated. RESULTS Correlation analysis revealed that most perioperative factors had no significant correlation with mGOALS scores. The incompetent group has a higher probability of cholecystic vascular injury compared to the competent group (30.8 vs 6.1%, P =0.004). The competent group demonstrated fewer inefficient Surgestures, lower shift frequency, and a larger dissection-exposure ratio of Surgestures during the procedure. The area under the receiver operating characteristic curve of the classification algorithm achieved 0.866. Different Surgesture features contributed variably to overall performance and specific skill items. CONCLUSION The computer algorithm accurately classified surgeons with different skill levels using objective Surgesture features, adding insight into designing automatic laparoscopic surgical skill assessment tools with technical feedback.
Collapse
Affiliation(s)
- Zixin Chen
- Department of General Surgery, Division of Pancreatic Surgery
- West China School of Medicine, West China Hospital of Sichuan University
| | - Dewei Yang
- Chongqing University of Posts and Telecommunications, School of Advanced Manufacturing Engineering, Chongqing
| | - Ang Li
- Department of General Surgery, Division of Pancreatic Surgery
- Guang’an People’s Hospital, Guang’an
| | - Louzong Sun
- Department of Hepatobiliary Surgery, Zigong First People’s Hospital, Zigong
| | - Jifan Zhao
- Chengdu Withai Innovations Technology Company, Chengdu
| | - Jie Liu
- Chengdu Withai Innovations Technology Company, Chengdu
| | - Linxun Liu
- Department of General Surgery, Qinghai Provincial People’s Hospital, Xining, People’s Republic of China
| | - Xiaobo Zhou
- School of Biomedical Informatics, McGovern Medical School, University of Texas Health Science Center, Houston, USA
| | - Yonghua Chen
- Department of General Surgery, Division of Pancreatic Surgery
| | - Yunqiang Cai
- Department of General Surgery, Division of Pancreatic Surgery
| | - Zhong Wu
- Department of General Surgery, Division of Pancreatic Surgery
| | - Ke Cheng
- Department of General Surgery, Division of Pancreatic Surgery
| | - He Cai
- Department of General Surgery, Division of Pancreatic Surgery
| | - Ming Tang
- Department of General Surgery, Division of Pancreatic Surgery
- West China School of Medicine, West China Hospital of Sichuan University
| | - Bing Peng
- Department of General Surgery, Division of Pancreatic Surgery
| | - Xin Wang
- Department of General Surgery, Division of Pancreatic Surgery
| |
Collapse
|
24
|
Lui TKL, Ko MKL, Liu JJ, Xiao X, Leung WK. Artificial intelligence-assisted real-time monitoring of effective withdrawal time during colonoscopy: a novel quality marker of colonoscopy. Gastrointest Endosc 2024; 99:419-427.e6. [PMID: 37858761 DOI: 10.1016/j.gie.2023.10.035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 10/06/2023] [Accepted: 10/11/2023] [Indexed: 10/21/2023]
Abstract
BACKGROUND AND AIMS The importance of withdrawal time during colonoscopy cannot be overstated in mitigating the risk of missed lesions and postcolonoscopy colorectal cancer. We evaluated a novel colonoscopy quality metric called the effective withdrawal time (EWT), which is an artificial intelligence (AI)-derived quantitative measure of quality withdrawal time, and its association with various colonic lesion detection rates as compared with standard withdrawal time (SWT). METHODS Three hundred fifty video recordings of colonoscopy withdrawal (from the cecum to the anus) were assessed by the new AI model. The primary outcome was adenoma detection rate (ADR) according to different quintiles of EWT. Multivariate logistic regression, adjusting for baseline covariates, was used to determine the adjusted odd ratios (ORs) for EWT on lesion detection rates, with the lowest quintile as reference. The area under the receiver-operating characteristic curve of EWT was compared with SWT. RESULTS The crude ADR in different quintiles of EWT, from lowest to highest, was 10.0%, 31.4%, 33.3%, 53.5%, and 85.7%. The ORs of detecting adenomas and polyps were significantly higher in all top 4 quintiles when compared with the lowest quintile. Each minute increase in EWT was associated with a 49% increase in ADR (aOR, 1.49; 95% confidence interval [CI], 1.36-1.65). The area under the receiver-operating characteristic curve of EWT was also significantly higher than SWT on adenoma detection (.80 [95% CI, .75-.84] vs .70 [95% CI, .64-.74], P < .01). CONCLUSIONS AI-derived monitoring of EWT is a promising novel quality indicator for colonoscopy, which is more associated with ADR than SWT.
Collapse
Affiliation(s)
- Thomas K L Lui
- Department of Medicine, Queen Mary Hospital, University of Hong Kong, Hong Kong, China
| | - Michael K L Ko
- Department of Medicine, Queen Mary Hospital, University of Hong Kong, Hong Kong, China
| | | | | | - Wai K Leung
- Department of Medicine, Queen Mary Hospital, University of Hong Kong, Hong Kong, China
| |
Collapse
|
25
|
Zhang H, Wu Q, Sun J, Wang J, Zhou L, Cai W, Zou D. A computer-aided system improves the performance of endoscopists in detecting colorectal polyps: a multi-center, randomized controlled trial. Front Med (Lausanne) 2024; 10:1341259. [PMID: 38327275 PMCID: PMC10847558 DOI: 10.3389/fmed.2023.1341259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 12/28/2023] [Indexed: 02/09/2024] Open
Abstract
Background Up to 45.9% of polyps are missed during colonoscopy, which is the major cause of post-colonoscopy colorectal cancer (CRC). Computer-aided detection (CADe) techniques based on deep learning might improve endoscopists' performance in detecting polyps. We aimed to evaluate the effectiveness of the CADe system in assisting endoscopists in a real-world clinical setting. Methods The CADe system was trained to detect colorectal polyps, recognize the ileocecal region, and monitor the speed of withdrawal during colonoscopy in real-time. Between 17 January 2021 and 16 July 2021. We recruited consecutive patients aged 18-75 years from three centers in China. We randomized patients in 1:1 groups to either colonoscopy with the CADe system or unassisted (control). The primary outcomes were the sensitivity and specificity of the endoscopists. We used subgroup analysis to examine the polyp detection rate (PDR) and the miss detection rate of endoscopists. Results A total of 1293 patients were included. The sensitivity of the endoscopists in the experimental group was significantly higher than that of the control group (84.97 vs. 72.07%, p < 0.001), and the specificity of the endoscopists in these two groups was comparable (100.00 vs. 100.00%). In a subgroup analysis, the CADe system improved the PDR of the 6-9 mm polyps (18.04 vs. 13.85%, p < 0.05) and reduced the miss detection rate, especially at 10:00-12:00 am (12.5 vs. 39.81%, p < 0.001). Conclusion The CADe system can potentially improve the sensitivity of endoscopists in detecting polyps, reduce the missed detection of polyps in colonoscopy, and reduce the risk of CRC. Registration This clinical trial was registered with the Chinese Clinical Trial Registry (Trial Registration Number: ChiCTR2100041988). Clinical trial registration website www.chictr.org.cn, identifier ChiCTR2100041988.
Collapse
Affiliation(s)
- Heng Zhang
- Department of Gastroenterology, The Central Hospital of Wuhan, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Qi Wu
- Endoscopy Center, Peking University Cancer Hospital and Institute, Beijing, China
| | - Jing Sun
- Department of Gastroenterology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jing Wang
- Endoscopy Center, Peking University Cancer Hospital and Institute, Beijing, China
| | - Lei Zhou
- Department of Gastroenterology, The Central Hospital of Wuhan, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Wei Cai
- Department of Gastrointestinal Surgery, The Central Hospital of Wuhan, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Duowu Zou
- Department of Gastroenterology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
26
|
Kim BS, Cho M, Chung GE, Lee J, Kang HY, Yoon D, Cho WS, Lee JC, Bae JH, Kong HJ, Kim S. Density clustering-based automatic anatomical section recognition in colonoscopy video using deep learning. Sci Rep 2024; 14:872. [PMID: 38195632 PMCID: PMC10776865 DOI: 10.1038/s41598-023-51056-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 12/29/2023] [Indexed: 01/11/2024] Open
Abstract
Recognizing anatomical sections during colonoscopy is crucial for diagnosing colonic diseases and generating accurate reports. While recent studies have endeavored to identify anatomical regions of the colon using deep learning, the deformable anatomical characteristics of the colon pose challenges for establishing a reliable localization system. This study presents a system utilizing 100 colonoscopy videos, combining density clustering and deep learning. Cascaded CNN models are employed to estimate the appendix orifice (AO), flexures, and "outside of the body," sequentially. Subsequently, DBSCAN algorithm is applied to identify anatomical sections. Clustering-based analysis integrates clinical knowledge and context based on the anatomical section within the model. We address challenges posed by colonoscopy images through non-informative removal preprocessing. The image data is labeled by clinicians, and the system deduces section correspondence stochastically. The model categorizes the colon into three sections: right (cecum and ascending colon), middle (transverse colon), and left (descending colon, sigmoid colon, rectum). We estimated the appearance time of anatomical boundaries with an average error of 6.31 s for AO, 9.79 s for HF, 27.69 s for SF, and 3.26 s for outside of the body. The proposed method can facilitate future advancements towards AI-based automatic reporting, offering time-saving efficacy and standardization.
Collapse
Grants
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- IITP-2023-2018-0-01833 the Ministry of Science and ICT, Korea under the Information Technology Research Center (ITRC) support program
Collapse
Affiliation(s)
- Byeong Soo Kim
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Minwoo Cho
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul, 03080, Korea
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, 03080, Korea
- Department of Medicine, Seoul National University College of Medicine, Seoul, 03080, Korea
| | - Goh Eun Chung
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Jooyoung Lee
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Hae Yeon Kang
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Dan Yoon
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Woo Sang Cho
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Jung Chan Lee
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, 03080, Korea
- Institute of Bioengineering, Seoul National University, Seoul, 08826, Republic of Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, 03080, Korea
| | - Jung Ho Bae
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea.
| | - Hyoun-Joong Kong
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul, 03080, Korea.
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, 03080, Korea.
- Department of Medicine, Seoul National University College of Medicine, Seoul, 03080, Korea.
- Medical Big Data Research Center, Seoul National University College of Medicine, Seoul, 03087, Korea.
| | - Sungwan Kim
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, 03080, Korea.
- Institute of Bioengineering, Seoul National University, Seoul, 08826, Republic of Korea.
- Artificial Intelligence Institute, Seoul National University, Research Park Building 942, 2 Fl., Seoul, 08826, Korea.
| |
Collapse
|
27
|
Troya J, Sudarevic B, Krenzer A, Banck M, Brand M, Walter BM, Puppe F, Zoller WG, Meining A, Hann A. Direct comparison of multiple computer-aided polyp detection systems. Endoscopy 2024; 56:63-69. [PMID: 37532115 PMCID: PMC10736101 DOI: 10.1055/a-2147-0571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 08/01/2023] [Indexed: 08/04/2023]
Abstract
BACKGROUND AND STUDY AIMS Artificial intelligence (AI)-based systems for computer-aided detection (CADe) of polyps receive regular updates and occasionally offer customizable detection thresholds, both of which impact their performance, but little is known about these effects. This study aimed to compare the performance of different CADe systems on the same benchmark dataset. METHODS 101 colonoscopy videos were used as benchmark. Each video frame with a visible polyp was manually annotated with bounding boxes, resulting in 129 705 polyp images. The videos were then analyzed by three different CADe systems, representing five conditions: two versions of GI Genius, Endo-AID with detection Types A and B, and EndoMind, a freely available system. Evaluation included an analysis of sensitivity and false-positive rate, among other metrics. RESULTS Endo-AID detection Type A, the earlier version of GI Genius, and EndoMind detected all 93 polyps. Both the later version of GI Genius and Endo-AID Type B missed 1 polyp. The mean per-frame sensitivities were 50.63 % and 67.85 %, respectively, for the earlier and later versions of GI Genius, 65.60 % and 52.95 %, respectively, for Endo-AID Types A and B, and 60.22 % for EndoMind. CONCLUSIONS This study compares the performance of different CADe systems, different updates, and different configuration modes. This might help clinicians to select the most appropriate system for their specific needs.
Collapse
Affiliation(s)
- Joel Troya
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
- Bavarian Cancer Research Center, Würzburg, Germany
| | - Boban Sudarevic
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
- Department of Internal Medicine and Gastroenterology, Katharinenhospital, Stuttgart, Germany
| | - Adrian Krenzer
- Artificial Intelligence and Knowledge Systems, Institute for Computer Science, Julius-Maximilians-Universität, Würzburg, Germany
| | - Michael Banck
- Artificial Intelligence and Knowledge Systems, Institute for Computer Science, Julius-Maximilians-Universität, Würzburg, Germany
| | - Markus Brand
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| | - Benjamin M. Walter
- Department of Internal Medicine I, University Hospital Ulm, Ulm, Germany
| | - Frank Puppe
- Artificial Intelligence and Knowledge Systems, Institute for Computer Science, Julius-Maximilians-Universität, Würzburg, Germany
| | - Wolfram G. Zoller
- Department of Internal Medicine and Gastroenterology, Katharinenhospital, Stuttgart, Germany
| | - Alexander Meining
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
- Bavarian Cancer Research Center, Würzburg, Germany
| | - Alexander Hann
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| |
Collapse
|
28
|
Yao L, Li X, Wu Z, Wang J, Luo C, Chen B, Luo R, Zhang L, Zhang C, Tan X, Lu Z, Zhu C, Huang Y, Tan T, Liu Z, Li Y, Li S, Yu H. Effect of artificial intelligence on novice-performed colonoscopy: a multicenter randomized controlled tandem study. Gastrointest Endosc 2024; 99:91-99.e9. [PMID: 37536635 DOI: 10.1016/j.gie.2023.07.044] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 07/21/2023] [Accepted: 07/22/2023] [Indexed: 08/05/2023]
Abstract
BACKGROUND AND AIMS The efficacy and safety of colonoscopy performed by artificial intelligence (AI)-assisted novices remain unknown. The aim of this study was to compare the lesion detection capability of novices, AI-assisted novices, and experts. METHODS This multicenter, randomized, noninferiority tandem study was conducted across 3 hospitals in China from May 1, 2022, to November 11, 2022. Eligible patients were randomized into 1 of 3 groups: the CN group (control novice group, withdrawal performed by a novice independently), the AN group (AI-assisted novice group, withdrawal performed by a novice with AI assistance), or the CE group (control expert group, withdrawal performed by an expert independently). Participants underwent a repeat colonoscopy conducted by an AI-assisted expert to evaluate the lesion miss rate and ensure lesion detection. The primary outcome was the adenoma miss rate (AMR). RESULTS A total of 685 eligible patients were analyzed: 229 in the CN group, 227 in the AN group, and 229 in the CE group. Both AMR and polyp miss rate were lower in the AN group than in the CN group (18.82% vs 43.69% [P < .001] and 21.23% vs 35.38% [P < .001], respectively). The noninferiority margin was met between the AN and CE groups of both AMR and polyp miss rate (18.82% vs 26.97% [P = .202] and 21.23% vs 24.10% [P < .249]). CONCLUSIONS AI-assisted colonoscopy lowered the AMR of novices, making them noninferior to experts. The withdrawal technique of new endoscopists can be enhanced by AI-assisted colonoscopy. (Clinical trial registration number: NCT05323279.).
Collapse
Affiliation(s)
- Liwen Yao
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xun Li
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Zhifeng Wu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Jing Wang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Chaijie Luo
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Boru Chen
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Renquan Luo
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Lihui Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Chenxia Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xia Tan
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Zihua Lu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Ci Zhu
- Digestive Endoscopy Center, Wuhan Eighth Hospital, Wuhan, China
| | - Yuan Huang
- Digestive Endoscopy Center, Wuhan Eighth Hospital, Wuhan, China
| | - Tao Tan
- Department of Endoscopy, The Third People's Hospital of Hubei Province, Wuhan, China
| | - Zhifeng Liu
- Department of Endoscopy, The Third People's Hospital of Hubei Province, Wuhan, China
| | - Ying Li
- Digestive Endoscopy Center, Wuhan Eighth Hospital, Wuhan, China
| | - Shuyu Li
- Department of Endoscopy, The Third People's Hospital of Hubei Province, Wuhan, China
| | - Honggang Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China; Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China; Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China.
| |
Collapse
|
29
|
Liu P, Wu J, He C, Wang W. ENDOANGEL versus water exchange for the detection of colorectal adenomas. Therap Adv Gastroenterol 2023; 16:17562848231218570. [PMID: 38116388 PMCID: PMC10729641 DOI: 10.1177/17562848231218570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/16/2023] [Accepted: 11/10/2023] [Indexed: 12/21/2023] Open
Abstract
Background Recently, the ENDOANGEL (EN) system, a computer-assisted detection technique, and water exchange (WE) assisted colonoscopy have both been shown to increase the colorectal adenoma detection rate (ADR). Objectives The aim of this study was to compare the ADR between EN- and WE-assisted colonoscopy. Design This was a retrospective study. Methods Data from patients who underwent either EN- or WE-assisted colonoscopy between October 2021 and August 2022 were analysed consecutively. The primary outcome measure was the ADR. Results The ADR was found to be similar between the EN and WE groups, with 80 out of 199 (40.2%) patients in the EN group compared to 78 out of 174 (44.8%) patients in the WE group [1.21; 95% confidence interval (CI), 0.80-1.83]. In the analysis using stabilized inverse probability treatment weighting after adjustment for confounding factors, both colonoscopy methods had similar performance in terms of ADR (1.41; 95% CI, 0.88-2.27). Conclusion EN was found to be comparable to WE in terms of ADR during colonoscopy, and both methods may be effectively used in clinical practice.
Collapse
Affiliation(s)
- Pengwei Liu
- Department of Gastroenterology, Yijishan Hospital of Wannan Medical College, Wuhu, China
| | - Jie Wu
- Department of Gastroenterology, Yijishan Hospital of Wannan Medical College, Wuhu, China
| | - Chiyi He
- Department of Gastroenterology, Yijishan Hospital of Wannan Medical College, No. 2 Zheshan West Road, Wuhu 241001, China
| | - Wei Wang
- Department of Gastroenterology, Yijishan Hospital of Wannan Medical College, No. 2 Zheshan West Road, Wuhu 241001, China
| |
Collapse
|
30
|
Moterani VC, Abbade JF, Borges VTM, Fonseca CGF, Desiderio N, Moterani Junior NJW, Gonçalves Moterani LBB. [Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extensionDiretrizes para protocolos de ensaios clínicos com intervenções que utilizam inteligência artificial: a extensão SPIRIT-AI]. Rev Panam Salud Publica 2023; 47:e149. [PMID: 38361499 PMCID: PMC10868409 DOI: 10.26633/rpsp.2023.149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Accepted: 07/23/2020] [Indexed: 01/10/2024] Open
Abstract
The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.
Collapse
Affiliation(s)
- Vinicius Cesar Moterani
- Universidade Estadual Paulista “Júlio de Mesquita Filho,”BotucatuBrazilUniversidade Estadual Paulista “Júlio de Mesquita Filho,” Botucatu, Brazil
| | - Joelcio Francisco Abbade
- Universidade Estadual Paulista “Júlio de Mesquita Filho,”BotucatuBrazilUniversidade Estadual Paulista “Júlio de Mesquita Filho,” Botucatu, Brazil
| | - Vera Therezinha Medeiros Borges
- Universidade Estadual Paulista “Júlio de Mesquita Filho,”BotucatuBrazilUniversidade Estadual Paulista “Júlio de Mesquita Filho,” Botucatu, Brazil
| | - Cecilia Guimarães Ferreira Fonseca
- Universidade Estadual Paulista “Júlio de Mesquita Filho,”BotucatuBrazilUniversidade Estadual Paulista “Júlio de Mesquita Filho,” Botucatu, Brazil
| | - Nathalia Desiderio
- Marilia Medical SchoolMariliaBrazilMarilia Medical School, Marilia, Brazil
| | | | | |
Collapse
|
31
|
Lou S, Du F, Song W, Xia Y, Yue X, Yang D, Cui B, Liu Y, Han P. Artificial intelligence for colorectal neoplasia detection during colonoscopy: a systematic review and meta-analysis of randomized clinical trials. EClinicalMedicine 2023; 66:102341. [PMID: 38078195 PMCID: PMC10698672 DOI: 10.1016/j.eclinm.2023.102341] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 11/14/2023] [Accepted: 11/15/2023] [Indexed: 05/11/2024] Open
Abstract
BACKGROUND The use of artificial intelligence (AI) in detecting colorectal neoplasia during colonoscopy holds the potential to enhance adenoma detection rates (ADRs) and reduce adenoma miss rates (AMRs). However, varied outcomes have been observed across studies. Thus, this study aimed to evaluate the potential advantages and disadvantages of employing AI-aided systems during colonoscopy. METHODS Using Medical Subject Headings (MeSH) terms and keywords, a comprehensive electronic literature search was performed of the Embase, Medline, and the Cochrane Library databases from the inception of each database until October 04, 2023, in order to identify randomized controlled trials (RCTs) comparing AI-assisted with standard colonoscopy for detecting colorectal neoplasia. Primary outcomes included AMR, ADR, and adenomas detected per colonoscopy (APC). Secondary outcomes comprised the poly missed detection rate (PMR), poly detection rate (PDR), and poly detected per colonoscopy (PPC). We utilized random-effects meta-analyses with Hartung-Knapp adjustment to consolidate results. The prediction interval (PI) and I2 statistics were utilized to quantify between-study heterogeneity. Moreover, meta-regression and subgroup analyses were performed to investigate the potential sources of heterogeneity. This systematic review and meta-analysis is registered with PROSPERO (CRD42023428658). FINDINGS This study encompassed 33 trials involving 27,404 patients. Those undergoing AI-aided colonoscopy experienced a significant decrease in PMR (RR, 0.475; 95% CI, 0.294-0.768; I2 = 87.49%) and AMR (RR, 0.495; 95% CI, 0.390-0.627; I2 = 48.76%). Additionally, a significant increase in PDR (RR, 1.238; 95% CI, 1.158-1.323; I2 = 81.67%) and ADR (RR, 1.242; 95% CI, 1.159-1.332; I2 = 78.87%), along with a significant increase in the rates of PPC (IRR, 1.388; 95% CI, 1.270-1.517; I2 = 91.99%) and APC (IRR, 1.390; 95% CI, 1.277-1.513; I2 = 86.24%), was observed. This resulted in 0.271 more PPCs (95% CI, 0.144-0.259; I2 = 65.61%) and 0.202 more APCs (95% CI, 0.144-0.259; I2 = 68.15%). INTERPRETATION AI-aided colonoscopy significantly enhanced the detection of colorectal neoplasia detection, likely by reducing the miss rate. However, future studies should focus on evaluating the cost-effectiveness and long-term benefits of AI-aided colonoscopy in reducing cancer incidence. FUNDING This work was supported by the Heilongjiang Provincial Natural Science Foundation of China (LH2023H096), the Postdoctoral research project in Heilongjiang Province (LBH-Z22210), the National Natural Science Foundation of China's General Program (82072640) and the Outstanding Youth Project of Heilongjiang Natural Science Foundation (YQ2021H023).
Collapse
Affiliation(s)
- Shenghan Lou
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Fenqi Du
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Wenjie Song
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Yixiu Xia
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Xinyu Yue
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Da Yang
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Binbin Cui
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Yanlong Liu
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Peng Han
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
- Key Laboratory of Tumor Immunology in Heilongjiang, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| |
Collapse
|
32
|
Lux TJ, Saßmannshausen Z, Kafetzis I, Sodmann P, Herold K, Sudarevic B, Schmitz R, Zoller WG, Meining A, Hann A. Assisted documentation as a new focus for artificial intelligence in endoscopy: the precedent of reliable withdrawal time and image reporting. Endoscopy 2023; 55:1118-1123. [PMID: 37399844 PMCID: PMC11321719 DOI: 10.1055/a-2122-1671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Accepted: 06/30/2023] [Indexed: 07/05/2023]
Abstract
BACKGROUND : Reliable documentation is essential for maintaining quality standards in endoscopy; however, in clinical practice, report quality varies. We developed an artificial intelligence (AI)-based prototype for the measurement of withdrawal and intervention times, and automatic photodocumentation. METHOD: A multiclass deep learning algorithm distinguishing different endoscopic image content was trained with 10 557 images (1300 examinations, nine centers, four processors). Consecutively, the algorithm was used to calculate withdrawal time (AI prediction) and extract relevant images. Validation was performed on 100 colonoscopy videos (five centers). The reported and AI-predicted withdrawal times were compared with video-based measurement; photodocumentation was compared for documented polypectomies. RESULTS: Video-based measurement in 100 colonoscopies revealed a median absolute difference of 2.0 minutes between the measured and reported withdrawal times, compared with 0.4 minutes for AI predictions. The original photodocumentation represented the cecum in 88 examinations compared with 98/100 examinations for the AI-generated documentation. For 39/104 polypectomies, the examiners' photographs included the instrument, compared with 68 for the AI images. Lastly, we demonstrated real-time capability (10 colonoscopies). CONCLUSION : Our AI system calculates withdrawal time, provides an image report, and is real-time ready. After further validation, the system may improve standardized reporting, while decreasing the workload created by routine documentation.
Collapse
Affiliation(s)
- Thomas J. Lux
- Interventional and Experimental Endoscopy (InExEn), Internal Medicine II,
University Hospital Würzburg, Würzburg, Germany
| | - Zita Saßmannshausen
- Interventional and Experimental Endoscopy (InExEn), Internal Medicine II,
University Hospital Würzburg, Würzburg, Germany
| | - Ioannis Kafetzis
- Interventional and Experimental Endoscopy (InExEn), Internal Medicine II,
University Hospital Würzburg, Würzburg, Germany
| | - Philipp Sodmann
- Interventional and Experimental Endoscopy (InExEn), Internal Medicine II,
University Hospital Würzburg, Würzburg, Germany
| | - Katja Herold
- Interventional and Experimental Endoscopy (InExEn), Internal Medicine II,
University Hospital Würzburg, Würzburg, Germany
| | - Boban Sudarevic
- Interventional and Experimental Endoscopy (InExEn), Internal Medicine II,
University Hospital Würzburg, Würzburg, Germany
- Department of Internal Medicine and Gastroenterology, Katharinenhospital,
Stuttgart, Germany
| | - Rüdiger Schmitz
- Department for Interdisciplinary Endoscopy; Department of Internal Medicine I;
and Department of Computational Neuroscience, University Hospital Hamburg - Eppendorf,
Hamburg, Germany
| | - Wolfram G. Zoller
- Department of Internal Medicine and Gastroenterology, Katharinenhospital,
Stuttgart, Germany
| | - Alexander Meining
- Interventional and Experimental Endoscopy (InExEn), Internal Medicine II,
University Hospital Würzburg, Würzburg, Germany
| | - Alexander Hann
- Interventional and Experimental Endoscopy (InExEn), Internal Medicine II,
University Hospital Würzburg, Würzburg, Germany
| |
Collapse
|
33
|
Susanto AP, Lyell D, Widyantoro B, Berkovsky S, Magrabi F. Effects of machine learning-based clinical decision support systems on decision-making, care delivery, and patient outcomes: a scoping review. J Am Med Inform Assoc 2023; 30:2050-2063. [PMID: 37647865 PMCID: PMC10654852 DOI: 10.1093/jamia/ocad180] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 08/01/2023] [Accepted: 08/23/2023] [Indexed: 09/01/2023] Open
Abstract
OBJECTIVE This study aims to summarize the research literature evaluating machine learning (ML)-based clinical decision support (CDS) systems in healthcare settings. MATERIALS AND METHODS We conducted a review in accordance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta Analyses extension for Scoping Review). Four databases, including PubMed, Medline, Embase, and Scopus were searched for studies published from January 2016 to April 2021 evaluating the use of ML-based CDS in clinical settings. We extracted the study design, care setting, clinical task, CDS task, and ML method. The level of CDS autonomy was examined using a previously published 3-level classification based on the division of clinical tasks between the clinician and CDS; effects on decision-making, care delivery, and patient outcomes were summarized. RESULTS Thirty-two studies evaluating the use of ML-based CDS in clinical settings were identified. All were undertaken in developed countries and largely in secondary and tertiary care settings. The most common clinical tasks supported by ML-based CDS were image recognition and interpretation (n = 12) and risk assessment (n = 9). The majority of studies examined assistive CDS (n = 23) which required clinicians to confirm or approve CDS recommendations for risk assessment in sepsis and for interpreting cancerous lesions in colonoscopy. Effects on decision-making, care delivery, and patient outcomes were mixed. CONCLUSION ML-based CDS are being evaluated in many clinical areas. There remain many opportunities to apply and evaluate effects of ML-based CDS on decision-making, care delivery, and patient outcomes, particularly in resource-constrained settings.
Collapse
Affiliation(s)
- Anindya Pradipta Susanto
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia
- Faculty of Medicine, Universitas Indonesia, Jakarta, DKI Jakarta 10430, Indonesia
| | - David Lyell
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia
| | - Bambang Widyantoro
- Faculty of Medicine, Universitas Indonesia, Jakarta, DKI Jakarta 10430, Indonesia
- National Cardiovascular Center Harapan Kita Hospital, Jakarta, DKI Jakarta 11420, Indonesia
| | - Shlomo Berkovsky
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia
| | - Farah Magrabi
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia
| |
Collapse
|
34
|
Zhang S, Zhao S, Bai Y. New Quality Indicators for Colonoscopy: More Issues Should Be Addressed. Clin Gastroenterol Hepatol 2023; 21:3196. [PMID: 36720298 DOI: 10.1016/j.cgh.2023.01.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Accepted: 01/09/2023] [Indexed: 02/02/2023]
Affiliation(s)
- Song Zhang
- Department of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, China
| | - Shengbing Zhao
- Department of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, China
| | - Yu Bai
- Department of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, China
| |
Collapse
|
35
|
Hsu WF, Chiu HM. Optimization of colonoscopy quality: Comprehensive review of the literature and future perspectives. Dig Endosc 2023; 35:822-834. [PMID: 37381701 DOI: 10.1111/den.14627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/14/2023] [Accepted: 06/27/2023] [Indexed: 06/30/2023]
Abstract
Colonoscopy is crucial in preventing colorectal cancer (CRC) and reducing associated mortality. This comprehensive review examines the importance of high-quality colonoscopy and associated quality indicators, including bowel preparation, cecal intubation rate, withdrawal time, adenoma detection rate (ADR), complete resection, specimen retrieval, complication rates, and patient satisfaction, while also discussing other ADR-related metrics. Additionally, the review draws attention to often overlooked quality aspects, such as nonpolypoid lesion detection, as well as insertion and withdrawal skills. Moreover, it explores the potential of artificial intelligence in enhancing colonoscopy quality and highlights specific considerations for organized screening programs. The review also emphasizes the implications of organized screening programs and the need for continuous quality improvement. A high-quality colonoscopy is crucial for preventing postcolonoscopy CRC- and CRC-related deaths. Health-care professionals must develop a thorough understanding of colonoscopy quality components, including technical quality, patient safety, and patient experience. By prioritizing ongoing evaluation and refinement of these quality indicators, health-care providers can contribute to improved patient outcomes and develop more effective CRC screening programs.
Collapse
Affiliation(s)
- Wen-Feng Hsu
- Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Han-Mo Chiu
- Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan
| |
Collapse
|
36
|
Wu HL, Yao LW, Shi HY, Wu LL, Li X, Zhang CX, Chen BR, Zhang J, Tan W, Cui N, Zhou W, Zhang JX, Xiao B, Gong RR, Ding Z, Yu HG. Validation of a real-time biliopancreatic endoscopic ultrasonography analytical device in China: a prospective, single-centre, randomised, controlled trial. Lancet Digit Health 2023; 5:e812-e820. [PMID: 37775472 DOI: 10.1016/s2589-7500(23)00160-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 06/16/2023] [Accepted: 08/09/2023] [Indexed: 10/01/2023]
Abstract
BACKGROUND Endoscopic ultrasonography (EUS) is a key procedure for the diagnosis of biliopancreatic diseases. However, the performance among EUS endoscopists varies greatly and leads to blind spots during the operation, which can impair the health outcomes of patients. We previously developed an artificial intelligence (AI) device that accurately identified EUS standard stations and significantly reduced the difficulty of ultrasonography image interpretation. In this study, we updated the device (named EUS-IREAD) and validated its performance in improving the quality of EUS procedures. METHODS In this single-centre, randomised, controlled trial, we updated EUS-IREAD so it consisted of five learning models to identify eight EUS stations and 24 anatomical structures. The trial was done at the Renmin Hospital of Wuhan University (Wuhan, China) and included patients aged 18 years or older with suspected biliopancreatic (pancreas and biliopancreatic duct) lesions due to clinical symptoms, radiological findings, or laboratory findings, and with a high risk of pancreatic cancer. Patients were randomly assigned (1:1) by a dedicated research assistant using a computer-generated random number series (with a block size of four) to undergo the EUS procedure with or without the assistance of EUS-IREAD. Endoscopists in the EUS-IREAD-assisted group were required to observe all standard stations and anatomical structures according to the prompts by the AI device. Data collectors, the independent data anaylsis team, and patients were masked to group allocation. The primary outcome was the missed scanning rate of standard stations between the two groups, which was assessed in patients who underwent EUS procedure in accordance with the assigned intervention (per protocol). This trial is registered with ClinicalTrials.gov, NCT05457101. FINDINGS Between July 9, 2022, and Feb 28, 2023, 290 patients (mean age 55·93 years [SD 14·06], 152 [52%] male, and 138 [48%] female) were randomly assigned and analysed, including 144 in the EUS-IREAD-assisted group and 146 in the control group. The EUS-IREAD-assisted group had a lower missed scanning rate of stations than the control group (4·5% [SD 0·8] vs 14·3% [1·0], -9·8% [95% CI -12·2 to -7·5]; odds ratio 3·6 [95% Cl 2·6 to 4·9]; p<0·0001). No significant adverse event was found during the study. INTERPRETATION Our study confirms the capability of EUS-IREAD to monitor the blind spots and reduce the missed rate of stations and structures during EUS procedures. The EUS-IREAD has the potential to play an essential part in EUS quality control. FUNDING Innovation Team Project of Health Commission of Hubei Province and College-enterprise Deepening Reform Project of Wuhan University.
Collapse
Affiliation(s)
- Hui Ling Wu
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Li Wen Yao
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Hui Ying Shi
- Department of Gastroenterology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Lian Lian Wu
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xun Li
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Chen Xia Zhang
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Bo Ru Chen
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Jun Zhang
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Wei Tan
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Ning Cui
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Wei Zhou
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Ji Xiang Zhang
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Bing Xiao
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Rong Rong Gong
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Zhen Ding
- Endoscopy Center, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China.
| | - Hong Gang Yu
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China.
| |
Collapse
|
37
|
Ding M, Yan J, Chao G, Zhang S. Application of artificial intelligence in colorectal cancer screening by colonoscopy: Future prospects (Review). Oncol Rep 2023; 50:199. [PMID: 37772392 DOI: 10.3892/or.2023.8636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 07/07/2023] [Indexed: 09/30/2023] Open
Abstract
Colorectal cancer (CRC) has become a severe global health concern, with the third‑high incidence and second‑high mortality rate of all cancers. The burden of CRC is expected to surge to 60% by 2030. Fortunately, effective early evidence‑based screening could significantly reduce the incidence and mortality of CRC. Colonoscopy is the core screening method for CRC with high popularity and accuracy. Yet, the accuracy of colonoscopy in CRC screening is related to the experience and state of operating physicians. It is challenging to maintain the high CRC diagnostic rate of colonoscopy. Artificial intelligence (AI)‑assisted colonoscopy will compensate for the above shortcomings and improve the accuracy, efficiency, and quality of colonoscopy screening. The unique advantages of AI, such as the continuous advancement of high‑performance computing capabilities and innovative deep‑learning architectures, which hugely impact the control of colorectal cancer morbidity and mortality expectancy, highlight its role in colonoscopy screening.
Collapse
Affiliation(s)
- Menglu Ding
- The Second Affiliated Hospital of Zhejiang Chinese Medical University (The Xin Hua Hospital of Zhejiang Province), Hangzhou, Zhejiang 310000, P.R. China
| | - Junbin Yan
- The Second Affiliated Hospital of Zhejiang Chinese Medical University (The Xin Hua Hospital of Zhejiang Province), Hangzhou, Zhejiang 310000, P.R. China
| | - Guanqun Chao
- Department of General Practice, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, Zhejiang 310000, P.R. China
| | - Shuo Zhang
- The Second Affiliated Hospital of Zhejiang Chinese Medical University (The Xin Hua Hospital of Zhejiang Province), Hangzhou, Zhejiang 310000, P.R. China
| |
Collapse
|
38
|
Sekiguchi M, Igarashi A, Toyoshima N, Takamaru H, Yamada M, Esaki M, Kobayashi N, Saito Y. Cost-effectiveness analysis of computer-aided detection systems for colonoscopy in Japan. Dig Endosc 2023; 35:891-899. [PMID: 36752676 DOI: 10.1111/den.14532] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Accepted: 02/05/2023] [Indexed: 02/09/2023]
Abstract
OBJECTIVES The usefulness of computer-aided detection systems (CADe) for colonoscopy has been increasingly reported. In many countries, however, data on the cost-effectiveness of their use are lacking; consequently, CADe for colonoscopy has not been covered by health insurance. We aimed to evaluate the cost-effectiveness of colonoscopy using CADe in Japan. METHODS We conducted a simulation model analysis using Japanese data to examine the cost-effectiveness of colonoscopy with and without CADe for a population aged 40-74 years who received colorectal cancer (CRC) screening with a fecal immunochemical test (FIT). The rates of receiving FIT screening and colonoscopy following a positive FIT were set as 40% and 70%, respectively. The sensitivities of FIT for advanced adenomas and CRC Dukes' A-D were 26.5% and 52.8-78.3%, respectively. CADe colonoscopy was judged to be cost-effective when its incremental cost-effectiveness ratio (ICER) was below JPY 5,000,000 per quality-adjusted life-years (QALYs) gained. RESULTS Compared to conventional colonoscopy, CADe colonoscopy showed a higher QALY (20.4098 vs. 20.4088) and lower CRC incidence (2373 vs. 2415 per 100,000) and mortality (561 vs. 569 per 100,000). When the CADe cost was set at JPY 1000-6000, the ICER per QALY gained for CADe colonoscopy was lower than JPY 5,000,000 (JPY 796,328-4,971,274). The CADe cost threshold at which the ICER for CADe colonoscopy exceeded JPY 5,000,000 was JPY 6040. CONCLUSIONS Computer-aided detection systems for colonoscopy has the potential to be cost-effective when the CADe cost is up to JPY 6000. These results suggest that the insurance reimbursement of CADe for colonoscopy is reasonable.
Collapse
Affiliation(s)
- Masau Sekiguchi
- Cancer Screening Center, National Cancer Center Hospital, Tokyo, Japan
- Endoscopy Division, National Cancer Center Hospital, Tokyo, Japan
- Division of Screening Technology, National Cancer Center Institute for Cancer Control, Tokyo, Japan
| | - Ataru Igarashi
- Department of Health Economics and Outcomes Research, Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, Japan
- Department of Public Health, Yokohama City University School of Medicine, Kanagawa, Japan
| | - Naoya Toyoshima
- Endoscopy Division, National Cancer Center Hospital, Tokyo, Japan
| | | | - Masayoshi Yamada
- Endoscopy Division, National Cancer Center Hospital, Tokyo, Japan
| | - Minoru Esaki
- Hepatobiliary and Pancreatic Surgery Division, National Cancer Center Hospital, Tokyo, Japan
| | - Nozomu Kobayashi
- Cancer Screening Center, National Cancer Center Hospital, Tokyo, Japan
- Endoscopy Division, National Cancer Center Hospital, Tokyo, Japan
- Division of Screening Technology, National Cancer Center Institute for Cancer Control, Tokyo, Japan
| | - Yutaka Saito
- Endoscopy Division, National Cancer Center Hospital, Tokyo, Japan
| |
Collapse
|
39
|
Leśniewska M, Patryn R, Kopystecka A, Kozioł I, Budzyńska J. Third Eye? The Assistance of Artificial Intelligence (AI) in the Endoscopy of Gastrointestinal Neoplasms. J Clin Med 2023; 12:6721. [PMID: 37959187 PMCID: PMC10650785 DOI: 10.3390/jcm12216721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 10/19/2023] [Accepted: 10/21/2023] [Indexed: 11/15/2023] Open
Abstract
Gastrointestinal cancers are characterized by high incidence and mortality. However, there are well-established methods of screening. The endoscopy exam provides the macroscopical image and enables harvesting the tissue samples for further histopathological diagnosis. The efficiency of endoscopies relies not only on proper patient preparation, but also on the skills of the personnel conducting the exam. In recent years, a number of reports concerning the application of artificial intelligence (AI) in medicine have arisen. Numerous studies aimed to assess the utility of deep learning/ neural network systems supporting endoscopies. In this review, we summarized the most recent reports and randomized clinical trials regarding the application of AI in screening and surveillance of gastrointestinal cancers among patients suffering from esophageal, gastric, and colorectal cancer, along with the advantages, limitations, and controversies of those novel solutions.
Collapse
Affiliation(s)
- Magdalena Leśniewska
- Students’ Scientific Circle on Medical Law at the Department of Humanities and Social Medicine, Medical University of Lublin, 20-093 Lublin, Poland; (M.L.); (A.K.); (I.K.); (J.B.)
| | - Rafał Patryn
- Department of Humanities and Social Medicine, Medical University of Lublin, 20-093 Lublin, Poland
| | - Agnieszka Kopystecka
- Students’ Scientific Circle on Medical Law at the Department of Humanities and Social Medicine, Medical University of Lublin, 20-093 Lublin, Poland; (M.L.); (A.K.); (I.K.); (J.B.)
| | - Ilona Kozioł
- Students’ Scientific Circle on Medical Law at the Department of Humanities and Social Medicine, Medical University of Lublin, 20-093 Lublin, Poland; (M.L.); (A.K.); (I.K.); (J.B.)
| | - Julia Budzyńska
- Students’ Scientific Circle on Medical Law at the Department of Humanities and Social Medicine, Medical University of Lublin, 20-093 Lublin, Poland; (M.L.); (A.K.); (I.K.); (J.B.)
| |
Collapse
|
40
|
Park JJ, Doiphode N, Zhang X, Pan L, Blue R, Shi J, Buch VP. Developing the surgeon-machine interface: using a novel instance-segmentation framework for intraoperative landmark labelling. Front Surg 2023; 10:1259756. [PMID: 37936949 PMCID: PMC10626480 DOI: 10.3389/fsurg.2023.1259756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 09/20/2023] [Indexed: 11/09/2023] Open
Abstract
Introduction The utilisation of artificial intelligence (AI) augments intraoperative safety, surgical training, and patient outcomes. We introduce the term Surgeon-Machine Interface (SMI) to describe this innovative intersection between surgeons and machine inference. A custom deep computer vision (CV) architecture within a sparse labelling paradigm was developed, specifically tailored to conceptualise the SMI. This platform demonstrates the ability to perform instance segmentation on anatomical landmarks and tools from a single open spinal dural arteriovenous fistula (dAVF) surgery video dataset. Methods Our custom deep convolutional neural network was based on SOLOv2 architecture for precise, instance-level segmentation of surgical video data. Test video consisted of 8520 frames, with sparse labelling of only 133 frames annotated for training. Accuracy and inference time, assessed using F1-score and mean Average Precision (mAP), were compared against current state-of-the-art architectures on a separate test set of 85 additionally annotated frames. Results Our SMI demonstrated superior accuracy and computing speed compared to these frameworks. The F1-score and mAP achieved by our platform were 17% and 15.2% respectively, surpassing MaskRCNN (15.2%, 13.9%), YOLOv3 (5.4%, 11.9%), and SOLOv2 (3.1%, 10.4%). Considering detections that exceeded the Intersection over Union threshold of 50%, our platform achieved an impressive F1-score of 44.2% and mAP of 46.3%, outperforming MaskRCNN (41.3%, 43.5%), YOLOv3 (15%, 34.1%), and SOLOv2 (9%, 32.3%). Our platform demonstrated the fastest inference time (88ms), compared to MaskRCNN (90ms), SOLOV2 (100ms), and YOLOv3 (106ms). Finally, the minimal amount of training set demonstrated a good generalisation performance -our architecture successfully identified objects in a frame that were not included in the training or validation frames, indicating its ability to handle out-of-domain scenarios. Discussion We present our development of an innovative intraoperative SMI to demonstrate the future promise of advanced CV in the surgical domain. Through successful implementation in a microscopic dAVF surgery, our framework demonstrates superior performance over current state-of-the-art segmentation architectures in intraoperative landmark guidance with high sample efficiency, representing the most advanced AI-enabled surgical inference platform to date. Our future goals include transfer learning paradigms for scaling to additional surgery types, addressing clinical and technical limitations for performing real-time decoding, and ultimate enablement of a real-time neurosurgical guidance platform.
Collapse
Affiliation(s)
- Jay J. Park
- Department of Neurosurgery, The Surgical Innovation and Machine Interfacing (SIMI) Lab, Stanford University School of Medicine, Stanford, CA, United States
- Centre for Global Health, Usher Institute, Edinburgh Medical School, The University of Edinburgh, Edinburgh, United Kingdom
| | - Nehal Doiphode
- Department of Neurosurgery, The Surgical Innovation and Machine Interfacing (SIMI) Lab, Stanford University School of Medicine, Stanford, CA, United States
- Department of Computer and Information Science, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States
| | - Xiao Zhang
- Department of Computer Science, University of Chicago, Chicago, IL, United States
| | - Lishuo Pan
- Department of Computer Science, Brown University, Providence, RI, United States
| | - Rachel Blue
- Department of Neurosurgery, Perelman School of Medicine at The University of Pennsylvania, Philadelphia, PA, United States
| | - Jianbo Shi
- Department of Computer and Information Science, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States
| | - Vivek P. Buch
- Department of Neurosurgery, The Surgical Innovation and Machine Interfacing (SIMI) Lab, Stanford University School of Medicine, Stanford, CA, United States
| |
Collapse
|
41
|
Wu Z, Yao L, Liu W, Zhang S, Zhang L, Lu Z, Wang J, Chen B, Luo R, Li X, Gong R, Luo C, Xu Y, Zeng Z, Yu H. Development and Validation of a Deep Learning-Based Histologic Diagnosis System for Diagnosing Colorectal Sessile Serrated Lesions. Am J Clin Pathol 2023; 160:394-403. [PMID: 37279532 DOI: 10.1093/ajcp/aqad058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2022] [Accepted: 05/01/2023] [Indexed: 06/08/2023] Open
Abstract
OBJECTIVES The histopathologic diagnosis of colorectal sessile serrated lesions (SSLs) and hyperplastic polyps (HPs) is of low consistency among pathologists. This study aimed to develop and validate a deep learning (DL)-based logical anthropomorphic pathology diagnostic system (LA-SSLD) for the differential diagnosis of colorectal SSL and HP. METHODS The diagnosis framework of the LA-SSLD system was constructed according to the current guidelines and consisted of 4 DL models. Deep convolutional neural network (DCNN) 1 was the mucosal layer segmentation model, DCNN 2 was the muscularis mucosa segmentation model, DCNN 3 was the glandular lumen segmentation model, and DCNN 4 was the glandular lumen classification (aberrant or regular) model. A total of 175 HP and 127 SSL sections were collected from Renmin Hospital of Wuhan University during November 2016 to November 2022. The performance of the LA-SSLD system was compared to 11 pathologists with different qualifications through the human-machine contest. RESULTS The Dice scores of DCNNs 1, 2, and 3 were 93.66%, 58.38%, and 74.04%, respectively. The accuracy of DCNN 4 was 92.72%. In the human-machine contest, the accuracy, sensitivity, and specificity of the LA-SSLD system were 85.71%, 86.36%, and 85.00%, respectively. In comparison with experts (pathologist D: accuracy 83.33%, sensitivity 90.91%, specificity 75.00%; pathologist E: accuracy 85.71%, sensitivity 90.91%, specificity 80.00%), LA-SSLD achieved expert-level accuracy and outperformed all the senior and junior pathologists. CONCLUSIONS This study proposed a logical anthropomorphic diagnostic system for the differential diagnosis of colorectal SSL and HP. The diagnostic performance of the system is comparable to that of experts and has the potential to become a powerful diagnostic tool for SSL in the future. It is worth mentioning that a logical anthropomorphic system can achieve expert-level accuracy with fewer samples, providing potential ideas for the development of other artificial intelligence models.
Collapse
Affiliation(s)
- Zhifeng Wu
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Liwen Yao
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Wen Liu
- Department of Pathology, Renmin Hospital of Wuhan University, Wuhan, China
| | - Shiying Zhang
- Department of Pathology, Renmin Hospital of Wuhan University, Wuhan, China
| | - Lihui Zhang
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Zihua Lu
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Jing Wang
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Boru Chen
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Renquan Luo
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Xun Li
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Rongrong Gong
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Chaijie Luo
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Youming Xu
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| | - Zhi Zeng
- Department of Pathology, Renmin Hospital of Wuhan University, Wuhan, China
| | - Honggang Yu
- Department of Gastroenterology, Key Laboratory of Hubei Province for Digestive System Disease, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision
| |
Collapse
|
42
|
Mizukami K, Fushimi E, Sagami R, Abe T, Sato T, Terashi S, Fukuda M, Nishikiori H, Nagai T, Kodama M, Murakami K. Usefulness of AI-Equipped Endoscopy for Detecting Colorectal Adenoma during Colonoscopy Screening: Confirm That Colon Neoplasm Finely Can Be Identified by AI without Overlooking Study (Confidential Study). J Clin Med 2023; 12:6332. [PMID: 37834976 PMCID: PMC10573595 DOI: 10.3390/jcm12196332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 09/28/2023] [Accepted: 09/30/2023] [Indexed: 10/15/2023] Open
Abstract
In the present prospective case series study, we investigated the lesion-detection ability of an AI-equipped colonoscopy as an addition to colonoscopy (CS) screening. Participants were 100 patients aged ≥20 years who had not undergone CS at the study site in the last 3 years and passed the exclusion criteria. CS procedures were conducted using conventional white light imaging and computer-aided detection (CADe). Adenoma detection rate (ADR; number of individuals with at least one adenoma detected) was compared between the conventional group and the CADe group. Of the 170 lesions identified, the ADR of the CADe group was significantly higher than the ADR of the conventional group (69% vs. 61%, p = 0.008). For the expert endoscopists, although ADR did not differ significantly, the mean number of detected adenomas per procedure (MAP) was significantly higher in the CADe group than in the conventional group (1.7 vs. 1.45, p = 0.034). For non-expert endoscopists, ADR and MAP were significantly higher in the CADe group than in the conventional group (ADR 69.5% vs. 56.6%, p = 0.016; MAP 1.66 vs. 1.11, p < 0.001). These results indicate that the CADe function in CS screening has a positive effect on adenoma detection, especially for non-experts.
Collapse
Affiliation(s)
- Kazuhiro Mizukami
- Department of Gastroenterology, Faculty of Medicine, Oita University, 1-1, Idaigaoka, Hasama, Yufu, Oita 879-5593, Japan
| | - Erina Fushimi
- Department of Gastroenterology, Faculty of Medicine, Oita University, 1-1, Idaigaoka, Hasama, Yufu, Oita 879-5593, Japan
| | - Ryota Sagami
- Department of Gastroenterology, Oita San-ai Medical Center, 1213 Ichi, Oita 870-1151, Japan
| | - Takashi Abe
- Department of Gastroenterology, Oita Koseiren Tsurumi Hospital, 4333, Tsurumi, Beppu, Oita 874-8585, Japan
| | - Takao Sato
- Department of Gastroenterology, Oita San-ai Medical Center, 1213 Ichi, Oita 870-1151, Japan
| | - Shohei Terashi
- Department of Gastroenterology, Oita Koseiren Tsurumi Hospital, 4333, Tsurumi, Beppu, Oita 874-8585, Japan
| | - Masahide Fukuda
- Department of Gastroenterology, Faculty of Medicine, Oita University, 1-1, Idaigaoka, Hasama, Yufu, Oita 879-5593, Japan
| | - Hidefumi Nishikiori
- Department of Gastroenterology, Oita San-ai Medical Center, 1213 Ichi, Oita 870-1151, Japan
| | - Takayuki Nagai
- Department of Gastroenterology, Oita Koseiren Tsurumi Hospital, 4333, Tsurumi, Beppu, Oita 874-8585, Japan
| | - Masaaki Kodama
- Department of Advanced Medical Sciences, Faculty of Medicine, Oita University, 1-1, Idaigaoka, Hasama, Yufu, Oita 879-5593, Japan
| | - Kazunari Murakami
- Department of Gastroenterology, Faculty of Medicine, Oita University, 1-1, Idaigaoka, Hasama, Yufu, Oita 879-5593, Japan
| |
Collapse
|
43
|
Sung JJY, Savulescu J, Ngiam KY, An B, Ang TL, Yeoh KG, Cham TJ, Tsao S, Chua TS. Artificial intelligence for gastroenterology: Singapore artificial intelligence for Gastroenterology Working Group Position Statement. J Gastroenterol Hepatol 2023; 38:1669-1676. [PMID: 37277693 DOI: 10.1111/jgh.16241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/12/2023] [Revised: 05/10/2023] [Accepted: 05/11/2023] [Indexed: 06/07/2023]
Abstract
BACKGROUND Successful implementation of artificial intelligence in gastroenterology and hepatology practice requires more than technology. There are ethical, legal, and social issues that need to be settled. AIM A group consisting of AI developers (engineer), AI users (gastroenterologist, hepatologist, and surgeon) and AI regulators (ethicist and administrator) formed a Working Group to draft these Positions Statements with the objective of arousing public and professional interest and dialogue, to promote ethical considerations when implementing AI technology, to suggest to policy makers and health authorities relevant factors to take into account when approving and regulating the use of AI tools, and to engage the profession in preparing for change in clinical practice. STATEMENTS These series of Position Statements point out the salient issues to maintain the trust between care provider and care receivers, and to legitimize the use of a non-human tool in healthcare delivery. It is based on fundamental principles such as respect, autonomy, privacy, responsibility, and justice. Enforcing the use of AI without considering these factor risk damaging the doctor-patient relationship.
Collapse
Affiliation(s)
- Joseph J Y Sung
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Julian Savulescu
- Centre for Biomedical Ethics, National University of Singapore, Singapore
| | - K Y Ngiam
- Department of Surgery, National University Hospital, Singapore
| | - Bo An
- School of Computer Science and Engineering, Nanyang Technological University, Singapore
| | - Tiing Leong Ang
- Singapore Health Service, Changi General Hospital, Singapore
| | - K G Yeoh
- Department of Medicine, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- Department of Gastroenterology and Hepatology, National University Hospital, National University Health System, Singapore
| | - Tat-Jen Cham
- School of Computer Science and Engineering, Nanyang Technological University, Singapore
| | - Stephen Tsao
- National Healthcare Group, Tan Tock Seng Hospital Singapore, Singapore
- Gastroenterological Society of Singapore, Singapore
| | - T S Chua
- Gastroenterology Chapter, Academy of Medicine, Singapore
| |
Collapse
|
44
|
Tham S, Koh FH, Ladlad J, Chue KM, Lin CL, Teo EK, Foo FJ. The imitation game: a review of the use of artificial intelligence in colonoscopy, and endoscopists' perceptions thereof. Ann Coloproctol 2023; 39:385-394. [PMID: 36907170 PMCID: PMC10626328 DOI: 10.3393/ac.2022.00878.0125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 12/22/2022] [Accepted: 01/09/2023] [Indexed: 03/14/2023] Open
Abstract
The development of deep learning systems in artificial intelligence (AI) has enabled advances in endoscopy, and AI-aided colonoscopy has recently been ushered into clinical practice as a clinical decision-support tool. This has enabled real-time AI-aided detection of polyps with a higher sensitivity than the average endoscopist, and evidence to support its use has been promising thus far. This review article provides a summary of currently published data relating to AI-aided colonoscopy, discusses current clinical applications, and introduces ongoing research directions. We also explore endoscopists' perceptions and attitudes toward the use of this technology, and discuss factors influencing its uptake in clinical practice.
Collapse
Affiliation(s)
- Sarah Tham
- Department of General Surgery, Sengkang General Hospital, SingHealth Services, Singapore
| | - Frederick H. Koh
- Colorectal Service, Department of General Surgery, Sengkang General Hospital, SingHealth Services, Singapore
- SKH Endoscopy Centre, Division of Hyperacute Care, Sengkang General Hospital, SingHealth Services, Singapore
| | - Jasmine Ladlad
- Colorectal Service, Department of General Surgery, Sengkang General Hospital, SingHealth Services, Singapore
- SKH Endoscopy Centre, Division of Hyperacute Care, Sengkang General Hospital, SingHealth Services, Singapore
| | - Koy-Min Chue
- Department of General Surgery, Sengkang General Hospital, SingHealth Services, Singapore
- SKH Endoscopy Centre, Division of Hyperacute Care, Sengkang General Hospital, SingHealth Services, Singapore
| | - SKH Endoscopy Centre
- SKH Endoscopy Centre, Division of Hyperacute Care, Sengkang General Hospital, SingHealth Services, Singapore
| | - Cui-Li Lin
- SKH Endoscopy Centre, Division of Hyperacute Care, Sengkang General Hospital, SingHealth Services, Singapore
- Department of Gastroenterology and Hepatology, Sengkang General Hospital, SingHealth Services, Singapore
| | - Eng-Kiong Teo
- SKH Endoscopy Centre, Division of Hyperacute Care, Sengkang General Hospital, SingHealth Services, Singapore
- Department of Gastroenterology and Hepatology, Sengkang General Hospital, SingHealth Services, Singapore
| | - Fung-Joon Foo
- Colorectal Service, Department of General Surgery, Sengkang General Hospital, SingHealth Services, Singapore
- SKH Endoscopy Centre, Division of Hyperacute Care, Sengkang General Hospital, SingHealth Services, Singapore
| |
Collapse
|
45
|
Mangas-Sanjuan C, de-Castro L, Cubiella J, Díez-Redondo P, Suárez A, Pellisé M, Fernández N, Zarraquiños S, Núñez-Rodríguez H, Álvarez-García V, Ortiz O, Sala-Miquel N, Zapater P, Jover R. Role of Artificial Intelligence in Colonoscopy Detection of Advanced Neoplasias : A Randomized Trial. Ann Intern Med 2023; 176:1145-1152. [PMID: 37639723 DOI: 10.7326/m22-2619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 08/31/2023] Open
Abstract
BACKGROUND The role of computer-aided detection in identifying advanced colorectal neoplasia is unknown. OBJECTIVE To evaluate the contribution of computer-aided detection to colonoscopic detection of advanced colorectal neoplasias as well as adenomas, serrated polyps, and nonpolypoid and right-sided lesions. DESIGN Multicenter, parallel, randomized controlled trial. (ClinicalTrials.gov: NCT04673136). SETTING Spanish colorectal cancer screening program. PARTICIPANTS 3213 persons with a positive fecal immunochemical test. INTERVENTION Enrollees were randomly assigned to colonoscopy with or without computer-aided detection. MEASUREMENTS Advanced colorectal neoplasia was defined as advanced adenoma and/or advanced serrated polyp. RESULTS The 2 comparison groups showed no significant difference in advanced colorectal neoplasia detection rate (34.8% with intervention vs. 34.6% for controls; adjusted risk ratio [aRR], 1.01 [95% CI, 0.92 to 1.10]) or the mean number of advanced colorectal neoplasias detected per colonoscopy (0.54 [SD, 0.95] with intervention vs. 0.52 [SD, 0.95] for controls; adjusted rate ratio, 1.04 [99.9% CI, 0.88 to 1.22]). Adenoma detection rate also did not differ (64.2% with intervention vs. 62.0% for controls; aRR, 1.06 [99.9% CI, 0.91 to 1.23]). Computer-aided detection increased the mean number of nonpolypoid lesions (0.56 [SD, 1.25] vs. 0.47 [SD, 1.18] for controls; adjusted rate ratio, 1.19 [99.9% CI, 1.01 to 1.41]), proximal adenomas (0.94 [SD, 1.62] vs. 0.81 [SD, 1.52] for controls; adjusted rate ratio, 1.17 [99.9% CI, 1.03 to 1.33]), and lesions of 5 mm or smaller (polyps in general and adenomas and serrated lesions in particular) detected per colonoscopy. LIMITATIONS The high adenoma detection rate in the control group may limit the generalizability of the findings to endoscopists with low detection rates. CONCLUSION Computer-aided detection did not improve colonoscopic identification of advanced colorectal neoplasias. PRIMARY FUNDING SOURCE Medtronic.
Collapse
Affiliation(s)
- Carolina Mangas-Sanjuan
- Department of Gastroenterology, Hospital General Universitario Dr. Balmis, Servicio de Medicina Digestiva, Instituto de Investigación Sanitaria y Biomédica de Alicante (ISABIAL), Spain (C.M., N.S.)
| | - Luisa de-Castro
- Department of Gastroenterology, Hospital Álvaro Cunqueiro, Digestive Pathology Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain (L. de-C., N.F.)
| | - Joaquín Cubiella
- Department of Gastroenterology, Hospital Universitario de Ourense, Centro de Investigación Biomédica en Red Enfermedades Hepáticas y Digestivas (CIBERehd), Ourense, Spain (J.C., S.Z.)
| | - Pilar Díez-Redondo
- Department of Gastroenterology, Hospital Río-Hortega, Valladolid, Spain (P.D., H.N.)
| | - Adolfo Suárez
- Department of Gastroenterology, Hospital Central de Asturias, Oviedo, Spain (A.S., V.A.)
| | - María Pellisé
- Department of Gastroenterology, Hospital Clínic Barcelona, Barcelona, Spain (M.P., O.O.)
| | - Nereida Fernández
- Department of Gastroenterology, Hospital Álvaro Cunqueiro, Digestive Pathology Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain (L. de-C., N.F.)
| | - Sara Zarraquiños
- Department of Gastroenterology, Hospital Universitario de Ourense, Centro de Investigación Biomédica en Red Enfermedades Hepáticas y Digestivas (CIBERehd), Ourense, Spain (J.C., S.Z.)
| | - Henar Núñez-Rodríguez
- Department of Gastroenterology, Hospital Río-Hortega, Valladolid, Spain (P.D., H.N.)
| | | | - Oswaldo Ortiz
- Department of Gastroenterology, Hospital Clínic Barcelona, Barcelona, Spain (M.P., O.O.)
| | - Noelia Sala-Miquel
- Department of Gastroenterology, Hospital General Universitario Dr. Balmis, Servicio de Medicina Digestiva, Instituto de Investigación Sanitaria y Biomédica de Alicante (ISABIAL), Spain (C.M., N.S.)
| | - Pedro Zapater
- Hospital General Universitario Dr. Balmis, Clinical Pharmacology Department, Instituto de Investigación Sanitaria y Biomédica de Alicante (ISABIAL), Departamento de Farmacología, Universidad Miguel Hernández, Alicante, CIBERehd, Spain (P.Z.)
| | - Rodrigo Jover
- Department of Gastroenterology, Hospital General Universitario Dr. Balmis, Servicio de Medicina Digestiva, Instituto de Investigación Sanitaria y Biomédica de Alicante (ISABIAL), Departamento de Medicina Clínica, Universidad Miguel Hernández, Alicante, Spain (R.J.)
| |
Collapse
|
46
|
Arif AA, Jiang SX, Byrne MF. Artificial intelligence in endoscopy: Overview, applications, and future directions. Saudi J Gastroenterol 2023; 29:269-277. [PMID: 37787347 PMCID: PMC10644999 DOI: 10.4103/sjg.sjg_286_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 08/16/2023] [Indexed: 09/15/2023] Open
Abstract
Since the emergence of artificial intelligence (AI) in medicine, endoscopy applications in gastroenterology have been at the forefront of innovations. The ever-increasing number of studies necessitates the need to organize and classify applications in a useful way. Separating AI capabilities by computer aided detection (CADe), diagnosis (CADx), and quality assessment (CADq) allows for a systematic evaluation of each application. CADe studies have shown promise in accurate detection of esophageal, gastric and colonic neoplasia as well as identifying sources of bleeding and Crohn's disease in the small bowel. While more advanced CADx applications employ optical biopsies to give further information to characterize neoplasia and grade inflammatory disease, diverse CADq applications ensure quality and increase the efficiency of procedures. Future applications show promise in advanced therapeutic modalities and integrated systems that provide multimodal capabilities. AI is set to revolutionize clinical decision making and performance of endoscopy.
Collapse
Affiliation(s)
- Arif A. Arif
- Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Shirley X. Jiang
- Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Michael F. Byrne
- Division of Gastroenterology, Department of Medicine, University of British Columbia, Vancouver, BC, Canada
- Satisfai Health, Vancouver, BC, Canada
| |
Collapse
|
47
|
Yao L, Zhang C, Xu B, Yi S, Li J, Ding X, Yu H. A deep learning-based system for mediastinum station localization in linear EUS (with video). Endosc Ultrasound 2023; 12:417-423. [PMID: 37969169 PMCID: PMC10631614 DOI: 10.1097/eus.0000000000000011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Accepted: 04/12/2023] [Indexed: 11/17/2023] Open
Abstract
Background and Objectives EUS is a crucial diagnostic and therapeutic method for many anatomical regions, especially in the evaluation of mediastinal diseases and related pathologies. Rapidly finding the standard stations is the key to achieving efficient and complete mediastinal EUS imaging. However, it requires substantial technical skills and extensive knowledge of mediastinal anatomy. We constructed a system, named EUS-MPS (EUS-mediastinal position system), for real-time mediastinal EUS station recognition. Methods The standard scanning of mediastinum EUS was divided into 7 stations. There were 33 010 images in mediastinum EUS examination collected to construct a station classification model. Then, we used 151 videos clips for video validation and used 1212 EUS images from 2 other hospitals for external validation. An independent data set containing 230 EUS images was applied for the man-machine contest. We conducted a crossover study to evaluate the effectiveness of this system in reducing the difficulty of mediastinal ultrasound image interpretation. Results For station classification, the model achieved an accuracy of 90.49% in image validation and 83.80% in video validation. At external validation, the models achieved 89.85% accuracy. In the man-machine contest, the model achieved an accuracy of 84.78%, which was comparable to that of expert (83.91%). The accuracy of the trainees' station recognition was significantly improved in the crossover study, with an increase of 13.26% (95% confidence interval, 11.04%-15.48%; P < 0.05). Conclusions This deep learning-based system shows great performance in mediastinum station localization, having the potential to play an important role in shortening the learning curve and establishing standard mediastinal scanning in the future.
Collapse
Affiliation(s)
- Liwen Yao
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Chenxia Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Bo Xu
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
| | - Shanshan Yi
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
| | - Juan Li
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
| | - Xiangwu Ding
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
| | - Honggang Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| |
Collapse
|
48
|
Hassan C, Spadaccini M, Mori Y, Foroutan F, Facciorusso A, Gkolfakis P, Tziatzios G, Triantafyllou K, Antonelli G, Khalaf K, Rizkala T, Vandvik PO, Fugazza A, Rondonotti E, Glissen-Brown JR, Kamba S, Maida M, Correale L, Bhandari P, Jover R, Sharma P, Rex DK, Repici A. Real-Time Computer-Aided Detection of Colorectal Neoplasia During Colonoscopy : A Systematic Review and Meta-analysis. Ann Intern Med 2023; 176:1209-1220. [PMID: 37639719 DOI: 10.7326/m22-3678] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 08/31/2023] Open
Abstract
BACKGROUND Artificial intelligence computer-aided detection (CADe) of colorectal neoplasia during colonoscopy may increase adenoma detection rates (ADRs) and reduce adenoma miss rates, but it may increase overdiagnosis and overtreatment of nonneoplastic polyps. PURPOSE To quantify the benefits and harms of CADe in randomized trials. DESIGN Systematic review and meta-analysis. (PROSPERO: CRD42022293181). DATA SOURCES Medline, Embase, and Scopus databases through February 2023. STUDY SELECTION Randomized trials comparing CADe-assisted with standard colonoscopy for polyp and cancer detection. DATA EXTRACTION Adenoma detection rate (proportion of patients with ≥1 adenoma), number of adenomas detected per colonoscopy, advanced adenoma (≥10 mm with high-grade dysplasia and villous histology), number of serrated lesions per colonoscopy, and adenoma miss rate were extracted as benefit outcomes. Number of polypectomies for nonneoplastic lesions and withdrawal time were extracted as harm outcomes. For each outcome, studies were pooled using a random-effects model. Certainty of evidence was assessed using the GRADE (Grading of Recommendations Assessment, Development and Evaluation) framework. DATA SYNTHESIS Twenty-one randomized trials on 18 232 patients were included. The ADR was higher in the CADe group than in the standard colonoscopy group (44.0% vs. 35.9%; relative risk, 1.24 [95% CI, 1.16 to 1.33]; low-certainty evidence), corresponding to a 55% (risk ratio, 0.45 [CI, 0.35 to 0.58]) relative reduction in miss rate (moderate-certainty evidence). More nonneoplastic polyps were removed in the CADe than the standard group (0.52 vs. 0.34 per colonoscopy; mean difference [MD], 0.18 polypectomy [CI, 0.11 to 0.26 polypectomy]; low-certainty evidence). Mean inspection time increased only marginally with CADe (MD, 0.47 minute [CI, 0.23 to 0.72 minute]; moderate-certainty evidence). LIMITATIONS This review focused on surrogates of patient-important outcomes. Most patients, however, may consider cancer incidence and cancer-related mortality important outcomes. The effect of CADe on such patient-important outcomes remains unclear. CONCLUSION The use of CADe for polyp detection during colonoscopy results in increased detection of adenomas but not advanced adenomas and in higher rates of unnecessary removal of nonneoplastic polyps. PRIMARY FUNDING SOURCE European Commission Horizon 2020 Marie Skłodowska-Curie Individual Fellowship.
Collapse
Affiliation(s)
- Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, and Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Italy (C.H., M.S., A.R.)
| | - Marco Spadaccini
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, and Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Italy (C.H., M.S., A.R.)
| | - Yuichi Mori
- Clinical Effectiveness Research Group, University of Oslo, Oslo, Norway, and Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan (Y.M.)
| | - Farid Foroutan
- Ted Rogers Centre for Heart Research, University Health Network, Toronto, Ontario, Canada (F.F.)
| | - Antonio Facciorusso
- Department of Medical Sciences, Section of Gastroenterology, University of Foggia, Foggia, Italy (A.Facciorusso)
| | - Paraskevas Gkolfakis
- Department of Gastroenterology, Hepatopancreatology, and Digestive Oncology, Erasme Hospital, Université Libre de Bruxelles, Brussels, Belgium (P.G.)
| | - Georgios Tziatzios
- Hepatogastroenterology Unit, Second Department of Internal Medicine-Propaedeutic, Medical School, National and Kapodistrian University of Athens, Attikon University General Hospital, Athens, Greece (G.T., K.T.)
| | - Konstantinos Triantafyllou
- Hepatogastroenterology Unit, Second Department of Internal Medicine-Propaedeutic, Medical School, National and Kapodistrian University of Athens, Attikon University General Hospital, Athens, Greece (G.T., K.T.)
| | - Giulio Antonelli
- Gastroenterology and Digestive Endoscopy Unit, Ospedale dei Castelli, Ariccia, and Department of Anatomical, Histological, Forensic Medicine and Orthopedics Sciences, Sapienza University of Rome, Rome, Italy (G.A.)
| | - Kareem Khalaf
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy (K.K., T.R.)
| | - Tommy Rizkala
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy (K.K., T.R.)
| | - Per Olav Vandvik
- Department of Medicine, Lovisenberg Diaconal Hospital, Oslo, Norway (P.O.V.)
| | - Alessandro Fugazza
- Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Italy (A.Fugazza, L.C.)
| | | | - Jeremy R Glissen-Brown
- Center for Advanced Endoscopy, Division of Gastroenterology and Hepatology, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts (J.R.G.)
| | - Shunsuke Kamba
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan (S.K.)
| | - Marcello Maida
- Gastroenterology and Endoscopy Unit, S. Elia-Raimondi Hospital, Caltanissetta, Italy (M.M.)
| | - Loredana Correale
- Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Italy (A.Fugazza, L.C.)
| | - Pradeep Bhandari
- Department of Gastroenterology, Queen Alexandra Hospital, Portsmouth, United Kingdom (P.B.)
| | - Rodrigo Jover
- Departamento de Medicina Clínica, Servicio de Gastroenterología, Hospital General Universitario Dr. Balmis, Instituto de Investigación Biomédica de Alicante ISABIAL, Universidad Miguel Hernández, Alicante, Spain (R.J.)
| | - Prateek Sharma
- Gastroenterology and Hepatology, Kansas City VA Medical Center, Kansas City, Missouri (P.S.)
| | - Douglas K Rex
- Division of Gastroenterology, Indiana University School of Medicine, Indianapolis, Indiana (D.K.R.)
| | - Alessandro Repici
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, and Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Italy (C.H., M.S., A.R.)
| |
Collapse
|
49
|
Thomas J, Ravichandran R, Nag A, Gupta L, Singh M, Panjiyar BK. Advancing Colorectal Cancer Screening: A Comprehensive Systematic Review of Artificial Intelligence (AI)-Assisted Versus Routine Colonoscopy. Cureus 2023; 15:e45278. [PMID: 37846251 PMCID: PMC10576852 DOI: 10.7759/cureus.45278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/14/2023] [Indexed: 10/18/2023] Open
Abstract
Colorectal cancer (CRC) is a rapidly escalating public health concern, which underlines the significance of its early detection and the need for the refinement of current screening methods. In this systematic review, we aimed to analyze the potential advantages and limitations of artificial intelligence (AI)-based computer-aided detection (CADe) systems as compared to routine colonoscopy. This review begins by shedding light on the global prevalence and mortality rates of CRC, highlighting the urgent need for effective screening techniques and early detection of this cancer type. It addresses the problems associated with undetected adenomas and polyps and the subsequent risk of interval CRC following colonoscopy. The incorporation of AI into diagnostics has been studied, specifically the use of CADe systems which are powered by deep learning. The review summarizes the findings from 13 randomized controlled trials (RCTs) (2019-2023), evaluating the impact of CADe on polyp and adenoma detection. The findings from the studies consistently show that CADe is superior to conventional colonoscopy procedures in terms of adenoma detection rate (ADR) and polyp detection rate (PDR), particularly with regard to small and flat lesions which are easily overlooked. The review acknowledges certain limitations of the included studies, such as potential performance bias and geographic limitations. The review ultimately concludes that AI-assisted colonoscopy can reduce missed lesion rates and improve CRC diagnosis. Collaboration between experts and clinicians is key for successful implementation. In summary, this review analyzes recent RCTs on AI-assisted colonoscopy for polyp and adenoma detection. It describes the likely benefits, limitations, and future implications of AI in enhancing colonoscopy procedures and lowering the incidence of CRC. More double-blinded trials and studies among diverse populations from different countries must be conducted to substantiate and expand upon the findings of this review.
Collapse
Affiliation(s)
- Jingle Thomas
- Internal Medicine, Al-Ameen Medical College, Vijayapura, IND
| | | | - Aiswarya Nag
- Internal Medicine, Sri Ramachandra Institute of Higher Education and Research, Chennai, IND
| | - Lovish Gupta
- Internal Medicine, Maulana Azad Medical College, New Delhi, IND
| | - Mansi Singh
- Medicine, O.O. Bogomolets National Medical University, Kyiv, UKR
| | - Binay K Panjiyar
- GCSRT, PGMEE, Harvard Medical School, Boston, USA
- Internal Medicine, California Institute of Behavioral Neurosciences & Psychology, Fairfield, USA
| |
Collapse
|
50
|
Ahmad HA, East JE, Panaccione R, Travis S, Canavan JB, Usiskin K, Byrne MF. Artificial Intelligence in Inflammatory Bowel Disease Endoscopy: Implications for Clinical Trials. J Crohns Colitis 2023; 17:1342-1353. [PMID: 36812142 PMCID: PMC10441563 DOI: 10.1093/ecco-jcc/jjad029] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Indexed: 02/24/2023]
Abstract
Artificial intelligence shows promise for clinical research in inflammatory bowel disease endoscopy. Accurate assessment of endoscopic activity is important in clinical practice and inflammatory bowel disease clinical trials. Emerging artificial intelligence technologies can increase efficiency and accuracy of assessing the baseline endoscopic appearance in patients with inflammatory bowel disease and the impact that therapeutic interventions may have on mucosal healing in both of these contexts. In this review, state-of-the-art endoscopic assessment of mucosal disease activity in inflammatory bowel disease clinical trials is described, covering the potential for artificial intelligence to transform the current paradigm, its limitations, and suggested next steps. Site-based artificial intelligence quality evaluation and inclusion of patients in clinical trials without the need for a central reader is proposed; for following patient progress, a second reading using AI alongside a central reader with expedited reading is proposed. Artificial intelligence will support precision endoscopy in inflammatory bowel disease and is on the threshold of advancing inflammatory bowel disease clinical trial recruitment.
Collapse
Affiliation(s)
| | - James E East
- Translational Gastroenterology Unit, Oxford NIHR Biomedical Research Centre, University of Oxford, Oxford, UK
| | - Remo Panaccione
- Inflammatory Bowel Disease Clinic, University of Calgary, Calgary, AB, Canada
| | - Simon Travis
- Translational Gastroenterology Unit, Oxford NIHR Biomedical Research Centre, University of Oxford, Oxford, UK
| | | | | | - Michael F Byrne
- University of British Columbia, Division of Gastroenterology, Department of Medicine, Vancouver, BC, Canada
- Satisfai Health, Vancouver, BC, Canada
| |
Collapse
|