1
|
Zhang C, Yao L, Jiang R, Wang J, Wu H, Li X, Wu Z, Luo R, Luo C, Tan X, Wang W, Xiao B, Hu H, Yu H. Assessment of the role of false-positive alerts in computer-aided polyp detection for assistance capabilities. J Gastroenterol Hepatol 2024. [PMID: 38744667 DOI: 10.1111/jgh.16615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Revised: 04/24/2024] [Accepted: 05/02/2024] [Indexed: 05/16/2024]
Abstract
BACKGROUND AND AIM False positives (FPs) pose a significant challenge in the application of artificial intelligence (AI) for polyp detection during colonoscopy. The study aimed to quantitatively evaluate the impact of computer-aided polyp detection (CADe) systems' FPs on endoscopists. METHODS The model's FPs were categorized into four gradients: 0-5, 5-10, 10-15, and 15-20 FPs per minute (FPPM). Fifty-six colonoscopy videos were collected for a crossover study involving 10 endoscopists. Polyp missed rate (PMR) was set as primary outcome. Subsequently, to further verify the impact of FPPM on the assistance capability of AI in clinical environments, a secondary analysis was conducted on a prospective randomized controlled trial (RCT) from Renmin Hospital of Wuhan University in China from July 1 to October 15, 2020, with the adenoma detection rate (ADR) as primary outcome. RESULTS Compared with routine group, CADe reduced PMR when FPPM was less than 5. However, with the continuous increase of FPPM, the beneficial effect of CADe gradually weakens. For secondary analysis of RCT, a total of 956 patients were enrolled. In AI-assisted group, ADR is higher when FPPM ≤ 5 compared with FPPM > 5 (CADe group: 27.78% vs 11.90%; P = 0.014; odds ratio [OR], 0.351; 95% confidence interval [CI], 0.152-0.812; COMBO group: 38.40% vs 23.46%, P = 0.029; OR, 0.427; 95% CI, 0.199-0.916). After AI intervention, ADR increased when FPPM ≤ 5 (27.78% vs 14.76%; P = 0.001; OR, 0.399; 95% CI, 0.231-0.690), but no statistically significant difference was found when FPPM > 5 (11.90% vs 14.76%, P = 0.788; OR, 1.111; 95% CI, 0.514-2.403). CONCLUSION The level of FPs of CADe does affect its effectiveness as an aid to endoscopists, with its best effect when FPPM is less than 5.
Collapse
Affiliation(s)
- Chenxia Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Liwen Yao
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Ruiqing Jiang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Jing Wang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Huiling Wu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Xun Li
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Zhifeng Wu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Renquan Luo
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Chaijie Luo
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Xia Tan
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Wen Wang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Bing Xiao
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Huiyan Hu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| | - Honggang Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Engineering Research Center for Artificial lntelligence Endoscopy Interventional Treatment of Hubei Province, Wuhan, China
| |
Collapse
|
2
|
Okumura T, Imai K, Misawa M, Kudo SE, Hotta K, Ito S, Kishida Y, Takada K, Kawata N, Maeda Y, Yoshida M, Yamamoto Y, Minamide T, Ishiwatari H, Sato J, Matsubayashi H, Ono H. Evaluating false-positive detection in a computer-aided detection system for colonoscopy. J Gastroenterol Hepatol 2024; 39:927-934. [PMID: 38273460 DOI: 10.1111/jgh.16491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Revised: 12/21/2023] [Accepted: 01/03/2024] [Indexed: 01/27/2024]
Abstract
BACKGROUND AND AIM Computer-aided detection (CADe) systems can efficiently detect polyps during colonoscopy. However, false-positive (FP) activation is a major limitation of CADe. We aimed to compare the rate and causes of FP using CADe before and after an update designed to reduce FP. METHODS We analyzed CADe-assisted colonoscopy videos recorded between July 2022 and October 2022. The number and causes of FPs and excessive time spent by the endoscopist on FP (ET) were compared pre- and post-update using 1:1 propensity score matching. RESULTS During the study period, 191 colonoscopy videos (94 and 97 in the pre- and post-update groups, respectively) were recorded. Propensity score matching resulted in 146 videos (73 in each group). The mean number of FPs and median ET per colonoscopy were significantly lower in the post-update group than those in the pre-update group (4.2 ± 3.7 vs 18.1 ± 11.1; P < 0.001 and 0 vs 16 s; P < 0.001, respectively). Mucosal tags, bubbles, and folds had the strongest association with decreased FP post-update (pre-update vs post-update: 4.3 ± 3.6 vs 0.4 ± 0.8, 0.32 ± 0.70 vs 0.04 ± 0.20, and 8.6 ± 6.7 vs 1.6 ± 1.7, respectively). There was no significant decrease in the true positive rate (post-update vs pre-update: 95.0% vs 99.2%; P = 0.09) or the adenoma detection rate (post-update vs pre-update: 52.1% vs 49.3%; P = 0.87). CONCLUSIONS The updated CADe can reduce FP without impairing polyp detection. A reduction in FP may help relieve the burden on endoscopists.
Collapse
Affiliation(s)
- Taishi Okumura
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Kenichiro Imai
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Masashi Misawa
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Shin-Ei Kudo
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Kinichi Hotta
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Sayo Ito
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | - Kazunori Takada
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Noboru Kawata
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Yuki Maeda
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Masao Yoshida
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Yoichi Yamamoto
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | | | - Junya Sato
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | - Hiroyuki Ono
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| |
Collapse
|
3
|
Campion JR, O'Connor DB, Lahiff C. Human-artificial intelligence interaction in gastrointestinal endoscopy. World J Gastrointest Endosc 2024; 16:126-135. [PMID: 38577646 PMCID: PMC10989254 DOI: 10.4253/wjge.v16.i3.126] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 01/18/2024] [Accepted: 02/23/2024] [Indexed: 03/14/2024] Open
Abstract
The number and variety of applications of artificial intelligence (AI) in gastrointestinal (GI) endoscopy is growing rapidly. New technologies based on machine learning (ML) and convolutional neural networks (CNNs) are at various stages of development and deployment to assist patients and endoscopists in preparing for endoscopic procedures, in detection, diagnosis and classification of pathology during endoscopy and in confirmation of key performance indicators. Platforms based on ML and CNNs require regulatory approval as medical devices. Interactions between humans and the technologies we use are complex and are influenced by design, behavioural and psychological elements. Due to the substantial differences between AI and prior technologies, important differences may be expected in how we interact with advice from AI technologies. Human–AI interaction (HAII) may be optimised by developing AI algorithms to minimise false positives and designing platform interfaces to maximise usability. Human factors influencing HAII may include automation bias, alarm fatigue, algorithm aversion, learning effect and deskilling. Each of these areas merits further study in the specific setting of AI applications in GI endoscopy and professional societies should engage to ensure that sufficient emphasis is placed on human-centred design in development of new AI technologies.
Collapse
Affiliation(s)
- John R Campion
- Department of Gastroenterology, Mater Misericordiae University Hospital, Dublin D07 AX57, Ireland
- School of Medicine, University College Dublin, Dublin D04 C7X2, Ireland
| | - Donal B O'Connor
- Department of Surgery, Trinity College Dublin, Dublin D02 R590, Ireland
| | - Conor Lahiff
- Department of Gastroenterology, Mater Misericordiae University Hospital, Dublin D07 AX57, Ireland
- School of Medicine, University College Dublin, Dublin D04 C7X2, Ireland
| |
Collapse
|
4
|
Khalaf K, Fujiyoshi MRA, Spadaccini M, Rizkala T, Ramai D, Colombo M, Fugazza A, Facciorusso A, Carrara S, Hassan C, Repici A. From Staining Techniques to Artificial Intelligence: A Review of Colorectal Polyps Characterization. MEDICINA (KAUNAS, LITHUANIA) 2024; 60:89. [PMID: 38256350 PMCID: PMC10818333 DOI: 10.3390/medicina60010089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 12/24/2023] [Accepted: 12/26/2023] [Indexed: 01/24/2024]
Abstract
This review article provides a comprehensive overview of the evolving techniques in image-enhanced endoscopy (IEE) for the characterization of colorectal polyps, and the potential of artificial intelligence (AI) in revolutionizing the diagnostic accuracy of endoscopy. We discuss the historical use of dye-spray and virtual chromoendoscopy for the characterization of colorectal polyps, which are now being replaced with more advanced technologies. Specifically, we focus on the application of AI to create a "virtual biopsy" for the detection and characterization of colorectal polyps, with potential for replacing histopathological diagnosis. The incorporation of AI has the potential to provide an evolutionary learning system that aids in the diagnosis and management of patients with the best possible outcomes. A detailed analysis of the literature supporting AI-assisted diagnostic techniques for the detection and characterization of colorectal polyps, with a particular emphasis on AI's characterization mechanism, is provided. The benefits of AI over traditional IEE techniques, including the reduction in human error in diagnosis, and its potential to provide an accurate diagnosis with similar accuracy to the gold standard are presented. However, the need for large-scale testing of AI in clinical practice and the importance of integrating patient data into the diagnostic process are acknowledged. In conclusion, the constant evolution of IEE technology and the potential for AI to revolutionize the field of endoscopy in the future are presented.
Collapse
Affiliation(s)
- Kareem Khalaf
- Division of Gastroenterology, St. Michael’s Hospital, University of Toronto, Toronto, ON M5B 1T8, Canada; (K.K.); (M.R.A.F.)
| | - Mary Raina Angeli Fujiyoshi
- Division of Gastroenterology, St. Michael’s Hospital, University of Toronto, Toronto, ON M5B 1T8, Canada; (K.K.); (M.R.A.F.)
- Digestive Diseases Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Marco Spadaccini
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
- Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Tommy Rizkala
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
- Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Daryl Ramai
- Gastroenterology and Hepatology, University of Utah Health, Salt Lake City, UT 84132, USA;
| | - Matteo Colombo
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
| | - Alessandro Fugazza
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
| | - Antonio Facciorusso
- Department of Endoscopy, Section of Gastroenterology, Department of Medical and Surgical Sciences, University of Foggia, 71122 Foggia, Italy;
| | - Silvia Carrara
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
| | - Cesare Hassan
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
- Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Alessandro Repici
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
- Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| |
Collapse
|
5
|
Li JW, Wang LM, Ichimasa K, Lin KW, Ngu JCY, Ang TL. Use of artificial intelligence in the management of T1 colorectal cancer: a new tool in the arsenal or is deep learning out of its depth? Clin Endosc 2024; 57:24-35. [PMID: 37743068 PMCID: PMC10834280 DOI: 10.5946/ce.2023.036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 05/11/2023] [Indexed: 09/26/2023] Open
Abstract
The field of artificial intelligence is rapidly evolving, and there has been an interest in its use to predict the risk of lymph node metastasis in T1 colorectal cancer. Accurately predicting lymph node invasion may result in fewer patients undergoing unnecessary surgeries; conversely, inadequate assessments will result in suboptimal oncological outcomes. This narrative review aims to summarize the current literature on deep learning for predicting the probability of lymph node metastasis in T1 colorectal cancer, highlighting areas of potential application and barriers that may limit its generalizability and clinical utility.
Collapse
Affiliation(s)
- James Weiquan Li
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore Health Services, Singapore
- Academic Medicine Center, Duke-NUS Medical School, Singapore
| | - Lai Mun Wang
- Department of Laboratory Medicine, Changi General Hospital, Singapore Health Services, Singapore
| | - Katsuro Ichimasa
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Kenneth Weicong Lin
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore Health Services, Singapore
- Academic Medicine Center, Duke-NUS Medical School, Singapore
| | - James Chi-Yong Ngu
- Department of General Surgery, Changi General Hospital, Singapore Health Services, Singapore
| | - Tiing Leong Ang
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore Health Services, Singapore
- Academic Medicine Center, Duke-NUS Medical School, Singapore
| |
Collapse
|
6
|
Kader R, Cid‐Mejias A, Brandao P, Islam S, Hebbar S, Puyal JG, Ahmad OF, Hussein M, Toth D, Mountney P, Seward E, Vega R, Stoyanov D, Lovat LB. Polyp characterization using deep learning and a publicly accessible polyp video database. Dig Endosc 2023; 35:645-655. [PMID: 36527309 PMCID: PMC10570984 DOI: 10.1111/den.14500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 12/13/2022] [Indexed: 01/20/2023]
Abstract
OBJECTIVES Convolutional neural networks (CNN) for computer-aided diagnosis of polyps are often trained using high-quality still images in a single chromoendoscopy imaging modality with sessile serrated lesions (SSLs) often excluded. This study developed a CNN from videos to classify polyps as adenomatous or nonadenomatous using standard narrow-band imaging (NBI) and NBI-near focus (NBI-NF) and created a publicly accessible polyp video database. METHODS We trained a CNN with 16,832 high and moderate quality frames from 229 polyp videos (56 SSLs). It was evaluated with 222 polyp videos (36 SSLs) across two test-sets. Test-set I consists of 14,320 frames (157 polyps, 111 diminutive). Test-set II, which is publicly accessible, 3317 video frames (65 polyps, 41 diminutive), which was benchmarked with three expert and three nonexpert endoscopists. RESULTS Sensitivity for adenoma characterization was 91.6% in test-set I and 89.7% in test-set II. Specificity was 91.9% and 88.5%. Sensitivity for diminutive polyps was 89.9% and 87.5%; specificity 90.5% and 88.2%. In NBI-NF, sensitivity was 89.4% and 89.5%, with a specificity of 94.7% and 83.3%. In NBI, sensitivity was 85.3% and 91.7%, with a specificity of 87.5% and 90.0%, respectively. The CNN achieved preservation and incorporation of valuable endoscopic innovations (PIVI)-1 and PIVI-2 thresholds for each test-set. In the benchmarking of test-set II, the CNN was significantly more accurate than nonexperts (13.8% difference [95% confidence interval 3.2-23.6], P = 0.01) with no significant difference with experts. CONCLUSIONS A single CNN can differentiate adenomas from SSLs and hyperplastic polyps in both NBI and NBI-NF. A publicly accessible NBI polyp video database was created and benchmarked.
Collapse
Affiliation(s)
- Rawen Kader
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | | | | | - Shahraz Islam
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
| | | | - Juana González‐Bueno Puyal
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Odin Vision LtdLondonUK
| | - Omer F. Ahmad
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | - Mohamed Hussein
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | | | | | - Ed Seward
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | - Roser Vega
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | - Danail Stoyanov
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
| | - Laurence B. Lovat
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| |
Collapse
|
7
|
Cherubini A, Dinh NN. A Review of the Technology, Training, and Assessment Methods for the First Real-Time AI-Enhanced Medical Device for Endoscopy. Bioengineering (Basel) 2023; 10:bioengineering10040404. [PMID: 37106592 PMCID: PMC10136070 DOI: 10.3390/bioengineering10040404] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 02/25/2023] [Accepted: 03/22/2023] [Indexed: 04/29/2023] Open
Abstract
Artificial intelligence (AI) has the potential to assist in endoscopy and improve decision making, particularly in situations where humans may make inconsistent judgments. The performance assessment of the medical devices operating in this context is a complex combination of bench tests, randomized controlled trials, and studies on the interaction between physicians and AI. We review the scientific evidence published about GI Genius, the first AI-powered medical device for colonoscopy to enter the market, and the device that is most widely tested by the scientific community. We provide an overview of its technical architecture, AI training and testing strategies, and regulatory path. In addition, we discuss the strengths and limitations of the current platform and its potential impact on clinical practice. The details of the algorithm architecture and the data that were used to train the AI device have been disclosed to the scientific community in the pursuit of a transparent AI. Overall, the first AI-enabled medical device for real-time video analysis represents a significant advancement in the use of AI for endoscopies and has the potential to improve the accuracy and efficiency of colonoscopy procedures.
Collapse
Affiliation(s)
- Andrea Cherubini
- Cosmo Intelligent Medical Devices, D02KV60 Dublin, Ireland
- Milan Center for Neuroscience, University of Milano-Bicocca, 20126 Milano, Italy
| | - Nhan Ngo Dinh
- Cosmo Intelligent Medical Devices, D02KV60 Dublin, Ireland
| |
Collapse
|
8
|
Ladabaum U, Shepard J, Weng Y, Desai M, Singer SJ, Mannalithara A. Computer-aided Detection of Polyps Does Not Improve Colonoscopist Performance in a Pragmatic Implementation Trial. Gastroenterology 2023; 164:481-483.e6. [PMID: 36528131 DOI: 10.1053/j.gastro.2022.12.004] [Citation(s) in RCA: 29] [Impact Index Per Article: 29.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 12/07/2022] [Accepted: 12/09/2022] [Indexed: 01/17/2023]
Affiliation(s)
- Uri Ladabaum
- Division of Gastroenterology and Hepatology, Department of Medicine, Stanford University School of Medicine, Stanford, California.
| | - John Shepard
- Critical Care Quality and Strategic Initiatives, Stanford Health Care, Stanford, California
| | - Yingjie Weng
- Quantitative Sciences Unit, Department of Medicine, Stanford University School of Medicine, Stanford, California
| | - Manisha Desai
- Quantitative Sciences Unit, Department of Medicine, Stanford University School of Medicine, Stanford, California
| | - Sara J Singer
- Department of Medicine, Stanford University School of Medicine, Stanford University Graduate School of Business, Stanford, California
| | - Ajitha Mannalithara
- Division of Gastroenterology and Hepatology, Department of Medicine, Stanford University School of Medicine, Stanford, California
| |
Collapse
|
9
|
Eysenbach G, Liu SHK, Leung K, Wu JT, Zauber AG, Leung WK. The Impacts of Computer-Aided Detection of Colorectal Polyps on Subsequent Colonoscopy Surveillance Intervals: Simulation Study. J Med Internet Res 2023; 25:e42665. [PMID: 36763451 PMCID: PMC9960036 DOI: 10.2196/42665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 01/10/2023] [Accepted: 01/23/2023] [Indexed: 01/25/2023] Open
Abstract
BACKGROUND Computer-aided detection (CADe) of colorectal polyps has been shown to increase adenoma detection rates, which would potentially shorten subsequent surveillance intervals. OBJECTIVE The purpose of this study is to simulate the potential changes in subsequent colonoscopy surveillance intervals after the application of CADe in a large cohort of patients. METHODS We simulated the projected increase in polyp and adenoma detection by universal CADe application in our patients who had undergone colonoscopy with complete endoscopic and histological findings between 2016 and 2020. The simulation was based on bootstrapping the published performance of CADe. The corresponding changes in surveillance intervals for each patient, as recommended by the US Multi-Society Task Force on Colorectal Cancer (USMSTF) or the European Society of Gastrointestinal Endoscopy (ESGE), were determined after the CADe was determined. RESULTS A total of 3735 patients who had undergone colonoscopy were included. Based on the simulated CADe effect, the application of CADe would result in 19.1% (n=714) and 1.9% (n=71) of patients having shorter surveillance intervals, according to the USMSTF and ESGE guidelines, respectively. In particular, all (or 2.7% (n=101) of the total) patients who were originally scheduled to have 3-5 years of surveillance would have their surveillance intervals shortened to 3 years, following the USMSTF guidelines. The changes in this group of patients were largely attributed to an increase in the number of adenomas (n=75, 74%) rather than serrated lesions being detected. CONCLUSIONS Widespread adoption of CADe would inevitably increase the demand for surveillance colonoscopies with the shortening of original surveillance intervals, particularly following the current USMSTF guideline.
Collapse
Affiliation(s)
| | - Sze Hang Kevin Liu
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, Hong Kong
| | - Kathy Leung
- WHO Collaborating Centre for Infectious Disease Epidemiology and Control, School of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, Hong Kong
| | - Joseph T Wu
- WHO Collaborating Centre for Infectious Disease Epidemiology and Control, School of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, Hong Kong
| | - Ann G Zauber
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Wai Keung Leung
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, Hong Kong
| |
Collapse
|
10
|
Raunig DL, Pennello GA, Delfino JG, Buckler AJ, Hall TJ, Guimaraes AR, Wang X, Huang EP, Barnhart HX, deSouza N, Obuchowski N. Multiparametric Quantitative Imaging Biomarker as a Multivariate Descriptor of Health: A Roadmap. Acad Radiol 2023; 30:159-182. [PMID: 36464548 PMCID: PMC9825667 DOI: 10.1016/j.acra.2022.10.026] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Revised: 10/24/2022] [Accepted: 10/29/2022] [Indexed: 12/02/2022]
Abstract
Multiparametric quantitative imaging biomarkers (QIBs) offer distinct advantages over single, univariate descriptors because they provide a more complete measure of complex, multidimensional biological systems. In disease, where structural and functional disturbances occur across a multitude of subsystems, multivariate QIBs are needed to measure the extent of system malfunction. This paper, the first Use Case in a series of articles on multiparameter imaging biomarkers, considers multiple QIBs as a multidimensional vector to represent all relevant disease constructs more completely. The approach proposed offers several advantages over QIBs as multiple endpoints and avoids combining them into a single composite that obscures the medical meaning of the individual measurements. We focus on establishing statistically rigorous methods to create a single, simultaneous measure from multiple QIBs that preserves the sensitivity of each univariate QIB while incorporating the correlation among QIBs. Details are provided for metrological methods to quantify the technical performance. Methods to reduce the set of QIBs, test the superiority of the mp-QIB model to any univariate QIB model, and design study strategies for generating precision and validity claims are also provided. QIBs of Alzheimer's Disease from the ADNI merge data set are used as a case study to illustrate the methods described.
Collapse
Affiliation(s)
- David L Raunig
- Department of Statistical and Quantitative Sciences, Data Science Institute, Takeda Pharmaceuticals, Cambridge, Massachusetts.
| | - Gene A Pennello
- Center for Devices and Radiological Health, US Food and Drug Administration Division of Imaging, Diagnostic and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland
| | - Jana G Delfino
- Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland
| | | | - Timothy J Hall
- Department of Medical Physics, University of Wisconsin, Madison, Wisconsin
| | - Alexander R Guimaraes
- Department of Diagnostic Radiology, Oregon Health & Sciences University, Portland, Oregon
| | - Xiaofeng Wang
- Department of Quantitative Health Sciences, Lerner Research Institute, Cleveland, Ohio
| | - Erich P Huang
- Biometric Research Program, Division of Cancer Treatment and Diagnosis - National Cancer Institute, National Institutes of Health, Bethesda, MD
| | - Huiman X Barnhart
- Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina
| | - Nandita deSouza
- Division of Radiotherapy and Imaging, the Insitute of Cancer Research and Royal Marsden NHS Foundation Trust, London, United Kingdom
| | - Nancy Obuchowski
- Department of Quantitative Health Sciences, Lerner Research Institute Cleveland Clinic Foundation, Cleveland, Ohio
| |
Collapse
|
11
|
Ahmad OF. Artificial intelligence for polyp characterization: easy as ABC. Endoscopy 2023; 55:23-24. [PMID: 36162423 DOI: 10.1055/a-1931-4332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Affiliation(s)
- Omer F Ahmad
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK.,Gastrointestinal Services, University College London Hospital, London, UK
| |
Collapse
|
12
|
Leenhardt R, Koulaouzidis A, Histace A, Baatrup G, Beg S, Bourreille A, de Lange T, Eliakim R, Iakovidis D, Dam Jensen M, Keuchel M, Margalit Yehuda R, McNamara D, Mascarenhas M, Spada C, Segui S, Smedsrud P, Toth E, Tontini GE, Klang E, Dray X, Kopylov U. Key research questions for implementation of artificial intelligence in capsule endoscopy. Therap Adv Gastroenterol 2022; 15:17562848221132683. [PMID: 36338789 PMCID: PMC9629556 DOI: 10.1177/17562848221132683] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 09/27/2022] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Artificial intelligence (AI) is rapidly infiltrating multiple areas in medicine, with gastrointestinal endoscopy paving the way in both research and clinical applications. Multiple challenges associated with the incorporation of AI in endoscopy are being addressed in recent consensus documents. OBJECTIVES In the current paper, we aimed to map future challenges and areas of research for the incorporation of AI in capsule endoscopy (CE) practice. DESIGN Modified three-round Delphi consensus online survey. METHODS The study design was based on a modified three-round Delphi consensus online survey distributed to a group of CE and AI experts. Round one aimed to map out key research statements and challenges for the implementation of AI in CE. All queries addressing the same questions were merged into a single issue. The second round aimed to rank all generated questions during round one and to identify the top-ranked statements with the highest total score. Finally, the third round aimed to redistribute and rescore the top-ranked statements. RESULTS Twenty-one (16 gastroenterologists and 5 data scientists) experts participated in the survey. In the first round, 48 statements divided into seven themes were generated. After scoring all statements and rescoring the top 12, the question of AI use for identification and grading of small bowel pathologies was scored the highest (mean score 9.15), correlation of AI and human expert reading-second (9.05), and real-life feasibility-third (9.0). CONCLUSION In summary, our current study points out a roadmap for future challenges and research areas on our way to fully incorporating AI in CE reading.
Collapse
Affiliation(s)
| | - Anastasios Koulaouzidis
- Department of Social Medicine and Public Health, Pomeranian Medical University, Szczecin, Poland,Department of Surgery, Odense University Hospital, Odense, Denmark,Department of Clinical research, University of Southern Denmark, Odense, Denmark
| | - Aymeric Histace
- ETIS UMR 8051 (CY Paris Cergy University, ENSEA, CNRS), Cergy, France
| | - Gunnar Baatrup
- Department of Surgery, Odense University Hospital, Odense, Denmark,Department of Clinical research, University of Southern Denmark, Odense, Denmark
| | - Sabina Beg
- Department of Gastroenterology, Imperial College NHS Healthcare Trust, London, UK
| | - Arnaud Bourreille
- Nantes Université, CHU Nantes, Institut des maladies de l’appareil digestif (IMAD), Hépato-gastroentérologie, Nantes, France
| | - Thomas de Lange
- Department of Medicine and emergencies-Mölndal, Region Västra Götaland, Sahlgrenska University Hospital, Gothenburg, Sweden,Department of Molecular and Clinical and Medicine, University of Gothenburg, Sahlgrenska Academy, Gothenburg, Sweden
| | - Rami Eliakim
- Department of Gastroenterology, Sheba Medical Center and Sackler School of Medicine, Tel Aviv University, Tel-Aviv, Israel
| | - Dimitris Iakovidis
- Department of Computer Science and Biomedical Informatics, University of Thessaly, Lamia, Greece
| | - Michael Dam Jensen
- Department of Internal Medicine, Section of Gastroenterology, Lillebaelt Hospital, Vejle, Denmark
| | - Martin Keuchel
- Clinic for Internal Medicine, Agaplesion Bethesda Krankenhaus Bergedorf, Hamburg, Germany
| | - Reuma Margalit Yehuda
- Department of Gastroenterology, Sheba Medical Center and Sackler School of Medicine, Tel Aviv University, Tel-Aviv, Israel
| | - Deirdre McNamara
- Trinity Academic Gastroenterology Group, Department of Clinical Medicine, Tallaght Hospital, Trinity College Dublin, Dublin, Ireland
| | - Miguel Mascarenhas
- Department of Gastroenterology, Centro Hospitalar São João, Porto, Portugal
| | - Cristiano Spada
- Digestive Endoscopy Unit and Gastroenterology, Fondazione Poliambulanza, Brescia, Italy,Digestive Endoscopy Unit, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Santi Segui
- Department of Mathematics and Computer Science, Universitat de Barcelona, Barcelona, Spain
| | - Pia Smedsrud
- Simula Metropolitan Centre for Digital Engineering, University of Oslo, Augere Medical AS, Oslo, Norway
| | - Ervin Toth
- Department of Gastroenterology, Skåne University Hospital, Lund University, Malmö, Sweden
| | - Gian Eugenio Tontini
- Department of Pathophysiology and Transplantation, University of Milan and Gastroenterology and Endoscopy Unit, Fondazione IRCCS Ca’Granda Ospedale Maggiore Policlinico, Milan, Italy
| | - Eyal Klang
- Sheba ARC, Sheba Medical Center and Sackler School of Medicine, Tel Aviv University, Tel-Aviv, Israel
| | - Xavier Dray
- Sorbonne Université, Centre of Digestive Endoscopy, Hôpital Saint-Antoine, AP-HP, Paris, France,ETIS UMR 8051 (CY Paris Cergy University, ENSEA, CNRS), Cergy, France
| | - Uri Kopylov
- Department of Gastroenterology, Sheba Medical Center and Sackler School of Medicine, Tel Aviv University, Tel-Aviv, Israel
| |
Collapse
|
13
|
García-Rodríguez A, Tudela Y, Córdova H, Carballal S, Ordás I, Moreira L, Vaquero E, Ortiz O, Rivero L, Sánchez FJ, Cuatrecasas M, Pellisé M, Bernal J, Fernández-Esparrach G. In vivo computer-aided diagnosis of colorectal polyps using white light endoscopy. Endosc Int Open 2022; 10:E1201-E1207. [PMID: 36118638 PMCID: PMC9473851 DOI: 10.1055/a-1881-3178] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 06/10/2022] [Indexed: 12/24/2022] Open
Abstract
Background and study aims Artificial intelligence is currently able to accurately predict the histology of colorectal polyps. However, systems developed to date use complex optical technologies and have not been tested in vivo. The objective of this study was to evaluate the efficacy of a new deep learning-based optical diagnosis system, ATENEA, in a real clinical setting using only high-definition white light endoscopy (WLE) and to compare its performance with endoscopists. Methods ATENEA was prospectively tested in real life on consecutive polyps detected in colorectal cancer screening colonoscopies at Hospital Clínic. No images were discarded, and only WLE was used. The in vivo ATENEA's prediction (adenoma vs non-adenoma) was compared with the prediction of four staff endoscopists without specific training in optical diagnosis for the study purposes. Endoscopists were blind to the ATENEA output. Histology was the gold standard. Results Ninety polyps (median size: 5 mm, range: 2-25) from 31 patients were included of which 69 (76.7 %) were adenomas. ATENEA correctly predicted the histology in 63 of 69 (91.3 %, 95 % CI: 82 %-97 %) adenomas and 12 of 21 (57.1 %, 95 % CI: 34 %-78 %) non-adenomas while endoscopists made correct predictions in 52 of 69 (75.4 %, 95 % CI: 60 %-85 %) and 20 of 21 (95.2 %, 95 % CI: 76 %-100 %), respectively. The global accuracy was 83.3 % (95 % CI: 74%-90 %) and 80 % (95 % CI: 70 %-88 %) for ATENEA and endoscopists, respectively. Conclusion ATENEA can accurately be used for in vivo characterization of colorectal polyps, enabling the endoscopist to make direct decisions. ATENEA showed a global accuracy similar to that of endoscopists despite an unsatisfactory performance for non-adenomatous lesions.
Collapse
Affiliation(s)
- Ana García-Rodríguez
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain
| | - Yael Tudela
- Computer Science Department. Autonomous University of Barcelona and Computer Vision Center, Barcelona, Catalonia, Spain
| | - Henry Córdova
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain,IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain
| | - Sabela Carballal
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain,IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain
| | - Ingrid Ordás
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain,IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain
| | - Leticia Moreira
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain,IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain
| | - Eva Vaquero
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain,IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain
| | - Oswaldo Ortiz
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain
| | - Liseth Rivero
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain,IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain
| | - F. Javier Sánchez
- Computer Science Department. Autonomous University of Barcelona and Computer Vision Center, Barcelona, Catalonia, Spain
| | - Miriam Cuatrecasas
- IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain,Pathology Department. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain
| | - Maria Pellisé
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain,IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain
| | - Jorge Bernal
- Computer Science Department. Autonomous University of Barcelona and Computer Vision Center, Barcelona, Catalonia, Spain
| | - Glòria Fernández-Esparrach
- Endoscopy Unit. Gastroenterology Department. ICMDiM. Hospital Clínic of Barcelona. University of Barcelona, Barcelona, Catalonia, Spain,IDIBAPS, Barcelona, Catalonia, Spain,CIBEREHD, Spain
| |
Collapse
|
14
|
Luca M, Ciobanu A. Polyp detection in video colonoscopy using deep learning. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-219276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Video colonoscopy automatic processing is a challenge and further development of computer assisted diagnosis is very helpful in correctness assessment of the exam, in e-learning and training, for statistics on polyps’ malignity or in polyps’ survey. New devices and programming languages are emerging and deep learning begun already to furnish astonishing results, in the quest for high speed and optimal polyp detection software. This paper presents a successful attempt in detecting the intestinal polyps in real time video colonoscopy with deep learning, using Mobile Net.
Collapse
Affiliation(s)
- Mihaela Luca
- Institute of Computer Science, Romanian Academy Iaşi Branch, Iaşi, Romania
| | - Adrian Ciobanu
- Institute of Computer Science, Romanian Academy Iaşi Branch, Iaşi, Romania
| |
Collapse
|
15
|
Artificial intelligence complemented by water exchange for right-sided colonic polyp detection: It's time to dive! Gastrointest Endosc 2022; 95:1207-1209. [PMID: 35410726 DOI: 10.1016/j.gie.2022.02.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 02/20/2022] [Indexed: 12/11/2022]
|
16
|
Ahmad OF, González-Bueno Puyal J, Brandao P, Kader R, Abbasi F, Hussein M, Haidry RJ, Toth D, Mountney P, Seward E, Vega R, Stoyanov D, Lovat LB. Performance of artificial intelligence for detection of subtle and advanced colorectal neoplasia. Dig Endosc 2022; 34:862-869. [PMID: 34748665 DOI: 10.1111/den.14187] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 10/22/2021] [Accepted: 11/05/2021] [Indexed: 02/05/2023]
Abstract
OBJECTIVES There is uncertainty regarding the efficacy of artificial intelligence (AI) software to detect advanced subtle neoplasia, particularly flat lesions and sessile serrated lesions (SSLs), due to low prevalence in testing datasets and prospective trials. This has been highlighted as a top research priority for the field. METHODS An AI algorithm was evaluated on four video test datasets containing 173 polyps (35,114 polyp-positive frames and 634,988 polyp-negative frames) specifically enriched with flat lesions and SSLs, including a challenging dataset containing subtle advanced neoplasia. The challenging dataset was also evaluated by eight endoscopists (four independent, four trainees, according to the Joint Advisory Group on gastrointestinal endoscopy [JAG] standards in the UK). RESULTS In the first two video datasets, the algorithm achieved per-polyp sensitivities of 100% and 98.9%. Per-frame sensitivities were 84.1% and 85.2%. In the subtle dataset, the algorithm detected a significantly higher number of polyps (P < 0.0001), compared to JAG-independent and trainee endoscopists, achieving per-polyp sensitivities of 79.5%, 37.2% and 11.5%, respectively. Furthermore, when considering subtle polyps detected by both the algorithm and at least one endoscopist, the AI detected polyps significantly faster on average. CONCLUSIONS The AI based algorithm achieved high per-polyp sensitivities for advanced colorectal neoplasia, including flat lesions and SSLs, outperforming both JAG independent and trainees on a very challenging dataset containing subtle lesions that could have been overlooked easily and contribute to interval colorectal cancer. Further prospective trials should evaluate AI to detect subtle advanced neoplasia in higher risk populations for colorectal cancer.
Collapse
Affiliation(s)
- Omer F Ahmad
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London
- Division of Surgery and Interventional Sciences, University College London, London, UK
- Gastrointestinal Services, University College London Hospital, London, UK
| | - Juana González-Bueno Puyal
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London
- Odin Vision Ltd, London, UK
| | - Patrick Brandao
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London
- Odin Vision Ltd, London, UK
| | - Rawen Kader
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London
- Division of Surgery and Interventional Sciences, University College London, London, UK
| | - Faisal Abbasi
- Division of Surgery and Interventional Sciences, University College London, London, UK
| | - Mohamed Hussein
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London
- Division of Surgery and Interventional Sciences, University College London, London, UK
| | - Rehan J Haidry
- Division of Surgery and Interventional Sciences, University College London, London, UK
- Gastrointestinal Services, University College London Hospital, London, UK
| | | | | | - Ed Seward
- Gastrointestinal Services, University College London Hospital, London, UK
| | - Roser Vega
- Gastrointestinal Services, University College London Hospital, London, UK
| | - Danail Stoyanov
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London
| | - Laurence B Lovat
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London
- Division of Surgery and Interventional Sciences, University College London, London, UK
- Gastrointestinal Services, University College London Hospital, London, UK
| |
Collapse
|
17
|
Spadaccini M, Hassan C, Alfarone L, Da Rio L, Maselli R, Carrara S, Galtieri PA, Pellegatta G, Fugazza A, Koleth G, Emmanuel J, Anderloni A, Mori Y, Wallace MB, Sharma P, Repici A. Comparing the number and relevance of false activations between 2 artificial intelligence computer-aided detection systems: the NOISE study. Gastrointest Endosc 2022; 95:975-981.e1. [PMID: 34995639 DOI: 10.1016/j.gie.2021.12.031] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Accepted: 12/25/2021] [Indexed: 12/11/2022]
Abstract
BACKGROUND AND AIMS Artificial intelligence has been shown to be effective in polyp detection, and multiple computer-aided detection (CADe) systems have been developed. False-positive (FP) activation emerged as a possible way to benchmark CADe performance in clinical practice. The aim of this study was to validate a previously developed classification of FPs comparing the performances of different brands of approved CADe systems. METHODS We compared 2 different consecutive video libraries (40 video per arm) collected at Humanitas Research Hospital with 2 different CADe system brands (CADe A and CADe B). For each video, the number of CADe false activations, cause, and time spent by the endoscopist to examine the area erroneously highlighted were reported. The FP activations were classified according to the previously developed classification of FPs (the NOISE classification) according to their cause and relevance. RESULTS In CADe A 1021 FP activations were registered across the 40 videos (25.5 ± 12.2 FPs per colonoscopy), whereas in CADe B 1028 were identified (25.7 ± 13.2 FPs per colonoscopy; P = .53). Among them, 22.9 ± 9.9 (89.8% in CADe A) and 22.1 ± 10.0 (86.0% in CADe B) were because of artifacts from the bowel wall. Conversely, 2.6 ± 1.9 (10.2% in CADe A) and 3.5 ± 2.1 (14% in CADe B) were caused by bowel content (P = .45). Within CADe A each false activation required .2 ± .9 seconds, with 1.6 ± 1.0 FPs (6.3%) requiring additional time for endoscopic assessment. Comparable results were reported within CADe B with .2 ± .8 seconds spent per false activation and 1.8 ± 1.2 FPs per colonoscopy requiring additional inspection. CONCLUSIONS The use of a standardized nomenclature provided comparable results with either of the 2 recently approved CADe systems. (Clinical trial registration number: NCT04399590.).
Collapse
Affiliation(s)
- Marco Spadaccini
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy; Endoscopy Unit, Humanitas Clinical and Research Center-IRCCS, Rozzano, Italy
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy; Endoscopy Unit, Humanitas Clinical and Research Center-IRCCS, Rozzano, Italy
| | - Ludovico Alfarone
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy; Endoscopy Unit, Humanitas Clinical and Research Center-IRCCS, Rozzano, Italy
| | - Leonardo Da Rio
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy; Endoscopy Unit, Humanitas Clinical and Research Center-IRCCS, Rozzano, Italy
| | - Roberta Maselli
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy; Endoscopy Unit, Humanitas Clinical and Research Center-IRCCS, Rozzano, Italy
| | - Silvia Carrara
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| | | | - Gaia Pellegatta
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| | - Alessandro Fugazza
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| | - Glenn Koleth
- Department of Gastroenterology and Hepatology, Hospital Selayang, Selangor, Malaysia
| | - James Emmanuel
- Department of Gastroenterology and Hepatology, Queen Elizabeth Hospital, Sabah, Malaysia
| | - Andrea Anderloni
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| | - Yuichi Mori
- Clinical Effectiveness Research Group, Institute of Health and Society, Faculty of Medicine, University of Oslo, Oslo, Norway; Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Michael B Wallace
- Endoscopy Unit, Sheikh Shakhbout Medical City, Abu Dhabi, United Arab Emirates
| | - Prateek Sharma
- Department of Gastroenterology and Hepatology, Kansas City VA Medical Center, Kansas City, USA
| | - Alessandro Repici
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy; Endoscopy Unit, Humanitas Clinical and Research Center-IRCCS, Rozzano, Italy
| |
Collapse
|
18
|
Hicks SA, Strümke I, Thambawita V, Hammou M, Riegler MA, Halvorsen P, Parasa S. On evaluation metrics for medical applications of artificial intelligence. Sci Rep 2022; 12:5979. [PMID: 35395867 PMCID: PMC8993826 DOI: 10.1038/s41598-022-09954-8] [Citation(s) in RCA: 108] [Impact Index Per Article: 54.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 03/30/2022] [Indexed: 12/18/2022] Open
Abstract
Clinicians and software developers need to understand how proposed machine learning (ML) models could improve patient care. No single metric captures all the desirable properties of a model, which is why several metrics are typically reported to summarize a model’s performance. Unfortunately, these measures are not easily understandable by many clinicians. Moreover, comparison of models across studies in an objective manner is challenging, and no tool exists to compare models using the same performance metrics. This paper looks at previous ML studies done in gastroenterology, provides an explanation of what different metrics mean in the context of binary classification in the presented studies, and gives a thorough explanation of how different metrics should be interpreted. We also release an open source web-based tool that may be used to aid in calculating the most relevant metrics presented in this paper so that other researchers and clinicians may easily incorporate them into their research.
Collapse
Affiliation(s)
- Steven A Hicks
- SimulaMet, Oslo, Norway. .,Oslo Metropolitan University, Oslo, Norway.
| | | | | | | | | | - Pål Halvorsen
- SimulaMet, Oslo, Norway.,Oslo Metropolitan University, Oslo, Norway
| | | |
Collapse
|
19
|
Van Berkel N, Opie J, Ahmad OF, Lovat L, Stoyanov D, Blandford A. Initial Responses to False Positives in AI-Supported Continuous Interactions: A Colonoscopy Case Study. ACM T INTERACT INTEL 2022. [DOI: 10.1145/3480247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2022]
Abstract
The use of artificial intelligence (AI) in clinical support systems is increasing. In this article, we focus on AI support for continuous interaction scenarios. A thorough understanding of end-user behaviour during these continuous human-AI interactions, in which user input is sustained over time and during which AI suggestions can appear at any time, is still missing. We present a controlled lab study involving 21 endoscopists and an AI colonoscopy support system. Using a custom-developed application and an off-the-shelf videogame controller, we record participants’ navigation behaviour and clinical assessment across 14 endoscopic videos. Each video is manually annotated to mimic an AI recommendation, being either true positive or false positive in nature. We find that time between AI recommendation and clinical assessment is significantly longer for incorrect assessments. Further, the type of medical content displayed significantly affects decision time. Finally, we discover that the participant’s clinical role plays a large part in the perception of clinical AI support systems. Our study presents a realistic assessment of the effects of imperfect and continuous AI support in a clinical scenario.
Collapse
Affiliation(s)
- Niels Van Berkel
- Aalborg University, Denmark and University College London, London, United Kingdom
| | - Jeremy Opie
- University College London, London, United Kingdom
| | | | - Laurence Lovat
- University College London Hospitals, London, United Kingdom
| | | | | |
Collapse
|
20
|
Li JW, Wang LM, Ang TL. Artificial intelligence-assisted colonoscopy: a narrative review of current data and clinical applications. Singapore Med J 2022; 63:118-124. [PMID: 35509251 PMCID: PMC9251247 DOI: 10.11622/smedj.2022044] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/22/2023]
Abstract
Colonoscopy is the reference standard procedure for the prevention and diagnosis of colorectal cancer, which is a leading cause of cancer-related deaths in Singapore. Artificial intelligence systems are automated, objective and reproducible. Artificial intelligence-assisted colonoscopy has recently been introduced into clinical practice as a clinical decision support tool. This review article provides a summary of the current published data and discusses ongoing research and current clinical applications of artificial intelligence-assisted colonoscopy.
Collapse
Affiliation(s)
- James Weiquan Li
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- SingHealth Duke-NUS Medicine Academic Clinical Programme, Singapore
| | - Lai Mun Wang
- Pathology Section, Department of Laboratory Medicine, Changi General Hospital, Singapore
- SingHealth Duke-NUS Pathology Academic Clinical Programme, Singapore
| | - Tiing Leong Ang
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- SingHealth Duke-NUS Medicine Academic Clinical Programme, Singapore
| |
Collapse
|
21
|
Kader R, Baggaley RF, Hussein M, Ahmad OF, Patel N, Corbett G, Dolwani S, Stoyanov D, Lovat LB. Survey on the perceptions of UK gastroenterologists and endoscopists to artificial intelligence. Frontline Gastroenterol 2022; 13:423-429. [PMID: 36046492 PMCID: PMC9380773 DOI: 10.1136/flgastro-2021-101994] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Accepted: 12/21/2021] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND AND AIMS With the potential integration of artificial intelligence (AI) into clinical practice, it is essential to understand end users' perception of this novel technology. The aim of this study, which was endorsed by the British Society of Gastroenterology (BSG), was to evaluate the UK gastroenterology and endoscopy communities' views on AI. METHODS An online survey was developed and disseminated to gastroenterologists and endoscopists across the UK. RESULTS One hundred four participants completed the survey. Quality improvement in endoscopy (97%) and better endoscopic diagnosis (92%) were perceived as the most beneficial applications of AI to clinical practice. The most significant challenges were accountability for incorrect diagnoses (85%) and potential bias of algorithms (82%). A lack of guidelines (92%) was identified as the greatest barrier to adopting AI in routine clinical practice. Participants identified real-time endoscopic image diagnosis (95%) as a research priority for AI, while the most perceived significant barriers to AI research were funding (82%) and the availability of annotated data (76%). Participants consider the priorities for the BSG AI Task Force to be identifying research priorities (96%), guidelines for adopting AI devices in clinical practice (93%) and supporting the delivery of multicentre clinical trials (91%). CONCLUSION This survey has identified views from the UK gastroenterology and endoscopy community regarding AI in clinical practice and research, and identified priorities for the newly formed BSG AI Task Force.
Collapse
Affiliation(s)
- Rawen Kader
- Division of Surgery and Interventional Sciences, University College London, London, UK
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London, UK
- Department of Gastroenterology, University College London Hospitals NHS Foundation Trust, London, UK
| | - Rebecca F Baggaley
- Department of Respiratory Infections, University of Leicester, Leicester, UK
| | - Mohamed Hussein
- Division of Surgery and Interventional Sciences, University College London, London, UK
- Department of Gastroenterology, University College London Hospitals NHS Foundation Trust, London, UK
| | - Omer F Ahmad
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London, UK
- Department of Gastroenterology, University College London Hospitals NHS Foundation Trust, London, UK
| | - Nisha Patel
- Department of Gastroenterology, Imperial College Healthcare NHS Trust, London, UK
| | - Gareth Corbett
- Department of Gastroenterology, Addenbrooke's Hospital, Cambridge, UK
| | - Sunil Dolwani
- Division of Population Medicine, School of Medicine, Cardiff University, Cardiff, UK
| | - Danail Stoyanov
- Division of Surgery and Interventional Sciences, University College London, London, UK
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London, UK
| | - Laurence B Lovat
- Division of Surgery and Interventional Sciences, University College London, London, UK
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London, UK
- Department of Gastroenterology, University College London Hospitals NHS Foundation Trust, London, UK
| |
Collapse
|
22
|
Sánchez-Peralta LF, Pagador JB, Sánchez-Margallo FM. Artificial Intelligence for Colorectal Polyps in Colonoscopy. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
23
|
Leenhardt R, Fernandez-Urien Sainz I, Rondonotti E, Toth E, Van de Bruaene C, Baltes P, Rosa BJ, Triantafyllou K, Histace A, Koulaouzidis A, Dray X. PEACE: Perception and Expectations toward Artificial Intelligence in Capsule Endoscopy. J Clin Med 2021; 10:jcm10235708. [PMID: 34884410 PMCID: PMC8658716 DOI: 10.3390/jcm10235708] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Revised: 11/22/2021] [Accepted: 11/22/2021] [Indexed: 12/16/2022] Open
Abstract
Artificial intelligence (AI) has shown promising results in digestive endoscopy, especially in capsule endoscopy (CE). However, some physicians still have some difficulties and fear the advent of this technology. We aimed to evaluate the perceptions and current sentiments toward the use of AI in CE. An online survey questionnaire was sent to an audience of gastroenterologists. In addition, several European national leaders of the International CApsule endoscopy REsearch (I CARE) Group were asked to disseminate an online survey among their national communities of CE readers (CER). The survey included 32 questions regarding general information, perceptions of AI, and its use in daily life, medicine, endoscopy, and CE. Among 380 European gastroenterologists who answered this survey, 333 (88%) were CERs. The mean average time length of experience in CE reading was 9.9 years (0.5–22). A majority of CERs agreed that AI would positively impact CE, shorten CE reading time, and help standardize reporting in CE and characterize lesions seen in CE. Nevertheless, in the foreseeable future, a majority of CERs disagreed with the complete replacement all CE reading by AI. Most CERs believed in the high potential of AI for becoming a valuable tool for automated diagnosis and for shortening the reading time. Currently, the perception is that AI will not replace CE reading.
Collapse
Affiliation(s)
- Romain Leenhardt
- Endoscopy Unit, Saint Antoine Hospital, Sorbonne University, APHP, 75012 Paris, France;
- ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy-Pontoise, France;
| | | | | | - Ervin Toth
- Department of Gastroenterology, Skane University Hospital, Lund University, 214 28 Malmo, Sweden;
| | | | - Peter Baltes
- Klinik für Innere Medizin, Agaplesion Bethesda Krankenhaus Bergedorf, 21029 Hamburg, Germany;
| | - Bruno Joel Rosa
- Department of Gastroenterology, Hospital da Senhora da Oliveira, 4835-044 Guimarães, Portugal;
- Life and Health Sciences Research Institute, School of Medicine, University of Minho, 4704-553 Braga, Portugal
| | - Konstantinos Triantafyllou
- Hepatogastroenterology Unit, Second Department of Internal Propaedeutic Medicine, Attikon University General Hospital, Medical School, National and Kapodistrian University of Athens, 10679 Athens, Greece;
| | - Aymeric Histace
- ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy-Pontoise, France;
| | - Anastasios Koulaouzidis
- Department of Social Medicine & Public Health, Faculty of Health Sciences, Pomeranian Medical University, 70-204 Szczecin, Poland;
| | - Xavier Dray
- Endoscopy Unit, Saint Antoine Hospital, Sorbonne University, APHP, 75012 Paris, France;
- ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy-Pontoise, France;
- Correspondence: ; Tel.: +33-149282000
| | | |
Collapse
|
24
|
Kader R, Hadjinicolaou AV, Georgiades F, Stoyanov D, Lovat LB. Optical diagnosis of colorectal polyps using convolutional neural networks. World J Gastroenterol 2021; 27:5908-5918. [PMID: 34629808 PMCID: PMC8475008 DOI: 10.3748/wjg.v27.i35.5908] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Revised: 04/29/2021] [Accepted: 08/24/2021] [Indexed: 02/06/2023] Open
Abstract
Colonoscopy remains the gold standard investigation for colorectal cancer screening as it offers the opportunity to both detect and resect pre-malignant and neoplastic polyps. Although technologies for image-enhanced endoscopy are widely available, optical diagnosis has not been incorporated into routine clinical practice, mainly due to significant inter-operator variability. In recent years, there has been a growing number of studies demonstrating the potential of convolutional neural networks (CNN) to enhance optical diagnosis of polyps. Data suggest that the use of CNNs might mitigate the inter-operator variability amongst endoscopists, potentially enabling a “resect and discard“ or ”leave in“ strategy to be adopted in real-time. This would have significant financial benefits for healthcare systems, avoid unnecessary polypectomies of non-neoplastic polyps and improve the efficiency of colonoscopy. Here, we review advances in CNN for the optical diagnosis of colorectal polyps, current limitations and future directions.
Collapse
Affiliation(s)
- Rawen Kader
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London W1W 7TY, United Kingdom
- Division of Surgery and Interventional Sciences, University College London, London W1W 7TY, United Kingdom
| | - Andreas V Hadjinicolaou
- MRC Cancer Unit, Department of Gastroenterology, University of Cambridge, Cambridge CB2 0QQ, United Kingdom
| | - Fanourios Georgiades
- Department of Surgery, University of Cambridge, Cambridge CB2 0QQ, United Kingdom
| | - Danail Stoyanov
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London W1W 7TY, United Kingdom
- Department of Computer Science, University College London, London W1W 7TY, United Kingdom
| | - Laurence B Lovat
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London W1W 7TY, United Kingdom
- Division of Surgery and Interventional Sciences, University College London, London W1W 7TY, United Kingdom
| |
Collapse
|
25
|
Mori Y, Bretthauer M. Addressing false-positive findings with artificial intelligence for polyp detection. Endoscopy 2021; 53:941-942. [PMID: 34438457 DOI: 10.1055/a-1381-7849] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Affiliation(s)
- Yuichi Mori
- Clinical Effectiveness Research Group, Institute of Health and Society, Faculty of Medicine, University of Oslo, Oslo, Norway.,Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Michael Bretthauer
- Clinical Effectiveness Research Group, Institute of Health and Society, Faculty of Medicine, University of Oslo, Oslo, Norway.,Department of Transplantation Medicine, Oslo University Hospital, Oslo, Norway
| |
Collapse
|
26
|
Affiliation(s)
- Nicholas G Burgess
- Department of Gastroenterology and Hepatology, Westmead Hospital, Sydney, Australia.,Westmead Clinical School, University of Sydney, Sydney, Australia
| |
Collapse
|
27
|
Computer-Aided Detection False Positives in Colonoscopy. Diagnostics (Basel) 2021; 11:diagnostics11061113. [PMID: 34207226 PMCID: PMC8235696 DOI: 10.3390/diagnostics11061113] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Revised: 06/08/2021] [Accepted: 06/14/2021] [Indexed: 12/24/2022] Open
Abstract
Randomized control trials and meta-analyses comparing colonoscopies with and without computer-aided detection (CADe) assistance showed significant increases in adenoma detection rates (ADRs) with CADe. A major limitation of CADe is its false positives (FPs), ranked 3rd in importance among 59 research questions in a modified Delphi consensus review. The definition of FPs varies. One commonly used definition defines an FP as an activation of the CADe system, irrespective of the number of frames or duration of time, not due to any polypoid or nonpolypoid lesions. Although only 0.07 to 0.2 FPs were observed per colonoscopy, video analysis studies using FPs as the primary outcome showed much higher numbers of 26 to 27 per colonoscopy. Most FPs were of short duration (91% < 0.5 s). A higher number of FPs was also associated with suboptimal bowel preparation. The appearance of FPs can lead to user fatigue. The polypectomy of FPs results in increased procedure time and added use of resources. Re-training the CADe algorithms is one way to reduce FPs but is not practical in the clinical setting during colonoscopy. Water exchange (WE) is an emerging method that the colonoscopist can use to provide salvage cleaning during insertion. We discuss the potential of WE for reducing FPs as well as the augmentation of ADRs through CADe.
Collapse
|
28
|
Sánchez-Peralta LF, Pagador JB, Sánchez-Margallo FM. Artificial Intelligence for Colorectal Polyps in Colonoscopy. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_308-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|