Efficacy of Real-Time Computer-Aided Detection of Colorectal Neoplasia in a Randomized Trial

Deep Learning for Automatic Identification and Characterization of the Bleeding Potential of Enteric Protruding Lesions in Capsule Endoscopy

Background and Aims

Capsule endoscopy (CE) revolutionized the study of the small intestine, overcoming the limitations of conventional endoscopy. Nevertheless, reviewing CE images is time-consuming. Convolutional Neural Networks (CNNs) are an artificial intelligence architecture with high performance levels for image analysis. Protruding lesions of the small intestine exhibit enormous morphologic diversity in CE images. We aimed to develop a CNN-based algorithm for automatic detection of varied small-bowel protruding lesions.

Methods

A CNN was developed using a pool of CE images containing protruding lesions or normal mucosa/other findings. A total of 2565 patients were included. These images were inserted into a CNN model with transfer learning. We evaluated the performance of the network by calculating its sensitivity, specificity, accuracy, positive predictive value, and negative predictive value.

Results

A CNN was developed based on a total of 21,320 CE images. Training and validation data sets comprising 80% and 20% of the total pool of images, respectively, were constructed for development and testing of the network. The algorithm automatically detected small-bowel protruding lesions with an accuracy of 97.1%. Our CNN had a sensitivity, specificity, positive, and negative predictive values of 95.9%, 97.1%, 83.0%, and 95.7%, respectively. The CNN operated at a rate of approximately 355 frames per second.

Conclusion

We developed an accurate CNN for automatic detection of enteric protruding lesions with a wide range of morphologies. The development of these tools may enhance the diagnostic efficiency of CE.

Paper-based genetic assays with bioconjugated gold nanorods and an automated readout pipeline

Paper-based biosensors featuring immunoconjugated gold nanoparticles have gained extraordinary momentum in recent times as the platform of choice in key cases of field applications, including the so-called rapid antigen tests for SARS-CoV-2. Here, we propose a revision of this format, one that may leverage on the most recent advances in materials science and data processing. In particular, we target an amplifiable DNA rather than a protein analyte, and we replace gold nanospheres with anisotropic nanorods, which are intrinsically brighter by a factor of ~ 10, and multiplexable. By comparison with a gold-standard method for dot-blot readout with digoxigenin, we show that gold nanorods entail much faster and easier processing, at the cost of a higher limit of detection (from below 1 to 10 ppm in the case of plasmid DNA containing a target transgene, in our current setup). In addition, we test a complete workflow to acquire and process photographs of dot-blot membranes with custom-made hardware and regression tools, as a strategy to gain more analytical sensitivity and potential for quantification. A leave-one-out approach for training and validation with as few as 36 sample instances already improves the limit of detection reached by the naked eye by a factor around 2. Taken together, we conjecture that the synergistic combination of new materials and innovative tools for data processing may bring the analytical sensitivity of paper-based biosensors to approach the level of lab-grade molecular tests.

Convolutional Neural Networks for Mechanistic Driver Detection in Atrial Fibrillation

The maintaining and initiating mechanisms of atrial fibrillation (AF) remain controversial. Deep learning is emerging as a powerful tool to better understand AF and improve its treatment, which remains suboptimal. This paper aims to provide a solution to automatically identify rotational activity drivers in endocardial electrograms (EGMs) with convolutional recurrent neural networks (CRNNs). The CRNN model was compared with two other state-of-the-art methods (SimpleCNN and attention-based time-incremental convolutional neural network (ATI-CNN)) for different input signals (unipolar EGMs, bipolar EGMs, and unipolar local activation times), sampling frequencies, and signal lengths. The proposed CRNN obtained a detection score based on the Matthews correlation coefficient of 0.680, an ATI-CNN score of 0.401, and a SimpleCNN score of 0.118, with bipolar EGMs as input signals exhibiting better overall performance. In terms of signal length and sampling frequency, no significant differences were found. The proposed architecture opens the way for new ablation strategies and driver detection methods to better understand the AF problem and its treatment.

Artificial Intelligence in Digestive Endoscopy—Where Are We and Where Are We Going?

Artificial intelligence, a computer-based concept that tries to mimic human thinking, is slowly becoming part of the endoscopy lab. It has developed considerably since the first attempt at developing an automated medical diagnostic tool, today being adopted in almost all medical fields, digestive endoscopy included. The detection rate of preneoplastic lesions (i.e., polyps) during colonoscopy may be increased with artificial intelligence assistance. It has also proven useful in detecting signs of ulcerative colitis activity. In upper digestive endoscopy, deep learning models may prove to be useful in the diagnosis and management of upper digestive tract diseases, such as gastroesophageal reflux disease, Barrett’s esophagus, and gastric cancer. As is the case with all new medical devices, there are challenges in the implementation in daily medical practice. The regulatory, economic, organizational culture, and language barriers between humans and machines are a few of them. Even so, many devices have been approved for use by their respective regulators. Future studies are currently striving to develop deep learning models that can replicate a growing amount of human brain activity. In conclusion, artificial intelligence may become an indispensable tool in digestive endoscopy.

Performance of Convolutional Neural Networks for Polyp Localization on Public Colonoscopy Image Datasets

Colorectal cancer is one of the most frequent malignancies. Colonoscopy is the de facto standard for precancerous lesion detection in the colon, i.e., polyps, during screening studies or after facultative recommendation. In recent years, artificial intelligence, and especially deep learning techniques such as convolutional neural networks, have been applied to polyp detection and localization in order to develop real-time CADe systems. However, the performance of machine learning models is very sensitive to changes in the nature of the testing instances, especially when trying to reproduce results for totally different datasets to those used for model development, i.e., inter-dataset testing. Here, we report the results of testing of our previously published polyp detection model using ten public colonoscopy image datasets and analyze them in the context of the results of other 20 state-of-the-art publications using the same datasets. The F1-score of our recently published model was 0.88 when evaluated on a private test partition, i.e., intra-dataset testing, but it decayed, on average, by 13.65% when tested on ten public datasets. In the published research, the average intra-dataset F1-score is 0.91, and we observed that it also decays in the inter-dataset setting to an average F1-score of 0.83.

Quality Indicators for the Detection and Removal of Colorectal Polyps and Interventions to Improve Them

Modifiable risk factors for postcolonoscopy colorectal cancer include suboptimal lesion detection (missed neoplasms) and inadequate lesion removal (incomplete polypectomy) during colonoscopy. Competent detection and removal of colorectal polyps are thus fundamental to ensuring adequate colonoscopy quality. Several well-researched quality metrics for polyp detection have been implemented into clinical practice, chief among these the adenoma detection rate. Less data are available on quality indicators for polyp removal, which currently include complete resection rates and skills assessment tools. This review summarizes the available literature on quality indicators for the detection and removal of colorectal polyps, as well as interventions to improve them.

Artificial Intelligence for Disease Assessment in Inflammatory Bowel Disease: How Will it Change Our Practice?

Artificial intelligence (AI) has arrived and it will directly impact how we assess, monitor, and manage inflammatory bowel disease (IBD). Advances in the machine learning methodologies that power AI have produced astounding results for replicating expert judgment and predicting clinical outcomes, particularly in the analysis of imaging. This review will cover general concepts for AI in IBD, with descriptions of common machine learning methods, including decision trees and neural networks. Applications of AI in IBD will cover recent achievements in endoscopic image interpretation and scoring, new capabilities for cross-sectional image analysis, natural language processing for automated understanding of clinical text, and progress in AI-powered clinical decision support tools. In addition to detailing current evidence supporting the capabilities of AI for replicating expert clinical judgment, speculative commentary on how AI may advance concepts of disease activity assessment, care pathways, and pathophysiologic mechanisms of IBD will be addressed.

Artificial intelligence in colonoscopy: A review on the current status

Artificial intelligence has become an increasingly hot topic in the last several years, and it has also gained its way into the medical field. In recent years, the application of artificial intelligence in the gastroenterology field has been of increasing interest, particularly in the colonoscopy setting. Novel technologies such as deep neural networks have enabled real‐time computer‐aided polyp detection and diagnosis during colonoscopy. This might lead to increased performance of endoscopists as well as potentially reducing the costs of unnecessary polypectomies of hyperplastic polyps. Newly published prospective trials studying computer‐aided detection showed that the assistance of artificial intelligence significantly increased the detection of polyps and non‐advanced adenomas approximately by 10%, while three tandem randomized control trials proved that the adenoma miss rate was significantly reduced (e.g., 13.8% vs. 36.7% in one Japanese multicenter trial). Promising results have also been shown in prospective single‐arm trials on computer‐aided polyp diagnosis, but the evidence is insufficient to reach a conclusion.

Artificial intelligence and colonoscopy experience: lessons from two randomised trials

BACKGROUND AND AIMS

Artificial intelligence has been shown to increase adenoma detection rate (ADR) as the main surrogate outcome parameter of colonoscopy quality. To which extent this effect may be related to physician experience is not known. We performed a randomised trial with colonoscopists in their qualification period (AID-2) and compared these data with a previously published randomised trial in expert endoscopists (AID-1).

METHODS

In this prospective, randomised controlled non-inferiority trial (AID-2), 10 non-expert endoscopists (<2000 colonoscopies) performed screening/surveillance/diagnostic colonoscopies in consecutive 40-80 year-old subjects using high-definition colonoscopy with or without a real-time deep-learning computer-aided detection (CADe) (GI Genius, Medtronic). The primary outcome was ADR in both groups with histology of resected lesions as reference. In a post-hoc analysis, data from this randomised controlled trial (RCT) were compared with data from the previous AID-1 RCT involving six experienced endoscopists in an otherwise similar setting.

RESULTS

In 660 patients (62.3±10 years; men/women: 330/330) with equal distribution of study parameters, overall ADR was higher in the CADe than in the control group (53.3% vs 44.5%; relative risk (RR): 1.22; 95% CI: 1.04 to 1.40; p<0.01 for non-inferiority and p=0.02 for superiority). Similar increases were seen in adenoma numbers per colonoscopy and in small and distal lesions. No differences were observed with regards to detection of non-neoplastic lesions. When pooling these data with those from the AID-1 study, use of CADe (RR 1.29; 95% CI: 1.16 to 1.42) and colonoscopy indication, but not the level of examiner experience (RR 1.02; 95% CI: 0.89 to 1.16) were associated with ADR differences in a multivariate analysis.

CONCLUSIONS

In less experienced examiners, CADe assistance during colonoscopy increased ADR and a number of related polyp parameters as compared with the control group. Experience appears to play a minor role as determining factor for ADR.

TRIAL REGISTRATION NUMBER

NCT:04260321.

Implementation of artificial intelligence in upper gastrointestinal endoscopy

The application of artificial intelligence (AI) using deep learning has significantly expanded in the field of esophagogastric endoscopy. Recent studies have shown promising results in detecting and differentiating early gastric cancer using AI tools built using white light, magnified, or image-enhanced endoscopic images. Some studies have reported the use of AI tools to predict the depth of early gastric cancer based on endoscopic images. Similarly, studies based on using AI for detecting early esophageal cancer have also been reported, with an accuracy comparable to that of endoscopy specialists. Moreover, an AI system, developed to diagnose pharyngeal cancer, has shown promising performance with high sensitivity. These reports suggest that, if introduced for regular use in clinical settings, AI systems can significantly reduce the burden on physicians. This review summarizes the current status of AI applications in the upper gastrointestinal tract and presents directions for clinical practice implementation and future research.

Detection of colorectal lesions during colonoscopy

Owing to its high mortality rate, the prevention of colorectal cancer is of particular importance. The resection of colorectal polyps is reported to drastically reduce colorectal cancer mortality, and examination by endoscopists who had a high adenoma detection rate was found to lower the risk of colorectal cancer, highlighting the importance of identifying lesions. Various devices, imaging techniques, and diagnostic tools aimed at reducing the rate of missed lesions have therefore been developed to improve detection. The distal attachments and devices for improving the endoscopic view angle are intended to help avoid missing blind spots such as folds and flexures in the colon, whereas the imaging techniques represented by image‐enhanced endoscopy contribute to improving lesion visibility. Recent advances in artificial intelligence‐supported detection systems are expected to supplement an endoscopist's eye through the instant diagnosis of the lesions displayed on the monitor. In this review, we provide an outline of each tool and assess its impact on the reduction in the incidence of missed colorectal polyps by summarizing previous clinical research and meta‐analyses. Although useful, the many devices, image‐enhanced endoscopy, and artificial intelligence tools exhibited various limitations. Integrating these tools can improve their shortcomings. Combining artificial intelligence‐based diagnoses with wide‐angle image‐enhanced endoscopy may be particularly useful. Thus, we hope that such tools will be available in the near future.

Discovering the first US FDA-approved computer-aided polyp detection system

Colorectal cancer is the third most common cancer worldwide. Because of the slow progression of the precancerous precursors, an efficient endoscopic surveillance strategy may be expected. It seems that around one-fourth of colorectal malignancies are still missed during colonoscopy. Several endoscopic technologies have been introduced, without radical changes. Interest in the development of artificial intelligence applications in the medical field has grown in the past decade. Artificial intelligence can help to highlight a specific region of interest that needs closer examination for the identification of polyps. The aim of this review is to report the first clinical experiences with the first US FDA-approved, real-time, deep-learning, computer-aided detection system (GI Genius™, Medtronic).

The influence of computer-aided polyp detection systems on reaction time for polyp detection and eye gaze

BACKGROUND

Multiple computer-aided systems for polyp detection (CADe) have been introduced into clinical practice, with an unclear effect on examiner behavior. This study aimed to measure the influence of a CADe system on reaction time, mucosa misinterpretation, and changes in visual gaze pattern.

METHODS

Participants with variable levels of colonoscopy experience viewed video sequences (n = 29) while eye movement was tracked. Using a crossover design, videos were presented in two assessments, with and without CADe support. Reaction time for polyp detection and eye-tracking metrics were evaluated.

RESULTS

21 participants performed 1218 experiments. CADe was significantly faster in detecting polyps compared with participants (median 1.16 seconds [99 %CI 0.40-3.43] vs. 2.97 seconds [99 %CI 2.53-3.77], respectively). However, the reaction time of participants when using CADe (median 2.90 seconds [99 %CI 2.55-3.38]) was similar to that without CADe. CADe increased misinterpretation of normal mucosa and reduced the eye travel distance.

CONCLUSIONS

Results confirm that CADe systems detect polyps faster than humans. However, use of CADe did not improve human reaction times. It increased misinterpretation of normal mucosa and decreased the eye travel distance. Possible consequences of these findings might be prolonged examination time and deskilling.

Initial Responses to False Positives in AI-Supported Continuous Interactions: A Colonoscopy Case Study

The use of artificial intelligence (AI) in clinical support systems is increasing. In this article, we focus on AI support for continuous interaction scenarios. A thorough understanding of end-user behaviour during these continuous human-AI interactions, in which user input is sustained over time and during which AI suggestions can appear at any time, is still missing. We present a controlled lab study involving 21 endoscopists and an AI colonoscopy support system. Using a custom-developed application and an off-the-shelf videogame controller, we record participants’ navigation behaviour and clinical assessment across 14 endoscopic videos. Each video is manually annotated to mimic an AI recommendation, being either true positive or false positive in nature. We find that time between AI recommendation and clinical assessment is significantly longer for incorrect assessments. Further, the type of medical content displayed significantly affects decision time. Finally, we discover that the participant’s clinical role plays a large part in the perception of clinical AI support systems. Our study presents a realistic assessment of the effects of imperfect and continuous AI support in a clinical scenario.

Software Analysis of Colonoscopy Videos Enhances Teaching and Quality Metrics

Purpose

Machine learning algorithms were hypothesized as being able to predict the quality of colonoscopy luminal images. This is to enhance training and quality indicators in endoscopy.

Methods

A separate study involving a randomized controlled trial of capped vs. un-capped colonoscopies provided the colonoscopy videos for this study. Videos were analyzed with an algorithm devised by the Australian Institute for Machine Learning. The image analysis validated focus measure, steerable filters-based metrics (SFIL), was used to assess luminal visualization quality and was compared with two independent clinician assessments (C1 and C2). Goodman and Kruskal's gamma (G) measure was used to assess rank correlation data using IBM SPSS Statistics for Windows, version 25.0 (IBM Corp., Armonk, NY).

Results

A total of 500 random colonoscopy video clips were extracted and analyzed, 88 being excluded. SFIL scores matched with C1 in 45% and C2 in 42% of cases, respectively. There was a significant correlation between SFIL and C1 (G = 0.644, p < 0.005) and SFIL and C2 (G = 0.734, p < 0.005).

Conclusion

This study demonstrates that machine learning algorithms can recognize the quality of luminal visualization during colonoscopy. We intend to apply this in the future to enhance colonoscopy training and as a metric for quality assessment.

Artificial intelligence-assisted colonoscopy: a narrative review of current data and clinical applications

Colonoscopy is the reference standard procedure for the prevention and diagnosis of colorectal cancer, which is a leading cause of cancer-related deaths in Singapore. Artificial intelligence systems are automated, objective and reproducible. Artificial intelligence-assisted colonoscopy has recently been introduced into clinical practice as a clinical decision support tool. This review article provides a summary of the current published data and discusses ongoing research and current clinical applications of artificial intelligence-assisted colonoscopy.

Effect of artificial intelligence-aided colonoscopy for adenoma and polyp detection: a meta-analysis of randomized clinical trials

BACKGROUND

This meta-analysis aimed to determine whether artificial intelligence (AI) improves colonoscopy outcome metrics i.e. adenoma detection rate (ADR) and polyp detection rate (PDR).

METHODS

Two authors independently searched Web of Science, PubMed, Science Direct, and Cochrane Library to find all published research before July 2021 that has compared AI-aided colonoscopy with routine colonoscopy (RC) for detection of adenoma and polyp.

RESULTS

This meta-analysis included 10 RCTs with 6629 individuals in AI-aided (n = 3300) and routine (n = 3329) groups. The results showed that both ADR (RR, 1.43; P < 0.001) and PDR (RR, 1.44; P < 0.001) using AI-aided endoscopy were significantly greater when compared with RC. The adenomas detected per colonoscopy (APC) (WMD, 0.25; P = 0.009), polyps detected per colonoscopy (PPC) (WMD, 0.52; P < 0.001), and sessile serrated lesions detected per colonoscopy (SSLPC) (RR, 1.53; P < 0.001) were significantly higher in the AI-aided group compared with the RC group. Subgroup analysis based on size, location, and shape of adenomas and polyps demonstrated that, except for in the cecum and pedunculated adenomas or polyps, the AI-aided groups of the other subgroups are more advantageous. Withdrawal time was longer in the AI-aided group when biopsies were included, while withdrawal time excluding biopsy time showed no significant difference.

CONCLUSIONS

AI-aided polyp detection system significantly increases lesion detection rate. In addition, lesion detection by AI is hardly affected by factors such as size, location, and shape.

Artificial intelligence in colorectal cancer screening in patients with inflammatory bowel disease

Artificial intelligence (AI) is a branch of computer science that develops intelligent machines. In recent years, medicine has been contemplated with this recent modality to aid in the diagnosis of diseases in several specialties, including gastroenterology and gastrointestinal endoscopy. This new technology has superior ability to perform tasks mimicking human behavior and can identify possible pathological alterations, such as pre-malignant lesions and dysplasia, precursor lesions of colorectal cancer (CRC), and support medical decision-making. CRC is among the three most prevalent cancer types, and the second most common cause of cancer-related deaths worldwide; in addition, it is a leading cause of death in patients with inflammatory bowel disease (IBD). Patients with IBD tend to have greater inflammatory cell activity in the intestinal mucosa, which can favor cell proliferation and CRC development. AI can contribute to the detection of pre-neoplastic lesions in patients at risk of CRC development, such as those with extensive IBD or when additional CRC risk factors, such as smoking, are present. In fact, AI systems could improve all aspects of care related to both the detection of pre-malignant and malignant lesions and the screening of patients with IBD. In this review, we aimed to show the benefits and innovations of AI in the screening of CRC in patients with IBD. The promising applications of AI have the potential to revolutionize clinical practice and gastrointestinal endoscopy, especially in at-risk patients, such as those with IBD.

Real-time artificial intelligence for detecting focal lesions and diagnosing neoplasms of the stomach by white-light endoscopy (with videos)

BACKGROUND AND AIMS

White-light endoscopy (WLE) is the most pivotal tool to detect gastric cancer in an early stage. However, the skill among endoscopists varies greatly. Here, we aim to develop a deep learning-based system named ENDOANGEL-LD (lesion detection) to assist in detecting all focal gastric lesions and predicting neoplasms by WLE.

METHODS

Endoscopic images were retrospectively obtained from Renmin Hospital of Wuhan University (RHWU) for the development, validation, and internal test of the system. Additional external tests were conducted in 5 other hospitals to evaluate the robustness. Stored videos from RHWU were used for assessing and comparing the performance of ENDOANGEL-LD with that of experts. Prospective consecutive patients undergoing upper endoscopy were enrolled from May 6, 2021 to August 2, 2021 in RHWU to assess clinical practice applicability.

RESULTS

Over 10,000 patients undergoing upper endoscopy were enrolled in this study. The sensitivities were 96.9% and 95.6% for detecting gastric lesions and 92.9% and 91.7% for diagnosing neoplasms in internal and external patients, respectively. In 100 videos, ENDOANGEL-LD achieved superior sensitivity and negative predictive value for detecting gastric neoplasms from that of experts (100% vs 85.5% ± 3.4% [P = .003] and 100% vs 86.4% ± 2.8% [P = .002], respectively). In 2010 prospective consecutive patients, ENDOANGEL-LD achieved a sensitivity of 92.8% for detecting gastric lesions with 3.04 ± 3.04 false positives per gastroscopy and a sensitivity of 91.8% and specificity of 92.4% for diagnosing neoplasms.

CONCLUSIONS

Our results show that ENDOANGEL-LD has great potential for assisting endoscopists in screening gastric lesions and suspicious neoplasms in clinical work. (Clinical trial registration number: ChiCTR2100045963.).

Adenoma detection by Endocuff-assisted versus standard colonoscopy in an organized screening program: the "ItaVision" randomized controlled trial

BACKGROUND

The Endocuff Vision device (Arc Medical Design Ltd., Leeds, UK) has been shown to increase mucosal exposure, and consequently adenoma detection rate (ADR), during colonoscopy. This nationwide multicenter study assessed possible benefits and harms of using Endocuff Vision in a fecal immunochemical test (FIT)-based screening program.

METHODS

Patients undergoing colonoscopy after a FIT-positive test were randomized 1:1 to undergo Endocuff-assisted colonoscopy or standard colonoscopy, stratified by sex, age, and screening history. Primary outcome was ADR. Secondary outcomes were ADR stratified by endoscopists' ADR, advanced ADR (AADR), adenomas per colonoscopy (APC), withdrawal time, and adverse events.

RESULTS

1866 patients were enrolled across 13 centers. After exclusions, 1813 (mean age 60.1 years; male 53.8 %) were randomized (908 Endocuff Vision, 905 standard colonoscopy). ADR was significantly higher in the Endocuff Vision arm (47.8 % vs. 40.8 %; relative risk [RR] 1.17, 95 % confidence interval [CI] 1.06-1.30), with no differences between arms regarding size or morphology. When stratifying for endoscopists' ADR, only low detectors (ADR < 33.3 %) showed a statistically significant ADR increase (Endocuff Vision 41.1 % [95 %CI 35.7-46.7] vs. standard colonoscopy 26.0 % [95 %CI 21.3-31.4]). AADR (24.8 % vs. 20.5 %, RR 1.21, 95 %CI 1.02-1.43) and APC (0.94 vs. 0.77; P  = 0.001) were higher in the Endocuff Vision arm. Withdrawal time and adverse events were similar between arms.

CONCLUSION

Endocuff Vision increased ADR in a FIT-based screening program by improving examination of the whole colonic mucosa. Utility was highest among endoscopists with a low ADR.

Artificial Intelligence in Endoscopy

Background

Owing to their rapid development, artificial intelligence (AI) technologies offer a great promise for gastroenterology practice and research. At present, AI-guided image interpretation has already been used with success for endoscopic detection of early malignant lesions. Nonetheless, there are complex challenges and possible shortcomings that must be considered before full implementation can be realized.

Summary

In this review, the current status of AI in endoscopy is summarized. Future perspectives and open questions for further studies are stressed.

Key Messages

The usage of AI algorithms for polyp detection in screening colonoscopy results in a significant increase in the adenoma detection rate, mainly attributed to the identification of diminutive polyps. Computer-aided characterization of colorectal polyps accompanies the detection, but further studies are needed to evaluate the clinical benefit. In contrast to colonoscopy, usage of AI in gastroscopy is currently rather limited. Regarding other fields of endoscopic imaging, capsule endoscopy is the ideal imaging platform for AI, due to the potential of saving time in the video analysis.

Artificial Endoscopy and Inflammatory Bowel Disease: Welcome to the Future

Artificial intelligence (AI) is assuming an increasingly important and central role in several medical fields. Its application in endoscopy provides a powerful tool supporting human experiences in the detection, characterization, and classification of gastrointestinal lesions. Lately, the potential of AI technology has been emerging in the field of inflammatory bowel disease (IBD), where the current cornerstone is the treat-to-target strategy. A sensible and specific tool able to overcome human limitations, such as AI, could represent a great ally and guide precision medicine decisions. Here we reviewed the available literature on the endoscopic applications of AI in order to properly describe the current state-of-the-art and identify the research gaps in IBD at the dawn of 2022.

Artificial Intelligence-Aid Colonoscopy Vs. Conventional Colonoscopy for Polyp and Adenoma Detection: A Systematic Review of 7 Discordant Meta-Analyses

Objectives: Multiple meta-analyses which investigated the comparative efficacy and safety of artificial intelligence (AI)-aid colonoscopy (AIC) vs. conventional colonoscopy (CC) in the detection of polyp and adenoma have been published. However, a definitive conclusion has not yet been generated. This systematic review selected from discordant meta-analyses to draw a definitive conclusion about whether AIC is better than CC for the detection of polyp and adenoma. Methods: We comprehensively searched potentially eligible literature in PubMed, Embase, Cochrane library, and China National Knowledgement Infrastructure (CNKI) databases from their inceptions until to April 2021. Assessment of Multiple Systematic Reviews (AMSTAR) instrument was used to assess the methodological quality. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist was used to assess the reporting quality. Two investigators independently used the Jadad decision algorithm to select high-quality meta-analyses which summarized the best available evidence. Results: Seven meta-analyses met our selection criteria finally. AMSTAR score ranged from 8 to 10, and PRISMA score ranged from 23 to 26. According to the Jadad decision algorithm, two high-quality meta-analyses were selected. These two meta-analyses suggested that AIC was superior to CC for colonoscopy outcomes, especially for polyp detection rate (PDR) and adenoma detection rate (ADR). Conclusion: Based on the best available evidence, we conclude that AIC should be preferentially selected for the route screening of colorectal lesions because it has potential value of increasing the polyp and adenoma detection. However, the continued improvement of AIC in differentiating the shape and pathology of colorectal lesions is needed.

Application and prospect of artificial intelligence in digestive endoscopy

INTRODUCTION

With the progress of science and technology, artificial intelligence represented by deep learning has gradually begun to be applied in the medical field. Artificial intelligence has been applied to benign gastrointestinal lesions, tumors, early cancer, inflammatory bowel disease, gallbladder, pancreas, and other diseases. This review summarizes the latest research results on artificial intelligence in digestive endoscopy and discusses the prospect of artificial intelligence in digestive system diseases.

AREAS COVERED

We retrieved relevant documents on artificial intelligence in digestive tract diseases from PubMed and Medline. This review elaborates on the knowledge of computer-aided diagnosis in digestive endoscopy.

EXPERT OPINION

Artificial intelligence significantly improves diagnostic accuracy, reduces physicians' workload, and provides a shred of evidence for clinical diagnosis and treatment. Shortly, artificial intelligence will have high application value in the field of medicine.

Charting a path forward for clinical research in artificial intelligence and gastroenterology

Gastroenterology has been an early leader in bridging the gap between artificial intelligence (AI) model development and clinical trial validation, and in recent years we have seen the publication of several randomized clinical trials examining the role of AI in gastroenterology. As AI applications for clinical medicine advance rapidly, there is a clear need for guidance surrounding AI-specific study design, evaluation, comparison, analysis and reporting of results. Several initiatives are in the publication or pre-publication phase including AI-specific amendments to minimum reporting guidelines for clinical trials, society task force initiatives aimed at priority use cases and research priorities, and minimum reporting guidelines that guide the reporting of clinical prediction models. In this paper, we examine applications of AI in clinical trials and discuss elements of newly published AI-specific extensions to the Consolidated Standards of Reporting Trials and Standard Protocol Items: Recommendations for Interventional Trials statements that guide clinical trial reporting and development. We then review AI applications at the pre-trial level in both endoscopy and other subfields of gastroenterology and explore areas where further guidance is needed to supplement the current guidance available at the pre-trial level.

The role of AI technology in prediction, diagnosis and treatment of colorectal cancer

Artificial intelligence (AI) is a fascinating new technology that incorporates machine learning and neural networks to improve existing technology or create new ones. Potential applications of AI are introduced to aid in the fight against colorectal cancer (CRC). This includes how AI will affect the epidemiology of colorectal cancer and the new methods of mass information gathering like GeoAI, digital epidemiology and real-time information collection. Meanwhile, this review also examines existing tools for diagnosing disease like CT/MRI, endoscopes, genetics, and pathological assessments also benefitted greatly from implementation of deep learning. Finally, how treatment and treatment approaches to CRC can be enhanced when applying AI is under discussion. The power of AI regarding the therapeutic recommendation in colorectal cancer demonstrates much promise in clinical and translational field of oncology, which means better and personalized treatments for those in need.

Survey on the perceptions of UK gastroenterologists and endoscopists to artificial intelligence

BACKGROUND AND AIMS

With the potential integration of artificial intelligence (AI) into clinical practice, it is essential to understand end users' perception of this novel technology. The aim of this study, which was endorsed by the British Society of Gastroenterology (BSG), was to evaluate the UK gastroenterology and endoscopy communities' views on AI.

METHODS

An online survey was developed and disseminated to gastroenterologists and endoscopists across the UK.

RESULTS

One hundred four participants completed the survey. Quality improvement in endoscopy (97%) and better endoscopic diagnosis (92%) were perceived as the most beneficial applications of AI to clinical practice. The most significant challenges were accountability for incorrect diagnoses (85%) and potential bias of algorithms (82%). A lack of guidelines (92%) was identified as the greatest barrier to adopting AI in routine clinical practice. Participants identified real-time endoscopic image diagnosis (95%) as a research priority for AI, while the most perceived significant barriers to AI research were funding (82%) and the availability of annotated data (76%). Participants consider the priorities for the BSG AI Task Force to be identifying research priorities (96%), guidelines for adopting AI devices in clinical practice (93%) and supporting the delivery of multicentre clinical trials (91%).

CONCLUSION

This survey has identified views from the UK gastroenterology and endoscopy community regarding AI in clinical practice and research, and identified priorities for the newly formed BSG AI Task Force.

Real-time colorectal polyp detection using a novel computer-aided detection system (CADe): a feasibility study

BACKGROUND AND AIMS

Colonoscopy aims to early detect and remove precancerous colorectal polyps, thereby preventing development of colorectal cancer (CRC). Recently, computer-aided detection (CADe) systems have been developed to assist endoscopists in polyp detection during colonoscopy. The aim of this study was to investigate feasibility and safety of a novel CADe system during real-time colonoscopy in three European tertiary referral centers.

METHODS

Ninety patients undergoing colonoscopy assisted by a real-time CADe system (DISCOVERY; Pentax Medical, Tokyo, Japan) were prospectively included. The CADe system was turned on only at withdrawal, and its output was displayed on secondary monitor. To study feasibility, inspection time, polyp detection rate (PDR), adenoma detection rate (ADR), sessile serrated lesion (SSL) detection rate (SDR), and the number of false positives were recorded. To study safety, (severe) adverse events ((S)AEs) were collected. Additionally, user friendliness was rated from 1 (worst) to 10 (best) by endoscopists.

RESULTS

Mean inspection time was 10.8 ± 4.3 min, while PDR was 55.6%, ADR 28.9%, and SDR 11.1%. The CADe system users estimated that < 20 false positives occurred in 81 colonoscopy procedures (90%). No (S)AEs related to the CADe system were observed during the 30-day follow-up period. User friendliness was rated as good, with a median score of 8/10.

CONCLUSION

Colonoscopy with this novel CADe system in a real-time setting was feasible and safe. Although PDR and SDR were high compared to previous studies with other CADe systems, future randomized controlled trials are needed to confirm these detection rates. The high SDR is of particular interest since interval CRC has been suggested to develop frequently through the serrated neoplasia pathway.

CLINICAL TRIAL REGISTRATION

The study was registered in the Dutch Trial Register (reference number: NL8788).

Measuring and Improving Quality of Colonoscopy for Colorectal Cancer Screening

Colorectal cancer (CRC) is largely preventable, yet it remains a major public health issue as it is the third most common and deadly malignancy in the United States. While there are many ways to screen for CRC, colonoscopy remains the gold standard as it is the only test that is both cancer-detecting and cancer-preventing through removal of precancerous polyps. Through identifying and removing neoplastic lesions, colonoscopy reduces CRC incidence by 31%-91% and CRC mortality by 65%-88%. However, colonoscopy is not an infallible test-there is a chance for missed lesions during the exam and there is substantial variation in outcomes among endoscopists. To enhance the quality of colonoscopic exams, and ultimately to improve CRC outcomes, quality indicators have been developed for measuring endoscopists' performance. In this review, we describe the colonoscopic quality indicators and benchmarks recommended by the American Society for Gastrointestinal Endoscopy/American College of Gastroenterology Task Force on Quality in Endoscopy for screening colonoscopies in average-risk individuals. Measuring and monitoring endoscopists' performance on these measures are critical first steps in striving toward conducting high quality exams. We also review the evidence for interventions that aim to improve critical measures including adenoma detection rate, withdrawal time, cecal intubation, and bowel preparation quality. Finally, we provide a preview of the forthcoming Advancing Care for Appropriate Colon Health Merit-Based Incentive Payment System Value Pathway by the Centers for Medicare & Medicaid Services and its potential impact on clinical practice.

Development of multi-class computer-aided diagnostic systems using the NICE/JNET classifications for colorectal lesions

BACKGROUND AND AIM

Diagnostic support using artificial intelligence may contribute to the equalization of endoscopic diagnosis of colorectal lesions. We developed computer-aided diagnosis (CADx) support system for diagnosing colorectal lesions using the NBI International Colorectal Endoscopic (NICE) classification and the Japan NBI Expert Team (JNET) classification.

METHODS

Using Residual Network as the classifier and NBI images as training images, we developed a CADx based on the NICE classification (CADx-N) and a CADx based on the JNET classification (CADx-J). For validation, 480 non-magnifying and magnifying NBI images were used for the CADx-N and 320 magnifying NBI images were used for the CADx-J. The diagnostic performance of the CADx-N was evaluated using the magnification rate.

RESULTS

The accuracy of the CADx-N for Types 1, 2, and 3 was 97.5%, 91.2%, and 93.8%, respectively. The diagnostic performance for each magnification level was good (no statistically significant difference). The sensitivity, specificity, positive predictive value, negative predictive value, and accuracy of the CADx-J were 100%, 96.3%, 82.8%, 100%, and 96.9% for Type 1; 80.3%, 93.7%, 94.1%, 79.2%, and 86.3% for Type 2A; 80.4%, 84.7%, 46.8%, 96.3%, and 84.1% for Type 2B; and 62.5%, 99.6%, 96.8%, 93.8%, and 94.1% for Type 3, respectively.

CONCLUSIONS

The multi-class CADx systems had good diagnostic performance with both the NICE and JNET classifications and may aid in educating non-expert endoscopists and assist in diagnosing colorectal lesions.

Pilot study of a new freely available computer-aided polyp detection system in clinical practice

PURPOSE

Computer-aided polyp detection (CADe) systems for colonoscopy are already presented to increase adenoma detection rate (ADR) in randomized clinical trials. Those commercially available closed systems often do not allow for data collection and algorithm optimization, for example regarding the usage of different endoscopy processors. Here, we present the first clinical experiences of a, for research purposes publicly available, CADe system.

METHODS

We developed an end-to-end data acquisition and polyp detection system named EndoMind. Examiners of four centers utilizing four different endoscopy processors used EndoMind during their clinical routine. Detected polyps, ADR, time to first detection of a polyp (TFD), and system usability were evaluated (NCT05006092).

RESULTS

During 41 colonoscopies, EndoMind detected 29 of 29 adenomas in 66 of 66 polyps resulting in an ADR of 41.5%. Median TFD was 130 ms (95%-CI, 80-200 ms) while maintaining a median false positive rate of 2.2% (95%-CI, 1.7-2.8%). The four participating centers rated the system using the System Usability Scale with a median of 96.3 (95%-CI, 70-100).

CONCLUSION

EndoMind's ability to acquire data, detect polyps in real-time, and high usability score indicate substantial practical value for research and clinical practice. Still, clinical benefit, measured by ADR, has to be determined in a prospective randomized controlled trial.

Impact of the clinical use of artificial intelligence-assisted neoplasia detection for colonoscopy: a large-scale prospective, propensity score-matched study (with video)

BACKGROUND AND AIMS

Recently, the use of computer-aided detection (CADe) for colonoscopy has been investigated to improve the adenoma detection rate (ADR). We aimed to assess the efficacy of a regulatory-approved CADe in a large-scale study with high numbers of patients and endoscopists.

METHODS

This was a propensity score-matched prospective study that took place at a university hospital between July 2020 and December 2020. We recruited patients aged ≥20 years who were scheduled for colonoscopy. Patients with polyposis, inflammatory bowel disease, or incomplete colonoscopy were excluded. We used a regulatory-approved CADe system and conducted a propensity score matching-based comparison of the ADR between patients examined with and without CADe as the primary outcome.

RESULTS

During the study period, 2261 patients underwent colonoscopy with the CADe system or routine colonoscopy, and 172 patients were excluded in accordance with the exclusion criteria. Thirty endoscopists (9 nonexperts and 21 experts) were involved in this study. Propensity score matching was conducted using 5 factors, resulting in 1836 patients included in the analysis (918 patients in each group). The ADR was significantly higher in the CADe group than in the control group (26.4% vs 19.9%, respectively; relative risk, 1.32; 95% confidence interval, 1.12-1.57); however, there was no significant increase in the advanced neoplasia detection rate (3.7% vs 2.9%, respectively).

CONCLUSIONS

The use of the CADe system for colonoscopy significantly increased the ADR in a large-scale prospective study including 30 endoscopists (Clinical trial registration number: UMIN000040677.).

Can image-enhanced endoscopy improve adenoma detection rate?

An accumulating body of evidence has shown that detection and resection of pre-cancerous adenoma by colonoscopy could effectively prevent colorectal cancer (CRC) and its related mortality. Among various colonoscopy quality indicators, such as cecal intubation rate, withdrawal time, and adenoma detection rate (ADR); ADR is the most important and most closely associated with the subsequent risk of CRC. Image-enhanced endoscopy (IEE), including digital and dye-based IEE, was originally developed to discriminate neoplastic from non-neoplastic lesions but later studies have demonstrated that it can also enhance lesion detection by enhancing the contrast between the lesion and background colonic mucosa. Nevertheless, using IEE in colonoscopy for lesion detection is still not the standard way of practice in the real world. For a better understanding of current IEE modalities, this review introduces and compares the currently available IEE modalities and their efficacy in detecting adenoma from the results of randomized controlled trials or meta-analyses.

Artificial intelligence in polyp detection - where are we and where are we headed?

The goal of artificial intelligence in colonoscopy is to improve adenoma detection rate and reduce interval colorectal cancer. Artificial intelligence in polyp detection during colonoscopy has evolved tremendously over the last decade mainly due to the implementation of neural networks. Computer aided detection (CADe) utilizing neural networks allows real time detection of polyps and adenomas. Current CADe systems are built in single centers by multidisciplinary teams and have only been utilized in limited clinical research studies. We review the most recent prospective randomized controlled trials here. These randomized control trials, both non-blinded and blinded, demonstrated increase in adenoma and polyp detection rates when endoscopists used CADe systems vs standard high definition colonoscopes. Increase of polyps and adenomas detected were mainly small and sessile in nature. CADe systems were found to be safe with little added time to the overall procedure. Results are promising as more CADe have shown to have ability to increase accuracy and improve quality of colonoscopy. Overall limitations included selection bias as all trials built and utilized different CADe developed at their own institutions, non-blinded arms, and question of external validity.

Artificial intelligence-assisted colonoscopy: A review of current state of practice and research

Colonoscopy is an effective screening procedure in colorectal cancer prevention programs; however, colonoscopy practice can vary in terms of lesion detection, classification, and removal. Artificial intelligence (AI)-assisted decision support systems for endoscopy is an area of rapid research and development. The systems promise improved detection, classification, screening, and surveillance for colorectal polyps and cancer. Several recently developed applications for AI-assisted colonoscopy have shown promising results for the detection and classification of colorectal polyps and adenomas. However, their value for real-time application in clinical practice has yet to be determined owing to limitations in the design, validation, and testing of AI models under real-life clinical conditions. Despite these current limitations, ambitious attempts to expand the technology further by developing more complex systems capable of assisting and supporting the endoscopist throughout the entire colonoscopy examination, including polypectomy procedures, are at the concept stage. However, further work is required to address the barriers and challenges of AI integration into broader colonoscopy practice, to navigate the approval process from regulatory organizations and societies, and to support physicians and patients on their journey to accepting the technology by providing strong evidence of its accuracy and safety. This article takes a closer look at the current state of AI integration into the field of colonoscopy and offers suggestions for future research.

Deep Learning and Device-Assisted Enteroscopy: Automatic Detection of Gastrointestinal Angioectasia

Background and Objectives: Device-assisted enteroscopy (DAE) allows deep exploration of the small bowel and combines diagnostic and therapeutic capacities. Suspected mid-gastrointestinal bleeding is the most frequent indication for DAE, and vascular lesions, particularly angioectasia, are the most common etiology. Nevertheless, the diagnostic yield of DAE for the detection of these lesions is suboptimal. Deep learning algorithms have shown great potential for automatic detection of lesions in endoscopy. We aimed to develop an artificial intelligence (AI) model for the automatic detection of angioectasia DAE images. Materials and Methods: A convolutional neural network (CNN) was developed using DAE images. Each frame was labeled as normal/mucosa or angioectasia. The image dataset was split for the constitution of training and validation datasets. The latter was used for assessing the performance of the CNN. Results: A total of 72 DAE exams were included, and 6740 images were extracted (5345 of normal mucosa and 1395 of angioectasia). The model had a sensitivity of 88.5%, a specificity of 97.1% and an AUC of 0.988. The image processing speed was 6.4 ms/frame. Conclusions: The application of AI to DAE may have a significant impact on the management of patients with suspected mid-gastrointestinal bleeding.

Computer-aided detection of colorectal polyps using a newly generated deep convolutional neural network: from development to first clinical experience

AIM

The use of artificial intelligence represents an objective approach to increase endoscopist's adenoma detection rate (ADR) and limit interoperator variability. In this study, we evaluated a newly developed deep convolutional neural network (DCNN) for automated detection of colorectal polyps ex vivo as well as in a first in-human trial.

METHODS

For training of the DCNN, 116 529 colonoscopy images from 278 patients with 788 different polyps were collected. A subset of 10 467 images containing 504 different polyps were manually annotated and treated as the gold standard. An independent set of 45 videos consisting of 15 534 single frames was used for ex vivo performance testing. In vivo real-time detection of colorectal polyps during routine colonoscopy by the DCNN was tested in 42 patients in a back-to-back approach.

RESULTS

When analyzing the test set of 15 534 single frames, the DCNN's sensitivity and specificity for polyp detection and localization within the frame was 90% and 80%, respectively, with an area under the curve of 0.92. In vivo, baseline polyp detection rate and ADR were 38% and 26% and significantly increased to 50% (P = 0.023) and 36% (P = 0.044), respectively, with the use of the DCNN. Of the 13 additionally with the DCNN detected lesions, the majority were diminutive and flat, among them three sessile serrated adenomas.

CONCLUSION

This newly developed DCNN enables highly sensitive automated detection of colorectal polyps both ex vivo and during first in-human clinical testing and could potentially increase the detection of colorectal polyps during colonoscopy.

Artificial intelligence and polyp detection in colonoscopy: Use of a single neural network to achieve rapid polyp localization for clinical use

BACKGROUND AND AIM

Artificial intelligence has been extensively studied to assist clinicians in polyp detection, but such systems usually require expansive processing power, making them prohibitively expensive and hindering wide adaption. The current study used a fast object detection algorithm, known as the YOLOv3 algorithm, to achieve real-time polyp detection on a laptop. In addition, we evaluated and classified the causes of false detections to further improve accuracy.

METHODS

The YOLOv3 algorithm was trained and validated with 6038 and 2571 polyp images, respectively. Videos from live colonoscopies in a tertiary center and those obtained from public databases were used for the training and validation sets. The algorithm was tested on 10 unseen videos from the CVC-Video ClinicDB dataset. Only bounding boxes with an intersection over union area of > 0.3 were considered positive predictions.

RESULTS

Polyp detection rate in our study was 100%, with the algorithm able to detect every polyp in each video. Sensitivity, specificity, and F1 score were 74.1%, 85.1%, and 83.3, respectively. The algorithm achieved a speed of 61.2 frames per second (fps) on a desktop RTX2070 GPU and 27.2 fps on a laptop GTX2060 GPU. Nearly a quarter of false negatives happened when the polyps were at the corner of an image. Image blurriness accounted for approximately 3% and 9% of false positive and false negative detections, respectively.

CONCLUSION

The YOLOv3 algorithm can achieve real-time poly detection with high accuracy and speed on a desktop GPU, making it low cost and accessible to most endoscopy centers worldwide.

A multisystem-compatible deep learning-based algorithm for detection and characterization of angiectasias in small-bowel capsule endoscopy. A proof-of-concept study

BACKGROUND AND AIMS

Current artificial intelligence (AI)-based solutions for capsule endoscopy (CE) interpretation are proprietary. We aimed to evaluate an AI solution trained on a specific CE system (Pillcam®, Medtronic) for the detection of angiectasias on images captured by a different proprietary system (MiroCam®, Intromedic).

MATERIAL AND METHODS

An advanced AI solution (Axaro®, Augmented Endoscopy), previously trained on Pillcam® small bowell images, was evaluated on independent datasets with more than 1200 Pillcam® and MiroCam® still frames (equally distributed, with or without angiectasias). Images were reviewed by experts before and after AI interpretation.

RESULTS

Sensitivity for the diagnosis of angiectasia was 97.4% with Pillcam® images and 96.1% with Mirocam® images, with specificity of 98.8% and 97.8%, respectively. Performances regarding the delineation of regions of interest and the characterization of angiectasias were similar in both groups (all above 95%). Processing time was significantly shorter with Mirocam® (20.7 ms) than with Pillcam® images (24.6 ms, p<0.0001), possibly related to technical differences between systems.

CONCLUSION

This proof-of-concept study on still images paves the way for the development of resource-sparing, "universal" CE databases and AI solutions for CE interpretation.

Digital surgery for gastroenterological diseases

Advances in machine learning, computer vision and artificial intelligence methods, in combination with those in processing and cloud computing capability, portend the advent of true decision support during interventions in real-time and soon perhaps in automated surgical steps. Such capability, deployed alongside technology intraoperatively, is termed digital surgery and can be delivered without the need for high-end capital robotic investment. An area close to clinical usefulness right now harnesses advances in near infrared endolaparoscopy and fluorescence guidance for tissue characterisation through the use of biophysics-inspired algorithms. This represents a potential synergistic methodology for the deep learning methods currently advancing in ophthalmology, radiology, and recently gastroenterology via colonoscopy. As databanks of more general surgical videos are created, greater analytic insights can be derived across the operative spectrum of gastroenterological disease and operations (including instrumentation and operative step sequencing and recognition, followed over time by surgeon and instrument performance assessment) and linked to value-based outcomes. However, issues of legality, ethics and even morality need consideration, as do the limiting effects of monopolies, cartels and isolated data silos. Furthermore, the role of the surgeon, surgical societies and healthcare institutions in this evolving field needs active deliberation, as the default risks relegation to bystander or passive recipient. This editorial provides insight into this accelerating field by illuminating the near-future and next decade evolutionary steps towards widespread clinical integration for patient and societal benefit.

Automated detection of cecal intubation with variable bowel preparation using a deep convolutional neural network

Background and study aims  Colonoscopy completion reduces post-colonoscopy colorectal cancer. As a result, there have been attempts at implementing artificial intelligence to automate the detection of the appendiceal orifice (AO) for quality assurance. However, the utilization of these algorithms has not been demonstrated in suboptimal conditions, including variable bowel preparation. We present an automated computer-assisted method using a deep convolutional neural network to detect the AO irrespective of bowel preparation. Methods  A total of 13,222 images (6,663 AO and 1,322 non-AO) were extracted from 35 colonoscopy videos recorded between 2015 and 2018. The images were labelled with Boston Bowel Preparation Scale scores. A total of 11,900 images were used for training/validation and 1,322 for testing. We developed a convolutional neural network (CNN) with a DenseNet architecture pre-trained on ImageNet as a feature extractor on our data and trained a classifier uniquely tailored for identification of AO and non-AO images using binary cross entropy loss. Results  The deep convolutional neural network was able to correctly classify the AO and non-AO images with an accuracy of 94 %. The area under the receiver operating curve of this neural network was 0.98. The sensitivity, specificity, positive predictive value, and negative predictive value of the algorithm were 0.96, 0.92, 0.92 and 0.96, respectively. AO detection was > 95 % regardless of BBPS scores, while non-AO detection improved from BBPS 1 score (83.95 %) to BBPS 3 score (98.28 %). Conclusions  A deep convolutional neural network was created demonstrating excellent discrimination between AO from non-AO images despite variable bowel preparation. This algorithm will require further testing to ascertain its effectiveness in real-time colonoscopy.