A novel artificial intelligence system for the assessment of bowel preparation (with video)

Efficacy of a full management model in daytime surgery for gastrointestinal polyps based on WeChat: A study protocol for randomized controlled trials

OBJECTIVE

The objective of this study is to improve the efficiency of daytime surgery for gastrointestinal polyp and ensure the safety of patients. We tried an information management method based on WeChat platform in patients undergoing daytime gastrointestinal polypectomy and to explore the feasibility and effectiveness of a full management model.

METHODS

Five hundred and ninety-three patients were randomly divided into two groups: the control group was treated with traditional management methods and the experimental group was treated with the whole-process management mode based on the WeChat platform. The WeChat platform-based full management model included establishing a day surgery management WeChat group, developing multidisciplinary, full-management protocols and processes for day surgery, establishing an information-based surgical scheduling system and adopting diverse forms of day surgery education and continuity of care. This feature included illustrated brochures, vivid verbal presentations, WeChat public numbers and Internet management platforms. The treatment time, hospitalization cost and patient satisfaction of the two groups were counted.

RESULTS

In the experimental group, 408 patients were enrolled. The preoperative waiting time and patients' length of stay were 3 days and 1 day, respectively. The medical and nursing intake time was 7 min. The procedure cancellation rate and postoperative complications rate was 0.07% and 0.02%. In the control group, 185 patients were enrolled in the study, The preoperative waiting time and patients' length of stay was 7 days and 3 days. The medical and nursing intake time was 28 min. The procedure cancellation rate and postoperative complications rate were 0.13% and 0.05%, respectively. The hospitalization costs were reduced by an average of $140/person and the satisfaction scores were higher than the control group. In summary, the preoperative waiting time, medical reception time, surgical cancellation rate, length of hospital stay and hospitalization cost in the observation group were less than those in the control group (p < 0.05). Patient satisfaction scores were significantly higher than those in the control group (p < 0.05).

CONCLUSION

Through the full management model based on WeChat, the preoperative waiting time, medical reception time, surgical cancellation rate, length of hospital stay and hospitalization cost in the experimental group were less than those in the control group. Patient satisfaction scores were significantly higher than those in the control group and the difference was statistically significant.

Automatic assessment of bowel preparation by an artificial intelligence model and its clinical applicability

BACKGROUND AND AIM

Reliable bowel preparation assessment is important in colonoscopy. However, current scoring systems are limited by laborious and time-consuming tasks and interobserver variability. We aimed to develop an artificial intelligence (AI) model to assess bowel cleanliness and evaluate its clinical applicability.

METHODS

A still image-driven AI model to assess the Boston Bowel Preparation Scale (BBPS) was developed and validated using 2361 colonoscopy images. For evaluating real-world applicability, the model was validated using 113 10-s colonoscopy video clips and 30 full colonoscopy videos to identify "adequate (BBPS 2-3)" or "inadequate (BBPS 0-1)" preparation. The model was tested with an external dataset of 29 colonoscopy videos. The clinical applicability of the model was evaluated using 225 consecutive colonoscopies. Inter-rater variability was analyzed between the AI model and endoscopists.

RESULTS

The AI model achieved an accuracy of 94.0% and an area under the receiver operating characteristic curve of 0.939 with the still images. Model testing with an external dataset showed an accuracy of 95.3%, an area under the receiver operating characteristic curve of 0.976, and a sensitivity of 100% for the detection of inadequate preparations. The clinical applicability study showed an overall agreement rate of 85.3% between endoscopists and the AI model, with Fleiss' kappa of 0.686. The agreement rate was lower for the right colon compared with the transverse and left colon, with Fleiss' kappa of 0.563, 0.575, and 0.789, respectively.

CONCLUSIONS

The AI model demonstrated accurate bowel preparation assessment and substantial agreement with endoscopists. Further refinement of the AI model is warranted for effective monitoring of qualified colonoscopy in large-scale screening programs.

Consensus statements on the current landscape of artificial intelligence applications in endoscopy, addressing roadblocks, and advancing artificial intelligence in gastroenterology

BACKGROUND AND AIMS

The American Society for Gastrointestinal Endoscopy (ASGE) AI Task Force along with experts in endoscopy, technology space, regulatory authorities, and other medical subspecialties initiated a consensus process that analyzed the current literature, highlighted potential areas, and outlined the necessary research in artificial intelligence (AI) to allow a clearer understanding of AI as it pertains to endoscopy currently.

METHODS

A modified Delphi process was used to develop these consensus statements.

RESULTS

Statement 1: Current advances in AI allow for the development of AI-based algorithms that can be applied to endoscopy to augment endoscopist performance in detection and characterization of endoscopic lesions. Statement 2: Computer vision-based algorithms provide opportunities to redefine quality metrics in endoscopy using AI, which can be standardized and can reduce subjectivity in reporting quality metrics. Natural language processing-based algorithms can help with the data abstraction needed for reporting current quality metrics in GI endoscopy effortlessly. Statement 3: AI technologies can support smart endoscopy suites, which may help optimize workflows in the endoscopy suite, including automated documentation. Statement 4: Using AI and machine learning helps in predictive modeling, diagnosis, and prognostication. High-quality data with multidimensionality are needed for risk prediction, prognostication of specific clinical conditions, and their outcomes when using machine learning methods. Statement 5: Big data and cloud-based tools can help advance clinical research in gastroenterology. Multimodal data are key to understanding the maximal extent of the disease state and unlocking treatment options. Statement 6: Understanding how to evaluate AI algorithms in the gastroenterology literature and clinical trials is important for gastroenterologists, trainees, and researchers, and hence education efforts by GI societies are needed. Statement 7: Several challenges regarding integrating AI solutions into the clinical practice of endoscopy exist, including understanding the role of human-AI interaction. Transparency, interpretability, and explainability of AI algorithms play a key role in their clinical adoption in GI endoscopy. Developing appropriate AI governance, data procurement, and tools needed for the AI lifecycle are critical for the successful implementation of AI into clinical practice. Statement 8: For payment of AI in endoscopy, a thorough evaluation of the potential value proposition for AI systems may help guide purchasing decisions in endoscopy. Reliable cost-effectiveness studies to guide reimbursement are needed. Statement 9: Relevant clinical outcomes and performance metrics for AI in gastroenterology are currently not well defined. To improve the quality and interpretability of research in the field, steps need to be taken to define these evidence standards. Statement 10: A balanced view of AI technologies and active collaboration between the medical technology industry, computer scientists, gastroenterologists, and researchers are critical for the meaningful advancement of AI in gastroenterology.

CONCLUSIONS

The consensus process led by the ASGE AI Task Force and experts from various disciplines has shed light on the potential of AI in endoscopy and gastroenterology. AI-based algorithms have shown promise in augmenting endoscopist performance, redefining quality metrics, optimizing workflows, and aiding in predictive modeling and diagnosis. However, challenges remain in evaluating AI algorithms, ensuring transparency and interpretability, addressing governance and data procurement, determining payment models, defining relevant clinical outcomes, and fostering collaboration between stakeholders. Addressing these challenges while maintaining a balanced perspective is crucial for the meaningful advancement of AI in gastroenterology.

Artificial Intelligence-assisted colonoscopy and colorectal cancer screening: Where are we going?

Colorectal cancer is a significant global health concern, necessitating effective screening strategies to reduce its incidence and mortality rates. Colonoscopy plays a crucial role in the detection and removal of colorectal neoplastic precursors. However, there are limitations and variations in the performance of endoscopists, leading to missed lesions and suboptimal outcomes. The emergence of artificial intelligence (AI) in endoscopy offers promising opportunities to improve the quality and efficacy of screening colonoscopies. In particular, AI applications, including computer-aided detection (CADe) and computer-aided characterization (CADx), have demonstrated the potential to enhance adenoma detection and optical diagnosis accuracy. Additionally, AI-assisted quality control systems aim to standardize the endoscopic examination process. This narrative review provides an overview of AI principles and discusses the current knowledge on AI-assisted endoscopy in the context of screening colonoscopies. It highlights the significant role of AI in improving lesion detection, characterization, and quality assurance during colonoscopy. However, further well-designed studies are needed to validate the clinical impact and cost-effectiveness of AI-assisted colonoscopy before its widespread implementation.

Detection of sessile serrated adenoma using artificial intelligence-enhanced endoscopy: an Asian perspective

BACKGROUND

As the serrated pathway has gained prominence as an alternative colorectal carcinogenesis pathway, sessile serrated adenomas or polyps (SSA/P) have been highlighted as lesions to rule out during colonoscopy. These lesions are however morphologically difficult to detect on endoscopy and can be mistaken for hyperplastic polyps due to similar endoscopic features. With the underlying nature of rapid progression and malignant transformation, interval cancer is a likely consequence of undetected or overlooked SSA/P. Real-time artificial intelligence (AI)-assisted colonoscopy via the computer-assisted detection system (CADe) is an increasingly useful tool in improving adenoma detection rate by providing a second eye during the procedure. In this article, we describe a guide through a video to illustrate the detection of SSA/P during AI-assisted colonoscopy.

METHODS

Consultant-grade endoscopists utilized real-time AI-assisted colonoscopy device, as part of a larger prospective study, to detect suspicious lesions which were later histopathologically confirmed to be SSA/P.

RESULTS

All lesions were picked up by the CADe where a real-time green box highlighted suspicious polyps to the clinician. Three SSA/P of varying morphology are described with reference to classical SSA/P features and with comparison to the features of the hyperplastic polyp found in our study. All three SSA/P observed are in keeping with the JNET Classification (Type 1).

CONCLUSION

In conclusion, CADe is a most useful aid to clinicians during endoscopy in the detection of SSA/P but must be complemented with factors such as good endoscopy skill and bowel prep for effective detection, and biopsy coupled with subsequent accurate histological diagnosis.

A newly developed deep learning-based system for automatic detection and classification of small bowel lesions during double-balloon enteroscopy examination

BACKGROUND

Double-balloon enteroscopy (DBE) is a standard method for diagnosing and treating small bowel disease. However, DBE may yield false-negative results due to oversight or inexperience. We aim to develop a computer-aided diagnostic (CAD) system for the automatic detection and classification of small bowel abnormalities in DBE.

DESIGN AND METHODS

A total of 5201 images were collected from Renmin Hospital of Wuhan University to construct a detection model for localizing lesions during DBE, and 3021 images were collected to construct a classification model for classifying lesions into four classes, protruding lesion, diverticulum, erosion & ulcer and angioectasia. The performance of the two models was evaluated using 1318 normal images and 915 abnormal images and 65 videos from independent patients and then compared with that of 8 endoscopists. The standard answer was the expert consensus.

RESULTS

For the image test set, the detection model achieved a sensitivity of 92% (843/915) and an area under the curve (AUC) of 0.947, and the classification model achieved an accuracy of 86%. For the video test set, the accuracy of the system was significantly better than that of the endoscopists (85% vs. 77 ± 6%, p < 0.01). For the video test set, the proposed system was superior to novices and comparable to experts.

CONCLUSIONS

We established a real-time CAD system for detecting and classifying small bowel lesions in DBE with favourable performance. ENDOANGEL-DBE has the potential to help endoscopists, especially novices, in clinical practice and may reduce the miss rate of small bowel lesions.

Development and validation of a three-dimensional deep learning-based system for assessing bowel preparation on colonoscopy video

Background

The performance of existing image-based training models in evaluating bowel preparation on colonoscopy videos was relatively low, and only a few models used external data to prove their generalization. Therefore, this study attempted to develop a more precise and stable AI system for assessing bowel preparation of colonoscopy video.

Methods

We proposed a system named ViENDO to assess the bowel preparation quality, including two CNNs. First, Information-Net was used to identify and filter out colonoscopy video frames unsuitable for Boston bowel preparation scale (BBPS) scoring. Second, BBPS-Net was trained and tested with 5,566 suitable short video clips through three-dimensional (3D) convolutional neural network (CNN) technology to detect BBPS-based insufficient bowel preparation. Then, ViENDO was applied to complete withdrawal colonoscopy videos from multiple centers to predict BBPS segment scores in clinical settings. We also conducted a human-machine contest to compare its performance with endoscopists.

Results

In video clips, BBPS-Net for determining inadequate bowel preparation generated an area under the curve of up to 0.98 and accuracy of 95.2%. When applied to full-length withdrawal colonoscopy videos, ViENDO assessed bowel cleanliness with an accuracy of 93.8% in the internal test set and 91.7% in the external dataset. The human-machine contest demonstrated that the accuracy of ViENDO was slightly superior compared to most endoscopists, though no statistical significance was found.

Conclusion

The 3D-CNN-based AI model showed good performance in evaluating full-length bowel preparation on colonoscopy video. It has the potential as a substitute for endoscopists to provide BBPS-based assessments during daily clinical practice.

ENDOANGEL versus water exchange for the detection of colorectal adenomas

Background

Recently, the ENDOANGEL (EN) system, a computer-assisted detection technique, and water exchange (WE) assisted colonoscopy have both been shown to increase the colorectal adenoma detection rate (ADR).

Objectives

The aim of this study was to compare the ADR between EN- and WE-assisted colonoscopy.

Design

This was a retrospective study.

Methods

Data from patients who underwent either EN- or WE-assisted colonoscopy between October 2021 and August 2022 were analysed consecutively. The primary outcome measure was the ADR.

Results

The ADR was found to be similar between the EN and WE groups, with 80 out of 199 (40.2%) patients in the EN group compared to 78 out of 174 (44.8%) patients in the WE group [1.21; 95% confidence interval (CI), 0.80-1.83]. In the analysis using stabilized inverse probability treatment weighting after adjustment for confounding factors, both colonoscopy methods had similar performance in terms of ADR (1.41; 95% CI, 0.88-2.27).

Conclusion

EN was found to be comparable to WE in terms of ADR during colonoscopy, and both methods may be effectively used in clinical practice.

Evaluating the Efficacy of ChatGPT in Navigating the Spanish Medical Residency Entrance Examination (MIR): Promising Horizons for AI in Clinical Medicine

The rapid progress in artificial intelligence, machine learning, and natural language processing has led to increasingly sophisticated large language models (LLMs) for use in healthcare. This study assesses the performance of two LLMs, the GPT-3.5 and GPT-4 models, in passing the MIR medical examination for access to medical specialist training in Spain. Our objectives included gauging the model's overall performance, analyzing discrepancies across different medical specialties, discerning between theoretical and practical questions, estimating error proportions, and assessing the hypothetical severity of errors committed by a physician.

MATERIAL AND METHODS

We studied the 2022 Spanish MIR examination results after excluding those questions requiring image evaluations or having acknowledged errors. The remaining 182 questions were presented to the LLM GPT-4 and GPT-3.5 in Spanish and English. Logistic regression models analyzed the relationships between question length, sequence, and performance. We also analyzed the 23 questions with images, using GPT-4's new image analysis capability.

RESULTS

GPT-4 outperformed GPT-3.5, scoring 86.81% in Spanish (p < 0.001). English translations had a slightly enhanced performance. GPT-4 scored 26.1% of the questions with images in English. The results were worse when the questions were in Spanish, 13.0%, although the differences were not statistically significant (p = 0.250). Among medical specialties, GPT-4 achieved a 100% correct response rate in several areas, and the Pharmacology, Critical Care, and Infectious Diseases specialties showed lower performance. The error analysis revealed that while a 13.2% error rate existed, the gravest categories, such as "error requiring intervention to sustain life" and "error resulting in death", had a 0% rate.

CONCLUSIONS

GPT-4 performs robustly on the Spanish MIR examination, with varying capabilities to discriminate knowledge across specialties. While the model's high success rate is commendable, understanding the error severity is critical, especially when considering AI's potential role in real-world medical practice and its implications for patient safety.

The Potential Use of Artificial Intelligence in Irritable Bowel Syndrome Management

Irritable bowel syndrome (IBS) has a global prevalence of around 4.1% and is associated with a low quality of life and increased healthcare costs. Current guidelines recommend that IBS is diagnosed using the symptom-based Rome IV criteria. Despite this, when patients seek medical attention, they are usually over-investigated. This issue might be resolved by novel technologies in medicine, such as the use of Artificial Intelligence (AI). In this context, this paper aims to review AI applications in IBS. AI in colonoscopy proved to be useful in organic lesion detection and diagnosis and in objectively assessing the quality of the procedure. Only a recently published study talked about the potential of AI-colonoscopy in IBS. AI was also used to study biofilm characteristics in the large bowel and establish a potential relationship with IBS. Moreover, an AI algorithm was developed in order to correlate specific bowel sounds with IBS. In addition to that, AI-based smartphone applications have been developed to facilitate the monitoring of IBS symptoms. From a therapeutic standpoint, an AI system was created to recommend specific diets based on an individual's microbiota. In conclusion, future IBS diagnosis and treatment may benefit from AI.

Colon Bowel Preparation in the Era of Artificial Intelligence: Is There Potential for Enhancing Colon Bowel Cleansing?

BACKGROUND AND OBJECTIVES

Proper bowel preparation is of paramount importance for enhancing adenoma detection rates and reducing postcolonoscopic colorectal cancer risk. Despite recommendations from gastroenterology societies regarding the optimal rates of successful bowel preparation, these guidelines are frequently unmet. Various approaches have been employed to enhance the rates of successful bowel preparation, yet the quality of cleansing remains suboptimal. Intensive bowel preparation techniques, supplementary administration of bowel solutions, and educational interventions aimed at improving patient adherence to instructions have been commonly utilized, particularly among patients at a high risk of inadequate bowel preparation. Expedited strategies conducted on the same day as the procedure have also been endorsed by scientific organizations. More recently, the utilization of artificial intelligence (AI) has emerged for the preprocedural detection of inadequate bowel preparation, holding the potential to guide the preparation process immediately preceding colonoscopy. This manuscript comprehensively reviews the current strategies employed to optimize bowel cleansing, with a specific focus on patients with elevated risks for inadequate bowel preparation. Additionally, the prospective role of AI in this context is thoroughly examined.

CONCLUSIONS

While a majority of outpatients may achieve cleanliness with standard cleansing protocols, dealing with hard-to-prepare patients remains a challenge. Rescue strategies based on AI are promising, but such evidence remains limited. To ensure proper bowel cleansing, a combination of strategies should be performed.

Effectiveness and application of artificial intelligence for endoscopic screening of colorectal cancer: the future is now

INTRODUCTION

Artificial intelligence (AI) in gastrointestinal endoscopy includes systems designed to interpret medical images and increase sensitivity during examination. This may be a promising solution to human biases and may provide support during diagnostic endoscopy.

AREAS COVERED

This review aims to summarize and evaluate data supporting AI technologies in lower endoscopy, addressing their effectiveness, limitations, and future perspectives.

EXPERT OPINION

Computer-aided detection (CADe) systems have been studied with promising results, allowing for an increase in adenoma detection rate (ADR), adenoma per colonoscopy (APC), and a reduction in adenoma miss rate (AMR). This may lead to an increase in the sensitivity of endoscopic examinations and a reduction in the risk of interval-colorectal cancer. In addition, computer-aided characterization (CADx) has also been implemented, aiming to distinguish adenomatous and non-adenomatous lesions through real-time assessment using advanced endoscopic imaging techniques. Moreover, computer-aided quality (CADq) systems have been developed with the aim of standardizing quality measures in colonoscopy (e.g. withdrawal time and adequacy of bowel cleansing) both to improve the quality of examinations and set a reference standard for randomized controlled trials.

Artificial Intelligence Applied to Colonoscopy: Is It Time to Take a Step Forward?

Growing evidence indicates that artificial intelligence (AI) applied to medicine is here to stay. In gastroenterology, AI computer vision applications have been stated as a research priority. The two main AI system categories are computer-aided polyp detection (CADe) and computer-assisted diagnosis (CADx). However, other fields of expansion are those related to colonoscopy quality, such as methods to objectively assess colon cleansing during the colonoscopy, as well as devices to automatically predict and improve bowel cleansing before the examination, predict deep submucosal invasion, obtain a reliable measurement of colorectal polyps and accurately locate colorectal lesions in the colon. Although growing evidence indicates that AI systems could improve some of these quality metrics, there are concerns regarding cost-effectiveness, and large and multicentric randomized studies with strong outcomes, such as post-colonoscopy colorectal cancer incidence and mortality, are lacking. The integration of all these tasks into one quality-improvement device could facilitate the incorporation of AI systems in clinical practice. In this manuscript, the current status of the role of AI in colonoscopy is reviewed, as well as its current applications, drawbacks and areas for improvement.

Artificial Intelligence in Pediatric Endoscopy: Current Status and Future Applications

The application of artificial intelligence (AI) has great promise for improving pediatric endoscopy. The majority of preclinical studies have been undertaken in adults, with the greatest progress being made in the context of colorectal cancer screening and surveillance. This development has only been possible with advances in deep learning, like the convolutional neural network model, which has enabled real-time detection of pathology. Comparatively, the majority of deep learning systems developed in inflammatory bowel disease have focused on predicting disease severity and were developed using still images rather than videos. The application of AI to pediatric endoscopy is in its infancy, thus providing an opportunity to develop clinically meaningful and fair systems that do not perpetuate societal biases. In this review, we provide an overview of AI, summarize the advances of AI in endoscopy, and describe its potential application to pediatric endoscopic practice and education.

Quality of bowel preparation in patients with inflammatory bowel disease undergoing colonoscopy: What factors to consider?

An adequate bowel preparation in patients with inflammatory bowel disease (IBD) is a prerequisite for successful colonoscopy for screening, diagnosis, and surveillance. Several bowel preparation formulations are available, both high- and low-volume based on polyethylene glycol. Generally, low-volume formulations are also based on several compounds such as magnesium citrate preparations with sodium picosulphate, oral sulphate solution, and oral sodium phosphate-based solutions. Targeted studies on the quality of bowel preparation prior to colonoscopy in the IBD population are still required, with current evidence from existing studies being inconclusive. New frontiers are also moving towards the use of alternatives to anterograde ones, using preparations based on retrograde colonic lavage.

Artificial Intelligence-Aided Endoscopy and Colorectal Cancer Screening

Colorectal cancer (CRC) is the third most common cancer worldwide, with the highest incidence reported in high-income countries. However, because of the slow progression of neoplastic precursors, along with the opportunity for their endoscopic detection and resection, a well-designed endoscopic screening program is expected to strongly decrease colorectal cancer incidence and mortality. In this regard, quality of colonoscopy has been clearly related with the risk of post-colonoscopy colorectal cancer. Recently, the development of artificial intelligence (AI) applications in the medical field has been growing in interest. Through machine learning processes, and, more recently, deep learning, if a very high numbers of learning samples are available, AI systems may automatically extract specific features from endoscopic images/videos without human intervention, helping the endoscopists in different aspects of their daily practice. The aim of this review is to summarize the current knowledge on AI-aided endoscopy, and to outline its potential role in colorectal cancer prevention.

Artificial intelligence in gastroenterology: A narrative review

Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.

An interpretable artificial intelligence system for detecting risk factors of gastroesophageal variceal bleeding

Bleeding risk factors for gastroesophageal varices (GEV) detected by endoscopy in cirrhotic patients determine the prophylactical treatment patients will undergo in the following 2 years. We propose a methodology for measuring the risk factors. We create an artificial intelligence system (ENDOANGEL-GEV) containing six models to segment GEV and to classify the grades (grades 1-3) and red color signs (RC, RC0-RC3) of varices. It also summarizes changes in the above results with region in real time. ENDOANGEL-GEV is trained using 6034 images from 1156 cirrhotic patients across three hospitals (dataset 1) and validated on multicenter datasets with 11009 images from 141 videos (dataset 2) and in a prospective study recruiting 161 cirrhotic patients from Renmin Hospital of Wuhan University (dataset 3). In dataset 1, ENDOANGEL-GEV achieves intersection over union values of 0.8087 for segmenting esophageal varices and 0.8141 for gastric varices. In dataset 2, the system maintains fairly accuracy across images from three hospitals. In dataset 3, ENDOANGEL-GEV surpasses attended endoscopists in detecting RC of GEV and classifying grades (p < 0.001). When ranking the risk of patients combined with the Child‒Pugh score, ENDOANGEL-GEV outperforms endoscopists for esophageal varices (p < 0.001) and shows comparable performance for gastric varices (p = 0.152). Compared with endoscopists, ENDOANGEL-GEV may help 12.31% (16/130) more patients receive the right intervention. We establish an interpretable system for the endoscopic diagnosis and risk stratification of GEV. It will assist in detecting the first bleeding risk factors accurately and expanding the scope of quantitative measurement of diseases.

Automated Detection of Bowel Preparation Scoring and Adequacy With Deep Convolutional Neural Networks

INTRODUCTION

Adequate bowel preparation is integral to effective colonoscopy. Inadequate bowel preparation has been associated with reduced adenoma detection rate and increased post-colonoscopy colorectal cancer (PCCRC). As a result, the USMSTF recommends early interval reevaluation for colonoscopies with inadequate bowel preparation. However, bowel preparation documentation is highly variable with subjective interpretation. In this study, we developed deep convolutional neural networks (DCNN) to objectively ascertain bowel preparation.

METHODS

Bowel preparation scores were assigned using the Boston Bowel Preparation Scale (BBPS). Bowel preparation adequacy and inadequacy were defined as BBPS ≥2 and BBPS <2, respectively. A total of 38523 images were extracted from 28 colonoscopy videos and split into 26966 images for training, 7704 for validation, and 3853 for testing. Two DCNNs were created using a Densenet-169 backbone in PyTorch library evaluating BBPS score and bowel preparation adequacy. We used Adam optimiser with an initial learning rate of 3 × 10-4 and a scheduler to decay the learning rate of each parameter group by 0.1 every 7 epochs along with focal loss as our criterion for both classifiers.

RESULTS

The overall accuracy for BBPS subclassification and determination of adequacy was 91% and 98%, respectively. The accuracy for BBPS 0, BBPS 1, BBPS 2, and BBPS 3 was 84%, 91%, 85%, and 96%, respectively.

CONCLUSION

We developed DCCNs capable of assessing bowel preparation adequacy and scoring with a high degree of accuracy. However, this algorithm will require further research to assess its efficacy in real-time colonoscopy.

Expected value of artificial intelligence in gastrointestinal endoscopy: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement

This ESGE Position Statement defines the expected value of artificial intelligence (AI) for the diagnosis and management of gastrointestinal neoplasia within the framework of the performance measures already defined by ESGE. This is based on the clinical relevance of the expected task and the preliminary evidence regarding artificial intelligence in artificial or clinical settings. MAIN RECOMMENDATIONS:: (1) For acceptance of AI in assessment of completeness of upper GI endoscopy, the adequate level of mucosal inspection with AI should be comparable to that assessed by experienced endoscopists. (2) For acceptance of AI in assessment of completeness of upper GI endoscopy, automated recognition and photodocumentation of relevant anatomical landmarks should be obtained in ≥90% of the procedures. (3) For acceptance of AI in the detection of Barrett's high grade intraepithelial neoplasia or cancer, the AI-assisted detection rate for suspicious lesions for targeted biopsies should be comparable to that of experienced endoscopists with or without advanced imaging techniques. (4) For acceptance of AI in the management of Barrett's neoplasia, AI-assisted selection of lesions amenable to endoscopic resection should be comparable to that of experienced endoscopists. (5) For acceptance of AI in the diagnosis of gastric precancerous conditions, AI-assisted diagnosis of atrophy and intestinal metaplasia should be comparable to that provided by the established biopsy protocol, including the estimation of extent, and consequent allocation to the correct endoscopic surveillance interval. (6) For acceptance of artificial intelligence for automated lesion detection in small-bowel capsule endoscopy (SBCE), the performance of AI-assisted reading should be comparable to that of experienced endoscopists for lesion detection, without increasing but possibly reducing the reading time of the operator. (7) For acceptance of AI in the detection of colorectal polyps, the AI-assisted adenoma detection rate should be comparable to that of experienced endoscopists. (8) For acceptance of AI optical diagnosis (computer-aided diagnosis [CADx]) of diminutive polyps (≤5 mm), AI-assisted characterization should match performance standards for implementing resect-and-discard and diagnose-and-leave strategies. (9) For acceptance of AI in the management of polyps ≥ 6 mm, AI-assisted characterization should be comparable to that of experienced endoscopists in selecting lesions amenable to endoscopic resection.

The scientific progress and prospects of artificial intelligence in digestive endoscopy: A comprehensive bibliometric analysis

Artificial intelligence (AI) has been used for diagnosis and outcome prediction in clinical practice. Furthermore, AI in digestive endoscopy has attracted much attention and shown promising and stimulating results. This study aimed to determine the development trends and research hotspots of AI in digestive endoscopy by visualizing articles. Publications on AI in digestive endoscopy research were retrieved from the Web of Science Core Collection on April 25, 2022. VOSviewer and CiteSpace were used to assess and plot the research outputs. This analytical research was based on original articles and reviews. A total of 524 records of AI research in digestive endoscopy, published between 2005 and 2022, were retrieved. The number of articles has increased 27-fold from 2017 to 2021. Fifty-one countries and 994 institutions contributed to all publications. Asian countries had the highest number of publications. China, the USA, and Japan were consistently the leading driving forces and mainly contributed (26%, 21%, and 14.31%, respectively). With a solid academic reputation in this area, Japan has the highest number of citations per article. Tada Tomohiro published the most articles and received the most citations.. Gastrointestinal endoscopy published the largest number of publications, and 4 of the top 10 cited papers were published in this journal. "The Classification," "ulcerative colitis," "capsule endoscopy," "polyp detection," and "early gastric cancer" were the leading research hotspots. Our study provides systematic elaboration for researchers to better understand the development of AI in gastrointestinal endoscopy.

Artificial intelligence-based assessments of colonoscopic withdrawal technique: a new method for measuring and enhancing the quality of fold examination

BACKGROUND

This study aimed to develop an artificial intelligence (AI)-based system for measuring fold examination quality (FEQ) of colonoscopic withdrawal technique. We also examined the relationship between the system's evaluation of FEQ and FEQ scores from experts, and adenoma detection rate (ADR) and withdrawal time of colonoscopists, and evaluated the system's ability to improve FEQ during colonoscopy.

METHODS

First, we developed an AI-based system for measuring FEQ. Next, 103 consecutive colonoscopies performed by 11 colonoscopists were collected for evaluation. Three experts graded FEQ of each colonoscopy, after which the recorded colonoscopies were evaluated by the system. We further assessed the system by correlating its evaluation of FEQ against expert scoring, historical ADR, and withdrawal time of each colonoscopist. We also conducted a prospective observational study to evaluate the system's performance in enhancing fold examination.

RESULTS

The system's evaluations of FEQ of each endoscopist were significantly correlated with experts' scores (r = 0.871, P < 0.001), historical ADR (r = 0.852, P = 0.001), and withdrawal time (r = 0.727, P = 0.01). For colonoscopies performed by colonoscopists with previously low ADRs (< 25 %), AI assistance significantly improved the FEQ, evaluated by both the AI system (0.29 [interquartile range (IQR) 0.27-0.30] vs. 0.23 [0.17-0.26]) and experts (14.00 [14.00-15.00] vs. 11.67 [10.00-13.33]) (both P < 0.001).

CONCLUSION

The system's evaluation of FEQ was strongly correlated with FEQ scores from experts, historical ADR, and withdrawal time of each colonoscopist. The system has the potential to enhance FEQ.

Development and validation of a deep learning-based algorithm for colonoscopy quality assessment

BACKGROUND

Quality indicators should be assessed and monitored to improve colonoscopy quality in clinical practice. Endoscopists must enter relevant information in the endoscopy reporting system to facilitate data collection, which may be inaccurate. The current study aimed to develop a full deep learning-based algorithm to identify and analyze intra-procedural colonoscopy quality indicators based on endoscopy images obtained during the procedure.

METHODS

A deep learning system for classifying colonoscopy images for quality assurance purposes was developed and its performance was assessed with an independent dataset. The system was utilized to analyze captured images and results were compared with those of real-world reports.

RESULTS

In total, 10,417 images from the hospital endoscopy database and 3157 from Hyper-Kvasir open dataset were utilized to develop the quality assurance algorithm. The overall accuracy of the algorithm was 96.72% and that of the independent test dataset was 94.71%. Moreover, 761 real-world reports and colonoscopy images were analyzed. The accuracy of electronic reports about cecal intubation rate was 99.34% and that of the algorithm was 98.95%. The agreement rate for the assessment of polypectomy rates using the electronic reports and the algorithm was 0.87 (95% confidence interval 0.83-0.90). A good correlation was found between the withdrawal time calculated using the algorithm and that entered by the physician (correlation coefficient r = 0.959, p < 0.0001).

CONCLUSION

We proposed a novel deep learning-based algorithm that used colonoscopy images for quality assurance purposes. This model can be used to automatically assess intra-procedural colonoscopy quality indicators in clinical practice.

From advanced diagnosis to advanced resection in early neoplastic colorectal lesions: Never-ending and trending topics in the 2020s

Colonoscopy represents the most widespread and effective tool for the prevention and treatment of early stage preneoplastic and neoplastic lesions in the panorama of cancer screening. In the world there are different approaches to the topic of colorectal cancer prevention and screening: different starting ages (45-50 years); different initial screening tools such as fecal occult blood with immunohistochemical or immune-enzymatic tests; recto-sigmoidoscopy; and colonoscopy. The key aspects of this scenario are composed of a proper bowel preparation that ensures a valid diagnostic examination, experienced endoscopist in detection of preneoplastic and early neoplastic lesions and open-minded to upcoming artificial intelligence-aided examination, knowledge in the field of resection of these lesions (from cold-snaring, through endoscopic mucosal resection and endoscopic submucosal dissection, up to advanced tools), and management of complications.

Innovations in GI-endoscopy

Gastrointestinal endoscopy covers both diagnosis and therapy. Due to its diagnostic accuracy and minimal invasiveness, several innovations have been made within the last years including artificial intelligence and endoscopic tumor resection. The present review highlights some of these innovation. In addition, a special focus is set on the experience made by our own research group trying to combine the expertise of endoscopists/ physicians as well as engineers and computer scientists.

Artificial intelligence implementation in pancreaticobiliary endoscopy

INTRODUCTION

Artificial intelligence has been rapidly deployed in gastroenterology and endoscopy. The acceleration of deep convolutional neural networks along with hardware development has allowed implementation of artificial intelligence algorithms into real-time endoscopy, particularly colonoscopy. However, artificial intelligence implementation in pancreaticobiliary endoscopy is nascent.

AREAS COVERED

Initial studies have been conducted in endoscopic retrograde pancreatography (ERCP), endoscopic ultrasound (EUS), and digital single operator cholangioscopy (DSOC). Machine learning has been implemented in identifying significant landmarks, including the ampulla on ERCP, and the bile duct, pancreas, and portal confluence on EUS. Moreover, artificial intelligence algorithms have been deployed in differentiating pathology including pancreas cancer, autoimmune pancreatitis, pancreatic cystic lesions, and biliary strictures.

EXPERT OPINION

There have been relatively few studies with limited sample sizes in developing these machine learning algorithms. Despite the early successful demonstration of artificial intelligence in pancreaticobiliary endoscopy, additional research needs to be conducted with larger data sets to improve generalizability and assessed in real-time endoscopy before clinical implementation. However, pancreaticobiliary endoscopy remains a promising avenue of artificial intelligence application with the potential to improve clinical practice and outcomes.

Clinical Applications of Artificial Intelligence-An Updated Overview

Artificial intelligence has the potential to revolutionize modern society in all its aspects. Encouraged by the variety and vast amount of data that can be gathered from patients (e.g., medical images, text, and electronic health records), researchers have recently increased their interest in developing AI solutions for clinical care. Moreover, a diverse repertoire of methods can be chosen towards creating performant models for use in medical applications, ranging from disease prediction, diagnosis, and prognosis to opting for the most appropriate treatment for an individual patient. In this respect, the present paper aims to review the advancements reported at the convergence of AI and clinical care. Thus, this work presents AI clinical applications in a comprehensive manner, discussing the recent literature studies classified according to medical specialties. In addition, the challenges and limitations hindering AI integration in the clinical setting are further pointed out.

Artificial Intelligence for Colonoscopy: Past, Present, and Future

During the past decades, many automated image analysis methods have been developed for colonoscopy. Real-time implementation of the most promising methods during colonoscopy has been tested in clinical trials, including several recent multi-center studies. All trials have shown results that may contribute to prevention of colorectal cancer. We summarize the past and present development of colonoscopy video analysis methods, focusing on two categories of artificial intelligence (AI) technologies used in clinical trials. These are (1) analysis and feedback for improving colonoscopy quality and (2) detection of abnormalities. Our survey includes methods that use traditional machine learning algorithms on carefully designed hand-crafted features as well as recent deep-learning methods. Lastly, we present the gap between current state-of-the-art technology and desirable clinical features and conclude with future directions of endoscopic AI technology development that will bridge the current gap.

Use of U-Net Convolutional Neural Networks for Automated Segmentation of Fecal Material for Objective Evaluation of Bowel Preparation Quality in Colonoscopy

Background: Adequate bowel cleansing is important for colonoscopy performance evaluation. Current bowel cleansing evaluation scales are subjective, with a wide variation in consistency among physicians and low reported rates of accuracy. We aim to use machine learning to develop a fully automatic segmentation method for the objective evaluation of the adequacy of colon preparation. Methods: Colonoscopy videos were retrieved from a video data cohort and transferred to qualified images, which were randomly divided into training, validation, and verification datasets. The fecal residue was manually segmented. A deep learning model based on the U-Net convolutional network architecture was developed to perform automatic segmentation. The performance of the automatic segmentation was evaluated on the overlap area with the manual segmentation. Results: A total of 10,118 qualified images from 119 videos were obtained. The model averaged 0.3634 s to segmentate one image automatically. The models produced a strong high-overlap area with manual segmentation, with 94.7% ± 0.67% of that area predicted by our AI model, which correlated well with the area measured manually (r = 0.915, p < 0.001). The AI system can be applied in real-time qualitatively and quantitatively. Conclusions: We established a fully automatic segmentation method to rapidly and accurately mark the fecal residue-coated mucosa for the objective evaluation of colon preparation.

Artificial intelligence-assisted colonoscopy: a narrative review of current data and clinical applications

Colonoscopy is the reference standard procedure for the prevention and diagnosis of colorectal cancer, which is a leading cause of cancer-related deaths in Singapore. Artificial intelligence systems are automated, objective and reproducible. Artificial intelligence-assisted colonoscopy has recently been introduced into clinical practice as a clinical decision support tool. This review article provides a summary of the current published data and discusses ongoing research and current clinical applications of artificial intelligence-assisted colonoscopy.

Artificial intelligence for the assessment of bowel preparation

BACKGROUND AND AIMS

A reliable assessment of bowel preparation is important to ensure high-quality colonoscopy. Current bowel preparation scoring systems are limited by interobserver variability. This study aimed to demonstrate objective assessment of bowel preparation adequacy using an artificial intelligence (AI)/convolutional neural network (CNN) algorithm developed from colonoscopy videos.

METHODS

Two CNNs were developed using a training set of 73,304 images from 200 colonoscopies. First, a binary CNN was developed and trained to distinguish video frames that were appropriate versus inappropriate for scoring with the Boston Bowel Preparation Scale (BBPS). A second multiclass CNN was developed and trained on 26,950 appropriate frames that were expertly annotated with BBPS segment scores (0-3). We validated the algorithm using 252 10-second video clips that were assigned BBPS segment scores by 2 experts. The algorithm provided mean BBPS scores based on the algorithm (AI-BBPS) by calculating mean BBPS based on each frame's scoring. We maximized the algorithm's performance by choosing a dichotomized AI-BBPS score that closely matched dichotomized BBPS scores (ie, adequate vs inadequate). We tested the mean BBPS score based on the algorithm AI-BBPS against human rating using 30 independent 10-second video clips (test set 1) and 10 full withdrawal colonoscopy videos (test set 2).

RESULTS

In the validation set, the algorithm demonstrated an area under the curve of .918 and accuracy of 85.3% for detection of inadequate bowel cleanliness. In test set 1, sensitivity for inadequate bowel preparation was 100% and agreement between raters and AI was 76.7% to 83.3%. In test set 2, sensitivity for inadequate bowel preparation for each segment was 100% and agreement between raters and AI was 68.9% to 89.7%. Agreement between raters alone versus raters and AI were similar (κ = .694 and .649, respectively).

CONCLUSIONS

The algorithm assessment of bowel cleanliness as measured with the BBPS showed good performance and agreement with experts including full withdrawal colonoscopies.

Correlation of timed barium esophagography with Eckardt score in primary achalasia patients treated with peroral endoscopic myotomy

PURPOSE

The purpose of our study was to evaluate the role of timed barium esophagogram (TBE) in quantitative measurement of improved esophageal emptying in primary achalasia patients treated with POEM. Also, we investigated the correlation of TBE with improvement of clinical symptoms as measured by Eckardt score.

METHODS

This retrospective study included 30 patients who underwent POEM due to primary achalasia. As a baseline study, all patients underwent TBE and were evaluated for clinical status by Eckardt score based on presence and frequency of dysphagia, regurgitation, substernal pain, and weight loss. Follow-up evaluation was performed within 3 months after POEM. Pre- and post-POEM TBE results were compared using a calculated value based on summation of height of the barium columns on 1-, 2- and 5-min delayed images. Also, the correlation of TBE with improvement of Eckardt score was evaluated using Pearson's correlation test.

RESULTS

There was a significant decrease in the calculated value of height between pre- and post-POEM TBE studies (40.5 ± 15.8-17.0 ± 11.6, p < 0.01). Also, the Eckardt score decreased significantly after POEM (6.7 ± 2.0-0.8 ± 1.0, p < 0.01). Pearson's correlation test revealed a positive correlation between improvement of TBE results and Eckardt score (correlation coefficient = 0.56, p < 0.01).

CONCLUSION

TBE is an objective method for quantitative measurement of improved esophageal emptying in primary achalasia patients treated with POEM and shows positive correlation with clinical symptoms evaluated by Eckardt score.

Artificial Intelligence in Endoscopy

Background

Owing to their rapid development, artificial intelligence (AI) technologies offer a great promise for gastroenterology practice and research. At present, AI-guided image interpretation has already been used with success for endoscopic detection of early malignant lesions. Nonetheless, there are complex challenges and possible shortcomings that must be considered before full implementation can be realized.

Summary

In this review, the current status of AI in endoscopy is summarized. Future perspectives and open questions for further studies are stressed.

Key Messages

The usage of AI algorithms for polyp detection in screening colonoscopy results in a significant increase in the adenoma detection rate, mainly attributed to the identification of diminutive polyps. Computer-aided characterization of colorectal polyps accompanies the detection, but further studies are needed to evaluate the clinical benefit. In contrast to colonoscopy, usage of AI in gastroscopy is currently rather limited. Regarding other fields of endoscopic imaging, capsule endoscopy is the ideal imaging platform for AI, due to the potential of saving time in the video analysis.

Development of artificial intelligence technology in diagnosis, treatment, and prognosis of colorectal cancer

Artificial intelligence (AI) technology has made leaps and bounds since its invention. AI technology can be subdivided into many technologies such as machine learning and deep learning. The application scope and prospect of different technologies are also totally different. Currently, AI technologies play a pivotal role in the highly complex and wide-ranging medical field, such as medical image recognition, biotechnology, auxiliary diagnosis, drug research and development, and nutrition. Colorectal cancer (CRC) is a common gastrointestinal cancer that has a high mortality, posing a serious threat to human health. Many CRCs are caused by the malignant transformation of colorectal polyps. Therefore, early diagnosis and treatment are crucial to CRC prognosis. The methods of diagnosing CRC are divided into imaging diagnosis, endoscopy, and pathology diagnosis. Treatment methods are divided into endoscopic treatment, surgical treatment, and drug treatment. AI technology is in the weak era and does not have communication capabilities. Therefore, the current AI technology is mainly used for image recognition and auxiliary analysis without in-depth communication with patients. This article reviews the application of AI in the diagnosis, treatment, and prognosis of CRC and provides the prospects for the broader application of AI in CRC.

The Colon Endoscopic Bubble Scale (CEBuS): a two-phase evaluation study

BACKGROUND

To date, no scale has been validated to assess bubbles associated with bowel preparation. This study aimed to develop and assess the reliability of a novel scale - the Colon Endoscopic Bubble Scale (CEBuS).

METHODS

This was a multicenter, prospective, observational study with two online evaluation phases of 45 randomly distributed still colonoscopy images (15 per scale grade). Observers assessed images twice, 2 weeks apart, using CEBuS (CEBuS-0 - no or minimal bubbles, covering < 5 % of the surface; CEBuS-1 - bubbles covering 5 %-50 %; CEBuS-2 - bubbles covering > 50 %) and reporting the clinical action (do nothing; wash with water; wash with simethicone).

RESULTS

CEBuS provided high levels of agreement both in evaluation Phase 1 (4 experts) and Phase 2 (6 experts and 13 non-experts), with almost perfect intraobserver reliability: kappa 0.82 (95 % confidence interval 0.75-0.88) and 0.86 (0.85-0.88); interobserver agreement - intraclass correlation coefficient (ICC) 0.83 (0.73-0.89) and 0.90 (0.86-0.94). Previous endoscopic experience had no influence on agreement among experts vs. non-experts: kappa 0.86 (0.80-0.91) vs. 0.87 (0.84-0.89) and ICC 0.91 (0.87-0.94) vs. 0.90 (0.86-0.94), respectively. Interobserver agreement on clinical action was ICC 0.63 (0.43-0.78) in Phase 1 and 0.77 (0.68-0.84) in Phase 2. Absolute agreement on clinical action per scale grade was 85 % (82-88) for CEBuS-0, 21 % (16-26) for CEBuS-1, and 74 % (70-78) for CEBuS-2.

CONCLUSION

CEBuS proved to be a reliable instrument to standardize the evaluation of colonic bubbles during colonoscopy. Assessment in daily practice is warranted.

Charting a path forward for clinical research in artificial intelligence and gastroenterology

Gastroenterology has been an early leader in bridging the gap between artificial intelligence (AI) model development and clinical trial validation, and in recent years we have seen the publication of several randomized clinical trials examining the role of AI in gastroenterology. As AI applications for clinical medicine advance rapidly, there is a clear need for guidance surrounding AI-specific study design, evaluation, comparison, analysis and reporting of results. Several initiatives are in the publication or pre-publication phase including AI-specific amendments to minimum reporting guidelines for clinical trials, society task force initiatives aimed at priority use cases and research priorities, and minimum reporting guidelines that guide the reporting of clinical prediction models. In this paper, we examine applications of AI in clinical trials and discuss elements of newly published AI-specific extensions to the Consolidated Standards of Reporting Trials and Standard Protocol Items: Recommendations for Interventional Trials statements that guide clinical trial reporting and development. We then review AI applications at the pre-trial level in both endoscopy and other subfields of gastroenterology and explore areas where further guidance is needed to supplement the current guidance available at the pre-trial level.

Novel frontiers of agents for bowel cleansing for colonoscopy

The incidence of colorectal cancer (CRC) is characterized by rapid declines in the wake of widespread screening. Colonoscopy is the gold standard for CRC screening, but its accuracy is related to high quality of bowel preparation (BP). In this review, we aimed to summarized the current strategy to increase bowel cleansing before colonoscopy. Newly bowel cleansing agents were developed with the same efficacy of previous agent but requiring less amount of liquid to improve patients’ acceptability. The role of the diet before colonoscopy was also changed, as well the contribution of educational intervention and the use of adjunctive drugs to improve patients’ tolerance and/or quality of BP. The review also described BP in special situations, as lower gastrointestinal bleeding, elderly people, patients with chronic kidney disease, patients with inflammatory bowel disease, patients with congestive heart failure, inpatient, patient with previous bowel resection, pregnant/lactating patients. The review underlined the quality of BP should be described using a validate scale in colonoscopy report and it explored the available scales. Finally, the review explored the possible contribution of bowel cleansing in post-colonoscopy syndrome that can be related by a transient alteration of gut microbiota. Moreover, the study underlined several points needed to further investigations.

Artificial intelligence and polyp detection in colonoscopy: Use of a single neural network to achieve rapid polyp localization for clinical use

BACKGROUND AND AIM

Artificial intelligence has been extensively studied to assist clinicians in polyp detection, but such systems usually require expansive processing power, making them prohibitively expensive and hindering wide adaption. The current study used a fast object detection algorithm, known as the YOLOv3 algorithm, to achieve real-time polyp detection on a laptop. In addition, we evaluated and classified the causes of false detections to further improve accuracy.

METHODS

The YOLOv3 algorithm was trained and validated with 6038 and 2571 polyp images, respectively. Videos from live colonoscopies in a tertiary center and those obtained from public databases were used for the training and validation sets. The algorithm was tested on 10 unseen videos from the CVC-Video ClinicDB dataset. Only bounding boxes with an intersection over union area of > 0.3 were considered positive predictions.

RESULTS

Polyp detection rate in our study was 100%, with the algorithm able to detect every polyp in each video. Sensitivity, specificity, and F1 score were 74.1%, 85.1%, and 83.3, respectively. The algorithm achieved a speed of 61.2 frames per second (fps) on a desktop RTX2070 GPU and 27.2 fps on a laptop GTX2060 GPU. Nearly a quarter of false negatives happened when the polyps were at the corner of an image. Image blurriness accounted for approximately 3% and 9% of false positive and false negative detections, respectively.

CONCLUSION

The YOLOv3 algorithm can achieve real-time poly detection with high accuracy and speed on a desktop GPU, making it low cost and accessible to most endoscopy centers worldwide.

Automated detection of cecal intubation with variable bowel preparation using a deep convolutional neural network

Background and study aims  Colonoscopy completion reduces post-colonoscopy colorectal cancer. As a result, there have been attempts at implementing artificial intelligence to automate the detection of the appendiceal orifice (AO) for quality assurance. However, the utilization of these algorithms has not been demonstrated in suboptimal conditions, including variable bowel preparation. We present an automated computer-assisted method using a deep convolutional neural network to detect the AO irrespective of bowel preparation. Methods  A total of 13,222 images (6,663 AO and 1,322 non-AO) were extracted from 35 colonoscopy videos recorded between 2015 and 2018. The images were labelled with Boston Bowel Preparation Scale scores. A total of 11,900 images were used for training/validation and 1,322 for testing. We developed a convolutional neural network (CNN) with a DenseNet architecture pre-trained on ImageNet as a feature extractor on our data and trained a classifier uniquely tailored for identification of AO and non-AO images using binary cross entropy loss. Results  The deep convolutional neural network was able to correctly classify the AO and non-AO images with an accuracy of 94 %. The area under the receiver operating curve of this neural network was 0.98. The sensitivity, specificity, positive predictive value, and negative predictive value of the algorithm were 0.96, 0.92, 0.92 and 0.96, respectively. AO detection was > 95 % regardless of BBPS scores, while non-AO detection improved from BBPS 1 score (83.95 %) to BBPS 3 score (98.28 %). Conclusions  A deep convolutional neural network was created demonstrating excellent discrimination between AO from non-AO images despite variable bowel preparation. This algorithm will require further testing to ascertain its effectiveness in real-time colonoscopy.

Application of deep learning based artificial intelligence technology in identification of colorectal polyps

Colorectal cancer is a cancer type that is most suitable for screening since subjects at risk of this malignancy can clearly benefit from colonoscopy screening. In 2017, there were about 431951 new cases of colorectal cancer in China, with an increase of 203.5% in 28 years. Early detection and early removal of adenomatous polyps and other precancerous lesions during colonoscopy can prevent the occurrence of colorectal cancer. However, various factors lead to missed diagnosis of polyps during colonoscopy, which increases the risk of colorectal cancer. In recent years, with the rapid development of artificial intelligence technology in the medical field, colonoscopy assisted by artificial intelligence can increase the detection rate of polyps and improve the quality of colonoscopy. This paper mainly reviews the quality control, bowel preparation, diagnosis and classification of colorectal polyps, and the future opportunities and challenges faced by convolutional neural network based artificial intelligence technology in the field of colonoscopy, hoping to provide some reference for clinical work.

Current status and limitations of artificial intelligence in colonoscopy

BACKGROUND

Artificial intelligence (AI) using deep learning methods for polyp detection (CADe) and characterization (CADx) is on the verge of clinical application. CADe already implied its potential use in randomized controlled trials. Further efforts are needed to take CADx to the next level of development.

AIM

This work aims to give an overview of the current status of AI in colonoscopy, without going into too much technical detail.

METHODS

A literature search to identify important studies exploring the use of AI in colonoscopy was performed.

RESULTS

This review focuses on AI performance in screening colonoscopy summarizing the first prospective trials for CADe, the state of research in CADx as well as current limitations of those systems and legal issues.

Adoption of New Technologies: Artificial Intelligence

Over the past decade, artificial intelligence (AI) has been broadly applied to many aspects of human life, with recent groundbreaking successes in facial recognition, natural language processing, autonomous driving, and medical imaging. Gastroenterology has applied AI to a vast array of clinical problems, and some of the earliest prospective trials examining AI in medicine have been in computer vision applied to endoscopy. Evidence is mounting for 2 broad areas of AI as applied to gastroenterology: computer-aided detection and computer-aided diagnosis.

Multi-step validation of a deep learning-based system for the quantification of bowel preparation: a prospective, observational study

BACKGROUND

Inadequate bowel preparation is associated with a decrease in adenoma detection rate (ADR). A deep learning-based bowel preparation assessment system based on the Boston bowel preparation scale (BBPS) has been previously established to calculate the automatic BBPS (e-BBPS) score (ranging 0-20). The aims of this study were to investigate whether there was a statistically inverse relationship between the e-BBPS score and the ADR, and to determine the threshold of e-BBPS score for adequate bowel preparation in colonoscopy screening.

METHODS

In this prospective, observational study, we trained and internally validated the e-BBPS system using retrospective colonoscopy images and videos from the Endoscopy Center of Wuhan University, annotated by endoscopists. We externally validated the system using colonoscopy images and videos from the First People's Hospital of Yichang and the Third Hospital of Wuhan. To prospectively validate the system, we recruited consecutive patients at Renmin Hospital of Wuhan University aged between 18 and 75 years undergoing colonoscopy. The exclusion criteria included: contraindication to colonoscopy, family polyposis syndrome, inflammatory bowel disease, history of surgery for colorectal or colorectal cancer, known or suspected bowel obstruction or perforation, patients who were pregnant or lactating, inability to receive caecal intubation, and lumen obstruction. We did colonoscopy procedures and collected withdrawal videos, which were reviewed and the e-BBPS system was applied to all colon segments. The primary outcome of this study was ADR, defined as the proportion of patients with one or more conventional adenomas detected during colonoscopy. We calculated the ADR of each e-BBPS score and did a correlation analysis using Spearman analysis.

FINDINGS

From May 11 to Aug 10, 2020, 616 patients underwent screening colonoscopies, which evaluated. There was a significant inverse correlation between the e-BBPS score and ADR (Spearman's rank -0·976, p<0·010). The ADR for the e-BBPS scores 1-8 was 28·57%, 28·68%, 26·79%, 19·19%, 17·57%, 17·07%, 14·81%, and 0%, respectively. According to the 25% ADR standard for screening colonoscopy, an e-BBPS score of 3 was set as a threshold to guarantee an ADR of more than 25%, and so high-quality endoscopy. Patients with scores of more than 3 had a significantly lower ADR than those with a score of 3 or less (ADR 15·93% vs 28·03%, p<0·001, 95% CI 0·28-0·66, odds ratio 0·43).

INTERPRETATION

The e-BBPS system has potential to provide a more objective and refined threshold for the quantification of adequate bowel preparation.

FUNDING

Project of Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision and Hubei Province Major Science and Technology Innovation Project.

Artificial intelligence in the diagnosis of gastric precancerous conditions by image-enhanced endoscopy: a multicenter, diagnostic study (with video)

BACKGROUND AND AIMS

Gastric precancerous conditions, including gastric atrophy (GA) and intestinal metaplasia (IM), play an important role in the development of gastric cancer. Image-enhanced endoscopy (IEE) shows great potential in diagnosing gastric precancerous conditions and adenocarcinoma. In this study, a deep convolutional neural network system, named ENDOANGEL, was constructed to detect gastric precancerous conditions by IEE.

METHODS

Endoscopic images were retrospectively obtained from 5 hospitals in China for the development, validation, and internal and external test of the system. Prospective consecutive patients receiving IEE were enrolled from January 13, 2020 to October 29, 2020 in Renmin Hospital of Wuhan University to assess in real time the applicability of the proposed computer-aided detection (CADe) system in clinical practice, and the performance of CADe was compared with that of endoscopists.

RESULTS

Six thousand two hundred fifty endoscopic images from 760 patients and 98 video clips from 77 individuals undergoing IEE were enrolled in this study. The diagnostic accuracy of GA was .901 (95% confidence interval [CI], .883-.917) in the internal test set, .864 (95% CI, .842-.884) in the multicenter external test set, and .878 (95% CI, .796-.935) in the prospective video test set. The diagnostic accuracy of IM was .908 (95% CI, .889-.924) in the internal test set, .859 (95% CI, .837-.880) in the multicenter external test set, and .898 (95% CI, .820-.950) in the prospective video test set. CADe achieved similar diagnostic accuracy to that of the experts for detecting GA (.869 [95% CI, .790-.927] vs .846 [95% CI, .808-.879], P = .396) and IM (.888 [95% CI, .812-.941] vs .820 [95% CI, .780-.855], P = .117) and was superior to that of nonexperts for GA (.750 [95% CI, .711-.786], P = .008) and IM (.736 [95% CI, .697-.773], P = .028).

CONCLUSIONS

CADe achieved high diagnostic accuracy in gastric precancerous conditions, which was similar to that of experts and superior to that of nonexperts. Thus, CADe provides possibilities for a wide application in assisting in the diagnosis of gastric precancerous conditions.