Artificial intelligence in GI endoscopy: stumbling blocks, gold standards and the role of endoscopy societies

Human-artificial intelligence interaction in gastrointestinal endoscopy

The number and variety of applications of artificial intelligence (AI) in gastrointestinal (GI) endoscopy is growing rapidly. New technologies based on machine learning (ML) and convolutional neural networks (CNNs) are at various stages of development and deployment to assist patients and endoscopists in preparing for endoscopic procedures, in detection, diagnosis and classification of pathology during endoscopy and in confirmation of key performance indicators. Platforms based on ML and CNNs require regulatory approval as medical devices. Interactions between humans and the technologies we use are complex and are influenced by design, behavioural and psychological elements. Due to the substantial differences between AI and prior technologies, important differences may be expected in how we interact with advice from AI technologies. Human–AI interaction (HAII) may be optimised by developing AI algorithms to minimise false positives and designing platform interfaces to maximise usability. Human factors influencing HAII may include automation bias, alarm fatigue, algorithm aversion, learning effect and deskilling. Each of these areas merits further study in the specific setting of AI applications in GI endoscopy and professional societies should engage to ensure that sufficient emphasis is placed on human-centred design in development of new AI technologies.

Closing the Gap: A Critical Examination of Adherence, Inconsistency, and Improvements in Colonoscopy Reporting Practices

INTRODUCTION

Comprehensive and standardized colonoscopy reports are crucial in colorectal cancer prevention, monitoring, and research. This study investigates adherence to national and international guidelines by analyzing reporting practices among 21 endoscopists in 7 German centers, with a focus on polyp reporting.

METHODS

We identified and assessed German, European, American, and World Health Organization-provided statements to identify key elements in colonoscopy reporting. Board-certified gastroenterologists rated the relevance of each element and estimated their reporting frequency. Adherence to the identified report elements was evaluated for 874 polyps from 351 colonoscopy reports ranging from March 2021 to March 2022.

RESULTS

We identified numerous recommendations for colonoscopy reporting. We categorized the reasoning behind those recommendations into clinical relevance, justification, and quality control and research. Although all elements were considered relevant by the surveyed gastroenterologists, discrepancies were observed in the evaluated reports. Particularly diminutive polyps or attributes which are rarely abnormal (e.g., surface integrity) respectively rarely performed (e.g., injection) were sparsely documented. Furthermore, the white light morphology of polyps was inconsistently documented using either the Paris classification or free text. In summary, the analysis of 874 reported polyps revealed heterogeneous adherence to the recommendations, with reporting frequencies ranging from 3% to 89%.

CONCLUSION

The inhomogeneous report practices may result from implicit reporting practices and recommendations with varying clinical relevance. Future recommendations should clearly differentiate between clinical relevance and research and quality control or explanatory purposes. Additionally, the role of computer-assisted documentation should be further evaluated to increase report frequencies of non-pathological findings and diminutive polyps.

Diagnostic accuracy of artificial intelligence-aided capsule endoscopy (TOP100) in overt small bowel bleeding

BACKGROUND

Capsule endoscopy (CE) is the first-choice exploration in case of overt small bowel bleeding (SBB). An early CE is known to increase diagnostic yield, but long reading times may delay therapeutics. The study evaluates the diagnostic performance of the artificial intelligence tool TOP100 in patients with overt SBB undergoing early CE with Pillcam SB3.

METHODS

Patients who underwent early CE (up to 14 days from the bleeding episode) for suspected overt SBB were included. One experienced endoscopist prospectively performed standard reading (SR) and a second blind experienced endoscopist performed a TOP100-based reading (TR). The primary endpoint was TR diagnostic accuracy for lesions with high bleeding potential (P2).

RESULTS

A total of 111 patients were analyzed. The most common clinical presentation was melena (64%). CE showed angiodysplasias in 40.5% of patients (45/111). In per-patient analysis, TR showed a sensitivity of 90.48% (95% CI 82.09-95.80), specificity of 100% (95% CI 87.23-100) with a PPV of 100% (95% CI 94.01-100), NPV of 77.14% (95% CI 63.58-86.71) and diagnostic accuracy of 92.79 (86.29-96.84). At multivariate analysis, adequate intestinal cleansing was the only independent predictor of concordance between TR and SR (OR 2.909, p = 0.019). The median reading time for SR and TR was 23 min (18.0-26.8) and 1.9 min (range 1.7-2.1), respectively (p < 0.001).

CONCLUSIONS

TOP100 provides a fast-reading mode for early CE in case of overt small bowel bleeding. It identifies most patients with active bleeding and angiodysplasias, aiding in the prioritization of therapeutic procedures. However, its accuracy in detecting ulcers, varices and P1 lesions seems insufficient.

Artificial Intelligence in Pediatric Endoscopy: Current Status and Future Applications

The application of artificial intelligence (AI) has great promise for improving pediatric endoscopy. The majority of preclinical studies have been undertaken in adults, with the greatest progress being made in the context of colorectal cancer screening and surveillance. This development has only been possible with advances in deep learning, like the convolutional neural network model, which has enabled real-time detection of pathology. Comparatively, the majority of deep learning systems developed in inflammatory bowel disease have focused on predicting disease severity and were developed using still images rather than videos. The application of AI to pediatric endoscopy is in its infancy, thus providing an opportunity to develop clinically meaningful and fair systems that do not perpetuate societal biases. In this review, we provide an overview of AI, summarize the advances of AI in endoscopy, and describe its potential application to pediatric endoscopic practice and education.

On evaluation metrics for medical applications of artificial intelligence

Clinicians and software developers need to understand how proposed machine learning (ML) models could improve patient care. No single metric captures all the desirable properties of a model, which is why several metrics are typically reported to summarize a model’s performance. Unfortunately, these measures are not easily understandable by many clinicians. Moreover, comparison of models across studies in an objective manner is challenging, and no tool exists to compare models using the same performance metrics. This paper looks at previous ML studies done in gastroenterology, provides an explanation of what different metrics mean in the context of binary classification in the presented studies, and gives a thorough explanation of how different metrics should be interpreted. We also release an open source web-based tool that may be used to aid in calculating the most relevant metrics presented in this paper so that other researchers and clinicians may easily incorporate them into their research.

Weakly supervised end-to-end artificial intelligence in gastrointestinal endoscopy

Artificial intelligence (AI) is widely used to analyze gastrointestinal (GI) endoscopy image data. AI has led to several clinically approved algorithms for polyp detection, but application of AI beyond this specific task is limited by the high cost of manual annotations. Here, we show that a weakly supervised AI can be trained on data from a clinical routine database to learn visual patterns of GI diseases without any manual labeling or annotation. We trained a deep neural network on a dataset of N = 29,506 gastroscopy and N = 18,942 colonoscopy examinations from a large endoscopy unit serving patients in Germany, the Netherlands and Belgium, using only routine diagnosis data for the 42 most common diseases. Despite a high data heterogeneity, the AI system reached a high performance for diagnosis of multiple diseases, including inflammatory, degenerative, infectious and neoplastic diseases. Specifically, a cross-validated area under the receiver operating curve (AUROC) of above 0.70 was reached for 13 diseases, and an AUROC of above 0.80 was reached for two diseases in the primary data set. In an external validation set including six disease categories, the AI system was able to significantly predict the presence of diverticulosis, candidiasis, colon and rectal cancer with AUROCs above 0.76. Reverse engineering the predictions demonstrated that plausible patterns were learned on the level of images and within images and potential confounders were identified. In summary, our study demonstrates the potential of weakly supervised AI to generate high-performing classifiers and identify clinically relevant visual patterns based on non-annotated routine image data in GI endoscopy and potentially other clinical imaging modalities.

PEACE: Perception and Expectations toward Artificial Intelligence in Capsule Endoscopy

Artificial intelligence (AI) has shown promising results in digestive endoscopy, especially in capsule endoscopy (CE). However, some physicians still have some difficulties and fear the advent of this technology. We aimed to evaluate the perceptions and current sentiments toward the use of AI in CE. An online survey questionnaire was sent to an audience of gastroenterologists. In addition, several European national leaders of the International CApsule endoscopy REsearch (I CARE) Group were asked to disseminate an online survey among their national communities of CE readers (CER). The survey included 32 questions regarding general information, perceptions of AI, and its use in daily life, medicine, endoscopy, and CE. Among 380 European gastroenterologists who answered this survey, 333 (88%) were CERs. The mean average time length of experience in CE reading was 9.9 years (0.5–22). A majority of CERs agreed that AI would positively impact CE, shorten CE reading time, and help standardize reporting in CE and characterize lesions seen in CE. Nevertheless, in the foreseeable future, a majority of CERs disagreed with the complete replacement all CE reading by AI. Most CERs believed in the high potential of AI for becoming a valuable tool for automated diagnosis and for shortening the reading time. Currently, the perception is that AI will not replace CE reading.