Artificial intelligence in upper GI endoscopy - current status, challenges and future promise

Establishing an AI model and application for automated capsule endoscopy recognition based on convolutional neural networks (with video)

BACKGROUND

Although capsule endoscopy (CE) is a crucial tool for diagnosing small bowel diseases, the need to process a vast number of images imposes a significant workload on physicians, leading to a high risk of missed diagnoses. This study aims to develop an artificial intelligence (AI) model and application based on convolutional neural networks that can automatically recognize various lesions in small bowel capsule endoscopy.

METHODS

Three small bowel capsule endoscopy datasets were used for AI model training, validation, and testing, encompassing 12 categories of images. The model's performance was evaluated using metrics such as AUC, sensitivity, specificity, precision, accuracy, and F1 score to select the best model. A human-machine comparison experiment was conducted using the best model and endoscopists with varying levels of experience. Model interpretability was analyzed using Grad-CAM and SHAP techniques. Finally, a clinical application was developed based on the best model using PyQt5 technology.

RESULTS

A total of 34,303 images were included in this study. The best model, MobileNetv3-large, achieved a weighted average sensitivity of 87.17%, specificity of 98.77%, and an AUC of 0.9897 across all categories. The application developed based on this model performed exceptionally well in comparison with endoscopists, achieving an accuracy of 87.17% and a processing speed of 75.04 frames per second, surpassing endoscopists of varying experience levels.

CONCLUSION

The AI model and application developed based on convolutional neural networks can quickly and accurately identify 12 types of small bowel lesions. With its high sensitivity, this system can effectively assist physicians in interpreting small bowel capsule endoscopy images.Future studies will validate the AI system for video evaluations and real-world clinical integration.

Challenges in early detection and endoscopic resection of esophageal cancer: There is a long way to go

The publication by Qu et al provided a comprehensive discussion about the epidemiology, etiology, histopathology, early detection, and endoscopic treatment of esophageal carcinoma (EC) and summarized the progress in the advanced technologies for screening and endoscopic resection for EC. In this editorial, we will provide deeper insight into the challenges that hinder practical application of these advanced technologies along with the role of these technologies in upper endoscopy quality. More efforts need to be made to overcome the challenges and add the value of these technologies in upper endoscopy quality. Clinical outcomes of management strategies after noncurative endoscopic dissection for early EC patients need further investigation. The experiences with noncurative endoscopic resection of other organs may have certain implications for noncurative resection of early EC.

Revolutionizing healthcare by use of artificial intelligence in esophageal carcinoma - a narrative review

Esophageal cancer is a major cause of cancer-related mortality worldwide, with significant regional disparities. Early detection of precursor lesions is essential to improve patient outcomes. Artificial intelligence (AI) techniques, including deep learning and machine learning, have proved to be of assistance to both gastroenterologists and pathologists in the diagnosis and characterization of upper gastrointestinal malignancies by correlating with the histopathology. The primary diagnostic method in gastroenterology is white light endoscopic evaluation, but conventional endoscopy is partially inefficient in detecting esophageal cancer. However, other endoscopic modalities, such as narrow-band imaging, endocytoscopy, and endomicroscopy, have shown improved visualization of mucosal structures and vasculature, which provides a set of baseline data to develop efficient AI-assisted predictive models for quick interpretation. The main challenges in managing esophageal cancer are identifying high-risk patients and the disease's poor prognosis. Thus, AI techniques can play a vital role in improving the early detection and diagnosis of precursor lesions, assisting gastroenterologists in performing targeted biopsies and real-time decisions of endoscopic mucosal resection or endoscopic submucosal dissection. Combining AI techniques and endoscopic modalities can enhance the diagnosis and management of esophageal cancer, improving patient outcomes and reducing cancer-related mortality rates. The aim of this review is to grasp a better understanding of the application of AI in the diagnosis, treatment, and prognosis of esophageal cancer and how computer-aided diagnosis and computer-aided detection can act as vital tools for clinicians in the long run.

Comparing artificial intelligence to humans for endoscopic diagnosis of gastric neoplasia: An external validation study

OBJECTIVES

Artificial intelligence (AI) uses deep learning functionalities that may enhance the detection of early gastric cancer during endoscopy. An AI-based endoscopic system for upper endoscopy was recently developed in Japan. We aim to validate this AI-based system in a Singaporean cohort.

METHODS

There were 300 de-identified still images prepared from endoscopy video files obtained from subjects that underwent gastroscopy in National University Hospital (NUH). Five specialists and 6 non-specialists (trainees) from NUH were assigned to read and categorize the images into "neoplastic" or "non-neoplastic." Results were then compared with the readings performed by the endoscopic AI system.

RESULTS

The mean accuracy, sensitivity, and specificity for the 11 endoscopists were 0.847, 0.525, and 0.872, respectively. These values for the AI-based system were 0.777, 0.591, and 0.791, respectively. While AI in general did not perform better than endoscopists on the whole, in the subgroup of high-grade dysplastic lesions, only 29.1% were picked up by the endoscopist rating, but 80% were classified as neoplastic by AI (P = 0.0011). The average diagnostic time was also faster in AI compared with endoscopists (677.1 s vs 42.02 s (P < 0.001).

CONCLUSION

We demonstrated that an AI system developed in another health system was comparable in diagnostic accuracy in the evaluation of static images. AI systems are faster and not fatigable and may have a role in augmenting human diagnosis during endoscopy. With more advances in AI and larger studies to support its efficacy it would likely play a larger role in screening endoscopy in future.

Comparative study of convolutional neural network architectures for gastrointestinal lesions classification

The gastrointestinal (GI) tract can be affected by different diseases or lesions such as esophagitis, ulcers, hemorrhoids, and polyps, among others. Some of them can be precursors of cancer such as polyps. Endoscopy is the standard procedure for the detection of these lesions. The main drawback of this procedure is that the diagnosis depends on the expertise of the doctor. This means that some important findings may be missed. In recent years, this problem has been addressed by deep learning (DL) techniques. Endoscopic studies use digital images. The most widely used DL technique for image processing is the convolutional neural network (CNN) due to its high accuracy for modeling complex phenomena. There are different CNNs that are characterized by their architecture. In this article, four architectures are compared: AlexNet, DenseNet-201, Inception-v3, and ResNet-101. To determine which architecture best classifies GI tract lesions, a set of metrics; accuracy, precision, sensitivity, specificity, F1-score, and area under the curve (AUC) were used. These architectures were trained and tested on the HyperKvasir dataset. From this dataset, a total of 6,792 images corresponding to 10 findings were used. A transfer learning approach and a data augmentation technique were applied. The best performing architecture was DenseNet-201, whose results were: 97.11% of accuracy, 96.3% sensitivity, 99.67% specificity, and 95% AUC.

An Optimal Artificial Intelligence System for Real-Time Endoscopic Prediction of Invasion Depth in Early Gastric Cancer

We previously constructed a VGG-16 based artificial intelligence (AI) model (image classifier [IC]) to predict the invasion depth in early gastric cancer (EGC) using endoscopic static images. However, images cannot capture the spatio-temporal information available during real-time endoscopy-the AI trained on static images could not estimate invasion depth accurately and reliably. Thus, we constructed a video classifier [VC] using videos for real-time depth prediction in EGC. We built a VC by attaching sequential layers to the last convolutional layer of IC v2, using video clips. We computed the standard deviation (SD) of output probabilities for a video clip and the sensitivities in the manner of frame units to observe consistency. The sensitivity, specificity, and accuracy of IC v2 for static images were 82.5%, 82.9%, and 82.7%, respectively. However, for video clips, the sensitivity, specificity, and accuracy of IC v2 were 33.6%, 85.5%, and 56.6%, respectively. The VC performed better analysis of the videos, with a sensitivity of 82.3%, a specificity of 85.8%, and an accuracy of 83.7%. Furthermore, the mean SD was lower for the VC than IC v2 (0.096 vs. 0.289). The AI model developed utilizing videos can predict invasion depth in EGC more precisely and consistently than image-trained models, and is more appropriate for real-world situations.

Advances and horizons for artificial intelligence of endoscopic screening and surveillance of gastric and esophageal disease

The development of artificial intelligence in endoscopic assessment of the gastrointestinal tract has shown progressive enhancement in diagnostic acuity. This review discusses the expanding applications for gastric and esophageal diseases. The gastric section covers the utility of AI in detecting and characterizing gastric polyps and further explores prevention, detection, and classification of gastric cancer. The esophageal discussion highlights applications for use in screening and surveillance in Barrett's esophagus and in high-risk conditions for esophageal squamous cell carcinoma. Additionally, these discussions highlight applications for use in assessing eosinophilic esophagitis and future potential in assessing esophageal microbiome changes.

Artificial intelligence for cancer detection in upper gastrointestinal endoscopy, current status, and future aspirations

This minireview discusses the benefits and pitfalls of machine learning, and artificial intelligence in upper gastrointestinal endoscopy for the detection and characterization of neoplasms. We have reviewed the literature for relevant publications on the topic using PubMed, IEEE, Science Direct, and Google Scholar databases. We discussed the phases of machine learning and the importance of advanced imaging techniques in upper gastrointestinal endoscopy and its association with artificial intelligence.

Machine Learning for Future Subtyping of the Tumor Microenvironment of Gastro-Esophageal Adenocarcinomas

Tumor progression involves an intricate interplay between malignant cells and their surrounding tumor microenvironment (TME) at specific sites. The TME is dynamic and is composed of stromal, parenchymal, and immune cells, which mediate cancer progression and therapy resistance. Evidence from preclinical and clinical studies revealed that TME targeting and reprogramming can be a promising approach to achieve anti-tumor effects in several cancers, including in GEA. Thus, it is of great interest to use modern technology to understand the relevant components of programming the TME. Here, we discuss the approach of machine learning, which recently gained increasing interest recently because of its ability to measure tumor parameters at the cellular level, reveal global features of relevance, and generate prognostic models. In this review, we discuss the relevant stromal composition of the TME in GEAs and discuss how they could be integrated. We also review the current progress in the application of machine learning in different medical disciplines that are relevant for the management and study of GEA.

Endoscopic diagnosis and treatment of gastric dysplasia and early cancer: Current evidence and what the future may hold

Gastric cancer accounts for a significant proportion of worldwide cancer-related morbidity and mortality. The well documented precancerous cascade provides an opportunity for clinicians to detect and treat gastric cancers at an endoscopically curable stage. In high prevalence regions such as Japan and Korea, this has led to the implementation of population screening programs. However, guidelines remain ambiguous in lower prevalence regions. In recent years, there have been many advances in the endoscopic diagnosis and treatment of early gastric cancer and precancerous lesions. More advanced endoscopic imaging has led to improved detection and characterization of gastric lesions as well as superior accuracy for delineation of margins prior to resection. In addition, promising early data on artificial intelligence in gastroscopy suggests a future role for this technology in maximizing the yield of advanced endoscopic imaging. Data on endoscopic resection (ER) are particularly robust in Japan and Korea, with high rates of curative ER and markedly reduced procedural morbidity. However, there is a shortage of data in other regions to support the applicability of protocols from these high prevalence countries. Future advances in endoscopic therapeutics will likely lead to further expansion of the current indications for ER, as both technology and proceduralist expertise continue to grow.

Artificial intelligence in gastroenterology and hepatology: Status and challenges

Originally proposed by John McCarthy in 1955, artificial intelligence (AI) has achieved a breakthrough and revolutionized the processing methods of clinical medicine with the increasing workloads of medical records and digital images. Doctors are paying attention to AI technologies for various diseases in the fields of gastroenterology and hepatology. This review will illustrate AI technology procedures for medical image analysis, including data processing, model establishment, and model validation. Furthermore, we will summarize AI applications in endoscopy, radiology, and pathology, such as detecting and evaluating lesions, facilitating treatment, and predicting treatment response and prognosis with excellent model performance. The current challenges for AI in clinical application include potential inherent bias in retrospective studies that requires larger samples for validation, ethics and legal concerns, and the incomprehensibility of the output results. Therefore, doctors and researchers should cooperate to address the current challenges and carry out further investigations to develop more accurate AI tools for improved clinical applications.