High Accuracy of Convolutional Neural Network for Evaluation of Helicobacter pylori Infection Based on Endoscopic Images: Preliminary Experience

Development and application of an artificial intelligence-assisted endoscopy system for diagnosis of Helicobacter pylori infection: a multicenter randomized controlled study

BACKGROUND

The early diagnosis and treatment of Heliobacter pylori (H.pylori) gastrointestinal infection provide significant benefits to patients. We constructed a convolutional neural network (CNN) model based on an endoscopic system to diagnose H. pylori infection, and then examined the potential benefit of this model to endoscopists in their diagnosis of H. pylori infection.

MATERIALS AND METHODS

A CNN neural network system for endoscopic diagnosis of H.pylori infection was established by collecting 7377 endoscopic images from 639 patients. The accuracy, sensitivity, and specificity were determined. Then, a randomized controlled study was used to compare the accuracy of diagnosis of H. pylori infection by endoscopists who were assisted or unassisted by this CNN model.

RESULTS

The deep CNN model for diagnosis of H. pylori infection had an accuracy of 89.6%, a sensitivity of 90.9%, and a specificity of 88.9%. Relative to the group of endoscopists unassisted by AI, the AI-assisted group had better accuracy (92.8% [194/209; 95%CI: 89.3%, 96.4%] vs. 75.6% [158/209; 95%CI: 69.7%, 81.5%]), sensitivity (91.8% [67/73; 95%CI: 85.3%, 98.2%] vs. 78.6% [44/56; 95%CI: 67.5%, 89.7%]), and specificity (93.4% [127/136; 95%CI: 89.2%, 97.6%] vs. 74.5% [114/153; 95%CI: 67.5%, 81.5%]). All of these differences were statistically significant (P < 0.05).

CONCLUSION

Our AI-assisted system for diagnosis of H. pylori infection has significant ability for diagnostic, and can improve the accuracy of endoscopists in gastroscopic diagnosis.

TRIAL REGISTRATION

This study was approved by the Ethics Committee of Daping Hospital (10/07/2020) (No.89,2020) and was registered with the Chinese Clinical Trial Registration Center (02/09/2020)   ( www.chictr.org.cn ; registration number: ChiCTR2000037801).

A review of deep learning methods for gastrointestinal diseases classification applied in computer-aided diagnosis system

Recent advancements in deep learning have significantly improved the intelligent classification of gastrointestinal (GI) diseases, particularly in aiding clinical diagnosis. This paper seeks to review a computer-aided diagnosis (CAD) system for GI diseases, aligning with the actual clinical diagnostic process. It offers a comprehensive survey of deep learning (DL) techniques tailored for classifying GI diseases, addressing challenges inherent in complex scenes, clinical constraints, and technical obstacles encountered in GI imaging. Firstly, the esophagus, stomach, small intestine, and large intestine were located to determine the organs where the lesions were located. Secondly, location detection and classification of a single disease are performed on the premise that the organ's location corresponding to the image is known. Finally, comprehensive classification for multiple diseases is carried out. The results of single and multi-classification are compared to achieve more accurate classification outcomes, and a more effective computer-aided diagnosis system for gastrointestinal diseases was further constructed.

Novel endoscopic techniques for the diagnosis of gastric Helicobacter pylori infection: a systematic review and network meta-analysis

Objective

This study aimed to conduct a network meta-analysis to compare the diagnostic efficacy of diverse novel endoscopic techniques for detecting gastric Helicobacter pylori infection.

Methods

From inception to August 2023, literature was systematically searched across Pubmed, Embase, and Web of Science databases. Cochrane's risk of bias tool assessed the methodological quality of the included studies. Data analysis was conducted using the R software, employing a ranking chart to determine the most effective diagnostic method comprehensively. Convergence analysis was performed to assess the stability of the results.

Results

The study encompassed 36 articles comprising 54 observational studies, investigating 14 novel endoscopic techniques and involving 7,230 patients diagnosed with gastric H. pylori infection. Compared with the gold standard, the comprehensive network meta-analysis revealed the superior diagnostic performance of two new endoscopic techniques, Magnifying blue laser imaging endoscopy (M-BLI) and high-definition magnifying endoscopy with i-scan (M-I-SCAN). Specifically, M-BLI demonstrated the highest ranking in both sensitivity (SE) and positive predictive value (PPV), ranking second in negative predictive value (NPV) and fourth in specificity (SP). M-I-SCAN secured the top position in NPV, third in SE and SP, and fifth in PPV.

Conclusion

After thoroughly analyzing the ranking chart, we conclude that M-BLI and M-I-SCAN stand out as the most suitable new endoscopic techniques for diagnosing gastric H. pylori infection.

Systematic review registration

https://inplasy.com/inplasy-2023-11-0051/, identifier INPLASY2023110051.

Will artificial intelligence reach any limit in gastroenterology?

Endoscopy is the cornerstone in the management of digestive diseases. Over the last few decades, technology has played an important role in the development of this field, helping endoscopists in better detecting and characterizing luminal lesions. However, despite ongoing advancements in endoscopic technology, the incidence of missed pre-neoplastic and neoplastic lesions remains high due to the operator-dependent nature of endoscopy and the challenging learning curve associated with new technologies. Artificial intelligence (AI), an operator-independent field, could be an invaluable solution. AI can serve as a “second observer”, enhancing the performance of endoscopists in detecting and characterizing luminal lesions. By utilizing deep learning (DL), an innovation within machine learning, AI automatically extracts input features from targeted endoscopic images. DL encompasses both computer-aided detection and computer-aided diagnosis, assisting endoscopists in reducing missed detection rates and predicting the histology of luminal digestive lesions. AI applications in clinical gastrointestinal diseases are continuously expanding and evolving the entire digestive tract. In all published studies, real-time AI assists endoscopists in improving the performance of non-expert gastroenterologists, bringing it to a level comparable to that of experts. The development of DL may be affected by selection biases. Studies have utilized different AI-assisted models, which are heterogeneous. In the future, algorithms need validation through large, randomized trials. Theoretically, AI has no limit to assist endoscopists in increasing the accuracy and the quality of endoscopic exams. However, practically, we still have a long way to go before standardizing our AI models to be accepted and applied by all gastroenterologists.

Characteristic endoscopic findings in Helicobacter pylori diagnosis in clinical practice

INTRODUCTION

Helicobacter pylori is a major risk factor for gastric cancer. In addition to eradication therapy, early-phase detection of gastric cancer through screening programs using high-vision endoscopy is also widely known to reduce mortality. Although European and US guidelines recommend evaluation of atrophy and intestinal metaplasia by high-vision endoscopy and pathological findings, the guideline used in Japan - the Kyoto classification of gastritis - is based on endoscopic evaluation, and recommends the grading of risk factors. This system requires classification into three endoscopic groups: H. pylori-negative, previous H. pylori infection (inactive gastritis), and current H. pylori infection (active gastritis). Major endoscopic findings in active gastritis are diffuse redness, enlarged folds, nodularity, mucosal swelling, and sticky mucus, while those in H pylori-related gastritis - irrespective of active or inactive status - are atrophy, intestinal metaplasia, and xanthoma.

AREAS COVERED

This review describes the endoscopic characteristics of current H. pylori infection, and how characteristic endoscopic findings should be evaluated.

EXPERT OPINION

Although the correct evaluation of endoscopic findings related to H. pylori remains necessary, if findings of possible infection are observed, it is important to diagnose infection by detection methods with high sensitivity and specificity, including the stool antigen test and urea breath test.

Artificial intelligence for gastric cancer in endoscopy: From diagnostic reasoning to market

Recognition of gastric conditions during endoscopy exams, including gastric cancer, usually requires specialized training and a long learning curve. Besides that, the interobserver variability is frequently high due to the different morphological characteristics of the lesions and grades of mucosal inflammation. In this sense, artificial intelligence tools based on deep learning models have been developed to support physicians to detect, classify, and predict gastric lesions more efficiently. Even though a growing number of studies exists in the literature, there are multiple challenges to bring a model to practice in this field, such as the need for more robust validation studies and regulatory hurdles. Therefore, the aim of this review is to provide a comprehensive assessment of the current use of artificial intelligence applied to endoscopic imaging to evaluate gastric precancerous and cancerous lesions and the barriers to widespread implementation of this technology in clinical routine.

A study on the improvement in the ability of endoscopists to diagnose gastric neoplasms using an artificial intelligence system

Background

Artificial intelligence-assisted gastroscopy (AIAG) based on deep learning has been validated in various scenarios, but there is a lack of studies regarding diagnosing neoplasms under white light endoscopy. This study explored the potential role of AIAG systems in enhancing the ability of endoscopists to diagnose gastric tumor lesions under white light.

Methods

A total of 251 patients with complete pathological information regarding electronic gastroscopy, biopsy, or ESD surgery in Xi'an Gaoxin Hospital were retrospectively collected and comprised 64 patients with neoplasm lesions (excluding advanced cancer) and 187 patients with non-neoplasm lesions. The diagnosis competence of endoscopists with intermediate experience and experts was compared for gastric neoplasms with or without the assistance of AIAG, which was developed based on ResNet-50.

Results

For the 251 patients with difficult clinical diagnoses included in the study, compared with endoscopists with intermediate experience, AIAG's diagnostic competence was much higher, with a sensitivity of 79.69% (79.69% vs. 72.50%, p = 0.012) and a specificity of 73.26% (73.26% vs. 52.62%, p < 0.001). With the help of AIAG, the endoscopists with intermediate experience (<8 years) demonstrated a relatively higher specificity (59.79% vs. 52.62%, p < 0.001). Experts (≥8 years) had similar results with or without AI assistance (with AI vs. without AI; sensitivities, 70.31% vs. 67.81%, p = 0.358; specificities, 83.85% vs. 85.88%, p = 0.116).

Conclusion

With the assistance of artificial intelligence (AI) systems, the ability of endoscopists with intermediate experience to diagnose gastric neoplasms is significantly improved, but AI systems have little effect on experts.

Applications of artificial intelligence in gastroscopy: a narrative review

Gastroscopy, a critical tool for the diagnosis of upper gastrointestinal diseases, has recently incorporated artificial intelligence (AI) technology to alleviate the challenges involved in endoscopic diagnosis of some lesions, thereby enhancing diagnostic accuracy. This narrative review covers the current status of research concerning various applications of AI technology to gastroscopy, then discusses future research directions. By providing this review, we hope to promote the integration of gastroscopy and AI technology, with long-term clinical applications that can assist patients.

Advances on diagnosis of Helicobacter pylori infections

The association of Helicobacter pylori to several gastric diseases, such as chronic gastritis, peptic ulcer disease, and gastric cancer, and its high prevalence worldwide, raised the necessity to use methods for a proper and fast diagnosis and monitoring the pathogen eradication. Available diagnostic methods can be classified as invasive or non-invasive, and the selection of the best relies on the clinical condition of the patient, as well as on the sensitivity, specificity, and accessibility of the diagnostic test. This review summarises all diagnostic methods currently available, including the invasive methods: endoscopy, histology, culture, and molecular methods, and the rapid urease test (RUT), as well as the non-invasive methods urea breath test (UBT), serological assays, biosensors, and microfluidic devices and the stool antigen test (SAT). Moreover, it lists the diagnostic advantages and limitations, as well as the main advances for each methodology. In the end, research on the development of new diagnostic methods, such as bacteriophage-based H. pylori diagnostic tools, is also discussed.

Revolutionizing healthcare by use of artificial intelligence in esophageal carcinoma - a narrative review

Esophageal cancer is a major cause of cancer-related mortality worldwide, with significant regional disparities. Early detection of precursor lesions is essential to improve patient outcomes. Artificial intelligence (AI) techniques, including deep learning and machine learning, have proved to be of assistance to both gastroenterologists and pathologists in the diagnosis and characterization of upper gastrointestinal malignancies by correlating with the histopathology. The primary diagnostic method in gastroenterology is white light endoscopic evaluation, but conventional endoscopy is partially inefficient in detecting esophageal cancer. However, other endoscopic modalities, such as narrow-band imaging, endocytoscopy, and endomicroscopy, have shown improved visualization of mucosal structures and vasculature, which provides a set of baseline data to develop efficient AI-assisted predictive models for quick interpretation. The main challenges in managing esophageal cancer are identifying high-risk patients and the disease's poor prognosis. Thus, AI techniques can play a vital role in improving the early detection and diagnosis of precursor lesions, assisting gastroenterologists in performing targeted biopsies and real-time decisions of endoscopic mucosal resection or endoscopic submucosal dissection. Combining AI techniques and endoscopic modalities can enhance the diagnosis and management of esophageal cancer, improving patient outcomes and reducing cancer-related mortality rates. The aim of this review is to grasp a better understanding of the application of AI in the diagnosis, treatment, and prognosis of esophageal cancer and how computer-aided diagnosis and computer-aided detection can act as vital tools for clinicians in the long run.

Real-Time Evaluation of Helicobacter pylori Infection by Convolution Neural Network During White-Light Endoscopy: A Prospective, Multicenter Study (With Video)

INTRODUCTION

Convolutional neural network during endoscopy may facilitate evaluation of Helicobacter pylori infection without obtaining gastric biopsies. The aim of the study was to evaluate the diagnosis accuracy of a computer-aided decision support system for H. pylori infection (CADSS-HP) based on convolutional neural network under white-light endoscopy.

METHODS

Archived video recordings of upper endoscopy with white-light examinations performed at Sir Run Run Shaw Hospital (January 2019-September 2020) were used to develop CADSS-HP. Patients receiving endoscopy were prospectively enrolled (August 2021-August 2022) from 3 centers to calculate the diagnostic property. Accuracy of CADSS-HP for H. pylori infection was also compared with endoscopic impression, urea breath test (URT), and histopathology. H. pylori infection was defined by positive test on histopathology and/or URT.

RESULTS

Video recordings of 599 patients who received endoscopy were used to develop CADSS-HP. Subsequently, 456 patients participated in the prospective evaluation including 189 (41.4%) with H. pylori infection. With a threshold of 0.5, CADSS-HP achieved an area under the curve of 0.95 (95% confidence interval [CI], 0.93-0.97) with sensitivity and specificity of 91.5% (95% CI 86.4%-94.9%) and 88.8% (95% CI 84.2%-92.2%), respectively. CADSS-HP demonstrated higher sensitivity (91.5% vs 78.3%; mean difference = 13.2%, 95% CI 5.7%-20.7%) and accuracy (89.9% vs 83.8%, mean difference = 6.1%, 95% CI 1.6%-10.7%) compared with endoscopic diagnosis by endoscopists. Sensitivity of CADSS-HP in diagnosing H. pylori was comparable with URT (91.5% vs 95.2%; mean difference = 3.7%, 95% CI -1.8% to 9.4%), better than histopathology (91.5% vs 82.0%; mean difference = 9.5%, 95% CI 2.3%-16.8%).

DISCUSSION

CADSS-HP achieved high sensitivity in the diagnosis of H. pylori infection in the real-time test, outperforming endoscopic diagnosis by endoscopists and comparable with URT. Clinicaltrials.gov ; ChiCTR2000030724.

The Importance of Artificial Intelligence in Upper Gastrointestinal Endoscopy

Recently, there has been a growing interest in the application of artificial intelligence (AI) in medicine, especially in specialties where visualization methods are applied. AI is defined as a computer's ability to achieve human cognitive performance, which is accomplished through enabling computer "learning". This can be conducted in two ways, as machine learning and deep learning. Deep learning is a complex learning system involving the application of artificial neural networks, whose algorithms imitate the human form of learning. Upper gastrointestinal endoscopy allows examination of the esophagus, stomach and duodenum. In addition to the quality of endoscopic equipment and patient preparation, the performance of upper endoscopy depends on the experience and knowledge of the endoscopist. The application of artificial intelligence in endoscopy refers to computer-aided detection and the more complex computer-aided diagnosis. The application of AI in upper endoscopy is aimed at improving the detection of premalignant and malignant lesions, with special attention on the early detection of dysplasia in Barrett's esophagus, the early detection of esophageal and stomach cancer and the detection of H. pylori infection. Artificial intelligence reduces the workload of endoscopists, is not influenced by human factors and increases the diagnostic accuracy and quality of endoscopic methods.

Application of artificial intelligence in endoscopic image analysis for the diagnosis of a gastric cancer pathogen-Helicobacter pylori infection

Helicobacter pylori (H. pylori) infection is the principal cause of chronic gastritis, gastric ulcers, duodenal ulcers, and gastric cancer. In clinical practice, diagnosis of H. pylori infection by a gastroenterologists' impression of endoscopic images is inaccurate and cannot be used for the management of gastrointestinal diseases. The aim of this study was to develop an artificial intelligence classification system for the diagnosis of H. pylori infection by pre-processing endoscopic images and machine learning methods. Endoscopic images of the gastric body and antrum from 302 patients receiving endoscopy with confirmation of H. pylori status by a rapid urease test at An Nan Hospital were obtained for the derivation and validation of an artificial intelligence classification system. The H. pylori status was interpreted as positive or negative by Convolutional Neural Network (CNN) and Concurrent Spatial and Channel Squeeze and Excitation (scSE) network, combined with different classification models for deep learning of gastric images. The comprehensive assessment for H. pylori status by scSE-CatBoost classification models for both body and antrum images from same patients achieved an accuracy of 0.90, sensitivity of 1.00, specificity of 0.81, positive predictive value of 0.82, negative predicted value of 1.00, and area under the curve of 0.88. The data suggest that an artificial intelligence classification model using scSE-CatBoost deep learning for gastric endoscopic images can distinguish H. pylori status with good performance and is useful for the survey or diagnosis of H. pylori infection in clinical practice.

Artificial intelligence in theranostics of gastric cancer, a review

Gastric cancer (GC) is one of the commonest cancers with high morbidity and mortality in the world. How to realize precise diagnosis and therapy of GC owns great clinical requirement. In recent years, artificial intelligence (AI) has been actively explored to apply to early diagnosis and treatment and prognosis of gastric carcinoma. Herein, we review recent advance of AI in early screening, diagnosis, therapy and prognosis of stomach carcinoma. Especially AI combined with breath screening early GC system improved 97.4 % of early GC diagnosis ratio, AI model on stomach cancer diagnosis system of saliva biomarkers obtained an overall accuracy of 97.18 %, specificity of 97.44 %, and sensitivity of 96.88 %. We also discuss concept, issues, approaches and challenges of AI applied in stomach cancer. This review provides a comprehensive view and roadmap for readers working in this field, with the aim of pushing application of AI in theranostics of stomach cancer to increase the early discovery ratio and curative ratio of GC patients.

Artificial Intelligence in Pediatric Endoscopy: Current Status and Future Applications

The application of artificial intelligence (AI) has great promise for improving pediatric endoscopy. The majority of preclinical studies have been undertaken in adults, with the greatest progress being made in the context of colorectal cancer screening and surveillance. This development has only been possible with advances in deep learning, like the convolutional neural network model, which has enabled real-time detection of pathology. Comparatively, the majority of deep learning systems developed in inflammatory bowel disease have focused on predicting disease severity and were developed using still images rather than videos. The application of AI to pediatric endoscopy is in its infancy, thus providing an opportunity to develop clinically meaningful and fair systems that do not perpetuate societal biases. In this review, we provide an overview of AI, summarize the advances of AI in endoscopy, and describe its potential application to pediatric endoscopic practice and education.

Assessment of Helicobacter pylori infection by deep learning based on endoscopic videos in real time

BACKGROUND AND AIMS

Endoscopic assessment of Helicobacter pylori infection is a simple and effective method. Here, we aimed to develop a deep learning-based system named Intelligent Detection Endoscopic Assistant-Helicobacter pylori (IDEA-HP) to assess H. pylori infection by using endoscopic videos in real time.

METHODS

Endoscopic data were retrospectively obtained from Zhejiang Cancer Hospital (ZJCH) for the development, validation, and testing of the system. Stored videos from ZJCH were used for assessing and comparing the performance of IDEA-HP with that of endoscopists. Prospective consecutive patients undergoing esophagogastroduodenoscopy were enrolled to assess the applicability of clinical practice. The urea breath test was used as the gold standard for diagnosing H. pylori infection.

RESULTS

In 100 videos, IDEA-HP achieved a similar overall accuracy of assessing H. pylori infection to that of experts (84.0% vs. 83.6% [P = 0.729]). Nevertheless, the diagnostic accuracy (84.0% vs. 74.0% [P<0.001]) and sensitivity (82.0% vs. 67.2% [P<0.001]) of IDEA-HP were significantly higher than those of the beginners. In 191 prospective consecutive patients, IDEA-HP achieved accuracy, sensitivity, and specificity of 85.3% (95% CI: 79.0%-89.3%), 83.3% (95% CI: 72.8%-90.5%), and 85.8% (95% CI: 77.7%-91.4%), respectively.

CONCLUSIONS

Our results show that IDEA-HP has great potential for assisting endoscopists in assessing H. pylori infection status during actual clinical work.

H. pylori Related Atrophic Gastritis Detection Using Enhanced Convolution Neural Network (CNN) Learner

Atrophic gastritis (AG) is commonly caused by the infection of the Helicobacter pylori (H. pylori) bacteria. If untreated, AG may develop into a chronic condition leading to gastric cancer, which is deemed to be the third primary cause of cancer-related deaths worldwide. Precursory detection of AG is crucial to avoid such cases. This work focuses on H. pylori-associated infection located at the gastric antrum, where the classification is of binary classes of normal versus atrophic gastritis. Existing work developed the Deep Convolution Neural Network (DCNN) of GoogLeNet with 22 layers of the pre-trained model. Another study employed GoogLeNet based on the Inception Module, fast and robust fuzzy C-means (FRFCM), and simple linear iterative clustering (SLIC) superpixel algorithms to identify gastric disease. GoogLeNet with Caffe framework and ResNet-50 are machine learners that detect H. pylori infection. Nonetheless, the accuracy may become abundant as the network depth increases. An upgrade to the current standards method is highly anticipated to avoid untreated and inaccurate diagnoses that may lead to chronic AG. The proposed work incorporates improved techniques revolving within DCNN with pooling as pre-trained models and channel shuffle to assist streams of information across feature channels to ease the training of networks for deeper CNN. In addition, Canonical Correlation Analysis (CCA) feature fusion method and ReliefF feature selection approaches are intended to revamp the combined techniques. CCA models the relationship between the two data sets of significant features generated by pre-trained ShuffleNet. ReliefF reduces and selects essential features from CCA and is classified using the Generalized Additive Model (GAM). It is believed the extended work is justified with a 98.2% testing accuracy reading, thus providing an accurate diagnosis of normal versus atrophic gastritis.

An explainable artificial intelligence system for diagnosing Helicobacter Pylori infection under endoscopy: a case-control study

Background

Changes in gastric mucosa caused by Helicobacter pylori (H. pylori) infection affect the observation of early gastric cancer under endoscopy. Although previous researches reported that computer-aided diagnosis (CAD) systems have great potential in the diagnosis of H. pylori infection, their explainability remains a challenge.

Objective

We aim to develop an explainable artificial intelligence system for diagnosing H. pylori infection (EADHI) and giving diagnostic basis under endoscopy.

Design

A case-control study.

Methods

We retrospectively obtained 47,239 images from 1826 patients between 1 June 2020 and 31 July 2021 at Renmin Hospital of Wuhan University for the development of EADHI. EADHI was developed based on feature extraction combining ResNet-50 and long short-term memory networks. Nine endoscopic features were used for H. pylori infection. EADHI's performance was evaluated and compared to that of endoscopists. An external test was conducted in Wenzhou Central Hospital to evaluate its robustness. A gradient-boosting decision tree model was used to examine the contributions of different mucosal features for diagnosing H. pylori infection.

Results

The system extracted mucosal features for diagnosing H. pylori infection with an overall accuracy of 78.3% [95% confidence interval (CI): 76.2-80.3]. The accuracy of EADHI for diagnosing H. pylori infection (91.1%, 95% CI: 85.7-94.6) was significantly higher than that of endoscopists (by 15.5%, 95% CI: 9.7-21.3) in internal test. And it showed a good accuracy of 91.9% (95% CI: 85.6-95.7) in external test. Mucosal edema was the most important diagnostic feature for H. pylori positive, while regular arrangement of collecting venules was the most important H. pylori negative feature.

Conclusion

The EADHI discerns H. pylori gastritis with high accuracy and good explainability, which may improve the trust and acceptability of endoscopists on CADs.

Plain language summary

An explainable AI system for Helicobacter pylori with good diagnostic performance Helicobacter pylori (H. pylori) is the main risk factor for gastric cancer (GC), and changes in gastric mucosa caused by H. pylori infection affect the observation of early GC under endoscopy. Therefore, it is necessary to identify H. pylori infection under endoscopy. Although previous research showed that computer-aided diagnosis (CAD) systems have great potential in H. pylori infection diagnosis, their generalization and explainability are still a challenge. Herein, we constructed an explainable artificial intelligence system for diagnosing H. pylori infection (EADHI) using images by case. In this study, we integrated ResNet-50 and long short-term memory (LSTM) networks into the system. Among them, ResNet50 is used for feature extraction, LSTM is used to classify H. pylori infection status based on these features. Furthermore, we added the information of mucosal features in each case when training the system so that EADHI could identify and output which mucosal features are contained in a case. In our study, EADHI achieved good diagnostic performance with an accuracy of 91.1% [95% confidence interval (CI): 85.7-94.6], which was significantly higher than that of endoscopists (by 15.5%, 95% CI: 9.7-21.3%) in internal test. In addition, it showed a good diagnostic accuracy of 91.9% (95% CI: 85.6-95.7) in external tests. The EADHI discerns H. pylori gastritis with high accuracy and good explainability, which may improve the trust and acceptability of endoscopists on CADs. However, we only used data from a single center to develop EADHI, and it was not effective in identifying past H. pylori infection. Future, multicenter, prospective studies are needed to demonstrate the clinical applicability of CADs.

Artificial intelligence in gastroenterology: A narrative review

Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.

Current Status of Artificial Intelligence-Based Computer-Assisted Diagnosis Systems for Gastric Cancer in Endoscopy

Artificial intelligence (AI) is gradually being utilized in various fields as its performance has been improving with the development of deep learning methods, availability of big data, and the progression of computer processing units. In the field of medicine, AI is mainly implemented in image recognition, such as in radiographic and pathologic diagnoses. In the realm of gastrointestinal endoscopy, although AI-based computer-assisted detection/diagnosis (CAD) systems have been applied in some areas, such as colorectal polyp detection and diagnosis, so far, their implementation in real-world clinical settings is limited. The accurate detection or diagnosis of gastric cancer (GC) is one of the challenges in which performance varies greatly depending on the endoscopist's skill. The diagnosis of early GC is especially challenging, partly because early GC mimics atrophic gastritis in the background mucosa. Therefore, several CAD systems for GC are being actively developed. The development of a CAD system for GC is considered challenging because it requires a large number of GC images. In particular, early stage GC images are rarely available, partly because it is difficult to diagnose gastric cancer during the early stages. Additionally, the training image data should be of a sufficiently high quality to conduct proper CAD training. Recently, several AI systems for GC that exhibit a robust performance, owing to being trained on a large number of high-quality images, have been reported. This review outlines the current status and prospects of AI use in esophagogastroduodenoscopy (EGDS), focusing on the diagnosis of GC.

Application of artificial intelligence in the endoscopic diagnosis of early gastric cancer, atrophic gastritis, and Helicobacter pylori infection

Gastric cancer (GC) is one of the most serious health problems worldwide. Chronic atrophic gastritis (CAG) is most commonly caused by Helicobacter pylori (H. pylori) infection. Currently, endoscopic detection of early gastric cancer (EGC) and CAG remains challenging for endoscopists, and the diagnostic accuracy of H. pylori infection by endoscopy is approximately 70%. Artificial intelligence (AI) can assist endoscopic diagnosis including detection, prediction of depth of invasion, boundary delineation, and anatomical location of EGC, and has achievable diagnostic ability even comparable to experienced endoscopists. In this review we summarized various AI-assisted systems in the diagnosis of EGC, CAG, and H. pylori infection.

Systematic review and meta-analysis: Artificial intelligence for the diagnosis of gastric precancerous lesions and Helicobacter pylori infection

BACKGROUND

The endoscopic diagnosis of Helicobacter-pylori(H.pylori) infection and gastric precancerous lesions(GPL), namely atrophic-gastritis and intestinal-metaplasia, still remains challenging. Artificial intelligence(AI) may represent a powerful resource for the endoscopic recognition of these conditions.

AIMS

To explore the diagnostic performance(DP) of AI in the diagnosis of GPL and H.pylori infection.

METHODS

A systematic-review was performed by two independent authors up to September 2021. Inclusion criteria were studies focusing on the DP of AI-system in the diagnosis of GPL and H.pylori infection. The pooled accuracy of studies included was reported.

RESULTS

Overall, 128 studies were found (PubMed-Embase-Cochrane Library) and four and nine studies were finally included regarding GPL and H.pylori infection, respectively. The pooled-accuracy(random effects model) was 90.3%(95%CI 84.3-94.9) and 79.6%(95%CI 66.7-90.0) with a significant heterogeneity[I²=90.4%(95%CI 78.5-95.7);I²=97.9%(97.2-98.6)] for GPL and H.pylori infection, respectively. The Begg's-test showed a significant publication-bias(p = 0.0371) only among studies regarding H.pylori infection. The pooled-accuracy(random-effects-model) was similar considering only studies using CNN-model for the diagnosis of H.pylori infection: 74.1%[(95%CI 51.6-91.3);I²=98.9%(95%CI 98.5-99.3)], Begg's-test(p = 0.1416) did not show publication-bias.

CONCLUSION

AI-system seems to be a good resource for an easier diagnosis of GPL and H.pylori infection, showing a pooled-diagnostic-accuracy of 90% and 80%, respectively. However, considering the high heterogeneity, these promising data need an external validation by randomized control trials and prospective real-time studies.

DeepHP: A New Gastric Mucosa Histopathology Dataset for Helicobacter pylori Infection Diagnosis

Emerging deep learning-based applications in precision medicine include computational histopathological analysis. However, there is a lack of the required training image datasets to generate classification and detection models. This phenomenon occurs mainly due to human factors that make it difficult to obtain well-annotated data. The present study provides a curated public collection of histopathological images (DeepHP) and a convolutional neural network model for diagnosing gastritis. Images from gastric biopsy histopathological exams were used to investigate the performance of the proposed model in detecting gastric mucosa with Helicobacter pylori infection. The DeepHP database comprises 394,926 histopathological images, of which 111 K were labeled as Helicobacter pylori positive and 283 K were Helicobacter pylori negative. We investigated the classification performance of three Convolutional Neural Network architectures. The models were tested and validated with two distinct image sets of 15% (59K patches) chosen randomly. The VGG16 architecture showed the best results with an Area Under the Curve of 0.998%. The results showed that CNN could be used to classify histopathological images from gastric mucosa with marked precision. Our model evidenced high potential and application in the computational pathology field.

Diagnostic accuracy of artificial intelligence for detecting gastrointestinal luminal pathologies: A systematic review and meta-analysis

Background

Artificial Intelligence (AI) holds considerable promise for diagnostics in the field of gastroenterology. This systematic review and meta-analysis aims to assess the diagnostic accuracy of AI models compared with the gold standard of experts and histopathology for the diagnosis of various gastrointestinal (GI) luminal pathologies including polyps, neoplasms, and inflammatory bowel disease.

Methods

We searched PubMed, CINAHL, Wiley Cochrane Library, and Web of Science electronic databases to identify studies assessing the diagnostic performance of AI models for GI luminal pathologies. We extracted binary diagnostic accuracy data and constructed contingency tables to derive the outcomes of interest: sensitivity and specificity. We performed a meta-analysis and hierarchical summary receiver operating characteristic curves (HSROC). The risk of bias was assessed using Quality Assessment for Diagnostic Accuracy Studies-2 (QUADAS-2) tool. Subgroup analyses were conducted based on the type of GI luminal disease, AI model, reference standard, and type of data used for analysis. This study is registered with PROSPERO (CRD42021288360).

Findings

We included 73 studies, of which 31 were externally validated and provided sufficient information for inclusion in the meta-analysis. The overall sensitivity of AI for detecting GI luminal pathologies was 91.9% (95% CI: 89.0–94.1) and specificity was 91.7% (95% CI: 87.4–94.7). Deep learning models (sensitivity: 89.8%, specificity: 91.9%) and ensemble methods (sensitivity: 95.4%, specificity: 90.9%) were the most commonly used models in the included studies. Majority of studies (n = 56, 76.7%) had a high risk of selection bias while 74% (n = 54) studies were low risk on reference standard and 67% (n = 49) were low risk for flow and timing bias.

Interpretation

The review suggests high sensitivity and specificity of AI models for the detection of GI luminal pathologies. There is a need for large, multi-center trials in both high income countries and low- and middle- income countries to assess the performance of these AI models in real clinical settings and its impact on diagnosis and prognosis.

Systematic review registration

[https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=288360], identifier [CRD42021288360].

Identification of upper GI diseases during screening gastroscopy using a deep convolutional neural network algorithm

BACKGROUND AND AIMS

The clinical application of GI endoscopy for the diagnosis of multiple diseases using artificial intelligence (AI) has been limited by its high false-positive rates. There is an unmet need to develop a GI endoscopy AI-assisted diagnosis system (GEADS) to improve diagnostic accuracy and clinical utility.

METHODS

In this retrospective, multicenter study, a convolutional neural network was trained to assess upper GI diseases based on 26,228 endoscopic images from Dazhou Central Hospital that were randomly assigned (3:1:1) to a training dataset, validation dataset, and test dataset, respectively. To validate the model, 6 external independent datasets comprising 51,372 images of upper GI diseases were collected. In addition, 1 prospective dataset comprising 27,975 images was collected. The performance of GEADS was compared with endoscopists with 2 professional degrees of expertise: expert and novice. Eight endoscopists were in the expert group with >5 years of experience, whereas 3 endoscopists were in the novice group with 1 to 5 years of experience.

RESULTS

The GEADS model achieved an accuracy of .918 (95% confidence interval [CI], .914-.922), with an F1 score of .884 (95% CI, .879-.889), recall of .873 (95% CI, .868-.878), and precision of .890 (95% CI, .885-.895) in the internal validation dataset. In the external validation datasets and 1 prospective validation dataset, the diagnostic accuracy of the GEADS ranged from .841 (95% CI, .834-.848) to .949 (95% CI, .935-.963). With the help of the GEADS, the diagnosing accuracies of novice and expert endoscopists were significantly improved (P < .001).

CONCLUSIONS

The AI system can assist endoscopists in improving the accuracy of diagnosing upper GI diseases.

Artificial intelligence in gastrointestinal endoscopy - Evolution to a new era

Artificial intelligence (AI) systems based on machine learning have evolved in the last few years with an increasing applicability in gastrointestinal endoscopy. Thanks to AI, an image (input) can be transformed into a clinical decision (output). Although AI systems have been initially studied to improve detection (CADe) and characterization of colorectal lesions (CADx), other indications are being currently investigated as detection of blind spots, scope guidance, or delineation/measurement of lesions. The objective of these review is to summarize the current evidence on applicability of AI systems in gastrointestinal endoscopy, highlight strengths and limitations of the technology and review regulatory and ethical aspects for its general implementation in gastrointestinal endoscopy.

Traditional and Modern Diagnostic Approaches in Diagnosing Pediatric Helicobacter pylori Infection

Helicobacter pylori (H. pylori) is the most common bacterial infection worldwide, is usually acquired during childhood and is related to gastric carcinogenesis during adulthood. Therefore, its early proper diagnosis and subsequent successful eradication represent the cornerstones of gastric cancer prevention. The aim of this narrative review was to assess traditional and modern diagnostic methods in terms of H. pylori diagnosis. Several invasive and non-invasive methods were described, each with its pros and cons. The invasive diagnostic methods comprise endoscopy with biopsy, rapid urease tests, histopathological exams, cultures and biopsy-based molecular tests. Among these, probably the most available, accurate and cost-effective test remains histology, albeit molecular tests definitely remain the most accurate despite their high costs. The non-invasive tests consist of urea breath tests, serology, stool antigens and non-invasive molecular tests. Urea breath tests and stool antigens are the most useful in clinical practice both for the diagnosis of H. pylori infection and for monitoring the eradication of this infection after therapy. The challenges related to accurate diagnosis lead to a choice that must be based on H. pylori virulence, environmental factors and host peculiarities.

Artificial Intelligence in Endoscopy

Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.

Multi-label recognition of cancer-related lesions with clinical priors on white-light endoscopy

Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can "break" the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Implementation of artificial intelligence in upper gastrointestinal endoscopy

The application of artificial intelligence (AI) using deep learning has significantly expanded in the field of esophagogastric endoscopy. Recent studies have shown promising results in detecting and differentiating early gastric cancer using AI tools built using white light, magnified, or image-enhanced endoscopic images. Some studies have reported the use of AI tools to predict the depth of early gastric cancer based on endoscopic images. Similarly, studies based on using AI for detecting early esophageal cancer have also been reported, with an accuracy comparable to that of endoscopy specialists. Moreover, an AI system, developed to diagnose pharyngeal cancer, has shown promising performance with high sensitivity. These reports suggest that, if introduced for regular use in clinical settings, AI systems can significantly reduce the burden on physicians. This review summarizes the current status of AI applications in the upper gastrointestinal tract and presents directions for clinical practice implementation and future research.

Real-Time Multi-Label Upper Gastrointestinal Anatomy Recognition from Gastroscope Videos

Esophagogastroduodenoscopy (EGD) is a critical step in the diagnosis of upper gastrointestinal disorders. However, due to inexperience or high workload, there is a wide variation in EGD performance by endoscopists. Variations in performance may result in exams that do not completely cover all anatomical locations of the stomach, leading to a potential risk of missed diagnosis of gastric diseases. Numerous guidelines or expert consensus have been proposed to assess and optimize the quality of endoscopy. However, there is a lack of mature and robust methods to accurately apply to real clinical real-time video environments. In this paper, we innovatively define the problem of recognizing anatomical locations in videos as a multi-label recognition task. This can be more consistent with the model learning of image-to-label mapping relationships. We propose a combined structure of a deep learning model (GL-Net) that combines a graph convolutional network (GCN) with long short-term memory (LSTM) networks to both extract label features and correlate temporal dependencies for accurate real-time anatomical locations identification in gastroscopy videos. Our methodological evaluation dataset is based on complete videos of real clinical examinations. A total of 29,269 images from 49 videos were collected as a dataset for model training and validation. Another 1736 clinical videos were retrospectively analyzed and evaluated for the application of the proposed model. Our method achieves 97.1% mean accuracy (mAP), 95.5% mean per-class accuracy and 93.7% average overall accuracy in a multi-label classification task, and is able to process these videos in real-time at 29.9 FPS. In addition, based on our approach, we designed a system to monitor routine EGD videos in detail and perform statistical analysis of the operating habits of endoscopists, which can be a useful tool to improve the quality of clinical endoscopy.

Deep learning for gastroscopic images: computer-aided techniques for clinicians

Gastric disease is a major health problem worldwide. Gastroscopy is the main method and the gold standard used to screen and diagnose many gastric diseases. However, several factors, such as the experience and fatigue of endoscopists, limit its performance. With recent advancements in deep learning, an increasing number of studies have used this technology to provide on-site assistance during real-time gastroscopy. This review summarizes the latest publications on deep learning applications in overcoming disease-related and nondisease-related gastroscopy challenges. The former aims to help endoscopists find lesions and characterize them when they appear in the view shed of the gastroscope. The purpose of the latter is to avoid missing lesions due to poor-quality frames, incomplete inspection coverage of gastroscopy, etc., thus improving the quality of gastroscopy. This study aims to provide technical guidance and a comprehensive perspective for physicians to understand deep learning technology in gastroscopy. Some key issues to be handled before the clinical application of deep learning technology and the future direction of disease-related and nondisease-related applications of deep learning to gastroscopy are discussed herein.

Application Status and Prospects of Artificial Intelligence in Peptic Ulcers

Peptic ulcer (PU) is a common and frequently occurring disease. Although PU seriously threatens the lives and health of global residents, the applications of artificial intelligence (AI) have strongly promoted diversification and modernization in the diagnosis and treatment of PU. This minireview elaborates on the research progress of AI in the field of PU, from PU's pathogenic factor Helicobacter pylori (Hp) infection, diagnosis and differential diagnosis, to its management and complications (bleeding, obstruction, perforation and canceration). Finally, the challenges and prospects of AI application in PU are prospected and expounded. With the in-depth understanding of modern medical technology, AI remains a promising option in the management of PU patients and plays a more indispensable role. How to realize the robustness, versatility and diversity of multifunctional AI systems in PU and conduct multicenter prospective clinical research as soon as possible are the top priorities in the future.

Artificial Intelligence in the Diagnosis of Upper Gastrointestinal Diseases

Artificial intelligence (AI) has enormous potential to support clinical routine workflows and therefore is gaining increasing popularity among medical professionals. In the field of gastroenterology, investigations on AI and computer-aided diagnosis (CAD) systems have mainly focused on the lower gastrointestinal (GI) tract. However, numerous CAD tools have been tested also in upper GI disorders showing encouraging results. The main application of AI in the upper GI tract is endoscopy; however, the need to analyze increasing loads of numerical and categorical data in short times has pushed researchers to investigate applications of AI systems in other upper GI settings, including gastroesophageal reflux disease, eosinophilic esophagitis, and motility disorders. AI and CAD systems will be increasingly incorporated into daily clinical practice in the coming years, thus at least basic notions will be soon required among physicians. For noninsiders, the working principles and potential of AI may be as fascinating as obscure. Accordingly, we reviewed systematic reviews, meta-analyses, randomized controlled trials, and original research articles regarding the performance of AI in the diagnosis of both malignant and benign esophageal and gastric diseases, also discussing essential characteristics of AI.

Identification of Barrett's esophagus in endoscopic images using deep learning

BACKGROUND

Development of a deep learning method to identify Barrett's esophagus (BE) scopes in endoscopic images.

METHODS

443 endoscopic images from 187 patients of BE were included in this study. The gastroesophageal junction (GEJ) and squamous-columnar junction (SCJ) of BE were manually annotated in endoscopic images by experts. Fully convolutional neural networks (FCN) were developed to automatically identify the BE scopes in endoscopic images. The networks were trained and evaluated in two separate image sets. The performance of segmentation was evaluated by intersection over union (IOU).

RESULTS

The deep learning method was proved to be satisfying in the automated identification of BE in endoscopic images. The values of the IOU were 0.56 (GEJ) and 0.82 (SCJ), respectively.

CONCLUSIONS

Deep learning algorithm is promising with accuracies of concordance with manual human assessment in segmentation of the BE scope in endoscopic images. This automated recognition method helps clinicians to locate and recognize the scopes of BE in endoscopic examinations.

Artificial Intelligence in the Analysis of Upper Gastrointestinal Disorders

In the past, conventional machine learning was applied to analyze tabulated medical data while deep learning was applied to study afflictions such as gastrointestinal disorders. Neural networks were used to detect, classify, and delineate various images of lesions because the local feature selection and optimization of the deep learning model enabled accurate image analysis. With the accumulation of medical records, the evolution of computational power and graphics processing units, and the widespread use of open-source libraries in large-scale machine learning processes, medical artificial intelligence (AI) is overcoming its limitations. While early studies prioritized the automatic diagnosis of cancer or pre-cancerous lesions, the current expanded scope of AI includes benign lesions, quality control, and machine learning analysis of big data. However, the limited commercialization of medical AI and the need to justify its application in each field of research are restricting factors. Modeling assumes that observations follow certain statistical rules, and external validation checks whether assumption is correct or generalizable. Therefore, unused data are essential in the training or internal testing process to validate the performance of the established AI models. This article summarizes the studies on the application of AI models in upper gastrointestinal disorders. The current limitations and the perspectives on future development have also been discussed.

Single Shot Multibox Detector Automatic Polyp Detection Network Based on Gastrointestinal Endoscopic Images

Purpose

In order to resolve the situation of high missed diagnosis rate and high misdiagnosis rate of the pathological analysis of the gastrointestinal endoscopic images by experts, we propose an automatic polyp detection algorithm based on Single Shot Multibox Detector (SSD).

Method

In the paper, SSD is based on VGG-16, the fully connected layer is changed to a convolutional layer, and four convolutional layers with successively decreasing scales are added as a new network structure. In order to verify the practicability, it is not only compared with manual polyp detection but also with Mask R-CNN.

Results

Multiple experimental results show that the mean Average Precision (mAP) of the SSD network is 95.74%, which is 12.4% higher than the manual detection and 5.7% higher than the Mask R-CNN. When detecting a single frame of image, the detection speed of SSD is 8.41 times that of manual detection.

Conclusion

Based on the traditional pattern recognition algorithm and the target detection algorithm using deep learning, we select a variety of algorithms to identify and classify polyps to achieve efficient detection results. Our research demonstrates that deep learning has a lot of room for development in the field of gastrointestinal image recognition.

Scope of Artificial Intelligence in Gastrointestinal Oncology

Gastrointestinal cancers are among the leading causes of death worldwide, with over 2.8 million deaths annually. Over the last few decades, advancements in artificial intelligence technologies have led to their application in medicine. The use of artificial intelligence in endoscopic procedures is a significant breakthrough in modern medicine. Currently, the diagnosis of various gastrointestinal cancer relies on the manual interpretation of radiographic images by radiologists and various endoscopic images by endoscopists. This can lead to diagnostic variabilities as it requires concentration and clinical experience in the field. Artificial intelligence using machine or deep learning algorithms can provide automatic and accurate image analysis and thus assist in diagnosis. In the field of gastroenterology, the application of artificial intelligence can be vast from diagnosis, predicting tumor histology, polyp characterization, metastatic potential, prognosis, and treatment response. It can also provide accurate prediction models to determine the need for intervention with computer-aided diagnosis. The number of research studies on artificial intelligence in gastrointestinal cancer has been increasing rapidly over the last decade due to immense interest in the field. This review aims to review the impact, limitations, and future potentials of artificial intelligence in screening, diagnosis, tumor staging, treatment modalities, and prediction models for the prognosis of various gastrointestinal cancers.

Artificial intelligence in gastroenterology: A state-of-the-art review

The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.

Challenges and opportunities in the application of artificial intelligence in gastroenterology and hepatology

Artificial intelligence (AI) is an umbrella term used to describe a cluster of interrelated fields. Machine learning (ML) refers to a model that learns from past data to predict future data. Medicine and particularly gastroenterology and hepatology, are data-rich fields with extensive data repositories, and therefore fruitful ground for AI/ML-based software applications. In this study, we comprehensively review the current applications of AI/ML-based models in these fields and the opportunities that arise from their application. Specifically, we refer to the applications of AI/ML-based models in prevention, diagnosis, management, and prognosis of gastrointestinal bleeding, inflammatory bowel diseases, gastrointestinal premalignant and malignant lesions, other nonmalignant gastrointestinal lesions and diseases, hepatitis B and C infection, chronic liver diseases, hepatocellular carcinoma, cholangiocarcinoma, and primary sclerosing cholangitis. At the same time, we identify the major challenges that restrain the widespread use of these models in healthcare in an effort to explore ways to overcome them. Notably, we elaborate on the concerns regarding intrinsic biases, data protection, cybersecurity, intellectual property, liability, ethical challenges, and transparency. Even at a slower pace than anticipated, AI is infiltrating the healthcare industry. AI in healthcare will become a reality, and every physician will have to engage with it by necessity.

Applications of Artificial Intelligence for the Diagnosis of Gastrointestinal Diseases

The development of convolutional neural networks has achieved impressive advances of machine learning in recent years, leading to an increasing use of artificial intelligence (AI) in the field of gastrointestinal (GI) diseases. AI networks have been trained to differentiate benign from malignant lesions, analyze endoscopic and radiological GI images, and assess histological diagnoses, obtaining excellent results and high overall diagnostic accuracy. Nevertheless, there data are lacking on side effects of AI in the gastroenterology field, and high-quality studies comparing the performance of AI networks to health care professionals are still limited. Thus, large, controlled trials in real-time clinical settings are warranted to assess the role of AI in daily clinical practice. This narrative review gives an overview of some of the most relevant potential applications of AI for gastrointestinal diseases, highlighting advantages and main limitations and providing considerations for future development.

Early gastrointestinal cancer: The application of artificial intelligence

Early gastrointestinal (GI) cancer has been the core of clinical endoscopic work. Its early detection and treatment are tightly associated with patients’ prognoses. As a novel technology, artificial intelligence has been improved and applied in the field of endoscopy. Studies on detection, diagnosis, risk, and prognosis evaluation of diseases in the GI tract have been in development, including precancerous lesions, adenoma, early GI cancers, and advanced GI cancers. In this review, research on esophagus, stomach, and colon was concluded, and associated with the process from precancerous lesions to early GI cancer, such as from Barrett’s esophagus to early esophageal cancer, from dysplasia to early gastric cancer, and from adenoma to early colonic cancer. A status quo of research on early GI cancers and artificial intelligence was provided.

Application of artificial intelligence in gastrointestinal disease: a narrative review

Objective

We collected evidence on the application of artificial intelligence (AI) in gastroenterology field. The review was carried out from two aspects of endoscopic types and gastrointestinal diseases, and briefly summarized the challenges and future directions in this field.

Background

Due to the advancement of computational power and a surge of available data, a solid foundation has been laid for the growth of AI. Specifically, varied machine learning (ML) techniques have been emerging in endoscopic image analysis. To improve the accuracy and efficiency of clinicians, AI has been widely applied to gastrointestinal endoscopy.

Methods

PubMed electronic database was searched using the keywords containing “AI”, “ML”, “deep learning (DL)”, “convolution neural network”, “endoscopy (such as white light endoscopy (WLE), narrow band imaging (NBI) endoscopy, magnifying endoscopy with narrow band imaging (ME-NBI), chromoendoscopy, endocytoscopy (EC), and capsule endoscopy (CE))”. Search results were assessed for relevance and then used for detailed discussion.

Conclusions

This review described the basic knowledge of AI, ML, and DL, and summarizes the application of AI in various endoscopes and gastrointestinal diseases. Finally, the challenges and directions of AI in clinical application were discussed. At present, the application of AI has solved some clinical problems, but more still needs to be done.

Artificial Intelligence in Upper Gastrointestinal Endoscopy

BACKGROUND

Over the past decade, several artificial intelligence (AI) systems are developed to assist in endoscopic assessment of (pre-)cancerous lesions of the gastrointestinal (GI) tract. In this review, we aimed to provide an overview of the possible indications of AI technology in upper GI endoscopy and hypothesize about potential challenges for its use in clinical practice.

SUMMARY

Application of AI in upper GI endoscopy has been investigated for several indications: (1) detection, characterization, and delineation of esophageal and gastric cancer (GC) and their premalignant conditions; (2) prediction of tumor invasion; and (3) detection of Helicobacter pylori. AI systems show promising results with an accuracy of up to 99% for the detection of superficial and advanced upper GI cancers. AI outperformed trainee and experienced endoscopists for the detection of esophageal lesions and atrophic gastritis. For GC, AI outperformed mid-level and trainee endoscopists but not expert endoscopists.

KEY MESSAGES

Application of artificial intelligence (AI) in upper gastrointestinal endoscopy may improve early diagnosis of esophageal and gastric cancer and may enable endoscopists to better identify patients eligible for endoscopic resection. The benefit of AI on the quality of upper endoscopy still needs to be demonstrated, while prospective trials are needed to confirm accuracy and feasibility during real-time daily endoscopy.

Diagnosis of Helicobacter pylori Infection and Recent Advances

BACKGROUND

Helicobacter pylori (H. pylori) infects approximately 50% of the world population. Its infection is associated with gastropathies, extra-gastric digestive diseases, and diseases of other systems. There is a canonical process from acute-on-chronic inflammation, chronic atrophic gastritis (CAG), intestinal metaplasia (IM), dysplasia, and intraepithelial neoplasia, eventually to gastric cancer (GC). H. pylori eradication abolishes the inflammatory response and early treatment prevents the progression to preneoplastic lesions.

METHODS

the test-and-treat strategy, endoscopy-based strategy, and screen-and-treat strategy are recommended to prevent GC based on risk stratification, prevalence, and patients' clinical manifestations and conditions. Challenges contain false-negative results, increasing antibiotic resistance, decreasing eradication rate, and poor retesting rate. Present diagnosis methods are mainly based on invasive endoscopy and noninvasive laboratory testing.

RESULTS

to improve the accuracy and effectiveness and reduce the missed diagnosis, some advances were achieved including newer imaging techniques (such as image-enhanced endoscopy (IEE), artificial intelligence (AI) technology, and quantitative real-time polymerase chain reaction (qPCR) and digital PCR (dPCR).

CONCLUSION

in the article, we summarized the diagnosis methods of H. pylori infection and recent advances, further finding out the opportunities in challenges.

Use of artificial intelligence in endoscopic ultrasound evaluation of pancreatic pathologies

The application of artificial intelligence (AI) using deep learning and machine learning approaches in modern medicine is rapidly expanding. Within the field of Gastroenterology, AI is being evaluated across a breadth of clinical and diagnostic applications including identification of pathology, differentiation of disease processes, and even automated procedure report generation. Many pancreatic pathologies can have overlapping features creating a diagnostic dilemma that provides a window for AI-assisted improvement in current evaluation and diagnosis, particularly using endoscopic ultrasound. This topic highlight will review the basics of AI, history of AI in gastrointestinal endoscopy, and prospects for AI in the evaluation of autoimmune pancreatitis, pancreatic ductal adenocarcinoma, chronic pancreatitis and intraductal papillary mucinous neoplasm.

Current situation and prospect of artificial intelligence application in endoscopic diagnosis of Helicobacter pylori infection

With the appearance and prevalence of deep learning, artificial intelligence (AI) has been broadly studied and made great progress in various fields of medicine, including gastroenterology. Helicobacter pylori (H. pylori), closely associated with various digestive and extradigestive diseases, has a high infection rate worldwide. Endoscopic surveillance can evaluate H. pylori infection situations and predict the risk of gastric cancer, but there is no objective diagnostic criteria to eliminate the differences between operators. The computer-aided diagnosis system based on AI technology has demonstrated excellent performance for the diagnosis of H. pylori infection, which is superior to novice endoscopists and similar to skilled. Compared with the visual diagnosis of H. pylori infection by endoscopists, AI possesses voluminous advantages: High accuracy, high efficiency, high quality control, high objectivity, and high-effect teaching. This review summarizes the previous and recent studies on AI-assisted diagnosis of H. pylori infection, points out the limitations, and puts forward prospect for future research.

Application of artificial intelligence-driven endoscopic screening and diagnosis of gastric cancer

The landscape of gastrointestinal endoscopy continues to evolve as new technologies and techniques become available. The advent of image-enhanced and magnifying endoscopies has highlighted the step toward perfecting endoscopic screening and diagnosis of gastric lesions. Simultaneously, with the development of convolutional neural network, artificial intelligence (AI) has made unprecedented breakthroughs in medical imaging, including the ongoing trials of computer-aided detection of colorectal polyps and gastrointestinal bleeding. In the past demi-decade, applications of AI systems in gastric cancer have also emerged. With AI’s efficient computational power and learning capacities, endoscopists can improve their diagnostic accuracies and avoid the missing or mischaracterization of gastric neoplastic changes. So far, several AI systems that incorporated both traditional and novel endoscopy technologies have been developed for various purposes, with most systems achieving an accuracy of more than 80%. However, their feasibility, effectiveness, and safety in clinical practice remain to be seen as there have been no clinical trials yet. Nonetheless, AI-assisted endoscopies shed light on more accurate and sensitive ways for early detection, treatment guidance and prognosis prediction of gastric lesions. This review summarizes the current status of various AI applications in gastric cancer and pinpoints directions for future research and clinical practice implementation from a clinical perspective.