Endoscopic three-categorical diagnosis of Helicobacter pylori infection using linked color imaging and deep learning: a single-center prospective study (with video)

Advancing precise diagnosis of nasopharyngeal carcinoma through endoscopy-based radiomics analysis

Nasopharyngeal carcinoma (NPC) has high metastatic potential and is hard to detect early. This study aims to develop a deep learning model for NPC diagnosis using optical imagery. From April 2008 to May 2021, we analyzed 12,087 nasopharyngeal endoscopic images and 309 videos from 1,108 patients. The pretrained model was fine-tuned with stochastic gradient descent on the final layers. Data augmentation was applied during training. Videos were converted to images for malignancy scoring. Performance metrics like AUC, accuracy, and sensitivity were calculated based on the malignancy score. The deep learning model demonstrated high performance in identifying NPC, with AUC values of 0.981 (95% confidence of interval [CI] 0.965-0.996) for the Fujian Cancer Hospital dataset and 0.937 (0.905-0.970) for the Jiangxi Cancer Hospital dataset. The proposed model effectively diagnoses NPC with high accuracy, sensitivity, and specificity across multiple datasets. It shows promise for early NPC detection, especially in identifying latent lesions.

Endoscopic appearances of gastric mucosa in different endoscopic models according to H. pylori infection status

Background

H. pylori infection has been recognized as a type 1 carcinogen of the gastric malignancy; therefore, early diagnosis and treatment are the corner stone of eradication. Recent findings have also shown that atrophy and intestinal metaplasia remain after successful eradication, which moderately increases the risk of gastric cancer compared with those who have never infected, so the evaluation of gastric mucosa during gastroscopy is important.

Aims

We aimed to describe and summarize the reliable literature and proposed features of H. pylori infection status and gastritis in research on newly developed endoscopic models that influence clinical practice. In the result, conventional white light endoscopic, image-enhanced endoscopic models, and studies related to the Kyoto classification of gastritis were searched and reviewed.

Results

Kyoto classification of gastritis and modified Kyoto classification scoring model for gastritis using conventional white light image (CWLI) endoscopy is an effective tool for evaluating current H. pylori infection status, past infections, eradications, noninfections, and pre-cancerous conditions. This model is widely used, low cost, and time-efficient, and is supported by recent findings. Advanced image-enhanced endoscopic models combined with magnifying endoscopy provide more clear endoscopic features for H. pylori infection status and early gastric cancer.

Conclusion

According to H pylori infection status, endoscopic prediction of gastric mucosal surface architecture analysis is possible, which influences clinical management. Endoscopic models might lead us to accurate and early diagnose of H. pylori infection status and may not be effective only for the eradication of H. pylori infection but also in the detection of early gastric cancer status.

Novel endoscopic techniques for the diagnosis of gastric Helicobacter pylori infection: a systematic review and network meta-analysis

Objective

This study aimed to conduct a network meta-analysis to compare the diagnostic efficacy of diverse novel endoscopic techniques for detecting gastric Helicobacter pylori infection.

Methods

From inception to August 2023, literature was systematically searched across Pubmed, Embase, and Web of Science databases. Cochrane's risk of bias tool assessed the methodological quality of the included studies. Data analysis was conducted using the R software, employing a ranking chart to determine the most effective diagnostic method comprehensively. Convergence analysis was performed to assess the stability of the results.

Results

The study encompassed 36 articles comprising 54 observational studies, investigating 14 novel endoscopic techniques and involving 7,230 patients diagnosed with gastric H. pylori infection. Compared with the gold standard, the comprehensive network meta-analysis revealed the superior diagnostic performance of two new endoscopic techniques, Magnifying blue laser imaging endoscopy (M-BLI) and high-definition magnifying endoscopy with i-scan (M-I-SCAN). Specifically, M-BLI demonstrated the highest ranking in both sensitivity (SE) and positive predictive value (PPV), ranking second in negative predictive value (NPV) and fourth in specificity (SP). M-I-SCAN secured the top position in NPV, third in SE and SP, and fifth in PPV.

Conclusion

After thoroughly analyzing the ranking chart, we conclude that M-BLI and M-I-SCAN stand out as the most suitable new endoscopic techniques for diagnosing gastric H. pylori infection.

Systematic review registration

https://inplasy.com/inplasy-2023-11-0051/, identifier INPLASY2023110051.

Characteristic endoscopic findings in Helicobacter pylori diagnosis in clinical practice

INTRODUCTION

Helicobacter pylori is a major risk factor for gastric cancer. In addition to eradication therapy, early-phase detection of gastric cancer through screening programs using high-vision endoscopy is also widely known to reduce mortality. Although European and US guidelines recommend evaluation of atrophy and intestinal metaplasia by high-vision endoscopy and pathological findings, the guideline used in Japan - the Kyoto classification of gastritis - is based on endoscopic evaluation, and recommends the grading of risk factors. This system requires classification into three endoscopic groups: H. pylori-negative, previous H. pylori infection (inactive gastritis), and current H. pylori infection (active gastritis). Major endoscopic findings in active gastritis are diffuse redness, enlarged folds, nodularity, mucosal swelling, and sticky mucus, while those in H pylori-related gastritis - irrespective of active or inactive status - are atrophy, intestinal metaplasia, and xanthoma.

AREAS COVERED

This review describes the endoscopic characteristics of current H. pylori infection, and how characteristic endoscopic findings should be evaluated.

EXPERT OPINION

Although the correct evaluation of endoscopic findings related to H. pylori remains necessary, if findings of possible infection are observed, it is important to diagnose infection by detection methods with high sensitivity and specificity, including the stool antigen test and urea breath test.

The Diagnostic Performance of Linked Color Imaging Compared to White Light Imaging in Endoscopic Diagnosis of Helicobacter pylori Infection: A Systematic Review and Meta-Analysis

Background/Aims

Recognizing Helicobacter pylori infection during endoscopy is important because it can lead to the performance of confirmatory testing. Linked color imaging (LCI) is an image enhancement technique that can improve the detection of gastrointestinal lesions. The purpose of this study was to compare LCI to conventional white light imaging (WLI) in the endoscopic diagnosis of H. pylori infection.

Methods

We conducted a comprehensive literature search using PubMed, Embase, and the Cochrane Library. All studies evaluating the diagnostic performance of LCI or WLI in the endoscopic diagnosis of H. pylori were eligible. Studies on magnifying endoscopy, chromoendoscopy, and artificial intelligence were excluded.

Results

Thirty-four studies were included in this meta-analysis, of which 32 reported the performance of WLI and eight reported the performance of LCI in diagnosing H. pylori infection. The pooled sensitivity and specificity of WLI in the diagnosis of H. pylori infection were 0.528 (95% confidence interval [CI], 0.517 to 0.540) and 0.821 (95% CI, 0.811 to 0.830), respectively. The pooled sensitivity and specificity of LCI in the diagnosis of H. pylori were 0.816 (95% CI, 0.790 to 0.841) and 0.868 (95% CI, 0.850 to 0.884), respectively. The pooled diagnostic odds ratios of WLI and LCI were 15.447 (95% CI, 8.225 to 29.013) and 31.838 (95% CI, 15.576 to 65.078), respectively. The areas under the summary receiver operating characteristic curves of WLI and LCI were 0.870 and 0.911, respectively.

Conclusions

LCI showed higher sensitivity in the endoscopic diagnosis of H. pylori infection than standard WLI.

Development of an Artificial Intelligence Diagnostic System Using Linked Color Imaging for Barrett's Esophagus

Background: Barrett's esophagus and esophageal adenocarcinoma cases are increasing as gastroesophageal reflux disease increases. Using artificial intelligence (AI) and linked color imaging (LCI), our aim was to establish a method of diagnosis for short-segment Barrett's esophagus (SSBE). Methods: We retrospectively selected 624 consecutive patients in total at our hospital, treated between May 2017 and March 2020, who experienced an esophagogastroduodenoscopy with white light imaging (WLI) and LCI. Images were randomly chosen as data for learning from WLI: 542 (SSBE+/- 348/194) of 696 (SSBE+/- 444/252); and LCI: 643 (SSBE+/- 446/197) of 805 (SSBE+/- 543/262). Using a Vision Transformer (Vit-B/16-384) to diagnose SSBE, we established two AI systems for WLI and LCI. Finally, 126 WLI (SSBE+/- 77/49) and 137 LCI (SSBE+/- 81/56) images were used for verification purposes. The accuracy of six endoscopists in making diagnoses was compared to that of AI. Results: Study participants were 68.2 ± 12.3 years, M/F 330/294, SSBE+/- 409/215. The accuracy/sensitivity/specificity (%) of AI were 84.1/89.6/75.5 for WLI and 90.5/90.1/91.1/for LCI, and those of experts and trainees were 88.6/88.7/88.4, 85.7/87.0/83.7 for WLI and 93.4/92.6/94.6, 84.7/88.1/79.8 for LCI, respectively. Conclusions: Using AI to diagnose SSBE was similar in accuracy to using a specialist. Our finding may aid the diagnosis of SSBE in the clinic.

Applications of artificial intelligence in gastroscopy: a narrative review

Gastroscopy, a critical tool for the diagnosis of upper gastrointestinal diseases, has recently incorporated artificial intelligence (AI) technology to alleviate the challenges involved in endoscopic diagnosis of some lesions, thereby enhancing diagnostic accuracy. This narrative review covers the current status of research concerning various applications of AI technology to gastroscopy, then discusses future research directions. By providing this review, we hope to promote the integration of gastroscopy and AI technology, with long-term clinical applications that can assist patients.

Uncertainty-aware network for fine-grained and imbalanced reflux esophagitis grading

Computer-aided diagnosis (CAD) assists endoscopists in analyzing endoscopic images, reducing misdiagnosis rates and enabling timely treatment. A few studies have focused on CAD for gastroesophageal reflux disease, but CAD studies on reflux esophagitis (RE) are still inadequate. This paper presents a CAD study on RE using a dataset collected from hospital, comprising over 3000 images. We propose an uncertainty-aware network with handcrafted features, utilizing representation and classifier decoupling with metric learning to address class imbalance and achieve fine-grained RE classification. To enhance interpretability, the network estimates uncertainty through test time augmentation. The experimental results demonstrate that the proposed network surpasses previous methods, achieving an accuracy of 90.2% and an F1 score of 90.1%.

Clinical usefulness of linked color imaging in identifying Helicobacter pylori infection: A systematic review and meta-analysis

BACKGROUND

Accurate diagnosis of Helicobacter pylori (H. pylori) infection status is a crucial premise for eradication therapy, as well as evaluation of risk for gastric cancer. Recent progress on imaging enhancement endoscopy (IEE) made it possible to not only detect precancerous lesions and early gastrointestinal cancers but also to predict H. pylori infection in real time. As a novel IEE modality, linked color imaging (LCI) has exhibited its value on diagnosis of lesions of gastric mucosa through emphasizing minor differences of color tone.

AIM

To compare the efficacy of LCI for H. pylori active infection vs conventional white light imaging (WLI).

METHODS

PubMed, Embase, Embase and Cochrane Library were searched up to the end of April 11, 2022. The random-effects model was adopted to calculate the diagnostic efficacy of LCI and WLI. The calculation of sensitivity, specificity, and likelihood ratios were performed; symmetric receiver operator characteristic (SROC) curves and the areas under the SROC curves were computed. Quality of the included studies was chosen to assess using the quality assessment of diagnostic accuracy studies-2 tool.

RESULTS

Seven original studies were included in this study. The pooled sensitivity, specificity, positive likelihood rate, and negative likelihood rate of LCI for the diagnosis of H. pylori infection of gastric mucosa were 0.85 [95% confidence interval (CI): 0.76-0.92], 0.82 (95%CI: 0.78-0.85), 4.71 (95%CI: 3.7-5.9), and 0.18 (95%CI: 0.10-0.31) respectively, with diagnostic odds ratio = 26 (95%CI: 13-52), SROC = 0.87 (95%CI: 0.84-0.90), which showed superiority of diagnostic efficacy compared to WLI.

CONCLUSION

Our results showed LCI can improve efficacy of diagnosis on H. pylori infection, which represents a useful endoscopic evaluation modality for clinical practice.

Diagnostic usefulness of deep learning methods for Helicobacter pylori infection using esophagogastroduodenoscopy images

Background and Aims

We aimed to assess the diagnostic potential of deep convolutional neural networks (DCNNs) for detecting Helicobacter pylori infection in patients who underwent esophagogastroduodenoscopy and Campylobacter-like organism tests.

Methods

We categorized a total of 13,071 images of various gastric sub-areas and employed five pretrained DCNN architectures: ResNet-101, Xception, Inception-v3, InceptionResnet-v2, and DenseNet-201. Additionally, we created an ensemble model by combining the output probabilities of the best models. We used images of different sub-areas of the stomach for training and evaluated the performance of our models. The diagnostic metrics assessed included area under the curve (AUC), specificity, accuracy, positive predictive value, and negative predictive value.

Results

When training included images from all sub-areas of the stomach, our ensemble model demonstrated the highest AUC (0.867), with specificity at 78.44%, accuracy at 80.28%, positive predictive value at 82.66%, and negative predictive value at 77.37%. Significant differences were observed in AUC between the ensemble model and the individual DCNN models. When training utilized images from each sub-area separately, the AUC values for the antrum, cardia and fundus, lower body greater curvature and lesser curvature, and upper body greater curvature and lesser curvature regions were 0.842, 0.826, 0.718, and 0.858, respectively, when the ensemble model was used.

Conclusions

Our study demonstrates that the DCNN model, designed for automated image analysis, holds promise for the evaluation and diagnosis of Helicobacter pylori infection.

The Importance of Artificial Intelligence in Upper Gastrointestinal Endoscopy

Recently, there has been a growing interest in the application of artificial intelligence (AI) in medicine, especially in specialties where visualization methods are applied. AI is defined as a computer's ability to achieve human cognitive performance, which is accomplished through enabling computer "learning". This can be conducted in two ways, as machine learning and deep learning. Deep learning is a complex learning system involving the application of artificial neural networks, whose algorithms imitate the human form of learning. Upper gastrointestinal endoscopy allows examination of the esophagus, stomach and duodenum. In addition to the quality of endoscopic equipment and patient preparation, the performance of upper endoscopy depends on the experience and knowledge of the endoscopist. The application of artificial intelligence in endoscopy refers to computer-aided detection and the more complex computer-aided diagnosis. The application of AI in upper endoscopy is aimed at improving the detection of premalignant and malignant lesions, with special attention on the early detection of dysplasia in Barrett's esophagus, the early detection of esophageal and stomach cancer and the detection of H. pylori infection. Artificial intelligence reduces the workload of endoscopists, is not influenced by human factors and increases the diagnostic accuracy and quality of endoscopic methods.

Role of linked color imaging for upper gastrointestinal disease: present and future

Techniques for upper gastrointestinal endoscopy are advancing to facilitate lesion detection and improve prognosis. However, most early tumors in the upper gastrointestinal tract exhibit subtle color changes or morphological features that are difficult to detect using white light imaging. Linked color imaging (LCI) has been developed to overcome these shortcomings; it expands or reduces color information to clarify color differences, thereby facilitating the detection and observation of lesions. This article summarizes the characteristics of LCI and advances in LCI-related research in the upper gastrointestinal tract field.

Application of artificial intelligence for improving early detection and prediction of therapeutic outcomes for gastric cancer in the era of precision oncology

Gastric cancer is a leading contributor to cancer incidence and mortality globally. Recently, artificial intelligence approaches, particularly machine learning and deep learning, are rapidly reshaping the full spectrum of clinical management for gastric cancer. Machine learning is formed from computers running repeated iterative models for progressively improving performance on a particular task. Deep learning is a subtype of machine learning on the basis of multilayered neural networks inspired by the human brain. This review summarizes the application of artificial intelligence algorithms to multi-dimensional data including clinical and follow-up information, conventional images (endoscope, histopathology, and computed tomography (CT)), molecular biomarkers, etc. to improve the risk surveillance of gastric cancer with established risk factors; the accuracy of diagnosis, and survival prediction among established gastric cancer patients; and the prediction of treatment outcomes for assisting clinical decision making. Therefore, artificial intelligence makes a profound impact on almost all aspects of gastric cancer from improving diagnosis to precision medicine. Despite this, most established artificial intelligence-based models are in a research-based format and often have limited value in real-world clinical practice. With the increasing adoption of artificial intelligence in clinical use, we anticipate the arrival of artificial intelligence-powered gastric cancer care.

Development and validation of a convolutional neural network model for diagnosing Helicobacter pylori infections with endoscopic images: a multicenter study

BACKGROUND AND AIMS

Insufficient validation limits the generalizability of deep learning in diagnosing Helicobacter pylori infection with endoscopic images. The aim of this study was to develop a deep learning model for the diagnosis of H pylori infection using endoscopic images and validate the model with internal and external datasets.

METHODS

A convolutional neural network (CNN) model was developed based on a training dataset comprising 13,403 endoscopic images from 952 patients who underwent endoscopy at Seoul National University Hospital Gangnam Center. Internal validation was performed using a separate dataset comprised of images of 411 individuals of Korean descent and 131 of non-Korean descent. External validation was performed with the images of 160 patients in Gangnam Severance Hospital. Gradient-weighted class activation mapping was performed to visually explain the model.

RESULTS

In predicting H pylori ever-infected status, the sensitivity, specificity, and accuracy of internal validation for people of Korean descent were .96 (95% confidence interval [CI], .93-.98), .90 (95% CI, .85-.95), and .94 (95% CI, .91-.96), respectively. In the internal validation for people of non-Korean descent, the sensitivity, specificity, and accuracy in predicting H pylori ever-infected status were .92 (95% CI, .86-.98), .79 (95% CI, .67-.91), and .88 (95% CI, .82-.93), respectively. In the external validation cohort, sensitivity, specificity, and accuracy were .86 (95% CI, .80-.93), .88 (95% CI, .79-.96), and .87 (95% CI, .82-.92), respectively, when performing 2-group categorization. Gradient-weighted class activation mapping showed that the CNN model captured the characteristic findings of each group.

CONCLUSIONS

This CNN model for diagnosing H pylori infection showed good overall performance in internal and external validation datasets, particularly in categorizing patients into the never- versus ever-infected groups.

Artificial Intelligence in Pediatric Endoscopy: Current Status and Future Applications

The application of artificial intelligence (AI) has great promise for improving pediatric endoscopy. The majority of preclinical studies have been undertaken in adults, with the greatest progress being made in the context of colorectal cancer screening and surveillance. This development has only been possible with advances in deep learning, like the convolutional neural network model, which has enabled real-time detection of pathology. Comparatively, the majority of deep learning systems developed in inflammatory bowel disease have focused on predicting disease severity and were developed using still images rather than videos. The application of AI to pediatric endoscopy is in its infancy, thus providing an opportunity to develop clinically meaningful and fair systems that do not perpetuate societal biases. In this review, we provide an overview of AI, summarize the advances of AI in endoscopy, and describe its potential application to pediatric endoscopic practice and education.

Assessment of Helicobacter pylori infection by deep learning based on endoscopic videos in real time

BACKGROUND AND AIMS

Endoscopic assessment of Helicobacter pylori infection is a simple and effective method. Here, we aimed to develop a deep learning-based system named Intelligent Detection Endoscopic Assistant-Helicobacter pylori (IDEA-HP) to assess H. pylori infection by using endoscopic videos in real time.

METHODS

Endoscopic data were retrospectively obtained from Zhejiang Cancer Hospital (ZJCH) for the development, validation, and testing of the system. Stored videos from ZJCH were used for assessing and comparing the performance of IDEA-HP with that of endoscopists. Prospective consecutive patients undergoing esophagogastroduodenoscopy were enrolled to assess the applicability of clinical practice. The urea breath test was used as the gold standard for diagnosing H. pylori infection.

RESULTS

In 100 videos, IDEA-HP achieved a similar overall accuracy of assessing H. pylori infection to that of experts (84.0% vs. 83.6% [P = 0.729]). Nevertheless, the diagnostic accuracy (84.0% vs. 74.0% [P<0.001]) and sensitivity (82.0% vs. 67.2% [P<0.001]) of IDEA-HP were significantly higher than those of the beginners. In 191 prospective consecutive patients, IDEA-HP achieved accuracy, sensitivity, and specificity of 85.3% (95% CI: 79.0%-89.3%), 83.3% (95% CI: 72.8%-90.5%), and 85.8% (95% CI: 77.7%-91.4%), respectively.

CONCLUSIONS

Our results show that IDEA-HP has great potential for assisting endoscopists in assessing H. pylori infection status during actual clinical work.

Linked Color Imaging for Stomach

Image-enhanced endoscopy (IEE) plays an important role in the detection and further examination of gastritis and early gastric cancer (EGC). Linked color imaging (LCI) is also useful for detecting and evaluating gastritis, gastric intestinal metaplasia as a pre-cancerous lesion, and EGC. LCI provides a clear excellent endoscopic view of the atrophic border and the demarcation line under various conditions of gastritis. We could recognize gastritis as the lesions of the diffuse redness to purple color area with LCI. On the other hand, EGCs are recognized as the lesions of the orange-red, orange, or orange-white color area in the lesion of the purple color area, which is the surround atrophic mucosa with LCI. With further prospective randomized studies, we will be able to evaluate the diagnosis ability for EGC by IEE, and it will be necessary to evaluate the role of WLI/IEE and the additional effects of the diagnostic ability by adding IEE to WLI in future.

Current status and future perspective of linked color imaging for gastric cancer screening: a literature review

Screening endoscopy has advanced to facilitate improvements in the detection and prognosis of gastric cancer. However, most early gastric cancers (EGCs) have subtle morphological or color features that are difficult to detect by white-light imaging (WLI); thus, even well-trained endoscopists can miss EGC when using this conventional endoscopic approach. This review summarizes the current and future status of linked color imaging (LCI), a new image-enhancing endoscopy (IEE) method, for gastric screening. LCI has been shown to produce bright images even at a distant view and provide excellent visibility of gastric cancer due to high color contrast relative to the surrounding tissue. LCI delineates EGC as orange-red and intestinal metaplasia as purple, regardless of a history of Helicobacter pylori (Hp) eradication, and contributes to the detection of superficial EGC. Moreover, LCI assists in the determination of Hp infection status, which is closely related to the risk of developing gastric cancer. Transnasal endoscopy (ultra-thin) using LCI is also useful for identifying gastric neoplastic lesions. Recently, several prospective studies have demonstrated that LCI has a higher detection ratio for gastric cancer than WLI. We believe that LCI should be used in routine upper gastrointestinal endoscopies.

Artificial intelligence in gastroenterology: A narrative review

Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.

Identification of ocular refraction based on deep learning algorithm as a novel retinoscopy method

BACKGROUND

The evaluation of refraction is indispensable in ophthalmic clinics, generally requiring a refractor or retinoscopy under cycloplegia. Retinal fundus photographs (RFPs) supply a wealth of information related to the human eye and might provide a promising approach that is more convenient and objective. Here, we aimed to develop and validate a fusion model-based deep learning system (FMDLS) to identify ocular refraction via RFPs and compare with the cycloplegic refraction. In this population-based comparative study, we retrospectively collected 11,973 RFPs from May 1, 2020 to November 20, 2021. The performance of the regression models for sphere and cylinder was evaluated using mean absolute error (MAE). The accuracy, sensitivity, specificity, area under the receiver operating characteristic curve, and F1-score were used to evaluate the classification model of the cylinder axis.

RESULTS

Overall, 7873 RFPs were retained for analysis. For sphere and cylinder, the MAE values between the FMDLS and cycloplegic refraction were 0.50 D and 0.31 D, representing an increase of 29.41% and 26.67%, respectively, when compared with the single models. The correlation coefficients (r) were 0.949 and 0.807, respectively. For axis analysis, the accuracy, specificity, sensitivity, and area under the curve value of the classification model were 0.89, 0.941, 0.882, and 0.814, respectively, and the F1-score was 0.88.

CONCLUSIONS

The FMDLS successfully identified the ocular refraction in sphere, cylinder, and axis, and showed good agreement with the cycloplegic refraction. The RFPs can provide not only comprehensive fundus information but also the refractive state of the eye, highlighting their potential clinical value.

Current Status of Artificial Intelligence-Based Computer-Assisted Diagnosis Systems for Gastric Cancer in Endoscopy

Artificial intelligence (AI) is gradually being utilized in various fields as its performance has been improving with the development of deep learning methods, availability of big data, and the progression of computer processing units. In the field of medicine, AI is mainly implemented in image recognition, such as in radiographic and pathologic diagnoses. In the realm of gastrointestinal endoscopy, although AI-based computer-assisted detection/diagnosis (CAD) systems have been applied in some areas, such as colorectal polyp detection and diagnosis, so far, their implementation in real-world clinical settings is limited. The accurate detection or diagnosis of gastric cancer (GC) is one of the challenges in which performance varies greatly depending on the endoscopist's skill. The diagnosis of early GC is especially challenging, partly because early GC mimics atrophic gastritis in the background mucosa. Therefore, several CAD systems for GC are being actively developed. The development of a CAD system for GC is considered challenging because it requires a large number of GC images. In particular, early stage GC images are rarely available, partly because it is difficult to diagnose gastric cancer during the early stages. Additionally, the training image data should be of a sufficiently high quality to conduct proper CAD training. Recently, several AI systems for GC that exhibit a robust performance, owing to being trained on a large number of high-quality images, have been reported. This review outlines the current status and prospects of AI use in esophagogastroduodenoscopy (EGDS), focusing on the diagnosis of GC.

Application of artificial intelligence in the endoscopic diagnosis of early gastric cancer, atrophic gastritis, and Helicobacter pylori infection

Gastric cancer (GC) is one of the most serious health problems worldwide. Chronic atrophic gastritis (CAG) is most commonly caused by Helicobacter pylori (H. pylori) infection. Currently, endoscopic detection of early gastric cancer (EGC) and CAG remains challenging for endoscopists, and the diagnostic accuracy of H. pylori infection by endoscopy is approximately 70%. Artificial intelligence (AI) can assist endoscopic diagnosis including detection, prediction of depth of invasion, boundary delineation, and anatomical location of EGC, and has achievable diagnostic ability even comparable to experienced endoscopists. In this review we summarized various AI-assisted systems in the diagnosis of EGC, CAG, and H. pylori infection.

Systematic review and meta-analysis: Artificial intelligence for the diagnosis of gastric precancerous lesions and Helicobacter pylori infection

BACKGROUND

The endoscopic diagnosis of Helicobacter-pylori(H.pylori) infection and gastric precancerous lesions(GPL), namely atrophic-gastritis and intestinal-metaplasia, still remains challenging. Artificial intelligence(AI) may represent a powerful resource for the endoscopic recognition of these conditions.

AIMS

To explore the diagnostic performance(DP) of AI in the diagnosis of GPL and H.pylori infection.

METHODS

A systematic-review was performed by two independent authors up to September 2021. Inclusion criteria were studies focusing on the DP of AI-system in the diagnosis of GPL and H.pylori infection. The pooled accuracy of studies included was reported.

RESULTS

Overall, 128 studies were found (PubMed-Embase-Cochrane Library) and four and nine studies were finally included regarding GPL and H.pylori infection, respectively. The pooled-accuracy(random effects model) was 90.3%(95%CI 84.3-94.9) and 79.6%(95%CI 66.7-90.0) with a significant heterogeneity[I²=90.4%(95%CI 78.5-95.7);I²=97.9%(97.2-98.6)] for GPL and H.pylori infection, respectively. The Begg's-test showed a significant publication-bias(p = 0.0371) only among studies regarding H.pylori infection. The pooled-accuracy(random-effects-model) was similar considering only studies using CNN-model for the diagnosis of H.pylori infection: 74.1%[(95%CI 51.6-91.3);I²=98.9%(95%CI 98.5-99.3)], Begg's-test(p = 0.1416) did not show publication-bias.

CONCLUSION

AI-system seems to be a good resource for an easier diagnosis of GPL and H.pylori infection, showing a pooled-diagnostic-accuracy of 90% and 80%, respectively. However, considering the high heterogeneity, these promising data need an external validation by randomized control trials and prospective real-time studies.

DeepHP: A New Gastric Mucosa Histopathology Dataset for Helicobacter pylori Infection Diagnosis

Emerging deep learning-based applications in precision medicine include computational histopathological analysis. However, there is a lack of the required training image datasets to generate classification and detection models. This phenomenon occurs mainly due to human factors that make it difficult to obtain well-annotated data. The present study provides a curated public collection of histopathological images (DeepHP) and a convolutional neural network model for diagnosing gastritis. Images from gastric biopsy histopathological exams were used to investigate the performance of the proposed model in detecting gastric mucosa with Helicobacter pylori infection. The DeepHP database comprises 394,926 histopathological images, of which 111 K were labeled as Helicobacter pylori positive and 283 K were Helicobacter pylori negative. We investigated the classification performance of three Convolutional Neural Network architectures. The models were tested and validated with two distinct image sets of 15% (59K patches) chosen randomly. The VGG16 architecture showed the best results with an Area Under the Curve of 0.998%. The results showed that CNN could be used to classify histopathological images from gastric mucosa with marked precision. Our model evidenced high potential and application in the computational pathology field.

Identification of upper GI diseases during screening gastroscopy using a deep convolutional neural network algorithm

BACKGROUND AND AIMS

The clinical application of GI endoscopy for the diagnosis of multiple diseases using artificial intelligence (AI) has been limited by its high false-positive rates. There is an unmet need to develop a GI endoscopy AI-assisted diagnosis system (GEADS) to improve diagnostic accuracy and clinical utility.

METHODS

In this retrospective, multicenter study, a convolutional neural network was trained to assess upper GI diseases based on 26,228 endoscopic images from Dazhou Central Hospital that were randomly assigned (3:1:1) to a training dataset, validation dataset, and test dataset, respectively. To validate the model, 6 external independent datasets comprising 51,372 images of upper GI diseases were collected. In addition, 1 prospective dataset comprising 27,975 images was collected. The performance of GEADS was compared with endoscopists with 2 professional degrees of expertise: expert and novice. Eight endoscopists were in the expert group with >5 years of experience, whereas 3 endoscopists were in the novice group with 1 to 5 years of experience.

RESULTS

The GEADS model achieved an accuracy of .918 (95% confidence interval [CI], .914-.922), with an F1 score of .884 (95% CI, .879-.889), recall of .873 (95% CI, .868-.878), and precision of .890 (95% CI, .885-.895) in the internal validation dataset. In the external validation datasets and 1 prospective validation dataset, the diagnostic accuracy of the GEADS ranged from .841 (95% CI, .834-.848) to .949 (95% CI, .935-.963). With the help of the GEADS, the diagnosing accuracies of novice and expert endoscopists were significantly improved (P < .001).

CONCLUSIONS

The AI system can assist endoscopists in improving the accuracy of diagnosing upper GI diseases.

Artificial intelligence in gastrointestinal endoscopy - Evolution to a new era

Artificial intelligence (AI) systems based on machine learning have evolved in the last few years with an increasing applicability in gastrointestinal endoscopy. Thanks to AI, an image (input) can be transformed into a clinical decision (output). Although AI systems have been initially studied to improve detection (CADe) and characterization of colorectal lesions (CADx), other indications are being currently investigated as detection of blind spots, scope guidance, or delineation/measurement of lesions. The objective of these review is to summarize the current evidence on applicability of AI systems in gastrointestinal endoscopy, highlight strengths and limitations of the technology and review regulatory and ethical aspects for its general implementation in gastrointestinal endoscopy.

Artificial Intelligence in Endoscopy

Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.

Implementation of artificial intelligence in upper gastrointestinal endoscopy

The application of artificial intelligence (AI) using deep learning has significantly expanded in the field of esophagogastric endoscopy. Recent studies have shown promising results in detecting and differentiating early gastric cancer using AI tools built using white light, magnified, or image-enhanced endoscopic images. Some studies have reported the use of AI tools to predict the depth of early gastric cancer based on endoscopic images. Similarly, studies based on using AI for detecting early esophageal cancer have also been reported, with an accuracy comparable to that of endoscopy specialists. Moreover, an AI system, developed to diagnose pharyngeal cancer, has shown promising performance with high sensitivity. These reports suggest that, if introduced for regular use in clinical settings, AI systems can significantly reduce the burden on physicians. This review summarizes the current status of AI applications in the upper gastrointestinal tract and presents directions for clinical practice implementation and future research.

Deep learning for gastroscopic images: computer-aided techniques for clinicians

Gastric disease is a major health problem worldwide. Gastroscopy is the main method and the gold standard used to screen and diagnose many gastric diseases. However, several factors, such as the experience and fatigue of endoscopists, limit its performance. With recent advancements in deep learning, an increasing number of studies have used this technology to provide on-site assistance during real-time gastroscopy. This review summarizes the latest publications on deep learning applications in overcoming disease-related and nondisease-related gastroscopy challenges. The former aims to help endoscopists find lesions and characterize them when they appear in the view shed of the gastroscope. The purpose of the latter is to avoid missing lesions due to poor-quality frames, incomplete inspection coverage of gastroscopy, etc., thus improving the quality of gastroscopy. This study aims to provide technical guidance and a comprehensive perspective for physicians to understand deep learning technology in gastroscopy. Some key issues to be handled before the clinical application of deep learning technology and the future direction of disease-related and nondisease-related applications of deep learning to gastroscopy are discussed herein.

Application and prospect of artificial intelligence in digestive endoscopy

INTRODUCTION

With the progress of science and technology, artificial intelligence represented by deep learning has gradually begun to be applied in the medical field. Artificial intelligence has been applied to benign gastrointestinal lesions, tumors, early cancer, inflammatory bowel disease, gallbladder, pancreas, and other diseases. This review summarizes the latest research results on artificial intelligence in digestive endoscopy and discusses the prospect of artificial intelligence in digestive system diseases.

AREAS COVERED

We retrieved relevant documents on artificial intelligence in digestive tract diseases from PubMed and Medline. This review elaborates on the knowledge of computer-aided diagnosis in digestive endoscopy.

EXPERT OPINION

Artificial intelligence significantly improves diagnostic accuracy, reduces physicians' workload, and provides a shred of evidence for clinical diagnosis and treatment. Shortly, artificial intelligence will have high application value in the field of medicine.

Application Status and Prospects of Artificial Intelligence in Peptic Ulcers

Peptic ulcer (PU) is a common and frequently occurring disease. Although PU seriously threatens the lives and health of global residents, the applications of artificial intelligence (AI) have strongly promoted diversification and modernization in the diagnosis and treatment of PU. This minireview elaborates on the research progress of AI in the field of PU, from PU's pathogenic factor Helicobacter pylori (Hp) infection, diagnosis and differential diagnosis, to its management and complications (bleeding, obstruction, perforation and canceration). Finally, the challenges and prospects of AI application in PU are prospected and expounded. With the in-depth understanding of modern medical technology, AI remains a promising option in the management of PU patients and plays a more indispensable role. How to realize the robustness, versatility and diversity of multifunctional AI systems in PU and conduct multicenter prospective clinical research as soon as possible are the top priorities in the future.

Artificial intelligence in gastroenterology: A state-of-the-art review

The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.

A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology

Artificial intelligence (AI) is rapidly becoming an essential tool in the medical field as well as in daily life. Recent developments in deep learning, a subfield of AI, have brought remarkable advances in image recognition, which facilitates improvement in the early detection of cancer by endoscopy, ultrasonography, and computed tomography. In addition, AI-assisted big data analysis represents a great step forward for precision medicine. This review provides an overview of AI technology, particularly for gastroenterology, hepatology, and pancreatology, to help clinicians utilize AI in the near future.

Application of artificial intelligence in gastrointestinal disease: a narrative review

Objective

We collected evidence on the application of artificial intelligence (AI) in gastroenterology field. The review was carried out from two aspects of endoscopic types and gastrointestinal diseases, and briefly summarized the challenges and future directions in this field.

Background

Due to the advancement of computational power and a surge of available data, a solid foundation has been laid for the growth of AI. Specifically, varied machine learning (ML) techniques have been emerging in endoscopic image analysis. To improve the accuracy and efficiency of clinicians, AI has been widely applied to gastrointestinal endoscopy.

Methods

PubMed electronic database was searched using the keywords containing “AI”, “ML”, “deep learning (DL)”, “convolution neural network”, “endoscopy (such as white light endoscopy (WLE), narrow band imaging (NBI) endoscopy, magnifying endoscopy with narrow band imaging (ME-NBI), chromoendoscopy, endocytoscopy (EC), and capsule endoscopy (CE))”. Search results were assessed for relevance and then used for detailed discussion.

Conclusions

This review described the basic knowledge of AI, ML, and DL, and summarizes the application of AI in various endoscopes and gastrointestinal diseases. Finally, the challenges and directions of AI in clinical application were discussed. At present, the application of AI has solved some clinical problems, but more still needs to be done.

Helicobacter pylori eradication: Exploring its impacts on the gastric mucosa

Helicobacter pylori (H. pylori) infects approximately 50% of all humans globally. Persistent H. pylori infection causes multiple gastric and extragastric diseases, indicating the importance of early diagnosis and timely treatment. H. pylori eradication produces dramatic changes in the gastric mucosa, resulting in restored function. Consequently, to better understand the importance of H. pylori eradication and clarify the subsequent recovery of gastric mucosal functions after eradication, we summarize histological, endoscopic, and gastric microbiota changes to assess the therapeutic effects on the gastric mucosa.

Diagnosis of Helicobacter pylori Infection and Recent Advances

BACKGROUND

Helicobacter pylori (H. pylori) infects approximately 50% of the world population. Its infection is associated with gastropathies, extra-gastric digestive diseases, and diseases of other systems. There is a canonical process from acute-on-chronic inflammation, chronic atrophic gastritis (CAG), intestinal metaplasia (IM), dysplasia, and intraepithelial neoplasia, eventually to gastric cancer (GC). H. pylori eradication abolishes the inflammatory response and early treatment prevents the progression to preneoplastic lesions.

METHODS

the test-and-treat strategy, endoscopy-based strategy, and screen-and-treat strategy are recommended to prevent GC based on risk stratification, prevalence, and patients' clinical manifestations and conditions. Challenges contain false-negative results, increasing antibiotic resistance, decreasing eradication rate, and poor retesting rate. Present diagnosis methods are mainly based on invasive endoscopy and noninvasive laboratory testing.

RESULTS

to improve the accuracy and effectiveness and reduce the missed diagnosis, some advances were achieved including newer imaging techniques (such as image-enhanced endoscopy (IEE), artificial intelligence (AI) technology, and quantitative real-time polymerase chain reaction (qPCR) and digital PCR (dPCR).

CONCLUSION

in the article, we summarized the diagnosis methods of H. pylori infection and recent advances, further finding out the opportunities in challenges.

Application of linked color imaging in the diagnosis of early gastrointestinal neoplasms and precancerous lesions: a review

INTRODUCTION

Minimally invasive endoscopic resection is often effective in the management of early gastrointestinal tumors. However, advanced and more effective methods of endoscopic examination are required to improve the rate of diagnosing early gastrointestinal tumors.

DISCUSSION

The development of dye-based image-enhanced endoscopy (d-IEE) and equipment-based image-enhanced endoscopy (e-IEE) has helped improve the diagnostic rate of early gastrointestinal tumor using endoscopy. In some special cases, these methods are still not accurate in diagnosing lesions. On the basis of these e-IEEs, a new endoscopic technique, linked color imaging (LCI), that combines a specific short wavelength narrow band of light with white light, has been developed.

CONCLUSION

In this article, we summarized the characteristics of LCI and the development of research regarding digestive tract examination.

PLAIN LANGUAGE SUMMARY

Application of linked color imaging in early gastrointestinal neoplasms At present, the complete diagnosis of early gastrointestinal tumors and precancerous lesions can be made by gastrointestinal endoscopy. With the improvement of therapeutic instruments and operators' experience, endoscopic therapy can often achieve significant effect in the treatment of early gastrointestinal tumors. The development and spread of equipment-based image-enhanced endoscopy (e-IEE) mode has helped improve the diagnosis rate of early gastrointestinal tumors under endoscopy. However, in some special cases, these methods are still not accurate for the diagnosis of lesions. On the basis of these E-IEEs, a new endoscopic technique, linked color imaging (LCI), has been developed, which combines a specific short wavelength narrow band of light with white light. LCI can significantly improve the diagnostic rate of all types of gastrointestinal mucosal lesions. Tumor lesions and inflammatory lesions can be distinguished by observing the mucosal microvascular structure and color difference. LCI helps detect early gastrointestinal mucosal lesions by taking advantage of the differences in light absorption of different wavelengths and contrast of enhanced colors in the later stage.

Application of artificial intelligence-driven endoscopic screening and diagnosis of gastric cancer

The landscape of gastrointestinal endoscopy continues to evolve as new technologies and techniques become available. The advent of image-enhanced and magnifying endoscopies has highlighted the step toward perfecting endoscopic screening and diagnosis of gastric lesions. Simultaneously, with the development of convolutional neural network, artificial intelligence (AI) has made unprecedented breakthroughs in medical imaging, including the ongoing trials of computer-aided detection of colorectal polyps and gastrointestinal bleeding. In the past demi-decade, applications of AI systems in gastric cancer have also emerged. With AI’s efficient computational power and learning capacities, endoscopists can improve their diagnostic accuracies and avoid the missing or mischaracterization of gastric neoplastic changes. So far, several AI systems that incorporated both traditional and novel endoscopy technologies have been developed for various purposes, with most systems achieving an accuracy of more than 80%. However, their feasibility, effectiveness, and safety in clinical practice remain to be seen as there have been no clinical trials yet. Nonetheless, AI-assisted endoscopies shed light on more accurate and sensitive ways for early detection, treatment guidance and prognosis prediction of gastric lesions. This review summarizes the current status of various AI applications in gastric cancer and pinpoints directions for future research and clinical practice implementation from a clinical perspective.

Status quo and future prospects of artificial neural network from the perspective of gastroenterologists

Artificial neural networks (ANNs) are one of the primary types of artificial intelligence and have been rapidly developed and used in many fields. In recent years, there has been a sharp increase in research concerning ANNs in gastrointestinal (GI) diseases. This state-of-the-art technique exhibits excellent performance in diagnosis, prognostic prediction, and treatment. Competitions between ANNs and GI experts suggest that efficiency and accuracy might be compatible in virtue of technique advancements. However, the shortcomings of ANNs are not negligible and may induce alterations in many aspects of medical practice. In this review, we introduce basic knowledge about ANNs and summarize the current achievements of ANNs in GI diseases from the perspective of gastroenterologists. Existing limitations and future directions are also proposed to optimize ANN’s clinical potential. In consideration of barriers to interdisciplinary knowledge, sophisticated concepts are discussed using plain words and metaphors to make this review more easily understood by medical practitioners and the general public.

Deep learning for diagnosis of precancerous lesions in upper gastrointestinal endoscopy: A review

Upper gastrointestinal (GI) cancers are the leading cause of cancer-related deaths worldwide. Early identification of precancerous lesions has been shown to minimize the incidence of GI cancers and substantiate the vital role of screening endoscopy. However, unlike GI cancers, precancerous lesions in the upper GI tract can be subtle and difficult to detect. Artificial intelligence techniques, especially deep learning algorithms with convolutional neural networks, might help endoscopists identify the precancerous lesions and reduce interobserver variability. In this review, a systematic literature search was undertaken of the Web of Science, PubMed, Cochrane Library and Embase, with an emphasis on the deep learning-based diagnosis of precancerous lesions in the upper GI tract. The status of deep learning algorithms in upper GI precancerous lesions has been systematically summarized. The challenges and recommendations targeting this field are comprehensively analyzed for future research.

Current status and future perspective of artificial intelligence applications in endoscopic diagnosis and management of gastric cancer

Image recognition using artificial intelligence (AI) has progressed significantly due to innovative technologies such as machine learning and deep learning. In the field of gastric cancer (GC) management, research on AI-based diagnosis such as anatomical classification of endoscopic images, diagnosis of Helicobacter pylori infection, and detection and qualitative diagnosis of GC is being conducted, and an accuracy equivalent to that of physicians has been reported. It is expected that AI will soon be introduced in the field of endoscopic diagnosis and management of gastric cancer as a supportive tool for physicians, thus improving the quality of medical care.

Artificial intelligence in endoscopy: Present and future perspectives

Artificial intelligence (AI) has been attracting considerable attention as an important scientific topic in the field of medicine. Deep-leaning (DL) technologies have been applied more dominantly than other traditional machine-learning methods. They have demonstrated excellent capability to retract visual features of objectives, even unnoticeable ones for humans, and analyze huge amounts of information within short periods. The amount of research applying DL-based models to real-time computer-aided diagnosis (CAD) systems has been increasing steadily in the GI endoscopy field. An array of published data has already demonstrated the advantages of DL-based CAD models in the detection and characterization of various neoplastic lesions, regardless of the level of the GI tract. Although the diagnostic performances and study designs vary widely, owing to a lack of academic standards to assess the capability of AI for GI endoscopic diagnosis fairly, the superiority of CAD models has been demonstrated for almost all applications studied so far. Most of the challenges associated with AI in the endoscopy field are general problems for AI models used in the real world outside of medical fields. Solutions have been explored seriously and some solutions have been tested in the endoscopy field. Given that AI has become the basic technology to make machines react to the environment, AI would be a major technological paradigm shift, for not only diagnosis but also treatment. In the near future, autonomous endoscopic diagnosis might no longer be just a dream, as we are witnessing with the advent of autonomously driven electric vehicles.

Artificial intelligence in gastric cancer: a systematic review

OBJECTIVE

This study aims to systematically review the application of artificial intelligence (AI) techniques in gastric cancer and to discuss the potential limitations and future directions of AI in gastric cancer.

METHODS

A systematic review was performed that follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Pubmed, EMBASE, the Web of Science, and the Cochrane Library were used to search for gastric cancer publications with an emphasis on AI that were published up to June 2020. The terms "artificial intelligence" and "gastric cancer" were used to search for the publications.

RESULTS

A total of 64 articles were included in this review. In gastric cancer, AI is mainly used for molecular bio-information analysis, endoscopic detection for Helicobacter pylori infection, chronic atrophic gastritis, early gastric cancer, invasion depth, and pathology recognition. AI may also be used to establish predictive models for evaluating lymph node metastasis, response to drug treatments, and prognosis. In addition, AI can be used for surgical training, skill assessment, and surgery guidance.

CONCLUSIONS

In the foreseeable future, AI applications can play an important role in gastric cancer management in the era of precision medicine.