Artificial intelligence-based diagnostic system classifying gastric cancers and ulcers: comparison between the original and newly developed systems

Endoscopic Artificial Intelligence for Image Analysis in Gastrointestinal Neoplasms

BACKGROUND

Artificial intelligence (AI) using deep learning systems has recently been utilized in various medical fields. In the field of gastroenterology, AI is primarily implemented in image recognition and utilized in the realm of gastrointestinal (GI) endoscopy. In GI endoscopy, computer-aided detection/diagnosis (CAD) systems assist endoscopists in GI neoplasm detection or differentiation of cancerous or noncancerous lesions. Several AI systems for colorectal polyps have already been applied in colonoscopy clinical practices. In esophagogastroduodenoscopy, a few CAD systems for upper GI neoplasms have been launched in Asian countries. The usefulness of these CAD systems in GI endoscopy has been gradually elucidated.

SUMMARY

In this review, we outline recent articles on several studies of endoscopic AI systems for GI neoplasms, focusing on esophageal squamous cell carcinoma (ESCC), esophageal adenocarcinoma (EAC), gastric cancer (GC), and colorectal polyps. In ESCC and EAC, computer-aided detection (CADe) systems were mainly developed, and a recent meta-analysis study showed sensitivities of 91.2% and 93.1% and specificities of 80% and 86.9%, respectively. In GC, a recent meta-analysis study on CADe systems demonstrated that their sensitivity and specificity were as high as 90%. A randomized controlled trial (RCT) also showed that the use of the CADe system reduced the miss rate. Regarding computer-aided diagnosis (CADx) systems for GC, although RCTs have not yet been conducted, most studies have demonstrated expert-level performance. In colorectal polyps, multiple RCTs have shown the usefulness of the CADe system for improving the polyp detection rate, and several CADx systems have been shown to have high accuracy in colorectal polyp differentiation.

KEY MESSAGES

Most analyses of endoscopic AI systems suggested that their performance was better than that of nonexpert endoscopists and equivalent to that of expert endoscopists. Thus, endoscopic AI systems may be useful for reducing the risk of overlooking lesions and improving the diagnostic ability of endoscopists.

Real-time detection of active bleeding in laparoscopic colectomy using artificial intelligence

BACKGROUND

Most intraoperative adverse events (iAEs) result from surgeons' errors, and bleeding is the majority of iAEs. Recognizing active bleeding timely is important to ensure safe surgery, and artificial intelligence (AI) has great potential for detecting active bleeding and providing real-time surgical support. This study aimed to develop a real-time AI model to detect active intraoperative bleeding.

METHODS

We extracted 27 surgical videos from a nationwide multi-institutional surgical video database in Japan and divided them at the patient level into three sets: training (n = 21), validation (n = 3), and testing (n = 3). We subsequently extracted the bleeding scenes and labeled distinctively active bleeding and blood pooling frame by frame. We used pre-trained YOLOv7_6w and developed a model to learn both active bleeding and blood pooling. The Average Precision at an Intersection over Union threshold of 0.5 (AP.50) for active bleeding and frames per second (FPS) were quantified. In addition, we conducted two 5-point Likert scales (5 = Excellent, 4 = Good, 3 = Fair, 2 = Poor, and 1 = Fail) questionnaires about sensitivity (the sensitivity score) and number of overdetection areas (the overdetection score) to investigate the surgeons' assessment.

RESULTS

We annotated 34,117 images of 254 bleeding events. The AP.50 for active bleeding in the developed model was 0.574 and the FPS was 48.5. Twenty surgeons answered two questionnaires, indicating a sensitivity score of 4.92 and an overdetection score of 4.62 for the model.

CONCLUSIONS

We developed an AI model to detect active bleeding, achieving real-time processing speed. Our AI model can be used to provide real-time surgical support.

Application of artificial intelligence in endoscopic gastrointestinal tumors

With an increasing number of patients with gastrointestinal cancer, effective and accurate early diagnostic clinical tools are required provide better health care for patients with gastrointestinal cancer. Recent studies have shown that artificial intelligence (AI) plays an important role in the diagnosis and treatment of patients with gastrointestinal tumors, which not only improves the efficiency of early tumor screening, but also significantly improves the survival rate of patients after treatment. With the aid of efficient learning and judgment abilities of AI, endoscopists can improve the accuracy of diagnosis and treatment through endoscopy and avoid incorrect descriptions or judgments of gastrointestinal lesions. The present article provides an overview of the application status of various artificial intelligence in gastric and colorectal cancers in recent years, and the direction of future research and clinical practice is clarified from a clinical perspective to provide a comprehensive theoretical basis for AI as a promising diagnostic and therapeutic tool for gastrointestinal cancer.

Artificial intelligence in endoscopy: Overview, applications, and future directions

Since the emergence of artificial intelligence (AI) in medicine, endoscopy applications in gastroenterology have been at the forefront of innovations. The ever-increasing number of studies necessitates the need to organize and classify applications in a useful way. Separating AI capabilities by computer aided detection (CADe), diagnosis (CADx), and quality assessment (CADq) allows for a systematic evaluation of each application. CADe studies have shown promise in accurate detection of esophageal, gastric and colonic neoplasia as well as identifying sources of bleeding and Crohn's disease in the small bowel. While more advanced CADx applications employ optical biopsies to give further information to characterize neoplasia and grade inflammatory disease, diverse CADq applications ensure quality and increase the efficiency of procedures. Future applications show promise in advanced therapeutic modalities and integrated systems that provide multimodal capabilities. AI is set to revolutionize clinical decision making and performance of endoscopy.

Artificial intelligence in gastroenterology: A narrative review

Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.

Current Status of Artificial Intelligence-Based Computer-Assisted Diagnosis Systems for Gastric Cancer in Endoscopy

Artificial intelligence (AI) is gradually being utilized in various fields as its performance has been improving with the development of deep learning methods, availability of big data, and the progression of computer processing units. In the field of medicine, AI is mainly implemented in image recognition, such as in radiographic and pathologic diagnoses. In the realm of gastrointestinal endoscopy, although AI-based computer-assisted detection/diagnosis (CAD) systems have been applied in some areas, such as colorectal polyp detection and diagnosis, so far, their implementation in real-world clinical settings is limited. The accurate detection or diagnosis of gastric cancer (GC) is one of the challenges in which performance varies greatly depending on the endoscopist's skill. The diagnosis of early GC is especially challenging, partly because early GC mimics atrophic gastritis in the background mucosa. Therefore, several CAD systems for GC are being actively developed. The development of a CAD system for GC is considered challenging because it requires a large number of GC images. In particular, early stage GC images are rarely available, partly because it is difficult to diagnose gastric cancer during the early stages. Additionally, the training image data should be of a sufficiently high quality to conduct proper CAD training. Recently, several AI systems for GC that exhibit a robust performance, owing to being trained on a large number of high-quality images, have been reported. This review outlines the current status and prospects of AI use in esophagogastroduodenoscopy (EGDS), focusing on the diagnosis of GC.

An Optimal Artificial Intelligence System for Real-Time Endoscopic Prediction of Invasion Depth in Early Gastric Cancer

We previously constructed a VGG-16 based artificial intelligence (AI) model (image classifier [IC]) to predict the invasion depth in early gastric cancer (EGC) using endoscopic static images. However, images cannot capture the spatio-temporal information available during real-time endoscopy-the AI trained on static images could not estimate invasion depth accurately and reliably. Thus, we constructed a video classifier [VC] using videos for real-time depth prediction in EGC. We built a VC by attaching sequential layers to the last convolutional layer of IC v2, using video clips. We computed the standard deviation (SD) of output probabilities for a video clip and the sensitivities in the manner of frame units to observe consistency. The sensitivity, specificity, and accuracy of IC v2 for static images were 82.5%, 82.9%, and 82.7%, respectively. However, for video clips, the sensitivity, specificity, and accuracy of IC v2 were 33.6%, 85.5%, and 56.6%, respectively. The VC performed better analysis of the videos, with a sensitivity of 82.3%, a specificity of 85.8%, and an accuracy of 83.7%. Furthermore, the mean SD was lower for the VC than IC v2 (0.096 vs. 0.289). The AI model developed utilizing videos can predict invasion depth in EGC more precisely and consistently than image-trained models, and is more appropriate for real-world situations.

Diagnostic accuracy of artificial intelligence for detecting gastrointestinal luminal pathologies: A systematic review and meta-analysis

Background

Artificial Intelligence (AI) holds considerable promise for diagnostics in the field of gastroenterology. This systematic review and meta-analysis aims to assess the diagnostic accuracy of AI models compared with the gold standard of experts and histopathology for the diagnosis of various gastrointestinal (GI) luminal pathologies including polyps, neoplasms, and inflammatory bowel disease.

Methods

We searched PubMed, CINAHL, Wiley Cochrane Library, and Web of Science electronic databases to identify studies assessing the diagnostic performance of AI models for GI luminal pathologies. We extracted binary diagnostic accuracy data and constructed contingency tables to derive the outcomes of interest: sensitivity and specificity. We performed a meta-analysis and hierarchical summary receiver operating characteristic curves (HSROC). The risk of bias was assessed using Quality Assessment for Diagnostic Accuracy Studies-2 (QUADAS-2) tool. Subgroup analyses were conducted based on the type of GI luminal disease, AI model, reference standard, and type of data used for analysis. This study is registered with PROSPERO (CRD42021288360).

Findings

We included 73 studies, of which 31 were externally validated and provided sufficient information for inclusion in the meta-analysis. The overall sensitivity of AI for detecting GI luminal pathologies was 91.9% (95% CI: 89.0–94.1) and specificity was 91.7% (95% CI: 87.4–94.7). Deep learning models (sensitivity: 89.8%, specificity: 91.9%) and ensemble methods (sensitivity: 95.4%, specificity: 90.9%) were the most commonly used models in the included studies. Majority of studies (n = 56, 76.7%) had a high risk of selection bias while 74% (n = 54) studies were low risk on reference standard and 67% (n = 49) were low risk for flow and timing bias.

Interpretation

The review suggests high sensitivity and specificity of AI models for the detection of GI luminal pathologies. There is a need for large, multi-center trials in both high income countries and low- and middle- income countries to assess the performance of these AI models in real clinical settings and its impact on diagnosis and prognosis.

Systematic review registration

[https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=288360], identifier [CRD42021288360].

Artificial intelligence in gastrointestinal endoscopy - Evolution to a new era

Artificial intelligence (AI) systems based on machine learning have evolved in the last few years with an increasing applicability in gastrointestinal endoscopy. Thanks to AI, an image (input) can be transformed into a clinical decision (output). Although AI systems have been initially studied to improve detection (CADe) and characterization of colorectal lesions (CADx), other indications are being currently investigated as detection of blind spots, scope guidance, or delineation/measurement of lesions. The objective of these review is to summarize the current evidence on applicability of AI systems in gastrointestinal endoscopy, highlight strengths and limitations of the technology and review regulatory and ethical aspects for its general implementation in gastrointestinal endoscopy.

Artificial Intelligence-Assisted Endoscopic Diagnosis of Early Upper Gastrointestinal Cancer: A Systematic Review and Meta-Analysis

Objective

The aim of this study was to assess the diagnostic ability of artificial intelligence (AI) in the detection of early upper gastrointestinal cancer (EUGIC) using endoscopic images.

Methods

Databases were searched for studies on AI-assisted diagnosis of EUGIC using endoscopic images. The pooled area under the curve (AUC), sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and diagnostic odds ratio (DOR) with 95% confidence interval (CI) were calculated.

Results

Overall, 34 studies were included in our final analysis. Among the 17 image-based studies investigating early esophageal cancer (EEC) detection, the pooled AUC, sensitivity, specificity, PLR, NLR, and DOR were 0.98, 0.95 (95% CI, 0.95–0.96), 0.95 (95% CI, 0.94–0.95), 10.76 (95% CI, 7.33–15.79), 0.07 (95% CI, 0.04–0.11), and 173.93 (95% CI, 81.79–369.83), respectively. Among the seven patient-based studies investigating EEC detection, the pooled AUC, sensitivity, specificity, PLR, NLR, and DOR were 0.98, 0.94 (95% CI, 0.91–0.96), 0.90 (95% CI, 0.88–0.92), 6.14 (95% CI, 2.06–18.30), 0.07 (95% CI, 0.04–0.11), and 69.13 (95% CI, 14.73–324.45), respectively. Among the 15 image-based studies investigating early gastric cancer (EGC) detection, the pooled AUC, sensitivity, specificity, PLR, NLR, and DOR were 0.94, 0.87 (95% CI, 0.87–0.88), 0.88 (95% CI, 0.87–0.88), 7.20 (95% CI, 4.32–12.00), 0.14 (95% CI, 0.09–0.23), and 48.77 (95% CI, 24.98–95.19), respectively.

Conclusions

On the basis of our meta-analysis, AI exhibited high accuracy in diagnosis of EUGIC.

Systematic Review Registration

https://www.crd.york.ac.uk/PROSPERO/, identifier PROSPERO (CRD42021270443).

Artificial intelligence: Emerging player in the diagnosis and treatment of digestive disease

Given the breakthroughs in key technologies, such as image recognition, deep learning and neural networks, artificial intelligence (AI) continues to be increasingly developed, leading to closer and deeper integration with an increasingly data-, knowledge- and brain labor-intensive medical industry. As society continues to advance and individuals become more aware of their health needs, the problems associated with the aging of the population are receiving increasing attention, and there is an urgent demand for improving medical technology, prolonging human life and enhancing health. Digestive system diseases are the most common clinical diseases and are characterized by complex clinical manifestations and a general lack of obvious symptoms in the early stage. Such diseases are very difficult to diagnose and treat. In recent years, the incidence of diseases of the digestive system has increased. As AI applications in the field of health care continue to be developed, AI has begun playing an important role in the diagnosis and treatment of diseases of the digestive system. In this paper, the application of AI in assisted diagnosis and the application and prospects of AI in malignant and benign digestive system diseases are reviewed.

Artificial Intelligence in Endoscopy

Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.

Usefulness of artificial intelligence in early gastric cancer

Gastric cancer (GC) is a major cancer worldwide, with high mortality and morbidity. Endoscopy, important for the early detection of GC, requires trained skills, high-quality technologies, surveillance and screening programs. Early diagnosis allows a better prognosis, through surgical or curative endoscopic therapy. Magnified endoscopy with virtual chromoendoscopy remarkably improve the detection of early gastric cancer (EGC) when endoscopy is performed by expert endoscopists. Artificial intelligence (AI) has also been introduced to GC diagnostics to increase diagnostic efficiency. AI improves the early detection of gastric lesions because it supports the non-expert and experienced endoscopist in defining the margins of the tumor and the depth of infiltration. AI increases the detection rate of EGC, reduces the rate of missing tumors, and characterizes EGCs, allowing clinicians to make the best therapeutic decision, that is, one that ensures curability. AI has had a remarkable evolution in medicine in recent years, moving from the research phase to clinical practice. In addition, the diagnosis of GC has markedly progressed. We predict that AI will allow great evolution in the diagnosis and treatment of EGC by overcoming the variability in performance that is currently a limitation of chromoendoscopy.

Development of a Convolutional Neural Network-Based Colonoscopy Image Assessment Model for Differentiating Crohn’s Disease and Ulcerative Colitis

Objective

Evaluation of the endoscopic features of Crohn’s disease (CD) and ulcerative colitis (UC) is the key diagnostic approach in distinguishing these two diseases. However, making diagnostic differentiation of endoscopic images requires precise interpretation by experienced clinicians, which remains a challenge to date. Therefore, this study aimed to establish a convolutional neural network (CNN)-based model to facilitate the diagnostic classification among CD, UC, and healthy controls based on colonoscopy images.

Methods

A total of 15,330 eligible colonoscopy images from 217 CD patients, 279 UC patients, and 100 healthy subjects recorded in the endoscopic database of Tongji Hospital were retrospectively collected. After selecting the ResNeXt-101 network, it was trained to classify endoscopic images either as CD, UC, or normal. We assessed its performance by comparing the per-image and per-patient parameters of the classification task with that of the six clinicians of different seniority.

Results

In per-image analysis, ResNeXt-101 achieved an overall accuracy of 92.04% for the three-category classification task, which was higher than that of the six clinicians (90.67, 78.33, 86.08, 73.66, 58.30, and 86.21%, respectively). ResNeXt-101 also showed higher differential diagnosis accuracy compared with the best performing clinician (CD 92.39 vs. 91.70%; UC 93.35 vs. 92.39%; normal 98.35 vs. 97.26%). In per-patient analysis, the overall accuracy of the CNN model was 90.91%, compared with 93.94, 78.79, 83.33, 59.09, 56.06, and 90.91% of the clinicians, respectively.

Conclusion

The ResNeXt-101 model, established in our study, performed superior to most clinicians in classifying the colonoscopy images as CD, UC, or healthy subjects, suggesting its potential applications in clinical settings.

Diagnostic accuracy of convolutional neural network-based endoscopic image analysis in diagnosing gastric cancer and predicting its invasion depth: a systematic review and meta-analysis

BACKGROUND AND AIMS

This study aimed to evaluate the accuracy and effectiveness of the convolutional neural network (CNN) in diagnosing gastric cancer and predicting the invasion depth of gastric cancer and to compare the performance of the CNN with that of endoscopists.

METHODS

PubMed, Embase, Web of Science, and gray literature were searched until July 23, 2021 for studies that assessed the diagnostic accuracy of CNN-assisted examinations for gastric cancer or the invasion depth of gastric cancer. Studies meeting inclusion criteria were included in the systematic review and meta-analysis.

RESULTS

Seventeen studies comprising 51,446 images and 174 videos of 5539 patients were included. The pooled sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR-), and area under the curve (AUC) of the CNN for diagnosing gastric cancer were 89% (95% confidence interval [CI], 85-93), 93% (95% CI, 88-97), 13.4 (95% CI, 7.3-25.5), .11 (95% CI, .07-.17), and .94 (95% CI, .91-.98), respectively. The performance of the CNN in diagnosing gastric cancer was not significantly different from that of expert endoscopists (.95 vs .90, P > .05) and was better than that of overall endoscopists (experts and nonexperts) (.95 vs .87, P < .05). The pooled sensitivity, specificity, LR+, LR-, and AUC of the CNN for predicting the invasion depth of gastric cancer were 82% (95% CI, 78-85), 90% (95% CI, 82-95), 8.4 (95% CI, 4.2-16.8), .20 (95% CI, .16-.26), and .90 (95% CI, .87-.93), respectively.

CONCLUSIONS

The CNN is highly accurate in diagnosing gastric cancer and predicting the invasion depth of gastric cancer. The performance of the CNN in diagnosing gastric cancer is not significantly different from that of expert endoscopists. Studies of the real-time performance of the CNN for gastric cancer diagnosis are needed to confirm these findings.

Development and evaluation of a double-check support system using artificial intelligence in endoscopic screening for gastric cancer

BACKGROUND

This study aimed to prevent missing gastric cancer and point out low-quality images by developing a double-check support system (DCSS) for esophagogastroduodenoscopy (EGD) still images using artificial intelligence.

METHODS

We extracted 12,977 still EGD images from 855 cases with cancer [821 with early gastric carcinoma (EGC) and 34 malignant lymphoma (ML)] and developed a lesion detection system using 10,994 images. The remaining images were used as a test dataset. Additional validation was performed using a new dataset containing 50 EGC and 1,200 non-GC images by comparing the interpretation of ten endoscopists (five trainees and five experts). Furthermore, we developed another system to detect low-quality images, which are not suitable for diagnosis, using 2198 images.

RESULTS

In the validation of 1983 images from the 124 cancer cases, the DCSS diagnosed cancer with a sensitivity of 89.2%, positive predictive value (PPV) of 93.3%, and an accuracy of 83.3%. EGC was detected in 93.2% and ML in 92.5% of cases. Comparing with the endoscopists, sensitivity was significantly higher in the DCSS, and the average diagnostic time was significantly shorter using the DCSS than that by the trainees. The sensitivity, specificity, PPV, and accuracy in detecting low-quality images were 65.8%, 93.1%, 79.6%, and 85.2% for "Blur" and 57.8%, 91.7%, 82.2%, and 78.1% for "Mucus adhesion," respectively.

CONCLUSIONS

The DCSS showed excellent capability in detecting lesions and pointing out low-quality images.

Current advancements in application of artificial intelligence in clinical decision-making by gastroenterologists in gastrointestinal bleeding

Artificial Intelligence (AI) is a type of intelligence that comes from machines or computer systems that mimics human cognitive function. Recently, AI has been utilized in medicine and helped clinicians make clinical decisions. In gastroenterology, AI has assisted colon polyp detection, optical biopsy, and diagnosis of Helicobacter pylori infection. AI also has a broad role in the clinical prediction and management of gastrointestinal bleeding. Machine learning can determine the clinical risk of upper and lower gastrointestinal bleeding. AI can assist the management of gastrointestinal bleeding by identifying high-risk patients who might need urgent endoscopic treatment or blood transfusion, determining bleeding stigmata during endoscopy, and predicting recurrence of gastrointestinal bleeding. The present review will discuss the role of AI in the clinical prediction and management of gastrointestinal bleeding, primarily on how it could assist gastroenterologists in their clinical decision-making compared to conventional methods. This review will also discuss challenges in implementing AI in routine practice.

Construction and Multicenter Diagnostic Verification of Intelligent Recognition System for Endoscopic Images From Early Gastric Cancer Based on YOLO-V3 Algorithm

Introduction

Endoscopy is an important tool for the diagnosis of early gastric cancer. Therefore, a combination of artificial intelligence and endoscopy has the ability to increase the speed and efficiency of early gastric cancer diagnosis. YOU ONLY LOOK ONCE (YOLO) is an advanced object detection depth neural network algorithm that has not been widely used in gastrointestinal image recognition.

Objective

We developed an artificial intelligence system herein referred to as “EGC-YOLO” for the rapid and accurate diagnosis of endoscopic images from early gastric cancer.

Methods

More than 40000 gastroscopic images from 1653 patients in Yixing people’s Hospital were used as the training set for the system, while endoscopic images from the other two hospitals were used as external validation test sets. The sensitivity, specificity, positive predictive value, Youden index and ROC curve were analyzed to evaluate detection efficiencies for EGC-YOLO.

Results

EGC-YOLO was able to diagnose early gastric cancer in the two test sets with a high superiority and efficiency. The accuracy, sensitivity, specificity and positive predictive value for Test Sets 1 and 2 were 85.15% and 86.02%, 85.36% and 83.02%, 84.41% and 92.21%, and 95.22% and 95.65%, respectively. In Test Sets 1 and 2, the corresponding Threshold-values were 0.02, 0.16 and 0.17 at the maximum of the Youden index. An increase in Threshold-values was associated with a downward trend in sensitivity and accuracy, while specificity remained relatively stable at more than 80%.

Conclusions

The EGC-YOLO system is superior for the efficient, accurate and rapid detection of early gastric cancer lesions. For different data sets, it is important to select the appropriate threshold-value in advance to achieve the best performance of the EGC-YOLO system.

Application Status and Prospects of Artificial Intelligence in Peptic Ulcers

Peptic ulcer (PU) is a common and frequently occurring disease. Although PU seriously threatens the lives and health of global residents, the applications of artificial intelligence (AI) have strongly promoted diversification and modernization in the diagnosis and treatment of PU. This minireview elaborates on the research progress of AI in the field of PU, from PU's pathogenic factor Helicobacter pylori (Hp) infection, diagnosis and differential diagnosis, to its management and complications (bleeding, obstruction, perforation and canceration). Finally, the challenges and prospects of AI application in PU are prospected and expounded. With the in-depth understanding of modern medical technology, AI remains a promising option in the management of PU patients and plays a more indispensable role. How to realize the robustness, versatility and diversity of multifunctional AI systems in PU and conduct multicenter prospective clinical research as soon as possible are the top priorities in the future.

Artificial intelligence for detecting superficial esophageal squamous cell carcinoma under multiple endoscopic imaging modalities: A multicenter study

BACKGROUND AND AIM

Diagnosis of esophageal squamous cell carcinoma (ESCC) is complicated and requires substantial expertise and experience. This study aimed to develop an artificial intelligence (AI) system for detecting superficial ESCC under multiple endoscopic imaging modalities.

METHODS

Endoscopic images were retrospectively collected from West China Hospital, Sichuan University as a training dataset and an independent internal validation dataset. Images from other four hospitals were used as an external validation dataset. The AI system was compared with 11 experienced endoscopists. Furthermore, videos were collected to assess the performance of the AI system.

RESULTS

A total of 53 933 images from 2621 patients and 142 videos from 19 patients were used to develop and validate the AI system. In the internal and external validation datasets, the performance of the AI system under all or different endoscopic imaging modalities was satisfactory, with sensitivity of 92.5-99.7%, specificity of 78.5-89.0%, and area under the receiver operating characteristic curves of 0.906-0.989. The AI system achieved comparable performance with experienced endoscopists. Regarding superficial ESCC confined to the epithelium, the AI system was more sensitive than experienced endoscopists on white-light imaging (90.8% vs 82.5%, P = 0.022). Moreover, the AI system exhibited good performance in videos, with sensitivity of 89.5-100% and specificity of 73.7-89.5%.

CONCLUSIONS

We developed an AI system that showed comparable performance with experienced endoscopists in detecting superficial ESCC under multiple endoscopic imaging modalities and might provide valuable support for inexperienced endoscopists, despite requiring further evaluation.

Artificial intelligence in gastroenterology: A state-of-the-art review

The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.

Early gastrointestinal cancer: The application of artificial intelligence

Early gastrointestinal (GI) cancer has been the core of clinical endoscopic work. Its early detection and treatment are tightly associated with patients’ prognoses. As a novel technology, artificial intelligence has been improved and applied in the field of endoscopy. Studies on detection, diagnosis, risk, and prognosis evaluation of diseases in the GI tract have been in development, including precancerous lesions, adenoma, early GI cancers, and advanced GI cancers. In this review, research on esophagus, stomach, and colon was concluded, and associated with the process from precancerous lesions to early GI cancer, such as from Barrett’s esophagus to early esophageal cancer, from dysplasia to early gastric cancer, and from adenoma to early colonic cancer. A status quo of research on early GI cancers and artificial intelligence was provided.

Application of artificial intelligence in gastrointestinal disease: a narrative review

Objective

We collected evidence on the application of artificial intelligence (AI) in gastroenterology field. The review was carried out from two aspects of endoscopic types and gastrointestinal diseases, and briefly summarized the challenges and future directions in this field.

Background

Due to the advancement of computational power and a surge of available data, a solid foundation has been laid for the growth of AI. Specifically, varied machine learning (ML) techniques have been emerging in endoscopic image analysis. To improve the accuracy and efficiency of clinicians, AI has been widely applied to gastrointestinal endoscopy.

Methods

PubMed electronic database was searched using the keywords containing “AI”, “ML”, “deep learning (DL)”, “convolution neural network”, “endoscopy (such as white light endoscopy (WLE), narrow band imaging (NBI) endoscopy, magnifying endoscopy with narrow band imaging (ME-NBI), chromoendoscopy, endocytoscopy (EC), and capsule endoscopy (CE))”. Search results were assessed for relevance and then used for detailed discussion.

Conclusions

This review described the basic knowledge of AI, ML, and DL, and summarizes the application of AI in various endoscopes and gastrointestinal diseases. Finally, the challenges and directions of AI in clinical application were discussed. At present, the application of AI has solved some clinical problems, but more still needs to be done.

Current Status and Future Perspective of Artificial Intelligence in the Management of Peptic Ulcer Bleeding: A Review of Recent Literature

With the decreasing incidence of peptic ulcer bleeding (PUB) over the past two decades, the clinician experience of managing patients with PUB has also declined, especially for young endoscopists. A patient with PUB management requires collaborative care involving the emergency department, gastroenterologist, radiologist, and surgeon, from initial assessment to hospital discharge. The application of artificial intelligence (AI) methods has remarkably improved people's lives. In particular, AI systems have shown great potential in many areas of gastroenterology to increase human performance. Colonoscopy polyp detection or diagnosis by an AI system was recently introduced for commercial use to improve endoscopist performance. Although PUB is a longstanding health problem, these newly introduced AI technologies may soon impact endoscopists' clinical practice by improving the quality of care for these patients. To update the current status of AI application in PUB, we reviewed recent relevant literature and provided future perspectives that are required to integrate such AI tools into real-world practice.

Application of artificial intelligence-driven endoscopic screening and diagnosis of gastric cancer

The landscape of gastrointestinal endoscopy continues to evolve as new technologies and techniques become available. The advent of image-enhanced and magnifying endoscopies has highlighted the step toward perfecting endoscopic screening and diagnosis of gastric lesions. Simultaneously, with the development of convolutional neural network, artificial intelligence (AI) has made unprecedented breakthroughs in medical imaging, including the ongoing trials of computer-aided detection of colorectal polyps and gastrointestinal bleeding. In the past demi-decade, applications of AI systems in gastric cancer have also emerged. With AI’s efficient computational power and learning capacities, endoscopists can improve their diagnostic accuracies and avoid the missing or mischaracterization of gastric neoplastic changes. So far, several AI systems that incorporated both traditional and novel endoscopy technologies have been developed for various purposes, with most systems achieving an accuracy of more than 80%. However, their feasibility, effectiveness, and safety in clinical practice remain to be seen as there have been no clinical trials yet. Nonetheless, AI-assisted endoscopies shed light on more accurate and sensitive ways for early detection, treatment guidance and prognosis prediction of gastric lesions. This review summarizes the current status of various AI applications in gastric cancer and pinpoints directions for future research and clinical practice implementation from a clinical perspective.

Performance Comparison of the Deep Learning and the Human Endoscopist for Bleeding Peptic Ulcer Disease

Purpose

Management of peptic ulcer bleeding is clinically challenging. Accurate characterization of the bleeding during endoscopy is key for endoscopic therapy. This study aimed to assess whether a deep learning model can aid in the classification of bleeding peptic ulcer disease.

Methods

Endoscopic still images of patients (n = 1694) with peptic ulcer bleeding for the last 5 years were retrieved and reviewed. Overall, 2289 images were collected for deep learning model training, and 449 images were validated for the performance test. Two expert endoscopists classified the images into different classes based on their appearance. Four deep learning models, including Mobile Net V2, VGG16, Inception V4, and ResNet50, were proposed and pre-trained by ImageNet with the established convolutional neural network algorithm. A comparison of the endoscopists and trained deep learning model was performed to evaluate the model’s performance on a dataset of 449 testing images.

Results

The results first presented the performance comparisons of four deep learning models. The Mobile Net V2 presented the optimal performance of the proposal models. The Mobile Net V2 was chosen for further comparing the performance with the diagnostic results obtained by one senior and one novice endoscopists. The sensitivity and specificity were acceptable for the prediction of “normal” lesions in both 3-class and 4-class classifications. For the 3-class category, the sensitivity and specificity were 94.83% and 92.36%, respectively. For the 4-class category, the sensitivity and specificity were 95.40% and 92.70%, respectively. The interobserver agreement of the testing dataset of the model was moderate to substantial with the senior endoscopist. The accuracy of the determination of endoscopic therapy required and high-risk endoscopic therapy of the deep learning model was higher than that of the novice endoscopist.

Conclusions

In this study, the deep learning model performed better than inexperienced endoscopists. Further improvement of the model may aid in clinical decision-making during clinical practice, especially for trainee endoscopist.

Application of artificial intelligence to endoscopy on common gastrointestinal benign diseases

Artificial intelligence (AI) has been widely involved in every aspect of healthcare in the preclinical stage. In the digestive system, AI has been trained to assist auxiliary examinations including histopathology, endoscopy, ultrasonography, computerized tomography, and magnetic resonance imaging in detection, diagnosis, classification, differentiation, prognosis, and quality control. In the field of endoscopy, the application of AI, such as automatic detection, diagnosis, classification, and invasion depth, in early gastrointestinal (GI) cancers has received wide attention. There is a paucity of studies of AI application on common GI benign diseases based on endoscopy. In the review, we provide an overview of AI applications to endoscopy on common GI benign diseases including in the esophagus, stomach, intestine, and colon. It indicates that AI will gradually become an indispensable part of normal endoscopic detection and diagnosis of common GI benign diseases as clinical data, algorithms, and other related work are constantly repeated and improved.

Current status and future perspective of artificial intelligence applications in endoscopic diagnosis and management of gastric cancer

Image recognition using artificial intelligence (AI) has progressed significantly due to innovative technologies such as machine learning and deep learning. In the field of gastric cancer (GC) management, research on AI-based diagnosis such as anatomical classification of endoscopic images, diagnosis of Helicobacter pylori infection, and detection and qualitative diagnosis of GC is being conducted, and an accuracy equivalent to that of physicians has been reported. It is expected that AI will soon be introduced in the field of endoscopic diagnosis and management of gastric cancer as a supportive tool for physicians, thus improving the quality of medical care.

Artificial intelligence for cancer detection of the upper gastrointestinal tract

In recent years, artificial intelligence (AI) has been found to be useful to physicians in the field of image recognition due to three elements: deep learning (that is, CNN, convolutional neural network), a high-performance computer, and a large amount of digitized data. In the field of gastrointestinal endoscopy, Japanese endoscopists have produced the world's first achievements of CNN-based AI system for detecting gastric and esophageal cancers. This study reviews papers on CNN-based AI for gastrointestinal cancers, and discusses the future of this technology in clinical practice. Employing AI-based endoscopes would enable early cancer detection. The better diagnostic abilities of AI technology may be beneficial in early gastrointestinal cancers in which endoscopists have variable diagnostic abilities and accuracy. AI coupled with the expertise of endoscopists would increase the accuracy of endoscopic diagnosis.

Artificial intelligence and its impact on quality improvement in upper and lower gastrointestinal endoscopy

Artificial intelligence (AI) and its application in medicine has grown large interest. Within gastrointestinal (GI) endoscopy, the field of colonoscopy and polyp detection is the most investigated, however, upper GI follows the lead. Since endoscopy is performed by humans, it is inherently an imperfect procedure. Computer-aided diagnosis may improve its quality by helping prevent missing lesions and supporting optical diagnosis for those detected. An entire evolution in AI systems has been established in the last decades, resulting in optimization of the diagnostic performance with lower variability and matching or even outperformance of expert endoscopists. This shows a great potential for future quality improvement of endoscopy, given the outstanding diagnostic features of AI. With this narrative review, we highlight the potential benefit of AI to improve overall quality in daily endoscopy and describe the most recent developments for characterization and diagnosis as well as the recent conditions for regulatory approval.

Striving for quality improvement: can artificial intelligence help?

Artificial intelligence (AI) is of keen interest for global health development as potential support for current human shortcomings. Gastrointestinal (GI) endoscopy is an excellent substrate for AI, since it holds the genuine potential to improve quality in GI endoscopy and overall patient care by improving detection and diagnosis guiding the endoscopists in performing endoscopy to the highest quality standards. The possibility of large data acquisitioning to refine algorithms makes implementation of AI into daily practice a potential reality. With the start of a new era adopting deep learning, large amounts of data can easily be processed, resulting in better diagnostic performances. In the upper gastrointestinal tract, research currently focusses on the detection and characterization of neoplasia, including Barrett's, squamous cell and gastric carcinoma, with an increasing amount of AI studies demonstrating the potential and benefit of AI-augmented endoscopy. Deep learning applied to small bowel video capsule endoscopy also appears to enhance pathology detection and reduce capsule reading time. In the colon, multiple prospective trials including five randomized trials, showed a consistent improvement in polyp and adenoma detection rates, one of the main quality indicators in endoscopy. There are however potential additional roles for AI to assist in quality improvement of endoscopic procedures, training and therapeutic decision making. Further large-scale, multicenter validation trials are required before AI-augmented diagnostic gastrointestinal endoscopy can be integrated into our routine clinical practice.

Techniques to integrate artificial intelligence systems with medical information in gastroenterology

Gastrointestinal (GI) endoscopy is the central element in contemporary gastroenterology as it provides direct evidence to guide targeted therapy. To increase the accuracy of GI endoscopy and to reduce human-related errors, artificial intelligence (AI) has been applied in GI endoscopy, which has been proved to be effective in diagnosing and treating numerous diseases. Therefore, we review current research on the efficacy of AI-assisted GI endoscopy in order to assess its functions, advantages and how the design can be improved.

Application of artificial intelligence in hepatology: Minireview

With the rapid advancements in computer science, artificial intelligence (AI) has become an intrinsic part of our daily life and clinical practices. The concepts of AI, such as machine learning, deep learning, and big data, are extensively used in clinical and basic research. In this review, we searched for the articles in PubMed and summarized recent developments of AI concerning hepatology while focusing on the diagnosis and risk assessment of liver diseases. Ultrasound is widely conducted for the routine surveillance of hepatocellular carcinoma along with tumor markers. Computer-aided diagnosis is useful in the detection of tumors and characterization of space-occupying lesions. The prognosis of hepatocellular carcinoma can be estimated via AI using large-scale and high-quality training datasets. The prevalence of nonalcoholic fatty liver disease is increasing worldwide and pivotal concern in the field is who will progress and develop hepatocellular carcinoma. Most AI studies require a large dataset, including laboratory or radiological findings and outcome data. AI will be useful in reducing medical errors, supporting clinical decisions, and predicting clinical outcomes. Thus, cooperation between AI and humans is expected to improve healthcare.