Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging

Advances in optical gastrointestinal endoscopy: a technical review

Optical endoscopy is the primary diagnostic and therapeutic tool for management of gastrointestinal (GI) malignancies. Most GI neoplasms arise from precancerous lesions; thus, technical innovations to improve detection and diagnosis of precancerous lesions and early cancers play a pivotal role in improving outcomes. Over the last few decades, the field of GI endoscopy has witnessed enormous and focused efforts to develop and translate accurate, user-friendly, and minimally invasive optical imaging modalities. From a technical point of view, a wide range of novel optical techniques is now available to probe different aspects of light-tissue interaction at macroscopic and microscopic scales, complementing white light endoscopy. Most of these new modalities have been successfully validated and translated to routine clinical practice. Herein, we provide a technical review of the current status of existing and promising new optical endoscopic imaging technologies for GI cancer screening and surveillance. We summarize the underlying principles of light-tissue interaction, the imaging performance at different scales, and highlight what is known about clinical applicability and effectiveness. Furthermore, we discuss recent discovery and translation of novel molecular probes that have shown promise to augment endoscopists' ability to diagnose GI lesions with high specificity. We also review and discuss the role and potential clinical integration of artificial intelligence-based algorithms to provide decision support in real time. Finally, we provide perspectives on future technology development and its potential to transform endoscopic GI cancer detection and diagnosis.

A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology

Artificial intelligence (AI) is rapidly becoming an essential tool in the medical field as well as in daily life. Recent developments in deep learning, a subfield of AI, have brought remarkable advances in image recognition, which facilitates improvement in the early detection of cancer by endoscopy, ultrasonography, and computed tomography. In addition, AI-assisted big data analysis represents a great step forward for precision medicine. This review provides an overview of AI technology, particularly for gastroenterology, hepatology, and pancreatology, to help clinicians utilize AI in the near future.

Endoscopic diagnosis and treatment of gastric dysplasia and early cancer: Current evidence and what the future may hold

Gastric cancer accounts for a significant proportion of worldwide cancer-related morbidity and mortality. The well documented precancerous cascade provides an opportunity for clinicians to detect and treat gastric cancers at an endoscopically curable stage. In high prevalence regions such as Japan and Korea, this has led to the implementation of population screening programs. However, guidelines remain ambiguous in lower prevalence regions. In recent years, there have been many advances in the endoscopic diagnosis and treatment of early gastric cancer and precancerous lesions. More advanced endoscopic imaging has led to improved detection and characterization of gastric lesions as well as superior accuracy for delineation of margins prior to resection. In addition, promising early data on artificial intelligence in gastroscopy suggests a future role for this technology in maximizing the yield of advanced endoscopic imaging. Data on endoscopic resection (ER) are particularly robust in Japan and Korea, with high rates of curative ER and markedly reduced procedural morbidity. However, there is a shortage of data in other regions to support the applicability of protocols from these high prevalence countries. Future advances in endoscopic therapeutics will likely lead to further expansion of the current indications for ER, as both technology and proceduralist expertise continue to grow.

Use of Artificial Intelligence to Improve the Quality Control of Gastrointestinal Endoscopy

With the rapid development of science and technology, artificial intelligence (AI) systems are becoming ubiquitous, and their utility in gastroenteroscopy is beginning to be recognized. Digestive endoscopy is a conventional and reliable method of examining and diagnosing digestive tract diseases. However, with the increase in the number and types of endoscopy, problems such as a lack of skilled endoscopists and difference in the professional skill of doctors with different degrees of experience have become increasingly apparent. Most studies thus far have focused on using computers to detect and diagnose lesions, but improving the quality of endoscopic examination process itself is the basis for improving the detection rate and correctly diagnosing diseases. In the present study, we mainly reviewed the role of AI in monitoring systems, mainly through the endoscopic examination time, reducing the blind spot rate, improving the success rate for detecting high-risk lesions, evaluating intestinal preparation, increasing the detection rate of polyps, automatically collecting maps and writing reports. AI can even perform quality control evaluations for endoscopists, improve the detection rate of endoscopic lesions and reduce the burden on endoscopists.

Artificial Intelligence in Upper Gastrointestinal Endoscopy

BACKGROUND

Over the past decade, several artificial intelligence (AI) systems are developed to assist in endoscopic assessment of (pre-)cancerous lesions of the gastrointestinal (GI) tract. In this review, we aimed to provide an overview of the possible indications of AI technology in upper GI endoscopy and hypothesize about potential challenges for its use in clinical practice.

SUMMARY

Application of AI in upper GI endoscopy has been investigated for several indications: (1) detection, characterization, and delineation of esophageal and gastric cancer (GC) and their premalignant conditions; (2) prediction of tumor invasion; and (3) detection of Helicobacter pylori. AI systems show promising results with an accuracy of up to 99% for the detection of superficial and advanced upper GI cancers. AI outperformed trainee and experienced endoscopists for the detection of esophageal lesions and atrophic gastritis. For GC, AI outperformed mid-level and trainee endoscopists but not expert endoscopists.

KEY MESSAGES

Application of artificial intelligence (AI) in upper gastrointestinal endoscopy may improve early diagnosis of esophageal and gastric cancer and may enable endoscopists to better identify patients eligible for endoscopic resection. The benefit of AI on the quality of upper endoscopy still needs to be demonstrated, while prospective trials are needed to confirm accuracy and feasibility during real-time daily endoscopy.

Diagnosis of gastric lesions through a deep convolutional neural network

BACKGROUND AND AIMS

A deep convolutional neural network (CNN) was used to achieve fast and accurate artificial intelligence (AI)-assisted diagnosis of early gastric cancer (GC) and other gastric lesions based on endoscopic images.

METHODS

A CNN-based diagnostic system based on a ResNet34 residual network structure and a DeepLabv3 structure was constructed and trained using 21,217 gastroendoscopic images of five gastric conditions, peptic ulcer (PU), early gastric cancer (EGC) and high-grade intraepithelial neoplasia (HGIN), advanced gastric cancer (AGC), gastric submucosal tumors (SMTs), and normal gastric mucosa without lesions. The trained CNN was evaluated using a test dataset of 1091 images. The accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the CNN were calculated. The CNN diagnosis was compared with those of 10 endoscopists with over 8 years of experience in endoscopic diagnosis.

RESULTS

The diagnostic specificity and PPV of the CNN were higher than that of the endoscopists for the EGC and HGIN images (specificity: 91.2% vs. 86.7%, by 4.5%, 95% CI 2.8-7.2%; PPV: 55.4% vs. 41.7%, by 13.7%, 95% CI 11.2-16.8%) and the diagnostic accuracy of the CNN was close to those of the endoscopists for the lesion-free, EGC and HGIN, PU, AGC, and SMTs images. The CNN had image recognition time of 42 s for all the test set images.

CONCLUSION

The constructed CNN system could be used as a rapid auxiliary diagnostic instrument to detect EGC and HGIN, as well as other gastric lesions, to reduce the workload of endoscopists.

Role of Artificial Intelligence in Video Capsule Endoscopy

Capsule endoscopy (CE) has been increasingly utilised in recent years as a minimally invasive tool to investigate the whole gastrointestinal (GI) tract and a range of capsules are currently available for evaluation of upper GI, small bowel, and lower GI pathology. Although CE is undoubtedly an invaluable test for the investigation of small bowel pathology, it presents considerable challenges and limitations, such as long and laborious reading times, risk of missing lesions, lack of bowel cleansing score and lack of locomotion. Artificial intelligence (AI) seems to be a promising tool that may help improve the performance metrics of CE, and consequently translate to better patient care. In the last decade, significant progress has been made to apply AI in the field of endoscopy, including CE. Although it is certain that AI will find soon its place in day-to-day endoscopy clinical practice, there are still some open questions and barriers limiting its widespread application. In this review, we provide some general information about AI, and outline recent advances in AI and CE, issues around implementation of AI in medical practice and potential future applications of AI-aided CE.

Current situation and prospect of artificial intelligence application in endoscopic diagnosis of Helicobacter pylori infection

With the appearance and prevalence of deep learning, artificial intelligence (AI) has been broadly studied and made great progress in various fields of medicine, including gastroenterology. Helicobacter pylori (H. pylori), closely associated with various digestive and extradigestive diseases, has a high infection rate worldwide. Endoscopic surveillance can evaluate H. pylori infection situations and predict the risk of gastric cancer, but there is no objective diagnostic criteria to eliminate the differences between operators. The computer-aided diagnosis system based on AI technology has demonstrated excellent performance for the diagnosis of H. pylori infection, which is superior to novice endoscopists and similar to skilled. Compared with the visual diagnosis of H. pylori infection by endoscopists, AI possesses voluminous advantages: High accuracy, high efficiency, high quality control, high objectivity, and high-effect teaching. This review summarizes the previous and recent studies on AI-assisted diagnosis of H. pylori infection, points out the limitations, and puts forward prospect for future research.

Usefulness of artificial intelligence in gastric neoplasms

Recently, studies in many medical fields have reported that image analysis based on artificial intelligence (AI) can be used to analyze structures or features that are difficult to identify with human eyes. To diagnose early gastric cancer, related efforts such as narrow-band imaging technology are on-going. However, diagnosis is often difficult. Therefore, a diagnostic method based on AI for endoscopic imaging was developed and its effectiveness was confirmed in many studies. The gastric cancer diagnostic program based on AI showed relatively high diagnostic accuracy and could differentially diagnose non-neoplastic lesions including benign gastric ulcers and dysplasia. An AI system has also been developed that helps to predict the invasion depth of gastric cancer through endoscopic images and observe the stomach during endoscopy without blind spots. Therefore, if AI is used in the field of endoscopy, it is expected to aid in the diagnosis of gastric neoplasms and determine the application of endoscopic therapy by predicting the invasion depth.

Application of artificial intelligence-driven endoscopic screening and diagnosis of gastric cancer

The landscape of gastrointestinal endoscopy continues to evolve as new technologies and techniques become available. The advent of image-enhanced and magnifying endoscopies has highlighted the step toward perfecting endoscopic screening and diagnosis of gastric lesions. Simultaneously, with the development of convolutional neural network, artificial intelligence (AI) has made unprecedented breakthroughs in medical imaging, including the ongoing trials of computer-aided detection of colorectal polyps and gastrointestinal bleeding. In the past demi-decade, applications of AI systems in gastric cancer have also emerged. With AI’s efficient computational power and learning capacities, endoscopists can improve their diagnostic accuracies and avoid the missing or mischaracterization of gastric neoplastic changes. So far, several AI systems that incorporated both traditional and novel endoscopy technologies have been developed for various purposes, with most systems achieving an accuracy of more than 80%. However, their feasibility, effectiveness, and safety in clinical practice remain to be seen as there have been no clinical trials yet. Nonetheless, AI-assisted endoscopies shed light on more accurate and sensitive ways for early detection, treatment guidance and prognosis prediction of gastric lesions. This review summarizes the current status of various AI applications in gastric cancer and pinpoints directions for future research and clinical practice implementation from a clinical perspective.

[Deep Learning in Upper Gastrointestinal Disorders: Status and Future Perspectives]

Artificial intelligence using deep learning has been applied to gastrointestinal disorders for the detection, classification, and delineation of various lesion images. With the accumulation of enormous medical records, the evolution of computation power with graphic processing units, and the widespread use of open-source libraries in large-scale machine learning processes, medical artificial intelligence is overcoming its traditional limitations. This paper explains the basic concepts of deep learning model establishment and summarizes previous studies on upper gastrointestinal disorders. The limitations and perspectives on future development are also discussed.

The role of computer-assisted systems for upper-endoscopy quality monitoring and assessment of gastric lesions

This article analyses the literature regarding the value of computer-assisted systems in esogastroduodenoscopy-quality monitoring and the assessment of gastric lesions. Current data show promising results in upper-endoscopy quality control and a satisfactory detection accuracy of gastric premalignant and malignant lesions, similar or even exceeding that of experienced endoscopists. Moreover, artificial systems enable the decision for the best treatment strategies in gastric-cancer patient care, namely endoscopic vs surgical resection according to tumor depth. In so doing, unnecessary surgical interventions would be avoided whilst providing a better quality of life and prognosis for these patients. All these performance data have been revealed by numerous studies using different artificial intelligence (AI) algorithms in addition to white-light endoscopy or novel endoscopic techniques that are available in expert endoscopy centers. It is expected that ongoing clinical trials involving AI and the embedding of computer-assisted diagnosis systems into endoscopic devices will enable real-life implementation of AI endoscopic systems in the near future and at the same time will help to overcome the current limits of the computer-assisted systems leading to an improvement in performance. These benefits should lead to better diagnostic and treatment strategies for gastric-cancer patients. Furthermore, the incorporation of AI algorithms in endoscopic tools along with the development of large electronic databases containing endoscopic images might help in upper-endoscopy assistance and could be used for telemedicine purposes and second opinion for difficult cases.

Identifying early gastric cancer under magnifying narrow-band images with deep learning: a multicenter study

BACKGROUND AND AIMS

Narrow-band imaging with magnifying endoscopy (ME-NBI) has shown advantages in the diagnosis of early gastric cancer (EGC). However, proficiency in diagnostic algorithms requires substantial expertise and experience. In this study, we aimed to develop a computer-aided diagnostic model for EGM (EGCM) to analyze and assist in the diagnosis of EGC under ME-NBI.

METHODS

A total of 1777 ME-NBI images from 295 cases were collected from 3 centers. These cases were randomly divided into a training cohort (n = 170), an internal test cohort (ITC, n = 73), and an external test cohort (ETC, n = 52). EGCM based on VGG-19 architecture (Visual Geometry Group [VGG], Oxford University, Oxford, UK) with a single fully connected 2-classification layer was developed through fine-tuning and validated on all cohorts. Furthermore, we compared the model with 8 endoscopists with varying experience. Primary comparison measures included accuracy, area under the receiver operating characteristic curve (AUC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

RESULTS

EGCM acquired AUCs of .808 in the ITC and .813 in the ETC. Moreover, EGCM achieved similar predictive performance as the senior endoscopists (accuracy: .770 vs .755, P = .355; sensitivity: .792 vs .767, P = .183; specificity: .745 vs .742, P = .931) but better than the junior endoscopists (accuracy: .770 vs .728, P < .05). After referring to the results of EGCM, the average diagnostic ability of the endoscopists was significantly improved in terms of accuracy, sensitivity, PPV, and NPV (P < .05).

CONCLUSIONS

EGCM exhibited comparable performance with senior endoscopists in the diagnosis of EGC and showed the potential value in aiding and improving the diagnosis of EGC by endoscopists.

Artificial intelligence in gastroenterology and hepatology: Status and challenges

Originally proposed by John McCarthy in 1955, artificial intelligence (AI) has achieved a breakthrough and revolutionized the processing methods of clinical medicine with the increasing workloads of medical records and digital images. Doctors are paying attention to AI technologies for various diseases in the fields of gastroenterology and hepatology. This review will illustrate AI technology procedures for medical image analysis, including data processing, model establishment, and model validation. Furthermore, we will summarize AI applications in endoscopy, radiology, and pathology, such as detecting and evaluating lesions, facilitating treatment, and predicting treatment response and prognosis with excellent model performance. The current challenges for AI in clinical application include potential inherent bias in retrospective studies that requires larger samples for validation, ethics and legal concerns, and the incomprehensibility of the output results. Therefore, doctors and researchers should cooperate to address the current challenges and carry out further investigations to develop more accurate AI tools for improved clinical applications.

A review on recent advancements in diagnosis and classification of cancers using artificial intelligence

Artificial intelligence has illustrated drastic changes in radiology and medical imaging techniques which in turn led to tremendous changes in screening patterns. In particular, advancements in these techniques led to the development of computer aided detection (CAD) strategy. These approaches provided highly accurate diagnostic reports which served as a "second-opinion" to the radiologists. However, with significant advancements in artificial intelligence strategy, the diagnostic and classifying capabilities of CAD system are meeting the levels of radiologists and clinicians. Thus, it shifts the CAD system from second opinion approach to a high utility tool. This article reviews the strategies and algorithms developed using artificial intelligence for the foremost cancer diagnosis and classification which overcomes the challenges in the traditional method. In addition, the possible direction of AI in medical aspects is also discussed in this study.

Current Evidence and Future Perspective of Accuracy of Artificial Intelligence Application for Early Gastric Cancer Diagnosis With Endoscopy: A Systematic and Meta-Analysis

Background & Aims: Gastric cancer is the common malignancies from cancer worldwide. Endoscopy is currently the most effective method to detect early gastric cancer (EGC). However, endoscopy is not infallible and EGC can be missed during endoscopy. Artificial intelligence (AI)-assisted endoscopic diagnosis is a recent hot spot of research. We aimed to quantify the diagnostic value of AI-assisted endoscopy in diagnosing EGC.

Method: The PubMed, MEDLINE, Embase and the Cochrane Library Databases were searched for articles on AI-assisted endoscopy application in EGC diagnosis. The pooled sensitivity, specificity, and area under the curve (AUC) were calculated, and the endoscopists' diagnostic value was evaluated for comparison. The subgroup was set according to endoscopy modality, and number of training images. A funnel plot was delineated to estimate the publication bias.

Result: 16 studies were included in this study. We indicated that the application of AI in endoscopic detection of EGC achieved an AUC of 0.96 (95% CI, 0.94–0.97), a sensitivity of 86% (95% CI, 77–92%), and a specificity of 93% (95% CI, 89–96%). In AI-assisted EGC depth diagnosis, the AUC was 0.82(95% CI, 0.78–0.85), and the pooled sensitivity and specificity was 0.72(95% CI, 0.58–0.82) and 0.79(95% CI, 0.56–0.92). The funnel plot showed no publication bias.

Conclusion: The AI applications for EGC diagnosis seemed to be more accurate than the endoscopists. AI assisted EGC diagnosis was more accurate than experts. More prospective studies are needed to make AI-aided EGC diagnosis universal in clinical practice.

Progress of Gastric Cancer Surgery in the era of Precision Medicine

With the development of genomics, the update of modern imaging technology and the advent of artificial intelligence and big data, the surgical treatment of gastric cancer has gradually stepped into precision medicine. Precision surgery treatment of gastric cancer is based on accurate molecular typing and staging using modern molecular diagnostic technology and imaging, and the formulation of precise and individualized surgical treatment plans, with the concept of minimally invasive and accelerated rehabilitation surgery running through it. For intermediate-stage gastric cancer, we have adopted a comprehensive treatment approach including traditional radiotherapy and chemotherapy, targeted therapy and immunotherapy. Utilize artificial intelligence and big data technology to improve the standardization and interconnectivity of specialty data and realize the transformation of evidence-based medicine. Promoting the standardization, standardization and individualization of gastric cancer surgical treatment, providing patients with precise diagnosis and treatment, and further improving patients' prognosis are the opportunities and challenges in the development of gastric cancer surgery.

Barrett esophagus: What to expect from Artificial Intelligence?

The evaluation and assessment of Barrett's esophagus is challenging for both expert and nonexpert endoscopists. However, the early diagnosis of cancer in Barrett's esophagus is crucial for its prognosis, and could save costs. Pre-clinical and clinical studies on the application of Artificial Intelligence (AI) in Barrett's esophagus have shown promising results. In this review, we focus on the current challenges and future perspectives of implementing AI systems in the management of patients with Barrett's esophagus.

Novel system in vitro of classifying oral carcinogenesis based on feature extraction for gray-level co-occurrence matrix using scanned laser pico projector

Oral cancer is among the top 10 causes of death due to cancer worldwide. The prognosis for oral cancer patients is not good, with a 5-year survival rate of only 50%. Earlier and more precise classification will help clinicians make a diagnosis and patients survive. With the advancement of technology, computer-aided detection methods are used to help clinicians form therapy strategies. Gray-level co-occurrence matrix (GLCM) feature extraction of images describing the spatial distribution of gray levels is widely used in medical imaging analysis. Scanned laser pico projector (SLPP) has advantages such as high intensity, directivity, coherence, and mono-color with low bandwidth. In this study, GLCM feature extraction and SLPP reflex images were combined to make a small, non-staining, noninvasive classification system. According to the various image characteristics in oral carcinogenesis, SLPP reflex images better define the borders and three-dimensional structures and provide effective GLCM features such as contrast, energy, and homogeneity to classify carcinogenesis in dysplastic oral keratinocyte (DOK) and normal oral keratinocyte (NOK) cells. Moreover, it also reliably classifies highly metastatic (HSC-3) and tongue cancer (CAL-27) cells. A promising computer-aided classification system for oral cancer was developed to build a reliable intraoral examination system for in situ computer-aided diagnosis in normal clinics.

Application of Artificial Intelligence in Gastrointestinal Endoscopy

Artificial intelligence (AI), also known as computer-aided diagnosis, is a technology that enables machines to process information and functions at or above human level and has great potential in gastrointestinal endoscopy applications. At present, the research on medical image recognition usually adopts the deep-learning algorithm based on the convolutional neural network. AI has been used in gastrointestinal endoscopy including esophagogastroduodenoscopy, capsule endoscopy, colonoscopy, etc. AI can help endoscopic physicians improve the diagnosis rate of various lesions, reduce the rate of missed diagnosis, improve the quality of endoscopy, assess the severity of the disease, and improve the efficiency of endoscopy. The diversity, susceptibility, and imaging specificity of gastrointestinal endoscopic images are all difficulties and challenges on the road to intelligence. We need more large-scale, high-quality, multicenter prospective studies to explore the clinical applicability of AI, and ethical issues need to be taken into account.

Advancing care for acute gastrointestinal bleeding using artificial intelligence

The future of gastrointestinal bleeding will include the integration of machine learning algorithms to enhance clinician risk assessment and decision making. Machine learning algorithms have shown promise in outperforming existing clinical risk scores for both upper and lower gastrointestinal bleeding but have not been validated in any prospective clinical trials. The adoption of electronic health records provides an exciting opportunity to deploy risk prediction tools in real time and also to expand the data available to train predictive models. Machine learning algorithms can be used to identify patients with acute gastrointestinal bleeding using data extracted from the electronic health record. This can lead to an automated process to find patients with symptoms of acute gastrointestinal bleeding so that risk prediction tools can be then triggered to consistently provide decision support to the physician. Neural network models can be used to provide continuous risk predictions for patients who are at higher risk, which can be used to guide triage of patients to appropriate levels of care. Finally, the future will likely include neural network-based analysis of endoscopic stigmata of bleeding to help guide best practices for hemostasis during the endoscopic procedure. Machine learning will enhance the delivery of care at every level for patients with acute gastrointestinal bleeding through identifying very low risk patients for outpatient management, triaging high risk patients for higher levels of care, and guiding optimal intervention during endoscopy.

Application of artificial intelligence using a convolutional neural network for diagnosis of early gastric cancer based on magnifying endoscopy with narrow-band imaging

BACKGROUND AND AIM

Magnifying endoscopy with narrow-band imaging (ME-NBI) has made a huge contribution to clinical practice. However, acquiring skill at ME-NBI diagnosis of early gastric cancer (EGC) requires considerable expertise and experience. Recently, artificial intelligence (AI), using deep learning and a convolutional neural network (CNN), has made remarkable progress in various medical fields. Here, we constructed an AI-assisted CNN computer-aided diagnosis (CAD) system, based on ME-NBI images, to diagnose EGC and evaluated the diagnostic accuracy of the AI-assisted CNN-CAD system.

METHODS

The AI-assisted CNN-CAD system (ResNet50) was trained and validated on a dataset of 5574 ME-NBI images (3797 EGCs, 1777 non-cancerous mucosa and lesions). To evaluate the diagnostic accuracy, a separate test dataset of 2300 ME-NBI images (1430 EGCs, 870 non-cancerous mucosa and lesions) was assessed using the AI-assisted CNN-CAD system.

RESULTS

The AI-assisted CNN-CAD system required 60 s to analyze 2300 test images. The overall accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of the CNN were 98.7%, 98%, 100%, 100%, and 96.8%, respectively. All misdiagnosed images of EGCs were of low-quality or of superficially depressed and intestinal-type intramucosal cancers that were difficult to distinguish from gastritis, even by experienced endoscopists.

CONCLUSIONS

The AI-assisted CNN-CAD system for ME-NBI diagnosis of EGC could process many stored ME-NBI images in a short period of time and had a high diagnostic ability. This system may have great potential for future application to real clinical settings, which could facilitate ME-NBI diagnosis of EGC in practice.

Development of artificial intelligence system for quality control of photo documentation in esophagogastroduodenoscopy

BACKGROUND

Esophagogastroduodenoscopy (EGD) is generally a safe procedure, but adverse events often occur. This highlights the necessity of the quality control of EGD. Complete visualization and photo documentation of upper gastrointestinal (UGI) tracts are important measures in quality control of EGD. To evaluate these measures in large scale, we developed an AI-driven quality control system for EGD through convolutional neural networks (CNNs) using archived endoscopic images.

METHODS

We retrospectively collected and labeled images from 250 EGD procedures, a total of 2599 images from eight locations of the UGI tract, using the European Society of Gastrointestinal Endoscopy (ESGE) photo documentation methods. The label confirmed by five experts was considered the gold standard. We developed a CNN model for multi-class classification of EGD images to one of the eight locations and binary classification of each EGD procedure based on its completeness.

RESULTS

Our CNN model successfully classified the EGD images into one of the eight regions of UGI tracts with 97.58% accuracy, 97.42% sensitivity, 99.66% specificity, 97.50% positive predictive value (PPV), and 99.66% negative predictive value (NPV). Our model classified the completeness of EGD with 89.20% accuracy, 89.20% sensitivity, 100.00% specificity, 100.00% PPV, and 64.94% NPV. We analyzed the credibility of our model using a probability heatmap.

CONCLUSIONS

We constructed a CNN model that could be used in the quality control of photo documentation in EGD. Our model needs further validation with a large dataset, and we expect our model to help both endoscopists and patients by improving the quality of EGD procedures.

SCNET: A Novel UGI Cancer Screening Framework Based on Semantic-Level Multimodal Data Fusion

Upper gastrointestinal (UGI) cancer has been identified as one of the ten most common causes of cancer deaths globally. UGI cancer screening is critical to improving the survival rate of UGI cancer patients. While many approaches to UGI cancer screening rely on single-modality data such as gastroscope imaging, limited studies have been dedicated to UGI cancer screening exploiting multisource and multimodal medical data, which could potentially lead to improved screening results. In this paper, we propose semantic-level cancer-screening network (SCNET), a framework for UGI cancer screening based on semantic-level multimodal upper gastrointestinal data fusion. Specifically, the proposed SCNET consists of a gastrointestinal image recognition flow and a textual medical record processing flow. High-level features of upper gastrointestinal data are extracted by identifying effective feature channels according to the correlation between the textual features and the spatial structure of the image features. The final screening results are obtained after the data fusion step. The experimental results show that the improvement of our approach over the state-of-the-art ones reached 4.01% in average. The source code of SCNET is available at https://github.com/netflymachine/SCNET.

Current status and future perspective of artificial intelligence applications in endoscopic diagnosis and management of gastric cancer

Image recognition using artificial intelligence (AI) has progressed significantly due to innovative technologies such as machine learning and deep learning. In the field of gastric cancer (GC) management, research on AI-based diagnosis such as anatomical classification of endoscopic images, diagnosis of Helicobacter pylori infection, and detection and qualitative diagnosis of GC is being conducted, and an accuracy equivalent to that of physicians has been reported. It is expected that AI will soon be introduced in the field of endoscopic diagnosis and management of gastric cancer as a supportive tool for physicians, thus improving the quality of medical care.

Artificial intelligence in upper GI endoscopy - current status, challenges and future promise

White-light endoscopy with biopsy is the current gold standard modality for detecting and diagnosing upper gastrointestinal (GI) pathology. However, missed lesions remain a challenge. To overcome interobserver variability and learning curve issues, artificial intelligence (AI) has recently been introduced to assist endoscopists in the detection and diagnosis of upper GI neoplasia. In contrast to AI in colonoscopy, current AI studies for upper GI endoscopy are smaller pilot studies. Researchers currently lack large volume, well-annotated, high-quality datasets in gastric cancer, dysplasia in Barrett's esophagus and early esophageal squamous cell cancer. This review will look at the latest studies of AI in upper GI endoscopy, discuss some of the challenges facing researchers, and predict what the future may hold in this rapidly changing field.

Artificial intelligence for cancer detection of the upper gastrointestinal tract

In recent years, artificial intelligence (AI) has been found to be useful to physicians in the field of image recognition due to three elements: deep learning (that is, CNN, convolutional neural network), a high-performance computer, and a large amount of digitized data. In the field of gastrointestinal endoscopy, Japanese endoscopists have produced the world's first achievements of CNN-based AI system for detecting gastric and esophageal cancers. This study reviews papers on CNN-based AI for gastrointestinal cancers, and discusses the future of this technology in clinical practice. Employing AI-based endoscopes would enable early cancer detection. The better diagnostic abilities of AI technology may be beneficial in early gastrointestinal cancers in which endoscopists have variable diagnostic abilities and accuracy. AI coupled with the expertise of endoscopists would increase the accuracy of endoscopic diagnosis.

Artificial intelligence and its impact on quality improvement in upper and lower gastrointestinal endoscopy

Artificial intelligence (AI) and its application in medicine has grown large interest. Within gastrointestinal (GI) endoscopy, the field of colonoscopy and polyp detection is the most investigated, however, upper GI follows the lead. Since endoscopy is performed by humans, it is inherently an imperfect procedure. Computer-aided diagnosis may improve its quality by helping prevent missing lesions and supporting optical diagnosis for those detected. An entire evolution in AI systems has been established in the last decades, resulting in optimization of the diagnostic performance with lower variability and matching or even outperformance of expert endoscopists. This shows a great potential for future quality improvement of endoscopy, given the outstanding diagnostic features of AI. With this narrative review, we highlight the potential benefit of AI to improve overall quality in daily endoscopy and describe the most recent developments for characterization and diagnosis as well as the recent conditions for regulatory approval.

Striving for quality improvement: can artificial intelligence help?

Artificial intelligence (AI) is of keen interest for global health development as potential support for current human shortcomings. Gastrointestinal (GI) endoscopy is an excellent substrate for AI, since it holds the genuine potential to improve quality in GI endoscopy and overall patient care by improving detection and diagnosis guiding the endoscopists in performing endoscopy to the highest quality standards. The possibility of large data acquisitioning to refine algorithms makes implementation of AI into daily practice a potential reality. With the start of a new era adopting deep learning, large amounts of data can easily be processed, resulting in better diagnostic performances. In the upper gastrointestinal tract, research currently focusses on the detection and characterization of neoplasia, including Barrett's, squamous cell and gastric carcinoma, with an increasing amount of AI studies demonstrating the potential and benefit of AI-augmented endoscopy. Deep learning applied to small bowel video capsule endoscopy also appears to enhance pathology detection and reduce capsule reading time. In the colon, multiple prospective trials including five randomized trials, showed a consistent improvement in polyp and adenoma detection rates, one of the main quality indicators in endoscopy. There are however potential additional roles for AI to assist in quality improvement of endoscopic procedures, training and therapeutic decision making. Further large-scale, multicenter validation trials are required before AI-augmented diagnostic gastrointestinal endoscopy can be integrated into our routine clinical practice.

The Role of Artificial Intelligence in Endoscopic Ultrasound for Pancreatic Disorders

The use of artificial intelligence (AI) in various medical imaging applications has expanded remarkably, and several reports have focused on endoscopic ultrasound (EUS) images of the pancreas. This review briefly summarizes each report in order to help endoscopists better understand and utilize the potential of this rapidly developing AI, after a description of the fundamentals of the AI involved, as is necessary for understanding each study. At first, conventional computer-aided diagnosis (CAD) was used, which extracts and selects features from imaging data using various methods and introduces them into machine learning algorithms as inputs. Deep learning-based CAD utilizing convolutional neural networks has been used; in these approaches, the images themselves are used as inputs, and more information can be analyzed in less time and with higher accuracy. In the field of EUS imaging, although AI is still in its infancy, further research and development of AI applications is expected to contribute to the role of optical biopsy as an alternative to EUS-guided tissue sampling while also improving diagnostic accuracy through double reading with humans and contributing to EUS education.

Evolving role of artificial intelligence in gastrointestinal endoscopy

Artificial intelligence (AI) is a combination of different technologies that enable machines to sense, comprehend, and learn with human-like levels of intelligence. AI technology will eventually enhance human capability, provide machines genuine autonomy, and reduce errors, and increase productivity and efficiency. AI seems promising, and the field is full of invention, novel applications; however, the limitation of machine learning suggests a cautious optimism as the right strategy. AI is also becoming incorporated into medicine to improve patient care by speeding up processes and achieving greater accuracy for optimal patient care. AI using deep learning technology has been used to identify, differentiate catalog images in several medical fields including gastrointestinal endoscopy. The gastrointestinal endoscopy field involves endoscopic diagnoses and prognostication of various digestive diseases using image analysis with the help of various gastrointestinal endoscopic device systems. AI-based endoscopic systems can reliably detect and provide crucial information on gastrointestinal pathology based on their training and validation. These systems can make gastroenterology practice easier, faster, more reliable, and reduce inter-observer variability in the coming years. However, the thought that these systems will replace human decision making replace gastrointestinal endoscopists does not seem plausible in the near future. In this review, we discuss AI and associated various technological terminologies, evolving role in gastrointestinal endoscopy, and future possibilities.

NBI utility in oncologic surgery: An organ by organ review

The main aims of the oncologic surgeon should be an early tumor diagnosis, complete surgical resection, and a careful post-treatment follow-up to ensure a prompt diagnosis of recurrence. Radiologic and endoscopic methods have been traditionally used for these purposes, but their accuracy might sometimes be suboptimal. Technological improvements could help the clinician during the diagnostic and therapeutic management of tumors. Narrow band imaging (NBI) belongs to optical image techniques, and uses light characteristics to enhance tissue vascularization. Because neoangiogenesis is a fundamental step during carcinogenesis, NBI could be useful in the diagnostic and therapeutic workup of tumors. Since its introduction in 2001, NBI use has rapidly spread in different oncologic specialties with clear advantages. There is an active interest in this topic as demonstrated by the thriving literature. It is unavoidable for clinicians to gain in-depth knowledge about the application of NBI to their specific field, losing the overall view on the topic. However, by looking at other fields of application, clinicians could find ideas to improve NBI use in their own specialty. The aim of this review is to summarize the existing literature on NBI use in oncology, with the aim of providing the state of the art: we present an overview on NBI fields of application, results, and possible future improvements in the different specialties.

Artificial intelligence-based diagnostic system classifying gastric cancers and ulcers: comparison between the original and newly developed systems

BACKGROUND

We previously reported for the first time the usefulness of artificial intelligence (AI) systems in detecting gastric cancers. However, the "original convolutional neural network (O-CNN)" employed in the previous study had a relatively low positive predictive value (PPV). Therefore, we aimed to develop an advanced AI-based diagnostic system and evaluate its applicability for the classification of gastric cancers and gastric ulcers.

METHODS

We constructed an "advanced CNN" (A-CNN) by adding a new training dataset (4453 gastric ulcer images from 1172 lesions) to the O-CNN, which had been trained using 13 584 gastric cancer and 373 gastric ulcer images. The diagnostic performance of the A-CNN in terms of classifying gastric cancers and ulcers was retrospectively evaluated using an independent validation dataset (739 images from 100 early gastric cancers and 720 images from 120 gastric ulcers) and compared with that of the O-CNN by estimating the overall classification accuracy.

RESULTS

The sensitivity, specificity, and PPV of the A-CNN in classifying gastric cancer at the lesion level were 99.0 % (95 % confidence interval [CI] 94.6 %-100 %), 93.3 % (95 %CI 87.3 %-97.1 %), and 92.5 % (95 %CI 85.8 %-96.7 %), respectively, and for classifying gastric ulcers were 93.3 % (95 %CI 87.3 %-97.1 %), 99.0 % (95 %CI 94.6 %-100 %), and 99.1 % (95 %CI 95.2 %-100 %), respectively. At the lesion level, the overall accuracies of the O- and A-CNN for classifying gastric cancers and gastric ulcers were 45.9 % (gastric cancers 100 %, gastric ulcers 0.8 %) and 95.9 % (gastric cancers 99.0 %, gastric ulcers 93.3 %), respectively.

CONCLUSION

The newly developed AI-based diagnostic system can effectively classify gastric cancers and gastric ulcers.

Artificial intelligence: A new budding star in gastric cancer

The pursuit of health has always been the driving force for the advancement of human society, and social development will be profoundly affected by every breakthrough in the medical industry. With the arrival of the information technology revolution era, artificial intelligence (AI) technology has been rapidly developed. AI has been combined with medicine but it has been less studied with gastric cancer (GC). AI is a new budding star in GC, and its contribution to GC is mainly focused on diagnosis and treatment. For early GC, AI’s impact is not only reflected in its high accuracy but also its ability to quickly train primary doctors, improve the diagnosis rate of early GC, and reduce missed cases. At the same time, it will also reduce the possibility of missed diagnosis of advanced GC in cardia. Furthermore, it is used to assist imaging doctors to determine the location of lymph nodes and, more importantly, it can more effectively judge the lymph node metastasis of GC, which is conducive to the prognosis of patients. In surgical treatment of GC, it also has great potential. Robotic surgery is the latest technology in GC surgery. It is a bright star for minimally invasive treatment of GC, and together with laparoscopic surgery, it has become a common treatment for GC. Through machine learning, robotic systems can reduce operator errors and trauma of patients, and can predict the prognosis of GC patients. Throughout the centuries of development of surgery, the history gradually changes from traumatic to minimally invasive. In the future, AI will help GC patients reduce surgical trauma and further improve the efficiency of minimally invasive treatment of GC.

Artificial intelligence in gastrointestinal endoscopy: general overview

Artificial intelligence (AI) is now a trendy subject in clinical medicine and especially in gastrointestinal (GI) endoscopy. AI has the potential to improve the quality of GI endoscopy at all levels. It will compensate for humans' errors and limited capabilities by bringing more accuracy, consistency, and higher speed, making endoscopic procedures more efficient and of higher quality. AI showed great results in diagnostic and therapeutic endoscopy in all parts of the GI tract. More studies are still needed before the introduction of this new technology in our daily practice and clinical guidelines. Furthermore, ethical clearance and new legislations might be needed. In conclusion, the introduction of AI will be a big breakthrough in the field of GI endoscopy in the upcoming years. It has the potential to bring major improvements to GI endoscopy at all levels.

Early gastric cancer and Artificial Intelligence: Is it time for population screening?

Gastric cancer is a common cause of death worldwide and its early detection is crucial to improve its prognosis. Its incidence varies throughout countries, and screening has been found to be cost-effective at least in high-incidence regions. Identification of individuals harbouring preneoplastic lesions and their surveillance or of those with early gastric cancer are extremely important processes and endoscopy play a key role for this purpose. Unfortunately, also quality and accuracy for endoscopic detection varies among centres and endoscopists. Recent studies about Artificial Intelligence applied to endoscopic imaging show that these technologies perform very well and could be extremely useful for endoscopists to achieve the accuracy needed for gastric cancer screening. Nonetheless, as its introduction in this field is very recent, most studies are carried out offline and its results in clinical practice need to be further validated namely by incorporating all the components/dimensions of endoscopy from pre to post-assessment.

Intelligent diagnosis of gastric intestinal metaplasia based on convolutional neural network and limited number of endoscopic images

BACKGROUND

Gastric intestinal metaplasia (GIM) is a precancerous lesion of gastric cancer. Currently, diagnosis of GIM is based on the experience of a physician, which is liable to interobserver variability. Thus, an intelligent diagnostic (ID) system, based on narrow-band and magnifying narrow-band images, was constructed to provide objective assistance in the diagnosis of GIM.

METHOD

We retrospectively collected 1880 endoscopic images (1048 GIM and 832 non-GIM) via biopsy from 336 patients confirmed histologically as GIM or non-GIM, from the Kiang Wu Hospital, Macau. We developed an ID system with these images using a modified convolutional neural network algorithm. A separate test dataset containing 477 pathologically confirmed images (242 GIM and 235 non-GIM) from 80 patients was used to test the performance of the ID system. Experienced endoscopists also examined the same test dataset, for comparison with the ID system. One of the challenges faced in this study was that it was difficult to obtain a large number of training images. Thus, data augmentation and transfer learning were applied together.

RESULTS

The area under the receiver operating characteristic curve was 0.928 for the pre-patient analysis of the ID system, while the sensitivities, specificities, and accuracies of the ID system against those of the human experts were (91.9% vs. 86.5%, p-value = 1.000) (86.0% vs. 81.4%, p-value = 0.754), and (88.8% vs. 83.8%, p-value = 0.424), respectively. Even though the three indices of the ID system were slightly higher than those of the human experts, there were no significant differences.

CONCLUSIONS

In this pilot study, a novel ID system was developed to diagnose GIM. This system exhibits promising diagnostic performance. It is believed that the proposed system has the potential for clinical application in the future.

Standalone performance of artificial intelligence for upper GI neoplasia: a meta-analysis

OBJECTIVE

Artificial intelligence (AI) may reduce underdiagnosed or overlooked upper GI (UGI) neoplastic and preneoplastic conditions, due to subtle appearance and low disease prevalence. Only disease-specific AI performances have been reported, generating uncertainty on its clinical value.

DESIGN

We searched PubMed, Embase and Scopus until July 2020, for studies on the diagnostic performance of AI in detection and characterisation of UGI lesions. Primary outcomes were pooled diagnostic accuracy, sensitivity and specificity of AI. Secondary outcomes were pooled positive (PPV) and negative (NPV) predictive values. We calculated pooled proportion rates (%), designed summary receiving operating characteristic curves with respective area under the curves (AUCs) and performed metaregression and sensitivity analysis.

RESULTS

Overall, 19 studies on detection of oesophageal squamous cell neoplasia (ESCN) or Barrett's esophagus-related neoplasia (BERN) or gastric adenocarcinoma (GCA) were included with 218, 445, 453 patients and 7976, 2340, 13 562 images, respectively. AI-sensitivity/specificity/PPV/NPV/positive likelihood ratio/negative likelihood ratio for UGI neoplasia detection were 90% (CI 85% to 94%)/89% (CI 85% to 92%)/87% (CI 83% to 91%)/91% (CI 87% to 94%)/8.2 (CI 5.7 to 11.7)/0.111 (CI 0.071 to 0.175), respectively, with an overall AUC of 0.95 (CI 0.93 to 0.97). No difference in AI performance across ESCN, BERN and GCA was found, AUC being 0.94 (CI 0.52 to 0.99), 0.96 (CI 0.95 to 0.98), 0.93 (CI 0.83 to 0.99), respectively. Overall, study quality was low, with high risk of selection bias. No significant publication bias was found.

CONCLUSION

We found a high overall AI accuracy for the diagnosis of any neoplastic lesion of the UGI tract that was independent of the underlying condition. This may be expected to substantially reduce the miss rate of precancerous lesions and early cancer when implemented in clinical practice.

Deep learning analysis for the detection of pancreatic cancer on endosonographic images: a pilot study

BACKGROUND/PURPOSE

The application of artificial intelligence to clinical diagnostics using deep learning has been developed in recent years. In this study, we developed an original computer-assisted diagnosis (CAD) system using deep learning analysis of EUS images (EUS-CAD), and assessed its ability to detect pancreatic ductal carcinoma (PDAC), using control images from patients with chronic pancreatitis (CP) and those with a normal pancreas (NP).

METHODS

A total of 920 endosonographic images were used for the training and 10-fold cross-validation, and another 470 images were independently tested. The detection abilities in both the validation and test setting were assessed, and independent factors associated with misdetection were identified among participants' characteristics and endosonographic image features.

RESULTS

Regarding the detection ability of EUS-CAD, the areas under the receiver operating characteristic curve were found to be 0.924 and 0.940 in the validation and test setting, respectively. In the analysis of misdetection, no factors were identified on univariate analysis in PDAC cases. On multivariate analysis of non-PDAC cases, only mass formation was associated with overdiagnosis of tumors.

CONCLUSIONS

Our pilot study demonstrated the efficacy of EUS-CAD for the detection of PDAC.

Accuracy of artificial intelligence-assisted detection of upper GI lesions: a systematic review and meta-analysis

BACKGROUND AND AIMS

Artificial intelligence (AI)-assisted detection is increasingly used in upper endoscopy. We performed a meta-analysis to determine the diagnostic accuracy of AI on detection of gastric and esophageal neoplastic lesions and Helicobacter pylori (HP) status.

METHODS

We searched Embase, PubMed, Medline, Web of Science, and Cochrane databases for studies on AI detection of gastric or esophageal neoplastic lesions and HP status. After assessing study quality using the Quality Assessment of Diagnostic Accuracy Studies tool, a bivariate meta-analysis following a random-effects model was used to summarize the data and plot hierarchical summary receiver-operating characteristic curves. The diagnostic accuracy was determined by the area under the hierarchical summary receiver-operating characteristic curve (AUC).

RESULTS

Twenty-three studies including 969,318 images were included. The AUC of AI detection of neoplastic lesions in the stomach, Barrett's esophagus, and squamous esophagus and HP status were .96 (95% confidence interval [CI], .94-.99), .96 (95% CI, .93-.99), .88 (95% CI, .82-.96), and .92 (95% CI, .88-.97), respectively. AI using narrow-band imaging was superior to white-light imaging on detection of neoplastic lesions in squamous esophagus (.92 vs .83, P < .001). The performance of AI was superior to endoscopists in the detection of neoplastic lesions in the stomach (AUC, .98 vs .87; P < .001), Barrett's esophagus (AUC, .96 vs .82; P < .001), and HP status (AUC, .90 vs .82; P < .001).

CONCLUSIONS

AI is accurate in the detection of upper GI neoplastic lesions and HP infection status. However, most studies were based on retrospective reviews of selected images, which requires further validation in prospective trials.

A deep learning method for delineating early gastric cancer resection margin under chromoendoscopy and white light endoscopy

BACKGROUND

Accurate delineation of cancer margins is critical for endoscopic curative resection. This study aimed to train and validate real-time fully convolutional networks for delineating the resection margin of early gastric cancer (EGC) under indigo carmine chromoendoscopy (CE) or white light endoscopy (WLE), and evaluated its performance and that of magnifying endoscopy with narrow-band imaging (ME-NBI).

METHODS

We collected CE and WLE images of EGC lesions to train fully convolutional networks ENDOANGEL. ENDOANGEL was tested both on stationary images and endoscopic submucosal dissection (ESD) videos. The accuracy and reliability of ENDOANGEL and NBI-dependent delineation were further evaluated by a novel endoscopy-pathology point-to-point marking.

RESULTS

ENDOANGEL had an accuracy of 85.7% in the CE images and 88.9% in the WLE images under an overlap ratio threshold of 0.60 in comparison with the manual markers labeled by the experts. In the ESD videos, the resection margins predicted by ENDOANGEL covered all areas of high-grade intraepithelial neoplasia and cancers. The minimum distance between the margins predicted by ENDOANGEL and the histological cancer boundary was 3.44 ± 1.45 mm which outperformed the resection margin based on ME-NBI.

CONCLUSIONS

ENDOANGEL has the potential to assist endoscopists in delineating the resection extent of EGC under CE or WLE during ESD.

Utilizing artificial intelligence in endoscopy: a clinician's guide

INTRODUCTION

Artificial intelligence (AI) that surpasses human ability in image recognition is expected to be applied in the field of gastrointestinal endoscopes. Accordingly, its research and development (R &D) is being actively conducted. With the development of endoscopic diagnosis, there is a shortage of specialists who can perform high-precision endoscopy. We will examine whether AI with excellent image recognition ability can overcome this problem.

AREAS COVERED

Since 2016, papers on artificial intelligence using convolutional neural network (CNN in other word Deep Learning) have been published. CNN is generally capable of more accurate detection and classification than conventional machine learning. This is a review of papers using CNN in the gastrointestinal endoscopy area, along with the reasons why AI is required in clinical practice. We divided this review into four parts: stomach, esophagus, large intestine, and capsule endoscope (small intestine).

EXPERT OPINION

Potential applications for the AI include colorectal polyp detection and differentiation, gastric and esophageal cancer detection, and lesion detection in capsule endoscopy. The accuracy of endoscopic diagnosis will increase if the AI and endoscopist perform the endoscopy together.

Techniques to integrate artificial intelligence systems with medical information in gastroenterology

Gastrointestinal (GI) endoscopy is the central element in contemporary gastroenterology as it provides direct evidence to guide targeted therapy. To increase the accuracy of GI endoscopy and to reduce human-related errors, artificial intelligence (AI) has been applied in GI endoscopy, which has been proved to be effective in diagnosing and treating numerous diseases. Therefore, we review current research on the efficacy of AI-assisted GI endoscopy in order to assess its functions, advantages and how the design can be improved.

Emerging artificial intelligence applications in gastroenterology: A review of the literature

Artificial intelligence (AI) allows machines to provide disruptive value in several industries and applications. Applications of AI techniques, specifically machine learning and more recently deep learning, are arising in gastroenterology. Computer-aided diagnosis for upper gastrointestinal endoscopy has growing attention for automated and accurate identification of dysplasia in Barrett’s esophagus, as well as for the detection of early gastric cancers (GCs), therefore preventing esophageal and gastric malignancies. Besides, convoluted neural network technology can accurately assess Helicobacter pylori (H. pylori) infection during standard endoscopy without the need for biopsies, thus, reducing gastric cancer risk. AI can potentially be applied during colonoscopy to automatically discover colorectal polyps and differentiate between neoplastic and non-neoplastic ones, with the possible ability to improve adenoma detection rate, which changes broadly among endoscopists performing screening colonoscopies. In addition, AI permits to establish the feasibility of curative endoscopic resection of large colonic lesions based on the pit pattern characteristics. The aim of this review is to analyze current evidence from the literature, supporting recent technologies of AI both in upper and lower gastrointestinal diseases, including Barrett's esophagus, GC, H. pylori infection, colonic polyps and colon cancer.

An improved deep learning approach and its applications on colonic polyp images detection

Background

Colonic polyps are more likely to be cancerous, especially those with large diameter, large number and atypical hyperplasia. If colonic polyps cannot be treated in early stage, they are likely to develop into colon cancer. Colonoscopy is easily limited by the operator’s experience, and factors such as inexperience and visual fatigue will directly affect the accuracy of diagnosis. Cooperating with Hunan children’s hospital, we proposed and improved a deep learning approach with global average pooling (GAP) in colonoscopy for assisted diagnosis. Our approach for assisted diagnosis in colonoscopy can prompt endoscopists to pay attention to polyps that may be ignored in real time, improve the detection rate, reduce missed diagnosis, and improve the efficiency of medical diagnosis.

Methods

We selected colonoscopy images from the gastrointestinal endoscopy room of Hunan children’s hospital to form the colonic polyp datasets. And we applied the image classification method based on Deep Learning to the classification of Colonic Polyps. The classic networks we used are VGGNets and ResNets. By using global average pooling, we proposed the improved approaches: VGGNets-GAP and ResNets-GAP.

Results

The accuracies of all models in datasets exceed 98%. The TPR and TNR are above 96 and 98% respectively. In addition, VGGNets-GAP networks not only have high classification accuracies, but also have much fewer parameters than those of VGGNets.

Conclusions

The experimental results show that the proposed approach has good effect on the automatic detection of colonic polyps. The innovations of our method are in two aspects: (1) the detection accuracy of colonic polyps has been improved. (2) our approach reduces the memory consumption and makes the model lightweight. Compared with the original VGG networks, the parameters of our VGG19-GAP networks are greatly reduced.

The Impact of Artificial Intelligence in the Endoscopic Assessment of Premalignant and Malignant Esophageal Lesions: Present and Future

In the gastroenterology field, the impact of artificial intelligence was investigated for the purposes of diagnostics, risk stratification of patients, improvement in quality of endoscopic procedures and early detection of neoplastic diseases, implementation of the best treatment strategy, and optimization of patient prognosis. Computer-assisted diagnostic systems to evaluate upper endoscopy images have recently emerged as a supporting tool in endoscopy due to the risks of misdiagnosis related to standard endoscopy and different expertise levels of endoscopists, time-consuming procedures, lack of availability of advanced procedures, increasing workloads, and development of endoscopic mass screening programs. Recent research has tended toward computerized, automatic, and real-time detection of lesions, which are approaches that offer utility in daily practice. Despite promising results, certain studies might overexaggerate the diagnostic accuracy of artificial systems, and several limitations remain to be overcome in the future. Therefore, additional multicenter randomized trials and the development of existent database platforms are needed to certify clinical implementation. This paper presents an overview of the literature and the current knowledge of the usefulness of different types of machine learning systems in the assessment of premalignant and malignant esophageal lesions via conventional and advanced endoscopic procedures. This study makes a presentation of the artificial intelligence terminology and refers also to the most prominent recent research on computer-assisted diagnosis of neoplasia on Barrett’s esophagus and early esophageal squamous cell carcinoma, and prediction of invasion depth in esophageal neoplasms. Furthermore, this review highlights the main directions of future doctor–computer collaborations in which machines are expected to improve the quality of medical action and routine clinical workflow, thus reducing the burden on physicians.

Artificial intelligence in gastric cancer: a systematic review

OBJECTIVE

This study aims to systematically review the application of artificial intelligence (AI) techniques in gastric cancer and to discuss the potential limitations and future directions of AI in gastric cancer.

METHODS

A systematic review was performed that follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Pubmed, EMBASE, the Web of Science, and the Cochrane Library were used to search for gastric cancer publications with an emphasis on AI that were published up to June 2020. The terms "artificial intelligence" and "gastric cancer" were used to search for the publications.

RESULTS

A total of 64 articles were included in this review. In gastric cancer, AI is mainly used for molecular bio-information analysis, endoscopic detection for Helicobacter pylori infection, chronic atrophic gastritis, early gastric cancer, invasion depth, and pathology recognition. AI may also be used to establish predictive models for evaluating lymph node metastasis, response to drug treatments, and prognosis. In addition, AI can be used for surgical training, skill assessment, and surgery guidance.

CONCLUSIONS

In the foreseeable future, AI applications can play an important role in gastric cancer management in the era of precision medicine.