Clinical usefulness of a deep learning-based system as the first screening on small-bowel capsule endoscopy reading

Clinical usefulness and acceptability of small-bowel capsule endoscopy with panoramic imaging compared with axial imaging in Japanese patients

Objectives

We aimed to evaluate the usefulness and acceptability of CapsoCam Plus (CapsoCam) in Japanese patients.

Methods

This retrospective single-center study enrolled 930 patients with suspected small-bowel bleeding (SSBB) who underwent capsule endoscopy. Thirty-three patients using CapsoCam and PillCam SB3 (SB3) were matched using propensity score matching. The diagnostic yield and the acceptability of CapsoCam were evaluated.

Results

There was no SSBB case where capsule endoscopy was performed within 48 h of bleeding. CapsoCam had a significantly higher observation rate of the entire small bowel (97% vs. 73%, p = 0.006) and Vater's papilla (82% vs. 15%, p < 0.001) than SB3. The reading time of CapsoCam was significantly longer than that of SB3 (30 vs. 25 min, p < 0.001), and CapsoCam's time from the capsule endoscopy swallowing to read completion was longer than that of SB3 (37 vs. 12 h, p < 0.001). The two groups showed no difference in the capsule endoscopy findings according to the P classification. Notably, 85% of the patients using CapsoCam reported examination distress as "not at all" or "almost not," and 94% reported swallowing difficulty as "very easy" or "easy."

Conclusions

CapsoCam took time to read; however, it is a well-tolerated examination with a high observation rate of Vater's papilla and entire small-bowel mucosa. Detectability of bleeding sources was comparable in both modalities for cases of occult SSBB and overt SSBB more than 48 h after bleeding. CapsoCam is a useful modality for patients with SSBB.

Artificial Intelligence in Gastrointestinal Endoscopy

Recent advancements in artificial intelligence (AI) have significantly impacted the field of gastrointestinal (GI) endoscopy, with applications spanning a wide range of clinical indications. The central goals for AI in GI endoscopy are to improve endoscopic procedural performance and quality assessment, optimize patient outcomes, and reduce administrative burden. Despite early progress, such as Food and Drug Administration approval of the first computer-aided polyp detection system in 2021, there are numerous important challenges to be faced on the path toward broader adoption of AI algorithms in clinical endoscopic practice.

Role of artificial intelligence in colorectal cancer

The sphere of artificial intelligence (AI) is ever expanding. Applications for clinical practice have been emerging over recent years. Although its uptake has been most prominent in endoscopy, this represents only one aspect of holistic patient care. There are a multitude of other potential avenues in which gastrointestinal care may be involved. We aim to review the role of AI in colorectal cancer as a whole. We performed broad scoping and focused searches of the applications of AI in the field of colorectal cancer. All trials including qualitative research were included from the year 2000 onwards. Studies were grouped into pre-operative, intra-operative and post-operative aspects. Pre-operatively, the major use is with endoscopic recognition. Colonoscopy has embraced the use for human derived classifications such as Narrow-band Imaging International Colorectal Endoscopic, Japan Narrow-band Imaging Expert Team, Paris and Kudo. However, novel detection and diagnostic methods have arisen from advances in AI classification. Intra-operatively, adjuncts such as image enhanced identification of structures and assessment of perfusion have led to improvements in clinical outcomes. Post-operatively, monitoring and surveillance have taken strides with potential socioeconomic and environmental savings. The uses of AI within the umbrella of colorectal surgery are multiple. We have identified existing technologies which are already augmenting cancer care. The future applications are exciting and could at least match, if not surpass human standards.

Artificial intelligence in a prediction model for postendoscopic retrograde cholangiopancreatography pancreatitis

OBJECTIVES

In this study we aimed to develop an artificial intelligence-based model for predicting postendoscopic retrograde cholangiopancreatography (ERCP) pancreatitis (PEP).

METHODS

We retrospectively reviewed ERCP patients at Nagoya University Hospital (NUH) and Toyota Memorial Hospital (TMH). We constructed two prediction models, a random forest (RF), one of the machine-learning algorithms, and a logistic regression (LR) model. First, we selected features of each model from 40 possible features. Then the models were trained and validated using three fold cross-validation in the NUH cohort and tested in the TMH cohort. The area under the receiver operating characteristic curve (AUROC) was used to assess model performance. Finally, using the output parameters of the RF model, we classified the patients into low-, medium-, and high-risk groups.

RESULTS

A total of 615 patients at NUH and 544 patients at TMH were enrolled. Ten features were selected for the RF model, including albumin, creatinine, biliary tract cancer, pancreatic cancer, bile duct stone, total procedure time, pancreatic duct injection, pancreatic guidewire-assisted technique without a pancreatic stent, intraductal ultrasonography, and bile duct biopsy. In the three fold cross-validation, the RF model showed better predictive ability than the LR model (AUROC 0.821 vs. 0.660). In the test, the RF model also showed better performance (AUROC 0.770 vs. 0.663, P = 0.002). Based on the RF model, we classified the patients according to the incidence of PEP (2.9%, 10.0%, and 23.9%).

CONCLUSION

We developed an RF model. Machine-learning algorithms could be powerful tools to develop accurate prediction models.

Small bowel capsule endoscopy examination and open access database with artificial intelligence: The SEE-artificial intelligence project

OBJECTIVES

Artificial intelligence (AI) may be practical for image classification of small bowel capsule endoscopy (CE). However, creating a functional AI model is challenging. We attempted to create a dataset and an object detection CE AI model to explore modeling problems to assist in reading small bowel CE.

METHODS

We extracted 18,481 images from 523 small bowel CE procedures performed at Kyushu University Hospital from September 2014 to June 2021. We annotated 12,320 images with 23,033 disease lesions, combined them with 6161 normal images as the dataset, and examined the characteristics. Based on the dataset, we created an object detection AI model using YOLO v5 and we tested validation.

RESULTS

We annotated the dataset with 12 types of annotations, and multiple annotation types were observed in the same image. We test validated our AI model with 1396 images, and sensitivity for all 12 types of annotations was about 91%, with 1375 true positives, 659 false positives, and 120 false negatives detected. The highest sensitivity for individual annotations was 97%, and the highest area under the receiver operating characteristic curve was 0.98, but the quality of detection varied depending on the specific annotation.

CONCLUSIONS

Object detection AI model in small bowel CE using YOLO v5 may provide effective and easy-to-understand reading assistance. In this SEE-AI project, we open our dataset, the weights of the AI model, and a demonstration to experience our AI. We look forward to further improving the AI model in the future.

From Data to Insights: How Is AI Revolutionizing Small-Bowel Endoscopy?

The role of capsule endoscopy and enteroscopy in managing various small-bowel pathologies is well-established. However, their broader application has been hampered mainly by their lengthy reading times. As a result, there is a growing interest in employing artificial intelligence (AI) in these diagnostic and therapeutic procedures, driven by the prospect of overcoming some major limitations and enhancing healthcare efficiency, while maintaining high accuracy levels. In the past two decades, the applicability of AI to gastroenterology has been increasing, mainly because of the strong imaging component. Nowadays, there are a multitude of studies using AI, specifically using convolutional neural networks, that prove the potential applications of AI to these endoscopic techniques, achieving remarkable results. These findings suggest that there is ample opportunity for AI to expand its presence in the management of gastroenterology diseases and, in the future, catalyze a game-changing transformation in clinical activities. This review provides an overview of the current state-of-the-art of AI in the scope of small-bowel study, with a particular focus on capsule endoscopy and enteroscopy.

Comparison of clinical utility of deep learning-based systems for small-bowel capsule endoscopy reading

BACKGROUND AND AIM

Convolutional neural network (CNN) systems that automatically detect abnormalities from small-bowel capsule endoscopy (SBCE) images are still experimental, and no studies have directly compared the clinical usefulness of different systems. We compared endoscopist readings using an existing and a novel CNN system in a real-world SBCE setting.

METHODS

Thirty-six complete SBCE videos, including 43 abnormal lesions (18 mucosal breaks, 8 angioectasia, and 17 protruding lesions), were retrospectively prepared. Three reading processes were compared: (A) endoscopist readings without CNN screening, (B) endoscopist readings after an existing CNN screening, and (C) endoscopist readings after a novel CNN screening.

RESULTS

The mean number of small-bowel images was 14 747 per patient. Among these images, existing and novel CNN systems automatically captured 24.3% and 9.4% of the images, respectively. In this process, both systems extracted all 43 abnormal lesions. Next, we focused on the clinical usefulness. The detection rates of abnormalities by trainee endoscopists were not significantly different across the three processes: A, 77%; B, 67%; and C, 79%. The mean reading time of the trainees was the shortest during process C (10.1 min per patient), followed by processes B (23.1 min per patient) and A (33.6 min per patient). The mean psychological stress score while reading videos (scale, 1-5) was the lowest in process C (1.8) but was not significantly different between processes B (2.8) and A (3.2).

CONCLUSIONS

Our novel CNN system significantly reduced endoscopist reading time and psychological stress while maintaining the detectability of abnormalities. CNN performance directly affects clinical utility and should be carefully assessed.

Smart Endoscopy Is Greener Endoscopy: Leveraging Artificial Intelligence and Blockchain Technologies to Drive Sustainability in Digestive Health Care

The surge in the implementation of artificial intelligence (AI) in recent years has permeated many aspects of our life, and health care is no exception. Whereas this technology can offer clear benefits, some of the problems associated with its use have also been recognised and brought into question, for example, its environmental impact. In a similar fashion, health care also has a significant environmental impact, and it requires a considerable source of greenhouse gases. Whereas efforts are being made to reduce the footprint of AI tools, here, we were specifically interested in how employing AI tools in gastroenterology departments, and in particular in conjunction with capsule endoscopy, can reduce the carbon footprint associated with digestive health care while offering improvements, particularly in terms of diagnostic accuracy. We address the different ways that leveraging AI applications can reduce the carbon footprint associated with all types of capsule endoscopy examinations. Moreover, we contemplate how the incorporation of other technologies, such as blockchain technology, into digestive health care can help ensure the sustainability of this clinical speciality and by extension, health care in general.

Disease surveillance evaluation of primary small-bowel follicular lymphoma using capsule endoscopy images based on a deep convolutional neural network (with video)

BACKGROUND AND AIMS

Capsule endoscopy (CE) is useful in evaluating disease surveillance for primary small-bowel follicular lymphoma (FL), but some cases are difficult to evaluate objectively. This study evaluated the usefulness of a deep convolutional neural network (CNN) system using CE images for disease surveillance of primary small-bowel FL.

METHODS

We enrolled 26 consecutive patients with primary small-bowel FL diagnosed between January 2011 and January 2021 who underwent CE before and after a watch-and-wait strategy or chemotherapy. Disease surveillance by the CNN system was evaluated by the percentage of FL-detected images among all CE images of the small-bowel mucosa.

RESULTS

Eighteen cases (69%) were managed with a watch-and-wait approach, and 8 cases (31%) were treated with chemotherapy. Among the 18 cases managed with the watch-and-wait approach, the outcome of lesion evaluation by the CNN system was almost the same in 13 cases (72%), aggravation in 4 (22%), and improvement in 1 (6%). Among the 8 cases treated with chemotherapy, the outcome of lesion evaluation by the CNN system was improvement in 5 cases (63%), almost the same in 2 (25%), and aggravation in 1 (12%). The physician and CNN system reported similar results regarding disease surveillance evaluation in 23 of 26 cases (88%), whereas a discrepancy between the 2 was found in the remaining 3 cases (12%), attributed to poor small-bowel cleansing level.

CONCLUSIONS

Disease surveillance evaluation of primary small-bowel FL using CE images by the developed CNN system was useful under the condition of excellent small-bowel cleansing level.

The Advent of Domain Adaptation into Artificial Intelligence for Gastrointestinal Endoscopy and Medical Imaging

Artificial intelligence (AI) is a subfield of computer science that aims to implement computer systems that perform tasks that generally require human learning, reasoning, and perceptual abilities. AI is widely used in the medical field. The interpretation of medical images requires considerable effort, time, and skill. AI-aided interpretations, such as automated abnormal lesion detection and image classification, are promising areas of AI. However, when images with different characteristics are extracted, depending on the manufacturer and imaging environment, a so-called domain shift problem occurs in which the developed AI has a poor versatility. Domain adaptation is used to address this problem. Domain adaptation is a tool that generates a newly converted image which is suitable for other domains. It has also shown promise in reducing the differences in appearance among the images collected from different devices. Domain adaptation is expected to improve the reading accuracy of AI for heterogeneous image distributions in gastrointestinal (GI) endoscopy and medical image analyses. In this paper, we review the history and basic characteristics of domain shift and domain adaptation. We also address their use in gastrointestinal endoscopy and the medical field more generally through published examples, perspectives, and future directions.

Study of capsule endoscopy delivery at scale through enhanced artificial intelligence-enabled analysis (the CESCAIL study)

AIM

Lower gastrointestinal (GI) diagnostics have been facing relentless capacity constraints for many years, even before the COVID-19 era. Restrictions from the COVID pandemic have resulted in a significant backlog in lower GI diagnostics. Given recent developments in deep neural networks (DNNs) and the application of artificial intelligence (AI) in endoscopy, automating capsule video analysis is now within reach. Comparable to the efficiency and accuracy of AI applications in small bowel capsule endoscopy, AI in colon capsule analysis will also improve the efficiency of video reading and address the relentless demand on lower GI services. The aim of the CESCAIL study is to determine the feasibility, accuracy and productivity of AI-enabled analysis tools (AiSPEED) for polyp detection compared with the 'gold standard': a conventional care pathway with clinician analysis.

METHOD

This multi-centre, diagnostic accuracy study aims to recruit 674 participants retrospectively and prospectively from centres conducting colon capsule endoscopy (CCE) as part of their standard care pathway. After the study participants have undergone CCE, the colon capsule videos will be uploaded onto two different pathways: AI-enabled video analysis and the gold standard conventional clinician analysis pathway. The reports generated from both pathways will be compared for accuracy (sensitivity and specificity). The reading time can only be compared in the prospective cohort. In addition to validating the AI tool, this study will also provide observational data concerning its use to assess the pathway execution in real-world performance.

RESULTS

The study is currently recruiting participants at multiple centres within the United Kingdom and is at the stage of collecting data.

CONCLUSION

This standard diagnostic accuracy study carries no additional risk to patients as it does not affect the standard care pathway, and hence patient care remains unaffected.

Design of a Convolutional Neural Network as a Deep Learning Tool for the Automatic Classification of Small-Bowel Cleansing in Capsule Endoscopy

Background and objectives: Capsule endoscopy (CE) is a non-invasive method to inspect the small bowel that, like other enteroscopy methods, requires adequate small-bowel cleansing to obtain conclusive results. Artificial intelligence (AI) algorithms have been seen to offer important benefits in the field of medical imaging over recent years, particularly through the adaptation of convolutional neural networks (CNNs) to achieve more efficient image analysis. Here, we aimed to develop a deep learning model that uses a CNN to automatically classify the quality of intestinal preparation in CE. Methods: A CNN was designed based on 12,950 CE images obtained at two clinical centers in Porto (Portugal). The quality of the intestinal preparation was classified for each image as: excellent, ≥90% of the image surface with visible mucosa; satisfactory, 50-90% of the mucosa visible; and unsatisfactory, <50% of the mucosa visible. The total set of images was divided in an 80:20 ratio to establish training and validation datasets, respectively. The CNN prediction was compared with the classification established by consensus of a group of three experts in CE, currently considered the gold standard to evaluate cleanliness. Subsequently, how the CNN performed in diagnostic terms was evaluated using an independent validation dataset. Results: Among the images obtained, 3633 were designated as unsatisfactory preparation, 6005 satisfactory preparation, and 3312 with excellent preparation. When differentiating the classes of small-bowel preparation, the algorithm developed here achieved an overall accuracy of 92.1%, with a sensitivity of 88.4%, a specificity of 93.6%, a positive predictive value of 88.5%, and a negative predictive value of 93.4%. The area under the curve for the detection of excellent, satisfactory, and unsatisfactory classes was 0.98, 0.95, and 0.99, respectively. Conclusions: A CNN-based tool was developed to automatically classify small-bowel preparation for CE, and it was seen to accurately classify intestinal preparation for CE. The development of such a system could enhance the reproducibility of the scales used for such purposes.

Clinicians’ Guide to Artificial Intelligence in Colon Capsule Endoscopy—Technology Made Simple

Artificial intelligence (AI) applications have become widely popular across the healthcare ecosystem. Colon capsule endoscopy (CCE) was adopted in the NHS England pilot project following the recent COVID pandemic’s impact. It demonstrated its capability to relieve the national backlog in endoscopy. As a result, AI-assisted colon capsule video analysis has become gastroenterology’s most active research area. However, with rapid AI advances, mastering these complex machine learning concepts remains challenging for healthcare professionals. This forms a barrier for clinicians to take on this new technology and embrace the new era of big data. This paper aims to bridge the knowledge gap between the current CCE system and the future, fully integrated AI system. The primary focus is on simplifying the technical terms and concepts in machine learning. This will hopefully address the general “fear of the unknown in AI” by helping healthcare professionals understand the basic principle of machine learning in capsule endoscopy and apply this knowledge in their future interactions and adaptation to AI technology. It also summarises the evidence of AI in CCE and its impact on diagnostic pathways. Finally, it discusses the unintended consequences of using AI, ethical challenges, potential flaws, and bias within clinical settings.

The Role of Artificial Intelligence in Monitoring Inflammatory Bowel Disease-The Future Is Now

Crohn's disease and ulcerative colitis remain debilitating disorders, characterized by progressive bowel damage and possible lethal complications. The growing number of applications for artificial intelligence in gastrointestinal endoscopy has already shown great potential, especially in the field of neoplastic and pre-neoplastic lesion detection and characterization, and is currently under evaluation in the field of inflammatory bowel disease management. The application of artificial intelligence in inflammatory bowel diseases can range from genomic dataset analysis and risk prediction model construction to the disease grading severity and assessment of the response to treatment using machine learning. We aimed to assess the current and future role of artificial intelligence in assessing the key outcomes in inflammatory bowel disease patients: endoscopic activity, mucosal healing, response to treatment, and neoplasia surveillance.

Artificial intelligence and inflammatory bowel disease: Where are we going?

Inflammatory bowel diseases, namely ulcerative colitis and Crohn's disease, are chronic and relapsing conditions that pose a growing burden on healthcare systems worldwide. Because of their complex and partly unknown etiology and pathogenesis, the management of ulcerative colitis and Crohn's disease can prove challenging not only from a clinical point of view but also for resource optimization. Artificial intelligence, an umbrella term that encompasses any cognitive function developed by machines for learning or problem solving, and its subsets machine learning and deep learning are becoming ever more essential tools with a plethora of applications in most medical specialties. In this regard gastroenterology is no exception, and due to the importance of endoscopy and imaging numerous clinical studies have been gradually highlighting the relevant role that artificial intelligence has in inflammatory bowel diseases as well. The aim of this review was to summarize the most recent evidence on the use of artificial intelligence in inflammatory bowel diseases in various contexts such as diagnosis, follow-up, treatment, prognosis, cancer surveillance, data collection, and analysis. Moreover, insights into the potential further developments in this field and their effects on future clinical practice were discussed.

Artificial intelligence and colon capsule endoscopy: Automatic detection of ulcers and erosions using a convolutional neural network

BACKGROUND AND AIM

Colon capsule endoscopy (CCE) has become a minimally invasive alternative for conventional colonoscopy. Nevertheless, each CCE exam produces between 50 000 and 100 000 frames, making its analysis time-consuming and prone to errors. Convolutional neural networks (CNNs) are a type of artificial intelligence (AI) architecture with high performance in image analysis. This study aims to develop a CNN model for the identification of colonic ulcers and erosions in CCE images.

METHODS

A CNN model was designed using a database of CCE images. A total of 124 CCE exams performed between 2010 and 2020 in two centers were reviewed. For CNN development, a total of 37 319 images were extracted, 33 749 showing normal colonic mucosa and 3570 showing colonic ulcers and erosions. Datasets for CNN training, validation, and testing were created. The performance of the algorithm was evaluated regarding its sensitivity, specificity, positive and negative predictive values, accuracy, and area under the curve.

RESULTS

The network had a sensitivity of 96.9% and a specificity of 99.9% specific for the detection of colonic ulcers and erosions. The algorithm had an overall accuracy of 99.6%. The area under the curve was 1.00. The CNN had an image processing capacity of 90 frames per second.

CONCLUSIONS

The developed algorithm is the first CNN-based model to accurately detect ulcers and erosions in CCE images, also providing a good image processing performance. The development of these AI systems may contribute to improve both the diagnostic and time efficiency of CCE exams, facilitating CCE adoption to routine clinical practice.

Technological advances in inflammatory bowel disease endoscopy and histology

Accurate disease characterization is the pillar of modern treatment of inflammatory bowel disease (IBD) and endoscopy is the mainstay of disease assessment and colorectal cancer surveillance. Recent technological progress has enhanced and expanded the use of endoscopy in IBD. In particular, numerous artificial intelligence (AI)-powered systems have shown to support human endoscopists' evaluations, improving accuracy and consistency while saving time. Moreover, advanced optical technologies such as endocytoscopy (EC), allowing high magnification in vivo, can bridge endoscopy with histology. Furthermore, molecular imaging, through probe based confocal laser endomicroscopy allows the real-time detection of specific biomarkers on gastrointestinal surface, and could be used to predict therapeutic response, paving the way to precision medicine. In parallel, as the applications of AI spread, computers are positioned to resolve some of the limitations of human histopathology evaluation, such as interobserver variability and inconsistencies in assessment. The aim of this review is to summarize the most promising advances in endoscopic and histologic assessment of IBD.

Key research questions for implementation of artificial intelligence in capsule endoscopy

BACKGROUND

Artificial intelligence (AI) is rapidly infiltrating multiple areas in medicine, with gastrointestinal endoscopy paving the way in both research and clinical applications. Multiple challenges associated with the incorporation of AI in endoscopy are being addressed in recent consensus documents.

OBJECTIVES

In the current paper, we aimed to map future challenges and areas of research for the incorporation of AI in capsule endoscopy (CE) practice.

DESIGN

Modified three-round Delphi consensus online survey.

METHODS

The study design was based on a modified three-round Delphi consensus online survey distributed to a group of CE and AI experts. Round one aimed to map out key research statements and challenges for the implementation of AI in CE. All queries addressing the same questions were merged into a single issue. The second round aimed to rank all generated questions during round one and to identify the top-ranked statements with the highest total score. Finally, the third round aimed to redistribute and rescore the top-ranked statements.

RESULTS

Twenty-one (16 gastroenterologists and 5 data scientists) experts participated in the survey. In the first round, 48 statements divided into seven themes were generated. After scoring all statements and rescoring the top 12, the question of AI use for identification and grading of small bowel pathologies was scored the highest (mean score 9.15), correlation of AI and human expert reading-second (9.05), and real-life feasibility-third (9.0).

CONCLUSION

In summary, our current study points out a roadmap for future challenges and research areas on our way to fully incorporating AI in CE reading.

Artificial intelligence to improve polyp detection and screening time in colon capsule endoscopy

Colon Capsule Endoscopy (CCE) is a minimally invasive procedure which is increasingly being used as an alternative to conventional colonoscopy. Videos recorded by the capsule cameras are long and require one or more experts' time to review and identify polyps or other potential intestinal problems that can lead to major health issues. We developed and tested a multi-platform web application, AI-Tool, which embeds a Convolution Neural Network (CNN) to help CCE reviewers. With the help of artificial intelligence, AI-Tool is able to detect images with high probability of containing a polyp and prioritize them during the reviewing process. With the collaboration of 3 experts that reviewed 18 videos, we compared the classical linear review method using RAPID Reader Software v9.0 and the new software we present. Applying the new strategy, reviewing time was reduced by a factor of 6 and polyp detection sensitivity was increased from 81.08 to 87.80%.

Automatic detection of crohn disease in wireless capsule endoscopic images using a deep convolutional neural network

The diagnosis of Crohn’s disease (CD) in the small bowel is generally performed by observing a very large number of images captured by capsule endoscopy (CE). This diagnostic technique entails a heavy workload for the specialists in terms of time spent reviewing the images. This paper presents a convolutional neural network capable of classifying the CE images to identify those ones affected by lesions indicative of the disease. The architecture of the proposed network was custom designed to solve this image classification problem. This allowed different design decisions to be made with the aim of improving its performance in terms of accuracy and processing speed compared to other state-of-the-art deep-learning-based reference architectures. The experimentation was carried out on a set of 15,972 images extracted from 31 CE videos of patients affected by CD, 7,986 of which showed lesions associated with the disease. The training, validation/selection and evaluation of the network was performed on 70%, 10% and 20% of the total images, respectively. The ROC curve obtained on the test image set has an area greater than 0.997, with points in a 95-99% sensitivity range associated with specificities of 99-96%. These figures are higher than those achieved by EfficientNet-B5, VGG-16, Xception or ResNet networks which also require an average processing time per image significantly higher than the one needed in the proposed architecture. Therefore, the network outlined in this paper is proving to be sufficiently promising to be considered for integration into tools used by specialists in their diagnosis of CD. In the sample of images analysed, the network was able to detect 99% of the images with lesions, filtering out for specialist review 96% of those with no signs of disease.

The Role of Capsule Endoscopy in Crohn's Disease: A Review

Crohn’s disease (CD) is a chronic inflammatory disorder with a predilection for the small bowel. Although awareness of this disorder has increased over the years, it remains a diagnostic challenge for many physicians. This is exacerbated by the rising incidence and high recurrence rate following therapy in certain individuals. It is currently agreed that a multimodality approach is the best one, but with the advent of new modalities, that could be changing. Furthermore, given its impact on the mental health of patients and the cost of treatment, it is pertinent that we arrive at not only convenient but accurate modalities in its diagnosis and management. Among these investigative modalities is the relatively novel capsule endoscopy (CE) that not only provides a more patient-friendly alternative but avoids the need for invasiveness. Asides from its diagnostic capability, its influence on therapy and monitoring of known CD patients following treatment has been shown. This article has reviewed the current literature comparing the relevance of CE with other available modalities in diagnosing CD patients. We explored its therapeutic impact and how it influences monitoring post-treatment in CD. This article also discusses the complications of CE and the possible solutions to these complications in the future.

Recent developments in small bowel endoscopy: the "black box" is now open!

Over the last few years, capsule endoscopy has been established as a fundamental device in the practicing gastroenterologist's toolbox. Its utilization in diagnostic algorithms for suspected small bowel bleeding, Crohn's disease, and small bowel tumors has been approved by several guidelines. The advent of double-balloon enteroscopy has significantly increased the therapeutic possibilities and release of multiple devices (single-balloon enteroscopy and spiral enteroscopy) aimed at improving the performance of small bowel enteroscopy. Recently, some important innovations have appeared in the small bowel endoscopy scene, providing further improvement to its evolution. Artificial intelligence in capsule endoscopy should increase diagnostic accuracy and reading efficiency, and the introduction of motorized spiral enteroscopy into clinical practice could also improve the therapeutic yield. This review focuses on the most recent studies on artificial-intelligence-assisted capsule endoscopy and motorized spiral enteroscopy.

Development of a Deep-Learning Algorithm for Small Bowel-Lesion Detection and a Study of the Improvement in the False-Positive Rate

Deep learning has recently been gaining attention as a promising technology to improve the identification of lesions, and deep-learning algorithms for lesion detection have been actively developed in small-bowel capsule endoscopy (SBCE). We developed a detection algorithm for abnormal findings by deep learning (convolutional neural network) the SBCE imaging data of 30 cases with abnormal findings. To enable the detection of a wide variety of abnormal findings, the training data were balanced to include all major findings identified in SBCE (bleeding, angiodysplasia, ulceration, and neoplastic lesions). To reduce the false-positive rate, “findings that may be responsible for hemorrhage” and “findings that may require therapeutic intervention” were extracted from the images of abnormal findings and added to the training dataset. For the performance evaluation, the sensitivity and the specificity were calculated using 271 detectable findings in 35 cases. The sensitivity was calculated using 68,494 images of non-abnormal findings. The sensitivity and specificity were 93.4% and 97.8%, respectively. The average number of images detected by the algorithm as having abnormal findings was 7514. We developed an image-reading support system using deep learning for SBCE and obtained a good detection performance.

Artificial Intelligence and the Future of Gastroenterology and Hepatology

The integration of artificial intelligence (AI) into gastroenterology and hepatology (GI) will inevitably transform the practice of GI in the coming decade. While the application of AI in health care is not new, advancements are occurring rapidly, and the future landscape of AI is beginning to come into focus. From endoscopic assistance via computer vision technology to the predictive capabilities of the vast information contained in the electronic health records, AI promises to optimize and expedite clinical and procedural practice and research in GI. The extensive body of literature already available on AI applications in gastroenterology may seem daunting at first; however, this review aims to provide a breakdown of the key studies conducted thus far and demonstrate the many potential ways this technology may impact the field. This review will also take a look into the future and imagine how GI can be transformed over the coming years, as well as potential limitations and pitfalls that must be overcome to realize this future.

Artificial intelligence within the small bowel: are we lagging behind?

PURPOSE OF REVIEW

The use of artificial intelligence in small bowel capsule endoscopy is expanding. This review focusses on the use of artificial intelligence for small bowel pathology compared with human data and developments to date.

RECENT FINDINGS

The diagnosis and management of small bowel disease has been revolutionized with the advent of capsule endoscopy. Reading of capsule endoscopy videos however is time consuming with an average reading time of 40 min. Furthermore, the fatigued human eye may miss subtle lesions including indiscreet mucosal bulges. In recent years, artificial intelligence has made significant progress in the field of medicine including gastroenterology. Machine learning has enabled feature extraction and in combination with deep neural networks, image classification has now materialized for routine endoscopy for the clinician.

SUMMARY

Artificial intelligence is in built within the Navicam-Ankon capsule endoscopy reading system. This development will no doubt expand to other capsule endoscopy platforms and capsule endoscopies that are used to visualize other parts of the gastrointestinal tract as a standard. This wireless and patient friendly technique combined with rapid reading platforms with the help of artificial intelligence will become an attractive and viable choice to alter how patients are investigated in the future.

Artificial Intelligence in Endoscopy

Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.

Deep Learning for Automatic Identification and Characterization of the Bleeding Potential of Enteric Protruding Lesions in Capsule Endoscopy

Background and Aims

Capsule endoscopy (CE) revolutionized the study of the small intestine, overcoming the limitations of conventional endoscopy. Nevertheless, reviewing CE images is time-consuming. Convolutional Neural Networks (CNNs) are an artificial intelligence architecture with high performance levels for image analysis. Protruding lesions of the small intestine exhibit enormous morphologic diversity in CE images. We aimed to develop a CNN-based algorithm for automatic detection of varied small-bowel protruding lesions.

Methods

A CNN was developed using a pool of CE images containing protruding lesions or normal mucosa/other findings. A total of 2565 patients were included. These images were inserted into a CNN model with transfer learning. We evaluated the performance of the network by calculating its sensitivity, specificity, accuracy, positive predictive value, and negative predictive value.

Results

A CNN was developed based on a total of 21,320 CE images. Training and validation data sets comprising 80% and 20% of the total pool of images, respectively, were constructed for development and testing of the network. The algorithm automatically detected small-bowel protruding lesions with an accuracy of 97.1%. Our CNN had a sensitivity, specificity, positive, and negative predictive values of 95.9%, 97.1%, 83.0%, and 95.7%, respectively. The CNN operated at a rate of approximately 355 frames per second.

Conclusion

We developed an accurate CNN for automatic detection of enteric protruding lesions with a wide range of morphologies. The development of these tools may enhance the diagnostic efficiency of CE.

Image Aided Recognition of Wireless Capsule Endoscope Based on the Neural Network

Wireless capsule endoscopy is an important method for diagnosing small bowel diseases, but it will collect thousands of endoscopy images that need to be diagnosed. The analysis of these images requires a huge workload and may cause manual reading errors. This article attempts to use neural networks instead of artificial endoscopic image analysis to assist doctors in diagnosing and treating endoscopic images. First, in image preprocessing, the image is converted from RGB color mode to lab color mode, texture features are extracted for network training, and finally, the accuracy of the algorithm is verified. After inputting the retained endoscopic image verification set into the neural network algorithm, the conclusion is that the accuracy of the neural network model constructed in this study is 97.69%, which can effectively distinguish normal, benign lesions, and malignant tumors. Experimental studies have proved that the neural network algorithm can effectively assist the endoscopist's diagnosis and improve the diagnosis efficiency. This research hopes to provide a reference for the application of neural network algorithms in the field of endoscopic images.

Deep learning and colon capsule endoscopy: automatic detection of blood and colonic mucosal lesions using a convolutional neural network

Background and study aims  Colon capsule endoscopy (CCE) is a minimally invasive alternative to conventional colonoscopy. However, CCE produces long videos, making its analysis time-consuming and prone to errors. Convolutional neural networks (CNN) are artificial intelligence (AI) algorithms with high performance levels in image analysis. We aimed to develop a deep learning model for automatic identification and differentiation of significant colonic mucosal lesions and blood in CCE images. Patients and methods  A retrospective multicenter study including 124 CCE examinations was conducted for development of a CNN model, using a database of CCE images including anonymized images of patients with normal colon mucosa, several mucosal lesions (erosions, ulcers, vascular lesions and protruding lesions) and luminal blood. For CNN development, 9005 images (3,075 normal mucosa, 3,115 blood and 2,815 mucosal lesions) were ultimately extracted. Two image datasets were created and used for CNN training and validation. Results  The mean (standard deviation) sensitivity and specificity of the CNN were 96.3 % (3.9 %) and 98.2 % (1.8 %) Mucosal lesions were detected with a sensitivity of 92.0 % and a specificity of 98.5 %. Blood was detected with a sensitivity and specificity of 97.2 % and 99.9 %, respectively. The algorithm was 99.2 % sensitive and 99.6 % specific in distinguishing blood from mucosal lesions. The CNN processed 65 frames per second. Conclusions  This is the first CNN-based algorithm to accurately detect and distinguish colonic mucosal lesions and luminal blood in CCE images. AI may improve diagnostic and time efficiency of CCE exams, thus facilitating CCE adoption to routine clinical practice.

Evolution and New Horizons of Endoscopy in Inflammatory Bowel Diseases

Endoscopy is the mainstay of inflammatory bowel disease (IBD) evaluation and the pillar of colorectal cancer surveillance. Endoscopic equipment, both hardware and software, are advancing at an incredible pace. Virtual chromoendoscopy is now widely available, allowing the detection of subtle inflammatory changes, thus reducing the gap between endoscopic and histologic assessment. The progress in the field of artificial intelligence (AI) has been remarkable, and numerous applications are now in an advanced stage of development. Computer-aided diagnosis (CAD) systems are likely to reshape most of the evaluations that are now prerogative of human endoscopists. Furthermore, sophisticated tools such as endocytoscopy and probe-based confocal laser endomicroscopy (pCLE) are enhancing our assessment of inflammation and dysplasia. Finally, pCLE combined with molecular labeling could pave the way to a new paradigm of personalized medicine. This review aims to summarize the main changes that occurred in the field of IBD endoscopy and to explore the most promising novelties.

Application and prospect of artificial intelligence in digestive endoscopy

INTRODUCTION

With the progress of science and technology, artificial intelligence represented by deep learning has gradually begun to be applied in the medical field. Artificial intelligence has been applied to benign gastrointestinal lesions, tumors, early cancer, inflammatory bowel disease, gallbladder, pancreas, and other diseases. This review summarizes the latest research results on artificial intelligence in digestive endoscopy and discusses the prospect of artificial intelligence in digestive system diseases.

AREAS COVERED

We retrieved relevant documents on artificial intelligence in digestive tract diseases from PubMed and Medline. This review elaborates on the knowledge of computer-aided diagnosis in digestive endoscopy.

EXPERT OPINION

Artificial intelligence significantly improves diagnostic accuracy, reduces physicians' workload, and provides a shred of evidence for clinical diagnosis and treatment. Shortly, artificial intelligence will have high application value in the field of medicine.

Artificial intelligence and capsule endoscopy: automatic detection of vascular lesions using a convolutional neural network

Background

Capsule endoscopy (CE) is the first line for evaluation of patients with obscure gastrointestinal bleeding. A wide range of small intestinal vascular lesions with different hemorrhagic potential are frequently found in these patients. Nevertheless, reading CE exams is time-consuming and prone to errors. Convolutional neural networks (CNN) are artificial intelligence tools with high performance levels in image analysis. This study aimed to develop a CNN-based model for identification and differentiation of vascular lesions with distinct hemorrhagic potential in CE images.

Methods

The development of the CNN was based on a database of CE images. This database included images of normal small intestinal mucosa, red spots, and angiectasia/varices. The hemorrhagic risk was assessed by Saurin's classification. For CNN development, 11,588 images (9525 normal mucosa, 1026 red spots, and 1037 angiectasia/varices) were ultimately extracted. Two image datasets were created for CNN training and testing.

Results

The network was 91.8% sensitive and 95.9% specific for detection of vascular lesions, providing accurate predictions in 94.4% of cases. In particular, the CNN had a sensitivity and specificity of 97.1% and 95.3%, respectively, for detection of red spots. Detection of angiectasia/varices occurred with a sensitivity of 94.1% and a specificity of 95.1%. The CNN had a frame reading rate of 145 frames/sec.

Conclusions

The developed algorithm is the first CNN-based model to accurately detect and distinguish enteric vascular lesions with different hemorrhagic risk. CNN-assisted CE reading may improve the diagnosis of these lesions and overall CE efficiency.

Artificial intelligence in gastroenterology: A state-of-the-art review

The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.

Application of Artificial Intelligence to Clinical Practice in Inflammatory Bowel Disease - What the Clinician Needs to Know

Artificial intelligence [AI] techniques are quickly spreading across medicine as an analytical method to tackle challenging clinical questions. What were previously thought of as highly complex data sources, such as images or free text, are now becoming manageable. Novel analytical methods merge the latest developments in information technology infrastructure with advances in computer science. Once primarily associated with Silicon Valley, AI techniques are now making their way into medicine, including in the field of inflammatory bowel diseases [IBD]. Understanding potential applications and limitations of these techniques can be difficult, in particular for busy clinicians. In this article, we explain the basic terminologies and provide a particular focus on the foundations behind state-of-the-art AI methodologies in both imaging and text. We explore the growing applications of AI in medicine, with a specific focus on IBD to inform the practising gastroenterologist and IBD specialist. Finally, we outline possible future uses of these technologies in daily clinical practice.

Artificial Intelligence in Capsule Endoscopy: A Practical Guide to Its Past and Future Challenges

Artificial intelligence (AI) has revolutionized the medical diagnostic process of various diseases. Since the manual reading of capsule endoscopy videos is a time-intensive, error-prone process, computerized algorithms have been introduced to automate this process. Over the past decade, the evolution of convolutional neural network (CNN) enabled AI to detect multiple lesions simultaneously with increasing accuracy and sensitivity. Difficulty in validating CNN performance and unique characteristics of capsule endoscopy images make computer-aided reading systems in capsule endoscopy still on a preclinical level. Although AI technology can be used as an auxiliary second observer in capsule endoscopy, it is expected that in the near future, it will effectively reduce the reading time and ultimately become an independent, integrated reading system.

A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology

Artificial intelligence (AI) is rapidly becoming an essential tool in the medical field as well as in daily life. Recent developments in deep learning, a subfield of AI, have brought remarkable advances in image recognition, which facilitates improvement in the early detection of cancer by endoscopy, ultrasonography, and computed tomography. In addition, AI-assisted big data analysis represents a great step forward for precision medicine. This review provides an overview of AI technology, particularly for gastroenterology, hepatology, and pancreatology, to help clinicians utilize AI in the near future.

The role of small-bowel endoscopy in inflammatory bowel disease: an updated review on the state-of-the-art in 2021

The impact of small-bowel (SB) capsule endoscopy and device-assisted enteroscopy on clinical practice, since their introduction 2 decades ago, has been remarkable. These disruptive technologies have transformed the investigation and management of SB pathology and now have a firmly established place in guidelines and clinical algorithms. Furthermore, recent years have witnessed innovations, driven by the demand of new goals in the management of inflammatory bowel disease (IBD), such as mucosal healing and evolving strategies based on tight monitoring and accelerated escalation of care. These developments in SB endoscopy have also been paralleled by refinement in dedicated radiological SB imaging technologies. This updated review highlights the current state of the art and more recent innovations with a focus on their role in IBD.

Artificial intelligence in small intestinal diseases: Application and prospects

The small intestine is located in the middle of the gastrointestinal tract, so small intestinal diseases are more difficult to diagnose than other gastrointestinal diseases. However, with the extensive application of artificial intelligence in the field of small intestinal diseases, with its efficient learning capacities and computational power, artificial intelligence plays an important role in the auxiliary diagnosis and prognosis prediction based on the capsule endoscopy and other examination methods, which improves the accuracy of diagnosis and prediction and reduces the workload of doctors. In this review, a comprehensive retrieval was performed on articles published up to October 2020 from PubMed and other databases. Thereby the application status of artificial intelligence in small intestinal diseases was systematically introduced, and the challenges and prospects in this field were also analyzed.

Role of Artificial Intelligence in Video Capsule Endoscopy

Capsule endoscopy (CE) has been increasingly utilised in recent years as a minimally invasive tool to investigate the whole gastrointestinal (GI) tract and a range of capsules are currently available for evaluation of upper GI, small bowel, and lower GI pathology. Although CE is undoubtedly an invaluable test for the investigation of small bowel pathology, it presents considerable challenges and limitations, such as long and laborious reading times, risk of missing lesions, lack of bowel cleansing score and lack of locomotion. Artificial intelligence (AI) seems to be a promising tool that may help improve the performance metrics of CE, and consequently translate to better patient care. In the last decade, significant progress has been made to apply AI in the field of endoscopy, including CE. Although it is certain that AI will find soon its place in day-to-day endoscopy clinical practice, there are still some open questions and barriers limiting its widespread application. In this review, we provide some general information about AI, and outline recent advances in AI and CE, issues around implementation of AI in medical practice and potential future applications of AI-aided CE.

A Current and Newly Proposed Artificial Intelligence Algorithm for Reading Small Bowel Capsule Endoscopy

Small bowel capsule endoscopy (SBCE) is one of the most useful methods for diagnosing small bowel mucosal lesions. However, it takes a long time to interpret the capsule images. To solve this problem, artificial intelligence (AI) algorithms for SBCE readings are being actively studied. In this article, we analyzed several studies that applied AI algorithms to SBCE readings, such as automatic lesion detection, automatic classification of bowel cleanliness, and automatic compartmentalization of small bowels. In addition to automatic lesion detection using AI algorithms, a new direction of AI algorithms related to shorter reading times and improved lesion detection accuracy should be considered. Therefore, it is necessary to develop an integrated AI algorithm composed of algorithms with various functions in order to be used in clinical practice.

Development and Verification of a Deep Learning Algorithm to Evaluate Small-Bowel Preparation Quality

Capsule endoscopy (CE) quality control requires an objective scoring system to evaluate the preparation of the small bowel (SB). We propose a deep learning algorithm to calculate SB cleansing scores and verify the algorithm’s performance. A 5-point scoring system based on clarity of mucosal visualization was used to develop the deep learning algorithm (400,000 frames; 280,000 for training and 120,000 for testing). External validation was performed using additional CE cases (n = 50), and average cleansing scores (1.0 to 5.0) calculated using the algorithm were compared to clinical grades (A to C) assigned by clinicians. Test results obtained using 120,000 frames exhibited 93% accuracy. The separate CE case exhibited substantial agreement between the deep learning algorithm scores and clinicians’ assessments (Cohen’s kappa: 0.672). In the external validation, the cleansing score decreased with worsening clinical grade (scores of 3.9, 3.2, and 2.5 for grades A, B, and C, respectively, p < 0.001). Receiver operating characteristic curve analysis revealed that a cleansing score cut-off of 2.95 indicated clinically adequate preparation. This algorithm provides an objective and automated cleansing score for evaluating SB preparation for CE. The results of this study will serve as clinical evidence supporting the practical use of deep learning algorithms for evaluating SB preparation quality.

Application of artificial intelligence to endoscopy on common gastrointestinal benign diseases

Artificial intelligence (AI) has been widely involved in every aspect of healthcare in the preclinical stage. In the digestive system, AI has been trained to assist auxiliary examinations including histopathology, endoscopy, ultrasonography, computerized tomography, and magnetic resonance imaging in detection, diagnosis, classification, differentiation, prognosis, and quality control. In the field of endoscopy, the application of AI, such as automatic detection, diagnosis, classification, and invasion depth, in early gastrointestinal (GI) cancers has received wide attention. There is a paucity of studies of AI application on common GI benign diseases based on endoscopy. In the review, we provide an overview of AI applications to endoscopy on common GI benign diseases including in the esophagus, stomach, intestine, and colon. It indicates that AI will gradually become an indispensable part of normal endoscopic detection and diagnosis of common GI benign diseases as clinical data, algorithms, and other related work are constantly repeated and improved.

Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review

BACKGROUND

Artificial intelligence (AI) applications are growing at an unprecedented pace in health care, including disease diagnosis, triage or screening, risk analysis, surgical operations, and so forth. Despite a great deal of research in the development and validation of health care AI, only few applications have been actually implemented at the frontlines of clinical practice.

OBJECTIVE

The objective of this study was to systematically review AI applications that have been implemented in real-life clinical practice.

METHODS

We conducted a literature search in PubMed, Embase, Cochrane Central, and CINAHL to identify relevant articles published between January 2010 and May 2020. We also hand searched premier computer science journals and conferences as well as registered clinical trials. Studies were included if they reported AI applications that had been implemented in real-world clinical settings.

RESULTS

We identified 51 relevant studies that reported the implementation and evaluation of AI applications in clinical practice, of which 13 adopted a randomized controlled trial design and eight adopted an experimental design. The AI applications targeted various clinical tasks, such as screening or triage (n=16), disease diagnosis (n=16), risk analysis (n=14), and treatment (n=7). The most commonly addressed diseases and conditions were sepsis (n=6), breast cancer (n=5), diabetic retinopathy (n=4), and polyp and adenoma (n=4). Regarding the evaluation outcomes, we found that 26 studies examined the performance of AI applications in clinical settings, 33 studies examined the effect of AI applications on clinician outcomes, 14 studies examined the effect on patient outcomes, and one study examined the economic impact associated with AI implementation.

CONCLUSIONS

This review indicates that research on the clinical implementation of AI applications is still at an early stage despite the great potential. More research needs to assess the benefits and challenges associated with clinical AI applications through a more rigorous methodology.

Small Bowel Capsule Endoscopy and artificial intelligence: First or second reader?

Several machine learning algorithms have been developed in the past years with the aim to improve SBCE (Small Bowel Capsule Endoscopy) feasibility ensuring at the same time a high diagnostic accuracy. If past algorithms were affected by low performances and unsatisfactory accuracy, deep learning systems raised up the expectancy of effective AI (Artificial Intelligence) application in SBCE reading. Automatic detection and characterization of lesions, such as angioectasias, erosions and ulcers, would significantly shorten reading time other than improve reader attention during SBCE review in routine activity. It is debated whether AI can be used as first or second reader. This issue should be further investigated measuring accuracy and cost-effectiveness of AI systems. Currently, AI has been mostly evaluated as first reader. However, second reading may play an important role in SBCE training as well as for better characterizing lesions for which the first reader was uncertain.

Summary of The Third Capsule Endoscopy Global Summit

In order to emphasize the epidemic prevention during capsule endoscopy examinations, exhibit the latest achievements of capsule endoscopy, and strengthen international exchanges and cooperation in capsule endoscopy products, quality control, R&D, clinical applications, and talents, The Third Capsule Endoscopy Global Summit was held in Chongqing, China. The summit invited foreign experts to live online and remotely broadcast special academic speeches. The invited domestic experts brought the latest academic reports on the spot. A total of 17 medical experts presented a number of latest technologies and academic achievements in the field of capsule endoscopy from five levels. Professor Xue-Liang Jiang, President of the World Chinese Digestive Society and Editor-in-Chief of the World Chinese Journal of Digestology, was invited to give a report on the clinical application of capsule endoscopy.

Artificial intelligence and capsule endoscopy: unravelling the future

The applicability of artificial intelligence (AI) in gastroenterology is a hot topic because of its disruptive nature. Capsule endoscopy plays an important role in several areas of digestive pathology, namely in the investigation of obscure hemorrhagic lesions and the management of inflammatory bowel disease. Therefore, there is growing interest in the use of AI in capsule endoscopy. Several studies have demonstrated the enormous potential of using convolutional neural networks in various areas of capsule endoscopy. The exponential development of the usefulness of AI in capsule endoscopy requires consideration of its medium- and long-term impact on clinical practice. Indeed, the advent of deep learning in the field of capsule endoscopy, with its evolutionary character, could lead to a paradigm shift in clinical activity in this setting. In this review, we aim to illustrate the state of the art of AI in the field of capsule endoscopy.

Development of a deep learning-based software for calculating cleansing score in small bowel capsule endoscopy

A standardized small bowel (SB) cleansing scale is currently not available. The aim of this study was to develop an automated calculation software for SB cleansing score using deep learning. Consecutively performed capsule endoscopy cases were enrolled from three hospitals. A 5-step scoring system based on mucosal visibility was trained for deep learning in the training set. Performance of the trained software was evaluated in the validation set. Average cleansing score (1.0 to 5.0) by deep learning was compared to clinical grading (A to C) reviewed by clinicians. Cleansing scores decreased as clinical grading worsened (scores of 4.1, 3.5, and 2.9 for grades A, B, and C, respectively, P < 0.001). Adequate preparation was achieved for 91.7% of validation cases. The average cleansing score was significantly different between adequate and inadequate group (4.0 vs. 2.9, P < 0.001). ROC curve analysis revealed that a cut-off value of cleansing score at 3.25 had an AUC of 0.977. Diagnostic yields for small, hard-to-find lesions were associated with high cleansing scores (4.3 vs. 3.8, P < 0.001). We developed a novel scoring software which calculates objective, automated cleansing scores for SB preparation. The cut-off value we suggested provides a standard criterion for adequate bowel preparation as a quality indicator.