Novel deep learning-based computer-aided diagnosis system for predicting inflammatory activity in ulcerative colitis

Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease

Integrating artificial intelligence into inflammatory bowel disease (IBD) has the potential to revolutionise clinical practice and research. Artificial intelligence harnesses advanced algorithms to deliver accurate assessments of IBD endoscopy and histology, offering precise evaluations of disease activity, standardised scoring, and outcome prediction. Furthermore, artificial intelligence offers the potential for a holistic endo-histo-omics approach by interlacing and harmonising endoscopy, histology, and omics data towards precision medicine. The emerging applications of artificial intelligence could pave the way for personalised medicine in IBD, offering patient stratification for the most beneficial therapy with minimal risk. Although artificial intelligence holds promise, challenges remain, including data quality, standardisation, reproducibility, scarcity of randomised controlled trials, clinical implementation, ethical concerns, legal liability, and regulatory issues. The development of standardised guidelines and interdisciplinary collaboration, including policy makers and regulatory agencies, is crucial for addressing these challenges and advancing artificial intelligence in IBD clinical practice and trials.

Deep learning-based lesion detection and severity grading of small-bowel Crohn's disease ulcers on double-balloon endoscopy images

BACKGROUND AND AIMS

Double-balloon endoscopy (DBE) is widely used in diagnosing small-bowel Crohn's disease (CD). However, CD misdiagnosis frequently occurs if inexperienced endoscopists cannot accurately detect the lesions. The CD evaluation may also be inaccurate owing to the subjectivity of endoscopists. This study aimed to use artificial intelligence (AI) to accurately detect and objectively assess small-bowel CD for more refined disease management.

METHODS

We collected 28,155 small-bowel DBE images from 628 patients from January 2018 to December 2022. Four expert gastroenterologists labeled the images, and at least 2 endoscopists made the final decision with agreement. A state-of-the-art deep learning model, EfficientNet-b5, was trained to detect CD lesions and evaluate CD ulcers. The detection included lesions of ulcer, noninflammatory stenosis, and inflammatory stenosis. Ulcer grading included ulcerated surface, ulcer size, and ulcer depth. A comparison of AI model performance with endoscopists was performed.

RESULTS

The EfficientNet-b5 achieved high accuracies of 96.3% (95% confidence interval [CI], 95.7%-96.7%), 95.7% (95% CI, 95.1%-96.2%), and 96.7% (95% CI, 96.2%-97.2%) for the detection of ulcers, noninflammatory stenosis, and inflammatory stenosis, respectively. In ulcer grading, the EfficientNet-b5 exhibited average accuracies of 87.3% (95% CI, 84.6%-89.6%) for grading the ulcerated surface, 87.8% (95% CI, 85.0%-90.2%) for grading the size of ulcers, and 85.2% (95% CI, 83.2%-87.0%) for ulcer depth assessment.

CONCLUSIONS

The EfficientNet-b5 achieved high accuracy in detecting CD lesions and grading CD ulcers. The AI model can provide expert-level accuracy and objective evaluation of small-bowel CD to optimize the clinical treatment plans.

Artificial intelligence in endoscopy related to inflammatory bowel disease: A systematic review

BACKGROUND AND OBJECTIVES

In spite of rapid growth of artificial intelligence (AI) in digestive endoscopy in lesion detection and characterization, the role of AI in inflammatory bowel disease (IBD) endoscopy is not clearly defined. We aimed at systematically reviewing the role of AI in IBD endoscopy and identifying future research areas.

METHODS

We searched the PubMed and Embase database using keywords ("artificial intelligence" OR "machine learning" OR "computer-aided" OR "convolutional neural network") AND ("inflammatory bowel disease" OR "ulcerative colitis" OR "Crohn's") AND ("endoscopy" or "colonoscopy" or "capsule endoscopy" or "device assisted enteroscopy") between 1975 and September 2023 and identified 62 original articles for detailed review. Review articles, consensus guidelines, case reports/series, editorials, letter to the editor, non-peer-reviewed pre-prints and conference abstracts were excluded. The quality of the included studies was assessed using the MI-CLAIM checklist.

RESULTS

The accuracy of AI models (25 studies) to assess ulcerative colitis (UC) endoscopic activity ranged between 86.54% and 94.5%. AI-assisted capsule endoscopy reading (12 studies) substantially reduced analyzable images and reading time with excellent accuracy (90.5% to 99.9%). AI-assisted analysis of colonoscopic images can help differentiate IBD from non-IBD, UC from non-UC and UC from Crohn's disease (CD) (three studies) with 72.1%, 98.3% and > 90% accuracy, respectively. AI models based on non-invasive clinical and radiologic parameters could predict endoscopic activity (three studies). AI-assisted virtual chromoendoscopy (four studies) could predict histologic remission and long-term outcomes. Computer-assisted detection (CADe) of dysplasia (two studies) is feasible along with AI-based differentiation of high from low-grade IBD neoplasia (79% accuracy). AI is effective in linking electronic medical record data (two studies) with colonoscopic videos to facilitate widespread machine learning.

CONCLUSION

AI-assisted IBD endoscopy has the potential to impact clinical management by automated detection and characterization of endoscopic lesions. Large, multi-center, prospective studies and commercially available IBD-specific endoscopic AI algorithms are warranted.

The 2022 top 10 list of endoscopy topics in medical publishing: an annual review by the American Society for Gastrointestinal Endoscopy Editorial Board

Using a systematic literature search of original articles published during 2022 in Gastrointestinal Endoscopy and other high-impact medical and gastroenterology journals, the 10-member Editorial Board of the American Society for Gastrointestinal Endoscopy composed a list of the 10 most significant topic areas in GI endoscopy during the study year. Each Editorial Board member was directed to consider 3 criteria in generating candidate lists-significance, novelty, and global impact on clinical practice-and subject matter consensus was facilitated by the Chair through electronic voting. The 10 identified areas collectively represent advances in the following endoscopic spheres: artificial intelligence, endoscopic submucosal dissection, Barrett's esophagus, interventional EUS, endoscopic resection techniques, pancreaticobiliary endoscopy, management of acute pancreatitis, endoscopic environmental sustainability, the NordICC trial, and spiral enteroscopy. Each board member was assigned a consensus topic area around which to summarize relevant important articles, thereby generating this précis of the "top 10" endoscopic advances of 2022.

A systematic review and meta-analysis of artificial intelligence-diagnosed endoscopic remission in ulcerative colitis

Endoscopic remission is an important therapeutic goal in ulcerative colitis (UC). The Ulcerative Colitis Endoscopic Index of Severity (UCEIS) and Mayo Endoscopic Score (MES) are the commonly used endoscopic scoring criteria. This systematic review and meta-analysis aimed to evaluate the accuracy of artificial intelligence (AI) in diagnosing endoscopic remission in UC. We also performed a meta-analysis of each of the four endoscopic remission criteria (UCEIS = 0, MES = 0, UCEIS = <1, MES = <1). Eighteen studies involving 13,687 patients were included. The combined sensitivity and specificity of AI for diagnosing endoscopic remission in UC was 87% (95% confidence interval [CI]:81-92%) and 92% (95% CI: 89-94%), respectively. The area under the curve (AUC) was 0.96 (95% CI: 0.94-0.97). The results showed that the AI model performed well regardless of which criteria were used to define endoscopic remission of UC.

Data-driven decision-making for precision diagnosis of digestive diseases

Modern omics technologies can generate massive amounts of biomedical data, providing unprecedented opportunities for individualized precision medicine. However, traditional statistical methods cannot effectively process and utilize such big data. To meet this new challenge, machine learning algorithms have been developed and applied rapidly in recent years, which are capable of reducing dimensionality, extracting features, organizing data and forming automatable data-driven clinical decision systems. Data-driven clinical decision-making have promising applications in precision medicine and has been studied in digestive diseases, including early diagnosis and screening, molecular typing, staging and stratification of digestive malignancies, as well as precise diagnosis of Crohn's disease, auxiliary diagnosis of imaging and endoscopy, differential diagnosis of cystic lesions, etiology discrimination of acute abdominal pain, stratification of upper gastrointestinal bleeding (UGIB), and real-time diagnosis of esophageal motility function, showing good application prospects. Herein, we reviewed the recent progress of data-driven clinical decision making in precision diagnosis of digestive diseases and discussed the limitations of data-driven decision making after a brief introduction of methods for data-driven decision making.

Next-Generation Endoscopy in Inflammatory Bowel Disease

Endoscopic healing is recognized as a primary treatment goal in Inflammatory Bowel Disease (IBD). However, endoscopic remission may not reflect histological remission, which is crucial to achieving favorable long-term outcomes. The development of new advanced techniques has revolutionized the field of IBD assessment and management. These tools can accurately assess vascular and mucosal features, drawing endoscopy closer to histology. Moreover, they can enhance the detection and characterization of IBD-related dysplasia. Given the persistent challenge of interobserver variability, a more standardized approach to endoscopy is warranted, and the integration of artificial intelligence (AI) holds promise for addressing this limitation. Additionally, although molecular endoscopy is still in its infancy, it is a promising tool to forecast response to therapy. This review provides an overview of advanced endoscopic techniques, including dye-based and dye-less chromoendoscopy, and in vivo histological examinations with probe-based confocal laser endomicroscopy and endocytoscopy. The remarkable contribution of these tools to IBD management, especially when integrated with AI, is discussed. Specific attention is given to their role in improving disease assessment, detection, and characterization of IBD-associated lesions, and predicting disease-related outcomes.

New Technologies in Digestive Endoscopy for Ulcerative Colitis Patients

Ulcerative colitis (UC) is a chronic inflammatory bowel disease primarily affecting the colon and rectum. Endoscopy plays a crucial role in the diagnosis and management of UC. Recent advancements in endoscopic technology, including chromoendoscopy, confocal laser endomicroscopy, endocytoscopy and the use of artificial intelligence, have revolutionized the assessment and treatment of UC patients. These innovative techniques enable early detection of dysplasia and cancer, more precise characterization of disease extent and severity and more targeted biopsies, leading to improved diagnosis and disease monitoring. Furthermore, these advancements have significant implications for therapeutic decision making, empowering clinicians to carefully consider a range of treatment options, including pharmacological therapies, endoscopic interventions and surgical approaches. In this review, we provide an overview of the latest endoscopic technologies and their applications for diagnosing and monitoring UC. We also discuss their impact on treatment decision making, highlighting the potential benefits and limitations of each technique.

Artificial intelligence in digestive endoscopy: recent advances

PURPOSE OF REVIEW

With the incessant advances in information technology and its implications in all domains of our life, artificial intelligence (AI) started to emerge as a need for better machine performance. How it can help endoscopists and what are the areas of interest in improving both diagnostic and therapeutic endoscopy in each part of the gastrointestinal (GI) tract. What are the recent benefits and clinical usefulness of this new technology in daily endoscopic practice.

RECENT FINDINGS

The two main AI systems categories are computer-assisted detection 'CADe' for lesion detection and computer-assisted diagnosis 'CADx' for optical biopsy and lesion characterization. Multiple softwares are now implemented in endoscopy practice. Other AI systems offer therapeutic assistance such as lesion delineation for complete endoscopic resection or prediction of possible lymphanode after endoscopic treatment. Quality assurance is the coming step with complete monitoring of high-quality colonoscopy. In all cases it is a computer-aid endoscopy as the overall result rely on the physician. Video capsule endoscopy is the unique example were the computer conduct the device, store multiple images, and perform accurate diagnosis.

SUMMARY

AI is a breakthrough in digestive endoscopy. Screening gastric and colonic cancer detection should be improved especially outside of expert's centers. Prospective and multicenter trials are mandatory before introducing new software in clinical practice.

Advances in Imaging of Inflammation, Fibrosis, and Cancer in the Gastrointestinal Tract

Gastrointestinal disease is prevalent and broad, manifesting itself in a variety of ways, including inflammation, fibrosis, infection, and cancer. However, historically, diagnostic technologies have exhibited limitations, especially with regard to diagnostic uncertainty. Despite development of newly emerging technologies such as optoacoustic imaging, many recent advancements have focused on improving upon pre-existing modalities such as ultrasound, computed tomography, magnetic resonance imaging, and endoscopy. These advancements include utilization of machine learning models, biomarkers, new technological applications such as diffusion weighted imaging, and new techniques such as transrectal ultrasound. This review discusses assessment of disease processes using imaging strategies for the detection and monitoring of inflammation, fibrosis, and cancer in the context of gastrointestinal disease. Specifically, we include ulcerative colitis, Crohn's disease, diverticulitis, celiac disease, graft vs. host disease, intestinal fibrosis, colorectal stricture, gastric cancer, and colorectal cancer. We address some of the most recent and promising advancements for improvement of gastrointestinal imaging, including unique discussions of such advancements with regard to imaging of fibrosis and differentiation between similar disease processes.