A virtual chromoendoscopy artificial intelligence system to detect endoscopic and histologic activity/remission and predict clinical outcomes in ulcerative colitis

Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease

Integrating artificial intelligence into inflammatory bowel disease (IBD) has the potential to revolutionise clinical practice and research. Artificial intelligence harnesses advanced algorithms to deliver accurate assessments of IBD endoscopy and histology, offering precise evaluations of disease activity, standardised scoring, and outcome prediction. Furthermore, artificial intelligence offers the potential for a holistic endo-histo-omics approach by interlacing and harmonising endoscopy, histology, and omics data towards precision medicine. The emerging applications of artificial intelligence could pave the way for personalised medicine in IBD, offering patient stratification for the most beneficial therapy with minimal risk. Although artificial intelligence holds promise, challenges remain, including data quality, standardisation, reproducibility, scarcity of randomised controlled trials, clinical implementation, ethical concerns, legal liability, and regulatory issues. The development of standardised guidelines and interdisciplinary collaboration, including policy makers and regulatory agencies, is crucial for addressing these challenges and advancing artificial intelligence in IBD clinical practice and trials.

How Artificial Intelligence Will Transform Clinical Care, Research, and Trials for Inflammatory Bowel Disease

Artificial intelligence (AI) refers to computer-based methodologies that use data to teach a computer to solve pre-defined tasks; these methods can be applied to identify patterns in large multi-modal data sources. AI applications in inflammatory bowel disease (IBD) includes predicting response to therapy, disease activity scoring of endoscopy, drug discovery, and identifying bowel damage in images. As a complex disease with entangled relationships between genomics, metabolomics, microbiome, and the environment, IBD stands to benefit greatly from methodologies that can handle this complexity. We describe current applications, critical challenges, and propose future directions of AI in IBD.

A novel artificial intelligence-assisted "vascular healing" diagnosis for prediction of future clinical relapse in patients with ulcerative colitis: a prospective cohort study (with video)

BACKGROUND AND AIMS

Image-enhanced endoscopy has attracted attention as a method for detecting inflammation and predicting outcomes in patients with ulcerative colitis (UC); however, the procedure requires specialist endoscopists. Artificial intelligence (AI)-assisted image-enhanced endoscopy may help nonexperts provide objective accurate predictions with the use of optical imaging. We aimed to develop a novel AI-based system using 8853 images from 167 patients with UC to diagnose "vascular-healing" and establish the role of AI-based vascular-healing for predicting the outcomes of patients with UC.

METHODS

This open-label prospective cohort study analyzed data for 104 patients with UC in clinical remission. Endoscopists performed colonoscopy using the AI system, which identified the target mucosa as AI-based vascular-active or vascular-healing. Mayo endoscopic subscore (MES), AI outputs, and histologic assessment were recorded for 6 colorectal segments from each patient. Patients were followed up for 12 months. Clinical relapse was defined as a partial Mayo score >2 RESULTS: The clinical relapse rate was significantly higher in the AI-based vascular-active group (23.9% [16/67]) compared with the AI-based vascular-healing group (3.0% [1/33)]; P = .01). In a subanalysis predicting clinical relapse in patients with MES ≤1, the area under the receiver operating characteristic curve for the combination of complete endoscopic remission and vascular healing (0.70) was increased compared with that for complete endoscopic remission alone (0.65).

CONCLUSIONS

AI-based vascular-healing diagnosis system may potentially be used to provide more confidence to physicians to accurately identify patients in remission of UC who would likely relapse rather than remain stable.

Artificial intelligence-assisted colonoscopy to identify histologic remission and predict the outcomes of patients with ulcerative colitis: A systematic review

This systematic review evaluated the current status of AI-assisted colonoscopy to identify histologic remission and predict the clinical outcomes of patients with ulcerative colitis. The use of artificial intelligence (AI) has increased substantially across several medical fields, including gastrointestinal endoscopy. Evidence suggests that it may be helpful to predict histologic remission and relapse, which would be beneficial because current histological diagnosis is limited by the inconvenience of obtaining biopsies and the high cost and time-intensiveness of pathological diagnosis. MEDLINE and the Cochrane Central Register of Controlled Trials were searched for studies published between January 1, 2000, and October 31, 2023. Nine studies fulfilled the selection criteria and were included; five evaluated the prediction of histologic remission, two assessed the prediction of clinical outcomes, and two evaluated both. Seven were prospective observational or cohort studies, while two were retrospective observational studies. No randomized controlled trials were identified. AI-assisted colonoscopy demonstrated sensitivity between 65 %-98 % and specificity values of 80 %-97 % for identifying histologic remission. Furthermore, it was able to predict future relapse in patients with ulcerative colitis. However, several challenges and barriers still exist to its routine clinical application, which should be overcome before the true potential of AI-assisted colonoscopy can be fully realized.

The development of artificial intelligence in the histological diagnosis of Inflammatory Bowel Disease (IBD-AI)

BACKGROUND

Inflammatory bowel disease (IBD) includes Crohn's Disease (CD) and Ulcerative Colitis (UC). Correct diagnosis requires the identification of precise morphological features such basal plasmacytosis. However, histopathological interpretation can be challenging, and it is subject to high variability.

AIM

The IBD-Artificial Intelligence (AI) project aims at the development of an AI-based evaluation system to support the diagnosis of IBD, semi-automatically quantifying basal plasmacytosis.

METHODS

A deep learning model was trained to detect and quantify plasma cells on a public dataset of 4981 annotated images. The model was then tested on an external validation cohort of 356 intestinal biopsies of CD, UC and healthy controls. AI diagnostic performance was calculated compared to human gold standard.

RESULTS

The system correctly found that CD and UC samples had a greater prevalence of basal plasma cells with mean number of PCs within ROIs of 38.22 (95 % CI: 31.73, 49.04) for CD, 55.16 (46.57, 65.93) for UC, and 17.25 (CI: 12.17, 27.05) for controls. Overall, OR=4.968 (CI: 1.835, 14.638) was found for IBD compared to normal mucosa (CD: +59 %; UC: +129 %). Additionally, as expected, UC samples were found to have more plasma cells in colon than CD cases.

CONCLUSION

Our model accurately replicated human assessment of basal plasmacytosis, underscoring the value of AI models as a potential aid IBD diagnosis.

Opening the doors of precision medicine: novel tools to assess intestinal barrier in inflammatory bowel disease and colitis-associated neoplasia

Mounting evidence underscores the pivotal role of the intestinal barrier and its convoluted network with diet and intestinal microbiome in the pathogenesis of inflammatory bowel disease (IBD) and colitis-associated colorectal cancer (CRC). Moreover, the bidirectional association of the intestinal barrier with the liver and brain, known as the gut-brain axis, plays a crucial role in developing complications, including extraintestinal manifestations of IBD and CRC metastasis. Consequently, barrier healing represents a crucial therapeutic target in these inflammatory-dependent disorders, with barrier assessment predicting disease outcomes, response to therapy and extraintestinal manifestations.New advanced technologies are revolutionising our understanding of the barrier paradigm, enabling the accurate assessment of the intestinal barrier and aiding in unravelling the complexity of the gut-brain axis. Cutting-edge endoscopic imaging techniques, such as ultra-high magnification endocytoscopy and probe-based confocal laser endomicroscopy, are new technologies allowing real-time exploration of the 'cellular' intestinal barrier. Additionally, novel advanced spatial imaging technology platforms, including multispectral imaging, upconversion nanoparticles, digital spatial profiling, optical spectroscopy and mass cytometry, enable a deep and comprehensive assessment of the 'molecular' and 'ultrastructural' barrier. In this promising landscape, artificial intelligence plays a pivotal role in standardising and integrating these novel tools, thereby contributing to barrier assessment and prediction of outcomes.Looking ahead, this integrated and comprehensive approach holds the promise of uncovering new therapeutic targets, breaking the therapeutic ceiling in IBD. Novel molecules, dietary interventions and microbiome modulation strategies aim to restore, reinforce, or modulate the gut-brain axis. These advancements have the potential for transformative and personalised approaches to managing IBD.

The Role of Artificial Intelligence in the Diagnosis and Treatment of Ulcerative Colitis

BACKGROUND AND OBJECTIVES

This review aims to delve into the role of artificial intelligence in medicine. Ulcerative colitis (UC) is a chronic, inflammatory bowel disease (IBD) characterized by superficial mucosal inflammation, rectal bleeding, diarrhoea and abdominal pain. By identifying the challenges inherent in UC diagnosis, we seek to highlight the potential impact of artificial intelligence on enhancing both diagnosis and treatment methodologies for this condition.

METHOD

A targeted, non-systematic review of literature relating to ulcerative colitis was undertaken. The PubMed and Scopus databases were searched to categorize a well-rounded understanding of the field of artificial intelligence and its developing role in the diagnosis and treatment of ulcerative colitis. Articles that were thought to be relevant were included. This paper only included articles published in English.

RESULTS

Artificial intelligence (AI) refers to computer algorithms capable of learning, problem solving and decision-making. Throughout our review, we highlighted the role and importance of artificial intelligence in modern medicine, emphasizing its role in diagnosis through AI-assisted endoscopies and histology analysis and its enhancements in the treatment of ulcerative colitis. Despite these advances, AI is still hindered due to its current lack of adaptability to real-world scenarios and its difficulty in widespread data availability, which hinders the growth of AI-led data analysis.

CONCLUSIONS

When considering the potential of artificial intelligence, its ability to enhance patient care from a diagnostic and therapeutic perspective shows signs of promise. For the true utilization of artificial intelligence, some roadblocks must be addressed. The datasets available to AI may not truly reflect the real-world, which would prevent its impact in all clinical scenarios when dealing with a spectrum of patients with different backgrounds and presenting factors. Considering this, the shift in medical diagnostics and therapeutics is coinciding with evolving technology. With a continuous advancement in artificial intelligence programming and a perpetual surge in patient datasets, these networks can be further enhanced and supplemented with a greater cohort, enabling better outcomes and prediction models for the future of modern medicine.

Present and future of endoscopy precision for inflammatory bowel disease

Several advanced imaging techniques are now available for endoscopists managing inflammatory bowel disease (IBD) patients. These tools, including dye-based and virtual chromoendoscopy, probe-based confocal laser endomicroscopy and endocytoscopy, are increasingly innovative applications in clinical practice. They allow for a more in-depth and refined evaluation of the mucosal and vascular bowel surface, getting closer to histology. They have demonstrated a remarkable ability in assessing intestinal inflammation, histologic remission, and predicting relapse and favorable long-term outcomes. In addition, the future application of molecular endoscopy to predict biological drug responses has yielded preliminary but encouraging results. Furthermore, these techniques are crucial in detecting and characterizing IBD-related dysplasia, assisting endoscopic mucosal resection and submucosal dissection towards a surgery-sparing approach. Artificial intelligence (AI) holds great potential in this promising landscape, as it can provide an objective and reproducible assessment of inflammation and dysplasia. Moreover, it can improve the prediction of outcomes and aid in subsequent therapeutic decision-making. This review aims to summarize the promising role of state-of-the-art advanced endoscopic techniques and related AI-enabled models for managing IBD, paving the way for precision medicine.

Artificial intelligence in endoscopy related to inflammatory bowel disease: A systematic review

BACKGROUND AND OBJECTIVES

In spite of rapid growth of artificial intelligence (AI) in digestive endoscopy in lesion detection and characterization, the role of AI in inflammatory bowel disease (IBD) endoscopy is not clearly defined. We aimed at systematically reviewing the role of AI in IBD endoscopy and identifying future research areas.

METHODS

We searched the PubMed and Embase database using keywords ("artificial intelligence" OR "machine learning" OR "computer-aided" OR "convolutional neural network") AND ("inflammatory bowel disease" OR "ulcerative colitis" OR "Crohn's") AND ("endoscopy" or "colonoscopy" or "capsule endoscopy" or "device assisted enteroscopy") between 1975 and September 2023 and identified 62 original articles for detailed review. Review articles, consensus guidelines, case reports/series, editorials, letter to the editor, non-peer-reviewed pre-prints and conference abstracts were excluded. The quality of the included studies was assessed using the MI-CLAIM checklist.

RESULTS

The accuracy of AI models (25 studies) to assess ulcerative colitis (UC) endoscopic activity ranged between 86.54% and 94.5%. AI-assisted capsule endoscopy reading (12 studies) substantially reduced analyzable images and reading time with excellent accuracy (90.5% to 99.9%). AI-assisted analysis of colonoscopic images can help differentiate IBD from non-IBD, UC from non-UC and UC from Crohn's disease (CD) (three studies) with 72.1%, 98.3% and > 90% accuracy, respectively. AI models based on non-invasive clinical and radiologic parameters could predict endoscopic activity (three studies). AI-assisted virtual chromoendoscopy (four studies) could predict histologic remission and long-term outcomes. Computer-assisted detection (CADe) of dysplasia (two studies) is feasible along with AI-based differentiation of high from low-grade IBD neoplasia (79% accuracy). AI is effective in linking electronic medical record data (two studies) with colonoscopic videos to facilitate widespread machine learning.

CONCLUSION

AI-assisted IBD endoscopy has the potential to impact clinical management by automated detection and characterization of endoscopic lesions. Large, multi-center, prospective studies and commercially available IBD-specific endoscopic AI algorithms are warranted.

Impact of artificial intelligence on prognosis, shared decision-making, and precision medicine for patients with inflammatory bowel disease: a perspective and expert opinion

INTRODUCTION

Artificial intelligence (AI) is expected to impact all facets of inflammatory bowel disease (IBD) management, including disease assessment, treatment decisions, discovery and development of new biomarkers and therapeutics, as well as clinician-patient communication.

AREAS COVERED

This perspective paper provides an overview of the application of AI in the clinical management of IBD through a review of the currently available AI models that could be potential tools for prognosis, shared decision-making, and precision medicine. This overview covers models that measure treatment response based on statistical or machine-learning methods, or a combination of the two. We briefly discuss a computational model that allows integration of immune/biological system knowledge with mathematical modeling and also involves a 'digital twin', which allows measurement of temporal trends in mucosal inflammatory activity for predicting treatment response. A viewpoint on AI-enabled wearables and nearables and their use to improve IBD management is also included.

EXPERT OPINION

Although challenges regarding data quality, privacy, and security; ethical concerns; technical limitations; and regulatory barriers remain to be fully addressed, a growing body of evidence suggests a tremendous potential for integration of AI into daily clinical practice to enable precision medicine and shared decision-making.

Evaluation of Disease Activity in Inflammatory Bowel Disease: Diagnostic Tools in the Assessment of Histological Healing

Inflammatory bowel disease (IBD) comprises two types of chronic intestinal disorders: Crohn's disease and ulcerative colitis. In long-standing ulcerative colitis disease activity, histological persistent inflammation has been linked to an increased risk of relapse, and long-term corticosteroid use, even when endoscopic remission is reached. In Crohn's disease, the discontinuous nature of lesions and transmural inflammation have limited the standardized histological assessment. The current evidence from research proposes that besides clinical and endoscopic healing, the achievement of histological healing constitutes an endpoint to assess disease activity and remission in IBD patients concerning better long-term disease outcomes. Histological alterations may persist even in the absence of endoscopic lesions. For these reasons, new advanced techniques promise to revolutionize the field of IBD by improving the endoscopic and histologic assessment, disease characterization, and ultimately patient care, with an established role in daily practice for objective assessment of lesions. This review outlines the importance of including microscopic evaluation in IBD, highlighting the clinical benefits of a deep state of disease remission using validated diagnostic methods and scoring systems for daily clinical practice.

Endoscopy in IBD: When and How?

Endoscopy is an essential tool supporting inflammatory bowel disease diagnosis, and ileocolonoscopy is essential to the diagnostic process because it allows for histological sampling. A decent description of endoscopic lesions may lead to a correct final diagnosis up to 89% of the time. Moreover, endoscopy is key to evaluating endoscopic severity, which in both Crohn's disease and ulcerative colitis is associated with worse disease outcomes (e.g., more frequent advanced therapy requirements or more frequent hospitalizations and surgeries). Endoscopic severity should be reported according to validated endoscopic scores, such as the Mayo endoscopic subscore (MES) or the ulcerative colitis endoscopic index of severity (UCEIS) for ulcerative colitis, the Rutgeerts score for postoperative Crohn's recurrence, and the Crohn's disease endoscopic index of severity (CDEIS) or the simplified endoscopic score for Crohn's disease (SES-CD) for luminal Crohn's disease activity. The measuring of endoscopic activity has become a regulatory agency requirement to increase the objective evaluation of disease activity and drug response. In recent years, the central reviewing of endoscopic videos has become a standard for clinical trials. However, the adjudication paradigm and the type of endoscopic reading may substantially affect trial outcomes, and the reproducibility of all endoscopic scores is not perfect as they require the interpretation of intrinsically subjective images. This paper reviews and discusses the available evidence on inflammatory bowel disease endoscopy.

Current status of image-enhanced endoscopy in inflammatory bowel disease

In inflammatory bowel disease (IBD), chronic inflammation leads to unfavorable clinical outcomes and increases the risk of developing colorectal neoplasm (CRN); thereby highlighting the importance of endoscopically evaluating disease activity as well as detecting and characterizing CRN in patients with IBD. With recent advances in image-enhanced endoscopic (IEE) technologies, especially virtual chromoendoscopy (VCE) platforms, this review discusses state-of-the-art IEE techniques and their applicability in assessing disease activity and surveillance colonoscopy in patients with IBD. Among various IEE, VCE demonstrated the capacity to identify quiescent disease activity. And endoscopic remission defined by the new scoring system using VCE platform better predicted clinical outcomes, which may benefit the tailoring of therapeutic strategies in patients with IBD. High-definition dye-chromoendoscopy (HD-DCE) is numerically superior to high-definition white light endoscopy (HD-WLE) in detecting CRN in IBD; however, discrepancy is observed in the statistical significance. VCE showed comparable performance in detecting dysplasia to HD-WLE or DCE and potential for optical diagnosis to differentiate neoplastic from nonneoplastic lesions during surveillance colonoscopy. Applying these novel advanced IEE technologies would provide opportunities for personalized medicine in IBD and optimal treatment of CRN in patients with IBD.

Next-Generation Endoscopy in Inflammatory Bowel Disease

Endoscopic healing is recognized as a primary treatment goal in Inflammatory Bowel Disease (IBD). However, endoscopic remission may not reflect histological remission, which is crucial to achieving favorable long-term outcomes. The development of new advanced techniques has revolutionized the field of IBD assessment and management. These tools can accurately assess vascular and mucosal features, drawing endoscopy closer to histology. Moreover, they can enhance the detection and characterization of IBD-related dysplasia. Given the persistent challenge of interobserver variability, a more standardized approach to endoscopy is warranted, and the integration of artificial intelligence (AI) holds promise for addressing this limitation. Additionally, although molecular endoscopy is still in its infancy, it is a promising tool to forecast response to therapy. This review provides an overview of advanced endoscopic techniques, including dye-based and dye-less chromoendoscopy, and in vivo histological examinations with probe-based confocal laser endomicroscopy and endocytoscopy. The remarkable contribution of these tools to IBD management, especially when integrated with AI, is discussed. Specific attention is given to their role in improving disease assessment, detection, and characterization of IBD-associated lesions, and predicting disease-related outcomes.

New Technologies in Digestive Endoscopy for Ulcerative Colitis Patients

Ulcerative colitis (UC) is a chronic inflammatory bowel disease primarily affecting the colon and rectum. Endoscopy plays a crucial role in the diagnosis and management of UC. Recent advancements in endoscopic technology, including chromoendoscopy, confocal laser endomicroscopy, endocytoscopy and the use of artificial intelligence, have revolutionized the assessment and treatment of UC patients. These innovative techniques enable early detection of dysplasia and cancer, more precise characterization of disease extent and severity and more targeted biopsies, leading to improved diagnosis and disease monitoring. Furthermore, these advancements have significant implications for therapeutic decision making, empowering clinicians to carefully consider a range of treatment options, including pharmacological therapies, endoscopic interventions and surgical approaches. In this review, we provide an overview of the latest endoscopic technologies and their applications for diagnosing and monitoring UC. We also discuss their impact on treatment decision making, highlighting the potential benefits and limitations of each technique.

Artificial intelligence and inflammatory bowel disease: Where are we going?

Inflammatory bowel diseases, namely ulcerative colitis and Crohn’s disease, are chronic and relapsing conditions that pose a growing burden on healthcare systems worldwide. Because of their complex and partly unknown etiology and pathogenesis, the management of ulcerative colitis and Crohn’s disease can prove challenging not only from a clinical point of view but also for resource optimization. Artificial intelligence, an umbrella term that encompasses any cognitive function developed by machines for learning or problem solving, and its subsets machine learning and deep learning are becoming ever more essential tools with a plethora of applications in most medical specialties. In this regard gastroenterology is no exception, and due to the importance of endoscopy and imaging numerous clinical studies have been gradually highlighting the relevant role that artificial intelligence has in inflammatory bowel diseases as well. The aim of this review was to summarize the most recent evidence on the use of artificial intelligence in inflammatory bowel diseases in various contexts such as diagnosis, follow-up, treatment, prognosis, cancer surveillance, data collection, and analysis. Moreover, insights into the potential further developments in this field and their effects on future clinical practice were discussed.

Technological advances in inflammatory bowel disease endoscopy and histology

Accurate disease characterization is the pillar of modern treatment of inflammatory bowel disease (IBD) and endoscopy is the mainstay of disease assessment and colorectal cancer surveillance. Recent technological progress has enhanced and expanded the use of endoscopy in IBD. In particular, numerous artificial intelligence (AI)-powered systems have shown to support human endoscopists' evaluations, improving accuracy and consistency while saving time. Moreover, advanced optical technologies such as endocytoscopy (EC), allowing high magnification in vivo, can bridge endoscopy with histology. Furthermore, molecular imaging, through probe based confocal laser endomicroscopy allows the real-time detection of specific biomarkers on gastrointestinal surface, and could be used to predict therapeutic response, paving the way to precision medicine. In parallel, as the applications of AI spread, computers are positioned to resolve some of the limitations of human histopathology evaluation, such as interobserver variability and inconsistencies in assessment. The aim of this review is to summarize the most promising advances in endoscopic and histologic assessment of IBD.