Utilizing Deep Learning to Analyze Whole Slide Images of Colonic Biopsies for Associations Between Eosinophil Density and Clinicopathologic Features in Active Ulcerative Colitis

Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease

Integrating artificial intelligence into inflammatory bowel disease (IBD) has the potential to revolutionise clinical practice and research. Artificial intelligence harnesses advanced algorithms to deliver accurate assessments of IBD endoscopy and histology, offering precise evaluations of disease activity, standardised scoring, and outcome prediction. Furthermore, artificial intelligence offers the potential for a holistic endo-histo-omics approach by interlacing and harmonising endoscopy, histology, and omics data towards precision medicine. The emerging applications of artificial intelligence could pave the way for personalised medicine in IBD, offering patient stratification for the most beneficial therapy with minimal risk. Although artificial intelligence holds promise, challenges remain, including data quality, standardisation, reproducibility, scarcity of randomised controlled trials, clinical implementation, ethical concerns, legal liability, and regulatory issues. The development of standardised guidelines and interdisciplinary collaboration, including policy makers and regulatory agencies, is crucial for addressing these challenges and advancing artificial intelligence in IBD clinical practice and trials.

How Artificial Intelligence Will Transform Clinical Care, Research, and Trials for Inflammatory Bowel Disease

Artificial intelligence (AI) refers to computer-based methodologies that use data to teach a computer to solve pre-defined tasks; these methods can be applied to identify patterns in large multi-modal data sources. AI applications in inflammatory bowel disease (IBD) includes predicting response to therapy, disease activity scoring of endoscopy, drug discovery, and identifying bowel damage in images. As a complex disease with entangled relationships between genomics, metabolomics, microbiome, and the environment, IBD stands to benefit greatly from methodologies that can handle this complexity. We describe current applications, critical challenges, and propose future directions of AI in IBD.

Gas-propelled nanomotors alleviate colitis through the regulation of intestinal immunoenvironment-hematopexis-microbiota circuits

The progression of ulcerative colitis (UC) is associated with immunologic derangement, intestinal hemorrhage, and microbiota imbalance. While traditional medications mainly focus on mitigating inflammation, it remains challenging to address multiple symptoms. Here, a versatile gas-propelled nanomotor was constructed by mild fusion of post-ultrasonic CaO2 nanospheres with Cu2O nanoblocks. The resulting CaO2-Cu2O possessed a desirable diameter (291.3 nm) and a uniform size distribution. It could be efficiently internalized by colonic epithelial cells and macrophages, scavenge intracellular reactive oxygen/nitrogen species, and alleviate immune reactions by pro-polarizing macrophages to the anti-inflammatory M2 phenotype. This nanomotor was found to penetrate through the mucus barrier and accumulate in the colitis mucosa due to the driving force of the generated oxygen bubbles. Rectal administration of CaO2-Cu2O could stanch the bleeding, repair the disrupted colonic epithelial layer, and reduce the inflammatory responses through its interaction with the genes relevant to blood coagulation, anti-oxidation, wound healing, and anti-inflammation. Impressively, it restored intestinal microbiota balance by elevating the proportions of beneficial bacteria (e.g., Odoribacter and Bifidobacterium) and decreasing the abundances of harmful bacteria (e.g., Prevotellaceae and Helicobacter). Our gas-driven CaO2-Cu2O offers a promising therapeutic platform for robust treatment of UC via the rectal route.

Challenges in IBD Research 2024: Precision Medicine

Precision medicine is part of 5 focus areas of the Challenges in IBD Research 2024 research document, which also includes preclinical human IBD mechanisms, environmental triggers, novel technologies, and pragmatic clinical research. Building on Challenges in IBD Research 2019, the current Challenges aims to provide a comprehensive overview of current gaps in inflammatory bowel diseases (IBDs) research and deliver actionable approaches to address them with a focus on how these gaps can lead to advancements in interception, remission, and restoration for these diseases. The document is the result of multidisciplinary input from scientists, clinicians, patients, and funders, and represents a valuable resource for patient-centric research prioritization. In particular, the precision medicine section is focused on the main research gaps in elucidating how to bring the best care to the individual patient in IBD. Research gaps were identified in biomarker discovery and validation for predicting disease progression and choosing the most appropriate treatment for each patient. Other gaps were identified in making the best use of existing patient biosamples and clinical data, developing new technologies to analyze large datasets, and overcoming regulatory and payer hurdles to enable clinical use of biomarkers. To address these gaps, the Workgroup suggests focusing on thoroughly validating existing candidate biomarkers, using best-in-class data generation and analysis tools, and establishing cross-disciplinary teams to tackle regulatory hurdles as early as possible. Altogether, the precision medicine group recognizes the importance of bringing basic scientific biomarker discovery and translating it into the clinic to help improve the lives of IBD patients.

Advancing Artificial Intelligence Integration Into the Pathology Workflow: Exploring Opportunities in Gastrointestinal Tract Biopsies

This review aims to present a comprehensive overview of the current landscape of artificial intelligence (AI) applications in the analysis of tubular gastrointestinal biopsies. These publications cover a spectrum of conditions, ranging from inflammatory ailments to malignancies. Moving beyond the conventional diagnosis based on hematoxylin and eosin-stained whole-slide images, the review explores additional implications of AI, including its involvement in interpreting immunohistochemical results, molecular subtyping, and the identification of cellular spatial biomarkers. Furthermore, the review examines how AI can contribute to enhancing the quality and control of diagnostic processes, introducing new workflow options, and addressing the limitations and caveats associated with current AI platforms in this context.

Deep Learning Models Capture Histological Disease Activity in Crohn's Disease and Ulcerative Colitis with High Fidelity

BACKGROUND AND AIMS

Histological disease activity in inflammatory bowel disease [IBD] is associated with clinical outcomes and is an important endpoint in drug development. We developed deep learning models for automating histological assessments in IBD.

METHODS

Histology images of intestinal mucosa from phase 2 and phase 3 clinical trials in Crohn's disease [CD] and ulcerative colitis [UC] were used to train artificial intelligence [AI] models to predict the Global Histology Activity Score [GHAS] for CD and Geboes histopathology score for UC. Three AI methods were compared. AI models were evaluated on held-back testing sets, and model predictions were compared against an expert central reader and five independent pathologists.

RESULTS

The model based on multiple instance learning and the attention mechanism [SA-AbMILP] demonstrated the best performance among competing models. AI-modelled GHAS and Geboes subgrades matched central readings with moderate to substantial agreement, with accuracies ranging from 65% to 89%. Furthermore, the model was able to distinguish the presence and absence of pathology across four selected histological features, with accuracies for colon in both CD and UC ranging from 87% to 94% and for CD ileum ranging from 76% to 83%. For both CD and UC and across anatomical compartments [ileum and colon] in CD, comparable accuracies against central readings were found between the model-assigned scores and scores by an independent set of pathologists.

CONCLUSIONS

Deep learning models based upon GHAS and Geboes scoring systems were effective at distinguishing between the presence and absence of IBD microscopic disease activity.

Artificial intelligence image-based prediction models in IBD exhibit high risk of bias: A systematic review

BACKGROUND

There has been an increase in the development of both machine learning (ML) and deep learning (DL) prediction models in Inflammatory Bowel Disease. We aim in this systematic review to assess the methodological quality and risk of bias of ML and DL IBD image-based prediction studies.

METHODS

We searched three databases, PubMed, Scopus and Embase, to identify ML and DL diagnostic or prognostic predictive models using imaging data in IBD, to Dec 31, 2022. We restricted our search to include studies that primarily used conventional imaging data, were undertaken in human participants, and published in English. Two reviewers independently reviewed the abstracts. The methodological quality of the studies was determined, and risk of bias evaluated using the prediction risk of bias assessment tool (PROBAST).

RESULTS

Forty studies were included, thirty-nine developed diagnostic models. Seven studies utilized ML approaches, six were retrospective and none used multicenter data for model development. Thirty-three studies utilized DL approaches, ten were prospective, and twelve multicenter studies. Overall, all studies demonstrated high risk of bias. ML studies were evaluated in 4 domains all rated as high risk of bias: participants (6/7), predictors (1/7), outcome (3/7), and analysis (7/7), and DL studies evaluated in 3 domains: participants (24/33), outcome (10/33), and analysis (18/33). The majority of image-based studies used colonoscopy images.

CONCLUSION

The risk of bias was high in AI IBD image-based prediction models, owing to insufficient sample size, unreported missingness and lack of an external validation cohort. Models with a high risk of bias are unlikely to be generalizable and suitable for clinical implementation.

Deep learning quantification reveals a fundamental prognostic role for ductular reaction in biliary atresia

BACKGROUND

We aimed to quantify ductular reaction (DR) in biliary atresia using a neural network in relation to underlying pathophysiology and prognosis.

METHODS

Image-processing neural network model was applied to 259 cytokeratin-7-stained native liver biopsies of patients with biliary atresia and 43 controls. The model quantified total proportional DR (DR%) composed of portal biliary epithelium (BE%) and parenchymal intermediate hepatocytes (PIH%). The results were related to clinical data, Sirius Red-quantified liver fibrosis, serum biomarkers, and bile acids.

RESULTS

In total, 2 biliary atresia biopsies were obtained preoperatively, 116 at Kasai portoenterostomy (KPE) and 141 during post-KPE follow-up. DR% (8.3% vs. 5.9%, p=0.045) and PIH% (1.3% vs. 0.6%, p=0.004) were increased at KPE in patients remaining cholestatic postoperatively. After KPE, patients with subsequent liver transplantation or death showed an increase in DR% (7.9%-9.9%, p = 0.04) and PIH% (1.6%-2.4%, p = 0.009), whereas patients with native liver survival (NLS) showed decreasing BE% (5.5%-3.0%, p = 0.03) and persistently low PIH% (0.9% vs. 1.3%, p = 0.11). In Cox regression, high DR predicted inferior NLS both at KPE [DR% (HR = 1.05, p = 0.01), BE% (HR = 1.05, p = 0.03), and PIH% (HR = 1.13, p = 0.005)] and during follow-up [DR% (HR = 1.08, p<0.0001), BE% (HR = 1.58, p = 0.001), and PIH% (HR = 1.04, p = 0.008)]. DR% correlated with Sirius red-quantified liver fibrosis at KPE (R = 0.47, p<0.0001) and follow-up (R = 0.27, p = 0.004). A close association between DR% and serum bile acids was observed at follow-up (R = 0.61, p<0.001). Liver fibrosis was not prognostic for NLS at KPE (HR = 1.00, p = 0.96) or follow-up (HR = 1.01, p = 0.29).

CONCLUSIONS

DR predicted NLS in different disease stages before transplantation while associating with serum bile acids after KPE.

Machine and deep learning in inflammatory bowel disease

PURPOSE OF REVIEW

The Management of inflammatory bowel disease (IBD) has evolved with the introduction and widespread adoption of biologic agents; however, the advent of artificial intelligence technologies like machine learning and deep learning presents another watershed moment in IBD treatment. Interest in these methods in IBD research has increased over the past 10 years, and they offer a promising path to better clinical outcomes for IBD patients.

RECENT FINDINGS

Developing new tools to evaluate IBD and inform clinical management is challenging because of the expansive volume of data and requisite manual interpretation of data. Recently, machine and deep learning models have been used to streamline diagnosis and evaluation of IBD by automating review of data from several diagnostic modalities with high accuracy. These methods decrease the amount of time that clinicians spend manually reviewing data to formulate an assessment.

SUMMARY

Interest in machine and deep learning is increasing in medicine, and these methods are poised to revolutionize the way that we treat IBD. Here, we highlight the recent advances in using these technologies to evaluate IBD and discuss the ways that they can be leveraged to improve clinical outcomes.

Inflammatory Bowel Diseases: Does One Histological Score Fit All?

Mucosal healing (MH) is the main treatment target in ulcerative colitis (UC) and Crohn's disease, and it is defined by the combination of complete endoscopic and histologic remission. The complete resolution of mucosal inflammation should be confirmed by histology but its assessment is not always univocal. Neutrophil infiltration represents the unique histological marker in discriminating the active vs. quiescent phases of the disease, together with crypt injuries (cryptitis and crypt abscesses), erosions, and ulcerations. On the contrary, basal plasmacytosis is not indicative of activity or the remission of inflammatory bowel diseases (IBDs) but instead represents a diagnostic clue, mostly at the onset. Several histological scoring systems have been developed to assess grade severity, particularly for UC. However, most are complex and/or subjective. The aim of this review was to summarize available scores, their characteristics and limitations, and to present the advantages of a simplified mucosa healing scheme (SHMHS) based on neutrophils and their distribution in the gut mucosa. Finally, we overview future developments including artificial intelligence models for standardization of disease assessments and novel molecular markers of inflammation with potential application in diagnostic practice.

Mise au point de l’utilisation de l’intelligence artificielle dans la prise en charge des maladies inflammatoires chroniques de l’intestin

Complexity of inflammatory bowel diseases (IBD) lies on their management and their biology. Clinics, blood and fecal samples tests, endoscopy and histology are the main tools guiding IBD treatment, but they generate a large amount of data, difficult to analyze by clinicians. Because of its capacity to analyze large number of data, artificial intelligence is currently generating enthusiasm in medicine, and this technology could be used to improve IBD management. In this review, after a short summary on IBD management and artificial intelligence, we will report pragmatic examples of artificial intelligence utilisation in IBD. Lastly, we will discuss the limitations of this technology.

Evaluating the potential of artificial intelligence in ulcerative colitis

INTRODUCTION

Diagnosis and therapeutic management in ulcerative colitis (UC) relies on a combination of endoscopic and histological scorings which are difficult to objectively quantify. Artificial intelligence (AI) might overcome the current issues of inter-observer variability, repetitive need for biopsies and estimation of disease activity medicine currently encourages.

AREAS COVERED

With this narrative literature review we aim to provide a clear and critical overview of the recent evolutions in the field of AI and UC, based on a literature search performed on Pubmed, Embase and Cochrane Library. The major focus of this review is the use of AI for endoscopic assessment of disease activity and the correlation with histology and long-term outcome. Moreover, we elucidate on the more recent developments in the field of AI as support in histological disease assessment, surveillance, therapy monitoring and natural language processing.

EXPERT OPINION

UC management is evolving with AI impacting nearly every aspect of it. The immediate future influence of AI in UC management will be focussed on the collection, extraction and organization of particular clinical information. Expect is the transformation toward a real-time standardized, reproducible, objective and high-reliable disease grading, especially in endoscopy, histology and eventually radiology applications for UC.

Artificial intelligence and inflammatory bowel disease: Where are we going?

Inflammatory bowel diseases, namely ulcerative colitis and Crohn’s disease, are chronic and relapsing conditions that pose a growing burden on healthcare systems worldwide. Because of their complex and partly unknown etiology and pathogenesis, the management of ulcerative colitis and Crohn’s disease can prove challenging not only from a clinical point of view but also for resource optimization. Artificial intelligence, an umbrella term that encompasses any cognitive function developed by machines for learning or problem solving, and its subsets machine learning and deep learning are becoming ever more essential tools with a plethora of applications in most medical specialties. In this regard gastroenterology is no exception, and due to the importance of endoscopy and imaging numerous clinical studies have been gradually highlighting the relevant role that artificial intelligence has in inflammatory bowel diseases as well. The aim of this review was to summarize the most recent evidence on the use of artificial intelligence in inflammatory bowel diseases in various contexts such as diagnosis, follow-up, treatment, prognosis, cancer surveillance, data collection, and analysis. Moreover, insights into the potential further developments in this field and their effects on future clinical practice were discussed.

Predictive models for endoscopic disease activity in patients with ulcerative colitis: Practical machine learning-based modeling and interpretation

Background

Endoscopic disease activity monitoring is important for the long-term management of patients with ulcerative colitis (UC), there is currently no widely accepted non-invasive method that can effectively predict endoscopic disease activity. We aimed to develop and validate machine learning (ML) models for predicting it, which are desired to reduce the frequency of endoscopic examinations and related costs.

Methods

The patients with a diagnosis of UC in two hospitals from January 2016 to January 2021 were enrolled in this study. Thirty nine clinical and laboratory variables were collected. All patients were divided into four groups based on MES or UCEIS scores. Logistic regression (LR) and four ML algorithms were applied to construct the prediction models. The performance of models was evaluated in terms of accuracy, sensitivity, precision, F1 score, and area under the receiver-operating characteristic curve (AUC). Then Shapley additive explanations (SHAP) was applied to determine the importance of the selected variables and interpret the ML models.

Results

A total of 420 patients were entered into the study. Twenty four variables showed statistical differences among the groups. After synthetic minority oversampling technique (SMOTE) oversampling and RFE variables selection, the random forests (RF) model with 23 variables in MES and the extreme gradient boosting (XGBoost) model with 21 variables in USEIS, had the greatest discriminatory ability (AUC = 0.8192 in MES and 0.8006 in UCEIS in the test set). The results obtained from SHAP showed that albumin, rectal bleeding, and CRP/ALB contributed the most to the overall model. In addition, the above three variables had a more balanced contribution to each classification under the MES than the UCEIS according to the SHAP values.

Conclusion

This proof-of-concept study demonstrated that the ML model could serve as an effective non-invasive approach to predicting endoscopic disease activity for patients with UC. RF and XGBoost, which were first introduced into data-based endoscopic disease activity prediction, are suitable for the present prediction modeling.

Technological advances in inflammatory bowel disease endoscopy and histology

Accurate disease characterization is the pillar of modern treatment of inflammatory bowel disease (IBD) and endoscopy is the mainstay of disease assessment and colorectal cancer surveillance. Recent technological progress has enhanced and expanded the use of endoscopy in IBD. In particular, numerous artificial intelligence (AI)-powered systems have shown to support human endoscopists' evaluations, improving accuracy and consistency while saving time. Moreover, advanced optical technologies such as endocytoscopy (EC), allowing high magnification in vivo, can bridge endoscopy with histology. Furthermore, molecular imaging, through probe based confocal laser endomicroscopy allows the real-time detection of specific biomarkers on gastrointestinal surface, and could be used to predict therapeutic response, paving the way to precision medicine. In parallel, as the applications of AI spread, computers are positioned to resolve some of the limitations of human histopathology evaluation, such as interobserver variability and inconsistencies in assessment. The aim of this review is to summarize the most promising advances in endoscopic and histologic assessment of IBD.

Simplified Histologic Mucosal Healing Scheme (SHMHS) for inflammatory bowel disease: a nationwide multicenter study of performance and applicability

BACKGROUND

Assessment of mucosal healing is important for the management of patients with inflammatory bowel disease (IBD), but endoscopy can miss microscopic disease areas that may relapse. Histological assessment is informative, but no single scoring system is widely adopted. We previously proposed an eight-item histological scheme for the easy, fast reporting of disease activity in the intestine. The aim of the present study was to evaluate the performance of our Simplified Histologic Mucosal Healing Scheme (SHMHS).

METHODS

Between April and May 2021 pathologists and gastroenterologists in Italy were invited to contribute to this multicenter study by providing data on single endoscopic-histological examinations for their IBD patients undergoing treatment. Disease activity was expressed using SHMHS (maximum score, 8) and either Simple Endoscopic Score for Crohn's Disease (categorized into grades 0-3) or Mayo Endoscopic Subscore (range 0-3).

RESULTS

Thirty hospitals provided data on 597 patients (291 Crohn's disease; 306 ulcerative colitis). The mean SHMHS score was 2.96 (SD = 2.42) and 66.8% of cases had active disease (score ≥ 2). The mean endoscopic score was 1.23 (SD = 1.05), with 67.8% having active disease (score ≥ 1). Histologic and endoscopic scores correlated (Spearman's ρ = 0.76), and scores for individual SHMHS items associated directly with endoscopic scores (chi-square p < 0.001, all comparisons). Between IBD types, scores for SHMHS items reflected differences in presentation, with cryptitis more common and erosions/ulcerations less common in Crohn's disease, and the distal colon more affected in ulcerative colitis.

CONCLUSIONS

SHMHS captures the main histological features of IBD. Routine adoption may simplify pathologist workload while ensuring accurate reporting for clinical decision making.