Deep learning-based automated quantification of goblet cell mucus using histological images as a predictor of clinical relapse of ulcerative colitis with endoscopic remission

The Histological Detection of Ulcerative Colitis Using a No-Code Artificial Intelligence Model

Ulcerative colitis (UC) is an intractable disease that affects young adults. Histological findings are essential for its diagnosis; however, the number of diagnostic pathologists is limited. Herein, we used a no-code artificial intelligence (AI) platform "Teachable Machine" to train a model that could distinguish between histological images of UC, non-UC coloproctitis, adenocarcinoma, and control. A total of 5100 histological images for training and 900 histological images for testing were prepared by pathologists. Our model showed accuracies of 0.99, 1.00, 0.99, and 0.99, for UC, non-UC coloproctitis, adenocarcinoma, and control, respectively. This is the first report in which a no-code easy AI platform has been able to comprehensively recognize the distinctive histologic patterns of UC.

Automated Neutrophil Quantification and Histological Score Estimation in Ulcerative Colitis

BACKGROUND

In the management of ulcerative colitis (UC), histological remission is increasingly recognized as the ultimate goal. The absence of neutrophil infiltration is crucial for assessing remission. This study aimed to develop an artificial intelligence (AI) system capable of accurately quantifying and localizing neutrophils in UC biopsy specimens to facilitate histological assessment.

METHODS

Our AI system, which incorporates semantic segmentation and object detection models, was developed to identify neutrophils in hematoxylin and eosin-stained whole slide images. The system assessed the presence and location of neutrophils within either the epithelium or lamina propria and predicted components of the Nancy Histological Index and the PICaSSO Histologic Remission Index. We evaluated the system's performance against that of experienced pathologists and validated its ability to predict future clinical relapse risk in patients with clinically remitted UC. The primary outcome measure was the clinical relapse rate, defined as a partial Mayo score of ≥3.

RESULTS

The model accurately identified neutrophils, achieving a performance of 0.77, 0.81, and 0.79 for precision, recall, and F-score, respectively. The system's histological score predictions showed a positive correlation with the pathologists' diagnoses (Spearman's ρ = 0.68-0.80; P < .05). Among patients who relapsed, the mean number of neutrophils in the rectum was higher than in those who did not relapse. Furthermore, the study highlighted that higher AI-based PICaSSO Histologic Remission Index and Nancy Histological Index scores were associated with hazard ratios increasing from 3.2 to 5.0 for evaluating the risk of UC relapse.

CONCLUSIONS

The AI system's precise localization and quantification of neutrophils proved valuable for histological assessment and clinical prognosis stratification.

Artificial intelligence-assisted colonoscopy to identify histologic remission and predict the outcomes of patients with ulcerative colitis: A systematic review

This systematic review evaluated the current status of AI-assisted colonoscopy to identify histologic remission and predict the clinical outcomes of patients with ulcerative colitis. The use of artificial intelligence (AI) has increased substantially across several medical fields, including gastrointestinal endoscopy. Evidence suggests that it may be helpful to predict histologic remission and relapse, which would be beneficial because current histological diagnosis is limited by the inconvenience of obtaining biopsies and the high cost and time-intensiveness of pathological diagnosis. MEDLINE and the Cochrane Central Register of Controlled Trials were searched for studies published between January 1, 2000, and October 31, 2023. Nine studies fulfilled the selection criteria and were included; five evaluated the prediction of histologic remission, two assessed the prediction of clinical outcomes, and two evaluated both. Seven were prospective observational or cohort studies, while two were retrospective observational studies. No randomized controlled trials were identified. AI-assisted colonoscopy demonstrated sensitivity between 65 %-98 % and specificity values of 80 %-97 % for identifying histologic remission. Furthermore, it was able to predict future relapse in patients with ulcerative colitis. However, several challenges and barriers still exist to its routine clinical application, which should be overcome before the true potential of AI-assisted colonoscopy can be fully realized.

Opening the doors of precision medicine: novel tools to assess intestinal barrier in inflammatory bowel disease and colitis-associated neoplasia

Mounting evidence underscores the pivotal role of the intestinal barrier and its convoluted network with diet and intestinal microbiome in the pathogenesis of inflammatory bowel disease (IBD) and colitis-associated colorectal cancer (CRC). Moreover, the bidirectional association of the intestinal barrier with the liver and brain, known as the gut-brain axis, plays a crucial role in developing complications, including extraintestinal manifestations of IBD and CRC metastasis. Consequently, barrier healing represents a crucial therapeutic target in these inflammatory-dependent disorders, with barrier assessment predicting disease outcomes, response to therapy and extraintestinal manifestations.New advanced technologies are revolutionising our understanding of the barrier paradigm, enabling the accurate assessment of the intestinal barrier and aiding in unravelling the complexity of the gut-brain axis. Cutting-edge endoscopic imaging techniques, such as ultra-high magnification endocytoscopy and probe-based confocal laser endomicroscopy, are new technologies allowing real-time exploration of the 'cellular' intestinal barrier. Additionally, novel advanced spatial imaging technology platforms, including multispectral imaging, upconversion nanoparticles, digital spatial profiling, optical spectroscopy and mass cytometry, enable a deep and comprehensive assessment of the 'molecular' and 'ultrastructural' barrier. In this promising landscape, artificial intelligence plays a pivotal role in standardising and integrating these novel tools, thereby contributing to barrier assessment and prediction of outcomes.Looking ahead, this integrated and comprehensive approach holds the promise of uncovering new therapeutic targets, breaking the therapeutic ceiling in IBD. Novel molecules, dietary interventions and microbiome modulation strategies aim to restore, reinforce, or modulate the gut-brain axis. These advancements have the potential for transformative and personalised approaches to managing IBD.

Challenges in IBD Research 2024: Precision Medicine

Precision medicine is part of 5 focus areas of the Challenges in IBD Research 2024 research document, which also includes preclinical human IBD mechanisms, environmental triggers, novel technologies, and pragmatic clinical research. Building on Challenges in IBD Research 2019, the current Challenges aims to provide a comprehensive overview of current gaps in inflammatory bowel diseases (IBDs) research and deliver actionable approaches to address them with a focus on how these gaps can lead to advancements in interception, remission, and restoration for these diseases. The document is the result of multidisciplinary input from scientists, clinicians, patients, and funders, and represents a valuable resource for patient-centric research prioritization. In particular, the precision medicine section is focused on the main research gaps in elucidating how to bring the best care to the individual patient in IBD. Research gaps were identified in biomarker discovery and validation for predicting disease progression and choosing the most appropriate treatment for each patient. Other gaps were identified in making the best use of existing patient biosamples and clinical data, developing new technologies to analyze large datasets, and overcoming regulatory and payer hurdles to enable clinical use of biomarkers. To address these gaps, the Workgroup suggests focusing on thoroughly validating existing candidate biomarkers, using best-in-class data generation and analysis tools, and establishing cross-disciplinary teams to tackle regulatory hurdles as early as possible. Altogether, the precision medicine group recognizes the importance of bringing basic scientific biomarker discovery and translating it into the clinic to help improve the lives of IBD patients.

Advancing Artificial Intelligence Integration Into the Pathology Workflow: Exploring Opportunities in Gastrointestinal Tract Biopsies

This review aims to present a comprehensive overview of the current landscape of artificial intelligence (AI) applications in the analysis of tubular gastrointestinal biopsies. These publications cover a spectrum of conditions, ranging from inflammatory ailments to malignancies. Moving beyond the conventional diagnosis based on hematoxylin and eosin-stained whole-slide images, the review explores additional implications of AI, including its involvement in interpreting immunohistochemical results, molecular subtyping, and the identification of cellular spatial biomarkers. Furthermore, the review examines how AI can contribute to enhancing the quality and control of diagnostic processes, introducing new workflow options, and addressing the limitations and caveats associated with current AI platforms in this context.

AI-luminating Artificial Intelligence in Inflammatory Bowel Diseases: A Narrative Review on the Role of AI in Endoscopy, Histology, and Imaging for IBD

Endoscopy, histology, and cross-sectional imaging serve as fundamental pillars in the detection, monitoring, and prognostication of inflammatory bowel disease (IBD). However, interpretation of these studies often relies on subjective human judgment, which can lead to delays, intra- and interobserver variability, and potential diagnostic discrepancies. With the rising incidence of IBD globally coupled with the exponential digitization of these data, there is a growing demand for innovative approaches to streamline diagnosis and elevate clinical decision-making. In this context, artificial intelligence (AI) technologies emerge as a timely solution to address the evolving challenges in IBD. Early studies using deep learning and radiomics approaches for endoscopy, histology, and imaging in IBD have demonstrated promising results for using AI to detect, diagnose, characterize, phenotype, and prognosticate IBD. Nonetheless, the available literature has inherent limitations and knowledge gaps that need to be addressed before AI can transition into a mainstream clinical tool for IBD. To better understand the potential value of integrating AI in IBD, we review the available literature to summarize our current understanding and identify gaps in knowledge to inform future investigations.

Artificial intelligence image-based prediction models in IBD exhibit high risk of bias: A systematic review

BACKGROUND

There has been an increase in the development of both machine learning (ML) and deep learning (DL) prediction models in Inflammatory Bowel Disease. We aim in this systematic review to assess the methodological quality and risk of bias of ML and DL IBD image-based prediction studies.

METHODS

We searched three databases, PubMed, Scopus and Embase, to identify ML and DL diagnostic or prognostic predictive models using imaging data in IBD, to Dec 31, 2022. We restricted our search to include studies that primarily used conventional imaging data, were undertaken in human participants, and published in English. Two reviewers independently reviewed the abstracts. The methodological quality of the studies was determined, and risk of bias evaluated using the prediction risk of bias assessment tool (PROBAST).

RESULTS

Forty studies were included, thirty-nine developed diagnostic models. Seven studies utilized ML approaches, six were retrospective and none used multicenter data for model development. Thirty-three studies utilized DL approaches, ten were prospective, and twelve multicenter studies. Overall, all studies demonstrated high risk of bias. ML studies were evaluated in 4 domains all rated as high risk of bias: participants (6/7), predictors (1/7), outcome (3/7), and analysis (7/7), and DL studies evaluated in 3 domains: participants (24/33), outcome (10/33), and analysis (18/33). The majority of image-based studies used colonoscopy images.

CONCLUSION

The risk of bias was high in AI IBD image-based prediction models, owing to insufficient sample size, unreported missingness and lack of an external validation cohort. Models with a high risk of bias are unlikely to be generalizable and suitable for clinical implementation.

The pathobiology of follicular lymphoma

Follicular lymphoma is one of the most frequent lymphomas. Histologically, it is characterized by a follicular (nodular) growth pattern of centrocytes and centroblasts; mixed with variable immune microenvironment cells. Clinically, it is characterized by diffuse lymphadenopathy, bone marrow involvement, and splenomegaly. It is biologically and clinically heterogeneous. In most patients it is indolent, but others have a more aggressive evolution with relapses; and transformation to diffuse large B-cell lymphoma. Tumorigenesis includes an asymptomatic preclinical phase in which premalignant B-lymphocytes with the t(14;18) chromosomal translocation acquire additional genetic alterations in the germinal centers, and clonal evolution occurs, although not all the cells progress to the tumor stage. This manuscript reviews the pathobiology and clinicopathological characteristics of follicular lymphoma. It includes a description of the physiology of the germinal center, the genetic alterations of BCL2 and BCL6, the mutational profile, the immune checkpoint, precision medicine, and highlights in the lymphoma classification. In addition, a comment and review on artificial intelligence and machine (deep) learning are made.

Machine and deep learning in inflammatory bowel disease

PURPOSE OF REVIEW

The Management of inflammatory bowel disease (IBD) has evolved with the introduction and widespread adoption of biologic agents; however, the advent of artificial intelligence technologies like machine learning and deep learning presents another watershed moment in IBD treatment. Interest in these methods in IBD research has increased over the past 10 years, and they offer a promising path to better clinical outcomes for IBD patients.

RECENT FINDINGS

Developing new tools to evaluate IBD and inform clinical management is challenging because of the expansive volume of data and requisite manual interpretation of data. Recently, machine and deep learning models have been used to streamline diagnosis and evaluation of IBD by automating review of data from several diagnostic modalities with high accuracy. These methods decrease the amount of time that clinicians spend manually reviewing data to formulate an assessment.

SUMMARY

Interest in machine and deep learning is increasing in medicine, and these methods are poised to revolutionize the way that we treat IBD. Here, we highlight the recent advances in using these technologies to evaluate IBD and discuss the ways that they can be leveraged to improve clinical outcomes.

Artificial Intelligence Enables Quantitative Assessment of Ulcerative Colitis Histology

Ulcerative colitis is a chronic inflammatory bowel disease that is characterized by a relapsing and remitting course. Assessment of disease activity critically informs treatment decisions. In addition to endoscopic remission, histologic remission is emerging as a treatment target and a key factor in the evaluation of disease activity and therapeutic efficacy. However, manual pathologist evaluation is semiquantitative and limited in granularity. Machine learning approaches are increasingly being developed to aid pathologists in accurate and reproducible scoring of histology, enabling precise quantitation of clinically relevant features. Here, we report the development and validation of convolutional neural network models that quantify histologic features pertinent to ulcerative colitis disease activity, directly from hematoxylin and eosin-stained whole slide images. Tissue and cell model predictions were used to generate quantitative human-interpretable features to fully characterize the histology samples. Tissue and cell predictions showed comparable agreement to pathologist annotations, and the extracted slide-level human-interpretable features demonstrated strong correlations with disease severity and pathologist-assigned Nancy histological index scores. Moreover, using a random forest classifier based on 13 human-interpretable features derived from the tissue and cell models, we were able to accurately predict Nancy histological index scores, with a weighted kappa (κ = 0.91) and Spearman correlation (⍴ = 0.89, P < .001) when compared with pathologist consensus Nancy histological index scores. We were also able to predict histologic remission, based on the absence of neutrophil extravasation, with a high accuracy of 0.97. This work demonstrates the potential of computer vision to enable a standardized and robust assessment of ulcerative colitis histopathology for translational research and improved evaluation of disease activity and prognosis.

A Novel Nomogram Combining Mucus Barrier Index for Predicting Treatment Failures in Ulcerative Colitis

Background

Treatment failures (TFs) generally exist in the course of ulcerative colitis (UC), while early reliable predictors of TFs are still lacking. We aimed to generate nomograms for the prediction of TFs.

Methods

In this retrospective case-control study, the endpoint was the occurrence of TFs, which included medically associated treatment failures and surgery-associated treatment failures (colectomy). Clinical features and mucus integrity evident by goblet cells (GCs) number, expression levels of MUC2 and SLC26A3 were enrolled in the univariate analysis. Nomogram performance was evaluated by discrimination and calibration.

Results

We identified 256 UC patients at our center from January 2010 to June 2022. Fourteen variables for TFs and 9 for colectomy were identified by univariate analysis. Five baseline indices were incorporated into the nomogram for the prediction of TFs: area of GCs, age at diagnosis, disease duration, hemoglobin, and Mayo score. The model was presented with decent discrimination (C index of 0.822) and well calibration. In addition, the colectomy predictive nomogram was built using MUC2 intensity, age at onset, and Mayo score with a good discrimination (C index of 0.92).

Conclusion

Nomograms based on comprehensive factors including mucus barrier function were developed to predict TFs in UC patients with great discrimination, which may serve as practical tools aiming to identify high-risk subgroups warrant timely intervention.