Machine Learning Approach for Biopsy-Based Identification of Eosinophilic Esophagitis Reveals Importance of Global features

Advances in omics data for eosinophilic esophagitis: moving towards multi-omics analyses

Eosinophilic esophagitis (EoE) is a chronic, allergic inflammatory disease of the esophagus characterized by eosinophil accumulation and has a growing global prevalence. EoE significantly impairs quality of life and poses a substantial burden on healthcare resources. Currently, only two FDA-approved medications exist for EoE, highlighting the need for broader research into its management and prevention. Recent advancements in omics technologies, such as genomics, epigenetics, transcriptomics, proteomics, and others, offer new insights into the genetic and immunologic mechanisms underlying EoE. Genomic studies have identified genetic loci and mutations associated with EoE, revealing predispositions that vary by ancestry and indicating EoE's complex genetic basis. Epigenetic studies have uncovered changes in DNA methylation and chromatin structure that affect gene expression, influencing EoE pathology. Transcriptomic analyses have revealed a distinct gene expression profile in EoE, dominated by genes involved in activated type 2 immunity and epithelial barrier function. Proteomic approaches have furthered the understanding of EoE mechanisms, identifying potential new biomarkers and therapeutic targets. However, challenges in integrating diverse omics data persist, largely due to their complexity and the need for advanced computational methods. Machine learning is emerging as a valuable tool for analyzing extensive and intricate datasets, potentially revealing new aspects of EoE pathogenesis. The integration of multi-omics data through sophisticated computational approaches promises significant advancements in our understanding of EoE, improving diagnostics, and enhancing treatment effectiveness. This review synthesizes current omics research and explores future directions for comprehensively understanding the disease mechanisms in EoE.

An Innovative Hybrid Model for Automatic Detection of White Blood Cells in Clinical Laboratories

Background: Microscopic examination of peripheral blood is a standard practice in clinical medicine. Although manual examination is considered the gold standard, it presents several disadvantages, such as interobserver variability, being quite time-consuming, and requiring well-trained professionals. New automatic digital algorithms have been developed to eliminate the disadvantages of manual examination and improve the workload of clinical laboratories. Objectives: Regular analysis of peripheral blood cells and careful interpretation of their results are critical for protecting individual health and early diagnosis of diseases. Because many diseases can occur due to this, this study aims to detect white blood cells automatically. Methods: A hybrid model has been developed for this purpose. In the developed model, feature extraction has been performed with MobileNetV2 and EfficientNetb0 architectures. In the next step, the neighborhood component analysis (NCA) method eliminated unnecessary features in the feature maps so that the model could work faster. Then, different features of the same image were combined, and the extracted features were combined to increase the model's performance. Results: The optimized feature map was classified into different classifiers in the last step. The proposed model obtained a competitive accuracy value of 95.6%. Conclusions: The results obtained in the proposed model show that the proposed model can be used in the detection of white blood cells.

Histopathology of Eosinophilic Esophagitis

Microscopic examination of esophageal biopsies is essential to diagnose eosinophilic esophagitis (EoE). Eosinophil inflammation is the basis for the diagnosis, but additional abnormalities may contribute to persistent symptoms and epithelial barrier dysfunction. Both peak eosinophil count and assessments of additional features should be included in pre-therapy and post-therapy pathology reports. Pathologic abnormalities identified in esophageal biopsies of EoE are reversible in contrast to esophageal strictures.

Advancing Artificial Intelligence Integration Into the Pathology Workflow: Exploring Opportunities in Gastrointestinal Tract Biopsies

This review aims to present a comprehensive overview of the current landscape of artificial intelligence (AI) applications in the analysis of tubular gastrointestinal biopsies. These publications cover a spectrum of conditions, ranging from inflammatory ailments to malignancies. Moving beyond the conventional diagnosis based on hematoxylin and eosin-stained whole-slide images, the review explores additional implications of AI, including its involvement in interpreting immunohistochemical results, molecular subtyping, and the identification of cellular spatial biomarkers. Furthermore, the review examines how AI can contribute to enhancing the quality and control of diagnostic processes, introducing new workflow options, and addressing the limitations and caveats associated with current AI platforms in this context.

Performance of an Artificial Intelligence Model for Recognition and Quantitation of Histologic Features of Eosinophilic Esophagitis on Biopsy Samples

We have developed an artificial intelligence (AI)-based digital pathology model for the evaluation of histologic features related to eosinophilic esophagitis (EoE). In this study, we evaluated the performance of our AI model in a cohort of pediatric and adult patients for histologic features included in the Eosinophilic Esophagitis Histologic Scoring System (EoEHSS). We collected a total of 203 esophageal biopsy samples from patients with mucosal eosinophilia of any degree (91 adult and 112 pediatric patients) and 10 normal controls from a prospectively maintained database. All cases were assessed by a specialized gastrointestinal (GI) pathologist for features in the EoEHSS at the time of original diagnosis and rescored by a central GI pathologist (R.K.M.). We subsequently analyzed whole-slide image digital slides using a supervised AI model operating in a cloud-based, deep learning AI platform (Aiforia Technologies) for peak eosinophil count (PEC) and several histopathologic features in the EoEHSS. The correlation and interobserver agreement between the AI model and pathologists (Pearson correlation coefficient [rs] = 0.89 and intraclass correlation coefficient [ICC] = 0.87 vs original pathologist; rs = 0.91 and ICC = 0.83 vs central pathologist) were similar to the correlation and interobserver agreement between pathologists for PEC (rs = 0.88 and ICC = 0.91) and broadly similar to those for most other histologic features in the EoEHSS. The AI model also accurately identified PEC of >15 eosinophils/high-power field by the original pathologist (area under the curve [AUC] = 0.98) and central pathologist (AUC = 0.98) and had similar AUCs for the presence of EoE-related endoscopic features to pathologists' assessment. Average eosinophils per epithelial unit area had similar performance compared to AI high-power field-based analysis. Our newly developed AI model can accurately identify, quantify, and score several of the main histopathologic features in the EoE spectrum, with agreement regarding EoEHSS scoring which was similar to that seen among GI pathologists.

DEPAS: De-novo Pathology Semantic Masks using a Generative Model

The integration of artificial intelligence (AI) into digital pathology has the potential to automate and improve various tasks, such as image analysis and diagnostic decision-making. Yet, the inherent variability of tissues, together with the need for image labeling, lead to biased datasets that limit the generalizability of algorithms trained on them. One of the emerging solutions for this challenge is synthetic histological images. Debiasing real datasets require not only generating photorealistic images but also the ability to control the cellular features within them. A common approach is to use generative methods that perform image translation between semantic masks that reflect prior knowledge of the tissue and a histological image. However, unlike other image domains, the complex structure of the tissue prevents a simple creation of histology semantic masks that are required as input to the image translation model, while semantic masks extracted from real images reduce the process's scalability. In this work, we introduce a scalable generative model, coined as DEPAS (De-novo Pathology Semantic Masks), that captures tissue structure and generates high-resolution semantic masks with state-of-the-art quality. We demonstrate the ability of DEPAS to generate realistic semantic maps of tissue for three types of organs: skin, prostate, and lung. Moreover, we show that these masks can be processed using a generative image translation model to produce photorealistic histology images of two types of cancer with two different types of staining techniques. Finally, we harness DEPAS to generate multi-label semantic masks that capture different cell types distributions and use them to produce histological images with on-demand cellular features. Overall, our work provides a state-of-the-art solution for the challenging task of generating synthetic histological images while controlling their semantic information in a scalable way.

Between Generating Noise and Generating Images: Noise in the Correct Frequency Improves the Quality of Synthetic Histopathology Images for Digital Pathology

Artificial intelligence and machine learning techniques have the promise to revolutionize the field of digital pathology. However, these models demand considerable amounts of data, while the availability of unbiased training data is limited. Synthetic images can augment existing datasets, to improve and validate AI algorithms. Yet, controlling the exact distribution of cellular features within them is still challenging. One of the solutions is harnessing conditional generative adversarial networks that take a semantic mask as an input rather than a random noise. Unlike other domains, outlining the exact cellular structure of tissues is hard, and most of the input masks depict regions of cell types. This is also the case for non-small cell lung cancer, the most common type of lung cancer. Deciding whether a patient would receive immunotherapy depends on quantifying regions of stained cells. However, using polygon-based masks introduce inherent artifacts within the synthetic images - due to the mismatch between the polygon size and the single-cell size. In this work, we show that introducing random single-pixel noise with the appropriate spatial frequency into a polygon semantic mask can dramatically improve the quality of the synthetic images. We used our platform to generate synthetic images of immunohistochemistry-treated lung biopsies. We test the quality of the images using a three-fold validation procedure. First, we show that adding the appropriate noise frequency yields 87% of the similarity metrics improvement that is obtained by adding the actual single-cell features. Second, we show that the synthetic images pass the Turing test. Finally, we show that adding these synthetic images to the train set improves AI performance in terms of PD-L1 semantic segmentation performances. Our work suggests a simple and powerful approach for generating synthetic data on demand to unbias limited datasets to improve the algorithms' accuracy and validate their robustness.

Artificial Intelligence: Exploring the Future of Innovation in Allergy Immunology

PURPOSE OF REVIEW

Artificial intelligence (AI) has increasingly been used in healthcare. Given the capacity of AI to handle large data and complex relationships between variables, AI is well suited for applications in healthcare. Recently, AI has been applied to allergy research.

RECENT FINDINGS

In this article, we review how AI technologies have been utilized in basic science and clinical allergy research for asthma, atopic dermatitis, rhinology, adverse reactions to drugs and vaccines, food allergy, anaphylaxis, urticaria, and eosinophilic gastrointestinal disorders. We discuss barriers for AI adoption to improve the care of patients with atopic diseases. These studies demonstrate the utility of applying AI to the field of allergy to help investigators expand their understanding of disease pathogenesis, improve diagnostic accuracy, enable prediction for treatments and outcomes, and for drug discovery.

Endoscopy in Pediatric Eosinophilic Esophagitis

Eosinophilic esophagitis (EoE) is a chronic allergen-mediated clinicopathologic condition that currently requires esophagogastroduodenoscopy with biopsies and histologic evaluation to diagnose and monitor its progress. This state-of-the art review outlines the pathophysiology of EoE, reviews the application of endoscopy as a diagnostic and therapeutic tool, and discusses potential complications related to therapeutic endoscopic interventions. It also introduces recent innovations that can enhance the endoscopist's ability to diagnose and monitor EoE with minimally invasive procedures and perform therapeutic maneuvers more safely and effectively.

Artificial intelligence in anatomical pathology: building a strong foundation for precision medicine

With the convergence of digital pathology (DP) and artificial intelligence (AI), anatomic pathology practice has been experiencing an exciting paradigm shifting. Pathologists will be provided with an augmented ability to improve diagnostic accuracy, efficiency, and consistency. There will be subvisual morphometric features discovered and multiomics data integrated to provide better prognostic and theragnostic information to guide individual patients' management. The perspective for future precision medicine is promising. However, there are many challenges before AI-assisted DP diagnostic workflows can be successfully implemented. Herein, we briefly review some examples of AI application in anatomic pathology with an emphasis on the subspecialty of gastrointestinal pathology and discuss potential challenges for clinical implementation.

Applications of Artificial Intelligence to Eosinophilic Esophagitis

Eosinophilic Esophagitis (EoE) is a chronic immune-related inflammation, and challenges to its diagnosis and treatment evaluation persist. This literature review evaluates all AI applications to EOE, including 15 studies using AI algorithms for counting eosinophils in biopsies, as well as newer diagnostics using mRNA transcripts in biopsies, endoscopic photos, blood and urine biomarkers, and an improved scoring system for disease classification. We also discuss the clinical impact of these models, challenges faced in applying AI to EoE, and future applications. In conclusion, AI has the potential to improve diagnostics and clinical evaluation in EoE, improving patient outcomes.

A Deep Multi-Label Segmentation Network For Eosinophilic Esophagitis Whole Slide Biopsy Diagnostics

Eosinophilic esophagitis (EoE) is an allergic inflammatory condition of the esophagus associated with elevated numbers of eosinophils. Disease diagnosis and monitoring require determining the concentration of eosinophils in esophageal biopsies, a time-consuming, tedious and somewhat subjective task currently performed by pathologists. Here, we developed a machine learning pipeline to identify, quantitate and diagnose EoE patients' at the whole slide image level. We propose a platform that combines multi-label segmentation deep network decision support system with dynamics convolution that is able to process whole biopsy slide. Our network is able to segment both intact and not-intact eosinophils with a mean intersection over union (mIoU) of 0.93. This segmentation enables the local quantification of intact eosinophils with a mean absolute error of 0.611 eosinophils. We examined a cohort of 1066 whole slide images from 400 patients derived from multiple institutions. Using this set, our model achieved a global accuracy of 94.75%, sensitivity of 94.13%, and specificity of 95.25% in reporting EoE disease activity. Our work provides state-of-the-art performances on the largest EoE cohort to date, and successfully addresses two of the main challenges in EoE diagnostics and digital pathology, the need to detect several types of small features simultaneously, and the ability to analyze whole slides efficiently. Our results pave the way for an automated diagnosis of EoE and can be utilized for other conditions with similar challenges.

Advances and horizons for artificial intelligence of endoscopic screening and surveillance of gastric and esophageal disease

The development of artificial intelligence in endoscopic assessment of the gastrointestinal tract has shown progressive enhancement in diagnostic acuity. This review discusses the expanding applications for gastric and esophageal diseases. The gastric section covers the utility of AI in detecting and characterizing gastric polyps and further explores prevention, detection, and classification of gastric cancer. The esophageal discussion highlights applications for use in screening and surveillance in Barrett's esophagus and in high-risk conditions for esophageal squamous cell carcinoma. Additionally, these discussions highlight applications for use in assessing eosinophilic esophagitis and future potential in assessing esophageal microbiome changes.

Harnessing artificial intelligence to infer novel spatial biomarkers for the diagnosis of eosinophilic esophagitis

Eosinophilic esophagitis (EoE) is a chronic allergic inflammatory condition of the esophagus associated with elevated esophageal eosinophils. Second only to gastroesophageal reflux disease, EoE is one of the leading causes of chronic refractory dysphagia in adults and children. EoE is a clinicopathologic disorder and the histological portion of the diagnosis requires enumerating the density of esophageal eosinophils in esophageal biopsies, and evaluating additional features such as basal zone hyperplasia is helpful. However, this task requires time-consuming, somewhat subjective manual analysis, thus reducing the ability to process the complex tissue structure and infer its relationship with the patient's clinical status. Previous artificial intelligence (AI) approaches that aimed to improve histology-based diagnosis focused on recapitulating identification and quantification of the area of maximal eosinophil density, the gold standard manual metric for determining EoE disease activity. However, this metric does not account for the distribution of eosinophils or other histological features, over the whole slide image. Here, we developed an artificial intelligence platform that infers local and spatial biomarkers based on semantic segmentation of intact eosinophils and basal zone distributions. Besides the maximal density of eosinophils [referred to as Peak Eosinophil Count (PEC)] and a maximal basal zone fraction, we identify the value of two additional metrics that reflect the distribution of eosinophils and basal zone fractions. This approach enables a decision support system that predicts EoE activity and potentially classifies the histological severity of EoE patients. We utilized a cohort that includes 1,066 biopsy slides from 400 subjects to validate the system's performance and achieved a histological severity classification accuracy of 86.70%, sensitivity of 84.50%, and specificity of 90.09%. Our approach highlights the importance of systematically analyzing the distribution of biopsy features over the entire slide and paves the way toward a personalized decision support system that will assist not only in counting cells but can also potentially improve diagnosis and provide treatment prediction.

2021 year in review: Spotlight on eosinophils

This review highlights recent advances in the understanding of eosinophils and eosinophilic diseases, particularly eosinophilic gastrointestinal diseases during the last year. The increasing incidence of diseases marked by eosinophilia has been documented and highlighted the need to understand eosinophil biology and eosinophilic contributions to disease. Significant insight into the nature of eosinophilic diseases has been achieved using next-generation sequencing technologies, proteomic analysis, and machine learning to analyze tissue biopsies. These technologies have elucidated mechanistic underpinnings of eosinophilic inflammation, delineated patient endotypes, and identified patient responses to therapeutic intervention. Importantly, recent clinical studies using mAbs that interfere with type 2 cytokine signaling or deplete eosinophils point to multiple and complex roles of eosinophils in tissues. Several studies identified distinct activation features of eosinophils in different tissues and disease states. The confluence of these studies supports a new paradigm of tissue-resident eosinophils that have pro- and anti-inflammatory immunomodulatory roles in allergic disease. Improved understanding of unique eosinophil activation states is now poised to identify novel therapeutic targets for eosinophilic diseases.