Prediction of genetic alterations from gastric cancer histopathology images using a fully automated deep learning approach

Artificial Intelligence Applications in Image-Based Diagnosis of Early Esophageal and Gastric Neoplasms

Artificial intelligence (AI) holds the potential to transform the management of upper gastrointestinal (GI) conditions, such as Barrett's esophagus, esophageal squamous cell cancer, and early gastric cancer. Advancements in deep learning and convolutional neural networks offer improved diagnostic accuracy and reduced diagnostic variability across different clinical settings, particularly where human error or fatigue may impair diagnostic precision. Deep learning models have shown the potential to improve early cancer detection and lesion characterization, predict invasion depth, and delineate lesion margins with remarkable accuracy, all contributing to effective treatment planning. Several challenges, however, limit the broad application of AI in GI endoscopy, particularly in the upper GI tract. Subtle lesion morphology and restricted diversity in training datasets, which are often sourced from specialized centers, may constrain the generalizability of AI models in various clinical settings. Furthermore, the "black box" nature of some AI systems can impede explainability and clinician trust. To address these issues, efforts are underway to incorporate multimodal data, such as combining endoscopic and histopathologic imaging, to bolster model robustness and transparency. In the future, AI promises substantial advancements in automated real-time endoscopic guidance, personalized risk assessment, and optimized biopsy decision making. As it evolves, it would substantially impact not only early diagnosis and prognosis, but also the cost-effectiveness of managing upper GI diseases, ultimately leading to improved patient outcomes and more efficient health care delivery.

Integrating transcriptomic data and digital pathology for NRG-based prediction of prognosis and therapy response in gastric cancer

BACKGROUND

Cancer is characterized by its ability to resist cell death, and emerging evidence suggests a potential correlation between non-apoptotic regulated cell death (RCD), tumor progression, and therapy response. However, the prognostic significance of non-apoptotic RCD-related genes (NRGs) and their relationships with immune response in gastric cancer (GC) remain unclear.

METHODS

In this study, RNA-seq gene expression and clinical information of GC patients were acquired from The Cancer Genome Atlas and the Gene Expression Omnibus databases. Cox and LASSO regression analyses were used to construct the NRG signature. Moreover, we developed a deep learning model based on ResNet50 to predict the NRG signature from digital pathology slides. The expression of signature hub genes was validated using real-time quantitative PCR and single-cell RNA sequencing data.

RESULTS

We identified 13 NRGs as signature genes for predicting the prognosis of patients with GC. The high-risk group, characterized by higher NRG scores, demonstrated a shorter overall survival rate, increased immunosuppressive cell infiltration, and immune dysfunction. Moreover, associations were observed between the NRG signature and chemotherapeutic drug responsiveness, as well as immunotherapy effectiveness in GC patients. Furthermore, the deep learning model effectively stratified GC patients based on the NRG signature by leveraging morphological variances, showing promising results for the classification of GC patients. Validation experiments demonstrated that the expression level of SERPINE1 was significantly upregulated in GC, while the expression levels of GPX3 and APOD were significantly downregulated.

CONCLUSION

The NRG signature and its deep learning model have significant clinical implications, highlighting the importance of individualized treatment strategies based on GC subtyping. These findings provide valuable insights for guiding clinical decision-making and treatment approaches for GC.

Deep learning-based analysis of EGFR mutation prevalence in lung adenocarcinoma H&E whole slide images

EGFR mutations are a major prognostic factor in lung adenocarcinoma. However, current detection methods require sufficient samples and are costly. Deep learning is promising for mutation prediction in histopathological image analysis but has limitations in that it does not sufficiently reflect tumor heterogeneity and lacks interpretability. In this study, we developed a deep learning model to predict the presence of EGFR mutations by analyzing histopathological patterns in whole slide images (WSIs). We also introduced the EGFR mutation prevalence (EMP) score, which quantifies EGFR prevalence in WSIs based on patch-level predictions, and evaluated its interpretability and utility. Our model estimates the probability of EGFR prevalence in each patch by partitioning the WSI based on multiple-instance learning and predicts the presence of EGFR mutations at the slide level. We utilized a patch-masking scheduler training strategy to enable the model to learn various histopathological patterns of EGFR. This study included 868 WSI samples from lung adenocarcinoma patients collected from three medical institutions: Hallym University Medical Center, Inha University Hospital, and Chungnam National University Hospital. For the test dataset, 197 WSIs were collected from Ajou University Medical Center to evaluate the presence of EGFR mutations. Our model demonstrated prediction performance with an area under the receiver operating characteristic curve of 0.7680 (0.7607-0.7720) and an area under the precision-recall curve of 0.8391 (0.8326-0.8430). The EMP score showed Spearman correlation coefficients of 0.4705 (p = 0.0087) for p.L858R and 0.5918 (p = 0.0037) for exon 19 deletions in 64 samples subjected to next-generation sequencing analysis. Additionally, high EMP scores were associated with papillary and acinar patterns (p = 0.0038 and p = 0.0255, respectively), whereas low EMP scores were associated with solid patterns (p = 0.0001). These results validate the reliability of our model and suggest that it can provide crucial information for rapid screening and treatment plans.

Applications of artificial intelligence in digital pathology for gastric cancer

Gastric cancer is one of the most common cancers and is one of the leading causes of cancer-related deaths in worldwide. Early diagnosis and treatment are essential for a positive outcome. The integration of artificial intelligence in the pathology field is increasingly widespread, including histopathological images analysis. In recent years, the application of digital pathology technology emerged as a potential solution to enhance the understanding and management of gastric cancer. Through sophisticated image analysis algorithms, artificial intelligence technologies facilitate the accuracy and sensitivity of gastric cancer diagnosis and treatment and personalized therapeutic strategies. This review aims to evaluate the current landscape and future potential of artificial intelligence in transforming gastric cancer pathology, so as to provide ideas for future research.

Comprehensive Collection of Whole-Slide Images and Genomic Profiles for Patients with Bladder Cancer

Bladder cancer is one of the leading causes of cancer-related mortality in the urinary system. Understanding genomic information is important in the treatment and prognosis of bladder cancer, but the current method used to identify mutations is time-consuming and labor-intensive. There are now many novel and convenient ways to predict cancerous genomics from pathological slides. However, the publicly available datasets are limited, especially for Asian populations. In this study, we developed a dataset consisting of 75 Asian cases of bladder cancers and 112 Whole-Slide Images with one to two images obtained for each patient. This dataset provides information on the most frequently and clinically significant mutated genes derived by whole-exome sequencing in these patients. This dataset will facilitate exploration and development of novel diagnostic and therapeutic technologies for bladder cancer.

The Role of TP53, KRAS, CDH1, Demographic and Clinical Variables in Gastric Cancer

Background

Worldwide, gastric cancer remains the fifth most prevalent type of cancer and is the third leading cause of cancer-related deaths. Gastric cancer is responsible for around 7% of global cancer occurrence and approximately 9% of annual cancer-related mortalities.

Objective

The aim of the study was to analyze gastric cancer dataset posted on Kaggle (https://www.kaggle.com/datasets/datasetengineer/gastric-cancer-gc-dataset).

Methods

This dataset comprises 212354 participants, of whom 10% had gastric cancer. This dataset was analyzed to extract the information regarding gastric cancer. The analysis of data was performed SPSS version 25. Descriptive analysis was used to describe data including frequency and percentages to describe categorical variables such as age, and the mean and standard deviation to describe non-categorical variables such as age. The relationships between variables and gastric cancer were calculated based on Chi-Square and One Way ANOVA tests, significance was considered if p value ≤0,05.

Results

The mean age was 53.2580±18.98 years. Seventy percent of participants were males. About 30% of participants had a family history of gastric cancer. About 40% of participants were smokers. About 50% of participants were alcoholic. About 75% of participants had Helicobacter pylori. 80% of participants were at high salt intake. About 50% of participants had chronic gastritis. Abnormal endoscopic image reports were reported in approximately 30% of participants. Biopsy results were negative in 90% of participants. The reports of CT scans were negative in approximately 80%. Genetic mutations were detected in Tp53 (50.1%), KRAS (20%), and CDH1 (29,9%). No significant relationships were found between gastric cancer and study variables.

Conclusion

Most of the people had risk factors such as Helicobacter pylori infection, salt intake, and mutations in TP53, KRAS, and CDH1. However, statistical analyses did not find significant correlations between those and gastric cancer.

Deep Learning for the Pathologic Diagnosis of Hepatocellular Carcinoma, Cholangiocarcinoma, and Metastatic Colorectal Cancer

Diagnosing primary liver cancers, particularly hepatocellular carcinoma (HCC) and cholangiocarcinoma (CC), is a challenging and labor-intensive process, even for experts, and secondary liver cancers further complicate the diagnosis. Artificial intelligence (AI) offers promising solutions to these diagnostic challenges by facilitating the histopathological classification of tumors using digital whole slide images (WSIs). This study aimed to develop a deep learning model for distinguishing HCC, CC, and metastatic colorectal cancer (mCRC) using histopathological images and to discuss its clinical implications. The WSIs from HCC, CC, and mCRC were used to train the classifiers. For normal/tumor classification, the areas under the curve (AUCs) were 0.989, 0.988, and 0.991 for HCC, CC, and mCRC, respectively. Using proper tumor tissues, the HCC/other cancer type classifier was trained to effectively distinguish HCC from CC and mCRC, with a concatenated AUC of 0.998. Subsequently, the CC/mCRC classifier differentiated CC from mCRC with a concatenated AUC of 0.995. However, testing on an external dataset revealed that the HCC/other cancer type classifier underperformed with an AUC of 0.745. After combining the original training datasets with external datasets and retraining, the classification drastically improved, all achieving AUCs of 1.000. Although these results are promising and offer crucial insights into liver cancer, further research is required for model refinement and validation.

Focalizing regions of biomarker relevance facilitates biomarker prediction on histopathological images

Image-based AI has thrived as a potentially revolutionary tool for predicting molecular biomarker statuses, which aids in categorizing patients for appropriate medical treatments. However, many methods using hematoxylin and eosin-stained (H&E) whole-slide images (WSIs) have been found to be inefficient because of the presence of numerous uninformative or irrelevant image patches. In this study, we introduced the region of biomarker relevance (ROB) concept to identify the morphological areas most closely associated with biomarkers for accurate status prediction. We actualized this concept within a framework called saliency ROB search (SRS) to enable efficient and effective predictions. By evaluating various lung adenocarcinoma (LUAD) biomarkers, we showcased the superior performance of SRS compared to current state-of-the-art AI approaches. These findings suggest that AI tools, built on the ROB concept, can achieve enhanced molecular biomarker prediction accuracy from pathological images.

Deep Learning-Based Stratification of Gastric Cancer Patients from Hematoxylin and Eosin-Stained Whole Slide Images by Predicting Molecular Features for Immunotherapy Response

Determining the molecular characteristics of cancer patients is crucial for optimal immunotherapy decisions. The aim of this study was to screen immunotherapy beneficiaries by predicting key molecular features from hematoxylin and eosin-stained images based on deep learning models. An independent data set from Asian gastric cancer patients was included for external validation. In addition, a segmentation model (Horizontal-Vertical Network) was used to quantify the cellular composition of tumor stroma. The model performance was evaluated by measuring the area under the curve (AUC). The tumor extraction model achieved an AUC of 0.9386 and 0.9062 in the internal and external test sets, respectively. The stratification model could predict the immunotherapy-sensitive subtypes (AUC range, 0.8685 to 0.9461), the genetic mutations (AUC range, 0.8283 to 0.9225), and the pathway activity (AUC range, 0.7568 to 0.8612) fairly accurately. In external validation, the prediction performance of Epstein-Barr virus and programmed cell death ligand 1 expression status achieved AUCs of 0.7906 and 0.6384, respectively. The segmentation model identified a relatively high proportion of inflammatory cells and connective cells in some immunotherapy-sensitive subtypes. The deep learning-based models potentially may serve as a valuable tool to screen for the beneficiaries of immunotherapy in gastric cancer patients.

Artificial intelligence applications in predicting the behavior of gastrointestinal cancers in pathology

Recent research has provided a wealth of data supporting the application of artificial intelligence (AI)-based applications in routine pathology practice. Indeed, it is clear that these methods can significantly support an accurate and rapid diagnosis by eliminating errors, increasing reliability, and improving workflow. In addition, the effectiveness of AI in the pathological evaluation of prognostic parameters associated with behavior, course, and treatment in many types of tumors has also been noted. Regarding gastrointestinal system (GIS) cancers, the contribution of AI methods to pathological diagnosis has been investigated in many studies. On the other hand, studies focusing on AI applications in evaluating parameters to determine tumor behavior are relatively few. For this purpose, the potential of AI models has been studied over a broad spectrum, from tumor subtyping to the identification of new digital biomarkers. The capacity of AI to infer genetic alterations of cancer tissues from digital slides has been demonstrated. Although current data suggest the merit of AI-based approaches in assessing tumor behavior in GIS cancers, a wide range of challenges still need to be solved, from laboratory infrastructure to improving the robustness of algorithms, before incorporating AI applications into real-life GIS pathology practice. This review aims to present data from AI applications in evaluating pathological parameters related to the behavior of GIS cancer with an overview of the opportunities and challenges encountered in implementing AI in pathology.

Deep Learning-Based Prediction of Molecular Tumor Biomarkers from H&E: A Practical Review

Molecular and genomic properties are critical in selecting cancer treatments to target individual tumors, particularly for immunotherapy. However, the methods to assess such properties are expensive, time-consuming, and often not routinely performed. Applying machine learning to H&E images can provide a more cost-effective screening method. Dozens of studies over the last few years have demonstrated that a variety of molecular biomarkers can be predicted from H&E alone using the advancements of deep learning: molecular alterations, genomic subtypes, protein biomarkers, and even the presence of viruses. This article reviews the diverse applications across cancer types and the methodology to train and validate these models on whole slide images. From bottom-up to pathologist-driven to hybrid approaches, the leading trends include a variety of weakly supervised deep learning-based approaches, as well as mechanisms for training strongly supervised models in select situations. While results of these algorithms look promising, some challenges still persist, including small training sets, rigorous validation, and model explainability. Biomarker prediction models may yield a screening method to determine when to run molecular tests or an alternative when molecular tests are not possible. They also create new opportunities in quantifying intratumoral heterogeneity and predicting patient outcomes.

Optimization of deep learning models for the prediction of gene mutations using unsupervised clustering

Deep learning models are increasingly being used to interpret whole-slide images (WSIs) in digital pathology and to predict genetic mutations. Currently, it is commonly assumed that tumor regions have most of the predictive power. However, it is reasonable to assume that other tissues from the tumor microenvironment may also provide important predictive information. In this paper, we propose an unsupervised clustering-based multiple-instance deep learning model for the prediction of genetic mutations using WSIs of three cancer types obtained from The Cancer Genome Atlas. Our proposed model facilitates the identification of spatial regions related to specific gene mutations and exclusion of patches that lack predictive information through the use of unsupervised clustering. This results in a more accurate prediction of gene mutations when compared with models using all image patches on WSIs and two recently published algorithms for all three different cancer types evaluated in this study. In addition, our study validates the hypothesis that the prediction of gene mutations solely based on tumor regions on WSI slides may not always provide the best performance. Other tissue types in the tumor microenvironment could provide a better prediction ability than tumor tissues alone. These results highlight the heterogeneity in the tumor microenvironment and the importance of identification of predictive image patches in digital pathology prediction tasks.

Prediction of Epstein-Barr Virus Status in Gastric Cancer Biopsy Specimens Using a Deep Learning Algorithm

IMPORTANCE

Epstein-Barr virus (EBV)-associated gastric cancer (EBV-GC) is 1 of 4 molecular subtypes of GC and is confirmed by an expensive molecular test, EBV-encoded small RNA in situ hybridization. EBV-GC has 2 histologic characteristics, lymphoid stroma and lace-like tumor pattern, but projecting EBV-GC at biopsy is difficult even for experienced pathologists.

OBJECTIVE

To develop and validate a deep learning algorithm to predict EBV status from pathology images of GC biopsy.

DESIGN, SETTING, AND PARTICIPANTS

This diagnostic study developed a deep learning classifier to predict EBV-GC using image patches of tissue microarray (TMA) and whole slide images (WSIs) of GC and applied it to GC biopsy specimens from GCs diagnosed at Kangbuk Samsung Hospital between 2011 and 2020. For a quantitative evaluation and EBV-GC prediction on biopsy specimens, the area of each class and the fraction in total tissue or tumor area were calculated. Data were analyzed from March 5, 2021, to February 10, 2022.

MAIN OUTCOMES AND MEASURES

Evaluation metrics of predictive model performance were assessed on accuracy, recall, precision, F1 score, area under the receiver operating characteristic curve (AUC), and κ coefficient.

RESULTS

This study included 137 184 image patches from 16 TMAs (708 tissue cores), 24 WSIs, and 286 biopsy images of GC. The classifier was able to classify EBV-GC image patches from TMAs and WSIs with 94.70% accuracy, 0.936 recall, 0.938 precision, 0.937 F1 score, and 0.909 κ coefficient. The classifier was used for predicting and measuring the area and fraction of EBV-GC on biopsy tissue specimens. A 10% cutoff value for the predicted fraction of EBV-GC to tissue (EBV-GC/tissue area) produced the best prediction results in EBV-GC biopsy specimens and showed the highest AUC value (0.8723; 95% CI, 0.7560-0.9501). That cutoff also obtained high sensitivity (0.895) and moderate specificity (0.745) compared with experienced pathologist sensitivity (0.842) and specificity (0.854) when using the presence of lymphoid stroma and a lace-like pattern as diagnostic criteria. On prediction maps, EBV-GCs with lace-like pattern and lymphoid stroma showed the same prediction results as EBV-GC, but cases lacking these histologic features revealed heterogeneous prediction results of EBV-GC and non-EBV-GC areas.

CONCLUSIONS AND RELEVANCE

This study showed the feasibility of EBV-GC prediction using a deep learning algorithm, even in biopsy samples. Use of such an image-based classifier before a confirmatory molecular test will reduce costs and tissue waste.

Deep learning-based prediction of molecular cancer biomarkers from tissue slides: A new tool for precision oncology

Molecular tests are necessary to stratify cancer patients for targeted therapy. However, high cost and technical barriers limit the application of these tests, hindering optimal treatment. Recently, deep learning (DL) has been applied to predict molecular test results from digitized images of tissue slides. Furthermore, treatment response and prognosis can be predicted from tissue slides using DL. In this review, we summarized DL-based studies regarding the prediction of genetic mutation, microsatellite instability, tumor mutational burden, molecular subtypes, gene expression, treatment response, and prognosis directly from hematoxylin- and eosin-stained tissue slides. Although performance needs to be improved, these studies clearly demonstrated the feasibility of DL-based prediction of key molecular features in cancer tissues. With the accumulation of data and technical advances, the performance of the DL system could be improved in the near future. Therefore, we expect that DL could provide cost- and time-effective alternative tools for patient stratification in the era of precision oncology.

The evolving role of morphology in endometrial cancer diagnostics: From histopathology and molecular testing towards integrative data analysis by deep learning

Endometrial cancer (EC) diagnostics is evolving into a system in which molecular aspects are increasingly important. The traditional histological subtype-driven classification has shifted to a molecular-based classification that stratifies EC into DNA polymerase epsilon mutated (POLEmut), mismatch repair deficient (MMRd), and p53 abnormal (p53abn), and the remaining EC as no specific molecular profile (NSMP). The molecular EC classification has been implemented in the World Health Organization 2020 classification and the 2021 European treatment guidelines, as it serves as a better basis for patient management. As a result, the integration of the molecular class with histopathological variables has become a critical focus of recent EC research. Pathologists have observed and described several morphological characteristics in association with specific genomic alterations, but these appear insufficient to accurately classify patients according to molecular subgroups. This requires pathologists to rely on molecular ancillary tests in routine workup. In this new era, it has become increasingly challenging to assign clinically relevant weights to histological and molecular features on an individual patient basis. Deep learning (DL) technology opens new options for the integrative analysis of multi-modal image and molecular datasets with clinical outcomes. Proof-of-concept studies in other cancers showed promising accuracy in predicting molecular alterations from H&E-stained tumor slide images. This suggests that some morphological characteristics that are associated with molecular alterations could be identified in EC, too, expanding the current understanding of the molecular-driven EC classification. Here in this review, we report the morphological characteristics of the molecular EC classification currently identified in the literature. Given the new challenges in EC diagnostics, this review discusses, therefore, the potential supportive role that DL could have, by providing an outlook on all relevant studies using DL on histopathology images in various cancer types with a focus on EC. Finally, we touch upon how DL might shape the management of future EC patients.