Deep Learning based on hematoxylin-eosin staining outperforms immunohistochemistry in predicting molecular subtypes of gastric adenocarcinoma

Learning generalizable AI models for multi-center histopathology image classification

Investigation of histopathology slides by pathologists is an indispensable component of the routine diagnosis of cancer. Artificial intelligence (AI) has the potential to enhance diagnostic accuracy, improve efficiency, and patient outcomes in clinical pathology. However, variations in tissue preparation, staining protocols, and histopathology slide digitization could result in over-fitting of deep learning models when trained on the data from only one center, thereby underscoring the necessity to generalize deep learning networks for multi-center use. Several techniques, including the use of grayscale images, color normalization techniques, and Adversarial Domain Adaptation (ADA) have been suggested to generalize deep learning algorithms, but there are limitations to their effectiveness and discriminability. Convolutional Neural Networks (CNNs) exhibit higher sensitivity to variations in the amplitude spectrum, whereas humans predominantly rely on phase-related components for object recognition. As such, we propose Adversarial fourIer-based Domain Adaptation (AIDA) which applies the advantages of a Fourier transform in adversarial domain adaptation. We conducted a comprehensive examination of subtype classification tasks in four cancers, incorporating cases from multiple medical centers. Specifically, the datasets included multi-center data for 1113 ovarian cancer cases, 247 pleural cancer cases, 422 bladder cancer cases, and 482 breast cancer cases. Our proposed approach significantly improved performance, achieving superior classification results in the target domain, surpassing the baseline, color augmentation and normalization techniques, and ADA. Furthermore, extensive pathologist reviews suggested that our proposed approach, AIDA, successfully identifies known histotype-specific features. This superior performance highlights AIDA's potential in addressing generalization challenges in deep learning models for multi-center histopathology datasets.

Transcriptomic subtyping of gastrointestinal malignancies

Gastrointestinal (GI) cancers are highly heterogeneous at multiple levels. Tumor heterogeneity can be captured by molecular profiling, such as genetic, epigenetic, proteomic, and transcriptomic classification. Transcriptomic subtyping has the advantage of combining genetic and epigenetic information, cancer cell-intrinsic properties, and the tumor microenvironment (TME). Unsupervised transcriptomic subtyping systems of different GI malignancies have gained interest because they reveal shared biological features across cancers and bear prognostic and predictive value. Importantly, transcriptomic subtypes accurately reflect complex phenotypic states varying not only per tumor region, but also throughout disease progression, with consequences for clinical management. Here, we discuss methodologies of transcriptomic subtyping, proposed taxonomies for GI malignancies, and the challenges posed to clinical implementation, highlighting opportunities for future transcriptomic profiling efforts to optimize clinical impact.

Machine learning and multi-omics data reveal driver gene-based molecular subtypes in hepatocellular carcinoma for precision treatment

The heterogeneity of Hepatocellular Carcinoma (HCC) poses a barrier to effective treatment. Stratifying highly heterogeneous HCC into molecular subtypes with similar features is crucial for personalized anti-tumor therapies. Although driver genes play pivotal roles in cancer progression, their potential in HCC subtyping has been largely overlooked. This study aims to utilize driver genes to construct HCC subtype models and unravel their molecular mechanisms. Utilizing a novel computational framework, we expanded the initially identified 96 driver genes to 1192 based on mutational aspects and an additional 233 considering driver dysregulation. These genes were subsequently employed as stratification markers for further analyses. A novel multi-omics subtype classification algorithm was developed, leveraging mutation and expression data of the identified stratification genes. This algorithm successfully categorized HCC into two distinct subtypes, CLASS A and CLASS B, demonstrating significant differences in survival outcomes. Integrating multi-omics and single-cell data unveiled substantial distinctions between these subtypes regarding transcriptomics, mutations, copy number variations, and epigenomics. Moreover, our prognostic model exhibited excellent predictive performance in training and external validation cohorts. Finally, a 10-gene classification model for these subtypes identified TTK as a promising therapeutic target with robust classification capabilities. This comprehensive study provides a novel perspective on HCC stratification, offering crucial insights for a deeper understanding of its pathogenesis and the development of promising treatment strategies.

[The model transferability of AI in digital pathology : Potential and reality]

OBJECTIVE

Artificial intelligence (AI) holds the potential to make significant advancements in pathology. However, its actual implementation and certification for practical use are currently limited, often due to challenges related to model transferability. In this context, we investigate the factors influencing transferability and present methods aimed at enhancing the utilization of AI algorithms in pathology.

MATERIALS AND METHODS

Various convolutional neural networks (CNNs) and vision transformers (ViTs) were trained using datasets from two institutions, along with the publicly available TCGA-MIBC dataset. These networks conducted predictions in urothelial tissue and intrahepatic cholangiocarcinoma (iCCA). The objective was to illustrate the impact of stain normalization, the influence of various artifacts during both training and testing, as well as the effects of the NoisyEnsemble method.

RESULTS

We were able to demonstrate that stain normalization of slides from different institutions has a significant positive effect on the inter-institutional transferability of CNNs and ViTs (respectively +13% and +10%). In addition, ViTs usually achieve a higher accuracy in the external test (here +1.5%). Similarly, we showcased how artifacts in test data can negatively affect CNN predictions and how incorporating these artifacts during training leads to improvements. Lastly, NoisyEnsembles of CNNs (better than ViTs) were shown to enhance transferability across different tissues and research questions (+7% Bladder, +15% iCCA).

DISCUSSION

It is crucial to be aware of the transferability challenge: achieving good performance during development does not necessarily translate to good performance in real-world applications. The inclusion of existing methods to enhance transferability, such as stain normalization and NoisyEnsemble, and their ongoing refinement, is of importance.

Management of high risk T1 gastric adenocarcinoma following endoscopic resection

Endoscopic submucosal dissection has revolutionized the treatment of early gastric cancer. However, cases that do not meet the curability criteria have a higher risk of lymph node metastasis and salvage surgery is still considered the next treatment approach to increase the chance of cure. Nevertheless, not all high-risk resections entail the same level of risk, emphasizing the utmost importance of individualized stratification for further treatment. In this review, we aim to examine the current evidence concerning the management following a high-risk non-curative resection, highlighting the existing approaches, while also presenting upcoming strategies that attempt to improve patient outcomes, minimize adverse events, and provide a tailored management.

Efficient diagnosis of IDH-mutant gliomas: 1p/19qNET assesses 1p/19q codeletion status using weakly-supervised learning

Accurate identification of molecular alterations in gliomas is crucial for their diagnosis and treatment. Although, fluorescence in situ hybridization (FISH) allows for the observation of diverse and heterogeneous alterations, it is inherently time-consuming and challenging due to the limitations of the molecular method. Here, we report the development of 1p/19qNET, an advanced deep-learning network designed to predict fold change values of 1p and 19q chromosomes and classify isocitrate dehydrogenase (IDH)-mutant gliomas from whole-slide images. We trained 1p/19qNET on next-generation sequencing data from a discovery set (DS) of 288 patients and utilized a weakly-supervised approach with slide-level labels to reduce bias and workload. We then performed validation on an independent validation set (IVS) comprising 385 samples from The Cancer Genome Atlas, a comprehensive cancer genomics resource. 1p/19qNET outperformed traditional FISH, achieving R2 values of 0.589 and 0.547 for the 1p and 19q arms, respectively. As an IDH-mutant glioma classifier, 1p/19qNET attained AUCs of 0.930 and 0.837 in the DS and IVS, respectively. The weakly-supervised nature of 1p/19qNET provides explainable heatmaps for the results. This study demonstrates the successful use of deep learning for precise determination of 1p/19q codeletion status and classification of IDH-mutant gliomas as astrocytoma or oligodendroglioma. 1p/19qNET offers comparable results to FISH and provides informative spatial information. This approach has broader applications in tumor classification.

Application of artificial intelligence for improving early detection and prediction of therapeutic outcomes for gastric cancer in the era of precision oncology

Gastric cancer is a leading contributor to cancer incidence and mortality globally. Recently, artificial intelligence approaches, particularly machine learning and deep learning, are rapidly reshaping the full spectrum of clinical management for gastric cancer. Machine learning is formed from computers running repeated iterative models for progressively improving performance on a particular task. Deep learning is a subtype of machine learning on the basis of multilayered neural networks inspired by the human brain. This review summarizes the application of artificial intelligence algorithms to multi-dimensional data including clinical and follow-up information, conventional images (endoscope, histopathology, and computed tomography (CT)), molecular biomarkers, etc. to improve the risk surveillance of gastric cancer with established risk factors; the accuracy of diagnosis, and survival prediction among established gastric cancer patients; and the prediction of treatment outcomes for assisting clinical decision making. Therefore, artificial intelligence makes a profound impact on almost all aspects of gastric cancer from improving diagnosis to precision medicine. Despite this, most established artificial intelligence-based models are in a research-based format and often have limited value in real-world clinical practice. With the increasing adoption of artificial intelligence in clinical use, we anticipate the arrival of artificial intelligence-powered gastric cancer care.

Artificial Intelligence in the Pathology of Gastric Cancer

Recent advances in artificial intelligence (AI) have provided novel tools for rapid and precise pathologic diagnosis. The introduction of digital pathology has enabled the acquisition of scanned slide images that are essential for the application of AI. The application of AI for improved pathologic diagnosis includes the error-free detection of potentially negligible lesions, such as a minute focus of metastatic tumor cells in lymph nodes, the accurate diagnosis of potentially controversial histologic findings, such as very well-differentiated carcinomas mimicking normal epithelial tissues, and the pathological subtyping of the cancers. Additionally, the utilization of AI algorithms enables the precise decision of the score of immunohistochemical markers for targeted therapies, such as human epidermal growth factor receptor 2 and programmed death-ligand 1. Studies have revealed that AI assistance can reduce the discordance of interpretation between pathologists and more accurately predict clinical outcomes. Several approaches have been employed to develop novel biomarkers from histologic images using AI. Moreover, AI-assisted analysis of the cancer microenvironment showed that the distribution of tumor-infiltrating lymphocytes was related to the response to the immune checkpoint inhibitor therapy, emphasizing its value as a biomarker. As numerous studies have demonstrated the significance of AI-assisted interpretation and biomarker development, the AI-based approach will advance diagnostic pathology.

Artificial intelligence for tumour tissue detection and histological regression grading in oesophageal adenocarcinomas: a retrospective algorithm development and validation study

BACKGROUND

Oesophageal adenocarcinoma and adenocarcinoma of the oesophagogastric junction are among the most common malignant epithelial tumours. Most patients receive neoadjuvant therapy before complete tumour resection. Histological assessment after resection includes identification of residual tumour tissue and areas of regressive tumour, data which are used to calculate a clinically relevant regression score. We developed an artificial intelligence (AI) algorithm for tumour tissue detection and tumour regression grading in surgical specimens from patients with oesophageal adenocarcinoma or adenocarcinoma of the oesophagogastric junction.

METHODS

We used one training cohort and four independent test cohorts to develop, train, and validate a deep learning tool. The material consisted of histological slides from surgically resected specimens from patients with oesophageal adenocarcinoma and adenocarcinoma of the oesophagogastric junction from three pathology institutes (two in Germany, one in Austria) and oesophageal cancer cohort of The Cancer Genome Atlas (TCGA). All slides were from neoadjuvantly treated patients except for those from the TCGA cohort, who were neoadjuvant-therapy naive. Data from training cohort and test cohort cases were extensively manually annotated for 11 tissue classes. A convolutional neural network was trained on the data using a supervised principle. First, the tool was formally validated using manually annotated test datasets. Next, tumour regression grading was assessed in a retrospective cohort of post-neoadjuvant therapy surgical specimens. The grading of the algorithm was compared with that of a group of 12 board-certified pathologists from one department. To further validate the tool, three pathologists processed whole resection cases with and without AI assistance.

FINDINGS

Of the four test cohorts, one included 22 manually annotated histological slides (n=20 patients), one included 62 sides (n=15), one included 214 slides (n=69), and the final one included 22 manually annotated histological slides (n=22). In the independent test cohorts the AI tool had high patch-level accuracy for identifying both tumour and regression tissue. When we validated the concordance of the AI tool against analyses by a group of pathologists (n=12), agreement was 63·6% (quadratic kappa 0·749; p<0·0001) at case level. The AI-based regression grading triggered true reclassification of resected tumour slides in seven cases (including six cases who had small tumour regions that were initially missed by pathologists). Use of the AI tool by three pathologists increased interobserver agreement and substantially reduced diagnostic time per case compared with working without AI assistance.

INTERPRETATION

Use of our AI tool in the diagnostics of oesophageal adenocarcinoma resection specimens by pathologists increased diagnostic accuracy, interobserver concordance, and significantly reduced assessment time. Prospective validation of the tool is required.

FUNDING

North Rhine-Westphalia state, Federal Ministry of Education and Research of Germany, and the Wilhelm Sander Foundation.

Application of artificial neural network algorithm in pathological diagnosis and prognosis prediction of digestive tract malignant tumors

The application of artificial neural network algorithm in pathological diagnosis of gastrointestinal malignant tumors has become a research hotspot. In the previous studies, the algorithm research mainly focused on the model development based on convolutional neural networks, while only a few studies used the combination of convolutional neural networks and recurrent neural networks. The research contents included classical histopathological diagnosis and molecular typing of malignant tumors, and the prediction of patient prognosis by utilizing artificial neural networks. This article reviews the research progress on artificial neural network algorithm in the pathological diagnosis and prognosis prediction of digestive tract malignant tumors.

Artificial intelligence applications in predicting the behavior of gastrointestinal cancers in pathology

Recent research has provided a wealth of data supporting the application of artificial intelligence (AI)-based applications in routine pathology practice. Indeed, it is clear that these methods can significantly support an accurate and rapid diagnosis by eliminating errors, increasing reliability, and improving workflow. In addition, the effectiveness of AI in the pathological evaluation of prognostic parameters associated with behavior, course, and treatment in many types of tumors has also been noted. Regarding gastrointestinal system (GIS) cancers, the contribution of AI methods to pathological diagnosis has been investigated in many studies. On the other hand, studies focusing on AI applications in evaluating parameters to determine tumor behavior are relatively few. For this purpose, the potential of AI models has been studied over a broad spectrum, from tumor subtyping to the identification of new digital biomarkers. The capacity of AI to infer genetic alterations of cancer tissues from digital slides has been demonstrated. Although current data suggest the merit of AI-based approaches in assessing tumor behavior in GIS cancers, a wide range of challenges still need to be solved, from laboratory infrastructure to improving the robustness of algorithms, before incorporating AI applications into real-life GIS pathology practice. This review aims to present data from AI applications in evaluating pathological parameters related to the behavior of GIS cancer with an overview of the opportunities and challenges encountered in implementing AI in pathology.

Deep learning model to predict Epstein-Barr virus associated gastric cancer in histology

The detection of Epstein-Barr virus (EBV) in gastric cancer patients is crucial for clinical decision making, as it is related with specific treatment responses and prognoses. Despite its importance, the limited medical resources preclude universal EBV testing. Herein, we propose a deep learning-based EBV prediction method from H&E-stained whole-slide images (WSI). Our model was developed using 319 H&E stained WSI (26 EBV positive; TCGA dataset) from the Cancer Genome Atlas, and 108 WSI (8 EBV positive; ISH dataset) from an independent institution. Our deep learning model, EBVNet consists of two sequential components: a tumor classifier and an EBV classifier. We visualized the learned representation by the classifiers using UMAP. We externally validated the model using 60 additional WSI (7 being EBV positive; HGH dataset). We compared the model's performance with those of four pathologists. EBVNet achieved an AUPRC of 0.65, whereas the four pathologists yielded a mean AUPRC of 0.41. Moreover, EBVNet achieved an negative predictive value, sensitivity, specificity, precision, and F1-score of 0.98, 0.86, 0.92, 0.60, and 0.71, respectively. Our proposed model is expected to contribute to prescreen patients for confirmatory testing, potentially to save test-related cost and labor.

How to learn with intentional mistakes: NoisyEnsembles to overcome poor tissue quality for deep learning in computational pathology

There is a lot of recent interest in the field of computational pathology, as many algorithms are introduced to detect, for example, cancer lesions or molecular features. However, there is a large gap between artificial intelligence (AI) technology and practice, since only a small fraction of the applications is used in routine diagnostics. The main problems are the transferability of convolutional neural network (CNN) models to data from other sources and the identification of uncertain predictions. The role of tissue quality itself is also largely unknown. Here, we demonstrated that samples of the TCGA ovarian cancer (TCGA-OV) dataset from different tissue sources have different quality characteristics and that CNN performance is linked to this property. CNNs performed best on high-quality data. Quality control tools were partially able to identify low-quality tiles, but their use did not increase the performance of the trained CNNs. Furthermore, we trained NoisyEnsembles by introducing label noise during training. These NoisyEnsembles could improve CNN performance for low-quality, unknown datasets. Moreover, the performance increases as the ensemble become more consistent, suggesting that incorrect predictions could be discarded efficiently to avoid wrong diagnostic decisions.

Molecular subtyping of gastroesophageal dysplasia heterogeneity according to TCGA/ACRG classes

Gastric adenocarcinoma has recently been classified into several subtypes on the basis of molecular profiling, which has been successfully reproduced by immunohistochemistry (IHC) and in situ hybridization (ISH). A series of 73 gastroesophageal dysplastic lesions (37 gastric dysplasia and 36 Barrett dysplasia; 44 low-grade dysplasia and 29 high-grade dysplasia) was investigated for mismatch repair proteins, E-cadherin, p53, and EBER status, to reproduce The Cancer Genome Atlas (TCGA) and Asian Cancer Research Group (ACRG) molecular clustering. Overall, the dysplastic lesions were classified as follows: according to TCGA classification, EBV, 0/73 (0%), MSI, 6/73 (8.2%), GS, 4/73 (5.5%), CIN, 63/73 (86.3%); according to ACRG molecular subtyping, MSI, 6/73 (8.2%), MSS/EMT, 4/73 (5.5%), MSS/TP53⁻, 33/73 (45.2%), MSS/TP53⁺, 30/73 (41.1%). A positive association was found between MSS/TP53⁻ and Barrett dysplasia (p = 0.0004), between MSS/TP53⁺ and LG dysplasia (p = 0.001) and between MSS/TP53⁺ and gastric dysplasia (p = 0.0018). Gastroesophageal dysplastic lesions proved to be heterogenous in terms of TCGA/ACRG classes, but with a different distribution from that of cancers, with no EBV-positive cases, an increasing presence of mismatch repair deficiency from low grade to high grade lesions, and a prevalence of p53 aberrations in Barrett dysplasia. The present study further demonstrated that gastroesophageal dysplastic lesions may be characterized by alterations in predictive/prognostic biomarkers, and this should be considered in routine diagnostic.