Automatic Pancreatic Ductal Adenocarcinoma Detection in Whole Slide Images Using Deep Convolutional Neural Networks

Pancreatic Ductal Adenocarcinoma (PDAC): A Review of Recent Advancements Enabled by Artificial Intelligence

Pancreatic Ductal Adenocarcinoma (PDAC) remains one of the most formidable challenges in oncology, characterized by its late detection and poor prognosis. Artificial intelligence (AI) and machine learning (ML) are emerging as pivotal tools in revolutionizing PDAC care across various dimensions. Consequently, many studies have focused on using AI to improve the standard of PDAC care. This review article attempts to consolidate the literature from the past five years to identify high-impact, novel, and meaningful studies focusing on their transformative potential in PDAC management. Our analysis spans a broad spectrum of applications, including but not limited to patient risk stratification, early detection, and prediction of treatment outcomes, thereby highlighting AI's potential role in enhancing the quality and precision of PDAC care. By categorizing the literature into discrete sections reflective of a patient's journey from screening and diagnosis through treatment and survivorship, this review offers a comprehensive examination of AI-driven methodologies in addressing the multifaceted challenges of PDAC. Each study is summarized by explaining the dataset, ML model, evaluation metrics, and impact the study has on improving PDAC-related outcomes. We also discuss prevailing obstacles and limitations inherent in the application of AI within the PDAC context, offering insightful perspectives on potential future directions and innovations.

Investigation of the usefulness of a bile duct biopsy and bile cytology using a hyperspectral camera and machine learning

To improve the efficiency of pathological diagnoses, the development of automatic pathological diagnostic systems using artificial intelligence (AI) is progressing; however, problems include the low interpretability of AI technology and the need for large amounts of data. We herein report the usefulness of a general-purpose method that combines a hyperspectral camera with machine learning. As a result of analyzing bile duct biopsy and bile cytology specimens, which are especially difficult to determine as benign or malignant, using multiple machine learning models, both were able to identify benign or malignant cells with an accuracy rate of more than 80% (93.3% for bile duct biopsy specimens and 83.2% for bile cytology specimens). This method has the potential to contribute to the diagnosis and treatment of bile duct cancer and is expected to be widely applied and utilized in general pathological diagnoses.

Artificial intelligence in digital pathology: a systematic review and meta-analysis of diagnostic test accuracy

Ensuring diagnostic performance of artificial intelligence (AI) before introduction into clinical practice is essential. Growing numbers of studies using AI for digital pathology have been reported over recent years. The aim of this work is to examine the diagnostic accuracy of AI in digital pathology images for any disease. This systematic review and meta-analysis included diagnostic accuracy studies using any type of AI applied to whole slide images (WSIs) for any disease. The reference standard was diagnosis by histopathological assessment and/or immunohistochemistry. Searches were conducted in PubMed, EMBASE and CENTRAL in June 2022. Risk of bias and concerns of applicability were assessed using the QUADAS-2 tool. Data extraction was conducted by two investigators and meta-analysis was performed using a bivariate random effects model, with additional subgroup analyses also performed. Of 2976 identified studies, 100 were included in the review and 48 in the meta-analysis. Studies were from a range of countries, including over 152,000 whole slide images (WSIs), representing many diseases. These studies reported a mean sensitivity of 96.3% (CI 94.1-97.7) and mean specificity of 93.3% (CI 90.5-95.4). There was heterogeneity in study design and 99% of studies identified for inclusion had at least one area at high or unclear risk of bias or applicability concerns. Details on selection of cases, division of model development and validation data and raw performance data were frequently ambiguous or missing. AI is reported as having high diagnostic accuracy in the reported areas but requires more rigorous evaluation of its performance.

Pancreatic Adenocarcinoma: Imaging Modalities and the Role of Artificial Intelligence in Analyzing CT and MRI Images

Pancreatic ductal adenocarcinoma (PDAC) stands out as the predominant malignant neoplasm affecting the pancreas, characterized by a poor prognosis, in most cases patients being diagnosed in a nonresectable stage. Image-based artificial intelligence (AI) models implemented in tumor detection, segmentation, and classification could improve diagnosis with better treatment options and increased survival. This review included papers published in the last five years and describes the current trends in AI algorithms used in PDAC. We analyzed the applications of AI in the detection of PDAC, segmentation of the lesion, and classification algorithms used in differential diagnosis, prognosis, and histopathological and genomic prediction. The results show a lack of multi-institutional collaboration and stresses the need for bigger datasets in order for AI models to be implemented in a clinically relevant manner.

Machine Learning of Histopathological Images Predicts Recurrences of Resected Pancreatic Ductal Adenocarcinoma With Adjuvant Treatment

OBJECTIVES

Pancreatic ductal adenocarcinoma is an intractable disease with frequent recurrence after resection and adjuvant therapy. The present study aimed to clarify whether artificial intelligence-assisted analysis of histopathological images can predict recurrence in patients with pancreatic ductal adenocarcinoma who underwent resection and adjuvant chemotherapy with tegafur/5-chloro-2,4-dihydroxypyridine/potassium oxonate.

MATERIALS AND METHODS

Eighty-nine patients were enrolled in the study. Machine-learning algorithms were applied to 10-billion-scale pixel data of whole-slide histopathological images to generate key features using multiple deep autoencoders. Areas under the curve were calculated from receiver operating characteristic curves using a support vector machine with key features alone and by combining with clinical data (age and carbohydrate antigen 19-9 and carcinoembryonic antigen levels) for predicting recurrence. Supervised learning with pathological annotations was conducted to determine the significant features for predicting recurrence.

RESULTS

Areas under the curves obtained were 0.73 (95% confidence interval, 0.59-0.87) by the histopathological data analysis and 0.84 (95% confidence interval, 0.73-0.94) by the combinatorial analysis of histopathological data and clinical data. Supervised learning model demonstrated that poor tumor differentiation was significantly associated with recurrence.

CONCLUSIONS

Results indicate that machine learning with the integration of artificial intelligence-driven evaluation of histopathological images and conventional clinical data provides relevant prognostic information for patients with pancreatic ductal adenocarcinoma.

From Machine Learning to Patient Outcomes: A Comprehensive Review of AI in Pancreatic Cancer

Pancreatic cancer is a highly aggressive and difficult-to-detect cancer with a poor prognosis. Late diagnosis is common due to a lack of early symptoms, specific markers, and the challenging location of the pancreas. Imaging technologies have improved diagnosis, but there is still room for improvement in standardizing guidelines. Biopsies and histopathological analysis are challenging due to tumor heterogeneity. Artificial Intelligence (AI) revolutionizes healthcare by improving diagnosis, treatment, and patient care. AI algorithms can analyze medical images with precision, aiding in early disease detection. AI also plays a role in personalized medicine by analyzing patient data to tailor treatment plans. It streamlines administrative tasks, such as medical coding and documentation, and provides patient assistance through AI chatbots. However, challenges include data privacy, security, and ethical considerations. This review article focuses on the potential of AI in transforming pancreatic cancer care, offering improved diagnostics, personalized treatments, and operational efficiency, leading to better patient outcomes.

Combined analytical approach empowers precise spectroscopic interpretation of subcellular components of pancreatic cancer cells

The lack of specific and sensitive early diagnostic options for pancreatic cancer (PC) results in patients being largely diagnosed with late-stage disease, thus inoperable and burdened with high mortality. Molecular spectroscopic methodologies, such as Raman or infrared spectroscopies, show promise in becoming a leader in screening for early-stage cancer diseases, including PC. However, should such technology be introduced, the identification of differentiating spectral features between various cancer types is required. This would not be possible without the precise extraction of spectra without the contamination by necrosis, inflammation, desmoplasia, or extracellular fluids such as mucous that surround tumor cells. Moreover, an efficient methodology for their interpretation has not been well defined. In this study, we compared different methods of spectral analysis to find the best for investigating the biomolecular composition of PC cells cytoplasm and nuclei separately. Sixteen PC tissue samples of main PC subtypes (ductal adenocarcinoma, intraductal papillary mucinous carcinoma, and ampulla of Vater carcinoma) were collected with Raman hyperspectral mapping, resulting in 191,355 Raman spectra and analyzed with comparative methodologies, specifically, hierarchical cluster analysis, non-negative matrix factorization, T-distributed stochastic neighbor embedding, principal components analysis (PCA), and convolutional neural networks (CNN). As a result, we propose an innovative approach to spectra classification by CNN, combined with PCA for molecular characterization. The CNN-based spectra classification achieved over 98% successful validation rate. Subsequent analyses of spectral features revealed differences among PC subtypes and between the cytoplasm and nuclei of their cells. Our study establishes an optimal methodology for cancer tissue spectral data classification and interpretation that allows precise and cognitive studies of cancer cells and their subcellular components, without mixing the results with cancer-surrounding tissue. As a proof of concept, we describe findings that add to the spectroscopic understanding of PC.

An improved multi-scale gradient generative adversarial network for enhancing classification of colorectal cancer histological images

Introduction

Deep learning-based solutions for histological image classification have gained attention in recent years due to their potential for objective evaluation of histological images. However, these methods often require a large number of expert annotations, which are both time-consuming and labor-intensive to obtain. Several scholars have proposed generative models to augment labeled data, but these often result in label uncertainty due to incomplete learning of the data distribution.

Methods

To alleviate these issues, a method called InceptionV3-SMSG-GAN has been proposed to enhance classification performance by generating high-quality images. Specifically, images synthesized by Multi-Scale Gradients Generative Adversarial Network (MSG-GAN) are selectively added to the training set through a selection mechanism utilizing a trained model to choose generated images with higher class probabilities. The selection mechanism filters the synthetic images that contain ambiguous category information, thus alleviating label uncertainty.

Results

Experimental results show that compared with the baseline method which uses InceptionV3, the proposed method can significantly improve the performance of pathological image classification from 86.87% to 89.54% for overall accuracy. Additionally, the quality of generated images is evaluated quantitatively using various commonly used evaluation metrics.

Discussion

The proposed InceptionV3-SMSG-GAN method exhibited good classification ability, where histological image could be divided into nine categories. Future work could focus on further refining the image generation and selection processes to optimize classification performance.

A, M. SK. CT scan pancreatic cancer segmentation and classification using deep learning and the tunicate swarm algorithm

Pancreatic cancer (PC) is a very lethal disease with a low survival rate, making timely and accurate diagnoses critical for successful treatment. PC classification in computed tomography (CT) scans is a vital task that aims to accurately discriminate between tumorous and non-tumorous pancreatic tissues. CT images provide detailed cross-sectional images of the pancreas, which allows oncologists and radiologists to analyse the characteristics and morphology of the tissue. Machine learning (ML) approaches, together with deep learning (DL) algorithms, are commonly explored to improve and automate the performance of PC classification in CT scans. DL algorithms, particularly convolutional neural networks (CNNs), are broadly utilized for medical image analysis tasks, involving segmentation and classification. This study explores the design of a tunicate swarm algorithm with deep learning-based pancreatic cancer segmentation and classification (TSADL-PCSC) technique on CT scans. The purpose of the TSADL-PCSC technique is to design an effectual and accurate model to improve the diagnostic performance of PC. To accomplish this, the TSADL-PCSC technique employs a W-Net segmentation approach to define the affected region on the CT scans. In addition, the TSADL-PCSC technique utilizes the GhostNet feature extractor to create a group of feature vectors. For PC classification, the deep echo state network (DESN) model is applied in this study. Finally, the hyperparameter tuning of the DESN approach occurs utilizing the TSA which assists in attaining improved classification performance. The experimental outcome of the TSADL-PCSC method was tested on a benchmark CT scan database. The obtained outcomes highlighted the significance of the TSADL-PCSC technique over other approaches to PC classification.

A review study on early detection of pancreatic ductal adenocarcinoma using artificial intelligence assisted diagnostic methods

Pancreatic ductal adenocarcinoma (PDAC) is an aggressive, chemo-refractory and recalcitrant cancer and increases the number of deaths. With just around 1 in 4 individuals having respectable tumours, PDAC is frequently discovered when it is in an advanced stage. Accordingly, ED of PDAC improves patient survival. Subsequently, this paper reviews the early detection of PDAC, initially, the work presented an overview of PDAC. Subsequently, it reviews the molecular biology of pancreatic cancer and the development of molecular biomarkers are represented. This article illustrates the importance of identifying PDCA, the Immune Microenvironment of Pancreatic Cancer. Consequently, in this review, traditional and non-traditional imaging techniques are elucidated, traditional and non-traditional methods like endoscopic ultrasound, Multidetector CT, CT texture analysis, PET-CT, magnetic resonance imaging, diffusion-weighted imaging, secondary signs of pancreatic cancer, and molecular imaging. The use of artificial intelligence in pancreatic cancer, novel MRI techniques, and the future directions of AI for PDAC detection and prognosis is then described. Additionally, the research problem definition and motivation, current trends and developments, state of art of survey, and objective of the research are demonstrated in the review. Consequently, this review concluded that Artificial Intelligence Assisted Diagnostic Methods with MRI images can be proposed in future to improve the specificity and the sensitivity of the work, and to classify malignant PDAC with greater accuracy.

ChampKit: A framework for rapid evaluation of deep neural networks for patch-based histopathology classification

BACKGROUND AND OBJECTIVE

Histopathology is the gold standard for diagnosis of many cancers. Recent advances in computer vision, specifically deep learning, have facilitated the analysis of histopathology images for many tasks, including the detection of immune cells and microsatellite instability. However, it remains difficult to identify optimal models and training configurations for different histopathology classification tasks due to the abundance of available architectures and the lack of systematic evaluations. Our objective in this work is to present a software tool that addresses this need and enables robust, systematic evaluation of neural network models for patch classification in histology in a light-weight, easy-to-use package for both algorithm developers and biomedical researchers.

METHODS

Here we present ChampKit (Comprehensive Histopathology Assessment of Model Predictions toolKit): an extensible, fully reproducible evaluation toolkit that is a one-stop-shop to train and evaluate deep neural networks for patch classification. ChampKit curates a broad range of public datasets. It enables training and evaluation of models supported by timm directly from the command line, without the need for users to write any code. External models are enabled through a straightforward API and minimal coding. As a result, Champkit facilitates the evaluation of existing and new models and deep learning architectures on pathology datasets, making it more accessible to the broader scientific community. To demonstrate the utility of ChampKit, we establish baseline performance for a subset of possible models that could be employed with ChampKit, focusing on several popular deep learning models, namely ResNet18, ResNet50, and R26-ViT, a hybrid vision transformer. In addition, we compare each model trained either from random weight initialization or with transfer learning from ImageNet pretrained models. For ResNet18, we also consider transfer learning from a self-supervised pretrained model.

RESULTS

The main result of this paper is the ChampKit software. Using ChampKit, we were able to systemically evaluate multiple neural networks across six datasets. We observed mixed results when evaluating the benefits of pretraining versus random intialization, with no clear benefit except in the low data regime, where transfer learning was found to be beneficial. Surprisingly, we found that transfer learning from self-supervised weights rarely improved performance, which is counter to other areas of computer vision.

CONCLUSIONS

Choosing the right model for a given digital pathology dataset is nontrivial. ChampKit provides a valuable tool to fill this gap by enabling the evaluation of hundreds of existing (or user-defined) deep learning models across a variety of pathology tasks. Source code and data for the tool are freely accessible at https://github.com/SBU-BMI/champkit.

Performance comparison between multi-center histopathology datasets of a weakly-supervised deep learning model for pancreatic ductal adenocarcinoma detection

BACKGROUND

Pancreatic ductal carcinoma patients have a really poor prognosis given its difficult early detection and the lack of early symptoms. Digital pathology is routinely used by pathologists to diagnose the disease. However, visually inspecting the tissue is a time-consuming task, which slows down the diagnostic procedure. With the advances occurred in the area of artificial intelligence, specifically with deep learning models, and the growing availability of public histology data, clinical decision support systems are being created. However, the generalization capabilities of these systems are not always tested, nor the integration of publicly available datasets for pancreatic ductal carcinoma detection (PDAC).

METHODS

In this work, we explored the performace of two weakly-supervised deep learning models using the two more widely available datasets with pancreatic ductal carcinoma histology images, The Cancer Genome Atlas Project (TCGA) and the Clinical Proteomic Tumor Analysis Consortium (CPTAC). In order to have sufficient training data, the TCGA dataset was integrated with the Genotype-Tissue Expression (GTEx) project dataset, which contains healthy pancreatic samples.

RESULTS

We showed how the model trained on CPTAC generalizes better than the one trained on the integrated dataset, obtaining an inter-dataset accuracy of 90.62% ± 2.32 and an outer-dataset accuracy of 92.17% when evaluated on TCGA + GTEx. Furthermore, we tested the performance on another dataset formed by tissue micro-arrays, obtaining an accuracy of 98.59%. We showed how the features learned in an integrated dataset do not differentiate between the classes, but between the datasets, noticing that a stronger normalization might be needed when creating clinical decision support systems with datasets obtained from different sources. To mitigate this effect, we proposed to train on the three available datasets, improving the detection performance and generalization capabilities of a model trained only on TCGA + GTEx and achieving a similar performance to the model trained only on CPTAC.

CONCLUSIONS

The integration of datasets where both classes are present can mitigate the batch effect present when integrating datasets, improving the classification performance, and accurately detecting PDAC across different datasets.

Pacpaint: a histology-based deep learning model uncovers the extensive intratumor molecular heterogeneity of pancreatic adenocarcinoma

Two tumor (Classical/Basal) and stroma (Inactive/active) subtypes of Pancreatic adenocarcinoma (PDAC) with prognostic and theragnostic implications have been described. These molecular subtypes were defined by RNAseq, a costly technique sensitive to sample quality and cellularity, not used in routine practice. To allow rapid PDAC molecular subtyping and study PDAC heterogeneity, we develop PACpAInt, a multi-step deep learning model. PACpAInt is trained on a multicentric cohort (n = 202) and validated on 4 independent cohorts including biopsies (surgical cohorts n = 148; 97; 126 / biopsy cohort n = 25), all with transcriptomic data (n = 598) to predict tumor tissue, tumor cells from stroma, and their transcriptomic molecular subtypes, either at the whole slide or tile level (112 µm squares). PACpAInt correctly predicts tumor subtypes at the whole slide level on surgical and biopsies specimens and independently predicts survival. PACpAInt highlights the presence of a minor aggressive Basal contingent that negatively impacts survival in 39% of RNA-defined classical cases. Tile-level analysis ( > 6 millions) redefines PDAC microheterogeneity showing codependencies in the distribution of tumor and stroma subtypes, and demonstrates that, in addition to the Classical and Basal tumors, there are Hybrid tumors that combine the latter subtypes, and Intermediate tumors that may represent a transition state during PDAC evolution.

Artificial intelligence as a noninvasive tool for pancreatic cancer prediction and diagnosis

Pancreatic cancer (PC) has a low incidence rate but a high mortality, with patients often in the advanced stage of the disease at the time of the first diagnosis. If detected, early neoplastic lesions are ideal for surgery, offering the best prognosis. Preneoplastic lesions of the pancreas include pancreatic intraepithelial neoplasia and mucinous cystic neoplasms, with intraductal papillary mucinous neoplasms being the most commonly diagnosed. Our study focused on predicting PC by identifying early signs using noninvasive techniques and artificial intelligence (AI). A systematic English literature search was conducted on the PubMed electronic database and other sources. We obtained a total of 97 studies on the subject of pancreatic neoplasms. The final number of articles included in our study was 44, 34 of which focused on the use of AI algorithms in the early diagnosis and prediction of pancreatic lesions. AI algorithms can facilitate diagnosis by analyzing massive amounts of data in a short period of time. Correlations can be made through AI algorithms by expanding image and electronic medical records databases, which can later be used as part of a screening program for the general population. AI-based screening models should involve a combination of biomarkers and medical and imaging data from different sources. This requires large numbers of resources, collaboration between medical practitioners, and investment in medical infrastructures.

Applications of Deep Learning in Endocrine Neoplasms

Machine learning methods have been growing in prominence across all areas of medicine. In pathology, recent advances in deep learning (DL) have enabled computational analysis of histological samples, aiding in diagnosis and characterization in multiple disease areas. In cancer, and particularly endocrine cancer, DL approaches have been shown to be useful in tasks ranging from tumor grading to gene expression prediction. This review summarizes the current state of DL research in endocrine cancer histopathology with an emphasis on experimental design, significant findings, and key limitations.

Multi-modality artificial intelligence in digital pathology

In common medical procedures, the time-consuming and expensive nature of obtaining test results plagues doctors and patients. Digital pathology research allows using computational technologies to manage data, presenting an opportunity to improve the efficiency of diagnosis and treatment. Artificial intelligence (AI) has a great advantage in the data analytics phase. Extensive research has shown that AI algorithms can produce more up-to-date and standardized conclusions for whole slide images. In conjunction with the development of high-throughput sequencing technologies, algorithms can integrate and analyze data from multiple modalities to explore the correspondence between morphological features and gene expression. This review investigates using the most popular image data, hematoxylin-eosin stained tissue slide images, to find a strategic solution for the imbalance of healthcare resources. The article focuses on the role that the development of deep learning technology has in assisting doctors' work and discusses the opportunities and challenges of AI.

Setting the Research Agenda for Clinical Artificial Intelligence in Pancreatic Adenocarcinoma Imaging

Simple Summary

Pancreatic ductal adenocarcinoma (PDAC) is one of the deadliest cancers worldwide, associated with a 98% loss of life expectancy and a 30% increase in disability-adjusted life years. Image-based artificial intelligence (AI) can help improve outcomes for PDAC given that current clinical guidelines are non-uniform and lack evidence-based consensus. However, research on image-based AI for PDAC is too scattered and lacking in sufficient quality to be incorporated into clinical workflows. In this review, an international, multi-disciplinary team of the world’s leading experts in pancreatic cancer breaks down the patient pathway and pinpoints the current clinical touchpoints in each stage. The available PDAC imaging AI literature addressing each pathway stage is then rigorously analyzed, and current performance and pitfalls are identified in a comprehensive overview. Finally, the future research agenda for clinically relevant, image-driven AI in PDAC is proposed.

Abstract

Pancreatic ductal adenocarcinoma (PDAC), estimated to become the second leading cause of cancer deaths in western societies by 2030, was flagged as a neglected cancer by the European Commission and the United States Congress. Due to lack of investment in research and development, combined with a complex and aggressive tumour biology, PDAC overall survival has not significantly improved the past decades. Cross-sectional imaging and histopathology play a crucial role throughout the patient pathway. However, current clinical guidelines for diagnostic workup, patient stratification, treatment response assessment, and follow-up are non-uniform and lack evidence-based consensus. Artificial Intelligence (AI) can leverage multimodal data to improve patient outcomes, but PDAC AI research is too scattered and lacking in quality to be incorporated into clinical workflows. This review describes the patient pathway and derives touchpoints for image-based AI research in collaboration with a multi-disciplinary, multi-institutional expert panel. The literature exploring AI to address these touchpoints is thoroughly retrieved and analysed to identify the existing trends and knowledge gaps. The results show absence of multi-institutional, well-curated datasets, an essential building block for robust AI applications. Furthermore, most research is unimodal, does not use state-of-the-art AI techniques, and lacks reliable ground truth. Based on this, the future research agenda for clinically relevant, image-driven AI in PDAC is proposed.

Robust deep learning model for prognostic stratification of pancreatic ductal adenocarcinoma patients

A major challenge for treating patients with pancreatic ductal adenocarcinoma (PDAC) is the unpredictability of their prognoses due to high heterogeneity. We present Multi-Omics DEep Learning for Prognosis-correlated subtyping (MODEL-P) to identify PDAC subtypes and to predict prognoses of new patients. MODEL-P was trained on autoencoder integrated multi-omics of 146 patients with PDAC together with their survival outcome. Using MODEL-P, we identified two PDAC subtypes with distinct survival outcomes (median survival 10.1 and 22.7 months, respectively, log rank p = 1 × 10⁻⁶), which correspond to DNA damage repair and immune response. We rigorously validated MODEL-P by stratifying patients in five independent datasets into these two survival groups and achieved significant survival difference, which is superior to current practice and other subtyping schemas. We believe the subtype-specific signatures would facilitate PDAC pathogenesis discovery, and MODEL-P can provide clinicians the prognoses information in the treatment decision-making to better gauge the benefits versus the risks.

•

We developed DL-based MODEL-P to identify prognosis-correlated PDAC subtypes

•

The identified subtypes related to DNA damage repair and immune response processes

•

MODEL-P stratified patients from independent datasets into distinct survival groups

•

MODEL-P could be used in clinics to aid treatment decision-making