Deep Learning-Based Differentiation between Mucinous Cystic Neoplasm and Serous Cystic Neoplasm in the Pancreas Using Endoscopic Ultrasonography

Advancements in biliopancreatic endoscopy: a comprehensive review of artificial intelligence in EUS and ERCP

The development and implementation of artificial intelligence (AI), particularly deep learning (DL) models, has generated significant interest across various fields of gastroenterology. While research in luminal endoscopy has seen rapid translation to clinical practice with approved AI devices, its potential extends far beyond, offering promising benefits for biliopancreatic endoscopy like optical characterization of strictures during cholangioscopy or detection and classification of pancreatic lesions during diagnostic endoscopic ultrasound (EUS). This narrative review provides an up-to-date of the latest literature and available studies in this field. Serving as a comprehensive guide to the current landscape of AI in biliopancreatic endoscopy, emphasizing technological advancements, main applications, ethical considerations, and future directions for research and clinical implementation.

Application of artificial intelligence in pancreas endoscopic ultrasound imaging- A systematic review

The pancreas is a vital organ in digestive system which has significant health implications. It is imperative to evaluate and identify malignant pancreatic lesions promptly in light of the high mortality rate linked to such malignancies. Endoscopic Ultrasound (EUS) is a non-invasive precise technique to detect pancreas disorders, but it is highly operator dependent. Artificial intelligence (AI), including traditional machine learning (ML) and deep learning (DL) techniques can play a pivotal role to enhancing the performance of EUS regardless of operator. AI performs a critical function in the detection, classification, and segmentation of medical images. The utilization of AI-assisted systems has improved the accuracy and productivity of pancreatic analysis, including the detection of diverse pancreatic disorders (e.g., pancreatitis, masses, and cysts) as well as landmarks and parenchyma. This systematic review examines the rapidly developing domain of AI-assisted system in EUS of the pancreas. Its objective is to present a thorough study of the present research status and developments in this area. This paper explores the significant challenges of AI-assisted system in pancreas EUS imaging, highlights the potential of AI techniques in addressing these challenges, and suggests the scope for future research in domain of AI-assisted EUS systems.

Basic Principles and Role of Endoscopic Ultrasound in Diagnosis and Differentiation of Pancreatic Cancer from Other Pancreatic Lesions: A Comprehensive Review of Endoscopic Ultrasound for Pancreatic Cancer

Pancreatic cancer is one of the leading causes of cancer-related deaths worldwide. Pancreatic lesions consist of both neoplastic and non-neoplastic lesions and often pose a diagnostic and therapeutic challenge due to similar clinical and radiological features. In recent years, pancreatic lesions have been discovered more frequently as incidental findings due to the increased utilization and widespread availability of abdominal cross-sectional imaging. Therefore, it becomes imperative to establish an early and appropriate diagnosis with meticulous differentiation in an attempt to balance unnecessary treatment of benign pancreatic lesions and missing the opportunity for early intervention in malignant lesions. Endoscopic ultrasound (EUS) has become an important diagnostic modality for the identification and risk stratification of pancreatic lesions due to its ability to provide detailed imaging and acquisition of tissue samples for analysis with the help of fine-needle aspiration/biopsy. The recent development of EUS-based technology, including contrast-enhanced endoscopic ultrasound, real-time elastography-endoscopic ultrasound, miniature probe ultrasound, confocal laser endomicroscopy, and the application of artificial intelligence has significantly augmented the diagnostic accuracy of EUS as it enables better evaluation of the number, location, dimension, wall thickness, and contents of these lesions. This article provides a comprehensive overview of the role of the different types of EUS available for the diagnosis and differentiation of pancreatic cancer from other pancreatic lesions while discussing their key strengths and important limitations.

Current status of artificial intelligence analysis for the treatment of pancreaticobiliary diseases using endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography

Pancreatic and biliary diseases encompass a range of conditions requiring accurate diagnosis for appropriate treatment strategies. This diagnosis relies heavily on imaging techniques like endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography. Artificial intelligence (AI), including machine learning and deep learning, is becoming integral in medical imaging and diagnostics, such as the detection of colorectal polyps. AI shows great potential in diagnosing pancreatobiliary diseases. Unlike machine learning, which requires feature extraction and selection, deep learning can utilize images directly as input. Accurate evaluation of AI performance is a complex task due to varied terminologies, evaluation methods, and development stages. Essential aspects of AI evaluation involve defining the AI's purpose, choosing appropriate gold standards, deciding on the validation phase, and selecting reliable validation methods. AI, particularly deep learning, is increasingly employed in endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography diagnostics, achieving high accuracy levels in detecting and classifying various pancreatobiliary diseases. The AI often performs better than doctors, even in tasks like differentiating benign from malignant pancreatic tumors, cysts, and subepithelial lesions, identifying gallbladder lesions, assessing endoscopic retrograde cholangiopancreatography difficulty, and evaluating the biliary strictures. The potential for AI in diagnosing pancreatobiliary diseases, especially where other modalities have limitations, is considerable. However, a crucial constraint is the need for extensive, high-quality annotated data for AI training. Future advances in AI, such as large language models, promise further applications in the medical field.

Applications and Prospects of Artificial Intelligence-Assisted Endoscopic Ultrasound in Digestive System Diseases

Endoscopic ultrasound (EUS) has emerged as a widely utilized tool in the diagnosis of digestive diseases. In recent years, the potential of artificial intelligence (AI) in healthcare has been gradually recognized, and its superiority in the field of EUS is becoming apparent. Machine learning (ML) and deep learning (DL) are the two main AI algorithms. This paper aims to outline the applications and prospects of artificial intelligence-assisted endoscopic ultrasound (EUS-AI) in digestive diseases over the past decade. The results demonstrated that EUS-AI has shown superiority or at least equivalence to traditional methods in the diagnosis, prognosis, and quality control of subepithelial lesions, early esophageal cancer, early gastric cancer, and pancreatic diseases including pancreatic cystic lesions, autoimmune pancreatitis, and pancreatic cancer. The implementation of EUS-AI has opened up new avenues for individualized precision medicine and has introduced novel diagnostic and treatment approaches for digestive diseases.

Artificial Intelligence in the Diagnosis and Treatment of Pancreatic Cystic Lesions and Adenocarcinoma

Pancreatic cancer is projected to become the second leading cause of cancer-related mortality in the United States by 2030. This is in part due to the paucity of reliable screening and diagnostic options for early detection. Amongst known pre-malignant pancreatic lesions, pancreatic intraepithelial neoplasia (PanIN) and intraductal papillary mucinous neoplasms (IPMNs) are the most prevalent. The current standard of care for the diagnosis and classification of pancreatic cystic lesions (PCLs) involves cross-sectional imaging studies and endoscopic ultrasound (EUS) and, when indicated, EUS-guided fine needle aspiration and cyst fluid analysis. However, this is suboptimal for the identification and risk stratification of PCLs, with accuracy of only 65-75% for detecting mucinous PCLs. Artificial intelligence (AI) is a promising tool that has been applied to improve accuracy in screening for solid tumors, including breast, lung, cervical, and colon cancer. More recently, it has shown promise in diagnosing pancreatic cancer by identifying high-risk populations, risk-stratifying premalignant lesions, and predicting the progression of IPMNs to adenocarcinoma. This review summarizes the available literature on artificial intelligence in the screening and prognostication of precancerous lesions in the pancreas, and streamlining the diagnosis of pancreatic cancer.

Histogram array and convolutional neural network of DWI for differentiating pancreatic ductal adenocarcinomas from solid pseudopapillary neoplasms and neuroendocrine neoplasms

PURPOSE

This study aimed to investigate the diagnostic performance of the histogram array and convolutional neural network (CNN) based on diffusion-weighted imaging (DWI) with multiple b-values under magnetic resonance imaging (MRI) to distinguish pancreatic ductal adenocarcinomas (PDACs) from solid pseudopapillary neoplasms (SPNs) and pancreatic neuroendocrine neoplasms (PNENs).

METHODS

This retrospective study consisted of patients diagnosed with PDACs (n = 132), PNENs (n = 45) and SPNs (n = 54). All patients underwent 3.0-T MRI including DWI with 10 b values. The regions of interest (ROIs) of pancreatic tumor were manually drawn using ITK-SNAP software, which included entire tumor at DWI (b = 1500 s/m²). The histogram array was obtained through the ROIs from multiple b-value data. PyTorch (version 1.11) was used to construct a CNN classifier to categorize the histogram array into PDACs, PNENs or SPNs.

RESULTS

The area under the curves (AUCs) of the histogram array and the CNN model for differentiating PDACs from PNENs and SPNs were 0.896, 0.846, and 0.839 in the training, validation and testing cohorts, respectively. The accuracy, sensitivity and specificity were 90.22%, 96.23%, and 82.05% in the training cohort, 84.78%, 96.15%, and 70.0% in the validation cohort, and 81.72%, 90.57%, and 70.0% in the testing cohort. The performance of CNN with AUC of 0.865 for this differentiation was significantly higher than that of f with AUC = 0.755 (P = 0.0057) and α with AUC = 0.776 (P = 0.0278) in all patients.

CONCLUSION

The histogram array and CNN based on DWI data with multiple b-values using MRI provided an accurate diagnostic performance to differentiate PDACs from PNENs and SPNs.

Accurate prediction of histological grading of intraductal papillary mucinous neoplasia using deep learning

BACKGROUND

 Risk stratification and recommendation for surgery for intraductal papillary mucinous neoplasm (IPMN) are currently based on consensus guidelines. Risk stratification from presurgery histology is only potentially decisive owing to the low sensitivity of fine-needle aspiration. In this study, we developed and validated a deep learning-based method to distinguish between IPMN with low grade dysplasia and IPMN with high grade dysplasia/invasive carcinoma using endoscopic ultrasound (EUS) images.

METHODS

 For model training, we acquired a total of 3355 EUS images from 43 patients who underwent pancreatectomy from March 2015 to August 2021. All patients had histologically proven IPMN. We used transfer learning to fine-tune a convolutional neural network and to classify "low grade IPMN" from "high grade IPMN/invasive carcinoma." Our test set consisted of 1823 images from 27 patients, recruiting 11 patients retrospectively, 7 patients prospectively, and 9 patients externally. We compared our results with the prediction based on international consensus guidelines.

RESULTS

 Our approach could classify low grade from high grade/invasive carcinoma in the test set with an accuracy of 99.6 % (95 %CI 99.5 %-99.9 %). Our deep learning model achieved superior accuracy in prediction of the histological outcome compared with any individual guideline, which have accuracies between 51.8 % (95 %CI 31.9 %-71.3 %) and 70.4 % (95 %CI 49.8-86.2).

CONCLUSION

 This pilot study demonstrated that deep learning in IPMN-EUS images can predict the histological outcome with high accuracy.

CT classification model of pancreatic serous cystic neoplasm and mucinous cystic neoplasm based on deep transfer learning

BACKGROUND

Pancreatic cancer is a highly lethal disease. The preoperative distinction between pancreatic serous cystic neoplasm (SCN) and mucinous cystic neoplasm (MCN) remains a clinical challenge.

OBJECTIVE

The goal of this study is to provide clinicians with supportive advice and avoid overtreatment by constructing a convolutional neural network (CNN) classifier to automatically identify pancreatic cancer using computed tomography (CT) images.

METHODS

We construct a CNN model using a dataset of 6,173 CT images obtained from 107 pathologically confirmed pancreatic cancer patients at Shanghai Changhai Hospital from January 2017 to February 2022. We divide CT slices into three categories namely, SCN, MCN, and no tumor, to train the DenseNet201-based CNN model with multi-head spatial attention mechanism (MSAM-DenseNet201). The attention module enhances the network's attention to local features and effectively improves the network performance. The trained model is applied to process all CT image slices and finally realize the two categories classification of MCN and SCN patients through a joint voting strategy.

RESULTS

Using a 10-fold cross validation method, this new MSAM-DenseNet201 model achieves a classification accuracy of 92.52%, a precision of 92.16%, a sensitivity of 92.16%, and a specificity of 92.86%, respectively.

CONCLUSIONS

This study demonstrates the feasibility of using a deep learning network or classification model to help diagnose MCN and SCN cases. This, the new method has great potential for developing new computer-aided diagnosis systems and applying in future clinical practice.

Deep Learning for Automatic Differentiation of Mucinous versus Non-Mucinous Pancreatic Cystic Lesions: A Pilot Study

Endoscopic ultrasound (EUS) morphology can aid in the discrimination between mucinous and non-mucinous pancreatic cystic lesions (PCLs) but has several limitations that can be overcome by artificial intelligence. We developed a convolutional neural network (CNN) algorithm for the automatic diagnosis of mucinous PCLs. Images retrieved from videos of EUS examinations for PCL characterization were used for the development, training, and validation of a CNN for mucinous cyst diagnosis. The performance of the CNN was measured calculating the area under the receiving operator characteristic curve (AUC), sensitivity, specificity, and positive and negative predictive values. A total of 5505 images from 28 pancreatic cysts were used (3725 from mucinous lesions and 1780 from non-mucinous cysts). The model had an overall accuracy of 98.5%, sensitivity of 98.3%, specificity of 98.9% and AUC of 1. The image processing speed of the CNN was 7.2 ms per frame. We developed a deep learning algorithm that differentiated mucinous and non-mucinous cysts with high accuracy. The present CNN may constitute an important tool to help risk stratify PCLs.

Application of Artificial Intelligence in the Management of Pancreatic Cystic Lesions

The rate of incidentally detected pancreatic cystic lesions (PCLs) has increased over the past decade and was recently reported at 8%. These lesions pose a unique challenge, as each subtype of PCL carries a different risk of malignant transformation, ranging from 0% (pancreatic pseudocyst) to 34–68% (main duct intraductal papillary mucinous neoplasm). It is imperative to correctly risk-stratify the malignant potential of these lesions in order to provide the correct care course for the patient, ranging from monitoring to surgical intervention. Even with the multiplicity of guidelines (i.e., the American Gastroenterology Association guidelines and Fukuoka/International Consensus guidelines) and multitude of diagnostic information, risk stratification of PCLs falls short. Studies have reported that 25–64% of patients undergoing PCL resection have pancreatic cysts with no malignant potential, and up to 78% of mucin-producing cysts resected harbor no malignant potential on pathological evaluation. Clinicians are now incorporating artificial intelligence technology to aid in the management of these difficult lesions. This review article focuses on advancements in artificial intelligence within digital pathomics, radiomics, and genomics as they apply to the diagnosis and risk stratification of PCLs.

Machine learning in endoscopic ultrasonography and the pancreas: The new frontier?

Pancreatic diseases have a substantial burden on society which is predicted to increase further over the next decades. Endoscopic ultrasonography (EUS) remains the best available diagnostic method to assess the pancreas, however, there remains room for improvement. Artificial intelligence (AI) approaches have been adopted to assess pancreatic diseases for over a decade, but this methodology has recently reached a new era with the innovative machine learning algorithms which can process, recognize, and label endosonographic images. Our review provides a targeted summary of AI in EUS for pancreatic diseases. Included studies cover a wide spectrum of pancreatic diseases from pancreatic cystic lesions to pancreatic masses and diagnosis of pancreatic cancer, chronic pancreatitis, and autoimmune pancreatitis. For these, AI models seemed highly successful, although the results should be evaluated carefully as the tasks, datasets and models were greatly heterogenous. In addition to use in diagnostics, AI was also tested as a procedural real-time assistant for EUS-guided biopsy as well as recognition of standard pancreatic stations and labeling anatomical landmarks during routine examination. Studies thus far have suggested that the adoption of AI in pancreatic EUS is highly promising and further opportunities should be explored in the field.

Using Quantitative Imaging for Personalized Medicine in Pancreatic Cancer: A Review of Radiomics and Deep Learning Applications

Simple Summary

With a five-year survival rate of only 3% for the majority of patients, pancreatic cancer is a global healthcare challenge. Radiomics and deep learning, two novel quantitative imaging methods that treat medical images as minable data instead of just pictures, have shown promise in advancing personalized management of pancreatic cancer through diagnosing precursor diseases, early detection, accurate diagnosis, and treatment personalization. Radiomics and deep learning methods aim to collect hidden information in medical images that is missed by conventional radiology practices through expanding the data search and comparing information across different patients. Both methods have been studied and applied in pancreatic cancer. In this review, we focus on the current progress of these two methods in pancreatic cancer and provide a comprehensive narrative review on the topic. With better regulation, enhanced workflow, and larger prospective patient datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through personalized precision medicine.

Abstract

As the most lethal major cancer, pancreatic cancer is a global healthcare challenge. Personalized medicine utilizing cutting-edge multi-omics data holds potential for major breakthroughs in tackling this critical problem. Radiomics and deep learning, two trendy quantitative imaging methods that take advantage of data science and modern medical imaging, have shown increasing promise in advancing the precision management of pancreatic cancer via diagnosing of precursor diseases, early detection, accurate diagnosis, and treatment personalization and optimization. Radiomics employs manually-crafted features, while deep learning applies computer-generated automatic features. These two methods aim to mine hidden information in medical images that is missed by conventional radiology and gain insights by systematically comparing the quantitative image information across different patients in order to characterize unique imaging phenotypes. Both methods have been studied and applied in various pancreatic cancer clinical applications. In this review, we begin with an introduction to the clinical problems and the technology. After providing technical overviews of the two methods, this review focuses on the current progress of clinical applications in precancerous lesion diagnosis, pancreatic cancer detection and diagnosis, prognosis prediction, treatment stratification, and radiogenomics. The limitations of current studies and methods are discussed, along with future directions. With better standardization and optimization of the workflow from image acquisition to analysis and with larger and especially prospective high-quality datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through big data-based high-precision personalization.

Automatic Pancreatic Cyst Lesion Segmentation on EUS Images Using a Deep-Learning Approach

The automatic segmentation of the pancreatic cyst lesion (PCL) is essential for the automated diagnosis of pancreatic cyst lesions on endoscopic ultrasonography (EUS) images. In this study, we proposed a deep-learning approach for PCL segmentation on EUS images. We employed the Attention U-Net model for automatic PCL segmentation. The Attention U-Net was compared with the Basic U-Net, Residual U-Net, and U-Net++ models. The Attention U-Net showed a better dice similarity coefficient (DSC) and intersection over union (IoU) scores than the other models on the internal test. Although the Basic U-Net showed a higher DSC and IoU scores on the external test than the Attention U-Net, there was no statistically significant difference. On the internal test of the cross-over study, the Attention U-Net showed the highest DSC and IoU scores. However, there was no significant difference between the Attention U-Net and Residual U-Net or between the Attention U-Net and U-Net++. On the external test of the cross-over study, all models showed no significant difference from each other. To the best of our knowledge, this is the first study implementing segmentation of PCL on EUS images using a deep-learning approach. Our experimental results show that a deep-learning approach can be applied successfully for PCL segmentation on EUS images.