Automatic Pancreatic Cyst Lesion Segmentation on EUS Images Using a Deep-Learning Approach

Application of artificial intelligence in pancreas endoscopic ultrasound imaging- A systematic review

The pancreas is a vital organ in digestive system which has significant health implications. It is imperative to evaluate and identify malignant pancreatic lesions promptly in light of the high mortality rate linked to such malignancies. Endoscopic Ultrasound (EUS) is a non-invasive precise technique to detect pancreas disorders, but it is highly operator dependent. Artificial intelligence (AI), including traditional machine learning (ML) and deep learning (DL) techniques can play a pivotal role to enhancing the performance of EUS regardless of operator. AI performs a critical function in the detection, classification, and segmentation of medical images. The utilization of AI-assisted systems has improved the accuracy and productivity of pancreatic analysis, including the detection of diverse pancreatic disorders (e.g., pancreatitis, masses, and cysts) as well as landmarks and parenchyma. This systematic review examines the rapidly developing domain of AI-assisted system in EUS of the pancreas. Its objective is to present a thorough study of the present research status and developments in this area. This paper explores the significant challenges of AI-assisted system in pancreas EUS imaging, highlights the potential of AI techniques in addressing these challenges, and suggests the scope for future research in domain of AI-assisted EUS systems.

MC3DU-Net: a multisequence cascaded pipeline for the detection and segmentation of pancreatic cysts in MRI

PURPOSE

Radiological detection and follow-up of pancreatic cysts in multisequence MRI studies are required to assess the likelihood of their malignancy and to determine their treatment. The evaluation requires expertise and has not been automated. This paper presents MC3DU-Net, a novel multisequence cascaded pipeline for the detection and segmentation of pancreatic cysts in MRI studies consisting of coronal MRCP and axial TSE MRI sequences.

METHODS

MC3DU-Net leverages the information in both sequences by computing a pancreas Region of Interest (ROI) segmentation in the TSE MRI scan, transferring it to MRCP scan, and then detecting and segmenting the cysts in the ROI of the MRCP scan. Both the voxel-level ROI of the pancreas and the segmentation of the cysts are performed with 3D U-Nets trained with Hard Negative Patch Mining, a new technique for class imbalance correction and for the reduction in false positives.

RESULTS

MC3DU-Net was evaluated on a dataset of 158 MRI patient studies with a training/validation/testing split of 118/17/23. Ground truth segmentations of a total of 840 cysts were manually obtained by expert clinicians. MC3DU-Net achieves a mean recall of 0.80 ± 0.19, a mean precision of 0.75 ± 0.26, a mean Dice score of 0.80 ± 0.19 and a mean ASSD of 0.60 ± 0.53 for pancreatic cysts of diameter > 5 mm, which is the clinically relevant endpoint.

CONCLUSION

MC3DU-Net is the first fully automatic method for detection and segmentation of pancreatic cysts in MRI. Automatic detection and segmentation of pancreatic cysts in MRI can be performed accurately and reliably. It may provide a method for precise disease evaluation and may serve as a second expert reader.

Applications and Prospects of Artificial Intelligence-Assisted Endoscopic Ultrasound in Digestive System Diseases

Endoscopic ultrasound (EUS) has emerged as a widely utilized tool in the diagnosis of digestive diseases. In recent years, the potential of artificial intelligence (AI) in healthcare has been gradually recognized, and its superiority in the field of EUS is becoming apparent. Machine learning (ML) and deep learning (DL) are the two main AI algorithms. This paper aims to outline the applications and prospects of artificial intelligence-assisted endoscopic ultrasound (EUS-AI) in digestive diseases over the past decade. The results demonstrated that EUS-AI has shown superiority or at least equivalence to traditional methods in the diagnosis, prognosis, and quality control of subepithelial lesions, early esophageal cancer, early gastric cancer, and pancreatic diseases including pancreatic cystic lesions, autoimmune pancreatitis, and pancreatic cancer. The implementation of EUS-AI has opened up new avenues for individualized precision medicine and has introduced novel diagnostic and treatment approaches for digestive diseases.

Diagnostic value of deep learning-assisted endoscopic ultrasound for pancreatic tumors: a systematic review and meta-analysis

Background and aims

Endoscopic ultrasonography (EUS) is commonly utilized in the diagnosis of pancreatic tumors, although as this modality relies primarily on the practitioner's visual judgment, it is prone to result in a missed diagnosis or misdiagnosis due to inexperience, fatigue, or distraction. Deep learning (DL) techniques, which can be used to automatically extract detailed imaging features from images, have been increasingly beneficial in the field of medical image-based assisted diagnosis. The present systematic review included a meta-analysis aimed at evaluating the accuracy of DL-assisted EUS for the diagnosis of pancreatic tumors diagnosis.

Methods

We performed a comprehensive search for all studies relevant to EUS and DL in the following four databases, from their inception through February 2023: PubMed, Embase, Web of Science, and the Cochrane Library. Target studies were strictly screened based on specific inclusion and exclusion criteria, after which we performed a meta-analysis using Stata 16.0 to assess the diagnostic ability of DL and compare it with that of EUS practitioners. Any sources of heterogeneity were explored using subgroup and meta-regression analyses.

Results

A total of 10 studies, involving 3,529 patients and 34,773 training images, were included in the present meta-analysis. The pooled sensitivity was 93% (95% confidence interval [CI], 87-96%), the pooled specificity was 95% (95% CI, 89-98%), and the area under the summary receiver operating characteristic curve (AUC) was 0.98 (95% CI, 0.96-0.99).

Conclusion

DL-assisted EUS has a high accuracy and clinical applicability for diagnosing pancreatic tumors.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023391853, identifier CRD42023391853.

Deep learning for pancreatic diseases based on endoscopic ultrasound: A systematic review

BACKGROUND AND AIMS

Endoscopic ultrasonography (EUS) is one of the main examinations in pancreatic diseases. A series of the studies reported the application of deep learning (DL)-assisted EUS in the diagnosis of pancreatic diseases. This systematic review is to evaluate the role of DL algorithms in assisting EUS diagnosis of pancreatic diseases.

METHODS

Literature search were conducted in PubMed and Semantic Scholar databases. Studies that developed DL models for pancreatic diseases based on EUS were eligible for inclusion. This review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and quality assessment of the included studies was performed according to the IJMEDI checklist.

RESULTS

A total of 23 studies were enrolled into this systematic review, which could be categorized into three groups according to computer vision tasks: classification, detection and segmentation. Seventeen studies focused on the classification task, among which five studies developed simple neural network (NN) models while twelve studies constructed convolutional NN (CNN) models. Three studies were concerned the detection task and five studies were the segmentation task, all based on CNN architectures. All models presented in the studies performed well based on EUS images, videos or voice. According to the IJMEDI checklist, six studies were recognized as high-grade quality, with scores beyond 35 points.

CONCLUSIONS

DL algorithms show great potential in EUS images/videos/voice for pancreatic diseases. However, there is room for improvement such as sample sizes, multi-center cooperation, data preprocessing, model interpretability, and code sharing.

Contrast Enhanced EUS for Predicting Solid Pancreatic Neuroendocrine Tumor Grade and Aggressiveness

Pancreatic neuroendocrine tumor (PNET) behavior assessment is a daily challenge for physicians. Modern PNET management varies from a watch-and-wait strategy to surgery depending on tumor aggressiveness. Therefore, the aggressiveness definition plays a pivotal role in the PNET work-up. The aggressiveness of PNETs is mainly based on the dimensions and histological grading, with sometimes a lack of specificity and sensibility. In the last twenty years, EUS has become a cornerstone in the diagnostic phase of PNET management for its high diagnostic yield and the possibility of obtaining a histological specimen. The number of EUS applications in the PNET work-up has been rapidly increasing with new and powerful possibilities. The application of contrast has led to an important step in PNET detection; in recent years, it has been gaining interesting applications in aggressiveness assessment. In this review, we underline the latest experiences and opportunities in the behavior assessment of PNETs using contact-enhanced EUS and contested enhanced harmonic EUS with a particular focus on the future application and possibility that these techniques could provide.

Automated Recognition of Cancer Tissues through Deep Learning Framework from the Photoacoustic Specimen

The fast advancement of biomedical research technology has expanded and enhanced the spectrum of diagnostic instruments. Various research groups have found optical imaging, ultrasonic imaging, and magnetic resonance imaging to create multifunctional devices that are critical for biomedical activities. Multispectral photoacoustic imaging that integrates the ideas of optical and ultrasonic technologies is one of the most essential instruments. At the same time, early cancer identification is becoming increasingly important in order to minimize fatality. Deep learning (DL) techniques have recently advanced to the point where they can be used to diagnose and classify cancer using biological images. This paper describes a hybrid optimization method that combines in-depth transfer learning-based cancer detection with multispectral photoacoustic imaging. The goal of the PS-ACO-RNN approach is to use ultrasound images to detect and classify the presence of cancer. Bilateral filtration (BF) is often used as a noise removal approach in image processing. In addition, lightweight LEDNet models are used to separate the biological images. A feature extractor with particle swarm with ant colony optimization (PS-ACO) paradigm can also be used. Finally, biological images assign appropriate class labels using a recurrent neural network (RNN) model. The effectiveness of the PS-ACO-RNN technique is verified using a benchmark database, and test results show that the PS-ACO-RNN approach works better than current approaches.

Application of Artificial Intelligence in the Management of Pancreatic Cystic Lesions

The rate of incidentally detected pancreatic cystic lesions (PCLs) has increased over the past decade and was recently reported at 8%. These lesions pose a unique challenge, as each subtype of PCL carries a different risk of malignant transformation, ranging from 0% (pancreatic pseudocyst) to 34–68% (main duct intraductal papillary mucinous neoplasm). It is imperative to correctly risk-stratify the malignant potential of these lesions in order to provide the correct care course for the patient, ranging from monitoring to surgical intervention. Even with the multiplicity of guidelines (i.e., the American Gastroenterology Association guidelines and Fukuoka/International Consensus guidelines) and multitude of diagnostic information, risk stratification of PCLs falls short. Studies have reported that 25–64% of patients undergoing PCL resection have pancreatic cysts with no malignant potential, and up to 78% of mucin-producing cysts resected harbor no malignant potential on pathological evaluation. Clinicians are now incorporating artificial intelligence technology to aid in the management of these difficult lesions. This review article focuses on advancements in artificial intelligence within digital pathomics, radiomics, and genomics as they apply to the diagnosis and risk stratification of PCLs.