Deep Convolutional Neural Network-Assisted Feature Extraction for Diagnostic Discrimination and Feature Visualization in Pancreatic Ductal Adenocarcinoma (PDAC) versus Autoimmune Pancreatitis (AIP)

BEYOND TRADITIONAL TOOLS: EXPLORING CONVOLUTIONAL NEURAL NETWORKS AS INNOVATIVE PROGNOSTIC MODELS IN PANCREATIC DUCTAL ADENOCARCINOMA

BACKGROUND

Pancreatic ductal adenocarcinoma (PDAC) is a highly aggressive and lethal form of cancer with limited prognostic accuracy using traditional factors. This has led to the exploration of innovative prognostic models, including convolutional neural networks (CNNs), in PDAC. CNNs, a type of artificial intelligence algorithm, have shown promise in various medical applications, including image analysis and pattern recognition. Their ability to extract complex features from medical images makes them suitable for improving prognostication in PDAC. However, implementing CNNs in clinical practice poses challenges, such as data availability and interpretability. Future research should focus on multi-center studies, integrating multiple data modalities, and combining CNN outputs with biomarker panels. Collaborative efforts and patient autonomy should be considered to ensure the ethical implementation of CNN-based prognostic models. Further validation and optimisation of CNN-based models are necessary to enhance their reliability and clinical utility in PDAC prognostication.

BACKGROUND

•Pancreatic ductal adenocarcinoma (PDAC) is an aggressive cancer with limited prognostic accuracy through traditional methods.

BACKGROUND

•Convolutional neural networks (CNNs) are being explored for prognostic models in PDAC.

BACKGROUND

•They can extract complex features from images, aiding PDAC prognostication.

BACKGROUND

•Further validation and optimization of CNN-based models are needed for better reliability and clinical utility in PDAC.

CT and MRI of abdominal cancers: current trends and perspectives in the era of radiomics and artificial intelligence

Abdominal cancers continue to pose daily challenges to clinicians, radiologists and researchers. These challenges are faced at each stage of abdominal cancer management, including early detection, accurate characterization, precise assessment of tumor spread, preoperative planning when surgery is anticipated, prediction of tumor aggressiveness, response to therapy, and detection of recurrence. Technical advances in medical imaging, often in combination with imaging biomarkers, show great promise in addressing such challenges. Information extracted from imaging datasets owing to the application of radiomics can be used to further improve the diagnostic capabilities of imaging. However, the analysis of the huge amount of data provided by these advances is a difficult task in daily practice. Artificial intelligence has the potential to help radiologists in all these challenges. Notably, the applications of AI in the field of abdominal cancers are expanding and now include diverse approaches for cancer detection, diagnosis and classification, genomics and detection of genetic alterations, analysis of tumor microenvironment, identification of predictive biomarkers and follow-up. However, AI currently has some limitations that need further refinement for implementation in the clinical setting. This review article sums up recent advances in imaging of abdominal cancers in the field of image/data acquisition, tumor detection, tumor characterization, prognosis, and treatment response evaluation.

Deep Learning Applications in Pancreatic Cancer

Pancreatic cancer is one of the most lethal gastrointestinal malignancies. Despite advances in cross-sectional imaging, chemotherapy, radiation therapy, and surgical techniques, the 5-year overall survival is only 12%. With the advent and rapid adoption of AI across all industries, we present a review of applications of DL in the care of patients diagnosed with PC. A review of different DL techniques with applications across diagnosis, management, and monitoring is presented across the different pathological subtypes of pancreatic cancer. This systematic review highlights AI as an emerging technology in the care of patients with pancreatic cancer.

Role of artificial intelligence in the characterization of indeterminate pancreatic head mass and its usefulness in preoperative diagnosis

Artificial intelligence (AI) has been used in various fields of day-to-day life and its role in medicine is immense. Understanding of oncology has been improved with the introduction of AI which helps in diagnosis, treatment planning, management, prognosis, and follow-up. It also helps to identify high-risk groups who can be subjected to timely screening for early detection of malignant conditions. It is more important in pancreatic cancer as it is one of the major causes of cancer-related deaths worldwide and there are no specific early features (clinical and radiological) for diagnosis. With improvement in imaging modalities (computed tomography, magnetic resonance imaging, endoscopic ultrasound), most often clinicians were being challenged with lesions that were difficult to diagnose with human competence. AI has been used in various other branches of medicine to differentiate such indeterminate lesions including the thyroid gland, breast, lungs, liver, adrenal gland, kidney, etc. In the case of pancreatic cancer, the role of AI has been explored and is still ongoing. This review article will focus on how AI can be used to diagnose pancreatic cancer early or differentiate it from benign pancreatic lesions, therefore, management can be planned at an earlier stage.

Enhancing pancreatic cancer classification through dynamic weighted ensemble: a game theory approach

The significant research carried out on medical healthcare networks is giving computing innovations lots of space to produce the most recent innovations. Pancreatic cancer, which ranks among of the most common tumors that are thought to be fatal and unsuspected since it is positioned in the region of the abdomen beyond the stomach and can't be adequately treated once diagnosed. In radiological imaging, such as MRI and CT, computer-aided diagnosis (CAD), quantitative evaluations, and automated pancreatic cancer classification approaches are routinely provided. This study provides a dynamic weighted ensemble framework for pancreatic cancer classification inspired by game theory. Grey Level Co-occurrence Matrix (GLCM) is utilized for feature extraction, together with Gaussian kernel-based fuzzy rough sets theory (GKFRST) for feature reduction and the Random Forest (RF) classifier for categorization. The ResNet50 and VGG16 are used in the transfer learning (TL) paradigm. The combination of the outcomes from the TL paradigm and the RF classifier paradigm is suggested using an innovative ensemble classifier that relies on the game theory method. When compared with the current models, the ensemble technique considerably increases the pancreatic cancer classification accuracy and yields exceptional performance. The study improves the categorization of pancreatic cancer by using game theory, a mathematical paradigm that simulates strategic interactions. Because game theory has been not frequently used in the discipline of cancer categorization, this research is distinctive in its methodology.

Deep Features from Pretrained Networks Do Not Outperform Hand-Crafted Features in Radiomics

In radiomics, utilizing features extracted from pretrained deep networks could result in models with a higher predictive performance than those relying on hand-crafted features. This study compared the predictive performance of models trained with either deep features, hand-crafted features, or a combination of these features in terms of the area under the receiver-operating characteristic curve (AUC) and other metrics. We trained models on ten radiological datasets using five feature selection methods and three classifiers. Our results indicate that models based on deep features did not show an improved AUC compared to those utilizing hand-crafted features (deep: AUC 0.775, hand-crafted: AUC 0.789; p = 0.28). Including morphological features alongside deep features led to overall improvements in prediction performance for all models (+0.02 gain in AUC; p < 0.001); however, the best model did not benefit from this (+0.003 gain in AUC; p = 0.57). Using all hand-crafted features in addition to the deep features resulted in a further overall improvement (+0.034 in AUC; p < 0.001), but only a minor improvement could be observed for the best model (deep: AUC 0.798, hand-crafted: AUC 0.789; p = 0.92). Furthermore, our results show that models based on deep features extracted from networks pretrained on medical data have no advantage in predictive performance over models relying on features extracted from networks pretrained on ImageNet data. Our study contributes a benchmarking analysis of models trained on hand-crafted and deep features from pretrained networks across multiple datasets. It also provides a comprehensive understanding of their applicability and limitations in radiomics. Our study shows, in conclusion, that models based on features extracted from pretrained deep networks do not outperform models trained on hand-crafted ones.

Computer-Aided Detection for Pancreatic Cancer Diagnosis: Radiological Challenges and Future Directions

Radiological imaging plays a crucial role in the detection and treatment of pancreatic ductal adenocarcinoma (PDAC). However, there are several challenges associated with the use of these techniques in daily clinical practice. Determination of the presence or absence of cancer using radiological imaging is difficult and requires specific expertise, especially after neoadjuvant therapy. Early detection and characterization of tumors would potentially increase the number of patients who are eligible for curative treatment. Over the last decades, artificial intelligence (AI)-based computer-aided detection (CAD) has rapidly evolved as a means for improving the radiological detection of cancer and the assessment of the extent of disease. Although the results of AI applications seem promising, widespread adoption in clinical practice has not taken place. This narrative review provides an overview of current radiological CAD systems in pancreatic cancer, highlights challenges that are pertinent to clinical practice, and discusses potential solutions for these challenges.

Pacpaint: a histology-based deep learning model uncovers the extensive intratumor molecular heterogeneity of pancreatic adenocarcinoma

Two tumor (Classical/Basal) and stroma (Inactive/active) subtypes of Pancreatic adenocarcinoma (PDAC) with prognostic and theragnostic implications have been described. These molecular subtypes were defined by RNAseq, a costly technique sensitive to sample quality and cellularity, not used in routine practice. To allow rapid PDAC molecular subtyping and study PDAC heterogeneity, we develop PACpAInt, a multi-step deep learning model. PACpAInt is trained on a multicentric cohort (n = 202) and validated on 4 independent cohorts including biopsies (surgical cohorts n = 148; 97; 126 / biopsy cohort n = 25), all with transcriptomic data (n = 598) to predict tumor tissue, tumor cells from stroma, and their transcriptomic molecular subtypes, either at the whole slide or tile level (112 µm squares). PACpAInt correctly predicts tumor subtypes at the whole slide level on surgical and biopsies specimens and independently predicts survival. PACpAInt highlights the presence of a minor aggressive Basal contingent that negatively impacts survival in 39% of RNA-defined classical cases. Tile-level analysis ( > 6 millions) redefines PDAC microheterogeneity showing codependencies in the distribution of tumor and stroma subtypes, and demonstrates that, in addition to the Classical and Basal tumors, there are Hybrid tumors that combine the latter subtypes, and Intermediate tumors that may represent a transition state during PDAC evolution.

Transfer-Learning Deep Radiomics and Hand-Crafted Radiomics for Classifying Lymph Nodes from Contrast-Enhanced Computed Tomography in Lung Cancer

OBJECTIVES

Positron emission tomography (PET) is currently considered the non-invasive reference standard for lymph node (N-)staging in lung cancer. However, not all patients can undergo this diagnostic procedure due to high costs, limited availability, and additional radiation exposure. The purpose of this study was to predict the PET result from traditional contrast-enhanced computed tomography (CT) and to test different feature extraction strategies.

METHODS

In this study, 100 lung cancer patients underwent a contrast-enhanced 18F-fluorodeoxyglucose (FDG) PET/CT scan between August 2012 and December 2019. We trained machine learning models to predict FDG uptake in the subsequent PET scan. Model inputs were composed of (i) traditional "hand-crafted" radiomics features from the segmented lymph nodes, (ii) deep features derived from a pretrained EfficientNet-CNN, and (iii) a hybrid approach combining (i) and (ii).

RESULTS

In total, 2734 lymph nodes [555 (20.3%) PET-positive] from 100 patients [49% female; mean age 65, SD: 14] with lung cancer (60% adenocarcinoma, 21% plate epithelial carcinoma, 8% small-cell lung cancer) were included in this study. The area under the receiver operating characteristic curve (AUC) ranged from 0.79 to 0.87, and the scaled Brier score (SBS) ranged from 16 to 36%. The random forest model (iii) yielded the best results [AUC 0.871 (0.865-0.878), SBS 35.8 (34.2-37.2)] and had significantly higher model performance than both approaches alone (AUC: p < 0.001, z = 8.8 and z = 22.4; SBS: p < 0.001, z = 11.4 and z = 26.6, against (i) and (ii), respectively).

CONCLUSION

Both traditional radiomics features and transfer-learning deep radiomics features provide relevant and complementary information for non-invasive N-staging in lung cancer.

A CT based radiomics nomogram for differentiation between focal-type autoimmune pancreatitis and pancreatic ductal adenocarcinoma

Objectives

The purpose of this study was to develop and validate an CT-based radiomics nomogram for the preoperative differentiation of focal-type autoimmune pancreatitis from pancreatic ductal adenocarcinoma.

Methods

96 patients with focal-type autoimmune pancreatitis and pancreatic ductal adenocarcinoma have been enrolled in the study (32 and 64 cases respectively). All cases have been confirmed by imaging, clinical follow-up and/or pathology. The imaging data were considered as: 70% training cohort and 30% test cohort. Pancreatic lesions have been manually delineated by two radiologists and image segmentation was performed to extract radiomic features from the CT images. Independent-sample T tests and LASSO regression were used for feature selection. The training cohort was classified using a variety of machine learning-based classifiers, and 5-fold cross-validation has been performed. The classification performance was evaluated using the test cohort. Multivariate logistic regression analysis was then used to develop a radiomics nomogram model, containing the CT findings and Rad-Score. Calibration curves have been plotted showing the agreement between the predicted and actual probabilities of the radiomics nomogram model. Different patients have been selected to test and evaluate the model prediction process. Finally, receiver operating characteristic curves and decision curves were plotted, and the radiomics nomogram model was compared with a single model to visually assess its diagnostic ability.

Results

A total of 158 radiomics features were extracted from each image. 7 features were selected to construct the radiomics model, then a variety of classifiers were used for classification and multinomial logistic regression (MLR) was selected to be the optimal classifier. Combining CT findings with radiomics model, a prediction model based on CT findings and radiomics was finally obtained. The nomogram model showed a good sensitivity and specificity with AUCs of 0.87 and 0.83 in training and test cohorts, respectively. The areas under the curve and decision curve analysis showed that the radiomics nomogram model may provide better diagnostic performance than the single model and achieve greater clinical net benefits than the CT finding model and radiomics signature model individually.

Conclusions

The CT image-based radiomics nomogram model can accurately distinguish between focal-type autoimmune pancreatitis and pancreatic ductal adenocarcinoma patients and provide additional clinical benefits.

Recent advances in the management of autoimmune pancreatitis in the era of artificial intelligence

Autoimmune pancreatitis (AIP) is a type of immune-mediated pancreatitis subdivided into two subtypes, type 1 and type 2 AIP. Furthermore, type 1 AIP is considered to be the pancreatic manifestation of the immunoglobulin G4 (IgG4)-related disease. Nowadays, AIP is increasingly researched and recognized, although its diagnosis represents a challenge for several reasons: False positive ultrasound-guided cytological samples for a neoplastic process, difficult to interpret levels of IgG4, the absence of biological markers to diagnose type 2 AIP, and the challenging clinical identification of atypical forms. Furthermore, 60% and 78% of type 1 and type 2 AIP, respectively, are retrospectively diagnosed on surgical specimens of resected pancreas for suspected cancer. As distinguishing AIP from pancreatic ductal adenocarcinoma can be challenging, obtaining a definitive diagnosis can therefore prove difficult, since endoscopic ultrasound fine-needle aspiration or biopsy of the pancreas are suboptimal. This paper focuses on recent innovations in the management of AIP with regard to the use of artificial intelligence, new serum markers, and new therapeutic approaches, while it also outlines the current management recommendations. A better knowledge of AIP can reduce the recourse to surgery and avoid its overuse, although such an approach requires close collaboration between gastroenterologists, surgeons and radiologists. Better knowledge on AIP and IgG4-related disease remains necessary to diagnose and manage patients.

Deep learning based radiomics for gastrointestinal cancer diagnosis and treatment: A minireview

Gastrointestinal (GI) cancers are the major cause of cancer-related mortality globally. Medical imaging is an important auxiliary means for the diagnosis, assessment and prognostic prediction of GI cancers. Radiomics is an emerging and effective technology to decipher the encoded information within medical images, and traditional machine learning is the most commonly used tool. Recent advances in deep learning technology have further promoted the development of radiomics. In the field of GI cancer, although there are several surveys on radiomics, there is no specific review on the application of deep-learning-based radiomics (DLR). In this review, a search was conducted on Web of Science, PubMed, and Google Scholar with an emphasis on the application of DLR for GI cancers, including esophageal, gastric, liver, pancreatic, and colorectal cancers. Besides, the challenges and recommendations based on the findings of the review are comprehensively analyzed to advance DLR.

A multidomain fusion model of radiomics and deep learning to discriminate between PDAC and AIP based on 18F-FDG PET/CT images

PURPOSE

To explore a multidomain fusion model of radiomics and deep learning features based on ¹⁸F-fluorodeoxyglucose positron emission tomography/computed tomography (¹⁸F-FDG PET/CT) images to distinguish pancreatic ductal adenocarcinoma (PDAC) and autoimmune pancreatitis (AIP), which could effectively improve the accuracy of diseases diagnosis.

MATERIALS AND METHODS

This retrospective study included 48 patients with AIP (mean age, 65 ± 12.0 years; range, 37-90 years) and 64 patients with PDAC patients (mean age, 66 ± 11.3 years; range, 32-88 years). Three different methods were discussed to identify PDAC and AIP based on ¹⁸F-FDG PET/CT images, including the radiomics model (RAD_model), the deep learning model (DL_model), and the multidomain fusion model (MF_model). We also compared the classification results of PET/CT, PET, and CT images in these three models. In addition, we explored the attributes of deep learning abstract features by analyzing the correlation between radiomics and deep learning features. Five-fold cross-validation was used to calculate receiver operating characteristic (ROC), area under the roc curve (AUC), accuracy (Acc), sensitivity (Sen), and specificity (Spe) to quantitatively evaluate the performance of different classification models.

RESULTS

The experimental results showed that the multidomain fusion model had the best comprehensive performance compared with radiomics and deep learning models, and the AUC, accuracy, sensitivity, specificity were 96.4% (95% CI 95.4-97.3%), 90.1% (95% CI 88.7-91.5%), 87.5% (95% CI 84.3-90.6%), and 93.0% (95% CI 90.3-95.6%), respectively. And our study proved that the multimodal features of PET/CT were superior to using either PET or CT features alone. First-order features of radiomics provided valuable complementary information for the deep learning model.

CONCLUSION

The preliminary results of this paper demonstrated that our proposed multidomain fusion model fully exploits the value of radiomics and deep learning features based on ¹⁸F-FDG PET/CT images, which provided competitive accuracy for the discrimination of PDAC and AIP.

The effect of CT texture-based analysis using machine learning approaches on radiologists' performance in differentiating focal-type autoimmune pancreatitis and pancreatic duct carcinoma

PURPOSE

To develop a support vector machine (SVM) classifier using CT texture-based analysis in differentiating focal-type autoimmune pancreatitis (AIP) and pancreatic duct carcinoma (PD), and to assess the radiologists' diagnostic performance with or without SVM.

MATERIALS AND METHODS

This retrospective study included 50 patients (20 patients with focal-type AIP and 30 patients with PD) who underwent dynamic contrast-enhanced CT. Sixty-two CT texture-based features were extracted from 2D images of the arterial and portal phase CTs. We conducted data compression and feature selections using principal component analysis (PCA) and produced the SVM classifier. Four readers participated in this observer performance study and the statistical significance of differences with and without the SVM was assessed by receiver operating characteristic (ROC) analysis.

RESULTS

The SVM performance indicated a high performance in differentiating focal-type AIP and PD (AUC = 0.920). The AUC for all 4 readers increased significantly from 0.827 to 0.911 when using the SVM outputs (p = 0.010). The AUC for inexperienced readers increased significantly from 0.781 to 0.905 when using the SVM outputs (p = 0.310). The AUC for experienced readers increased from 0.875 to 0.912 when using the SVM outputs, however, there was no significant difference (p = 0.018).

CONCLUSION

The use of SVM classifier using CT texture-based features improved the diagnostic performance for differentiating focal-type AIP and PD on CT.

Artificial intelligence in pancreatic cancer

Pancreatic cancer is the deadliest disease, with a five-year overall survival rate of just 11%. The pancreatic cancer patients diagnosed with early screening have a median overall survival of nearly ten years, compared with 1.5 years for those not diagnosed with early screening. Therefore, early diagnosis and early treatment of pancreatic cancer are particularly critical. However, as a rare disease, the general screening cost of pancreatic cancer is high, the accuracy of existing tumor markers is not enough, and the efficacy of treatment methods is not exact. In terms of early diagnosis, artificial intelligence technology can quickly locate high-risk groups through medical images, pathological examination, biomarkers, and other aspects, then screening pancreatic cancer lesions early. At the same time, the artificial intelligence algorithm can also be used to predict the survival time, recurrence risk, metastasis, and therapy response which could affect the prognosis. In addition, artificial intelligence is widely used in pancreatic cancer health records, estimating medical imaging parameters, developing computer-aided diagnosis systems, etc. Advances in AI applications for pancreatic cancer will require a concerted effort among clinicians, basic scientists, statisticians, and engineers. Although it has some limitations, it will play an essential role in overcoming pancreatic cancer in the foreseeable future due to its mighty computing power.

One 3D VOI-based deep learning radiomics strategy, clinical model and radiologists for predicting lymph node metastases in pancreatic ductal adenocarcinoma based on multiphasic contrast-enhanced computer tomography

Purpose

We designed to construct one 3D VOI-based deep learning radiomics strategy for identifying lymph node metastases (LNM) in pancreatic ductal adenocarcinoma on the basis of multiphasic contrast-enhanced computer tomography and to assist clinical decision-making.

Methods

This retrospective research enrolled 139 PDAC patients undergoing pre-operative arterial phase and venous phase scanning examination between 2015 and 2021. A primary group (training group and validation group) and an independent test group were divided. The DLR strategy included three sections. (1) Residual network three dimensional-18 (Resnet 3D-18) architecture was constructed for deep learning feature extraction. (2) Least absolute shrinkage and selection operator model was used for feature selection. (3) Fully connected network served as the classifier. The DLR strategy was applied for constructing different 3D CNN models using 5-fold cross-validation. Radiomics scores (Rad score) were calculated for distinguishing the statistical difference between negative and positive lymph nodes. A clinical model was constructed by combining significantly different clinical variables using univariate and multivariable logistic regression. The manifestation of two radiologists was detected for comparing with computer-developed models. Receiver operating characteristic curves, the area under the curve, accuracy, precision, recall, and F1 score were used for evaluating model performance.

Results

A total of 45, 49, and 59 deep learning features were selected via LASSO model. No matter in which 3D CNN model, Rad score demonstrated the deep learning features were significantly different between non-LNM and LNM groups. The AP+VP DLR model yielded the best performance in predicting status of lymph node in PDAC with an AUC of 0.995 (95% CI:0.989-1.000) in training group; an AUC of 0.940 (95% CI:0.910-0.971) in validation group; and an AUC of 0.949 (95% CI:0.914-0.984) in test group. The clinical model enrolled the histological grade, CA19-9 level and CT-reported tumor size. The AP+VP DLR model outperformed AP DLR model, VP DLR model, clinical model, and two radiologists.

Conclusions

The AP+VP DLR model based on Resnet 3D-18 demonstrated excellent ability for identifying LNM in PDAC, which could act as a non-invasive and accurate guide for clinical therapeutic strategies. This 3D CNN model combined with 3D tumor segmentation technology is labor-saving, promising, and effective.

Imaging of Pancreatic Ductal Adenocarcinoma: An Update on Recent Advances

Pancreatic ductal carcinoma (PDAC) is one of the leading causes of cancer-related death worldwide. Computed tomography (CT) remains the primary imaging modality for diagnosis of PDAC. However, CT has limitations for early pancreatic tumor detection and tumor characterization so that it is currently challenged by magnetic resonance imaging. More recently, a particular attention has been given to radiomics for the characterization of pancreatic lesions using extraction and analysis of quantitative imaging features. In addition, radiomics has currently many applications that are developed in conjunction with artificial intelligence (AI) with the aim of better characterizing pancreatic lesions and providing a more precise assessment of tumor burden. This review article sums up recent advances in imaging of PDAC in the field of image/data acquisition, tumor detection, tumor characterization, treatment response evaluation, and preoperative planning. In addition, current applications of radiomics and AI in the field of PDAC are discussed.

A systematic review of radiomics in pancreatitis: applying the evidence level rating tool for promoting clinical transferability

Background

Multiple tools have been applied to radiomics evaluation, while evidence rating tools for this field are still lacking. This study aims to assess the quality of pancreatitis radiomics research and test the feasibility of the evidence level rating tool.

Results

Thirty studies were included after a systematic search of pancreatitis radiomics studies until February 28, 2022, via five databases. Twenty-four studies employed radiomics for diagnostic purposes. The mean ± standard deviation of the adherence rate was 38.3 ± 13.3%, 61.3 ± 11.9%, and 37.1 ± 27.2% for the Radiomics Quality Score (RQS), the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist, and the Image Biomarker Standardization Initiative (IBSI) guideline for preprocessing steps, respectively. The median (range) of RQS was 7.0 (− 3.0 to 18.0). The risk of bias and application concerns were mainly related to the index test according to the modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. The meta-analysis on differential diagnosis of autoimmune pancreatitis versus pancreatic cancer by CT and mass-forming pancreatitis versus pancreatic cancer by MRI showed diagnostic odds ratios (95% confidence intervals) of, respectively, 189.63 (79.65–451.48) and 135.70 (36.17–509.13), both rated as weak evidence mainly due to the insufficient sample size.

Conclusions

More research on prognosis of acute pancreatitis is encouraged. The current pancreatitis radiomics studies have insufficient quality and share common scientific disadvantages. The evidence level rating is feasible and necessary for bringing the field of radiomics from preclinical research area to clinical stage.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13244-022-01279-4.

Artificial intelligence for the detection of pancreatic lesions

PURPOSE

Pancreatic cancer is one of the most lethal neoplasms among common cancers worldwide, and PCLs are well-known precursors of this type of cancer. Artificial intelligence (AI) could help to improve and speed up the detection and classification of pancreatic lesions. The aim of this review is to summarize the articles addressing the diagnostic yield of artificial intelligence applied to medical imaging (computed tomography [CT] and/or magnetic resonance [MR]) for the detection of pancreatic cancer and pancreatic cystic lesions.

METHODS

We performed a comprehensive literature search using PubMed, EMBASE, and Scopus (from January 2010 to April 2021) to identify full articles evaluating the diagnostic accuracy of AI-based methods processing CT or MR images to detect pancreatic ductal adenocarcinoma (PDAC) or pancreatic cystic lesions (PCLs).

RESULTS

We found 20 studies meeting our inclusion criteria. Most of the AI-based systems used were convolutional neural networks. Ten studies addressed the use of AI to detect PDAC, eight studies aimed to detect and classify PCLs, and 4 aimed to predict the presence of high-grade dysplasia or cancer.

CONCLUSION

AI techniques have shown to be a promising tool which is expected to be helpful for most radiologists' tasks. However, methodologic concerns must be addressed, and prospective clinical studies should be carried out before implementation in clinical practice.

Radiomics in pancreatic cancer for oncologist: Present and future

Radiomics is changing the world of medicine and more specifically the world of oncology. Early diagnosis and treatment improve the prognosis of patients with cancer. After treatment, the evaluation of the response will determine future treatments. In oncology, every change in treatment means a loss of therapeutic options and this is key in pancreatic cancer. Radiomics has been developed in oncology in the early diagnosis and differential diagnosis of benign and malignant lesions, in the evaluation of response, in the prediction of possible side effects, marking the risk of recurrence, survival and prognosis of the disease. Some studies have validated its use to differentiate normal tissues from tumor tissues with high sensitivity and specificity, and to differentiate cystic lesions and pancreatic neuroendocrine tumor grades with texture parameters. In addition, these parameters have been related to survival in patients with pancreatic cancer and to response to radiotherapy and chemotherapy. This review aimed to establish the current status of the use of radiomics in pancreatic cancer and future perspectives.

Setting the Research Agenda for Clinical Artificial Intelligence in Pancreatic Adenocarcinoma Imaging

Simple Summary

Pancreatic ductal adenocarcinoma (PDAC) is one of the deadliest cancers worldwide, associated with a 98% loss of life expectancy and a 30% increase in disability-adjusted life years. Image-based artificial intelligence (AI) can help improve outcomes for PDAC given that current clinical guidelines are non-uniform and lack evidence-based consensus. However, research on image-based AI for PDAC is too scattered and lacking in sufficient quality to be incorporated into clinical workflows. In this review, an international, multi-disciplinary team of the world’s leading experts in pancreatic cancer breaks down the patient pathway and pinpoints the current clinical touchpoints in each stage. The available PDAC imaging AI literature addressing each pathway stage is then rigorously analyzed, and current performance and pitfalls are identified in a comprehensive overview. Finally, the future research agenda for clinically relevant, image-driven AI in PDAC is proposed.

Abstract

Pancreatic ductal adenocarcinoma (PDAC), estimated to become the second leading cause of cancer deaths in western societies by 2030, was flagged as a neglected cancer by the European Commission and the United States Congress. Due to lack of investment in research and development, combined with a complex and aggressive tumour biology, PDAC overall survival has not significantly improved the past decades. Cross-sectional imaging and histopathology play a crucial role throughout the patient pathway. However, current clinical guidelines for diagnostic workup, patient stratification, treatment response assessment, and follow-up are non-uniform and lack evidence-based consensus. Artificial Intelligence (AI) can leverage multimodal data to improve patient outcomes, but PDAC AI research is too scattered and lacking in quality to be incorporated into clinical workflows. This review describes the patient pathway and derives touchpoints for image-based AI research in collaboration with a multi-disciplinary, multi-institutional expert panel. The literature exploring AI to address these touchpoints is thoroughly retrieved and analysed to identify the existing trends and knowledge gaps. The results show absence of multi-institutional, well-curated datasets, an essential building block for robust AI applications. Furthermore, most research is unimodal, does not use state-of-the-art AI techniques, and lacks reliable ground truth. Based on this, the future research agenda for clinically relevant, image-driven AI in PDAC is proposed.

Radiomics and Its Applications and Progress in Pancreatitis: A Current State of the Art Review

Radiomics involves high-throughput extraction and analysis of quantitative information from medical images. Since it was proposed in 2012, there are some publications on the application of radiomics for (1) predicting recurrent acute pancreatitis (RAP), clinical severity of acute pancreatitis (AP), and extrapancreatic necrosis in AP; (2) differentiating mass-forming chronic pancreatitis (MFCP) from pancreatic ductal adenocarcinoma (PDAC), focal autoimmune pancreatitis (AIP) from PDAC, and functional abdominal pain (functional gastrointestinal diseases) from RAP and chronic pancreatitis (CP); and (3) identifying CP and normal pancreas, and CP risk factors and complications. In this review, we aim to systematically summarize the applications and progress of radiomics in pancreatitis and it associated situations, so as to provide reference for related research.

A deep learning algorithm to improve readers' interpretation and speed of pancreatic cystic lesions on dual-phase enhanced CT

PURPOSE

To develop a deep learning model (DLM) to improve readers' interpretation and speed in the differentiation of pancreatic cystic lesions (PCLs) on dual-phase enhanced CT, and a low contrast media dose, external testing set validated the model.

MATERIALS AND METHODS

Dual-phase enhanced CT images of 363 patients with 368 PCLs obtained from two centers were retrospectively assessed. Based on the examination date, a training and validation set of 266 PCLs, an internal testing set of 52 PCLs were designated from center 1. An external testing set included 50 PCLs from center 2. Clinical and radiological characteristics were compared. The DLM was developed using 3D specially designed densely connected convolutional networks for PCL differentiation. Radiomic features were extracted to build a traditional radiomics model (RM). Performance of the DLM, traditional RM, and three readers was compared.

RESULTS

The accuracy for differential diagnosis was 0.904 with DLM, which was the highest in the internal testing set. Accuracy differences between the DLM and senior radiologist were not significant both in the internal and external testing set (both p > 0.05). With the help of the DLM, the accuracy and specificity of the junior radiologist were significantly improved (all p < 0.05), and all readers' diagnostic time was shortened (all p < 0.05).

CONCLUSION

The DLM achieved senior radiologist-level performance in differentiating benign and malignant PCLs which could improve the junior radiologist's interpretation and speed of PCLs on CT.

Using Quantitative Imaging for Personalized Medicine in Pancreatic Cancer: A Review of Radiomics and Deep Learning Applications

Simple Summary

With a five-year survival rate of only 3% for the majority of patients, pancreatic cancer is a global healthcare challenge. Radiomics and deep learning, two novel quantitative imaging methods that treat medical images as minable data instead of just pictures, have shown promise in advancing personalized management of pancreatic cancer through diagnosing precursor diseases, early detection, accurate diagnosis, and treatment personalization. Radiomics and deep learning methods aim to collect hidden information in medical images that is missed by conventional radiology practices through expanding the data search and comparing information across different patients. Both methods have been studied and applied in pancreatic cancer. In this review, we focus on the current progress of these two methods in pancreatic cancer and provide a comprehensive narrative review on the topic. With better regulation, enhanced workflow, and larger prospective patient datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through personalized precision medicine.

Abstract

As the most lethal major cancer, pancreatic cancer is a global healthcare challenge. Personalized medicine utilizing cutting-edge multi-omics data holds potential for major breakthroughs in tackling this critical problem. Radiomics and deep learning, two trendy quantitative imaging methods that take advantage of data science and modern medical imaging, have shown increasing promise in advancing the precision management of pancreatic cancer via diagnosing of precursor diseases, early detection, accurate diagnosis, and treatment personalization and optimization. Radiomics employs manually-crafted features, while deep learning applies computer-generated automatic features. These two methods aim to mine hidden information in medical images that is missed by conventional radiology and gain insights by systematically comparing the quantitative image information across different patients in order to characterize unique imaging phenotypes. Both methods have been studied and applied in various pancreatic cancer clinical applications. In this review, we begin with an introduction to the clinical problems and the technology. After providing technical overviews of the two methods, this review focuses on the current progress of clinical applications in precancerous lesion diagnosis, pancreatic cancer detection and diagnosis, prognosis prediction, treatment stratification, and radiogenomics. The limitations of current studies and methods are discussed, along with future directions. With better standardization and optimization of the workflow from image acquisition to analysis and with larger and especially prospective high-quality datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through big data-based high-precision personalization.

The impact of radiomics in diagnosis and staging of pancreatic cancer

INTRODUCTION

Pancreatic cancer (PC) is one of the most aggressive tumours, and better risk stratification among patients is required to provide tailored treatment. The meaning of radiomics and texture analysis as predictive techniques are not already systematically assessed. The aim of this study is to assess the role of radiomics in PC.

METHODS

A PubMed/MEDLINE and Embase systematic review was conducted to assess the role of radiomics in PC. The search strategy was 'radiomics [All Fields] AND ("pancreas" [MeSH Terms] OR "pancreas" [All Fields] OR "pancreatic" [All Fields])' and only original articles referred to PC in humans in the English language were considered.

RESULTS

A total of 123 studies and 183 studies were obtained using the mentioned search strategy on PubMed and Embase, respectively. After the complete selection process, a total of 56 papers were considered eligible for the analysis of the results. Radiomics methods were applied in PC for assessment technical feasibility and reproducibility aspects analysis, risk stratification, biologic or genomic status prediction and treatment response prediction.

DISCUSSION

Radiomics seems to be a promising approach to evaluate PC from diagnosis to treatment response prediction. Further and larger studies are required to confirm the role and allowed to include radiomics parameter in a comprehensive decision support system.

Recognition of Handwritten Arabic and Hindi Numerals Using Convolutional Neural Networks

Arabic and Hindi handwritten numeral detection and classification is one of the most popular fields in the automation research. It has many applications in different fields. Automatic detection and automatic classification of handwritten numerals have persistently received attention from researchers around the world due to the robotic revolution in the past decades. Therefore, many great efforts and contributions have been made to provide highly accurate detection and classification methodologies with high performance. In this paper, we propose a two-stage methodology for the detection and classification of Arabic and Hindi handwritten numerals. The classification was based on convolutional neural networks (CNNs). The first stage of the methodology is the detection of the input numeral to be either Arabic or Hindi. The second stage is to detect the input numeral according to the language it came from. The simulation results show very high performance; the recognition rate was close to 100%.

Artificial intelligence: a critical review of current applications in pancreatic imaging

The applications of artificial intelligence (AI), including machine learning and deep learning, in the field of pancreatic disease imaging are rapidly expanding. AI can be used for the detection of pancreatic ductal adenocarcinoma and other pancreatic tumors but also for pancreatic lesion characterization. In this review, the basic of radiomics, recent developments and current results of AI in the field of pancreatic tumors are presented. Limitations and future perspectives of AI are discussed.