CT classification model of pancreatic serous cystic neoplasms and mucinous cystic neoplasms based on a deep neural network

Artificial Intelligence in Pancreatic Image Analysis: A Review

Pancreatic cancer is a highly lethal disease with a poor prognosis. Its early diagnosis and accurate treatment mainly rely on medical imaging, so accurate medical image analysis is especially vital for pancreatic cancer patients. However, medical image analysis of pancreatic cancer is facing challenges due to ambiguous symptoms, high misdiagnosis rates, and significant financial costs. Artificial intelligence (AI) offers a promising solution by relieving medical personnel's workload, improving clinical decision-making, and reducing patient costs. This study focuses on AI applications such as segmentation, classification, object detection, and prognosis prediction across five types of medical imaging: CT, MRI, EUS, PET, and pathological images, as well as integrating these imaging modalities to boost diagnostic accuracy and treatment efficiency. In addition, this study discusses current hot topics and future directions aimed at overcoming the challenges in AI-enabled automated pancreatic cancer diagnosis algorithms.

DenseNet model incorporating hybrid attention mechanisms and clinical features for pancreatic cystic tumor classification

PURPOSE

The aim of this study is to develop a deep learning model capable of discriminating between pancreatic plasma cystic neoplasms (SCN) and mucinous cystic neoplasms (MCN) by leveraging patient-specific clinical features and imaging outcomes. The intent is to offer valuable diagnostic support to clinicians in their clinical decision-making processes.

METHODS

The construction of the deep learning model involved utilizing a dataset comprising abdominal magnetic resonance T2-weighted images obtained from patients diagnosed with pancreatic cystic tumors at Changhai Hospital. The dataset comprised 207 patients with SCN and 93 patients with MCN, encompassing a total of 1761 images. The foundational architecture employed was DenseNet-161, augmented with a hybrid attention mechanism module. This integration aimed to enhance the network's attentiveness toward channel and spatial features, thereby amplifying its performance. Additionally, clinical features were incorporated prior to the fully connected layer of the network to actively contribute to subsequent decision-making processes, thereby significantly augmenting the model's classification accuracy. The final patient classification outcomes were derived using a joint voting methodology, and the model underwent comprehensive evaluation.

RESULTS

Using the five-fold cross validation, the accuracy of the classification model in this paper was 92.44%, with an AUC value of 0.971, a precision rate of 0.956, a recall rate of 0.919, a specificity of 0.933, and an F1-score of 0.936.

CONCLUSION

This study demonstrates that the DenseNet model, which incorporates hybrid attention mechanisms and clinical features, is effective for distinguishing between SCN and MCN, and has potential application for the diagnosis of pancreatic cystic tumors in clinical practice.

Role of artificial intelligence in the characterization of indeterminate pancreatic head mass and its usefulness in preoperative diagnosis

Artificial intelligence (AI) has been used in various fields of day-to-day life and its role in medicine is immense. Understanding of oncology has been improved with the introduction of AI which helps in diagnosis, treatment planning, management, prognosis, and follow-up. It also helps to identify high-risk groups who can be subjected to timely screening for early detection of malignant conditions. It is more important in pancreatic cancer as it is one of the major causes of cancer-related deaths worldwide and there are no specific early features (clinical and radiological) for diagnosis. With improvement in imaging modalities (computed tomography, magnetic resonance imaging, endoscopic ultrasound), most often clinicians were being challenged with lesions that were difficult to diagnose with human competence. AI has been used in various other branches of medicine to differentiate such indeterminate lesions including the thyroid gland, breast, lungs, liver, adrenal gland, kidney, etc. In the case of pancreatic cancer, the role of AI has been explored and is still ongoing. This review article will focus on how AI can be used to diagnose pancreatic cancer early or differentiate it from benign pancreatic lesions, therefore, management can be planned at an earlier stage.

A primer on artificial intelligence in pancreatic imaging

Artificial Intelligence (AI) is set to transform medical imaging by leveraging the vast data contained in medical images. Deep learning and radiomics are the two main AI methods currently being applied within radiology. Deep learning uses a layered set of self-correcting algorithms to develop a mathematical model that best fits the data. Radiomics converts imaging data into mineable features such as signal intensity, shape, texture, and higher-order features. Both methods have the potential to improve disease detection, characterization, and prognostication. This article reviews the current status of artificial intelligence in pancreatic imaging and critically appraises the quality of existing evidence using the radiomics quality score.

Pancreatic Cystic Lesions: Next Generation of Radiologic Assessment

Pancreatic cystic lesions are frequently identified on cross-sectional imaging. As many of these are presumed branch-duct intraductal papillary mucinous neoplasms, these lesions generate much anxiety for the patients and clinicians, often necessitating long-term follow-up imaging and even unnecessary surgical resections. However, the incidence of pancreatic cancer is overall low for patients with incidental pancreatic cystic lesions. Radiomics and deep learning are advanced tools of imaging analysis that have attracted much attention in addressing this unmet need, however, current publications on this topic show limited success and large-scale research is needed.

CT classification model of pancreatic serous cystic neoplasm and mucinous cystic neoplasm based on deep transfer learning

BACKGROUND

Pancreatic cancer is a highly lethal disease. The preoperative distinction between pancreatic serous cystic neoplasm (SCN) and mucinous cystic neoplasm (MCN) remains a clinical challenge.

OBJECTIVE

The goal of this study is to provide clinicians with supportive advice and avoid overtreatment by constructing a convolutional neural network (CNN) classifier to automatically identify pancreatic cancer using computed tomography (CT) images.

METHODS

We construct a CNN model using a dataset of 6,173 CT images obtained from 107 pathologically confirmed pancreatic cancer patients at Shanghai Changhai Hospital from January 2017 to February 2022. We divide CT slices into three categories namely, SCN, MCN, and no tumor, to train the DenseNet201-based CNN model with multi-head spatial attention mechanism (MSAM-DenseNet201). The attention module enhances the network's attention to local features and effectively improves the network performance. The trained model is applied to process all CT image slices and finally realize the two categories classification of MCN and SCN patients through a joint voting strategy.

RESULTS

Using a 10-fold cross validation method, this new MSAM-DenseNet201 model achieves a classification accuracy of 92.52%, a precision of 92.16%, a sensitivity of 92.16%, and a specificity of 92.86%, respectively.

CONCLUSIONS

This study demonstrates the feasibility of using a deep learning network or classification model to help diagnose MCN and SCN cases. This, the new method has great potential for developing new computer-aided diagnosis systems and applying in future clinical practice.

Classification of pancreatic cystic neoplasms using radiomic feature analysis is equivalent to an experienced academic radiologist: a step toward computer-augmented diagnostics for radiologists

PURPOSE

A wide array of benign and malignant lesions of the pancreas can be cystic and these cystic lesions can have overlapping imaging appearances. The purpose of this study is to compare the diagnostic accuracy of a radiomics-based pancreatic cyst classifier to an experienced academic radiologist.

METHODS

In this IRB-approved retrospective single-institution study, patients with surgically resected pancreatic cysts who underwent preoperative abdominal CT from 2003 to 2016 were identified. Pancreatic cyst(s) and background pancreas were manually segmented, and 488 radiomics features were extracted. Random forest classification based on radiomics features, age, and gender was evaluated with fourfold cross-validation. An academic radiologist blinded to the final pathologic diagnosis reviewed each case and provided the most likely diagnosis.

RESULTS

214 patients were included (64 intraductal papillary mucinous neoplasms, 33 mucinous cystic neoplasms, 60 serous cystadenomas, 24 solid pseudopapillary neoplasms, and 33 cystic neuroendocrine tumors). The radiomics-based machine learning approach showed AUC of 0.940 in pancreatic cyst classification, compared with AUC of 0.895 for the radiologist.

CONCLUSION

Radiomics-based machine learning achieved equivalent performance as an experienced academic radiologist in the classification of pancreatic cysts. The high diagnostic accuracy can potentially maximize the efficiency of healthcare utilization by maximizing detection of high-risk lesions.

Deep learning combined with radiomics for the classification of enlarged cervical lymph nodes

PURPOSE

To investigate the application of deep learning combined with traditional radiomics methods for classifying enlarged cervical lymph nodes.

METHODS

The clinical and computed tomography (CT) imaging data of 276 patients with enlarged cervical lymph nodes (150 with lymph-node metastasis, 65 with lymphoma, and 61 with benign lymphadenopathy) who were treated at the hospital from January 2015 to January 2021 were retrospectively analysed. The patients were randomly divided into a training group and a test group at a ratio of 8:2. The radiomics features were extracted using one-by-one convolution and neural network activation, filtered with the least absolute shrinkage and selection operator (LASSO) model, and used to construct a discrimination model with PyTorch. Then, the performance of the model was compared with the radiologists' diagnostic performance. The neural network model was evaluated using the area under the receiver-operator characteristic curve (AUC), and the accuracy, sensitivity, and specificity were analysed.

RESULTS

A total of 102 features, comprising five traditional radiomic features and 97 deep learning features, were selected with LASSO and used to construct a discrimination model, which achieved a total accuracy of 87.50%. The AUC value, specificity, and sensitivity were, respectively, 0.92, 92.30%, and 90.00% for metastatic lymph nodes, 0.87, 95.45%, and 83.33% for benign lymphadenopathy, and 0.88, 90.47%, and 85.71% for lymphoma. The accuracies of the radiologists' diagnoses were 62.68% and 62.68%. The diagnostic performance of the model was significantly different from that of the radiologists (p < 0.05).

CONCLUSION

CT-based deep learning combined with the traditional radiomics methods has a high diagnostic value for the classification of cervical enlarged lymph nodes.

Using Quantitative Imaging for Personalized Medicine in Pancreatic Cancer: A Review of Radiomics and Deep Learning Applications

Simple Summary

With a five-year survival rate of only 3% for the majority of patients, pancreatic cancer is a global healthcare challenge. Radiomics and deep learning, two novel quantitative imaging methods that treat medical images as minable data instead of just pictures, have shown promise in advancing personalized management of pancreatic cancer through diagnosing precursor diseases, early detection, accurate diagnosis, and treatment personalization. Radiomics and deep learning methods aim to collect hidden information in medical images that is missed by conventional radiology practices through expanding the data search and comparing information across different patients. Both methods have been studied and applied in pancreatic cancer. In this review, we focus on the current progress of these two methods in pancreatic cancer and provide a comprehensive narrative review on the topic. With better regulation, enhanced workflow, and larger prospective patient datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through personalized precision medicine.

Abstract

As the most lethal major cancer, pancreatic cancer is a global healthcare challenge. Personalized medicine utilizing cutting-edge multi-omics data holds potential for major breakthroughs in tackling this critical problem. Radiomics and deep learning, two trendy quantitative imaging methods that take advantage of data science and modern medical imaging, have shown increasing promise in advancing the precision management of pancreatic cancer via diagnosing of precursor diseases, early detection, accurate diagnosis, and treatment personalization and optimization. Radiomics employs manually-crafted features, while deep learning applies computer-generated automatic features. These two methods aim to mine hidden information in medical images that is missed by conventional radiology and gain insights by systematically comparing the quantitative image information across different patients in order to characterize unique imaging phenotypes. Both methods have been studied and applied in various pancreatic cancer clinical applications. In this review, we begin with an introduction to the clinical problems and the technology. After providing technical overviews of the two methods, this review focuses on the current progress of clinical applications in precancerous lesion diagnosis, pancreatic cancer detection and diagnosis, prognosis prediction, treatment stratification, and radiogenomics. The limitations of current studies and methods are discussed, along with future directions. With better standardization and optimization of the workflow from image acquisition to analysis and with larger and especially prospective high-quality datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through big data-based high-precision personalization.