1
|
Mandal S, Balraj K, Kodamana H, Arora C, Clark JM, Kwon DS, Rathore AS. Weakly supervised large-scale pancreatic cancer detection using multi-instance learning. Front Oncol 2024; 14:1362850. [PMID: 39267824 PMCID: PMC11390448 DOI: 10.3389/fonc.2024.1362850] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 08/01/2024] [Indexed: 09/15/2024] Open
Abstract
Introduction Early detection of pancreatic cancer continues to be a challenge due to the difficulty in accurately identifying specific signs or symptoms that might correlate with the onset of pancreatic cancer. Unlike breast or colon or prostate cancer where screening tests are often useful in identifying cancerous development, there are no tests to diagnose pancreatic cancers. As a result, most pancreatic cancers are diagnosed at an advanced stage, where treatment options, whether systemic therapy, radiation, or surgical interventions, offer limited efficacy. Methods A two-stage weakly supervised deep learning-based model has been proposed to identify pancreatic tumors using computed tomography (CT) images from Henry Ford Health (HFH) and publicly available Memorial Sloan Kettering Cancer Center (MSKCC) data sets. In the first stage, the nnU-Net supervised segmentation model was used to crop an area in the location of the pancreas, which was trained on the MSKCC repository of 281 patient image sets with established pancreatic tumors. In the second stage, a multi-instance learning-based weakly supervised classification model was applied on the cropped pancreas region to segregate pancreatic tumors from normal appearing pancreas. The model was trained, tested, and validated on images obtained from an HFH repository with 463 cases and 2,882 controls. Results The proposed deep learning model, the two-stage architecture, offers an accuracy of 0.907 ± 0.01, sensitivity of 0.905 ± 0.01, specificity of 0.908 ± 0.02, and AUC (ROC) 0.903 ± 0.01. The two-stage framework can automatically differentiate pancreatic tumor from non-tumor pancreas with improved accuracy on the HFH dataset. Discussion The proposed two-stage deep learning architecture shows significantly enhanced performance for predicting the presence of a tumor in the pancreas using CT images compared with other reported studies in the literature.
Collapse
Affiliation(s)
- Shyamapada Mandal
- Department of Chemical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Keerthiveena Balraj
- Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi, New Delhi, India
| | - Hariprasad Kodamana
- Department of Chemical Engineering, Indian Institute of Technology Delhi, New Delhi, India
- Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi, New Delhi, India
| | - Chetan Arora
- Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi, New Delhi, India
- Department of Computer Science and Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Julie M Clark
- Henry Ford Pancreatic Cancer Center, Henry Ford Health, Detroit, MI, United States
| | - David S Kwon
- Henry Ford Pancreatic Cancer Center, Henry Ford Health, Detroit, MI, United States
- Department of Surgery, Henry Ford Health, Detroit, MI, United States
| | - Anurag S Rathore
- Department of Chemical Engineering, Indian Institute of Technology Delhi, New Delhi, India
- Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi, New Delhi, India
| |
Collapse
|
2
|
Zhang XB, Fan YB, Jing R, Getu MA, Chen WY, Zhang W, Dong HX, Dakal TC, Hayat A, Cai HJ, Ashrafizadeh M, Abd El-Aty AM, Hacimuftuoglu A, Liu P, Li TF, Sethi G, Ahn KS, Ertas YN, Chen MJ, Ji JS, Ma L, Gong P. Gastroenteropancreatic neuroendocrine neoplasms: current development, challenges, and clinical perspectives. Mil Med Res 2024; 11:35. [PMID: 38835066 DOI: 10.1186/s40779-024-00535-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Accepted: 05/07/2024] [Indexed: 06/06/2024] Open
Abstract
Neuroendocrine neoplasms (NENs) are highly heterogeneous and potentially malignant tumors arising from secretory cells of the neuroendocrine system. Gastroenteropancreatic neuroendocrine neoplasms (GEP-NENs) are the most common subtype of NENs. Historically, GEP-NENs have been regarded as infrequent and slow-growing malignancies; however, recent data have demonstrated that the worldwide prevalence and incidence of GEP-NENs have increased exponentially over the last three decades. In addition, an increasing number of studies have proven that GEP-NENs result in a limited life expectancy. These findings suggested that the natural biology of GEP-NENs is more aggressive than commonly assumed. Therefore, there is an urgent need for advanced researches focusing on the diagnosis and management of patients with GEP-NENs. In this review, we have summarized the limitations and recent advancements in our comprehension of the epidemiology, clinical presentations, pathology, molecular biology, diagnosis, and treatment of GEP-NETs to identify factors contributing to delays in diagnosis and timely treatment of these patients.
Collapse
Affiliation(s)
- Xian-Bin Zhang
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China
| | - Yi-Bao Fan
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China
- School of Pharmacy, Shenzhen University Medical School, Shenzhen University, Shenzhen, Guangdong, 518060, China
| | - Rui Jing
- Department of Radiology, Second Hospital of Shandong University, Jinan, Shandong, 250000, China
| | - Mikiyas Amare Getu
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China
| | - Wan-Ying Chen
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China
- School of Pharmacy, Shenzhen University Medical School, Shenzhen University, Shenzhen, Guangdong, 518060, China
| | - Wei Zhang
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China
| | - Hong-Xia Dong
- Department of Gastroenterology, General Hospital of Chinese PLA, Beijing, 100853, China
| | - Tikam Chand Dakal
- Department of Biotechnology, Mohanlal Sukhadia University, Udaipur, Rajasthan, 313001, India
| | - Akhtar Hayat
- Interdisciplinary Research Centre in Biomedical Materials (IRCBM), COMSATS University Islamabad, Lahore Campus, Lahore, 54000, Pakistan
| | - Hua-Jun Cai
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China
| | - Milad Ashrafizadeh
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China
| | - A M Abd El-Aty
- Department of Pharmacology, Faculty of Veterinary Medicine, Cairo University, Giza, 12211, Egypt
- Department of Medical Pharmacology, Medical Faculty, Ataturk University, Erzurum, 25240, Turkey
| | - Ahmet Hacimuftuoglu
- Department of Medical Pharmacology, Medical Faculty, Ataturk University, Erzurum, 25240, Turkey
| | - Peng Liu
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China
| | - Tian-Feng Li
- Reproductive Medicine Center, Shenzhen Maternity & Child Healthcare Hospital, Southern Medical University, Shenzhen, Guangdong, 518055, China
| | - Gautam Sethi
- Department of Pharmacology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, 117600, Singapore
| | - Kwang Seok Ahn
- Department of Science in Korean Medicine, Kyung Hee University, Seoul, 02447, Republic of Korea
| | - Yavuz Nuri Ertas
- ERNAM-Nanotechnology Research and Application Center, Erciyes University, Kayseri, 38039, Türkiye
- Department of Biomedical Engineering, Erciyes University, Kayseri, 38280, Türkiye
- UNAM-National Nanotechnology Research Center, Bilkent University, Ankara, 06800, Türkiye
| | - Min-Jiang Chen
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Intervention Research, Fifth Affiliated Hospital of Wenzhou Medical University, Lishui, Zhejiang, 323000, China
| | - Jian-Song Ji
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Intervention Research, Fifth Affiliated Hospital of Wenzhou Medical University, Lishui, Zhejiang, 323000, China
| | - Li Ma
- Department of Epidemiology, Dalian Medical University, Dalian, Liaoning, 116044, China
| | - Peng Gong
- Department of General SurgeryInstitute of Precision Diagnosis and Treatment of Digestive System Tumors and Guangdong Provincial Key Laboratory of Chinese Medicine Ingredients and Gut Microbiomics, Carson International Cancer Center, Shenzhen University General Hospital, Shenzhen University, Shenzhen, Guangdong, 518055, China.
| |
Collapse
|
3
|
Yan Q, Chen Y, Liu C, Shi H, Han M, Wu Z, Huang S, Zhang C, Hou B. Predicting histologic grades for pancreatic neuroendocrine tumors by radiologic image-based artificial intelligence: a systematic review and meta-analysis. Front Oncol 2024; 14:1332387. [PMID: 38725633 PMCID: PMC11080013 DOI: 10.3389/fonc.2024.1332387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 04/02/2024] [Indexed: 05/12/2024] Open
Abstract
Background Accurate detection of the histological grade of pancreatic neuroendocrine tumors (PNETs) is important for patients' prognoses and treatment. Here, we investigated the performance of radiological image-based artificial intelligence (AI) models in predicting histological grades using meta-analysis. Method A systematic literature search was performed for studies published before September 2023. Study characteristics and diagnostic measures were extracted. Estimates were pooled using random-effects meta-analysis. Evaluation of risk of bias was performed by the QUADAS-2 tool. Results A total of 26 studies were included, 20 of which met the meta-analysis criteria. We found that the AI-based models had high area under the curve (AUC) values and showed moderate predictive value. The pooled distinguishing abilities between different grades of PNETs were 0.89 [0.84-0.90]. By performing subgroup analysis, we found that the radiomics feature-only models had a predictive value of 0.90 [0.87-0.92] with I2 = 89.91%, while the pooled AUC value of the combined group was 0.81 [0.77-0.84] with I2 = 41.54%. The validation group had a pooled AUC of 0.84 [0.81-0.87] without heterogenicity, whereas the validation-free group had high heterogenicity (I2 = 91.65%, P=0.000). The machine learning group had a pooled AUC of 0.83 [0.80-0.86] with I2 = 82.28%. Conclusion AI can be considered as a potential tool to detect histological PNETs grades. Sample diversity, lack of external validation, imaging modalities, inconsistent radiomics feature extraction across platforms, different modeling algorithms and software choices were sources of heterogeneity. Standardized imaging, transparent statistical methodologies for feature selection and model development are still needed in the future to achieve the transformation of radiomics results into clinical applications. Systematic Review Registration https://www.crd.york.ac.uk/prospero/, identifier CRD42022341852.
Collapse
Affiliation(s)
- Qian Yan
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| | - Yubin Chen
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| | - Chunsheng Liu
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Hexian Shi
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Mingqian Han
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Zelong Wu
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Shanzhou Huang
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| | - Chuanzhao Zhang
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
| | - Baohua Hou
- Department of General Surgery, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
- School of Medicine, South China University of Technology, Guangzhou, China
- Department of General Surgery, Heyuan People’s Hospital, Heyuan, China
| |
Collapse
|
4
|
Dromain C, Pavel M, Ronot M, Schaefer N, Mandair D, Gueguen D, Cheng C, Dehaene O, Schutte K, Cahané D, Jégou S, Balazard F. Response heterogeneity as a new biomarker of treatment response in patients with neuroendocrine tumors. Future Oncol 2023; 19:2171-2183. [PMID: 37497626 DOI: 10.2217/fon-2022-1137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/28/2023] Open
Abstract
Aim: The RAISE project aimed to find a surrogate end point to predict treatment response early in patients with enteropancreatic neuroendocrine tumors (NET). Response heterogeneity, defined as the coexistence of responding and non-responding lesions, has been proposed as a predictive marker for progression-free survival (PFS) in patients with NETs. Patients & methods: Computerized tomography scans were analyzed from patients with multiple lesions in CLARINET (NCT00353496; n = 148/204). Cox regression analyses evaluated association between response heterogeneity, estimated using the standard deviation of the longest diameter ratio of target lesions, and NET progression. Results: Greater response heterogeneity at a given visit was associated with earlier progression thereafter: week 12 hazard ratio (HR; 95% confidence interval): 1.48 (1.20-1.82); p < 0.001; n = 148; week 36: 1.72 (1.32-2.24); p < 0.001; n = 108. HRs controlled for sum of longest diameter ratio: week 12: 1.28 (1.04-1.59); p = 0.020 and week 36: 1.81 (1.20-2.72); p = 0.005. Conclusion: Response heterogeneity independently predicts PFS in patients with enteropancreatic NETs. Further validation is required.
Collapse
Affiliation(s)
| | - Marianne Pavel
- Department of Medicine 1, Friedrich-Alexander-University of Erlangen-Nürnberg, Erlangen, Germany
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
5
|
Feuerecker B, Heimer MM, Geyer T, Fabritius MP, Gu S, Schachtner B, Beyer L, Ricke J, Gatidis S, Ingrisch M, Cyran CC. Artificial Intelligence in Oncological Hybrid Imaging. Nuklearmedizin 2023; 62:296-305. [PMID: 37802057 DOI: 10.1055/a-2157-6810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/08/2023]
Abstract
BACKGROUND Artificial intelligence (AI) applications have become increasingly relevant across a broad spectrum of settings in medical imaging. Due to the large amount of imaging data that is generated in oncological hybrid imaging, AI applications are desirable for lesion detection and characterization in primary staging, therapy monitoring, and recurrence detection. Given the rapid developments in machine learning (ML) and deep learning (DL) methods, the role of AI will have significant impact on the imaging workflow and will eventually improve clinical decision making and outcomes. METHODS AND RESULTS The first part of this narrative review discusses current research with an introduction to artificial intelligence in oncological hybrid imaging and key concepts in data science. The second part reviews relevant examples with a focus on applications in oncology as well as discussion of challenges and current limitations. CONCLUSION AI applications have the potential to leverage the diagnostic data stream with high efficiency and depth to facilitate automated lesion detection, characterization, and therapy monitoring to ultimately improve quality and efficiency throughout the medical imaging workflow. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based therapy guidance in oncology. However, significant challenges remain regarding application development, benchmarking, and clinical implementation. KEY POINTS · Hybrid imaging generates a large amount of multimodality medical imaging data with high complexity and depth.. · Advanced tools are required to enable fast and cost-efficient processing along the whole radiology value chain.. · AI applications promise to facilitate the assessment of oncological disease in hybrid imaging with high quality and efficiency for lesion detection, characterization, and response assessment. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based oncological therapy guidance.. · Selected applications in three oncological entities (lung, prostate, and neuroendocrine tumors) demonstrate how AI algorithms may impact imaging-based tasks in hybrid imaging and potentially guide clinical decision making..
Collapse
Affiliation(s)
- Benedikt Feuerecker
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
- German Cancer Research Center (DKFZ), Partner site Munich, DKTK German Cancer Consortium, Munich, Germany
| | - Maurice M Heimer
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | - Thomas Geyer
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | | | - Sijing Gu
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | | | - Leonie Beyer
- Department of Nuclear Medicine, University Hospital, LMU Munich, Munich, Germany
| | - Jens Ricke
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | - Sergios Gatidis
- Department of Radiology, University Hospital Tübingen, Tübingen, Germany
- MPI, Max Planck Institute for Intelligent Systems, Tübingen, Germany
| | - Michael Ingrisch
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | - Clemens C Cyran
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| |
Collapse
|
6
|
Pavel M, Dromain C, Ronot M, Schaefer N, Mandair D, Gueguen D, Elvira D, Jégou S, Balazard F, Dehaene O, Schutte K. The use of deep learning models to predict progression-free survival in patients with neuroendocrine tumors. Future Oncol 2023; 19:2185-2199. [PMID: 37497644 DOI: 10.2217/fon-2022-1136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/28/2023] Open
Abstract
Aim: The RAISE project assessed whether deep learning could improve early progression-free survival (PFS) prediction in patients with neuroendocrine tumors. Patients & methods: Deep learning models extracted features from CT scans from patients in CLARINET (NCT00353496) (n = 138/204). A Cox model assessed PFS prediction when combining deep learning with the sum of longest diameter ratio (SLDr) and logarithmically transformed CgA concentration (logCgA), versus SLDr and logCgA alone. Results: Deep learning models extracted features other than lesion shape to predict PFS at week 72. No increase in performance was achieved with deep learning versus SLDr and logCgA models alone. Conclusion: Deep learning models extracted relevant features to predict PFS, but did not improve early prediction based on SLDr and logCgA.
Collapse
Affiliation(s)
- Marianne Pavel
- Department of Medicine 1, Friedrich-Alexander-University of Erlangen-Nürnberg, Erlangen, Germany
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
7
|
De Muzio F, Pellegrino F, Fusco R, Tafuto S, Scaglione M, Ottaiano A, Petrillo A, Izzo F, Granata V. Prognostic Assessment of Gastropancreatic Neuroendocrine Neoplasm: Prospects and Limits of Radiomics. Diagnostics (Basel) 2023; 13:2877. [PMID: 37761243 PMCID: PMC10529975 DOI: 10.3390/diagnostics13182877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 08/28/2023] [Accepted: 08/30/2023] [Indexed: 09/29/2023] Open
Abstract
Neuroendocrine neoplasms (NENs) are a group of lesions originating from cells of the diffuse neuroendocrine system. NENs may involve different sites, including the gastrointestinal tract (GEP-NENs). The incidence and prevalence of GEP-NENs has been constantly rising thanks to the increased diagnostic power of imaging and immuno-histochemistry. Despite the plethora of biochemical markers and imaging techniques, the prognosis and therapeutic choice in GEP-NENs still represents a challenge, mainly due to the great heterogeneity in terms of tumor lesions and clinical behavior. The concept that biomedical images contain information about tissue heterogeneity and pathological processes invisible to the human eye is now well established. From this substrate comes the idea of radiomics. Computational analysis has achieved promising results in several oncological settings, and the use of radiomics in different types of GEP-NENs is growing in the field of research, yet with conflicting results. The aim of this narrative review is to provide a comprehensive update on the role of radiomics on GEP-NEN management, focusing on the main clinical aspects analyzed by most existing reports: predicting tumor grade, distinguishing NET from other tumors, and prognosis assessment.
Collapse
Affiliation(s)
- Federica De Muzio
- Department of Medicine and Health Sciences “V. Tiberio”, University of Molise, 86100 Campobasso, Italy;
| | | | - Roberta Fusco
- Medical Oncology Division, Igea SpA, 80013 Napoli, Italy;
| | - Salvatore Tafuto
- Unit of Sarcomi e Tumori Rari, Istituto Nazionale Tumori, IRCCS, Fondazione G. Pascale, 80131 Naples, Italy;
| | - Mariano Scaglione
- Department of Medical, Surgical and Experimental Sciences, University of Sassari, 07100 Sassari, Italy
| | - Alessandro Ottaiano
- Unit for Innovative Therapies of Abdominal Metastastes, Istituto Nazionale Tumori, IRCCS, Fondazione G. Pascale, 80131 Naples, Italy;
| | - Antonella Petrillo
- Division of Radiology, Istituto Nazionale Tumori, IRCCS, Fondazione G. Pascale, 80131 Naples, Italy;
| | - Francesco Izzo
- Division of Hepatobiliary Surgery, Istituto Nazionale Tumori, IRCCS, Fondazione G. Pascale, 80131 Naples, Italy
| | - Vincenza Granata
- Division of Radiology, Istituto Nazionale Tumori, IRCCS, Fondazione G. Pascale, 80131 Naples, Italy;
| |
Collapse
|
8
|
Dinesh MG, Bacanin N, Askar SS, Abouhawwash M. Diagnostic ability of deep learning in detection of pancreatic tumour. Sci Rep 2023; 13:9725. [PMID: 37322046 PMCID: PMC10272117 DOI: 10.1038/s41598-023-36886-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Accepted: 06/12/2023] [Indexed: 06/17/2023] Open
Abstract
Pancreatic cancer is associated with higher mortality rates due to insufficient diagnosis techniques, often diagnosed at an advanced stage when effective treatment is no longer possible. Therefore, automated systems that can detect cancer early are crucial to improve diagnosis and treatment outcomes. In the medical field, several algorithms have been put into use. Valid and interpretable data are essential for effective diagnosis and therapy. There is much room for cutting-edge computer systems to develop. The main objective of this research is to predict pancreatic cancer early using deep learning and metaheuristic techniques. This research aims to create a deep learning and metaheuristic techniques-based system to predict pancreatic cancer early by analyzing medical imaging data, mainly CT scans, and identifying vital features and cancerous growths in the pancreas using Convolutional Neural Network (CNN) and YOLO model-based CNN (YCNN) models. Once diagnosed, the disease cannot be effectively treated, and its progression is unpredictable. That's why there's been a push in recent years to implement fully automated systems that can sense cancer at a prior stage and improve diagnosis and treatment. The paper aims to evaluate the effectiveness of the novel YCNN approach compared to other modern methods in predicting pancreatic cancer. To predict the vital features from the CT scan and the proportion of cancer feasts in the pancreas using the threshold parameters booked as markers. This paper employs a deep learning approach called a Convolutional Neural network (CNN) model to predict pancreatic cancer images. In addition, we use the YOLO model-based CNN (YCNN) to aid in the categorization process. Both biomarkers and CT image dataset is used for testing. The YCNN method was shown to perform well by a cent percent of accuracy compared to other modern techniques in a thorough review of comparative findings.
Collapse
Affiliation(s)
- M G Dinesh
- Department of Computer Science and Engineering, EASA College of Engineering and Technology, Coimbatore, India
| | | | - S S Askar
- Department of Statistics and Operations Research, College of Science, King Saud University, P.O. Box 2455, 11451, Riyadh, Saudi Arabia
| | - Mohamed Abouhawwash
- Department of Computational Mathematics, Science and Engineering (CMSE), College of Engineering, Michigan State University, East Lansing, MI, 48824, USA.
- Department of Mathematics, Faculty of Science, Mansoura University, Mansoura, 35516, Egypt.
| |
Collapse
|
9
|
Jiang C, Wang K, Yan L, Yao H, Shi H, Lin R. Predicting the survival of patients with pancreatic neuroendocrine neoplasms using deep learning: A study based on Surveillance, Epidemiology, and End Results database. Cancer Med 2023; 12:12413-12424. [PMID: 37165971 PMCID: PMC10278508 DOI: 10.1002/cam4.5949] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 03/18/2023] [Accepted: 04/02/2023] [Indexed: 05/12/2023] Open
Abstract
BACKGROUND The study aims to evaluate the performance of three advanced machine learning algorithms and a traditional Cox proportional hazard (CoxPH) model in predicting the overall survival (OS) of patients with pancreatic neuroendocrine neoplasms (PNENs). METHOD The clinicopathological dataset obtained from the Surveillance, Epidemiology, and End Results database was randomly assigned to the training set and testing set at a ratio of 7:3. The concordance index (C-index) and integrated Brier score (IBS) were used to compare the predictive performance of the models. The accuracy of the model in predicting the 5-year and 10-year survival rates was compared using the receiver operating characteristic curve, decision curve analysis (DCA) and calibration curve. RESULTS This study included 3239 patients with PNENs in total. The DeepSurv model had the highest C-index of 0.7882 in the testing set and training set and the lowest IBS of 0.1278 in the testing set compared with the CoxPH, neural multitask logistic and random survival forest models (C-index = 0.7501, 0.7616, and 0.7612, respectively; IBS = 0.1397, 0.1418, and 0.1432, respectively). Moreover, the DeepSurv model had the highest accuracy in predicting 5- and 10-year OS rates (area under the curve: 0.87 and 0.90). DCA showed that the DeepSurv model had high potential for clinical decisions in 5- and 10-year OS models. Finally, we developed an online application based on the DeepSurv model for clinical use (https://whuh-ml-neuroendocrinetumor-app-predict-oyw5km.streamlit.app/). CONCLUSIONS All four models analyzed above can predict the prognosis of PNENs well, among which the DeepSurv model has the best prediction performance.
Collapse
Affiliation(s)
- Chen Jiang
- Department of Gastroenterology, Union Hospital, Tongji Medical CollegeHuazhong University of Science and TechnologyWuhanChina
| | - Kan Wang
- Department of Cardiovascular Surgery, Union Hospital, Tongji Medical CollegeHuazhong University of Science and TechnologyWuhanChina
| | - Lizhao Yan
- Department of Hand Surgery, Union Hospital, Tongji Medical CollegeHuazhong University of Science and TechnologyWuhanChina
| | - Hailing Yao
- Department of Gastroenterology, Union Hospital, Tongji Medical CollegeHuazhong University of Science and TechnologyWuhanChina
| | - Huiying Shi
- Department of Gastroenterology, Union Hospital, Tongji Medical CollegeHuazhong University of Science and TechnologyWuhanChina
| | - Rong Lin
- Department of Gastroenterology, Union Hospital, Tongji Medical CollegeHuazhong University of Science and TechnologyWuhanChina
| |
Collapse
|
10
|
Murakami M, Fujimori N, Nakata K, Nakamura M, Hashimoto S, Kurahara H, Nishihara K, Abe T, Hashigo S, Kugiyama N, Ozawa E, Okamoto K, Ishida Y, Okano K, Takaki R, Shimamatsu Y, Ito T, Miki M, Oza N, Yamaguchi D, Yamamoto H, Takedomi H, Kawabe K, Akashi T, Miyahara K, Ohuchida J, Ogura Y, Nakashima Y, Ueki T, Ishigami K, Umakoshi H, Ueda K, Oono T, Ogawa Y. Machine learning-based model for prediction and feature analysis of recurrence in pancreatic neuroendocrine tumors G1/G2. J Gastroenterol 2023; 58:586-597. [PMID: 37099152 DOI: 10.1007/s00535-023-01987-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 03/28/2023] [Indexed: 04/27/2023]
Abstract
BACKGROUND Pancreatic neuroendocrine neoplasms (PanNENs) are a heterogeneous group of tumors. Although the prognosis of resected PanNENs is generally considered to be good, a relatively high recurrence rate has been reported. Given the scarcity of large-scale reports about PanNEN recurrence due to their rarity, we aimed to identify the predictors for recurrence in patients with resected PanNENs to improve prognosis. METHODS We established a multicenter database of 573 patients with PanNENs, who underwent resection between January 1987 and July 2020 at 22 Japanese centers, mainly in the Kyushu region. We evaluated the clinical characteristics of 371 patients with localized non-functioning pancreatic neuroendocrine tumors (G1/G2). We also constructed a machine learning-based prediction model to analyze the important features to determine recurrence. RESULTS Fifty-two patients experienced recurrence (14.0%) during the follow-up period, with the median time of recurrence being 33.7 months. The random survival forest (RSF) model showed better predictive performance than the Cox proportional hazards regression model in terms of the Harrell's C-index (0.841 vs. 0.820). The Ki-67 index, residual tumor, WHO grade, tumor size, and lymph node metastasis were the top five predictors in the RSF model; tumor size above 20 mm was the watershed with increased recurrence probability, whereas the 5-year disease-free survival rate decreased linearly as the Ki-67 index increased. CONCLUSIONS Our study revealed the characteristics of resected PanNENs in real-world clinical practice. Machine learning techniques can be powerful analytical tools that provide new insights into the relationship between the Ki-67 index or tumor size and recurrence.
Collapse
Affiliation(s)
- Masatoshi Murakami
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Nao Fujimori
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan.
| | - Kohei Nakata
- Department of Surgery and Oncology, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Masafumi Nakamura
- Department of Surgery and Oncology, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Shinichi Hashimoto
- Digestive and Lifestyle Diseases, Kagoshima University Graduate School of Medical and Dental Sciences, Kagoshima, Japan
| | - Hiroshi Kurahara
- Department of Digestive Surgery, Breast and Thyroid Surgery, Kagoshima University Graduate School of Medical and Dental Sciences, Kagoshima, Japan
| | - Kazuyoshi Nishihara
- Department of Surgery, Kitakyushu Municipal Medical Center, Kitakyushu, Japan
| | - Toshiya Abe
- Department of Surgery, Kitakyushu Municipal Medical Center, Kitakyushu, Japan
| | - Shunpei Hashigo
- Department of Gastroenterology and Hepatology, Graduate School of Medical Sciences, Kumamoto University, Kumamoto, Japan
| | - Naotaka Kugiyama
- Department of Gastroenterology and Hepatology, Graduate School of Medical Sciences, Kumamoto University, Kumamoto, Japan
| | - Eisuke Ozawa
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Kazuhisa Okamoto
- Department of Gastroenterology, Faculty of Medicine, Oita University, Oita, Japan
| | - Yusuke Ishida
- Department of Gastroenterology and Medicine, Faculty of Medicine, Fukuoka University, Fukuoka, Japan
| | - Keiichi Okano
- Department of Gastroenterological Surgery, Faculty of Medicine, Kagawa University, Kita-gun, Japan
| | - Ryo Takaki
- Department of Gastroenterology, Urasoe General Hospital, Urasoe, Japan
| | - Yutaka Shimamatsu
- Division of Gastroenterology, Department of Medicine, Kurume University School of Medicine, Kurume, Japan
| | - Tetsuhide Ito
- Neuroendocrine Tumor Centre, Fukuoka Sanno Hospital, Fukuoka, Japan
- Department of Gastroenterology, Graduate School of Medical Sciences, International University of Health and Welfare, Fukuoka, Japan
| | - Masami Miki
- Department of Gastroenterology, National Hospital Organization Kyushu Cancer Center, Fukuoka, Japan
| | - Noriko Oza
- Department of Hepato-Biliary-Pancreatology, Saga-Ken Medical Centre Koseikan, Saga, Japan
| | - Daisuke Yamaguchi
- Department of Gastroenterology, National Hospital Organization Ureshino Medical Center, Ureshino, Japan
| | | | - Hironobu Takedomi
- Division of Gastroenterology, Department of Internal Medicine, Faculty of Medicine, Saga University, Saga, Japan
| | - Ken Kawabe
- Department of Gastroenterology, National Hospital Organization Kyushu Medical Center, Fukuoka, Japan
| | - Tetsuro Akashi
- Department of Internal Medicine, Saiseikai Fukuoka General Hospital, Fukuoka, Japan
| | - Koichi Miyahara
- Department of Internal Medicine, Karatsu Red Cross Hospital, Karatsu, Japan
| | - Jiro Ohuchida
- Department of Surgery, Miyazaki Prefectural Miyazaki Hospital, Miyazaki, Japan
| | - Yasuhiro Ogura
- Department of Surgery, Fukuoka Red Cross Hospital, Fukuoka, Japan
| | - Yohei Nakashima
- Department of Surgery, Japan Community Health Care Organization, Kyushu Hospital, Kitakyushu, Japan
| | - Toshiharu Ueki
- Department of Gastroenterology, Fukuoka University Chikushi Hospital, Chikushino, Japan
| | - Kousei Ishigami
- Department of Clinical Radiology, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Hironobu Umakoshi
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Keijiro Ueda
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Takamasa Oono
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| | - Yoshihiro Ogawa
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, 812-8582, Japan
| |
Collapse
|
11
|
Histogram array and convolutional neural network of DWI for differentiating pancreatic ductal adenocarcinomas from solid pseudopapillary neoplasms and neuroendocrine neoplasms. Clin Imaging 2023; 96:15-22. [PMID: 36736182 DOI: 10.1016/j.clinimag.2023.01.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 12/20/2022] [Accepted: 01/23/2023] [Indexed: 01/28/2023]
Abstract
PURPOSE This study aimed to investigate the diagnostic performance of the histogram array and convolutional neural network (CNN) based on diffusion-weighted imaging (DWI) with multiple b-values under magnetic resonance imaging (MRI) to distinguish pancreatic ductal adenocarcinomas (PDACs) from solid pseudopapillary neoplasms (SPNs) and pancreatic neuroendocrine neoplasms (PNENs). METHODS This retrospective study consisted of patients diagnosed with PDACs (n = 132), PNENs (n = 45) and SPNs (n = 54). All patients underwent 3.0-T MRI including DWI with 10 b values. The regions of interest (ROIs) of pancreatic tumor were manually drawn using ITK-SNAP software, which included entire tumor at DWI (b = 1500 s/m2). The histogram array was obtained through the ROIs from multiple b-value data. PyTorch (version 1.11) was used to construct a CNN classifier to categorize the histogram array into PDACs, PNENs or SPNs. RESULTS The area under the curves (AUCs) of the histogram array and the CNN model for differentiating PDACs from PNENs and SPNs were 0.896, 0.846, and 0.839 in the training, validation and testing cohorts, respectively. The accuracy, sensitivity and specificity were 90.22%, 96.23%, and 82.05% in the training cohort, 84.78%, 96.15%, and 70.0% in the validation cohort, and 81.72%, 90.57%, and 70.0% in the testing cohort. The performance of CNN with AUC of 0.865 for this differentiation was significantly higher than that of f with AUC = 0.755 (P = 0.0057) and α with AUC = 0.776 (P = 0.0278) in all patients. CONCLUSION The histogram array and CNN based on DWI data with multiple b-values using MRI provided an accurate diagnostic performance to differentiate PDACs from PNENs and SPNs.
Collapse
|
12
|
van Beek DJ, Verschuur AVD, Brosens LAA, Valk GD, Pieterman CRC, Vriens MR. Status of Surveillance and Nonsurgical Therapy for Small Nonfunctioning Pancreatic Neuroendocrine Tumors. Surg Oncol Clin N Am 2023; 32:343-371. [PMID: 36925190 DOI: 10.1016/j.soc.2022.10.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/16/2023]
Abstract
Pancreatic neuroendocrine tumors (PNETs) occur in < 1/100,000 patients and most are nonfunctioning (NF). Approximately 5% occur as part of multiple endocrine neoplasia type 1. Anatomic and molecular imaging have a pivotal role in the diagnosis, staging and active surveillance. Surgery is generally recommended for nonfunctional pancreatic neuroendocrine tumors (NF-PNETs) >2 cm to prevent metastases. For tumors ≤2 cm, active surveillance is a viable alternative. Tumor size and grade are important factors to guide management. Assessment of death domain-associated protein 6/alpha-thalassemia/mental retardation X-linked and alternative lengthening of telomeres are promising novel prognostic markers. This review summarizes the status of surveillance and nonsurgical management for small NF-PNETs, including factors that can guide management.
Collapse
Affiliation(s)
- Dirk-Jan van Beek
- Department of Endocrine Surgical Oncology, University Medical Center Utrecht, Internal Mail Number G.04.228, PO Box 85500, Utrecht 3508 GA, the Netherlands
| | - Anna Vera D Verschuur
- Department of Pathology, University Medical Center Utrecht, Internal Mail Number G02.5.26, PO Box 85500, Utrecht 3508 GA, the Netherlands. https://twitter.com/annaveraverschu
| | - Lodewijk A A Brosens
- Department of Pathology, University Medical Center Utrecht, Internal Mail Number G4.02.06, PO Box 85500, Utrecht 3508 GA, the Netherlands
| | - Gerlof D Valk
- Department of Endocrine Oncology, University Medical Center Utrecht, Internal Mail Number Q.05.4.300, PO Box 85500, Utrecht 3508 GA, the Netherlands
| | - Carolina R C Pieterman
- Department of Endocrine Oncology, University Medical Center Utrecht, Internal Mail Number Q.05.4.300, PO Box 85500, Utrecht 3508 GA, the Netherlands.
| | - Menno R Vriens
- Department of Endocrine Surgical Oncology, University Medical Center Utrecht, Internal Mail Number G.04.228, PO Box 85500, Utrecht 3508 GA, the Netherlands
| |
Collapse
|
13
|
Staal FC, Taghavi M, Hong EK, Tissier R, van Treijen M, Heeres BC, van der Zee D, Tesselaar ME, Beets-Tan RG, Maas M. CT-based radiomics to distinguish progressive from stable neuroendocrine liver metastases treated with somatostatin analogues: an explorative study. Acta Radiol 2023; 64:1062-1070. [PMID: 35702011 DOI: 10.1177/02841851221106598] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND Accurate response evaluation in patients with neuroendocrine liver metastases (NELM) remains a challenge. Radiomics has shown promising results regarding response assessment. PURPOSE To differentiate progressive (PD) from stable disease (SD) with radiomics in patients with NELM undergoing somatostatin analogue (SSA) treatment. MATERIAL AND METHODS A total of 46 patients with histologically confirmed gastroenteropancreatic neuroendocrine tumors (GEP-NET) with ≥1 NELM and ≥2 computed tomography (CT) scans were included. Response was assessed with Response Evaluation Criteria in Solid Tumors (RECIST1.1). Hepatic target lesions were manually delineated and analyzed with radiomics. Radiomics features were extracted from each NELM on both arterial-phase (AP) and portal-venous-phase (PVP) CT. Multiple instance learning with regularized logistic regression via LASSO penalization (with threefold cross-validation) was used to classify response. Three models were computed: (i) AP model; (ii) PVP model; and (iii) AP + PVP model for a lesion-based and patient-based outcome. Next, clinical features were added to each model. RESULTS In total, 19 (40%) patients had PD. Median follow-up was 13 months (range 1-50 months). Radiomics models could not accurately classify response (area under the curve 0.44-0.60). Adding clinical variables to the radiomics models did not significantly improve the performance of any model. CONCLUSION Radiomics features were not able to accurately classify response of NELM on surveillance CT scans during SSA treatment.
Collapse
Affiliation(s)
- Femke Cr Staal
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, 5211Maastricht University Medical Centre, Maastricht, The Netherlands
- Center for Neuroendocrine Tumors, ENETS Center of Excellence, 1228Netherlands Cancer Institute Amsterdam/University Medical Center Utrecht, Utrecht, The Netherlands
| | - M Taghavi
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, 5211Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Eun K Hong
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, 5211Maastricht University Medical Centre, Maastricht, The Netherlands
- Department of Radiology, 26725Seoul National University Hospital, Seoul, Republic of Korea
| | - Renaud Tissier
- Biostatistics Center, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Mark van Treijen
- Center for Neuroendocrine Tumors, ENETS Center of Excellence, 1228Netherlands Cancer Institute Amsterdam/University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Endocrine Oncology, 8124University Medical Centre Utrecht, Utrecht, The Netherlands
| | - Birthe C Heeres
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | | | - Margot Et Tesselaar
- Center for Neuroendocrine Tumors, ENETS Center of Excellence, 1228Netherlands Cancer Institute Amsterdam/University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Medical Oncology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Regina Gh Beets-Tan
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, 5211Maastricht University Medical Centre, Maastricht, The Netherlands
- Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Monique Maas
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
| |
Collapse
|
14
|
Feuerecker B, Heimer MM, Geyer T, Fabritius MP, Gu S, Schachtner B, Beyer L, Ricke J, Gatidis S, Ingrisch M, Cyran CC. Artificial Intelligence in Oncological Hybrid Imaging. ROFO-FORTSCHR RONTG 2023; 195:105-114. [PMID: 36170852 DOI: 10.1055/a-1909-7013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
BACKGROUND Artificial intelligence (AI) applications have become increasingly relevant across a broad spectrum of settings in medical imaging. Due to the large amount of imaging data that is generated in oncological hybrid imaging, AI applications are desirable for lesion detection and characterization in primary staging, therapy monitoring, and recurrence detection. Given the rapid developments in machine learning (ML) and deep learning (DL) methods, the role of AI will have significant impact on the imaging workflow and will eventually improve clinical decision making and outcomes. METHODS AND RESULTS The first part of this narrative review discusses current research with an introduction to artificial intelligence in oncological hybrid imaging and key concepts in data science. The second part reviews relevant examples with a focus on applications in oncology as well as discussion of challenges and current limitations. CONCLUSION AI applications have the potential to leverage the diagnostic data stream with high efficiency and depth to facilitate automated lesion detection, characterization, and therapy monitoring to ultimately improve quality and efficiency throughout the medical imaging workflow. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based therapy guidance in oncology. However, significant challenges remain regarding application development, benchmarking, and clinical implementation. KEY POINTS · Hybrid imaging generates a large amount of multimodality medical imaging data with high complexity and depth.. · Advanced tools are required to enable fast and cost-efficient processing along the whole radiology value chain.. · AI applications promise to facilitate the assessment of oncological disease in hybrid imaging with high quality and efficiency for lesion detection, characterization, and response assessment. The goal is to generate reproducible, structured, quantitative diagnostic data for evidence-based oncological therapy guidance.. · Selected applications in three oncological entities (lung, prostate, and neuroendocrine tumors) demonstrate how AI algorithms may impact imaging-based tasks in hybrid imaging and potentially guide clinical decision making.. CITATION FORMAT · Feuerecker B, Heimer M, Geyer T et al. Artificial Intelligence in Oncological Hybrid Imaging. Fortschr Röntgenstr 2023; 195: 105 - 114.
Collapse
Affiliation(s)
- Benedikt Feuerecker
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany.,German Cancer Research Center (DKFZ), Partner site Munich, DKTK German Cancer Consortium, Munich, Germany
| | - Maurice M Heimer
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | - Thomas Geyer
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | | | - Sijing Gu
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | | | - Leonie Beyer
- Department of Nuclear Medicine, University Hospital, LMU Munich, Munich, Germany
| | - Jens Ricke
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | - Sergios Gatidis
- Department of Radiology, University Hospital Tübingen, Tübingen, Germany.,MPI, Max Planck Institute for Intelligent Systems, Tübingen, Germany
| | - Michael Ingrisch
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| | - Clemens C Cyran
- Department of Radiology, University Hospital, LMU Munich, Munich, Germany
| |
Collapse
|
15
|
Meng J, Luo Z, Chen Z, Zhou J, Chen Z, Lu B, Zhang M, Wang Y, Yuan C, Shen X, Huang Q, Zhang Z, Ye Z, Cao Q, Zhou Z, Xu Y, Mao R, Chen M, Sun C, Li Z, Feng ST, Meng X, Huang B, Li X. Intestinal fibrosis classification in patients with Crohn's disease using CT enterography-based deep learning: comparisons with radiomics and radiologists. Eur Radiol 2022; 32:8692-8705. [PMID: 35616733 DOI: 10.1007/s00330-022-08842-z] [Citation(s) in RCA: 30] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 04/13/2022] [Accepted: 04/25/2022] [Indexed: 12/27/2022]
Abstract
OBJECTIVES Accurate evaluation of bowel fibrosis in patients with Crohn's disease (CD) remains challenging. Computed tomography enterography (CTE)-based radiomics enables the assessment of bowel fibrosis; however, it has some deficiencies. We aimed to develop and validate a CTE-based deep learning model (DLM) for characterizing bowel fibrosis more efficiently. METHODS We enrolled 312 bowel segments of 235 CD patients (median age, 33 years old) from three hospitals in this retrospective study. A training cohort and test cohort 1 were recruited from center 1, while test cohort 2 from centers 2 and 3. All patients performed CTE within 3 months before surgery. The histological fibrosis was semi-quantitatively assessed. A DLM was constructed in the training cohort based on a 3D deep convolutional neural network with 10-fold cross-validation, and external independent validation was conducted on the test cohorts. The radiomics model (RM) was developed with 4 selected radiomics features extracted from CTE images by using logistic regression. The evaluation of CTE images was performed by two radiologists. DeLong's test and a non-inferiority test were used to compare the models' performance. RESULTS DLM distinguished none-mild from moderate-severe bowel fibrosis with an area under the receiver operator characteristic curve (AUC) of 0.828 in the training cohort and 0.811, 0.808, and 0.839 in the total test cohort, test cohorts 1 and 2, respectively. In the total test cohort, DLM achieved better performance than two radiologists (*1 AUC = 0.579, *2 AUC = 0.646; both p < 0.05) and was not inferior to RM (AUC = 0.813, p < 0.05). The total processing time for DLM was much shorter than that of RM (p < 0.001). CONCLUSION DLM is better than radiologists in diagnosing intestinal fibrosis on CTE in patients with CD and not inferior to RM; furthermore, it is more time-saving compared to RM. KEY POINTS • Question Could computed tomography enterography (CTE)-based deep learning model (DLM) accurately distinguish intestinal fibrosis severity in patients with Crohn's disease (CD)? • Findings In this cross-sectional study that included 235 patients with CD, DLM achieved better performance than that of two radiologists' interpretation and was not inferior to RM with significant differences and much shorter processing time. • Meaning This DLM may accurately distinguish the degree of intestinal fibrosis in patients with CD and guide gastroenterologists to formulate individualized treatment strategies for those with bowel strictures.
Collapse
Affiliation(s)
- Jixin Meng
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Zixin Luo
- Medical AI Lab, School of Biomedical Engineering, Health Science Center, Shenzhen University, Block A2, Lihu Campus of Shenzhen University, 1066 Xueyuan Avenue, Shenzhen, 518000, People's Republic of China
| | - Zhihui Chen
- Department of Gastrointestinal and Pancreatic Surgery, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510080, People's Republic of China
| | - Jie Zhou
- Department of Radiology, The Sixth Affiliated Hospital, Sun Yat-sen University, Yuancun Er Heng Road, NO.26, Guangzhou, 510655, People's Republic of China
| | - Zhao Chen
- Department of Medical Imaging Center, Nan Fang Hospital, Southern Medical University, 1838 Guangzhou Avenue North, Guangzhou, 510515, People's Republic of China
| | - Baolan Lu
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Mengchen Zhang
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Yangdi Wang
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Chenglang Yuan
- Medical AI Lab, School of Biomedical Engineering, Health Science Center, Shenzhen University, Block A2, Lihu Campus of Shenzhen University, 1066 Xueyuan Avenue, Shenzhen, 518000, People's Republic of China
| | - Xiaodi Shen
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Qinqin Huang
- Medical AI Lab, School of Biomedical Engineering, Health Science Center, Shenzhen University, Block A2, Lihu Campus of Shenzhen University, 1066 Xueyuan Avenue, Shenzhen, 518000, People's Republic of China
| | - Zhuya Zhang
- Medical AI Lab, School of Biomedical Engineering, Health Science Center, Shenzhen University, Block A2, Lihu Campus of Shenzhen University, 1066 Xueyuan Avenue, Shenzhen, 518000, People's Republic of China
| | - Ziyin Ye
- Department of Pathology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Qinghua Cao
- Department of Pathology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Zhiyang Zhou
- Department of Radiology, The Sixth Affiliated Hospital, Sun Yat-sen University, Yuancun Er Heng Road, NO.26, Guangzhou, 510655, People's Republic of China
| | - Yikai Xu
- Department of Medical Imaging Center, Nan Fang Hospital, Southern Medical University, 1838 Guangzhou Avenue North, Guangzhou, 510515, People's Republic of China
| | - Ren Mao
- Department of Gastroenterology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
- Department of Gastroenterology, Hepatology and Nutrition, Digestive Diseases and Surgery Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Minhu Chen
- Department of Gastroenterology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Canhui Sun
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Ziping Li
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Shi-Ting Feng
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China
| | - Xiaochun Meng
- Department of Radiology, The Sixth Affiliated Hospital, Sun Yat-sen University, Yuancun Er Heng Road, NO.26, Guangzhou, 510655, People's Republic of China
| | - Bingsheng Huang
- Medical AI Lab, School of Biomedical Engineering, Health Science Center, Shenzhen University, Block A2, Lihu Campus of Shenzhen University, 1066 Xueyuan Avenue, Shenzhen, 518000, People's Republic of China.
| | - Xuehua Li
- Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, 58 Zhongshan II Road, Guangzhou, 510080, People's Republic of China.
| |
Collapse
|
16
|
Jan Z, El Assadi F, Abd-alrazaq A, Jithesh PV. Artificial Intelligence for the Prediction and Early Diagnosis of Pancreatic Cancer: Scoping Review (Preprint).. [DOI: 10.2196/preprints.44248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
BACKGROUND
Pancreatic cancer is the 12th most common cancer worldwide, with an overall survival rate of 4.9%. Early diagnosis of pancreatic cancer is essential for timely treatment and survival. Artificial intelligence (AI) provides advanced models and algorithms for better diagnosis of pancreatic cancer.
OBJECTIVE
This study aims to explore AI models used for the prediction and early diagnosis of pancreatic cancers as reported in the literature.
METHODS
A scoping review was conducted and reported in line with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. PubMed, Google Scholar, Science Direct, BioRXiv, and MedRxiv were explored to identify relevant articles. Study selection and data extraction were independently conducted by 2 reviewers. Data extracted from the included studies were synthesized narratively.
RESULTS
Of the 1185 publications, 30 studies were included in the scoping review. The included articles reported the use of AI for 6 different purposes. Of these included articles, AI techniques were mostly used for the diagnosis of pancreatic cancer (14/30, 47%). Radiological images (14/30, 47%) were the most frequently used data in the included articles. Most of the included articles used data sets with a size of <1000 samples (11/30, 37%). Deep learning models were the most prominent branch of AI used for pancreatic cancer diagnosis in the studies, and the convolutional neural network was the most used algorithm (18/30, 60%). Six validation approaches were used in the included studies, of which the most frequently used approaches were k-fold cross-validation (10/30, 33%) and external validation (10/30, 33%). A higher level of accuracy (99%) was found in studies that used support vector machine, decision trees, and k-means clustering algorithms.
CONCLUSIONS
This review presents an overview of studies based on AI models and algorithms used to predict and diagnose pancreatic cancer patients. AI is expected to play a vital role in advancing pancreatic cancer prediction and diagnosis. Further research is required to provide data that support clinical decisions in health care.
Collapse
|
17
|
Development and validation of a combined nomogram model based on deep learning contrast-enhanced ultrasound and clinical factors to predict preoperative aggressiveness in pancreatic neuroendocrine neoplasms. Eur Radiol 2022; 32:7965-7975. [PMID: 35389050 DOI: 10.1007/s00330-022-08703-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Revised: 02/21/2022] [Accepted: 02/25/2022] [Indexed: 01/03/2023]
Abstract
OBJECTIVES This study aimed to develop and validate a combined nomogram model based on deep learning (DL) contrast-enhanced ultrasound (CEUS) and clinical factors to preoperatively predict the aggressiveness of pancreatic neuroendocrine neoplasms (PNENs). METHODS In this retrospective study, consecutive patients with histologically proven PNENs underwent CEUS examination at the initial work-up between January 2010 and October 2020. Patients were randomly allocated to the training and test sets. Typical sonographic and enhanced images of PNENs were selected to fine-tune the SE-ResNeXt-50 network. A combined nomogram model was developed by incorporating the DL predictive probability with clinical factors using multivariate logistic regression analysis. The utility of the proposed model was evaluated using receiver operator characteristic, calibration, and decision curve analysis. RESULTS A total of 104 patients were evaluated, including 80 (mean age ± standard deviation, 47 years ± 12; 56 males) in the training set and 24 (50 years ± 12; 14 males) in the test set. The DL model displayed effective image recognition with an AUC of 0.81 (95%CI: 0.62-1.00) in the test set. The combined nomogram model that incorporated independent clinical risk factors, such as tumor size, arterial enhancement level, and DL predictive probability, showed strong discrimination, with an AUC of 0.85 (95%CI: 0.69-1.00) in the test set with good calibration. Decision curve analysis verified the clinical usefulness of the combined nomogram. CONCLUSIONS The combined nomogram model could serve as a preoperative, noninvasive, and precise evaluation tool to differentiate aggressive and non-aggressive PNENs. KEY POINTS • Tumor size (odds ratio [OR], 1.58; p = 0.02), arterial enhancement level (OR, 0.04; p = 0.008), and deep learning predictive probability (OR, 288.46; p < 0.001) independently predicted aggressiveness of pancreatic neuroendocrine neoplasms preoperatively. • The combined model predicted aggressiveness better than the clinical model (AUC: 0.97 vs. 0.87, p = 0.009), achieving AUC values of 0.97 and 0.85 in the training set and the test set, respectively.
Collapse
|
18
|
Tian G, Xu D, He Y, Chai W, Deng Z, Cheng C, Jin X, Wei G, Zhao Q, Jiang T. Deep learning for real-time auxiliary diagnosis of pancreatic cancer in endoscopic ultrasonography. Front Oncol 2022; 12:973652. [PMID: 36276094 PMCID: PMC9586286 DOI: 10.3389/fonc.2022.973652] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Accepted: 09/21/2022] [Indexed: 11/13/2022] Open
Abstract
In recent year, many deep learning have been playing an important role in the detection of cancers. This study aimed to real-timely differentiate a pancreatic cancer (PC) or a non-pancreatic cancer (NPC) lesion via endoscopic ultrasonography (EUS) image. A total of 1213 EUS images from 157 patients (99 male, 58 female) with pancreatic disease were used for training, validation and test groups. Before model training, regions of interest (ROIs) were manually drawn to mark the PC and NPC lesions using Labelimage software. Yolov5m was used as the algorithm model to automatically distinguish the presence of pancreatic lesion. After training the model based on EUS images using YOLOv5, the parameters achieved convergence within 300 rounds (GIoU Loss: 0.01532, Objectness Loss: 0.01247, precision: 0.713 and recall: 0.825). For the validation group, the mAP0.5 was 0.831, and mAP@.5:.95 was 0.512. In addition, the receiver operating characteristic (ROC) curve analysis showed this model seemed to have a trend of more AUC of 0.85 (0.665 to 0.956) than the area under the curve (AUC) of 0.838 (0.65 to 0.949) generated by physicians using EUS detection without puncture, although pairwise comparison of ROC curves showed that the AUC between the two groups was not significant (z= 0.15, p = 0.8804). This study suggested that the YOLOv5m would generate attractive results and allow for the real-time decision support for distinction of a PC or a NPC lesion.
Collapse
Affiliation(s)
- Guo Tian
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
- Key Laboratory of Pulsed Power Translational Medicine of Zhejiang Province, Hangzhou, China
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Danxia Xu
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
- Key Laboratory of Pulsed Power Translational Medicine of Zhejiang Province, Hangzhou, China
| | - Yinghua He
- Department of Clinical Pharmacy, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
- Zhejiang Provincial Key Laboratory for Drug Evaluation and Clinical Research, Hangzhou, China
| | - Weilu Chai
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
- Key Laboratory of Pulsed Power Translational Medicine of Zhejiang Province, Hangzhou, China
| | - Zhuang Deng
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Chao Cheng
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Xinyan Jin
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Guyue Wei
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Qiyu Zhao
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
- Key Laboratory of Pulsed Power Translational Medicine of Zhejiang Province, Hangzhou, China
| | - Tianan Jiang
- Department of Ultrasound Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
- Key Laboratory of Pulsed Power Translational Medicine of Zhejiang Province, Hangzhou, China
- Zhejiang University Cancer Center, Hangzhou, China
- *Correspondence: Tianan Jiang,
| |
Collapse
|
19
|
Lu Q, Zhou C, Zhang H, Liang L, Zhang Q, Chen X, Xu X, Zhao G, Ma J, Gao Y, Peng Q, Li S. A multimodal model fusing multiphase contrast-enhanced CT and clinical characteristics for predicting lymph node metastases of pancreatic cancer. Phys Med Biol 2022; 67. [PMID: 35905729 DOI: 10.1088/1361-6560/ac858e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Accepted: 07/29/2022] [Indexed: 11/12/2022]
Abstract
Abstract
Objective. To develop a multimodal model that combines multiphase contrast-enhanced computed tomography (CECT) imaging and clinical characteristics, including experts’ experience, to preoperatively predict lymph node metastasis (LNM) in pancreatic cancer patients. Methods. We proposed a new classifier fusion strategy (CFS) based on a new evidential reasoning (ER) rule (CFS-nER) by combining nomogram weights into a previous ER rule-based CFS. Three kernelled support tensor machine-based classifiers with plain, arterial, and venous phases of CECT as the inputs, respectively, were constructed. They were then fused based on the CFS-nER to construct a fusion model of multiphase CECT. The clinical characteristics were analyzed by univariate and multivariable logistic regression to screen risk factors, which were used to construct correspondent risk factor-based classifiers. Finally, the fusion model of the three phases of CECT and each risk factor-based classifier were fused further to construct the multimodal model based on our CFS-nER, named MMM-nER. This study consisted of 186 patients diagnosed with pancreatic cancer from four clinical centers in China, 88 (47.31%) of whom had LNM. Results. The fusion model of the three phases of CECT performed better overall than single and two-phase fusion models; this implies that the three considered phases of CECT were supplementary and complemented one another. The MMM-nER further improved the predictive performance, which implies that our MMM-nER can complement the supplementary information between CECT and clinical characteristics. The MMM-nER had better predictive performance than based on previous classifier fusion strategies, which presents the advantage of our CFS-nER. Conclusion. We proposed a new CFS-nER, based on which the fusion model of the three phases of CECT and MMM-nER were constructed and performed better than all compared methods. MMM-nER achieved an encouraging performance, implying that it can assist clinicians in noninvasively and preoperatively evaluating the lymph node status of pancreatic cancer.
Collapse
|
20
|
Staal FCR, Aalbersberg EA, van der Velden D, Wilthagen EA, Tesselaar MET, Beets-Tan RGH, Maas M. GEP-NET radiomics: a systematic review and radiomics quality score assessment. Eur Radiol 2022; 32:7278-7294. [PMID: 35882634 DOI: 10.1007/s00330-022-08996-w] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 05/25/2022] [Accepted: 06/26/2022] [Indexed: 11/04/2022]
Abstract
OBJECTIVE The number of radiomics studies in gastroenteropancreatic neuroendocrine tumours (GEP-NETs) is rapidly increasing. This systematic review aims to provide an overview of the available evidence of radiomics for clinical outcome measures in GEP-NETs, to understand which applications hold the most promise and which areas lack evidence. METHODS PubMed, Embase, and Wiley/Cochrane Library databases were searched and a forward and backward reference check of the identified studies was executed. Inclusion criteria were (1) patients with GEP-NETs and (2) radiomics analysis on CT, MRI or PET. Two reviewers independently agreed on eligibility and assessed methodological quality with the radiomics quality score (RQS) and extracted outcome data. RESULTS In total, 1364 unique studies were identified and 45 were included for analysis. Most studies focused on GEP-NET grade and differential diagnosis of GEP-NETs from other neoplasms, while only a minority analysed treatment response or long-term outcomes. Several studies were able to predict tumour grade or to differentiate GEP-NETs from other lesions with a good performance (AUCs 0.74-0.96 and AUCs 0.80-0.99, respectively). Only one study developed a model to predict recurrence in pancreas NETs (AUC 0.77). The included studies reached a mean RQS of 18%. CONCLUSION Although radiomics for GEP-NETs is still a relatively new area, some promising models have been developed. Future research should focus on developing robust models for clinically relevant aims such as prediction of response or long-term outcome in GEP-NET, since evidence for these aims is still scarce. KEY POINTS • The majority of radiomics studies in gastroenteropancreatic neuroendocrine tumours is of low quality. • Most evidence for radiomics is available for the identification of tumour grade or differentiation of gastroenteropancreatic neuroendocrine tumours from other neoplasms. • Radiomics for the prediction of response or long-term outcome in gastroenteropancreatic neuroendocrine tumours warrants further research.
Collapse
Affiliation(s)
- Femke C R Staal
- Department of Radiology, The Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands.,GROW School for Oncology and Reproduction, Maastricht University Medical Centre, Universiteitssingel 40, 6229 ER, Maastricht, The Netherlands.,The Netherlands Cancer Institute/University Medical Center Utrecht Center for Neuroendocrine Tumors, ENETS Center of Excellence, Amsterdam/Utrecht, The Netherlands
| | - Else A Aalbersberg
- The Netherlands Cancer Institute/University Medical Center Utrecht Center for Neuroendocrine Tumors, ENETS Center of Excellence, Amsterdam/Utrecht, The Netherlands.,Department of Nuclear Medicine, The Netherlands Cancer Institute Amsterdam, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
| | - Daphne van der Velden
- Department of Radiology, The Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
| | - Erica A Wilthagen
- Scientific Information Service, The Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
| | - Margot E T Tesselaar
- The Netherlands Cancer Institute/University Medical Center Utrecht Center for Neuroendocrine Tumors, ENETS Center of Excellence, Amsterdam/Utrecht, The Netherlands.,Department of Medical Oncology, The Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
| | - Regina G H Beets-Tan
- Department of Radiology, The Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands.,GROW School for Oncology and Reproduction, Maastricht University Medical Centre, Universiteitssingel 40, 6229 ER, Maastricht, The Netherlands.,Faculty of Health Sciences, University of Southern Denmark, J. B. Winsløws Vej 19, 3, 5000, Odense, Denmark
| | - Monique Maas
- Department of Radiology, The Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands.
| |
Collapse
|
21
|
Ramachandran A, Madhusudhan KS. Advances in the imaging of gastroenteropancreatic neuroendocrine neoplasms. World J Gastroenterol 2022; 28:3008-3026. [PMID: 36051339 PMCID: PMC9331531 DOI: 10.3748/wjg.v28.i26.3008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 11/30/2021] [Accepted: 06/20/2022] [Indexed: 02/06/2023] Open
Abstract
Gastroenteropancreatic neuroendocrine neoplasms comprise a heterogeneous group of tumors that differ in their pathogenesis, hormonal syndromes produced, biological behavior and consequently, in their requirement for and/or response to specific chemotherapeutic agents and molecular targeted therapies. Various imaging techniques are available for functional and morphological evaluation of these neoplasms and the selection of investigations performed in each patient should be customized to the clinical question. Also, with the increased availability of cross sectional imaging, these neoplasms are increasingly being detected incidentally in routine radiology practice. This article is a review of the various imaging modalities currently used in the evaluation of neuroendocrine neoplasms, along with a discussion of the role of advanced imaging techniques and a glimpse into the newer imaging horizons, mostly in the research stage.
Collapse
Affiliation(s)
- Anupama Ramachandran
- Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi 110029, India
| | - Kumble Seetharama Madhusudhan
- Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi 110029, India
| |
Collapse
|
22
|
Pantelis AG, Panagopoulou PA, Lapatsanis DP. Artificial Intelligence and Machine Learning in the Diagnosis and Management of Gastroenteropancreatic Neuroendocrine Neoplasms—A Scoping Review. Diagnostics (Basel) 2022; 12:diagnostics12040874. [PMID: 35453922 PMCID: PMC9027316 DOI: 10.3390/diagnostics12040874] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Revised: 03/27/2022] [Accepted: 03/29/2022] [Indexed: 12/21/2022] Open
Abstract
Neuroendocrine neoplasms (NENs) and tumors (NETs) are rare neoplasms that may affect any part of the gastrointestinal system. In this scoping review, we attempt to map existing evidence on the role of artificial intelligence, machine learning and deep learning in the diagnosis and management of NENs of the gastrointestinal system. After implementation of inclusion and exclusion criteria, we retrieved 44 studies with 53 outcome analyses. We then classified the papers according to the type of studied NET (26 Pan-NETs, 59.1%; 3 metastatic liver NETs (6.8%), 2 small intestinal NETs, 4.5%; colorectal, rectal, non-specified gastroenteropancreatic and non-specified gastrointestinal NETs had from 1 study each, 2.3%). The most frequently used AI algorithms were Supporting Vector Classification/Machine (14 analyses, 29.8%), Convolutional Neural Network and Random Forest (10 analyses each, 21.3%), Random Forest (9 analyses, 19.1%), Logistic Regression (8 analyses, 17.0%), and Decision Tree (6 analyses, 12.8%). There was high heterogeneity on the description of the prediction model, structure of datasets, and performance metrics, whereas the majority of studies did not report any external validation set. Future studies should aim at incorporating a uniform structure in accordance with existing guidelines for purposes of reproducibility and research quality, which are prerequisites for integration into clinical practice.
Collapse
Affiliation(s)
- Athanasios G. Pantelis
- 4th Department of Surgery, Evaggelismos General Hospital of Athens, 10676 Athens, Greece;
- Correspondence:
| | | | - Dimitris P. Lapatsanis
- 4th Department of Surgery, Evaggelismos General Hospital of Athens, 10676 Athens, Greece;
| |
Collapse
|
23
|
Preuss K, Thach N, Liang X, Baine M, Chen J, Zhang C, Du H, Yu H, Lin C, Hollingsworth MA, Zheng D. Using Quantitative Imaging for Personalized Medicine in Pancreatic Cancer: A Review of Radiomics and Deep Learning Applications. Cancers (Basel) 2022; 14:cancers14071654. [PMID: 35406426 PMCID: PMC8997008 DOI: 10.3390/cancers14071654] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2022] [Revised: 03/16/2022] [Accepted: 03/18/2022] [Indexed: 12/12/2022] Open
Abstract
Simple Summary With a five-year survival rate of only 3% for the majority of patients, pancreatic cancer is a global healthcare challenge. Radiomics and deep learning, two novel quantitative imaging methods that treat medical images as minable data instead of just pictures, have shown promise in advancing personalized management of pancreatic cancer through diagnosing precursor diseases, early detection, accurate diagnosis, and treatment personalization. Radiomics and deep learning methods aim to collect hidden information in medical images that is missed by conventional radiology practices through expanding the data search and comparing information across different patients. Both methods have been studied and applied in pancreatic cancer. In this review, we focus on the current progress of these two methods in pancreatic cancer and provide a comprehensive narrative review on the topic. With better regulation, enhanced workflow, and larger prospective patient datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through personalized precision medicine. Abstract As the most lethal major cancer, pancreatic cancer is a global healthcare challenge. Personalized medicine utilizing cutting-edge multi-omics data holds potential for major breakthroughs in tackling this critical problem. Radiomics and deep learning, two trendy quantitative imaging methods that take advantage of data science and modern medical imaging, have shown increasing promise in advancing the precision management of pancreatic cancer via diagnosing of precursor diseases, early detection, accurate diagnosis, and treatment personalization and optimization. Radiomics employs manually-crafted features, while deep learning applies computer-generated automatic features. These two methods aim to mine hidden information in medical images that is missed by conventional radiology and gain insights by systematically comparing the quantitative image information across different patients in order to characterize unique imaging phenotypes. Both methods have been studied and applied in various pancreatic cancer clinical applications. In this review, we begin with an introduction to the clinical problems and the technology. After providing technical overviews of the two methods, this review focuses on the current progress of clinical applications in precancerous lesion diagnosis, pancreatic cancer detection and diagnosis, prognosis prediction, treatment stratification, and radiogenomics. The limitations of current studies and methods are discussed, along with future directions. With better standardization and optimization of the workflow from image acquisition to analysis and with larger and especially prospective high-quality datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through big data-based high-precision personalization.
Collapse
Affiliation(s)
- Kiersten Preuss
- Department of Radiation Oncology, University of Nebraska Medical Center, Omaha, NE 68198, USA; (K.P.); (N.T.); (M.B.); (J.C.); (C.L.)
- Department of Nutrition and Health Sciences, University of Nebraska Lincoln, Lincoln, NE 68588, USA
| | - Nate Thach
- Department of Radiation Oncology, University of Nebraska Medical Center, Omaha, NE 68198, USA; (K.P.); (N.T.); (M.B.); (J.C.); (C.L.)
- Department of Computer Science, University of Nebraska Lincoln, Lincoln, NE 68588, USA;
| | - Xiaoying Liang
- Department of Radiation Oncology, Mayo Clinic, Jacksonville, FL 32224, USA;
| | - Michael Baine
- Department of Radiation Oncology, University of Nebraska Medical Center, Omaha, NE 68198, USA; (K.P.); (N.T.); (M.B.); (J.C.); (C.L.)
| | - Justin Chen
- Department of Radiation Oncology, University of Nebraska Medical Center, Omaha, NE 68198, USA; (K.P.); (N.T.); (M.B.); (J.C.); (C.L.)
- Naperville North High School, Naperville, IL 60563, USA
| | - Chi Zhang
- School of Biological Sciences, University of Nebraska Lincoln, Lincoln, NE 68588, USA;
| | - Huijing Du
- Department of Mathematics, University of Nebraska Lincoln, Lincoln, NE 68588, USA;
| | - Hongfeng Yu
- Department of Computer Science, University of Nebraska Lincoln, Lincoln, NE 68588, USA;
| | - Chi Lin
- Department of Radiation Oncology, University of Nebraska Medical Center, Omaha, NE 68198, USA; (K.P.); (N.T.); (M.B.); (J.C.); (C.L.)
| | - Michael A. Hollingsworth
- Eppley Institute for Research in Cancer, University of Nebraska Medical Center, Omaha, NE 68198, USA;
| | - Dandan Zheng
- Department of Radiation Oncology, University of Nebraska Medical Center, Omaha, NE 68198, USA; (K.P.); (N.T.); (M.B.); (J.C.); (C.L.)
- Department of Radiation Oncology, University of Rochester, Rochester, NY 14626, USA
- Correspondence: ; Tel.: +1-(585)-276-3255
| |
Collapse
|
24
|
Abstract
Artificial intelligence (AI) has illuminated a clear path towards an evolving health-care system replete with enhanced precision and computing capabilities. Medical imaging analysis can be strengthened by machine learning as the multidimensional data generated by imaging naturally lends itself to hierarchical classification. In this Review, we describe the role of machine intelligence in image-based endocrine cancer diagnostics. We first provide a brief overview of AI and consider its intuitive incorporation into the clinical workflow. We then discuss how AI can be applied for the characterization of adrenal, pancreatic, pituitary and thyroid masses in order to support clinicians in their diagnostic interpretations. This Review also puts forth a number of key evaluation criteria for machine learning in medicine that physicians can use in their appraisals of these algorithms. We identify mitigation strategies to address ongoing challenges around data availability and model interpretability in the context of endocrine cancer diagnosis. Finally, we delve into frontiers in systems integration for AI, discussing automated pipelines and evolving computing platforms that leverage distributed, decentralized and quantum techniques.
Collapse
Affiliation(s)
| | - Ihab R Kamel
- Department of Imaging & Imaging Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Harrison X Bai
- Department of Imaging & Imaging Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| |
Collapse
|
25
|
Althobaiti MM, Almulihi A, Ashour AA, Mansour RF, Gupta D. Design of Optimal Deep Learning-Based Pancreatic Tumor and Nontumor Classification Model Using Computed Tomography Scans. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:2872461. [PMID: 35070232 PMCID: PMC8769827 DOI: 10.1155/2022/2872461] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Revised: 12/10/2021] [Accepted: 12/17/2021] [Indexed: 12/18/2022]
Abstract
Pancreatic tumor is a lethal kind of tumor and its prediction is really poor in the current scenario. Automated pancreatic tumor classification using computer-aided diagnosis (CAD) model is necessary to track, predict, and classify the existence of pancreatic tumors. Artificial intelligence (AI) can offer extensive diagnostic expertise and accurate interventional image interpretation. With this motivation, this study designs an optimal deep learning based pancreatic tumor and nontumor classification (ODL-PTNTC) model using CT images. The goal of the ODL-PTNTC technique is to detect and classify the existence of pancreatic tumors and nontumor. The proposed ODL-PTNTC technique includes adaptive window filtering (AWF) technique to remove noise existing in it. In addition, sailfish optimizer based Kapur's Thresholding (SFO-KT) technique is employed for image segmentation process. Moreover, feature extraction using Capsule Network (CapsNet) is derived to generate a set of feature vectors. Furthermore, Political Optimizer (PO) with Cascade Forward Neural Network (CFNN) is employed for classification purposes. In order to validate the enhanced performance of the ODL-PTNTC technique, a series of simulations take place and the results are investigated under several aspects. A comprehensive comparative results analysis stated the promising performance of the ODL-PTNTC technique over the recent approaches.
Collapse
Affiliation(s)
- Maha M. Althobaiti
- Department of Computer Science College of Computing and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| | - Ahmed Almulihi
- Department of Computer Science College of Computing and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| | - Amal Adnan Ashour
- Department of Oral & Maxillofacial Surgery and Diagnostic Sciences Faculty of Dentistry, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| | - Romany F. Mansour
- Department of Mathematics Faculty of Science, New Valley University, El-Kharga 72511, Egypt
| | - Deepak Gupta
- Department of Computer Science & Engineering, Maharaja Agrasen Institute of Technology, Delhi, India
| |
Collapse
|
26
|
Kröner PT, Engels MML, Glicksberg BS, Johnson KW, Mzaik O, van Hooft JE, Wallace MB, El-Serag HB, Krittanawong C. Artificial intelligence in gastroenterology: A state-of-the-art review. World J Gastroenterol 2021; 27:6794-6824. [PMID: 34790008 PMCID: PMC8567482 DOI: 10.3748/wjg.v27.i40.6794] [Citation(s) in RCA: 52] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 06/15/2021] [Accepted: 09/16/2021] [Indexed: 02/06/2023] Open
Abstract
The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.
Collapse
Affiliation(s)
- Paul T Kröner
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Megan ML Engels
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Cancer Center Amsterdam, Department of Gastroenterology and Hepatology, Amsterdam UMC, Location AMC, Amsterdam 1105, The Netherlands
| | - Benjamin S Glicksberg
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Kipp W Johnson
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Obaie Mzaik
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Jeanin E van Hooft
- Department of Gastroenterology and Hepatology, Leiden University Medical Center, Amsterdam 2300, The Netherlands
| | - Michael B Wallace
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Division of Gastroenterology and Hepatology, Sheikh Shakhbout Medical City, Abu Dhabi 11001, United Arab Emirates
| | - Hashem B El-Serag
- Section of Gastroenterology and Hepatology, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
| | - Chayakrit Krittanawong
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Cardiology, Michael E. DeBakey VA Medical Center, Houston, TX 77030, United States
| |
Collapse
|
27
|
Lee S, Summers RM. Clinical Artificial Intelligence Applications in Radiology: Chest and Abdomen. Radiol Clin North Am 2021; 59:987-1002. [PMID: 34689882 DOI: 10.1016/j.rcl.2021.07.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Organ segmentation, chest radiograph classification, and lung and liver nodule detections are some of the popular artificial intelligence (AI) tasks in chest and abdominal radiology due to the wide availability of public datasets. AI algorithms have achieved performance comparable to humans in less time for several organ segmentation tasks, and some lesion detection and classification tasks. This article introduces the current published articles of AI applied to chest and abdominal radiology, including organ segmentation, lesion detection, classification, and predicting prognosis.
Collapse
Affiliation(s)
- Sungwon Lee
- Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center, Building 10, Room 1C224D, 10 Center Drive, Bethesda, MD 20892-1182, USA
| | - Ronald M Summers
- Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center, Building 10, Room 1C224D, 10 Center Drive, Bethesda, MD 20892-1182, USA.
| |
Collapse
|
28
|
Sakamoto T, Goto T, Fujiogi M, Kawarai Lefor A. Machine learning in gastrointestinal surgery. Surg Today 2021; 52:995-1007. [PMID: 34559310 DOI: 10.1007/s00595-021-02380-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2021] [Accepted: 07/03/2021] [Indexed: 12/11/2022]
Abstract
Machine learning (ML) is a collection of algorithms allowing computers to learn directly from data without predetermined equations. It is used widely to analyze "big data". In gastrointestinal surgery, surgeons deal with various data such as clinical parameters, surgical videos, and pathological images, to stratify surgical risk, perform safe surgery and predict patient prognosis. In the current "big data" era, the accelerating accumulation of a large amount of data drives studies using ML algorithms. Three subfields of ML are supervised learning, unsupervised learning, and reinforcement learning. In this review, we summarize applications of ML to surgical practice in the preoperative, intraoperative, and postoperative phases of care. Prediction and stratification using ML is promising; however, the current overarching concern is the availability of ML models. Information systems that can manage "big data" and integrate ML models into electronic health records are essential to incorporate ML into daily practice. ML is fundamental technology to meaningfully process data that exceeds the capacity of the human mind to comprehend. The accelerating accumulation of a large amount of data is changing the nature of surgical practice fundamentally. Artificial intelligence (AI), represented by ML, is being incorporated into daily surgical practice.
Collapse
Affiliation(s)
- Takashi Sakamoto
- Department of Gastroenterological Surgery, Gastroenterological Center, Cancer Institute Hospital, Japanese Foundation for Cancer Research, 3-8-31 Ariake, Koto, Tokyo, 135-8550, Japan. .,Department of Clinical Epidemiology and Health Economics, School of Public Health, The University of Tokyo, Bunkyo-ku, Tokyo, 113-0033, Japan.
| | - Tadahiro Goto
- Department of Clinical Epidemiology and Health Economics, School of Public Health, The University of Tokyo, Bunkyo-ku, Tokyo, 113-0033, Japan.,TXP Medical Co. Ltd, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 114-8485, Japan
| | - Michimasa Fujiogi
- Department of Emergency Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA.,Department of Pediatric Surgery, Graduate School of Medicine, The University of Tokyo, Bunkyo-ku, Tokyo, 113-0033, Japan
| | - Alan Kawarai Lefor
- Department of Surgery, Jichi Medical University, Shimotsuke, Tochigi, 3290498, Japan
| |
Collapse
|
29
|
Huang B, Lin X, Shen J, Chen X, Chen J, Li ZP, Wang M, Yuan C, Diao XF, Luo Y, Feng ST. Accurate and Feasible Deep Learning Based Semi-Automatic Segmentation in CT for Radiomics Analysis in Pancreatic Neuroendocrine Neoplasms. IEEE J Biomed Health Inform 2021; 25:3498-3506. [PMID: 33798088 DOI: 10.1109/jbhi.2021.3070708] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Current clinical practice or radiomics studies of pancreatic neuroendocrine neoplasms (pNENs) require manual delineation of the lesions in computed tomography (CT) images, which is time-consuming and subjective. We used a semi-automatic deep learning (DL) method for segmentation of pNENs and verified its feasibility in radiomics analysis. This retrospective study included two datasets: Dataset 1, contrast-enhanced CT images (CECT) of 80 and 18 patients respectively collected from two centers; and Dataset 2, CECT of 56 and 16 patients respectively from two centers. A DL-based semi-automatic segmentation model was developed and validated with Dataset 1 and Dataset 2, and the segmentation results were used for radiomics analysis from which the performance was compared against that based on manual segmentation. The mean Dice similarity coefficient of the trained segmentation model was 81.8% and 74.8% for external validation with Dataset 1 and Dataset 2 respectively. Four classifiers frequently used in radiomics studies were trained and tested with leave-one-out cross-validation strategy. For pathological grading prediction with Dataset 1, the area under the receiver operating characteristic curve (AUC) with semi-automatic segmentation was up to 0.76 and 0.87 respectively for internal and external validation. For recurrence study with Dataset 2, the AUC with semi-automatic segmentation was up to 0.78. All these AUCs were not statistically significant from the corresponding results based on manual segmentation. Our study showed that DL-based semi-automatic segmentation is accurate and feasible for the radiomics analysis in pNENs.
Collapse
|
30
|
Han X, Yang J, Luo J, Chen P, Zhang Z, Alu A, Xiao Y, Ma X. Application of CT-Based Radiomics in Discriminating Pancreatic Cystadenomas From Pancreatic Neuroendocrine Tumors Using Machine Learning Methods. Front Oncol 2021; 11:606677. [PMID: 34367940 PMCID: PMC8339967 DOI: 10.3389/fonc.2021.606677] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Accepted: 07/05/2021] [Indexed: 02/05/2023] Open
Abstract
Objectives The purpose of this study aimed at investigating the reliability of radiomics features extracted from contrast-enhanced CT in differentiating pancreatic cystadenomas from pancreatic neuroendocrine tumors (PNETs) using machine-learning methods. Methods In this study, a total number of 120 patients, including 66 pancreatic cystadenomas patients and 54 PNETs patients were enrolled. Forty-eight radiomic features were extracted from contrast-enhanced CT images using LIFEx software. Five feature selection methods were adopted to determine the appropriate features for classifiers. Then, nine machine learning classifiers were employed to build predictive models. The performance of the forty-five models was evaluated with area under the curve (AUC), accuracy, sensitivity, specificity, and F1 score in the testing group. Results The predictive models exhibited reliable ability of differentiating pancreatic cystadenomas from PNETs when combined with suitable selection methods. A combination of DC as the selection method and RF as the classifier, as well as Xgboost+RF, demonstrated the best discriminative ability, with the highest AUC of 0.997 in the testing group. Conclusions Radiomics-based machine learning methods might be a noninvasive tool to assist in differentiating pancreatic cystadenomas and PNETs.
Collapse
Affiliation(s)
- Xuejiao Han
- Department of Biotherapy, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
| | - Jing Yang
- State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China.,Melanoma and Sarcoma Medical Oncology Unit, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Jingwen Luo
- Department of Biotherapy, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
| | - Pengan Chen
- West China School of Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Zilong Zhang
- West China School of Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Aqu Alu
- Department of Biotherapy, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
| | - Yinan Xiao
- West China School of Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Xuelei Ma
- Department of Biotherapy, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
| |
Collapse
|
31
|
Huang B, Tian J, Zhang H, Luo Z, Qin J, Huang C, He X, Luo Y, Zhou Y, Dan G, Chen H, Feng ST, Yuan C. Deep Semantic Segmentation Feature-Based Radiomics for the Classification Tasks in Medical Image Analysis. IEEE J Biomed Health Inform 2021; 25:2655-2664. [PMID: 33290235 DOI: 10.1109/jbhi.2020.3043236] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Recently, an emerging trend in medical image classification is to combine radiomics framework with deep learning classification network in an integrated system. Although this combination is efficient in some tasks, the deep learning-based classification network is often difficult to capture an effective representation of lesion regions, and prone to face the challenge of overfitting, leading to unreliable features and inaccurate results, especially when the sizes of the lesions are small or the training dataset is small. In addition, these combinations mostly lack an effective feature selection mechanism, which makes it difficult to obtain the optimal feature selection. In this paper, we introduce a novel and effective deep semantic segmentation feature-based radiomics (DSFR) framework to overcome the above-mentioned challenges, which consists of two modules: the deep semantic feature extraction module and the feature selection module. Specifically, the extraction module is utilized to extract hierarchical semantic features of the lesions from a trained segmentation network. The feature selection module aims to select the most representative features by using a novel feature similarity adaptation algorithm. Experiments are extensively conducted to evaluate our method in two clinical tasks: the pathological grading prediction in pancreatic neuroendocrine neoplasms (pNENs), and the prediction of thrombolytic therapy efficacy in deep venous thrombosis (DVT). Experimental results on both tasks demonstrate that the proposed method consistently outperforms the state-of-the-art approaches by a large margin.
Collapse
|
32
|
Enriquez JS, Chu Y, Pudakalakatti S, Hsieh KL, Salmon D, Dutta P, Millward NZ, Lurie E, Millward S, McAllister F, Maitra A, Sen S, Killary A, Zhang J, Jiang X, Bhattacharya PK, Shams S. Hyperpolarized Magnetic Resonance and Artificial Intelligence: Frontiers of Imaging in Pancreatic Cancer. JMIR Med Inform 2021; 9:e26601. [PMID: 34137725 PMCID: PMC8277399 DOI: 10.2196/26601] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 02/24/2021] [Accepted: 04/03/2021] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND There is an unmet need for noninvasive imaging markers that can help identify the aggressive subtype(s) of pancreatic ductal adenocarcinoma (PDAC) at diagnosis and at an earlier time point, and evaluate the efficacy of therapy prior to tumor reduction. In the past few years, there have been two major developments with potential for a significant impact in establishing imaging biomarkers for PDAC and pancreatic cancer premalignancy: (1) hyperpolarized metabolic (HP)-magnetic resonance (MR), which increases the sensitivity of conventional MR by over 10,000-fold, enabling real-time metabolic measurements; and (2) applications of artificial intelligence (AI). OBJECTIVE Our objective of this review was to discuss these two exciting but independent developments (HP-MR and AI) in the realm of PDAC imaging and detection from the available literature to date. METHODS A systematic review following the PRISMA extension for Scoping Reviews (PRISMA-ScR) guidelines was performed. Studies addressing the utilization of HP-MR and/or AI for early detection, assessment of aggressiveness, and interrogating the early efficacy of therapy in patients with PDAC cited in recent clinical guidelines were extracted from the PubMed and Google Scholar databases. The studies were reviewed following predefined exclusion and inclusion criteria, and grouped based on the utilization of HP-MR and/or AI in PDAC diagnosis. RESULTS Part of the goal of this review was to highlight the knowledge gap of early detection in pancreatic cancer by any imaging modality, and to emphasize how AI and HP-MR can address this critical gap. We reviewed every paper published on HP-MR applications in PDAC, including six preclinical studies and one clinical trial. We also reviewed several HP-MR-related articles describing new probes with many functional applications in PDAC. On the AI side, we reviewed all existing papers that met our inclusion criteria on AI applications for evaluating computed tomography (CT) and MR images in PDAC. With the emergence of AI and its unique capability to learn across multimodal data, along with sensitive metabolic imaging using HP-MR, this knowledge gap in PDAC can be adequately addressed. CT is an accessible and widespread imaging modality worldwide as it is affordable; because of this reason alone, most of the data discussed are based on CT imaging datasets. Although there were relatively few MR-related papers included in this review, we believe that with rapid adoption of MR imaging and HP-MR, more clinical data on pancreatic cancer imaging will be available in the near future. CONCLUSIONS Integration of AI, HP-MR, and multimodal imaging information in pancreatic cancer may lead to the development of real-time biomarkers of early detection, assessing aggressiveness, and interrogating early efficacy of therapy in PDAC.
Collapse
Affiliation(s)
- José S Enriquez
- Department of Cancer Systems Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, United States.,Graduate School of Biomedical Sciences, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Yan Chu
- School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, United States
| | - Shivanand Pudakalakatti
- Department of Cancer Systems Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Kang Lin Hsieh
- School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, United States
| | - Duncan Salmon
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
| | - Prasanta Dutta
- Department of Cancer Systems Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Niki Zacharias Millward
- Graduate School of Biomedical Sciences, University of Texas MD Anderson Cancer Center, Houston, TX, United States.,Department of Urology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Eugene Lurie
- Department of Translational Molecular Pathology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Steven Millward
- Department of Cancer Systems Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, United States.,Graduate School of Biomedical Sciences, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Florencia McAllister
- Graduate School of Biomedical Sciences, University of Texas MD Anderson Cancer Center, Houston, TX, United States.,Department of Clinical Cancer Prevention, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Anirban Maitra
- Graduate School of Biomedical Sciences, University of Texas MD Anderson Cancer Center, Houston, TX, United States.,Department of Pathology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Subrata Sen
- Graduate School of Biomedical Sciences, University of Texas MD Anderson Cancer Center, Houston, TX, United States.,Department of Translational Molecular Pathology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Ann Killary
- Graduate School of Biomedical Sciences, University of Texas MD Anderson Cancer Center, Houston, TX, United States.,Department of Translational Molecular Pathology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Jian Zhang
- Division of Computer Science and Engineering, Louisiana State University, Baton Rouge, LA, United States
| | - Xiaoqian Jiang
- School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, United States
| | - Pratip K Bhattacharya
- Department of Cancer Systems Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, United States.,Graduate School of Biomedical Sciences, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Shayan Shams
- School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, United States
| |
Collapse
|
33
|
Song C, Wang M, Luo Y, Chen J, Peng Z, Wang Y, Zhang H, Li ZP, Shen J, Huang B, Feng ST. Predicting the recurrence risk of pancreatic neuroendocrine neoplasms after radical resection using deep learning radiomics with preoperative computed tomography images. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:833. [PMID: 34164467 PMCID: PMC8184461 DOI: 10.21037/atm-21-25] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Background To establish and validate a prediction model for pancreatic neuroendocrine neoplasms (pNENs) recurrence after radical surgery with preoperative computed tomography (CT) images. Methods We retrospectively collected data from 74 patients with pathologically confirmed pNENs (internal group: 56 patients, Hospital I; external validation group: 18 patients, Hospital II). Using the internal group, models were trained with CT findings evaluated by radiologists, radiomics, and deep learning radiomics (DLR) to predict 5-year pNEN recurrence. Radiomics and DLR models were established for arterial (A), venous (V), and arterial and venous (A&V) contrast phases. The model with the optimal performance was further combined with clinical information, and all patients were divided into high- and low-risk groups to analyze survival with the Kaplan-Meier method. Results In the internal group, the areas under the curves (AUCs) of DLR-A, DLR-V, and DLR-A&V models were 0.80, 0.58, and 0.72, respectively. The corresponding radiomics AUCs were 0.74, 0.68, and 0.70. The AUC of the CT findings model was 0.53. The DLR-A model represented the optimum; added clinical information improved the AUC from 0.80 to 0.83. In the validation group, the AUCs of DLR-A, DLR-V, and DLR-A&V models were 0.77, 0.48, and 0.64, respectively, and those of radiomics-A, radiomics-V, and radiomics-A&V models were 0.56, 0.52, and 0.56, respectively. The AUC of the CT findings model was 0.52. In the validation group, the comparison between the DLR-A and the random models showed a trend of significant difference (P=0.058). Recurrence-free survival differed significantly between high- and low-risk groups (P=0.003). Conclusions Using DLR, we successfully established a preoperative recurrence prediction model for pNEN patients after radical surgery. This allows a risk evaluation of pNEN recurrence, optimizing clinical decision-making.
Collapse
Affiliation(s)
- Chenyu Song
- Department of Radiology, The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Mingyu Wang
- Medical AI Lab, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Yanji Luo
- Department of Radiology, The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Jie Chen
- Department of Gastroenterology, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Zhenpeng Peng
- Department of Radiology, The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Yangdi Wang
- Department of Radiology, The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Hongyuan Zhang
- Medical AI Lab, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Zi-Ping Li
- Department of Radiology, The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Jingxian Shen
- Department of Radiology, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Bingsheng Huang
- Medical AI Lab, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Shi-Ting Feng
- Department of Radiology, The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, China
| |
Collapse
|
34
|
Wang R, Liu H, Liang P, Zhao H, Li L, Gao J. Radiomics analysis of CT imaging for differentiating gastric neuroendocrine carcinomas from gastric adenocarcinomas. Eur J Radiol 2021; 138:109662. [PMID: 33774440 DOI: 10.1016/j.ejrad.2021.109662] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 01/29/2021] [Accepted: 03/16/2021] [Indexed: 02/07/2023]
Abstract
PURPOSE To develop and evaluate a CT-based radiomics nomogram for differentiating gastric neuroendocrine carcinomas (NECs) from gastric adenocarcinomas (ADCs). METHODS CT images of 63 patients with gastric NECs were collected retrospectively, and 63 patients with gastric ADCs were selected as the control group. Univariate analysis was used to identify the significant factors of clinical characteristics and CT findings for differentiating gastric NECs from ADCs. Radiomics analysis was applied to CT images of unenhanced, arterial phase and venous phase, respectively. A radiomics nomogram incorporating the radiomics signature and the subjective CT findings was developed and its diagnostic ability was evaluated. The diagnostic performances of CT findings model, radiomics signature and radiomics nomogram were compared using DeLong test. RESULTS The tumor margin and lymph node (LN) metastasis were independent predictors for differentiating gastric NECs from ADCs. The radiomics signature based on venous phase presented superior AUC of 0.798 [95 % confidence interval (CI), 0.657-0.938] in validation cohort. The nomogram incorporated the radiomics signature, tumor margin and LN metastasis showed AUCs of 0.821 (95 %CI: 0.725-0.895) in the primary cohort and 0.809 (95 %CI: 0.649-0.918) in the validation cohort. Moreover, the radiomics nomogram showed good discrimination and calibration. The diagnostic performance of CT findings model was significantly lower than that of radiomics nomogram (p = 0.001) and radiomics signature (p = 0.025). CONCLUSIONS Radiomics analysis exhibited good performance in differentiating gastric NECs from ADCs, and the radiomics nomogram may have significant clinical implications on preoperative detection of gastric malignant tumors.
Collapse
Affiliation(s)
- Rui Wang
- Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, 450052, Henan, China
| | - Huan Liu
- Advanced Application Team, GE Healthcare, Shanghai, 201203, China
| | - Pan Liang
- Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, 450052, Henan, China
| | - Huiping Zhao
- Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, 450052, Henan, China
| | - Liming Li
- Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, 450052, Henan, China
| | - Jianbo Gao
- Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, 450052, Henan, China.
| |
Collapse
|
35
|
The Chinese guidelines for the diagnosis and treatment of pancreatic neuroendocrine neoplasms (2020). JOURNAL OF PANCREATOLOGY 2021. [DOI: 10.1097/jp9.0000000000000064] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
|
36
|
Gorris M, Hoogenboom SA, Wallace MB, van Hooft JE. Artificial intelligence for the management of pancreatic diseases. Dig Endosc 2021; 33:231-241. [PMID: 33065754 PMCID: PMC7898901 DOI: 10.1111/den.13875] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 09/29/2020] [Accepted: 10/11/2020] [Indexed: 12/16/2022]
Abstract
Novel artificial intelligence techniques are emerging in all fields of healthcare, including gastroenterology. The aim of this review is to give an overview of artificial intelligence applications in the management of pancreatic diseases. We performed a systematic literature search in PubMed and Medline up to May 2020 to identify relevant articles. Our results showed that the development of machine-learning based applications is rapidly evolving in the management of pancreatic diseases, guiding precision medicine in clinical, endoscopic and radiologic settings. Before implementation into clinical practice, further research should focus on the external validation of novel techniques, clarifying the accuracy and robustness of these models.
Collapse
Affiliation(s)
- Myrte Gorris
- Department of Gastroenterology and HepatologyAmsterdam Gastroenterology Endocrinology MetabolismAmsterdam University Medical CentersUniversity of AmsterdamAmsterdamThe Netherlands
| | - Sanne A. Hoogenboom
- Department of Gastroenterology and HepatologyAmsterdam Gastroenterology Endocrinology MetabolismAmsterdam University Medical CentersUniversity of AmsterdamAmsterdamThe Netherlands
| | - Michael B. Wallace
- Department of Gastroenterology and HepatologyMayo Clinic JacksonvilleJacksonvilleUSA
| | - Jeanin E. van Hooft
- Department of Gastroenterology and HepatologyAmsterdam Gastroenterology Endocrinology MetabolismAmsterdam University Medical CentersUniversity of AmsterdamAmsterdamThe Netherlands
- Department of Gastroenterology and HepatologyLeiden University Medical CenterLeidenThe Netherlands
| |
Collapse
|
37
|
Modlin IM, Kidd M, Drozdov IA, Bodei L. The Use of Deep Learning and Neural Networks in Imaging: Welcome to the New Mathematical Milieu of Medicine. Neuroendocrinology 2020; 110:322-327. [PMID: 31694034 DOI: 10.1159/000504605] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/01/2019] [Accepted: 11/04/2019] [Indexed: 11/19/2022]
Affiliation(s)
- Irvin M Modlin
- Yale University School of Medicine, New Haven, Connecticut, USA,
| | - Mark Kidd
- Wren Laboratories, Branford, Connecticut, USA
| | | | - Lisa Bodei
- Memorial Sloan Kettering Cancer Center, New York, New York, USA
| |
Collapse
|