1
|
Yang K, Song Y, Su Y, Li C, Ding N. Establishment and Validation of an Early Predictive Model for Severe Acute Pancreatitis. J Inflamm Res 2024; 17:3551-3561. [PMID: 38855164 PMCID: PMC11162219 DOI: 10.2147/jir.s457199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 05/14/2024] [Indexed: 06/11/2024] Open
Abstract
Objective The purpose of this study is to establishment and validation of an early predictive model for severe acute pancreatitis (SAP). Methods From January 2015 to August 2022, 2986 AP patients admitted to Changsha Central Hospital were enrolled in this study. They were randomly divided into a modeling group (n = 2112) and a validation group (n = 874). In the modeling group, identify risk factors through logistic regression models and draw column charts. Use internal validation method to verify the accuracy of column chart prediction. Apply calibration curves to evaluate the consistency between nomograms and ideal observations. Draw a DCA curve to evaluate the net benefits of the prediction model. Results Nine variables including respiratory rate, heart rate, WBC, PDW, PT, SCR, AMY, CK, and TG are the risk factors for SAP. The column chart risk prediction model which was constructed based on these 9 independent factors has high prediction accuracy (modeling group AUC = 0.788, validation group AUC = 7.789). The calibration curve analysis shows that the prediction probabilities of the modeling and validation groups are consistent with the observation probabilities. By drawing a DCA curve, it shows that the model has a wide threshold range (0.01-0.88). Conclusion The study developed an intuitive nomogram containing readily available laboratory parameters to predict the incidence rate of SAP.
Collapse
Affiliation(s)
- Kongzhi Yang
- Department of Emergency Medicine, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, People’s Republic of China
| | - Yaqin Song
- Department of Emergency Medicine, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, People’s Republic of China
| | - Yingjie Su
- Department of Emergency Medicine, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, People’s Republic of China
| | - Changluo Li
- Department of Emergency Medicine, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, People’s Republic of China
| | - Ning Ding
- Department of Emergency Medicine, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, People’s Republic of China
| |
Collapse
|
2
|
Qian R, Zhuang J, Xie J, Cheng H, Ou H, Lu X, Ouyang Z. Predictive value of machine learning for the severity of acute pancreatitis: A systematic review and meta-analysis. Heliyon 2024; 10:e29603. [PMID: 38655348 PMCID: PMC11035062 DOI: 10.1016/j.heliyon.2024.e29603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 04/02/2024] [Accepted: 04/10/2024] [Indexed: 04/26/2024] Open
Abstract
Background Predicting the severity of acute pancreatitis (AP) early poses a challenge in clinical practice. While there are well-established clinical scoring tools, their actual predictive performance remains uncertain. Various studies have explored the application of machine-learning methods for early AP prediction. However, a more comprehensive evidence-based assessment is needed to determine their predictive accuracy. Hence, this systematic review and meta-analysis aimed to evaluate the predictive accuracy of machine learning in assessing the severity of AP. Methods PubMed, EMBASE, Cochrane Library, and Web of Science were systematically searched until December 5, 2023. The risk of bias in eligible studies was assessed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). Subgroup analyses, based on different machine learning types, were performed. Additionally, the predictive accuracy of mainstream scoring tools was summarized. Results This systematic review ultimately included 33 original studies. The pooled c-index in both the training and validation sets was 0.87 (95 % CI: 0.84-0.89) and 0.88 (95 % CI: 0.86-0.90), respectively. The sensitivity in the training set was 0.81 (95 % CI: 0.77-0.84), and in the validation set, it was 0.79 (95 % CI: 0.71-0.85). The specificity in the training set was 0.84 (95 % CI: 0.78-0.89), and in the validation set, it was 0.90 (95 % CI: 0.86-0.93). The primary model incorporated was logistic regression; however, its predictive accuracy was found to be inferior to that of neural networks, random forests, and xgboost. The pooled c-index of the APACHE II, BISAP, and Ranson were 0.74 (95 % CI: 0.68-0.80), 0.77 (95 % CI: 0.70-0.85), and 0.74 (95 % CI: 0.68-0.79), respectively. Conclusions Machine learning demonstrates excellent accuracy in predicting the severity of AP, providing a reference for updating or developing a straightforward clinical prediction tool.
Collapse
Affiliation(s)
- Rui Qian
- Department of Gastroenterology, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen 518000, China
| | - Jiamei Zhuang
- The Fourth Clinical Medical College of Guangzhou University of Chinese Medicine, Shenzhen, 518033, China
| | - Jianjun Xie
- Department of Gastroenterology, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen 518000, China
| | - Honghui Cheng
- Department of Gastroenterology, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen 518000, China
| | - Haiya Ou
- Department of Gastroenterology, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen 518000, China
| | - Xiang Lu
- Department of Plumonary and Critical Care Medicine, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen 518000, China
| | - Zichen Ouyang
- Department of Hepatology, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen 518000, China
| |
Collapse
|
3
|
Hu JX, Zhao CF, Wang SL, Tu XY, Huang WB, Chen JN, Xie Y, Chen CR. Acute pancreatitis: A review of diagnosis, severity prediction and prognosis assessment from imaging technology, scoring system and artificial intelligence. World J Gastroenterol 2023; 29:5268-5291. [PMID: 37899784 PMCID: PMC10600804 DOI: 10.3748/wjg.v29.i37.5268] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 07/31/2023] [Accepted: 09/14/2023] [Indexed: 09/25/2023] Open
Abstract
Acute pancreatitis (AP) is a potentially life-threatening inflammatory disease of the pancreas, with clinical management determined by the severity of the disease. Diagnosis, severity prediction, and prognosis assessment of AP typically involve the use of imaging technologies, such as computed tomography, magnetic resonance imaging, and ultrasound, and scoring systems, including Ranson, Acute Physiology and Chronic Health Evaluation II, and Bedside Index for Severity in AP scores. Computed tomography is considered the gold standard imaging modality for AP due to its high sensitivity and specificity, while magnetic resonance imaging and ultrasound can provide additional information on biliary obstruction and vascular complications. Scoring systems utilize clinical and laboratory parameters to classify AP patients into mild, moderate, or severe categories, guiding treatment decisions, such as intensive care unit admission, early enteral feeding, and antibiotic use. Despite the central role of imaging technologies and scoring systems in AP management, these methods have limitations in terms of accuracy, reproducibility, practicality and economics. Recent advancements of artificial intelligence (AI) provide new opportunities to enhance their performance by analyzing vast amounts of clinical and imaging data. AI algorithms can analyze large amounts of clinical and imaging data, identify scoring system patterns, and predict the clinical course of disease. AI-based models have shown promising results in predicting the severity and mortality of AP, but further validation and standardization are required before widespread clinical application. In addition, understanding the correlation between these three technologies will aid in developing new methods that can accurately, sensitively, and specifically be used in the diagnosis, severity prediction, and prognosis assessment of AP through complementary advantages.
Collapse
Affiliation(s)
- Jian-Xiong Hu
- Intensive Care Unit, The Affiliated Hospital of Putian University, Putian 351100, Fujian Province, China
| | - Cheng-Fei Zhao
- School of Pharmacy and Medical Technology, Putian University, Putian 351100, Fujian Province, China
- Key Laboratory of Pharmaceutical Analysis and Laboratory Medicine, Putian University, Putian 351100, Fujian Province, China
| | - Shu-Ling Wang
- Department of Critical Care Medicine, Fujian Medical University Union Hospital, Fuzhou 350001, Fujian Province, China
| | - Xiao-Yan Tu
- Department of Critical Care Medicine, Fujian Medical University Union Hospital, Fuzhou 350001, Fujian Province, China
| | - Wei-Bin Huang
- Department of Critical Care Medicine, Fujian Medical University Union Hospital, Fuzhou 350001, Fujian Province, China
| | - Jun-Nian Chen
- Department of Critical Care Medicine, Fujian Medical University Union Hospital, Fuzhou 350001, Fujian Province, China
| | - Ying Xie
- School of Mechanical, Electrical and Information Engineering, Putian University, Putian 351100, Fujian Province, China
| | - Cun-Rong Chen
- Department of Critical Care Medicine, Fujian Medical University Union Hospital, Fuzhou 350001, Fujian Province, China
| |
Collapse
|
4
|
Li B, Wu W, Liu A, Feng L, Li B, Mei Y, Tan L, Zhang C, Tian Y. Establishment and Validation of a Nomogram Prediction Model for the Severe Acute Pancreatitis. J Inflamm Res 2023; 16:2831-2843. [PMID: 37449283 PMCID: PMC10337691 DOI: 10.2147/jir.s416411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2023] [Accepted: 07/01/2023] [Indexed: 07/18/2023] Open
Abstract
Background Severe acute pancreatitis (SAP) can progress to lung and kidney dysfunction, and blood clotting within 48 hours of its onset, and is associated with a high mortality rate. The aim of this study was to establish a reliable diagnostic prediction model for the early stage of severe pancreatitis. Methods The clinical data of patients diagnosed with acute pancreatitis from October 2017 to June 2022 at the Shangluo Central Hospital were collected. The risk factors were screened by least absolute shrinkage and selection operator (LASSO) regression analysis. A novel nomogram model was then established by multivariable logistic regression analysis. Results The data of 436 patients with acute pancreatitis, 45 (10.3%) patients had progressed to SAP. Through univariate and LASSO regression analyses, the neutrophils (P <0.001), albumin (P < 0.001), blood glucose (P < 0.001), serum calcium (P < 0.001), serum creatinine (P < 0.001), blood urea nitrogen (P < 0.001) and procalcitonin (P = 0.005) were identified as independent predictive factors for SAP. The nomogram built on the basis of these factors predicted SAP with sensitivity of 0.733, specificity of 0.9, positive predictive value of 0.458 and negative predictive value of 0.967. Furthermore, the concordance index of the nomogram reached 0.889 (95% CI, 0.837-0.941), and the area under the curve (AUC) in receiver operating characteristic curve (ROC) analysis was significantly higher than that of the APACHEII and ABISAP scoring systems. The established model was validated by plotting the clinical decision curve analysis (DCA) and clinical impact curve (CIC). Conclusion We established a nomogram to predict the progression of early acute pancreatitis to SAP with high discrimination and accuracy.
Collapse
Affiliation(s)
- Bo Li
- Department of Pancreatic Surgery, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| | - Weiqing Wu
- Department of Pancreatic Surgery, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| | - Aijun Liu
- Department of Pancreatic Surgery, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| | - Lifeng Feng
- Department of Pancreatic Surgery, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| | - Bin Li
- Department of Pancreatic Surgery, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| | - Yong Mei
- Department of Pancreatic Surgery, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| | - Li Tan
- Department of Pancreatic Surgery, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| | - Chaoyang Zhang
- Department of Ultrasound Medicine, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| | - Yangtao Tian
- Department of Pancreatic Surgery, Shangluo Center Hospital, Shangluo, Shaanxi, 726000, People’s Republic of China
| |
Collapse
|
5
|
Prediction of the severity of acute pancreatitis using machine learning models. Postgrad Med 2022; 134:703-710. [PMID: 35801388 DOI: 10.1080/00325481.2022.2099193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/08/2022]
Abstract
BACKGROUND Acute pancreatitis (AP) is the most common pancreatic disease. Predicting the severity of AP is critical for making preventive decisions. However, the performance of existing scoring systems in predicting AP severity was not satisfactory. The purpose of this study was to develop predictive models for the severity of AP using machine learning (ML) algorithms and explore the important predictors that affected the prediction results. METHODS The data of 441 patients in the Department of Gastroenterology in our hospital were analyzed retrospectively. The demographic data, blood routine and blood biochemical indexes, and the CTSI score were collected to develop five different ML predictive models to predict the severity of AP. The performance of the models was evaluated by the area under the receiver operating characteristic curve (AUC). The important predictors were determined by ranking the feature importance of the predictive factors. RESULTS Compared to other ML models, the extreme gradient boosting model (XGBoost) showed better performance in predicting severe AP, with an AUC of 0.906, an accuracy of 0.902, a sensitivity of 0.700, a specificity of 0.961, and a F1socre of 0.764. Further analysis showed that the CTSI score, ALB, LDH, and NEUT were the important predictors of the severity of AP. CONCLUSION The results showed that the XGBoost algorithm can accurately predict the severity of AP, which can provide an assistance for the clinicians to identify severe AP at an early stage.
Collapse
|