1
|
Liu C, Yang WY, Cheng F, Chien CW, Chuang YC, Jin Y. Identification of key risk factors for venous thromboembolism in urological inpatients based on the Caprini scale and interpretable machine learning methods. Thromb J 2024; 22:76. [PMID: 39152448 PMCID: PMC11328390 DOI: 10.1186/s12959-024-00645-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Accepted: 08/07/2024] [Indexed: 08/19/2024] Open
Abstract
PURPOSE To identify the key risk factors for venous thromboembolism (VTE) in urological inpatients based on the Caprini scale using an interpretable machine learning method. METHODS VTE risk data of urological inpatients were obtained based on the Caprini scale in the case hospital. Based on the data, the Boruta method was used to further select the key variables from the 37 variables in the Caprini scale. Furthermore, decision rules corresponding to each risk level were generated using the rough set (RS) method. Finally, random forest (RF), support vector machine (SVM), and backpropagation artificial neural network (BPANN) were used to verify the data accuracy and were compared with the RS method. RESULTS Following the screening, the key risk factors for VTE in urology were "(C1) Age," "(C2) Minor Surgery planned," "(C3) Obesity (BMI > 25)," "(C8) Varicose veins," "(C9) Sepsis (< 1 month)," (C10) "Serious lung disease incl. pneumonia (< 1month) " (C11) COPD," "(C16) Other risk," "(C18) Major surgery (> 45 min)," "(C19) Laparoscopic surgery (> 45 min)," "(C20) Patient confined to bed (> 72 h)," "(C18) Malignancy (present or previous)," "(C23) Central venous access," "(C31) History of DVT/PE," "(C32) Other congenital or acquired thrombophilia," and "(C34) Stroke (< 1 month." According to the decision rules of different risk levels obtained using the RS method, "(C1) Age," "(C18) Major surgery (> 45 minutes)," and "(C21) Malignancy (present or previous)" were the main factors influencing mid- and high-risk levels, and some suggestions on VTE prevention were indicated based on these three factors. The average accuracies of the RS, RF, SVM, and BPANN models were 79.5%, 87.9%, 92.6%, and 97.2%, respectively. In addition, BPANN had the highest accuracy, recall, F1-score, and precision. CONCLUSIONS The RS model achieved poorer accuracy than the other three common machine learning models. However, the RS model provides strong interpretability and allows for the identification of high-risk factors and decision rules influencing high-risk assessments of VTE in urology. This transparency is very important for clinicians in the risk assessment process.
Collapse
Affiliation(s)
- Chao Liu
- Medical Department, The Second Affiliated Hospital of Hebei North University, Zhangjiakou, 075000, Hebei, China
- Institute for Hospital Management, Shenzhen International Graduate School, Tsinghua University, Shenzhen, 518055, Guangdong, China
| | - Wei-Ying Yang
- Nursing Department, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, 317000, Zhejiang, China
| | - Fengmin Cheng
- Nursing Department, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, 317000, Zhejiang, China
| | - Ching-Wen Chien
- Institute for Hospital Management, Shenzhen International Graduate School, Tsinghua University, Shenzhen, 518055, Guangdong, China.
| | - Yen-Ching Chuang
- Business College, Taizhou University, Taizhou, 318000, Zhejiang, China.
- Institute of Public Health & Emergency Management, Taizhou University, Taizhou, 318000, Zhejiang, China.
- Key Laboratory of evidence-based Radiology of Taizhou, Linhai, 317000, Zhejiang, China.
| | - Yanjun Jin
- Department of Urology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, 317000, Zhejiang, China.
| |
Collapse
|
2
|
Danilatou V, Dimopoulos D, Kostoulas T, Douketis J. Machine Learning-Based Predictive Models for Patients with Venous Thromboembolism: A Systematic Review. Thromb Haemost 2024. [PMID: 38574756 DOI: 10.1055/a-2299-4758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/06/2024]
Abstract
BACKGROUND Venous thromboembolism (VTE) is a chronic disorder with a significant health and economic burden. Several VTE-specific clinical prediction models (CPMs) have been used to assist physicians in decision-making but have several limitations. This systematic review explores if machine learning (ML) can enhance CPMs by analyzing extensive patient data derived from electronic health records. We aimed to explore ML-CPMs' applications in VTE for risk stratification, outcome prediction, diagnosis, and treatment. METHODS Three databases were searched: PubMed, Google Scholar, and IEEE electronic library. Inclusion criteria focused on studies using structured data, excluding non-English publications, studies on non-humans, and certain data types such as natural language processing and image processing. Studies involving pregnant women, cancer patients, and children were also excluded. After excluding irrelevant studies, a total of 77 studies were included. RESULTS Most studies report that ML-CPMs outperformed traditional CPMs in terms of receiver operating area under the curve in the four clinical domains that were explored. However, the majority of the studies were retrospective, monocentric, and lacked detailed model architecture description and external validation, which are essential for quality audit. This review identified research gaps and highlighted challenges related to standardized reporting, reproducibility, and model comparison. CONCLUSION ML-CPMs show promise in improving risk assessment and individualized treatment recommendations in VTE. Apparently, there is an urgent need for standardized reporting and methodology for ML models, external validation, prospective and real-world data studies, as well as interventional studies to evaluate the impact of artificial intelligence in VTE.
Collapse
Affiliation(s)
- Vasiliki Danilatou
- School of Medicine, European University of Cyprus, Nicosia, Cyprus
- Healthcare Division, Sphynx Technology Solutions, Nicosia, Cyprus
| | - Dimitrios Dimopoulos
- School of Engineering, Department of Information and Communication Systems Engineering, University of the Aegean, North Aegean, Greece
| | - Theodoros Kostoulas
- School of Engineering, Department of Information and Communication Systems Engineering, University of the Aegean, North Aegean, Greece
| | - James Douketis
- Department of Medicine, McMaster University, Hamilton, Canada
- Department of Medicine, St. Joseph's Healthcare Hamilton, Ontario, Canada
| |
Collapse
|
3
|
Park C, Loza-Avalos SE, Harvey J, Hirschkorn C, Dultz LA, Dumas RP, Sanders D, Chowdhry V, Starr A, Cripps M. A Real-Time Automated Machine Learning Algorithm for Predicting Mortality in Trauma Patients: Survey Says it's Ready for Prime-Time. Am Surg 2024; 90:655-661. [PMID: 37848176 DOI: 10.1177/00031348231207299] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2023]
Abstract
BACKGROUND Though artificial intelligence ("AI") has been increasingly applied to patient care, many of these predictive models are retrospective and not readily available for real-time decision-making. This survey-based study aims to evaluate implementation of a new, validated mortality risk calculator (Parkland Trauma Index of Mortality, "PTIM") embedded in our electronic healthrecord ("EHR") that calculates hourly predictions of mortality with high sensitivity and specificity. METHODS This is a prospective, survey-based study performed at a level 1 trauma center. An anonymous survey was sent to surgical providers and regarding PTIM implementation. The PTIM score evaluates 23 variables including Glasgow Coma Score (GCS), vital signs, and laboratory data. RESULTS Of the 40 completed surveys, 35 reported using PTIM in decision-making. Prior to reviewing PTIM, providers identified perceived top 3 predictors of mortality, including GCS (22/38, 58%), age (18/35, 47%), and maximum heart rate (17/35, 45%). Most providers reported the PTIM assisted their treatment decisions (27/35, 77%) and timing of operative intervention (23/35, 66%). Many providers agreed that PTIM integrated into rounds and patient assessment (22/36, 61%) and that it improved efficiency in assessing patients' potential mortality (21/36, 58%). CONCLUSIONS Artificial intelligence algorithms are mostly retrospective and lag in real-time prediction of mortality. To our knowledge, this is the first real-time, automated algorithm predicting mortality in trauma patients. In this small survey-based study, we found PTIM assists in decision-making, timing of intervention, and improves accuracy in assessing mortality. Next steps include evaluating the short- and long-term impact on patient outcomes.
Collapse
Affiliation(s)
- Caroline Park
- Division of Burns, Trauma and Acute Care Surgery, Department of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Sandra E Loza-Avalos
- Division of Burns, Trauma and Acute Care Surgery, Department of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Jalen Harvey
- Division of Burns, Trauma and Acute Care Surgery, Department of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | | | - Linda A Dultz
- Division of Burns, Trauma and Acute Care Surgery, Department of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Ryan P Dumas
- Division of Burns, Trauma and Acute Care Surgery, Department of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Drew Sanders
- Department of Orthopedic Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | | | - Adam Starr
- Department of Orthopedic Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Michael Cripps
- Division of Burns, Trauma and Acute Care Surgery, Department of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA
| |
Collapse
|
4
|
Yang S, Zhang Y, Jiao X, Liu J, Wang W, Kuang T, Gong J, Li J, Yang Y. Padua prediction score may be inappropriate for VTE risk assessment in hospitalized patients with acute respiratory conditions: A Chinese single-center cohort study. IJC HEART & VASCULATURE 2023; 49:101301. [PMID: 38035260 PMCID: PMC10684791 DOI: 10.1016/j.ijcha.2023.101301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 10/25/2023] [Accepted: 11/07/2023] [Indexed: 12/02/2023]
Abstract
Background The Padua Prediction Score (PPS) recommended by the guidelines lacks effective external validation in a Chinese cohort. This study sought to assess the accuracy of the PPS to predict venous thromboembolism (VTE) risk in medical inpatients with acute respiratory conditions. Methods This consecutive cohort study included 1,574 inpatients from January to August 2019. The occurrence rate of VTE in patients classified at high-risk and low-risk groups according to PPS and Caprini risk assessment model (RAM) was compared. The discriminatory capability of the RAMs was evaluated in all the patients and the subgroup without pharmacological prophylaxis. Reclassification parameters were also used to assess the clinical utility. Results 170 (10.8%) patients were objectively confirmed as having VTE during hospitalization. The incidence rate of VTE in low-risk patients was 6.3% by PPS, which was significantly higher than that by Caprini RAM (2.6%, p < 0.001). The area under the curve (AUC) for PPS and Caprini RAM was 0.714 (95%CI, 0.672-0.756) and 0.760 (95%CI, 0.724-0.797), respectively (p = 0.003). The AUC of Caprini RAM was larger than PPS even in subgroups without pharmacological prophylaxis (0.774 vs 0.709, p = 0.002). Compared with Caprini RAM, the net reclassification index was estimated at 0.037 (p = 0.436), and integrated discrimination improvement was 0.015 (p = 0.495) by PPS. Conclusions According to our cohort study, PPS may not be appropriate to predict VTE risk in hospitalized patients with acute respiratory conditions. An accurate, widely applicable, validated RAM needs to be further constructed in Chinese medical inpatients.
Collapse
Affiliation(s)
| | | | - Xiaojing Jiao
- Department of Respiratory and Critical Care Medicine, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Jiayu Liu
- Department of Respiratory and Critical Care Medicine, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Wei Wang
- Department of Respiratory and Critical Care Medicine, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Tuguang Kuang
- Department of Respiratory and Critical Care Medicine, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Juanni Gong
- Department of Respiratory and Critical Care Medicine, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Jifeng Li
- Department of Respiratory and Critical Care Medicine, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Yuanhua Yang
- Department of Respiratory and Critical Care Medicine, Beijing Institute of Respiratory Medicine and Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
5
|
Nassour N, Akhbari B, Ranganathan N, Tawakol A, Rosovsky RP, Guss D, DiGiovanni CW, Ashkani-Esfahani S. Correlation Between Statin Use and Symptomatic Venous Thromboembolism Incidence in Patients With Ankle Fracture: A Machine Learning Approach. Foot Ankle Spec 2023:19386400231207692. [PMID: 37905534 DOI: 10.1177/19386400231207692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/02/2023]
Abstract
BACKGROUND Identifying factors that correlate with the incidence of venous thromboembolism (VTE) has the potential to improve VTE prevention and positively influence decision-making regarding prophylaxis. In this study, we aimed to investigate the correlation between statin consumption and the incidence of VTE in patients who sustained an ankle fracture. METHODS In this retrospective, case-controlled study, cases were those who developed VTE and controls were those who had no VTE, and the ratio was 1:4. Patients' demographics, history of hyperlipidemia, and reported statins use were obtained. A random forest classifier (RFC) model was used to predict whether statin consumers were at risk of VTE after ankle fracture regardless of VTE prophylaxis administration based on statin consumption, body mass index (BMI), age, and biological sex. RESULTS Of the 1175 patients with ankle fractures, 238 had confirmed VTE (case group), and 937 had no symptomatic VTE (control group; ratio 1:4). Fifty (21%) cases and 407 (43%) controls were on a statin. Statin users had a significantly lower incidence of VTE after ankle fracture, odds ratio (OR) = 0.35, 95% CI: 0.25, 0.49, P < .001. Our model showed an area under the receiving operator curve (AUROC) of 78%, a sensitivity of 73%, and a specificity of 83% in predicting the risk of VTE. The importance of the predictors of VTE, other than the use of statins (model importance = 0.1), were age (model importance of 0.72), BMI (model importance of 0.24), and biological sex (model importance of 0.02). CONCLUSION Statins were significantly associated with a lower rate of VTE in our population of patients who sustained an ankle fracture. LEVELS OF EVIDENCE 3.
Collapse
Affiliation(s)
- Nour Nassour
- Foot & Ankle Research and Innovation Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Bardiya Akhbari
- Foot & Ankle Research and Innovation Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Noopur Ranganathan
- Foot & Ankle Research and Innovation Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Ahmed Tawakol
- Division of Cardiology, Department of Medicine, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts
| | - Rachel P Rosovsky
- Division of Hematology, Department of Medicine, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts
| | - Daniel Guss
- Foot & Ankle Research and Innovation Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- Foot and Ankle Division, Department of Orthopaedic Surgery, Massachusetts General Hospital, Newton Wellesley Hospital, Harvard Medical School, Boston, Massachusetts
| | - Christopher W DiGiovanni
- Foot & Ankle Research and Innovation Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- Foot and Ankle Division, Department of Orthopaedic Surgery, Massachusetts General Hospital, Newton Wellesley Hospital, Harvard Medical School, Boston, Massachusetts
| | - Soheil Ashkani-Esfahani
- Foot & Ankle Research and Innovation Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- Foot and Ankle Division, Department of Orthopaedic Surgery, Massachusetts General Hospital, Newton Wellesley Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
6
|
Sheng W, Wang X, Xu W, Hao Z, Ma H, Zhang S. Development and validation of machine learning models for venous thromboembolism risk assessment at admission: a retrospective study. Front Cardiovasc Med 2023; 10:1198526. [PMID: 37705687 PMCID: PMC10497101 DOI: 10.3389/fcvm.2023.1198526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Accepted: 08/10/2023] [Indexed: 09/15/2023] Open
Abstract
Introduction Venous thromboembolism (VTE) risk assessment at admission is of great importance for early screening and timely prophylaxis and management during hospitalization. The purpose of this study is to develop and validate novel risk assessment models at admission based on machine learning (ML) methods. Methods In this retrospective study, a total of 3078 individuals were included with their Caprini variables within 24 hours at admission. Then several ML models were built, including logistic regression (LR), random forest (RF), and extreme gradient boosting (XGB). The prediction performance of ML models and the Caprini risk score (CRS) was then validated and compared through a series of evaluation metrics. Results The values of AUROC and AUPRC were 0.798 and 0.303 for LR, 0.804 and 0.360 for RF, and 0.796 and 0.352 for XGB, respectively, which outperformed CRS significantly (0.714 and 0.180, P < 0.001). When prediction scores were stratified into three risk levels for application, RF could obtain more reasonable results than CRS, including smaller false positive alerts and larger lower-risk proportions. The boosting results of stratification were further verified by the net-reclassification-improvement (NRI) analysis. Discussion This study indicated that machine learning models could improve VTE risk prediction at admission compared with CRS. Among the ML models, RF was found to have superior performance and great potential in clinical practice.
Collapse
Affiliation(s)
- Wenbo Sheng
- Research and Development Department, Shanghai Synyi Medical Technology Co., Ltd., Shanghai, China
| | - Xiaoli Wang
- Pudong Institute for Health Development, Shanghai, China
| | - Wenxiang Xu
- Research and Development Department, Shanghai Synyi Medical Technology Co., Ltd., Shanghai, China
| | - Zedong Hao
- Research and Development Department, Shanghai Synyi Medical Technology Co., Ltd., Shanghai, China
| | - Handong Ma
- Research and Development Department, Shanghai Synyi Medical Technology Co., Ltd., Shanghai, China
| | - Shaodian Zhang
- Research and Development Department, Shanghai Synyi Medical Technology Co., Ltd., Shanghai, China
- Division of Medical Affairs, Shanghai Tenth People's Hospital, Shanghai, China
| |
Collapse
|
7
|
Wu L, Cheng B. A nomogram to predict postoperative deep vein thrombosis in patients with femoral fracture: a retrospective study. J Orthop Surg Res 2023; 18:463. [PMID: 37370139 DOI: 10.1186/s13018-023-03931-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 06/14/2023] [Indexed: 06/29/2023] Open
Abstract
OBJECTIVE The implementation of more active anticoagulant prevention and treatment measures has indeed led to a significant reduction in the incidence of perioperative deep vein thrombosis (DVT) among patients with bone trauma. However, it is important to note that despite these efforts, the incidence of DVT still remains relatively high. According to the Caprini score, all patients undergoing major orthopedic surgery were defined as the high-risk group for DVT. Stratifying the risk further within high-risk groups for DVT continues to present challenges. As a result, the commonly used Caprini score during the perioperative period is not applicable to orthopedic patients. We attempt to establish a specialized model to predict postoperative DVT risk in patients with femoral fracture. METHODS We collected the clinical data of 513 patients undergoing femoral fracture surgery in our hospital from May 2018 to December 2019. According to the independent risk factors of DVT obtained by univariate and multivariate logistic regression analysis, the corresponding nomogram model was established and verified internally. The discriminative capacity of nomogram was evaluated by receiver operating characteristic (ROC) curve and area under the curve (AUC). The calibration curve used to verify model consistency was the fitted line between predicted and actual incidences. The clinical validity of the nomogram model was assessed using decision curve analysis (DCA) which could quantify the net benefit of different risk threshold probabilities. Bootstrap method was applied to the internal validation of the nomogram model. Furthermore, a comparison was made between the Caprini score and the developed nomogram model. RESULTS The Caprini scores of subjects ranged from 5 to 17 points. The incidence of DVT was not positively correlated with the Caprini score. The predictors of the nomogram model included 10 risk factors such as age, hypoalbuminemia, multiple trauma, perioperative red blood cell infusion, etc. Compared with the Caprini scale (AUC = 0.571, 95% CI 0.479-0.623), the calibration accuracy and identification ability of nomogram were higher (AUC = 0.865,95% CI 0.780-0.935). The decision curve analysis (DCA) indicated the clinical effectiveness of nomogram was higher than the Caprini score. CONCLUSIONS The nomogram was established to effectively predict postoperative DVT in patients with femoral fracture. To further reduce the incidence, more specialized risk assessment models for DVT should take into account the unique risk factors and characteristics associated with specific patient populations.
Collapse
Affiliation(s)
- Linqin Wu
- Department of Anesthesiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Bo Cheng
- Department of Anesthesiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China.
| |
Collapse
|
8
|
Lobastov K, Urbanek T, Stepanov E, Lal BK, Marangoni J, Krauss ES, Cronin M, Dengler N, Segal A, Welch HJ, Gianesini S, Chen X, Caprini JA. The Thresholds of Caprini Score Associated With Increased Risk of Venous Thromboembolism Across Different Specialties: A Systematic Review. Ann Surg 2023; 277:929-937. [PMID: 36912040 DOI: 10.1097/sla.0000000000005843] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 02/18/2023] [Indexed: 03/14/2023]
Abstract
OBJECTIVE Estimation of the specific thresholds of the Caprini risk score (CRS) that are associated with the increased incidence of venous thromboembolism (VTE) across different specialties, including identifying the highest level of risk. BACKGROUND Accurate risk assessment remains an important but often challenging aspect of VTE prophylaxis. One well-established risk assessment model is CRS, which has been validated in thousands of patients from many different medical and surgical specialties. METHODS A search of MEDLINE and the Cochrane Library was performed in March 2022. Manuscripts that reported on (1) patients admitted to medical or surgical departments and (2) had their VTE risk assessed by CRS and (3) reported on the correlation between the score and VTE incidence, were included in the analysis. RESULTS A total of 4562 references were identified, and the full text of 202 papers was assessed for eligibility. The correlation between CRS and VTE incidence was reported in 68 studies that enrolled 4,207,895 patients. In all specialties, a significant increase in VTE incidence was observed in patients with a CRS of ≥5. In most specialties thresholds of ≥7, ≥9, and ≥11 to 12 were associated with dramatically increased incidences of VTE. In COVID-19, cancer, trauma, vascular, general, head and neck, and thoracic surgery patients with ≥9 and ≥11 to 12 scores the VTE incidence was extremely high (ranging from 13% to 47%). CONCLUSION The Caprini score is being used increasingly to predict VTE in many medical and surgical specialties. In most cases, the VTE risk for individual patients increases dramatically at a threshold CRS of 7 to 11.
Collapse
Affiliation(s)
- Kirill Lobastov
- Pirogov Russian National Research Medical University, Moscow, Russia
| | | | - Eugeniy Stepanov
- Pirogov Russian National Research Medical University, Moscow, Russia
| | - Brajesh K Lal
- University of Maryland School of Medicine, Baltimore, MD
| | | | - Eugene S Krauss
- Department of Orthopaedic Surgery, Syosset Hospital, Northwell Health, Syosset, NY
| | - MaryAnne Cronin
- Department of Orthopaedic Surgery, Syosset Hospital, Northwell Health, Syosset, NY
| | - Nancy Dengler
- Department of Orthopaedic Surgery, Syosset Hospital, Northwell Health, Syosset, NY
| | - Ayal Segal
- Department of Orthopaedic Surgery, Syosset Hospital, Northwell Health, Syosset, NY
| | - Harold J Welch
- Division of Vascular Surgery, Lahey Hospital and Medical Center, Burlington, MA
| | | | - Xiaolan Chen
- Department of Respiratory and Critical Care Medicine, Beijing Shijitan Hospital, Capital Medical University, Beijing, China
| | | |
Collapse
|
9
|
Peng HT, Siddiqui MM, Rhind SG, Zhang J, da Luz LT, Beckett A. Artificial intelligence and machine learning for hemorrhagic trauma care. Mil Med Res 2023; 10:6. [PMID: 36793066 PMCID: PMC9933281 DOI: 10.1186/s40779-023-00444-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Accepted: 02/01/2023] [Indexed: 02/17/2023] Open
Abstract
Artificial intelligence (AI), a branch of machine learning (ML) has been increasingly employed in the research of trauma in various aspects. Hemorrhage is the most common cause of trauma-related death. To better elucidate the current role of AI and contribute to future development of ML in trauma care, we conducted a review focused on the use of ML in the diagnosis or treatment strategy of traumatic hemorrhage. A literature search was carried out on PubMed and Google scholar. Titles and abstracts were screened and, if deemed appropriate, the full articles were reviewed. We included 89 studies in the review. These studies could be grouped into five areas: (1) prediction of outcomes; (2) risk assessment and injury severity for triage; (3) prediction of transfusions; (4) detection of hemorrhage; and (5) prediction of coagulopathy. Performance analysis of ML in comparison with current standards for trauma care showed that most studies demonstrated the benefits of ML models. However, most studies were retrospective, focused on prediction of mortality, and development of patient outcome scoring systems. Few studies performed model assessment via test datasets obtained from different sources. Prediction models for transfusions and coagulopathy have been developed, but none is in widespread use. AI-enabled ML-driven technology is becoming integral part of the whole course of trauma care. Comparison and application of ML algorithms using different datasets from initial training, testing and validation in prospective and randomized controlled trials are warranted for provision of decision support for individualized patient care as far forward as possible.
Collapse
Affiliation(s)
- Henry T Peng
- Defence Research and Development Canada, Toronto Research Centre, Toronto, ON, M3K 2C9, Canada.
| | - M Musaab Siddiqui
- Defence Research and Development Canada, Toronto Research Centre, Toronto, ON, M3K 2C9, Canada
| | - Shawn G Rhind
- Defence Research and Development Canada, Toronto Research Centre, Toronto, ON, M3K 2C9, Canada
| | - Jing Zhang
- Defence Research and Development Canada, Toronto Research Centre, Toronto, ON, M3K 2C9, Canada
| | | | - Andrew Beckett
- St. Michael's Hospital, Toronto, ON, M5B 1W8, Canada
- Royal Canadian Medical Services, Ottawa, K1A 0K2, Canada
| |
Collapse
|
10
|
Wilson S, Chen X, Cronin M, Dengler N, Enker P, Krauss ES, Laberko L, Lobastov K, Obi AT, Powell CA, Schastlivtsev I, Segal A, Simonson B, Siracuse J, Wakefield TW, McAneny D, Caprini JA, Caprini JA. Thrombosis prophylaxis in surgical patients using the Caprini Risk Score. Curr Probl Surg 2022; 59:101221. [PMID: 36372452 DOI: 10.1016/j.cpsurg.2022.101221] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Affiliation(s)
| | - Xialan Chen
- Beijing Shijitan Hospital, Capital Medical University, Beijing, P.R. China
| | - MaryAnne Cronin
- Department of Orthopedic Surgery, Syosset Hospital, Syosset, NY
| | - Nancy Dengler
- Department of Orthopedic Surgery, Syosset Hospital, Syosset, NY
| | - Paul Enker
- Zucker School of Medicine, Hofstra University, Uniondale, NY
| | - Eugene S Krauss
- Department of Orthopedic Surgery, Syosset Hospital, Syosset, NY
| | - Leonid Laberko
- Pirogov Russian National Research Medical University, Moscow, Russia
| | - Kirill Lobastov
- Pirogov Russian National Research Medical University, Moscow, Russia
| | - Andrea T Obi
- Section of Vascular Surgery, Department of Surgery, University of Michigan, Ann Arbor, MI
| | - Chloé A Powell
- Department of Surgery, University of Michigan, Ann Arbor, MI
| | | | - Ayal Segal
- Department of Orthopedic Surgery, Syosset Hospital, Syosset, NY
| | - Barry Simonson
- Zucker School of Medicine, Hofstra University, Uniondale, NY
| | | | | | - David McAneny
- Boston University School of Medicine, Boston Medical Center, Boston, MA
| | - Joseph A Caprini
- Emeritus, NorthShore University Health System, University of Chicago Pritzker School of Medicine, Chicago, IL
| | | |
Collapse
|
11
|
Stoitsas K, Bahulikar S, de Munter L, de Jongh MAC, Jansen MAC, Jung MM, van Wingerden M, Van Deun K. Clustering of trauma patients based on longitudinal data and the application of machine learning to predict recovery. Sci Rep 2022; 12:16990. [PMID: 36216874 PMCID: PMC9550811 DOI: 10.1038/s41598-022-21390-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Accepted: 09/27/2022] [Indexed: 12/29/2022] Open
Abstract
Predicting recovery after trauma is important to provide patients a perspective on their estimated future health, to engage in shared decision making and target interventions to relevant patient groups. In the present study, several unsupervised techniques are employed to cluster patients based on longitudinal recovery profiles. Subsequently, these data-driven clusters were assessed on clinical validity by experts and used as targets in supervised machine learning models. We present a formalised analysis of the obtained clusters that incorporates evaluation of (i) statistical and machine learning metrics, (ii) clusters clinical validity with descriptive statistics and medical expertise. Clusters quality assessment revealed that clusters obtained through a Bayesian method (High Dimensional Supervised Classification and Clustering) and a Deep Gaussian Mixture model, in combination with oversampling and a Random Forest for supervised learning of the cluster assignments provided among the most clinically sensible partitioning of patients. Other methods that obtained higher classification accuracy suffered from cluster solutions with large majority classes or clinically less sensible classes. Models that used just physical or a mix of physical and psychological outcomes proved to be among the most sensible, suggesting that clustering on psychological outcomes alone yields recovery profiles that do not conform to known risk factors.
Collapse
Affiliation(s)
- Kostas Stoitsas
- Department of Methodology and Statistics, Tilburg University, Tilburg, 5000 LE, The Netherlands.
| | - Saurabh Bahulikar
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, 5000 LE, The Netherlands
| | - Leonie de Munter
- Department Traumatology, ETZ Hospital, Hilvarenbeekseweg 60, 5022 GC, Tilburg, The Netherlands
| | - Mariska A C de Jongh
- Network Emergency Care Brabant, Brabant Trauma Registry, Hilvarenbeekseweg 60, 5022 GC, Tilburg, The Netherlands
| | - Maria A C Jansen
- Network Emergency Care Brabant, Brabant Trauma Registry, Hilvarenbeekseweg 60, 5022 GC, Tilburg, The Netherlands
| | - Merel M Jung
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, 5000 LE, The Netherlands
| | - Marijn van Wingerden
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, 5000 LE, The Netherlands
| | - Katrijn Van Deun
- Department of Methodology and Statistics, Tilburg University, Tilburg, 5000 LE, The Netherlands
| |
Collapse
|
12
|
Ma H, Dong Z, Chen M, Sheng W, Li Y, Zhang W, Zhang S, Yu Y. A gradient boosting tree model for multi-department venous thromboembolism risk assessment with imbalanced data. J Biomed Inform 2022; 134:104210. [PMID: 36122879 DOI: 10.1016/j.jbi.2022.104210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 08/17/2022] [Accepted: 09/12/2022] [Indexed: 11/19/2022]
Abstract
Venous thromboembolism (VTE) is the world's third most common cause of vascular mortality and a serious complication from multiple departments. Risk assessment of VTE guides clinical intervention in time and is of great importance to in-hospital patients. Traditional VTE risk assessment methods based on scaling tools, which always require rules carefully designed by human experts, are difficult to apply to large-population scenarios since the manually designed rules are not guaranteed to be accurate to all populations. In contrast, with the development of the electronic health record (EHR) datasets, data-driven machine-learning-based risk assessment methods have proven superior predictability in many studies in recent years. This paper uses the gradient boosting tree model to study the VTE risk assessment problem with multi-department data. There exist two distinct characteristics of VTE data collected at the level of the entire hospital: its wide distribution and heterogeneity across multiple departments. To this end, we consider the prediction task over multiple departments as a multi-task learning process, and introduce the algorithm of a task-aware tree-based method TSGB to tackle the multi-task prediction problem. Although the introduction of multi-task learning improves overall across-department performance, we reveal the problem of task-wise performance decline while dealing with imbalanced VTE data volume. According to the analysis, we finally propose two variants of TSGB to alleviate the problems and further boost the prediction performance. Compared with state-of-the-art rule-based and multi-task tree-based methods, the experimental results show the proposed methods not only improve the overall across-department AUC performance effectively, but also ensure the improvement of performance over every single department prediction.
Collapse
Affiliation(s)
- Handong Ma
- Shanghai Jiao Tong University, Shanghai, China.
| | | | | | - Wenbo Sheng
- Shanghai Synyi Medical Technology Co., Ltd, Shanghai, China.
| | - Yao Li
- Shanghai Jiao Tong University, Shanghai, China.
| | | | - Shaodian Zhang
- Shanghai Synyi Medical Technology Co., Ltd, Shanghai, China; Shanghai Tenth People's Hospital, Shanghai, China.
| | - Yong Yu
- Shanghai Jiao Tong University, Shanghai, China.
| |
Collapse
|
13
|
Meng L, Wei T, Fan R, Su H, Liu J, Wang L, Huang X, Qi Y, Li X. Development and validation of a machine learning model to predict venous thromboembolism among hospitalized cancer patients. Asia Pac J Oncol Nurs 2022; 9:100128. [PMID: 36276886 PMCID: PMC9583033 DOI: 10.1016/j.apjon.2022.100128] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Accepted: 07/30/2022] [Indexed: 11/02/2022] Open
|
14
|
Abstract
The Caprini risk assessment model (RAM) is widely used to assess risk of venous thromboembolism (VTE). However, it is cumbersome with 31 variables and poses challenges with inter-rater reliability. This study aimed to determine if an abbreviated model could perform similarly in VTE risk assessment. We performed a retrospective review of trauma patients ≥ 18 years old and admitted for over 24 h at a Level I trauma center from January 1, 2018, to December 31, 2018. Demographic and clinical data were analyzed to generate Caprini scores. Using a p-value cutoff of < 0.05, the individual components of the original Caprini RAM most highly associated with VTE were identified and used to calculate an abbreviated Caprini score. Logistic regression assessed odds of inpatient VTE with the original or abbreviated Caprini RAMs. Receiver operating characteristic curves and c-statistics were generated to assess discriminatory ability. The study sample included 1279 patients. Ten risk factors were included in the abbreviated model (recent major surgery, length of surgery > 2 h, transfusion, restricted mobility > 72 h, central venous catheter, current major surgery, age, history of VTE, hip or leg fracture, and serious trauma). Compared to the original, the abbreviated model had a similar odds ratio (1.17 vs 1.07, both p-values < 0.001), c-statistic (0.747 vs 0.753), sensitivity (0.73 vs 0.76) and specificity (0.62 vs 0.61). An abbreviated Caprini RAM performs similarly to the original, may streamline workflow and allow for automation in electronic health records, potentially enhancing its use in resource limited settings.
Collapse
|