Prediction of venous thromboembolism with machine learning techniques in young-middle-aged inpatients

A narrative review of the application of machine learning in venous thromboembolism

OBJECTIVE

To summarize the current research progress of machine learning and venous thromboembolism.

METHODS

The literature on risk factors, diagnosis, prevention and prognosis of machine learning and venous thromboembolism in recent years was reviewed.

RESULTS

Machine learning is the future of biomedical research, personalized medicine, and computer-aided diagnosis, and will significantly promote the development of biomedical research and healthcare. However, many medical professionals are not familiar with it. In this review, we will introduce several commonly used machine learning algorithms in medicine, discuss the application of machine learning in venous thromboembolism, and reveal the challenges and opportunities of machine learning in medicine.

CONCLUSION

The incidence of venous thromboembolism is high, the diagnostic measures are diverse, and it is necessary to classify and treat machine learning, and machine learning as a research tool, it is more necessary to strengthen the special research of venous thromboembolism and machine learning.

Prediction model of deep vein thrombosis risk after lower extremity orthopedic surgery

Purpose

This investigation was conceived to engineer and appraise a pioneering clinical nomogram, crafted to bridge the extant chasm in literature regarding the postoperative risk stratification for deep vein thrombosis (DVT) in the aftermath of lower extremity orthopedic procedures. This novel tool offers a sophisticated and discerning algorithm for risk prediction, heretofore unmet by existing methodologies.

Methods

In this retrospective observational study, clinical records of hospitalized patients who underwent lower extremity orthopedic surgery were collected at the Wuxi TCM Hospital Affiliated to the Nanjing University of Chinese Medicine between Jan 2017 and Oct 2019. The univariate and multivariate analysis with the backward stepwise method was applied to select features for the predictive nomogram. The performance of the nomogram was evaluated with respect to its discriminant capability, calibration ability, and clinical utility.

Result

A total of 5773 in-hospital patients were eligible for the study, with the incidence of deep vein thrombosis being approximately 1 % in this population. Among 31 variables included, 5 of them were identified to be the predictive features in the nomogram, including age, mean corpuscular hemoglobin concentration (MCHC), D-dimer, platelet distribution width (PDW), and thrombin time (TT). The area under the receiver operating characteristic (ROC) curve in the training and validation cohort was 85.9 % (95%CI: 79.96 %-90.04 %) and 85.7 % (95%CI: 78.96 %-90.69 %), respectively. Both the calibration curves and decision curve analysis demonstrated the overall satisfactory performance of the model.

Conclusion

Our groundbreaking nomogram is distinguished by its unparalleled accuracy in discriminative and calibrating functions, complemented by its tangible clinical applicability. This innovative instrument is set to empower clinicians with a robust framework for the accurate forecasting of postoperative DVT, thus facilitating the crafting of bespoke and prompt therapeutic strategies, aligning with the rigorous standards upheld by the most esteemed biomedical journals.

Machine Learning-Based Predictive Models for Patients with Venous Thromboembolism: A Systematic Review

BACKGROUND

 Venous thromboembolism (VTE) is a chronic disorder with a significant health and economic burden. Several VTE-specific clinical prediction models (CPMs) have been used to assist physicians in decision-making but have several limitations. This systematic review explores if machine learning (ML) can enhance CPMs by analyzing extensive patient data derived from electronic health records. We aimed to explore ML-CPMs' applications in VTE for risk stratification, outcome prediction, diagnosis, and treatment.

METHODS

 Three databases were searched: PubMed, Google Scholar, and IEEE electronic library. Inclusion criteria focused on studies using structured data, excluding non-English publications, studies on non-humans, and certain data types such as natural language processing and image processing. Studies involving pregnant women, cancer patients, and children were also excluded. After excluding irrelevant studies, a total of 77 studies were included.

RESULTS

 Most studies report that ML-CPMs outperformed traditional CPMs in terms of receiver operating area under the curve in the four clinical domains that were explored. However, the majority of the studies were retrospective, monocentric, and lacked detailed model architecture description and external validation, which are essential for quality audit. This review identified research gaps and highlighted challenges related to standardized reporting, reproducibility, and model comparison.

CONCLUSION

 ML-CPMs show promise in improving risk assessment and individualized treatment recommendations in VTE. Apparently, there is an urgent need for standardized reporting and methodology for ML models, external validation, prospective and real-world data studies, as well as interventional studies to evaluate the impact of artificial intelligence in VTE.

Comparison of different machine learning classification models for predicting deep vein thrombosis in lower extremity fractures

Deep vein thrombosis (DVT) is a common complication in patients with lower extremity fractures. Once it occurs, it will seriously affect the quality of life and postoperative recovery of patients. Therefore, early prediction and prevention of DVT can effectively improve the prognosis of patients. This study constructed different machine learning models to explore their effectiveness in predicting DVT. Five prediction models were applied to the study, including Extreme Gradient Boosting (XGBoost) model, Logistic Regression (LR) model, RandomForest (RF) model, Multilayer Perceptron (MLP) model, and Support Vector Machine (SVM) model. Afterwards, the performance of the obtained prediction models was evaluated by area under the curve (AUC), accuracy, sensitivity, specificity, F1 score, and Kappa. The prediction performances of the models based on machine learning are as follows: XGBoost model (AUC = 0.979, accuracy = 0.931), LR model (AUC = 0.821, accuracy = 0.758), RF model (AUC = 0.970, accuracy = 0.921), MLP model (AUC = 0.830, accuracy = 0.756), SVM model (AUC = 0.713, accuracy = 0.661). On our data set, the XGBoost model has the best performance. However, the model still needs external verification research before clinical application.

A machine learning model for diagnosing acute pulmonary embolism and comparison with Wells score, revised Geneva score, and Years algorithm

BACKGROUND

Acute pulmonary embolism (APE) is a fatal cardiovascular disease, yet missed diagnosis and misdiagnosis often occur due to non-specific symptoms and signs. A simple, objective technique will help clinicians make a quick and precise diagnosis. In population studies, machine learning (ML) plays a critical role in characterizing cardiovascular risks, predicting outcomes, and identifying biomarkers. This work sought to develop an ML model for helping APE diagnosis and compare it against current clinical probability assessment models.

METHODS

This is a single-center retrospective study. Patients with suspected APE were continuously enrolled and randomly divided into two groups including training and testing sets. A total of 8 ML models, including random forest (RF), Naïve Bayes, decision tree, K-nearest neighbors, logistic regression, multi-layer perceptron, support vector machine, and gradient boosting decision tree were developed based on the training set to diagnose APE. Thereafter, the model with the best diagnostic performance was selected and evaluated against the current clinical assessment strategies, including the Wells score, revised Geneva score, and Years algorithm. Eventually, the ML model was internally validated to assess the diagnostic performance using receiver operating characteristic (ROC) analysis.

RESULTS

The ML models were constructed using eight clinical features, including D-dimer, cardiac troponin T (cTNT), arterial oxygen saturation, heart rate, chest pain, lower limb pain, hemoptysis, and chronic heart failure. Among eight ML models, the RF model achieved the best performance with the highest area under the curve (AUC) (AUC = 0.774). Compared to the current clinical assessment strategies, the RF model outperformed the Wells score ( P = 0.030) and was not inferior to any other clinical probability assessment strategy. The AUC of the RF model for diagnosing APE onset in internal validation set was 0.726.

CONCLUSIONS

Based on RF algorithm, a novel prediction model was finally constructed for APE diagnosis. When compared to the current clinical assessment strategies, the RF model achieved better diagnostic efficacy and accuracy. Therefore, the ML algorithm can be a useful tool in assisting with the diagnosis of APE.

Using machine learning in the prediction of symptomatic venous thromboembolism following ankle fracture

BACKGROUND

Venous thromboembolism (VTE) is a major cause of morbidity and mortality in the trauma setting, and both prediction and prevention of VTE have long been a concern for healthcare providers in orthopedic surgery. The purpose of this study was to evaluate the use of novel statistical analysis and machine-learning in predicting the risk of VTE and the usefulness of prophylaxis following ankle fractures.

METHODS

The medical profiles of 16,421 patients with ankle fractures were screened retrospectively for symptomatic VTE. In total, 238 patients sustaining either surgical or nonsurgical treatment for ankle fracture with subsequently confirmed VTE within 180 days following the injury were placed in the case group. Alternatively, 937 patients who sustained ankle fractures managed similarly but had no documented evidence of VTE were randomly chosen as the control group. Individuals from both the case and control populations were also divided into those who had received VTE prophylaxis and those who had not. Over 110 variables were included. Conventional statistics and machine learning methods were used for data analysis.

RESULTS

Patients who had a motor vehicle accident, surgical treatment, increased hospital stay, and were on warfarin were shown to have a higher incidence of VTE, whereas patients who were on statins had a lower incidence of VTE. The highest Area Under the Receiver Operating Characteristic Curves (AUROC) showing the performance of our machine learning approach was 0.88 with 0.94 sensitivity and 0.36 specificity. The most balanced performance was seen in a model that was trained using selected variables with 0.86 AUROC, 0.75 sensitivity, and 0.85 specificity.

CONCLUSION

By using machine learning, this study successfully pinpointed several predictive factors linked to the occurrence or absence of VTE in patients who experienced an ankle fracture. Training these algorithms using larger, more granular, and multicentric data will further increase their validity and reliability and should be considered the standard for the development of such algorithms.

LEVEL OF EVIDENCE

Case-Control study - 3.

Coagulation parameters correlate to venous thromboembolism occurrence during the perioperative period in patients with spinal fractures

BACKGROUND

Venous thromboembolism (VTE) is one of the leading causes of mortality in hospitalized patients. However, whether the coagulation-related parameters of the hospitalized patients could be used to predict the occurrence of VTE in patients with spinal injury surgery remained unclear.

METHOD

The patients with spinal fractures who met the inclusion and exclusion criteria were enrolled to be analyzed using a retrospective analysis approach. The association of risk factors of enrolled patients and operations to VTE occurrence were analyzed. The activated partial thromboplastin time, prothrombin time, thrombin time, D-dimer (D-D), fibrinogen (FIB) and fibrinogen degradation products (FDP) were detected. ROC and HR analysis were applied to evaluate the correlation of coagulation-related parameters and other parameters to VTE occurrence.

RESULT

The indicators of D-D, FIB and FDP were significantly elevated in VTE patients compared to non-VTE patients. The multivariate analysis of OR showed that six risk factors, including age ≥ 60, spinal cord injury, postoperative bedtime over 5 days, plasma D-dimer ≥ 0.54 mg/L, plasma fibrinogen ≥ 3.75 g/L and plasma FDP ≥ 5.19 mg/L, were positively correlated to VTE.

CONCLUSION

The six risk factors, including D-D, FIB, FDP, age ≥ 60, spinal cord injury, and postoperative bedtime over 5 days, could be used to predict the occurrence of VTE.

Evaluation of Machine Learning Algorithms for Early Diagnosis of Deep Venous Thrombosis

Deep venous thrombosis (DVT) is a disease that must be diagnosed quickly, as it can trigger the death of patients. Nowadays, one can find different ways to determine it, including clinical scoring, D-dimer, ultrasonography, etc. Recently, scientists have focused efforts on using machine learning (ML) and neural networks for disease diagnosis, progressively increasing the accuracy and efficacy. Patients with suspected DVT have no apparent symptoms. Using pattern recognition techniques, aiding good timely diagnosis, as well as well-trained ML models help to make good decisions and validation. The aim of this paper is to propose several ML models for a more efficient and reliable DVT diagnosis through its implementation on an edge device for the development of instruments that are smart, portable, reliable, and cost-effective. The dataset was obtained from a state-of-the-art article. It is divided into 85% for training and cross-validation and 15% for testing. The input data in this study are the Wells criteria, the patient’s age, and the patient’s gender. The output data correspond to the patient’s diagnosis. This study includes the evaluation of several classifiers such as Decision Trees (DT), Extra Trees (ET), K-Nearest Neighbor (KNN), Multi-Layer Perceptron Neural Network (MLP-NN), Random Forest (RF), and Support Vector Machine (SVM). Finally, the implementation of these ML models on a high-performance embedded system is proposed to develop an intelligent system for early DVT diagnosis. It is reliable, portable, open source, and low cost. The performance of different ML algorithms was evaluated, where KNN achieved the highest accuracy of 90.4% and specificity of 80.66% implemented on personal computer (PC) and Raspberry Pi 4 (RPi4). The accuracy of all trained models on PC and Raspberry Pi 4 is greater than 85%, while the area under the curve (AUC) values are between 0.81 and 0.86. In conclusion, as compared to traditional methods, the best ML classifiers are effective at predicting DVT in an early and efficient manner.

The new SUMPOT to predict postoperative complications using an Artificial Neural Network

An accurate assessment of preoperative risk may improve use of hospital resources and reduce morbidity and mortality in high-risk surgical patients. This study aims at implementing an automated surgical risk calculator based on Artificial Neural Network technology to identify patients at risk for postoperative complications. We developed the new SUMPOT based on risk factors previously used in other scoring systems and tested it in a cohort of 560 surgical patients undergoing elective or emergency procedures and subsequently admitted to intensive care units, high-dependency units or standard wards. The whole dataset was divided into a training set, to train the predictive model, and a testing set, to assess generalization performance. The effectiveness of the Artificial Neural Network is a measure of the accuracy in detecting those patients who will develop postoperative complications. A total of 560 surgical patients entered the analysis. Among them, 77 patients (13.7%) suffered from one or more postoperative complications (PoCs), while 483 patients (86.3%) did not. The trained Artificial Neural Network returned an average classification accuracy of 90% in the testing set. Specifically, classification accuracy was 90.2% in the control group (46 patients out of 51 were correctly classified) and 88.9% in the PoC group (8 patients out of 9 were correctly classified). The Artificial Neural Network showed good performance in predicting presence/absence of postoperative complications, suggesting its potential value for perioperative management of surgical patients. Further clinical studies are required to confirm its applicability in routine clinical practice.

Machine learning with D-dimer in the risk stratification for pulmonary embolism: a derivation and internal validation study

AIM

To develop a machine learning model to predict the diagnosis of pulmonary embolism (PE).

METHODS AND RESULTS

We undertook a derivation and internal validation study to develop a risk prediction model for use in patients being investigated for possible PE. The machine learning technique, generalized logistic regression using elastic net, was chosen following an assessment of seven machine learning techniques and on the basis that it optimized the area under the receiver operator characteristic curve (AUC) and Brier score. Models were developed both with and without the addition of D-dimer. A total of 3347 patients were included in the study of whom, 219 (6.5%) had PE. Four clinical variables (O2 saturation, previous deep venous thrombosis or PE, immobilization or surgery, and alternative diagnosis equal or more likely than PE) plus D-dimer contributed to the machine learning models. The addition of D-dimer improved the AUC by 0.16 (95% confidence interval 0.13-0.19), from 0.73 to 0.89 (0.87-0.91) and decreased the Brier score by 14% (10-18%). More could be ruled out with a higher positive likelihood ratio than by the Wells score combined with D-dimer, revised Geneva score combined with D-dimer, or the Pulmonary Embolism Rule-out Criteria score. Machine learning with D-dimer maintained a low-false-negative rate at a true-negative rate of nearly 53%, which was better performance than any of the other alternatives.

CONCLUSION

A machine learning model outperformed traditional risk scores for the risk stratification of PE in the emergency department. However, external validation is needed.