1
|
Heo KY, Rajan PV, Khawaja S, Barber LA, Yoon ST. Machine learning approach to predict venous thromboembolism among patients undergoing multi-level spinal posterior instrumented fusion. JOURNAL OF SPINE SURGERY (HONG KONG) 2024; 10:214-223. [PMID: 38974487 PMCID: PMC11224786 DOI: 10.21037/jss-24-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 01/20/2024] [Accepted: 04/14/2024] [Indexed: 07/09/2024]
Abstract
Background The absence of consensus for prophylaxis of venous thromboembolism (VTE) in spine surgery underscores the importance of identifying patients at risk. This study incorporated machine learning (ML) models to assess key risk factors of VTE in patients who underwent posterior spinal instrumented fusion. Methods Data was collected from the IBM MarketScan Database [2009-2021] for patients ≥18 years old who underwent spinal posterior instrumentation (3-6 levels), excluding traumas, malignancies, and infections. VTE incidence (deep vein thrombosis and pulmonary embolism) was recorded 90-day post-surgery. Risk factors for VTE were investigated and compared through several ML models including logistic regression, linear support vector machine (LSVM), random forest, XGBoost, and neural networks. Results Among the 141,697 patients who underwent spinal fusion with posterior instrumentation (3-6 levels), the overall 90-day VTE rate was 3.81%. The LSVM model demonstrated the best prediction with an area under the curve (AUC) of 0.68. The most important features for prediction of VTE included remote history of VTE, diagnosis of chronic hypercoagulability, metastatic cancer, hemiplegia, and chronic renal disease. Patients who did not have these five key risk factors had a 90-day VTE rate of 2.95%. Patients who had an increasing number of key risk factors had subsequently higher risks of postoperative VTE. Conclusions The analysis of the data with different ML models identified 5 key variables that are most closely associated with VTE. Using these variables, we have developed a simple risk model with additive odds ratio ranging from 2.80 (1 risk factor) to 46.92 (4 risk factors) over 90 days after posterior spinal fusion surgery. These findings can help surgeons risk-stratify their patients for VTE risk, and potentially guide subsequent chemoprophylaxis.
Collapse
Affiliation(s)
- Kevin Y Heo
- Department of Orthopaedic Surgery, Emory University School of Medicine, Atlanta, GA, USA
| | - Prashant V Rajan
- Department of Orthopaedic Surgery, Emory University School of Medicine, Atlanta, GA, USA
| | - Sameer Khawaja
- Department of Orthopaedic Surgery, Emory University School of Medicine, Atlanta, GA, USA
| | - Lauren A Barber
- Department of Orthopaedic Surgery, Emory University School of Medicine, Atlanta, GA, USA
| | - Sangwook Tim Yoon
- Department of Orthopaedic Surgery, Emory University School of Medicine, Atlanta, GA, USA
| |
Collapse
|
2
|
Stamate E, Piraianu AI, Ciobotaru OR, Crassas R, Duca O, Fulga A, Grigore I, Vintila V, Fulga I, Ciobotaru OC. Revolutionizing Cardiology through Artificial Intelligence-Big Data from Proactive Prevention to Precise Diagnostics and Cutting-Edge Treatment-A Comprehensive Review of the Past 5 Years. Diagnostics (Basel) 2024; 14:1103. [PMID: 38893630 PMCID: PMC11172021 DOI: 10.3390/diagnostics14111103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Revised: 05/12/2024] [Accepted: 05/23/2024] [Indexed: 06/21/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI) can radically change almost every aspect of the human experience. In the medical field, there are numerous applications of AI and subsequently, in a relatively short time, significant progress has been made. Cardiology is not immune to this trend, this fact being supported by the exponential increase in the number of publications in which the algorithms play an important role in data analysis, pattern discovery, identification of anomalies, and therapeutic decision making. Furthermore, with technological development, there have appeared new models of machine learning (ML) and deep learning (DP) that are capable of exploring various applications of AI in cardiology, including areas such as prevention, cardiovascular imaging, electrophysiology, interventional cardiology, and many others. In this sense, the present article aims to provide a general vision of the current state of AI use in cardiology. RESULTS We identified and included a subset of 200 papers directly relevant to the current research covering a wide range of applications. Thus, this paper presents AI applications in cardiovascular imaging, arithmology, clinical or emergency cardiology, cardiovascular prevention, and interventional procedures in a summarized manner. Recent studies from the highly scientific literature demonstrate the feasibility and advantages of using AI in different branches of cardiology. CONCLUSIONS The integration of AI in cardiology offers promising perspectives for increasing accuracy by decreasing the error rate and increasing efficiency in cardiovascular practice. From predicting the risk of sudden death or the ability to respond to cardiac resynchronization therapy to the diagnosis of pulmonary embolism or the early detection of valvular diseases, AI algorithms have shown their potential to mitigate human error and provide feasible solutions. At the same time, limits imposed by the small samples studied are highlighted alongside the challenges presented by ethical implementation; these relate to legal implications regarding responsibility and decision making processes, ensuring patient confidentiality and data security. All these constitute future research directions that will allow the integration of AI in the progress of cardiology.
Collapse
Affiliation(s)
- Elena Stamate
- Department of Cardiology, Emergency University Hospital of Bucharest, 050098 Bucharest, Romania; (E.S.); (V.V.)
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
| | - Alin-Ionut Piraianu
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
| | - Oana Roxana Ciobotaru
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Railway Hospital Galati, 800223 Galati, Romania
| | - Rodica Crassas
- Emergency County Hospital Braila, 810325 Braila, Romania;
| | - Oana Duca
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Emergency County Hospital Braila, 810325 Braila, Romania;
| | - Ana Fulga
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei Street, 800578 Galati, Romania
| | - Ionica Grigore
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Emergency County Hospital Braila, 810325 Braila, Romania;
| | - Vlad Vintila
- Department of Cardiology, Emergency University Hospital of Bucharest, 050098 Bucharest, Romania; (E.S.); (V.V.)
- Clinical Department of Cardio-Thoracic Pathology, University of Medicine and Pharmacy “Carol Davila” Bucharest, 37 Dionisie Lupu Street, 4192910 Bucharest, Romania
| | - Iuliu Fulga
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei Street, 800578 Galati, Romania
| | - Octavian Catalin Ciobotaru
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Railway Hospital Galati, 800223 Galati, Romania
| |
Collapse
|
3
|
Danilatou V, Dimopoulos D, Kostoulas T, Douketis J. Machine Learning-Based Predictive Models for Patients with Venous Thromboembolism: A Systematic Review. Thromb Haemost 2024. [PMID: 38574756 DOI: 10.1055/a-2299-4758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/06/2024]
Abstract
BACKGROUND Venous thromboembolism (VTE) is a chronic disorder with a significant health and economic burden. Several VTE-specific clinical prediction models (CPMs) have been used to assist physicians in decision-making but have several limitations. This systematic review explores if machine learning (ML) can enhance CPMs by analyzing extensive patient data derived from electronic health records. We aimed to explore ML-CPMs' applications in VTE for risk stratification, outcome prediction, diagnosis, and treatment. METHODS Three databases were searched: PubMed, Google Scholar, and IEEE electronic library. Inclusion criteria focused on studies using structured data, excluding non-English publications, studies on non-humans, and certain data types such as natural language processing and image processing. Studies involving pregnant women, cancer patients, and children were also excluded. After excluding irrelevant studies, a total of 77 studies were included. RESULTS Most studies report that ML-CPMs outperformed traditional CPMs in terms of receiver operating area under the curve in the four clinical domains that were explored. However, the majority of the studies were retrospective, monocentric, and lacked detailed model architecture description and external validation, which are essential for quality audit. This review identified research gaps and highlighted challenges related to standardized reporting, reproducibility, and model comparison. CONCLUSION ML-CPMs show promise in improving risk assessment and individualized treatment recommendations in VTE. Apparently, there is an urgent need for standardized reporting and methodology for ML models, external validation, prospective and real-world data studies, as well as interventional studies to evaluate the impact of artificial intelligence in VTE.
Collapse
Affiliation(s)
- Vasiliki Danilatou
- School of Medicine, European University of Cyprus, Nicosia, Cyprus
- Healthcare Division, Sphynx Technology Solutions, Nicosia, Cyprus
| | - Dimitrios Dimopoulos
- School of Engineering, Department of Information and Communication Systems Engineering, University of the Aegean, North Aegean, Greece
| | - Theodoros Kostoulas
- School of Engineering, Department of Information and Communication Systems Engineering, University of the Aegean, North Aegean, Greece
| | - James Douketis
- Department of Medicine, McMaster University, Hamilton, Canada
- Department of Medicine, St. Joseph's Healthcare Hamilton, Ontario, Canada
| |
Collapse
|
4
|
Watson C, Saaid H, Vedula V, Cardenas JC, Henke PK, Nicoud F, Xu XY, Hunt BJ, Manning KB. Venous Thromboembolism: Review of Clinical Challenges, Biology, Assessment, Treatment, and Modeling. Ann Biomed Eng 2024; 52:467-486. [PMID: 37914979 DOI: 10.1007/s10439-023-03390-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Accepted: 10/17/2023] [Indexed: 11/03/2023]
Abstract
Venous thromboembolism (VTE) is a massive clinical challenge, annually affecting millions of patients globally. VTE is a particularly consequential pathology, as incidence is correlated with extremely common risk factors, and a large cohort of patients experience recurrent VTE after initial intervention. Altered hemodynamics, hypercoagulability, and damaged vascular tissue cause deep-vein thrombosis and pulmonary embolism, the two permutations of VTE. Venous valves have been identified as likely locations for initial blood clot formation, but the exact pathway by which thrombosis occurs in this environment is not entirely clear. Several risk factors are known to increase the likelihood of VTE, particularly those that increase inflammation and coagulability, increase venous resistance, and damage the endothelial lining. While these risk factors are useful as predictive tools, VTE diagnosis prior to presentation of outward symptoms is difficult, chiefly due to challenges in successfully imaging deep-vein thrombi. Clinically, VTE can be managed by anticoagulants or mechanical intervention. Recently, direct oral anticoagulants and catheter-directed thrombolysis have emerged as leading tools in resolution of venous thrombosis. While a satisfactory VTE model has yet to be developed, recent strides have been made in advancing in silico models of venous hemodynamics, hemorheology, fluid-structure interaction, and clot growth. These models are often guided by imaging-informed boundary conditions or inspired by benchtop animal models. These gaps in knowledge are critical targets to address necessary improvements in prediction and diagnosis, clinical management, and VTE experimental and computational models.
Collapse
Affiliation(s)
- Connor Watson
- Department of Biomedical Engineering, The Pennsylvania State University, 122 Chemical and Biomedical Engineering Building, University Park, PA, 16802-4400, USA
| | - Hicham Saaid
- Department of Biomedical Engineering, The Pennsylvania State University, 122 Chemical and Biomedical Engineering Building, University Park, PA, 16802-4400, USA
| | - Vijay Vedula
- Department of Mechanical Engineering, Fu Foundation School of Engineering and Applied Science, Columbia University, New York, NY, USA
| | - Jessica C Cardenas
- Department of Surgery and the Center for Translational Injury Research, McGovern Medical School, University of Texas Health Science Center, Houston, TX, USA
| | - Peter K Henke
- Section of Vascular Surgery, Department of Surgery, University of Michigan Health System, Ann Arbor, MI, USA
| | - Franck Nicoud
- CNRS, IMAG, Université de Montpellier, Montpellier, France
- Institut Universitaire de France, Paris, France
| | - Xiao Yun Xu
- Department of Chemical Engineering, Imperial College London, London, UK
| | - Beverley J Hunt
- Department of Thrombosis and Haemostasis, King's College, London, UK
- Thrombosis and Haemophilia Centre, Guy's & St Thomas' NHS Trust, London, UK
| | - Keefe B Manning
- Department of Biomedical Engineering, The Pennsylvania State University, 122 Chemical and Biomedical Engineering Building, University Park, PA, 16802-4400, USA.
- Department of Surgery, Penn State Hershey Medical Center, Hershey, PA, USA.
| |
Collapse
|
5
|
Ghanem M, Ghaith AK, El-Hajj VG, Bhandarkar A, de Giorgio A, Elmi-Terander A, Bydon M. Limitations in Evaluating Machine Learning Models for Imbalanced Binary Outcome Classification in Spine Surgery: A Systematic Review. Brain Sci 2023; 13:1723. [PMID: 38137171 PMCID: PMC10741524 DOI: 10.3390/brainsci13121723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 12/12/2023] [Accepted: 12/15/2023] [Indexed: 12/24/2023] Open
Abstract
Clinical prediction models for spine surgery applications are on the rise, with an increasing reliance on machine learning (ML) and deep learning (DL). Many of the predicted outcomes are uncommon; therefore, to ensure the models' effectiveness in clinical practice it is crucial to properly evaluate them. This systematic review aims to identify and evaluate current research-based ML and DL models applied for spine surgery, specifically those predicting binary outcomes with a focus on their evaluation metrics. Overall, 60 papers were included, and the findings were reported according to the PRISMA guidelines. A total of 13 papers focused on lengths of stay (LOS), 12 on readmissions, 12 on non-home discharge, 6 on mortality, and 5 on reoperations. The target outcomes exhibited data imbalances ranging from 0.44% to 42.4%. A total of 59 papers reported the model's area under the receiver operating characteristic (AUROC), 28 mentioned accuracies, 33 provided sensitivity, 29 discussed specificity, 28 addressed positive predictive value (PPV), 24 included the negative predictive value (NPV), 25 indicated the Brier score with 10 providing a null model Brier, and 8 detailed the F1 score. Additionally, data visualization varied among the included papers. This review discusses the use of appropriate evaluation schemes in ML and identifies several common errors and potential bias sources in the literature. Embracing these recommendations as the field advances may facilitate the integration of reliable and effective ML models in clinical settings.
Collapse
Affiliation(s)
- Marc Ghanem
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
- School of Medicine, Lebanese American University, Byblos 4504, Lebanon
| | - Abdul Karim Ghaith
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| | - Victor Gabriel El-Hajj
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
- Department of Clinical Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
| | - Archis Bhandarkar
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| | - Andrea de Giorgio
- Artificial Engineering, Via del Rione Sirignano, 80121 Naples, Italy;
| | - Adrian Elmi-Terander
- Department of Clinical Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
- Department of Surgical Sciences, Uppsala University, 75236 Uppsala, Sweden
| | - Mohamad Bydon
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| |
Collapse
|
6
|
Katiyar P, Chase H, Lenke LG, Weidenbaum M, Sardar ZM. Using Machine Learning (ML) Models to Predict Risk of Venous Thromboembolism (VTE) Following Spine Surgery. Clin Spine Surg 2023; 36:E453-E456. [PMID: 37482644 PMCID: PMC10805960 DOI: 10.1097/bsd.0000000000001498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Accepted: 06/21/2023] [Indexed: 07/25/2023]
Abstract
STUDY DESIGN A retrospective cohort study. OBJECTIVES Venous thromboembolism (VTE) is a potentially high-risk complication for patients undergoing spine surgery. Although guidelines for assessing VTE risk in this population have been established, development of new techniques that target different aspects of the medical history may prove to be of further utility. The goal of this study was to develop a predictive machine learning (ML) model to identify nontraditional risk factors for predicting VTE in spine surgery patients. SUMMARY OF BACKGROUND DATA A cohort of 63 patients was identified who had undergone spine surgery at a single center from 2015 to 2021. Thirty-one patients had a confirmed VTE, while 32 had no VTE. A total of 113 attributes were defined and collected via chart review. Attribute categories included demographics, medications, labs, past medical history, operative history, and VTE diagnosis. METHODS The Waikato Environment for Knowledge Analysis (WEKA) software was used in creating and evaluating the ML models. Six classifier models were tested with 10-fold cross-validation and statistically evaluated using t tests. RESULTS Comparing the predictive ML models to the control model (ZeroR), all predictive models were significantly better than the control model at predicting VTE risk, based on the 113 attributes ( P <0.001). The Random Forest model had the highest accuracy of 88.89% with a positive predictive value of 93.75%. The Simple Logistic algorithm had an accuracy of 84.13% and defined risk attributes to include calcium and phosphate laboratory values, history of cardiac comorbidity, history of previous VTE, anesthesia time, selective serotonin reuptake inhibitor use, antibiotic use, and antihistamine use. The J48 model had an accuracy of 80.95% and it defined hemoglobin laboratory values, anesthesia time, beta-blocker use, dopamine agonist use, history of cancer, and Medicare use as potential VTE risk factors. CONCLUSION Further development of these tools may provide high diagnostic value and may guide chemoprophylaxis treatment in this setting of high-risk patients.
Collapse
Affiliation(s)
- Prerana Katiyar
- Columbia University Vagelos College of Physicians and Surgeons
| | | | - Lawrence G. Lenke
- Columbia University Irving Medical Center
- Och Spine Hospital at New York Presbyterian
| | - Mark Weidenbaum
- Columbia University Irving Medical Center
- Och Spine Hospital at New York Presbyterian
| | - Zeeshan M. Sardar
- Columbia University Irving Medical Center
- Och Spine Hospital at New York Presbyterian
| |
Collapse
|
7
|
Wellington IJ, Karsmarski OP, Murphy KV, Shuman ME, Ng MK, Antonacci CL. The use of machine learning for predicting candidates for outpatient spine surgery: a review. JOURNAL OF SPINE SURGERY (HONG KONG) 2023; 9:323-330. [PMID: 37841781 PMCID: PMC10570640 DOI: 10.21037/jss-22-121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Accepted: 06/14/2023] [Indexed: 10/17/2023]
Abstract
While spine surgery has historically been performed in the inpatient setting, in recent years there has been growing interest in performing certain cervical and lumbar spine procedures on an outpatient basis. While conducting these procedures in the outpatient setting may be preferable for both the surgeon and the patient, appropriate patient selection is crucial. The employment of machine learning techniques for data analysis and outcome prediction has grown in recent years within spine surgery literature. Machine learning is a form of statistics often applied to large datasets that creates predictive models, with minimal to no human intervention, that can be applied to previously unseen data. Machine learning techniques may outperform traditional logistic regression with regards to predictive accuracy when analyzing complex datasets. Researchers have applied machine learning to develop algorithms to aid in patient selection for spinal surgery and to predict postoperative outcomes. Furthermore, there has been increasing interest in using machine learning to assist in the selection of patients who may be appropriate candidates for outpatient cervical and lumbar spine surgery. The goal of this review is to discuss the current literature utilizing machine learning to predict appropriate patients for cervical and lumbar spine surgery, candidates for outpatient spine surgery, and outcomes following these procedures.
Collapse
Affiliation(s)
- Ian J. Wellington
- Department of Orthopaedic Surgery, University of Connecticut, Farmington, CT, USA
| | - Owen P. Karsmarski
- Department of Orthopaedic Surgery, University of Connecticut, Farmington, CT, USA
| | - Kyle V. Murphy
- Department of Orthopaedic Surgery, University of Connecticut, Farmington, CT, USA
| | - Matthew E. Shuman
- Department of Orthopaedic Surgery, University of Connecticut, Farmington, CT, USA
| | - Mitchell K. Ng
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | | |
Collapse
|
8
|
Hopkins BS, Cloney MB, Dhillon ES, Texakalidis P, Dallas J, Nguyen VN, Ordon M, Tecle NE, Chen TC, Hsieh PC, Liu JC, Koski TR, Dahdaleh NS. Using machine learning and big data for the prediction of venous thromboembolic events after spine surgery: A single-center retrospective analysis of multiple models on a cohort of 6869 patients. JOURNAL OF CRANIOVERTEBRAL JUNCTION AND SPINE 2023; 14:221-229. [PMID: 37860027 PMCID: PMC10583792 DOI: 10.4103/jcvjs.jcvjs_69_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Accepted: 07/12/2023] [Indexed: 10/21/2023] Open
Abstract
Objective Venous thromboembolic event (VTE) after spine surgery is a rare but potentially devastating complication. With the advent of machine learning, an opportunity exists for more accurate prediction of such events to aid in prevention and treatment. Methods Seven models were screened using 108 database variables and 62 preoperative variables. These models included deep neural network (DNN), DNN with synthetic minority oversampling technique (SMOTE), logistic regression, ridge regression, lasso regression, simple linear regression, and gradient boosting classifier. Relevant metrics were compared between each model. The top four models were selected based on area under the receiver operator curve; these models included DNN with SMOTE, linear regression, lasso regression, and ridge regression. Separate random sampling of each model was performed 1000 additional independent times using a randomly generated training/testing distribution. Variable weights and magnitudes were analyzed after sampling. Results Using all patient-related variables, DNN using SMOTE was the top-performing model in predicting postoperative VTE after spinal surgery (area under the curve [AUC] =0.904), followed by lasso regression (AUC = 0.894), ridge regression (AUC = 0.873), and linear regression (AUC = 0.864). When analyzing a subset of only preoperative variables, the top-performing models were lasso regression (AUC = 0.865) and DNN with SMOTE (AUC = 0.864), both of which outperform any currently published models. Main model contributions relied heavily on variables associated with history of thromboembolic events, length of surgical/anesthetic time, and use of postoperative chemoprophylaxis. Conclusions The current study provides promise toward machine learning methods geared toward predicting postoperative complications after spine surgery. Further study is needed in order to best quantify and model real-world risk for such events.
Collapse
Affiliation(s)
- Benjamin S. Hopkins
- Department of Neurological Surgery, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA
| | - Michael B. Cloney
- Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Ekamjeet S. Dhillon
- Department of Orthopaedics and Sports Medicine, University of Washington, Seattle, WA, USA
| | - Pavlos Texakalidis
- Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Jonathan Dallas
- Department of Neurological Surgery, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA
| | - Vincent N. Nguyen
- Department of Neurological Surgery, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA
| | - Matthew Ordon
- Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Najib El Tecle
- Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Thomas C. Chen
- Department of Neurological Surgery, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA
| | - Patrick C. Hsieh
- Department of Neurological Surgery, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA
| | - John C. Liu
- Department of Neurological Surgery, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA
| | - Tyler R. Koski
- Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Nader S. Dahdaleh
- Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| |
Collapse
|
9
|
Ngan A, Song J, Katz AD, Jung B, Zappia L, Trent S, Silber J, Virk S, Essig D. Venous Thromboembolism Rates Have Not Decreased in Elective Lumbar Fusion Surgery from 2011 to 2020. Global Spine J 2023:21925682231173642. [PMID: 37116184 DOI: 10.1177/21925682231173642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/30/2023] Open
Abstract
STUDY DESIGN Retrospective cohort study. OBJECTIVES This study aimed to (1) evaluate for any temporal trends in the rates of VTE, deep venous thrombosis (DVT), pulmonary embolism (PE), and mortality from 2011 to 2020 and (2) identify the predictors of VTE following lumbar fusion surgery. METHODS Annual incidences of 30-day VTE, DVT, PE, and mortality were calculated for each of the operation year groups from 2011 to 2020. Multivariable Poisson regression was utilized to test the association between operation year and primary outcomes, as well as to identify significant predictors of VTE. RESULTS A total of 121,205 patients were included. There were no statistically significant differences in VTE, DVT, PE, or mortality rates among the operation year groups. Multivariable regression analysis revealed that compared to 2011, operation year 2019 was associated with significantly lower rates of DVT. Age, BMI, prolonged operation time, prolonged length of stay, non-home discharge, anterior fusion, smoking status, functional dependence, and chronic steroid use were identified as independent predictors of VTE following lumbar fusion. Female sex, Hispanic ethnicity, and outpatient surgery setting were identified as protective factors from VTE in this cohort. CONCLUSIONS Rates of VTE after lumbar fusion have remained mostly unchanged between 2011 and 2020. Older age, higher BMI, longer operation time, prolonged length of stay, non-home discharge, anterior fusion, smoking, functional dependence, and steroid use were independent predictors of VTE after lumbar fusion, while female sex, Hispanic ethnicity, and outpatient surgery were the protective factors.
Collapse
Affiliation(s)
- Alex Ngan
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| | - Junho Song
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| | - Austen D Katz
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| | - Bongseok Jung
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| | - Luke Zappia
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| | - Sarah Trent
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| | - Jeff Silber
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| | - Sohrab Virk
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| | - David Essig
- Northwell Health Long Island Jewish Medical Center, New Hyde Park, NY, USA
| |
Collapse
|
10
|
Gao KT, Tibrewala R, Hess M, Bharadwaj UU, Inamdar G, Link TM, Chin CT, Pedoia V, Majumdar S. Automatic detection and voxel‐wise mapping of lumbar spine Modic changes with deep learning. JOR Spine 2022; 5:e1204. [PMID: 35783915 PMCID: PMC9238279 DOI: 10.1002/jsp2.1204] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Revised: 05/01/2022] [Accepted: 05/05/2022] [Indexed: 11/14/2022] Open
Abstract
Background Modic changes (MCs) are the most prevalent classification system for describing magnetic resonance imaging (MRI) signal intensity changes in the vertebrae. However, there is a growing need for novel quantitative and standardized methods of characterizing these anomalies, particularly for lesions of transitional or mixed nature, due to the lack of conclusive evidence of their associations with low back pain. This retrospective imaging study aims to develop an interpretable deep learning‐based detection tool for voxel‐wise mapping of MCs. Methods Seventy‐five lumbar spine MRI exams that presented with acute‐to‐chronic low back pain, radiculopathy, and other symptoms of the lumbar spine were enrolled. The pipeline consists of two deep convolutional neural networks to generate an interpretable voxel‐wise Modic map. First, an autoencoder was trained to segment vertebral bodies from T1‐weighted sagittal lumbar spine images. Next, two radiologists segmented and labeled MCs from a combined T1‐ and T2‐weighted assessment to serve as ground truth for training a second autoencoder that performs segmentation of MCs. The voxels in the detected regions were then categorized to the appropriate Modic type using a rule‐based signal intensity algorithm. Post hoc, three radiologists independently graded a second dataset with the aid of the model predictions in an artificial (AI)‐assisted experiment. Results The model successfully identified the presence of changes in 85.7% of samples in the unseen test set with a sensitivity of 0.71 (±0.072), specificity of 0.95 (±0.022), and Cohen's kappa score of 0.63. In the AI‐assisted experiment, the agreement between the junior radiologist and the senior neuroradiologist significantly improved from Cohen's kappa score of 0.52 to 0.58 (p < 0.05). Conclusions This deep learning‐based approach demonstrates substantial agreement with radiologists and may serve as a tool to improve inter‐rater reliability in the assessment of MCs.
Collapse
Affiliation(s)
- Kenneth T. Gao
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
- Department of Bioengineering University of California Berkeley–University of California San Francisco Graduate Program in Bioengineering Berkeley California USA
| | - Radhika Tibrewala
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
| | - Madeline Hess
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
| | - Upasana U. Bharadwaj
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
| | - Gaurav Inamdar
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
| | - Thomas M. Link
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
| | - Cynthia T. Chin
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
| | - Valentina Pedoia
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
| | - Sharmila Majumdar
- Department of Radiology and Biomedical Imaging University of California, San Francisco San Francisco California USA
| |
Collapse
|
11
|
Saravi B, Hassel F, Ülkümen S, Zink A, Shavlokhova V, Couillard-Despres S, Boeker M, Obid P, Lang GM. Artificial Intelligence-Driven Prediction Modeling and Decision Making in Spine Surgery Using Hybrid Machine Learning Models. J Pers Med 2022; 12:jpm12040509. [PMID: 35455625 PMCID: PMC9029065 DOI: 10.3390/jpm12040509] [Citation(s) in RCA: 37] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 03/18/2022] [Accepted: 03/19/2022] [Indexed: 12/22/2022] Open
Abstract
Healthcare systems worldwide generate vast amounts of data from many different sources. Although of high complexity for a human being, it is essential to determine the patterns and minor variations in the genomic, radiological, laboratory, or clinical data that reliably differentiate phenotypes or allow high predictive accuracy in health-related tasks. Convolutional neural networks (CNN) are increasingly applied to image data for various tasks. Its use for non-imaging data becomes feasible through different modern machine learning techniques, converting non-imaging data into images before inputting them into the CNN model. Considering also that healthcare providers do not solely use one data modality for their decisions, this approach opens the door for multi-input/mixed data models which use a combination of patient information, such as genomic, radiological, and clinical data, to train a hybrid deep learning model. Thus, this reflects the main characteristic of artificial intelligence: simulating natural human behavior. The present review focuses on key advances in machine and deep learning, allowing for multi-perspective pattern recognition across the entire information set of patients in spine surgery. This is the first review of artificial intelligence focusing on hybrid models for deep learning applications in spine surgery, to the best of our knowledge. This is especially interesting as future tools are unlikely to use solely one data modality. The techniques discussed could become important in establishing a new approach to decision-making in spine surgery based on three fundamental pillars: (1) patient-specific, (2) artificial intelligence-driven, (3) integrating multimodal data. The findings reveal promising research that already took place to develop multi-input mixed-data hybrid decision-supporting models. Their implementation in spine surgery may hence be only a matter of time.
Collapse
Affiliation(s)
- Babak Saravi
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
- Institute of Experimental Neuroregeneration, Spinal Cord Injury and Tissue Regeneration Center Salzburg (SCI-TReCS), Paracelsus Medical University, 5020 Salzburg, Austria;
- Correspondence:
| | - Frank Hassel
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Sara Ülkümen
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Alisia Zink
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Veronika Shavlokhova
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany;
| | - Sebastien Couillard-Despres
- Institute of Experimental Neuroregeneration, Spinal Cord Injury and Tissue Regeneration Center Salzburg (SCI-TReCS), Paracelsus Medical University, 5020 Salzburg, Austria;
- Austrian Cluster for Tissue Regeneration, 1200 Vienna, Austria
| | - Martin Boeker
- Intelligence and Informatics in Medicine, Medical Center Rechts der Isar, School of Medicine, Technical University of Munich, 81675 Munich, Germany;
| | - Peter Obid
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
| | - Gernot Michael Lang
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
| |
Collapse
|