1
|
Ton A, Wishart D, Ball JR, Shah I, Murakami K, Ordon MP, Alluri RK, Hah R, Safaee MM. The Evolution of Risk Assessment in Spine Surgery: A Narrative Review. World Neurosurg 2024; 188:1-14. [PMID: 38677646 DOI: 10.1016/j.wneu.2024.04.117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 04/17/2024] [Accepted: 04/18/2024] [Indexed: 04/29/2024]
Abstract
BACKGROUND Risk assessment is critically important in elective and high-risk interventions, particularly spine surgery. This narrative review describes the evolution of risk assessment from the earliest instruments focused on general surgical risk stratification, to more accurate and spine-specific risk calculators that quantified risk, to the current era of big data. METHODS The PubMed and SCOPUS databases were queried on October 11, 2023 using search terms to identify risk assessment tools (RATs) in spine surgery. A total of 108 manuscripts were included after screening with full-text review using the following inclusion criteria: 1) study population of adult spine surgical patients, 2) studies describing validation and subsequent performance of preoperative RATs, and 3) studies published in English. RESULTS Early RATs provided stratified patients into broad categories and allowed for improved communication between physicians. Subsequent risk calculators attempted to quantify risk by estimating general outcomes such as mortality, but then evolved to estimate spine-specific surgical complications. The integration of novel concepts such as invasiveness, frailty, genetic biomarkers, and sarcopenia led to the development of more sophisticated predictive models that estimate the risk of spine-specific complications and long-term outcomes. CONCLUSIONS RATs have undergone a transformative shift from generalized risk stratification to quantitative predictive models. The next generation of tools will likely involve integration of radiographic and genetic biomarkers, machine learning, and artificial intelligence to improve the accuracy of these models and better inform patients, surgeons, and payers.
Collapse
Affiliation(s)
- Andy Ton
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Danielle Wishart
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Jacob R Ball
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Ishan Shah
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Kiley Murakami
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Matthew P Ordon
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - R Kiran Alluri
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Raymond Hah
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Michael M Safaee
- Department of Neurological Surgery, Keck School of MedicineUniversity of Southern California, Los Angeles, California, USA.
| |
Collapse
|
2
|
Ren S, Yang L, Du J, He M, Shen B. DRGKB: a knowledgebase of worldwide diagnosis-related groups' practices for comparison, evaluation and knowledge-guided application. Database (Oxford) 2024; 2024:baae046. [PMID: 38843311 PMCID: PMC11155695 DOI: 10.1093/database/baae046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 01/08/2024] [Accepted: 05/15/2024] [Indexed: 06/09/2024]
Abstract
As a prospective payment method, diagnosis-related groups (DRGs)'s implementation has varying effects on different regions and adopt different case classification systems. Our goal is to build a structured public online knowledgebase describing the worldwide practice of DRGs, which includes systematic indicators for DRGs' performance assessment. Therefore, we manually collected the qualified literature from PUBMED and constructed DRGKB website. We divided the evaluation indicators into four categories, including (i) medical service quality; (ii) medical service efficiency; (iii) profitability and sustainability; (iv) case grouping ability. Then we carried out descriptive analysis and comprehensive scoring on outcome measurements performance, improvement strategy and specialty performance. At last, the DRGKB finally contains 297 entries. It was found that DRGs generally have a considerable impact on hospital operations, including average length of stay, medical quality and use of medical resources. At the same time, the current DRGs also have many deficiencies, including insufficient reimbursement rates and the ability to classify complex cases. We analyzed these underperforming parts by domain. In conclusion, this research innovatively constructed a knowledgebase to quantify the practice effects of DRGs, analyzed and visualized the development trends and area performance from a comprehensive perspective. This study provides a data-driven research paradigm for following DRGs-related work along with a proposed DRGs evolution model. Availability and implementation: DRGKB is freely available at http://www.sysbio.org.cn/drgkb/. Database URL: http://www.sysbio.org.cn/drgkb/.
Collapse
Affiliation(s)
- Shumin Ren
- Department of Pharmacy and Institutes for Systems Genetics, West China Hospital, Sichuan University, Frontiers Science Center for Disease-Related Molecular Network, Xinchuan Road 2222, Chengdu 610041, China
- Department of Computer Science and Information Technology, University of A Coruña, Faculty of Infomation, Campus of Elvina, A Coruña 15071, Spain
| | - Lin Yang
- Department of Pharmacy and Institutes for Systems Genetics, West China Hospital, Sichuan University, Frontiers Science Center for Disease-Related Molecular Network, Xinchuan Road 2222, Chengdu 610041, China
| | - Jiale Du
- Department of Pharmacy and Institutes for Systems Genetics, West China Hospital, Sichuan University, Frontiers Science Center for Disease-Related Molecular Network, Xinchuan Road 2222, Chengdu 610041, China
| | - Mengqiao He
- Department of Pharmacy and Institutes for Systems Genetics, West China Hospital, Sichuan University, Frontiers Science Center for Disease-Related Molecular Network, Xinchuan Road 2222, Chengdu 610041, China
| | - Bairong Shen
- Department of Pharmacy and Institutes for Systems Genetics, West China Hospital, Sichuan University, Frontiers Science Center for Disease-Related Molecular Network, Xinchuan Road 2222, Chengdu 610041, China
| |
Collapse
|
3
|
Adida S, Legarreta AD, Hudson JS, McCarthy D, Andrews E, Shanahan R, Taori S, Lavadi RS, Buell TJ, Hamilton DK, Agarwal N, Gerszten PC. Machine Learning in Spine Surgery: A Narrative Review. Neurosurgery 2024; 94:53-64. [PMID: 37930259 DOI: 10.1227/neu.0000000000002660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 07/06/2023] [Indexed: 11/07/2023] Open
Abstract
Artificial intelligence and machine learning (ML) can offer revolutionary advances in their application to the field of spine surgery. Within the past 5 years, novel applications of ML have assisted in surgical decision-making, intraoperative imaging and navigation, and optimization of clinical outcomes. ML has the capacity to address many different clinical needs and improve diagnostic and surgical techniques. This review will discuss current applications of ML in the context of spine surgery by breaking down its implementation preoperatively, intraoperatively, and postoperatively. Ethical considerations to ML and challenges in ML implementation must be addressed to maximally benefit patients, spine surgeons, and the healthcare system. Areas for future research in augmented reality and mixed reality, along with limitations in generalizability and bias, will also be highlighted.
Collapse
Affiliation(s)
- Samuel Adida
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Andrew D Legarreta
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Joseph S Hudson
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - David McCarthy
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Edward Andrews
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Regan Shanahan
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Suchet Taori
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Raj Swaroop Lavadi
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Thomas J Buell
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - D Kojo Hamilton
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Nitin Agarwal
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
- Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh , Pennsylvania , USA
| | - Peter C Gerszten
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| |
Collapse
|
4
|
Tragaris T, Benetos IS, Vlamis J, Pneumaticos S. Machine Learning Applications in Spine Surgery. Cureus 2023; 15:e48078. [PMID: 38046496 PMCID: PMC10689893 DOI: 10.7759/cureus.48078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/31/2023] [Indexed: 12/05/2023] Open
Abstract
This literature review sought to identify and evaluate the current applications of artificial intelligence (AI)/machine learning (ML) in spine surgery that can effectively guide clinical decision-making and surgical planning. By using specific keywords to maximize search sensitivity, a thorough literature research was conducted in several online databases: Scopus, PubMed, and Google Scholar, and the findings were filtered according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A total of 46 studies met the requirements and were included in this review. According to this study, AI/ML models were sufficiently accurate with a mean overall value of 74.9%, and performed best at preoperative patient selection, cost prediction, and length of stay. Performance was also good at predicting functional outcomes and postoperative mortality. Regression analysis was the most frequently utilized application whereas deep learning/artificial neural networks had the highest sensitivity score (81.5%). Despite the relatively brief history of engagement with AI/ML, as evidenced by the fact that 77.5% of studies were published after 2018, the outcomes have been promising. In light of the Big Data era, the increasing prevalence of National Registries, and the wide-ranging applications of AI, such as exemplified by ChatGPT (OpenAI, San Francisco, California), it is highly likely that the field of spine surgery will gradually adopt and integrate AI/ML into its clinical practices. Consequently, it is of great significance for spine surgeons to acquaint themselves with the fundamental principles of AI/ML, as these technologies hold the potential for substantial improvements in overall patient care.
Collapse
Affiliation(s)
- Themistoklis Tragaris
- 1st Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - Ioannis S Benetos
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - John Vlamis
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - Spyridon Pneumaticos
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| |
Collapse
|
5
|
Gowd AK, Agarwalla A, Beck EC, Derman PB, Yasmeh S, Albert TJ, Liu JN. Prediction of Admission Costs Following Anterior Cervical Discectomy and Fusion Utilizing Machine Learning. Spine (Phila Pa 1976) 2022; 47:1549-1557. [PMID: 36301923 DOI: 10.1097/brs.0000000000004436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 05/09/2022] [Indexed: 02/01/2023]
Abstract
STUDY DESIGN Retrospective case series. OBJECTIVE Predict cost following anterior cervical discectomy and fusion (ACDF) within the 90-day global period using machine learning models. BACKGROUND The incidence of ACDF has been increasing with a disproportionate decrease in reimbursement. As bundled payment models become common, it is imperative to identify factors that impact the cost of care. MATERIALS AND METHODS The Nationwide Readmissions Database (NRD) was accessed in 2018 for all primary ACDFs by the International Classification of Diseases 10th Revision (ICD-10) procedure codes. Costs were calculated by utilizing the total hospital charge and each hospital's cost-to-charge ratio. Hospital characteristics, such as volume of procedures performed and wage index, were also queried. Readmissions within 90 days were identified, and cost of readmissions was added to the total admission cost to represent the 90-day healthcare cost. Machine learning algorithms were used to predict patients with 90-day admission costs >1 SD from the mean. RESULTS There were 42,485 procedures included in this investigation with an average age of 57.7±12.3 years with 50.6% males. The average cost of the operative admission was $24,874±25,610, the average cost of readmission was $25,371±11,476, and the average total cost was $26,977±28,947 including readmissions costs. There were 10,624 patients who were categorized as high cost. Wage index, hospital volume, age, and diagnosis-related group severity were most correlated with the total cost of care. Gradient boosting trees algorithm was most predictive of the total cost of care (area under the curve=0.86). CONCLUSIONS Bundled payment models utilize wage index and diagnosis-related groups to determine reimbursement of ACDF. However, machine learning algorithms identified additional variables, such as hospital volume, readmission, and patient age, that are also important for determining the cost of care. Machine learning can improve cost-effectiveness and reduce the financial burden placed upon physicians and hospitals by implementing patient-specific reimbursement.
Collapse
Affiliation(s)
- Anirudh K Gowd
- Department of Orthopaedic Surgery, Wake Forest University Baptist Medical Center, Winston-Salem, NC
| | - Avinesh Agarwalla
- Department of Orthopedic Surgery, Westchester Medical Center, Valhalla, NY
| | - Edward C Beck
- Department of Orthopaedic Surgery, Wake Forest University Baptist Medical Center, Winston-Salem, NC
| | | | - Siamak Yasmeh
- Department of Orthopedic Surgery, Loma Linda University Medical Center, Loma Linda, CA
| | - Todd J Albert
- Department of Orthopedic Surgery, Weill Cornell Medical College, Hospital for Special Surgery, New York, NY
| | - Joseph N Liu
- USC Epstein Family Center for Sports Medicine, Keck Medicine of USC, Los Angeles, CA
| |
Collapse
|
6
|
Salmons HI, Lu Y, Reed RR, Forsythe B, Sebastian AS. Implementation of Machine Learning to Predict Cost of Care Associated with Ambulatory Single-Level Lumbar Decompression. World Neurosurg 2022; 167:e1072-e1079. [PMID: 36089278 DOI: 10.1016/j.wneu.2022.08.149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 08/27/2022] [Accepted: 08/30/2022] [Indexed: 11/28/2022]
Abstract
BACKGROUND With the emergence of the concept of value-based care, efficient resource allocation has become an increasingly prominent factor in surgical decision-making. Validated machine learning (ML) models for cost prediction in outpatient spine surgery are limited. As such, we developed and internally validated a supervised ML algorithm to reliably identify cost drivers associated with ambulatory single-level lumbar decompression surgery. METHODS A retrospective review of the New York State Ambulatory Surgical Database was performed to identify patients who underwent single-level lumbar decompression from 2014 to 2015. Patients with a length of stay of >0 were excluded. Using pre- and intraoperative parameters (features) derived from the New York State Ambulatory Surgical Database, an optimal supervised ML model was ultimately developed and internally validated after 5 candidate models were rigorously tested, trained, and compared for predictive performance related to total charges. The best performing model was then evaluated by testing its performance on identifying relationships between features of interest and cost prediction. Finally, the best performing algorithm was entered into an open-access web application. RESULTS A total of 8402 patients were included. The gradient-boosted ensemble model demonstrated the best performance assessed via internal validation. Major cost drivers included anesthesia type, operating room time, race, patient income and insurance status, community type, worker's compensation status, and comorbidity index. CONCLUSIONS The gradient-boosted ensemble model predicted total charges and associated cost drivers associated with ambulatory single-level lumbar decompression using a large, statewide database with excellent performance. External validation of this algorithm in future studies may guide practical application of this clinical tool.
Collapse
Affiliation(s)
- Harold I Salmons
- Department of Orthopedic Surgery, Mayo Clinic, Rochester, Minnesota, USA.
| | - Yining Lu
- Department of Orthopedic Surgery, Mayo Clinic, Rochester, Minnesota, USA
| | - Ryder R Reed
- Department of Orthopedic Surgery, Mayo Clinic, Rochester, Minnesota, USA
| | - Brian Forsythe
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, Illinois, USA
| | - Arjun S Sebastian
- Department of Orthopedic Surgery, Mayo Clinic, Rochester, Minnesota, USA
| |
Collapse
|
7
|
Ren G, Yu K, Xie Z, Wang P, Zhang W, Huang Y, Wang Y, Wu X. Current Applications of Machine Learning in Spine: From Clinical View. Global Spine J 2022; 12:1827-1840. [PMID: 34628966 PMCID: PMC9609532 DOI: 10.1177/21925682211035363] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
STUDY DESIGN Narrative review. OBJECTIVES This review aims to present current applications of machine learning (ML) in spine domain to clinicians. METHODS We conducted a comprehensive PubMed search of peer-reviewed articles that were published between 2006 and 2020 using terms (spine, spinal, lumbar, cervical, thoracic, machine learning) to examine ML in spine. Then exclude research of other domain, case report, review or meta-analysis, and which without available abstract or full text. RESULTS Total 1738 articles were retrieved from database, and 292 studies were finally included. Key findings of current applications were compiled and summarized in this review. Main clinical applications of those techniques including image processing, diagnosis, decision supporting, operative assistance, rehabilitation, surgery outcomes, complications, hospitalization and cost. CONCLUSIONS ML had achieved excellent performance and hold immense potential in spine. ML could help clinical staff to improve medical level, enhance work efficiency, and reduce adverse events. However more randomized controlled trials and improvement of interpretability are essential to clinicians accepting models' assistance in real work.
Collapse
Affiliation(s)
- GuanRui Ren
- Southeast University Medical College,
Nanjing, Jiangsu, China
| | - Kun Yu
- Nanjing Jiangbei Hospital, Nanjing,
Jiangsu, China
| | - ZhiYang Xie
- Department of Spine Surgery, Zhongda
Hospital, School of Medicine, Southeast University, Nanjing, Jiangsu, China
| | - PeiYang Wang
- Southeast University Medical College,
Nanjing, Jiangsu, China
| | - Wei Zhang
- Southeast University Medical College,
Nanjing, Jiangsu, China
| | - Yong Huang
- Southeast University Medical College,
Nanjing, Jiangsu, China
| | - YunTao Wang
- Department of Spine Surgery, Zhongda
Hospital, School of Medicine, Southeast University, Nanjing, Jiangsu, China,YunTao Wang, Department of Spine Surgery,
Zhongda Hospital, School of Medicine, Southeast University, No. 87, Dingjiaqiao
Road, Nanjing, Jiangsu 210009, China.
| | - XiaoTao Wu
- Department of Spine Surgery, Zhongda
Hospital, School of Medicine, Southeast University, Nanjing, Jiangsu, China,XiaoTao Wu, Department of Spine Surgery,
Zhongda Hospital, School of Medicine, Southeast University, No. 87, Dingjiaqiao
Road, Nanjing, Jiangsu 210009, China.
| |
Collapse
|
8
|
Lopez CD, Boddapati V, Lombardi JM, Lee NJ, Mathew J, Danford NC, Iyer RR, Dyrszka MD, Sardar ZM, Lenke LG, Lehman RA. Artificial Learning and Machine Learning Applications in Spine Surgery: A Systematic Review. Global Spine J 2022; 12:1561-1572. [PMID: 35227128 PMCID: PMC9393994 DOI: 10.1177/21925682211049164] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
OBJECTIVES This current systematic review sought to identify and evaluate all current research-based spine surgery applications of AI/ML in optimizing preoperative patient selection, as well as predicting and managing postoperative outcomes and complications. METHODS A comprehensive search of publications was conducted through the EMBASE, Medline, and PubMed databases using relevant keywords to maximize the sensitivity of the search. No limits were placed on level of evidence or timing of the study. Findings were reported according to the PRISMA guidelines. RESULTS After application of inclusion and exclusion criteria, 41 studies were included in this review. Bayesian networks had the highest average AUC (.80), and neural networks had the best accuracy (83.0%), sensitivity (81.5%), and specificity (71.8%). Preoperative planning/cost prediction models (.89,82.2%) and discharge/length of stay models (.80,78.0%) each reported significantly higher average AUC and accuracy compared to readmissions/reoperation prediction models (.67,70.2%) (P < .001, P = .005, respectively). Model performance also significantly varied across postoperative management applications for average AUC and accuracy values (P < .001, P < .027, respectively). CONCLUSIONS Generally, authors of the reviewed studies concluded that AI/ML offers a potentially beneficial tool for providers to optimize patient care and improve cost-efficiency. More specifically, AI/ML models performed best, on average, when optimizing preoperative patient selection and planning and predicting costs, hospital discharge, and length of stay. However, models were not as accurate in predicting postoperative complications, adverse events, and readmissions and reoperations. An understanding of AI/ML-based applications is becoming increasingly important, particularly in spine surgery, as the volume of reported literature, technology accessibility, and clinical applications continue to rapidly expand.
Collapse
Affiliation(s)
- Cesar D. Lopez
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Venkat Boddapati
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA,Venkat Boddapati, MD, Columbia University Irving Medical Center, 622 W. 168th St., PH-11, New York, NY 10032, USA.
| | - Joseph M. Lombardi
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Nathan J. Lee
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Justin Mathew
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Nicholas C. Danford
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Rajiv R. Iyer
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Marc D. Dyrszka
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Zeeshan M. Sardar
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Lawrence G. Lenke
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Ronald A. Lehman
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| |
Collapse
|
9
|
André A, Peyrou B, Carpentier A, Vignaux JJ. Feasibility and Assessment of a Machine Learning-Based Predictive Model of Outcome After Lumbar Decompression Surgery. Global Spine J 2022; 12:894-908. [PMID: 33207969 PMCID: PMC9344503 DOI: 10.1177/2192568220969373] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
STUDY DESIGN Retrospective study at a unique center. OBJECTIVE The aim of this study is twofold, to develop a virtual patients model for lumbar decompression surgery and to evaluate the precision of an artificial neural network (ANN) model designed to accurately predict the clinical outcomes of lumbar decompression surgery. METHODS We performed a retrospective study of complete Electronic Health Records (EHR) to identify potential unfavorable criteria for spine surgery (predictors). A cohort of synthetics EHR was created to classify patients by surgical success (green zone) or partial failure (orange zone) using an Artificial Neural Network which screens all the available predictors. RESULTS In the actual cohort, we included 60 patients, with complete EHR allowing efficient analysis, 26 patients were in the orange zone (43.4%) and 34 were in the green zone (56.6%). The average positive criteria amount for actual patients was 8.62 for the green zone (SD+/- 3.09) and 10.92 for the orange zone (SD 3.38). The classifier (a neural network) was trained using 10,000 virtual patients and 2000 virtual patients were used for test purposes. The 12,000 virtual patients were generated from the 60 EHR, of which half were in the green zone and half in the orange zone. The model showed an accuracy of 72% and a ROC score of 0.78. The sensitivity was 0.885 and the specificity 0.59. CONCLUSION Our method can be used to predict a favorable patient to have lumbar decompression surgery. However, there is still a need to further develop its ability to analyze patients in the "failure of treatment" zone to offer precise management of patient health before spinal surgery.
Collapse
Affiliation(s)
- Arthur André
- Ramsay santé, Clinique Geoffroy
Saint-Hilaire, Paris, France,Neurosurgery Department,
Pitié-Salpêtrière University Hospital, Paris, France,Cortexx Medical Intelligence, Paris,
France,Arthur André, Cortexx Medical Intelligence,
156 Boulevard, Haussmann 75008, Paris.
| | | | | | | |
Collapse
|
10
|
Saravi B, Hassel F, Ülkümen S, Zink A, Shavlokhova V, Couillard-Despres S, Boeker M, Obid P, Lang GM. Artificial Intelligence-Driven Prediction Modeling and Decision Making in Spine Surgery Using Hybrid Machine Learning Models. J Pers Med 2022; 12:jpm12040509. [PMID: 35455625 PMCID: PMC9029065 DOI: 10.3390/jpm12040509] [Citation(s) in RCA: 38] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 03/18/2022] [Accepted: 03/19/2022] [Indexed: 12/22/2022] Open
Abstract
Healthcare systems worldwide generate vast amounts of data from many different sources. Although of high complexity for a human being, it is essential to determine the patterns and minor variations in the genomic, radiological, laboratory, or clinical data that reliably differentiate phenotypes or allow high predictive accuracy in health-related tasks. Convolutional neural networks (CNN) are increasingly applied to image data for various tasks. Its use for non-imaging data becomes feasible through different modern machine learning techniques, converting non-imaging data into images before inputting them into the CNN model. Considering also that healthcare providers do not solely use one data modality for their decisions, this approach opens the door for multi-input/mixed data models which use a combination of patient information, such as genomic, radiological, and clinical data, to train a hybrid deep learning model. Thus, this reflects the main characteristic of artificial intelligence: simulating natural human behavior. The present review focuses on key advances in machine and deep learning, allowing for multi-perspective pattern recognition across the entire information set of patients in spine surgery. This is the first review of artificial intelligence focusing on hybrid models for deep learning applications in spine surgery, to the best of our knowledge. This is especially interesting as future tools are unlikely to use solely one data modality. The techniques discussed could become important in establishing a new approach to decision-making in spine surgery based on three fundamental pillars: (1) patient-specific, (2) artificial intelligence-driven, (3) integrating multimodal data. The findings reveal promising research that already took place to develop multi-input mixed-data hybrid decision-supporting models. Their implementation in spine surgery may hence be only a matter of time.
Collapse
Affiliation(s)
- Babak Saravi
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
- Institute of Experimental Neuroregeneration, Spinal Cord Injury and Tissue Regeneration Center Salzburg (SCI-TReCS), Paracelsus Medical University, 5020 Salzburg, Austria;
- Correspondence:
| | - Frank Hassel
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Sara Ülkümen
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Alisia Zink
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Veronika Shavlokhova
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany;
| | - Sebastien Couillard-Despres
- Institute of Experimental Neuroregeneration, Spinal Cord Injury and Tissue Regeneration Center Salzburg (SCI-TReCS), Paracelsus Medical University, 5020 Salzburg, Austria;
- Austrian Cluster for Tissue Regeneration, 1200 Vienna, Austria
| | - Martin Boeker
- Intelligence and Informatics in Medicine, Medical Center Rechts der Isar, School of Medicine, Technical University of Munich, 81675 Munich, Germany;
| | - Peter Obid
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
| | - Gernot Michael Lang
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
| |
Collapse
|
11
|
Estimation and Prediction of Hospitalization and Medical Care Costs Using Regression in Machine Learning. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:7969220. [PMID: 35281545 PMCID: PMC8906954 DOI: 10.1155/2022/7969220] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/26/2021] [Accepted: 02/07/2022] [Indexed: 12/12/2022]
Abstract
Medical costs are one of the most common recurring expenses in a person’s life. Based on different research studies, BMI, ageing, smoking, and other factors are all related to greater personal medical care costs. The estimates of the expenditures of health care related to obesity are needed to help create cost-effective obesity prevention strategies. Obesity prevention at a young age is a top concern in global health, clinical practice, and public health. To avoid these restrictions, genetic variants are employed as instrumental variables in this research. Using statistics from public huge datasets, the impact of body mass index (BMI) on overall healthcare expenses is predicted. A multiview learning architecture can be used to leverage BMI information in records, including diagnostic texts, diagnostic IDs, and patient traits. A hierarchy perception structure was suggested to choose significant words, health checks, and diagnoses for training phase informative data representations, because various words, diagnoses, and previous health care have varying significance for expense calculation. In this system model, linear regression analysis, naive Bayes classifier, and random forest algorithms were compared using a business analytic method that applied statistical and machine-learning approaches. According to the results of our forecasting method, linear regression has the maximum accuracy of 97.89 percent in forecasting overall healthcare costs. In terms of financial statistics, our methodology provides a predictive method.
Collapse
|
12
|
DelSole EM, Keck WL, Patel AA. The State of Machine Learning in Spine Surgery: A Systematic Review. Clin Spine Surg 2022; 35:80-89. [PMID: 34121074 DOI: 10.1097/bsd.0000000000001208] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Accepted: 04/14/2021] [Indexed: 11/27/2022]
Abstract
STUDY DESIGN This was a systematic review of existing literature. OBJECTIVE The objective of this study was to evaluate the current state-of-the-art trends and utilization of machine learning in the field of spine surgery. SUMMARY OF BACKGROUND DATA The past decade has seen a rise in the clinical use of machine learning in many fields including diagnostic radiology and oncology. While studies have been performed that specifically pertain to spinal surgery, there have been relatively few aggregate reviews of the existing scientific literature as applied to clinical spine surgery. METHODS This study utilized Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to review the scientific literature from 2009 to 2019 with syntax specific for machine learning and spine surgery applications. Specific data was extracted from the available literature including algorithm application, algorithms tested, database type and size, algorithm training method, and outcome of interest. RESULTS A total of 44 studies met inclusion criteria, of which the majority were level III evidence. Studies were grouped into 4 general types: diagnostic tools, clinical outcome prediction, surgical assessment tools, and decision support tools. Across studies, a wide swath of algorithms were used, which were trained across multiple disparate databases. There were no studies identified that assessed the ethical implementation or patient perceptions of machine learning in clinical care. CONCLUSIONS The results reveal the broad range of clinical applications and methods used to create machine learning algorithms for use in the field of spine surgery. Notable disparities exist in algorithm choice, database characteristics, and training methods. Ongoing research is needed to make machine learning operational on a large scale.
Collapse
Affiliation(s)
- Edward M DelSole
- Department of Orthopaedic Surgery, Division of Spine Surgery, Geisinger Musculoskeletal Institute
| | - Wyatt L Keck
- Geisinger Commonwealth School of Medicine, Scranton
| | - Aalpen A Patel
- Department of Radiology (Geisinger), Steele Institute for Health Innovation and Geisinger, Danville, PA
| |
Collapse
|
13
|
Kuo R, Zulvia FE. The application of gradient evolution algorithm to an intuitionistic fuzzy neural network for forecasting medical cost of acute hepatitis treatment in Taiwan. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107711] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
14
|
Chan AK, Santacatterina M, Pennicooke B, Shahrestani S, Ballatori AM, Orrico KO, Burke JF, Manley GT, Tarapore PE, Huang MC, Dhall SS, Chou D, Mummaneni PV, DiGiorgio AM. Does state malpractice environment affect outcomes following spinal fusions? A robust statistical and machine learning analysis of 549,775 discharges following spinal fusion surgery in the United States. Neurosurg Focus 2021; 49:E18. [PMID: 33130616 DOI: 10.3171/2020.8.focus20610] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 08/20/2020] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Spine surgery is especially susceptible to malpractice claims. Critics of the US medical liability system argue that it drives up costs, whereas proponents argue it deters negligence. Here, the authors study the relationship between malpractice claim density and outcomes. METHODS The following methods were used: 1) the National Practitioner Data Bank was used to determine the number of malpractice claims per 100 physicians, by state, between 2005 and 2010; 2) the Nationwide Inpatient Sample was queried for spinal fusion patients; and 3) the Area Resource File was queried to determine the density of physicians, by state. States were categorized into 4 quartiles regarding the frequency of malpractice claims per 100 physicians. To evaluate the association between malpractice claims and death, discharge disposition, length of stay (LOS), and total costs, an inverse-probability-weighted regression-adjustment estimator was used. The authors controlled for patient and hospital characteristics. Covariates were used to train machine learning models to predict death, discharge disposition not to home, LOS, and total costs. RESULTS Overall, 549,775 discharges following spinal fusions were identified, with 495,640 yielding state-level information about medical malpractice claim frequency per 100 physicians. Of these, 124,425 (25.1%), 132,613 (26.8%), 130,929 (26.4%), and 107,673 (21.7%) were from the lowest, second-lowest, second-highest, and highest quartile states, respectively, for malpractice claims per 100 physicians. Compared to the states with the fewest claims (lowest quartile), surgeries in states with the most claims (highest quartile) showed a statistically significantly higher odds of a nonhome discharge (OR 1.169, 95% CI 1.139-1.200), longer LOS (mean difference 0.304, 95% CI 0.256-0.352), and higher total charges (mean difference [log scale] 0.288, 95% CI 0.281-0.295) with no significant associations for mortality. For the machine learning models-which included medical malpractice claim density as a covariate-the areas under the curve for death and discharge disposition were 0.94 and 0.87, and the R2 values for LOS and total charge were 0.55 and 0.60, respectively. CONCLUSIONS Spinal fusion procedures from states with a higher frequency of malpractice claims were associated with an increased odds of nonhome discharge, longer LOS, and higher total charges. This suggests that medicolegal climate may potentially alter practice patterns for a given spine surgeon and may have important implications for medical liability reform. Machine learning models that included medical malpractice claim density as a feature were satisfactory in prediction and may be helpful for patients, surgeons, hospitals, and payers.
Collapse
Affiliation(s)
- Andrew K Chan
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Michele Santacatterina
- 2Cornell TRIPODS Center for Data Science for Improved Decision-Making and Cornell Tech, Cornell University, New York, New York
| | - Brenton Pennicooke
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Shane Shahrestani
- 3Keck School of Medicine, University of Southern California, Los Angeles, California; and
| | - Alexander M Ballatori
- 3Keck School of Medicine, University of Southern California, Los Angeles, California; and
| | - Katie O Orrico
- 4American Association of Neurological Surgeons/Congress of Neurological Surgeons Washington Office, Washington, DC
| | - John F Burke
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Geoffrey T Manley
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Phiroz E Tarapore
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Michael C Huang
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Sanjay S Dhall
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Dean Chou
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Praveen V Mummaneni
- 1Department of Neurological Surgery, University of California, San Francisco, California
| | - Anthony M DiGiorgio
- 1Department of Neurological Surgery, University of California, San Francisco, California
| |
Collapse
|
15
|
Huang YC, Li SJ, Chen M, Lee TS. The Prediction Model of Medical Expenditure Appling Machine Learning Algorithm in CABG Patients. Healthcare (Basel) 2021; 9:710. [PMID: 34200785 PMCID: PMC8230367 DOI: 10.3390/healthcare9060710] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Revised: 06/07/2021] [Accepted: 06/08/2021] [Indexed: 11/17/2022] Open
Abstract
Most patients face expensive healthcare management after coronary artery bypass grafting (CABG) surgery, which brings a substantial financial burden to the government. The National Health Insurance Research Database (NHIRD) is a complete database containing over 99% of individuals' medical information in Taiwan. Our research used the latest data that selected patients who accepted their first CABG surgery between January 2014 and December 2017 (n = 12,945) to predict which factors will affect medical expenses, and built the prediction model using different machine learning algorithms. After analysis, our result showed that the surgical expenditure (X4) and 1-year medical expenditure before the CABG operation (X14), and the number of hemodialysis (X15), were the key factors affecting the 1-year medical expenses of CABG patients after discharge. Furthermore, the XGBoost and SVR methods are both the best predictive models. Thus, our research suggests enhancing the healthcare management for patients with kidney-related diseases to avoid costly complications. We provide helpful information for medical management, which may decrease health insurance burdens in the future.
Collapse
Affiliation(s)
- Yen-Chun Huang
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24205, Taiwan;
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 242062, Taiwan
| | - Shao-Jung Li
- Cardiovascular Research Center, Wan Fang Hospital, Taipei Medical University, Taipei City 116, Taiwan;
- Taipei Heart Institute, Taipei Medical University, New Taipei City 231, Taiwan
- Department of Surgery, School of Medicine, College of Medicine, Taipei Medical University, Taipei City 116, Taiwan
- Division of Cardiovascular Surgery, Department of Surgery, Wan Fang Hospital, Taipei Medical University, Taipei City 116, Taiwan
| | - Mingchih Chen
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24205, Taiwan;
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 242062, Taiwan
| | - Tian-Shyug Lee
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24205, Taiwan;
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 242062, Taiwan
| |
Collapse
|
16
|
Tan TH, Hsu CC, Chen CJ, Hsu SL, Liu TL, Lin HJ, Wang JJ, Liu CF, Huang CC. Predicting outcomes in older ED patients with influenza in real time using a big data-driven and machine learning approach to the hospital information system. BMC Geriatr 2021; 21:280. [PMID: 33902485 PMCID: PMC8077903 DOI: 10.1186/s12877-021-02229-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2020] [Accepted: 04/19/2021] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND Predicting outcomes in older patients with influenza in the emergency department (ED) by machine learning (ML) has never been implemented. Therefore, we conducted this study to clarify the clinical utility of implementing ML. METHODS We recruited 5508 older ED patients (≥65 years old) in three hospitals between 2009 and 2018. Patients were randomized into a 70%/30% split for model training and testing. Using 10 clinical variables from their electronic health records, a prediction model using the synthetic minority oversampling technique preprocessing algorithm was constructed to predict five outcomes. RESULTS The best areas under the curves of predicting outcomes were: random forest model for hospitalization (0.840), pneumonia (0.765), and sepsis or septic shock (0.857), XGBoost for intensive care unit admission (0.902), and logistic regression for in-hospital mortality (0.889) in the testing data. The predictive model was further applied in the hospital information system to assist physicians' decisions in real time. CONCLUSIONS ML is a promising way to assist physicians in predicting outcomes in older ED patients with influenza in real time. Evaluations of the effectiveness and impact are needed in the future.
Collapse
Affiliation(s)
- Tian-Hoe Tan
- Department of Emergency Medicine, Chi Mei Medical Center, 901 Zhonghua Road, Yongkang District, Tainan City, 710, Taiwan
| | - Chien-Chin Hsu
- Department of Emergency Medicine, Chi Mei Medical Center, 901 Zhonghua Road, Yongkang District, Tainan City, 710, Taiwan
- Department of Biotechnology, Southern Taiwan University of Science and Technology, Tainan, Taiwan
| | - Chia-Jung Chen
- Information Systems, Chi Mei Medical Center, Tainan, Taiwan
| | - Shu-Lien Hsu
- Department of Nursing, Chi Mei Medical Center, Tainan, Taiwan
| | - Tzu-Lan Liu
- Information Systems, Chi Mei Medical Center, Tainan, Taiwan
| | - Hung-Jung Lin
- Department of Emergency Medicine, Chi Mei Medical Center, 901 Zhonghua Road, Yongkang District, Tainan City, 710, Taiwan
- Department of Emergency Medicine, Taipei Medical University, Taipei, Taiwan
| | - Jhi-Joung Wang
- Department of Medical Research, Chi Mei Medical Center, Tainan, Taiwan
- Allied AI Biomed Center, Southern Taiwan University of Science and Technology, Tainan, Taiwan
| | - Chung-Feng Liu
- Department of Medical Research, Chi Mei Medical Center, Tainan, Taiwan
| | - Chien-Cheng Huang
- Department of Emergency Medicine, Chi Mei Medical Center, 901 Zhonghua Road, Yongkang District, Tainan City, 710, Taiwan.
- Department of Senior Services, Southern Taiwan University of Science and Technology, Tainan, Taiwan.
- Department of Environmental and Occupational Health, College of Medicine, National Cheng Kung University, Tainan, Taiwan.
| |
Collapse
|
17
|
Jiang K, Shang Y, Wang L, Zhang Z, Zhou S, Dong J, Wu H. A framework for meaningful use of clinical decision model: A diabetic nephropathy prediction modeling based on real world data. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-202030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
This study aims to propose a framework for developing a sharable predictive model of diabetic nephropathy (DN) to improve the clinical efficiency of automatic DN detection in data intensive clinical scenario. Different classifiers have been developed for early detection, while the heterogeneity of data makes meaningful use of such developed models difficult. Decision tree (DT) and random forest (RF) were adopted as training classifiers in de-identified electronic medical record dataset from 6,745 patients with diabetes. After model construction, the obtained classification rules from classifier were coded in a standard PMML file. A total of 39 clinical features from 2159 labeled patients were included as risk factors in DN prediction after data preprocessing. The mean testing accuracy of the DT classifier was 0.8, which was consistent to that of the RF classifier (0.823). The DT classifier was choose to recode as a set of operable rules in PMML file that could be transferred and shared, which indicates the proposed framework of constructing a sharable prediction model via PMML is feasible and will promote the interoperability of trained classifiers among different institutions, thus achieving meaningful use of clinical decision making. This study will be applied to multiple sites to further verify feasibility.
Collapse
Affiliation(s)
- Kui Jiang
- Department of Medical Informatics, Medical School of Nantong University, Nantong, Jiangsu Province, People’s Republic of China
| | - Yujuan Shang
- Department of Medical Informatics, Medical School of Nantong University, Nantong, Jiangsu Province, People’s Republic of China
- Department of Statistics and Data Management, Children’s Hospital of Fudan University, Shanghai, China
| | - Lei Wang
- Department of Medical Informatics, Medical School of Nantong University, Nantong, Jiangsu Province, People’s Republic of China
| | - Zheqing Zhang
- Department of Medical Informatics, Medical School of Nantong University, Nantong, Jiangsu Province, People’s Republic of China
| | - Siwei Zhou
- Department of Medical Informatics, Medical School of Nantong University, Nantong, Jiangsu Province, People’s Republic of China
| | - Jiancheng Dong
- Department of Medical Informatics, Medical School of Nantong University, Nantong, Jiangsu Province, People’s Republic of China
| | - Huiqun Wu
- Department of Medical Informatics, Medical School of Nantong University, Nantong, Jiangsu Province, People’s Republic of China
| |
Collapse
|
18
|
Role of machine learning in management of degenerative spondylolisthesis: a systematic review. CURRENT ORTHOPAEDIC PRACTICE 2021. [DOI: 10.1097/bco.0000000000000992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
19
|
Comparison of machine learning techniques to predict unplanned readmission following total shoulder arthroplasty. J Shoulder Elbow Surg 2021; 30:e50-e59. [PMID: 32868011 DOI: 10.1016/j.jse.2020.05.013] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Revised: 04/29/2020] [Accepted: 05/04/2020] [Indexed: 02/01/2023]
Abstract
BACKGROUND Machine learning (ML) techniques have been shown to successfully predict postoperative complications for high-volume orthopedic procedures such as hip and knee arthroplasty and to stratify patients for risk-adjusted bundled payments. The latter has not been done for more heterogeneous, lower-volume procedures such as total shoulder arthroplasty (TSA) with equally limited discussion around strategies to optimize the predictive ability of ML algorithms. The purpose of this study was to (1) assess which of 5 ML algorithms best predicts 30-day readmission, (2) test select ML strategies to optimize the algorithms, and (3) report on which patient variables contribute most to risk prediction in TSA across algorithms. METHODS We identified 9043 patients in the American College of Surgeons National Surgical Quality Improvement Database who underwent primary TSA between 2011 and 2015. Predictors included demographics, comorbidities, laboratory data, and intraoperative variables. The outcome of interest was 30-day unplanned readmission. Five ML algorithms-support-vector machine (SVM), logistic regression, random forest (RF), an adaptive boosting algorithm, and neural network-were trained on the derivation cohort (2011-2014 TSA patients) to predict 30-day unplanned readmission rates. After training, weights for each respective model were fixed and the classifiers were evaluated on the 2015 TSA cohort to simulate a prospective evaluation. C-statistic and f1 scores were used to assess the performance of each classifier. After evaluation, features were removed independently to assess which features most affected classifier performance. RESULTS The derivation and validation cohorts comprised 5857 and 3186 primary TSA patients, respectively, with similar demographics, comorbidities, and 30-day unplanned readmission rates (2.9% vs. 2.7%). Of the ML algorithms, SVM performed the worst with a c-statistic of 0.54 and an f1-score of 0.07, whereas the random-forest classifier performed the best with the highest c-statistic of 0.74 and an f1-score of 0.18. In addition, SVM was most sensitive to loss of single features, whereas the performance of RF did not dramatically decrease after loss of single features. Within the trained RF classifier, 5 variables achieved weights >0.5 in descending order: high bilirubin (>1.9 mg/dL), age >65, race, chronic obstructive pulmonary disease, and American Society of Anesthesiologists' scores ≥3. In our validation cohort, we observed a 2.7% readmission rate. From this cohort, using the RF classifier we were then able to identify 436 high-risk patients with a predicted risk score >0.6, of whom 36 were readmitted (readmission rate of 8.2%). CONCLUSION Predictive analytics algorithms can achieve acceptable prediction of unplanned readmission for TSA with the RF classifier outperforming other common algorithms.
Collapse
|
20
|
Thongpeth W, Lim A, Wongpairin A, Thongpeth T, Chaimontree S. Comparison of linear, penalized linear and machine learning models predicting hospital visit costs from chronic disease in Thailand. INFORMATICS IN MEDICINE UNLOCKED 2021. [DOI: 10.1016/j.imu.2021.100769] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
|
21
|
Abstract
The National Health Insurance Administration of Taiwan has implemented global budget payments, the Diagnosis-Related Group (DRG) inpatient diagnosis-related group payment system, and the same-disease payment system, in order to decrease the financial burden of medical expenditure. However, the benefit system reduces the income of doctors and hospitals. This study proposed an early warning payment algorithm that applies data analytics technology to diabetes hospitalization- and treatment-related fees. A model was constructed based on the characteristics of the Exponentially Weighted Moving Average (EWMA) algorithm to develop control charts, which were first employed using the 2001–2017 health insurance statistical database released by the Department of Health Insurance (DHI). This model was used to simulate data from inpatients with diabetes, to create an early warning algorithm for diagnosis-related groups’ (DRGs’) medical payments as well as to measure its accuracy. This study will provide a reference for the formulation of payment policies by the DHI.
Collapse
|
22
|
Hung M, Hon ES, Lauren E, Xu J, Judd G, Su W. Machine Learning Approach to Predict Risk of 90-Day Hospital Readmissions in Patients With Atrial Fibrillation: Implications for Quality Improvement in Healthcare. Health Serv Res Manag Epidemiol 2020; 7:2333392820961887. [PMID: 33088848 PMCID: PMC7545784 DOI: 10.1177/2333392820961887] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Background: Atrial fibrillation (AF) in the elderly population is projected to increase over the next several decades. Catheter ablation shows promise as a treatment option and is becoming increasingly available. We examined 90-day hospital readmission for AF patients undergoing catheter ablation and utilized machine learning methods to explore the risk factors associated with these readmission trends. Methods: Data from the 2013 Nationwide Readmissions Database on AF cases were used to predict 90-day readmissions for AF with catheter ablation. Multiple machine learning methods such as k-Nearest Neighbors, Decision Tree, and Support Vector Machine were employed to determine variable importance and build risk prediction models. Accuracy, precision, sensitivity, specificity, and area under the curve were compared for each model. Results: The 90-day hospital readmission rate was 17.6%; the average age of the patients was 64.9 years; 62.9% of patients were male. Important variables in predicting 90-day hospital readmissions in patients with AF undergoing catheter ablation included the age of the patient, number of diagnoses on the patient’s record, and the total number of discharges from a hospital. The k-Nearest Neighbor had the best performance with a prediction accuracy of 85%. This was closely followed by Decision Tree, but Support Vector Machine was less ideal. Conclusions: Machine learning methods can produce accurate models in predicting hospital readmissions for patients with AF. The likelihood of readmission to the hospital increases as the patient age, total number of hospital discharges, and total number of patient diagnoses increase. Findings from this study can inform quality improvement in healthcare and in achieving patient-centered care.
Collapse
Affiliation(s)
- Man Hung
- Roseman University of Health Sciences College of Dental Medicine, South Jordan, UT, USA.,University of Utah School of Medicine, Salt Lake City, UT, USA.,Utah Center for Clinical and Translational Sciences, Salt Lake City, UT, USA.,Huntsman Cancer Institute, Salt Lake City, UT, USA
| | - Eric S Hon
- University of Chicago Department of Economics, Chicago, IL, USA
| | - Evelyn Lauren
- University of Utah School of Medicine, Salt Lake City, UT, USA
| | - Julie Xu
- University of Utah College of Nursing, Salt Lake City, UT, USA
| | - Gary Judd
- Roseman University of Health Sciences College of Dental Medicine, South Jordan, UT, USA
| | - Weicong Su
- University of Utah Department of Mathematics, Salt Lake City, UT, USA
| |
Collapse
|
23
|
Using Machine Learning to Predict 30-Day Hospital Readmissions in Patients with Atrial Fibrillation Undergoing Catheter Ablation. J Pers Med 2020; 10:jpm10030082. [PMID: 32784873 PMCID: PMC7564438 DOI: 10.3390/jpm10030082] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Revised: 08/02/2020] [Accepted: 08/06/2020] [Indexed: 12/24/2022] Open
Abstract
Atrial fibrillation (AF) cases are expected to increase over the next several decades, due to the rise in the elderly population. One promising treatment option for AF is catheter ablation, which is increasing in use. We investigated the hospital readmissions data for AF patients undergoing catheter ablation, and used machine learning models to explore the risk factors behind these readmissions. We analyzed data from the 2013 Nationwide Readmissions Database on cases with AF, and determined the relative importance of factors in predicting 30-day readmissions for AF with catheter ablation. Various machine learning methods, such as k-nearest neighbors, decision tree, and support vector machine were utilized to develop predictive models with their accuracy, precision, sensitivity, specificity, and area under the curve computed and compared. We found that the most important variables in predicting 30-day hospital readmissions in patients with AF undergoing catheter ablation were the age of the patient, the total number of discharges from a hospital, and the number of diagnoses on the patient’s record, among others. Out of the methods used, k-nearest neighbor had the highest prediction accuracy of 85%, closely followed by decision tree, while support vector machine was less desirable for these data. Hospital readmissions for AF with catheter ablation can be predicted with relatively high accuracy, utilizing machine learning methods. As patient age, the total number of hospital discharges, and the total number of patient diagnoses increase, the risk of hospital readmissions increases.
Collapse
|
24
|
Javaid M, Haleem A. Impact of industry 4.0 to create advancements in orthopaedics. J Clin Orthop Trauma 2020; 11:S491-S499. [PMID: 32774017 PMCID: PMC7394797 DOI: 10.1016/j.jcot.2020.03.006] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 03/15/2020] [Accepted: 03/16/2020] [Indexed: 12/19/2022] Open
Abstract
Scientists and health professional are focusing on improving the medical sciences for the betterment of patients. The fourth industrial revolution, which is commonly known as Industry 4.0, is a significant advancement in the field of engineering. Industry 4.0 is opening a new opportunity for digital manufacturing with greater flexibility and operational performance. This development is also going to have a positive impact in the field of orthopaedics. The purpose of this paper is to present various advancements in orthopaedics by the implementation of Industry 4.0. To undertake this study, we have studied the available literature extensively on Industry 4.0, technologies of Industry 4.0 and their role in orthopaedics. Paper briefly explains about Industry 4.0, identifies and discusses the major technologies of Industry 4.0, which will support development in orthopaedics. Finally, from the available literature, the paper identifies twelve significant advancements of Industry 4.0 in orthopaedics. Industry 4.0 uses various types of digital manufacturing and information technologies to create orthopaedics implants, patient-specific tools, devices and innovative way of treatment. This revolution is to be useful to perform better spinal surgery, knee and hip replacement, and invasive surgeries.
Collapse
Affiliation(s)
- Mohd Javaid
- Corresponding author., https://scholar.google.co.in/citations?user=rfyiwvsAAAAJ&hl=en
| | | |
Collapse
|
25
|
Wu SW, Pan Q, Chen T. Research on diagnosis-related group grouping of inpatient medical expenditure in colorectal cancer patients based on a decision tree model. World J Clin Cases 2020; 8:2484-2493. [PMID: 32607325 PMCID: PMC7322429 DOI: 10.12998/wjcc.v8.i12.2484] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Revised: 05/25/2020] [Accepted: 05/29/2020] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND In 2018, the diagnosis-related groups prospective payment system (DRGs-PPS) was introduced in a trial operation in Beijing according to the requirements of medical and health reform. The implementation of the system requires that more than 300 disease types pay through the DRGs-PPS for medical insurance. Colorectal cancer (CRC), as a common malignant tumor with high prevalence in recent years, was among the 300 disease types.
AIM To investigate the composition and factors related to inpatient medical expenditure in CRC patients based on disease DRGs, and to provide a basis for the rational economic control of hospitalization expenses for the diagnosis and treatment of CRC.
METHODS The basic material and cost data for 1026 CRC inpatients in a Grade-A tertiary hospital in Beijing during 2014-2018 were collected using the medical record system. A variance analysis of the composition of medical expenditure was carried out, and a multivariate linear regression model was used to select influencing factors with the greatest statistical significance. A decision tree model based on the exhaustive χ2 automatic interaction detector (E-CHAID) algorithm for DRG grouping was built by setting chosen factors as separation nodes, and the payment standard of each diagnostic group and upper limit cost were calculated. The correctness and rationality of the data were re-evaluated and verified by clinical practice.
RESULTS The average hospital stay of the 1026 CRC patients investigated was 18.5 d, and the average hospitalization cost was 57872.4 RMB yuan. Factors including age, gender, length of hospital stay, diagnosis and treatment, as well as clinical operations had significant influence on inpatient expenditure (P < 0.05). By adopting age, diagnosis, treatment, and surgery as the grouping nodes, a decision tree model based on the E-CHAID algorithm was established, and the CRC patients were divided into 12 DRG cost groups. Among these 12 groups, the number of patients aged ≤ 67 years, and underwent surgery and chemotherapy or radiotherapy was largest; while patients aged > 67 years, and underwent surgery and chemotherapy or radiotherapy had the highest medical cost. In addition, the standard cost and upper limit cost in the 12 groups were calculated and re-evaluated.
CONCLUSION It is important to strengthen the control over the use of drugs and management of the hospitalization process, surgery, diagnosis and treatment to reduce the economic burden on patients. Tailored adjustments to medical payment standards should be made according to the characteristics and treatment of disease types to improve the comprehensiveness and practicability of the DRGs-PPS.
Collapse
Affiliation(s)
- Suo-Wei Wu
- Department of Medical Administration, Beijing Hospital, Beijing 100730, China
| | - Qi Pan
- Department of Medical Administration, Beijing Hospital, Beijing 100730, China
| | - Tong Chen
- Department of Medical Administration, Beijing Hospital, Beijing 100730, China
| |
Collapse
|
26
|
Ha CW, Kim SH, Lee DH, Kim H, Park YB. Predictive validity of radiographic signs of complete discoid lateral meniscus in children using machine learning techniques. J Orthop Res 2020; 38:1279-1288. [PMID: 31883134 DOI: 10.1002/jor.24578] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/12/2019] [Accepted: 12/04/2019] [Indexed: 02/04/2023]
Abstract
The diagnostic utility of radiographic signs of complete discoid lateral meniscus remains controversial. This study aimed to investigate the diagnostic accuracy and determine which sign is most reliably detects the presence of a complete discoid lateral meniscus in children. A total of 141 knees (age 7-16) with complete discoid lateral meniscus and 141 age- and sex-matched knees with normal meniscus were included. The following radiographic signs were evaluated: lateral joint (LJ) space, fibular head (FH) height, lateral tibial spine (LTS) height, lateral tibial plateau (LTP) obliquity, lateral femoral condyle (LFC) squaring, LTP cupping, LFC notching, and prominence ratio of the femoral condyle. Prediction models were constructed using logistic regressions, decision trees, and random forest analyses. Receiver operating characteristic curves and area under the curve (AUC) were estimated to compare the diagnostic accuracy of the radiographic signs and model fit. The random forest model yielded the best diagnostic accuracy (AUC: 0.909), with 86.5% sensitivity and 82.2% specificity. LJ space height, FH height, and prominence ratio showed statistically large AUC compared with LTS height and LTP obliquity (P < .05 in all). The cut-off values for diagnosing discoid meniscus to be <12.55 mm for FH height, <0.804 for prominence ratio, and >6.6 mm for LJ space height when using the random forest model. On the basis of the results of this study, in clinical practice, LJ space height, FH height and prominence ratio could be easily used as supplementary tools for complete discoid lateral meniscus in children.
Collapse
Affiliation(s)
- Chul-Won Ha
- Department of Orthopedic Surgery, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, South Korea
| | - Seong Hwan Kim
- Department of Orthopedic Surgery, Hyundae General Hospital, Chung-Ang University College of Medicine, Namyangju-si, Gyeonggi-do, South Korea
| | - Dong-Hoon Lee
- Department of Orthopedic Surgery, Chung-Ang University Hospital, Chung-Ang University College of Medicine, Seoul, South Korea
| | - Hyojoon Kim
- Department of Computer Science, Princeton University, Princeton, New Jersey
| | - Yong-Beom Park
- Department of Orthopedic Surgery, Chung-Ang University Hospital, Chung-Ang University College of Medicine, Seoul, South Korea
| |
Collapse
|
27
|
Helm JM, Swiergosz AM, Haeberle HS, Karnuta JM, Schaffer JL, Krebs VE, Spitzer AI, Ramkumar PN. Machine Learning and Artificial Intelligence: Definitions, Applications, and Future Directions. Curr Rev Musculoskelet Med 2020; 13:69-76. [PMID: 31983042 PMCID: PMC7083992 DOI: 10.1007/s12178-020-09600-8] [Citation(s) in RCA: 146] [Impact Index Per Article: 36.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
PURPOSE OF REVIEW With the unprecedented advancement of data aggregation and deep learning algorithms, artificial intelligence (AI) and machine learning (ML) are poised to transform the practice of medicine. The field of orthopedics, in particular, is uniquely suited to harness the power of big data, and in doing so provide critical insight into elevating the many facets of care provided by orthopedic surgeons. The purpose of this review is to critically evaluate the recent and novel literature regarding ML in the field of orthopedics and to address its potential impact on the future of musculoskeletal care. RECENT FINDINGS Recent literature demonstrates that the incorporation of ML into orthopedics has the potential to elevate patient care through alternative patient-specific payment models, rapidly analyze imaging modalities, and remotely monitor patients. Just as the business of medicine was once considered outside the domain of the orthopedic surgeon, we report evidence that demonstrates these emerging applications of AI warrant ownership, leverage, and application by the orthopedic surgeon to better serve their patients and deliver optimal, value-based care.
Collapse
Affiliation(s)
- J Matthew Helm
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, 2049 E 100th St., Cleveland, OH, 44195, USA
| | - Andrew M Swiergosz
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, 2049 E 100th St., Cleveland, OH, 44195, USA
| | - Heather S Haeberle
- Baylor College of Medicine, Department of Orthopaedic Surgery, Houston, TX, USA
| | - Jaret M Karnuta
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, 2049 E 100th St., Cleveland, OH, 44195, USA
| | - Jonathan L Schaffer
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, 2049 E 100th St., Cleveland, OH, 44195, USA
| | - Viktor E Krebs
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, 2049 E 100th St., Cleveland, OH, 44195, USA
| | - Andrew I Spitzer
- Department of Orthopaedic Surgery, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Prem N Ramkumar
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, 2049 E 100th St., Cleveland, OH, 44195, USA.
| |
Collapse
|
28
|
Safaee MM, Ames CP, Smith JS. Epidemiology and Socioeconomic Trends in Adult Spinal Deformity Care. Neurosurgery 2019; 87:25-32. [DOI: 10.1093/neuros/nyz454] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2019] [Accepted: 08/18/2019] [Indexed: 12/21/2022] Open
Abstract
Abstract
Adult spinal deformity (ASD) has gained significant attention over the past decade with improvements in diagnostic tools, classification schemes, and surgical technique. The demographics of the aging population in the United States are undergoing a fundamental shift as medical care advances and life expectancy increases. The “baby boomers” represent the fastest growing demographic in the United States and by 2050, the number of individuals 65 yr and older is projected to reach 89 million, more than double its current size. Based on current prevalence estimates there are approximately 27.5 million elderly individuals with some form of spinal deformity, which will place a significant burden on our health care systems. Rates of surgery for ASD and case complexity are both increasing, with concomitant increase in the cost of deformity care. At the same time, patients are more medically complex with increasing number of comorbidities that result in increased surgical risk and complication profiles. This review aims to highlight recent trends in the epidemiology and socioeconomic patterns in surgery for ASD.
Collapse
Affiliation(s)
- Michael M Safaee
- Department of Neurological Surgery, University of California, San Francisco, California
| | - Christopher P Ames
- Department of Neurological Surgery, University of California, San Francisco, California
| | - Justin S Smith
- Department of Neurological Surgery, University of Virginia, Charlottesville, Virginia
| |
Collapse
|
29
|
Karnuta JM, Navarro SM, Haeberle HS, Helm JM, Kamath AF, Schaffer JL, Krebs VE, Ramkumar PN. Predicting Inpatient Payments Prior to Lower Extremity Arthroplasty Using Deep Learning: Which Model Architecture Is Best? J Arthroplasty 2019; 34:2235-2241.e1. [PMID: 31230954 DOI: 10.1016/j.arth.2019.05.048] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/28/2019] [Revised: 05/24/2019] [Accepted: 05/28/2019] [Indexed: 02/01/2023] Open
Abstract
BACKGROUND Recent advances in machine learning have given rise to deep learning, which uses hierarchical layers to build models, offering the ability to advance value-based healthcare by better predicting patient outcomes and costs of a given treatment. The purpose of this study is to compare the performance of 2 common deep learning models, traditional multilayer perceptron (MLP), and the newer dense neural network (DenseNet), in predicting outcomes for primary total hip arthroplasty (THA) and total knee arthroplasty (TKA) as a foundation for future musculoskeletal studies seeking to utilize machine learning. METHODS Using 295,605 patients undergoing primary THA and TKA from a New York State inpatient administrative database from 2009 to 2016, 2 neural network designs (MLP vs DenseNet) with different model regularization techniques (dropout, batch normalization, and DeCovLoss) were applied to compare model performance on predicting inpatient procedural cost using the area under the receiver operating characteristic curve (AUC). Models were implemented to identify high-cost surgical cases. RESULTS DenseNet performed similarly to or better than MLP across the different regularization techniques in predicting procedural costs of THA and TKA. Applying regularization to DenseNet resulted in a significantly higher AUC as compared to DenseNet alone (0.813 vs 0.792, P = .011). When regularization methods were applied to MLP, the AUC was significantly lower than without regularization (0.621 vs 0.791, P = 1.1 × 10-15). When the optimal MLP and DenseNet models were compared in a head-to-head fashion, they performed similarly at cost prediction (P > .999). CONCLUSION This study establishes that in predicting costs of lower extremity arthroplasty, DenseNet models improve in performance with regularization, whereas simple neural network models perform significantly worse without regularization. In light of the resource-intensive nature of creating and testing deep learning models for orthopedic surgery, particularly for value-centric procedures such as arthroplasty, this study establishes a set of key technical features that resulted in better prediction of inpatient surgical costs. We demonstrated that regularization is critically important for neural networks in arthroplasty cost prediction and that future studies should utilize these deep learning techniques to predict arthroplasty costs. LEVEL OF EVIDENCE III.
Collapse
Affiliation(s)
- Jaret M Karnuta
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, Cleveland, OH
| | | | - Heather S Haeberle
- Department of Orthopedic Surgery, Baylor College of Medicine, Houston, TX
| | - J Matthew Helm
- Department of Orthopaedic Surgery, Texas Tech University Health Sciences Center, Lubbock, TX
| | - Atul F Kamath
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, Cleveland, OH
| | | | - Viktor E Krebs
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, Cleveland, OH
| | - Prem N Ramkumar
- Machine Learning Arthroplasty Laboratory, Cleveland Clinic, Cleveland, OH
| |
Collapse
|
30
|
Goyal A, Ngufor C, Kerezoudis P, McCutcheon B, Storlie C, Bydon M. Can machine learning algorithms accurately predict discharge to nonhome facility and early unplanned readmissions following spinal fusion? Analysis of a national surgical registry. J Neurosurg Spine 2019; 31:568-578. [PMID: 31174185 DOI: 10.3171/2019.3.spine181367] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2018] [Accepted: 03/12/2019] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Nonhome discharge and unplanned readmissions represent important cost drivers following spinal fusion. The authors sought to utilize different machine learning algorithms to predict discharge to rehabilitation and unplanned readmissions in patients receiving spinal fusion. METHODS The authors queried the 2012-2013 American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) for patients undergoing cervical or lumbar spinal fusion. Outcomes assessed included discharge to nonhome facility and unplanned readmissions within 30 days after surgery. A total of 7 machine learning algorithms were evaluated. Predictive hierarchical clustering of procedure codes was used to increase model performance. Model performance was evaluated using overall accuracy and area under the receiver operating characteristic curve (AUC), as well as sensitivity, specificity, and positive and negative predictive values. These performance metrics were computed for both the imputed and unimputed (missing values dropped) datasets. RESULTS A total of 59,145 spinal fusion cases were analyzed. The incidence rates of discharge to nonhome facility and 30-day unplanned readmission were 12.6% and 4.5%, respectively. All classification algorithms showed excellent discrimination (AUC > 0.80, range 0.85-0.87) for predicting nonhome discharge. The generalized linear model showed comparable performance to other machine learning algorithms. By comparison, all models showed poorer predictive performance for unplanned readmission, with AUC ranging between 0.63 and 0.66. Better predictive performance was noted with models using imputed data. CONCLUSIONS In an analysis of patients undergoing spinal fusion, multiple machine learning algorithms were found to reliably predict nonhome discharge with modest performance noted for unplanned readmissions. These results provide early evidence regarding the feasibility of modern machine learning classifiers in predicting these outcomes and serve as possible clinical decision support tools to facilitate shared decision making.
Collapse
Affiliation(s)
- Anshit Goyal
- 1Mayo Clinic Neuro-Informatics Laboratory
- 2Department of Neurosurgery, and
| | - Che Ngufor
- 3Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota
| | | | | | - Curtis Storlie
- 3Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota
| | - Mohamad Bydon
- 1Mayo Clinic Neuro-Informatics Laboratory
- 2Department of Neurosurgery, and
| |
Collapse
|
31
|
Special Issue on Using Machine Learning Algorithms in the Prediction of Kyphosis Disease: A Comparative Study. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9163322] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Machine learning (ML) is the technology that allows a computer system to learn from the environment, through re-iterative processes, and improve itself from experience. Recently, machine learning has gained massive attention across numerous fields, and is making it easy to model data extremely well, without the importance of using strong assumptions about the modeled system. The rise of machine learning has proven to better describe data as a result of providing both engineering solutions and an important benchmark. Therefore, in this current research work, we applied three different machine learning algorithms, which were, the Random Forest (RF), Support Vector Machines (SVM), and Artificial Neural Network (ANN) to predict kyphosis disease based on a biomedical data. At the initial stage of the experiments, we performed 5- and 10-Fold Cross-Validation using Logistic Regression as a baseline model to compare with our ML models without performing grid search. We then evaluated the models and compared their performances based on 5- and 10-Fold Cross-Validation after running grid search algorithms on the ML models. Among the Support Vector Machines, we experimented with the three kernels (Linear, Radial Basis Function (RBF), Polynomial). We observed overall accuracies of the models between 79%–85%, and 77%–86% based on the 5- and 10-Fold Cross-Validation, after running grid search respectively. Based on the 5- and 10-Fold Cross-Validation as evaluation metrics, the RF, SVM-RBF, and ANN models achieved accuracies more than 80%. The RF, SVM-RBF and ANN models outperformed the baseline model based on the 10-Fold Cross-Validation with grid search. Overall, in terms of accuracies, the ANN model outperformed all the other ML models, achieving 85.19% and 86.42% based on the 5- and 10-Fold Cross-Validation. We proposed that RF, SVM-RBF and ANN models should be used to detect and predict kyphosis disease after a patient had undergone surgery or operation. We suggest that machine learning should be adopted and used as an essential and critical tool across the maximum spectrum of answering biomedical questions.
Collapse
|
32
|
|
33
|
Comment on "Is Medicine Still an Art?". Ann Surg 2019; 269:e74. [PMID: 31082923 DOI: 10.1097/sla.0000000000002879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
34
|
Ando T, Ooba N, Mochizuki M, Koide D, Kimura K, Lee SL, Setoguchi S, Kubota K. Positive predictive value of ICD-10 codes for acute myocardial infarction in Japan: a validation study at a single center. BMC Health Serv Res 2018; 18:895. [PMID: 30477501 PMCID: PMC6260564 DOI: 10.1186/s12913-018-3727-0] [Citation(s) in RCA: 52] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2018] [Accepted: 11/16/2018] [Indexed: 12/02/2022] Open
Abstract
Background In Japan, several large healthcare databases have become available for research since the early 2000’s. However, validation studies to examine the accuracy of these databases remain scarce. We conducted a validation study in order to estimate the positive predictive value (PPV) of local or ICD-10 codes for acute myocardial infarction (AMI) in Japanese claims. In particular, we examined whether the PPV differs between claims in the Diagnosis Procedure Combination case mix scheme (DPC claims) and in non-DPC claims. Methods We selected a random sample of 200 patients from all patients hospitalized at a large tertiary-care university hospital between January 1, 2009 and December 31, 2011 who had an inpatient claim assigned a local or ICD-10 code for AMI. We used a standardized data abstraction form to collect the relevant information from an electronic medical records system. Abstracted information was then categorized by a single cardiologist as being either definite or not having AMI. Results In a random sample of 200 patients, the average age was 67.7 years and the proportion of males was 78.0%. The PPV of the local or ICD-10 code for AMI was 82.5% in this sample of 200 patients. Further, of 178 patients who had an ICD-10 code for AMI based on any of the 7 types of condition codes in the DPC claims, the PPV was 89.3%, whereas of the 161 patients who had an ICD-10 code for AMI based on any of 3 major types of condition codes in the DPC claims, the PPV was 93.8%. Conclusion The PPV of the local or ICD-10 code for AMI was high for inpatient claims in Japan. The PPV was even higher for the ICD-10 code for AMI for those patients who received AMI care through the DPC case mix scheme. The current study was conducted in a single center, suggesting that a multi-center study involving different types of hospitals is needed in the future. The accuracy of condition codes for DPC claims in Japan may also be worth examining for conditions other than AMI such as stroke.
Collapse
Affiliation(s)
- Takashi Ando
- Division of Evaluation and Analysis of Drug Information, Keio University Faculty of Pharmacy, Tokyo, Japan
| | - Nobuhiro Ooba
- Department of Clinical Pharmacy, Nihon University School of Pharmacy, Chiba, Japan
| | - Mayumi Mochizuki
- Division of Evaluation and Analysis of Drug Information, Keio University Faculty of Pharmacy, Tokyo, Japan
| | - Daisuke Koide
- Department of Biostatistics & Bioinformatics Graduate School of Medicine The University of Tokyo, Tokyo, Japan
| | - Koichi Kimura
- Departments of Advanced Medical Science, The Institute of Medical Science, The University of Tokyo, Tokyo, Japan
| | - Seitetz L Lee
- Department of Cardiovascular Medicine, University of Tokyo, Tokyo, Japan
| | | | - Kiyoshi Kubota
- NPO Drug Safety Research Unit Japan, Yushima 1-2-13-4F, Bunkyo-ku, Tokyo, 114-0002, Japan.
| |
Collapse
|
35
|
Yulita IN, Fanany MI, Arymurthy AM. Fast Convolutional Method for Automatic Sleep Stage Classification. Healthc Inform Res 2018; 24:170-178. [PMID: 30109150 PMCID: PMC6085207 DOI: 10.4258/hir.2018.24.3.170] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2018] [Revised: 07/22/2018] [Accepted: 07/24/2018] [Indexed: 11/23/2022] Open
Abstract
Objectives Polysomnography is essential to diagnose sleep disorders. It is used to identify a patient's sleep pattern during sleep. This pattern is obtained by a doctor or health practitioner by using a scoring process, which is time consuming. To overcome this problem, we developed a system that can automatically classify sleep stages. Methods This paper proposes a new method for sleep stage classification, called the fast convolutional method. The proposed method was evaluated against two sleep datasets. The first dataset was obtained from physionet.org, a physiologic signals data centers. Twenty-five patients who had a sleep disorder participated in this data collection. The second dataset was collected in Mitra Keluarga Kemayoran Hospital, Indonesia. Data was recorded from ten healthy respondents. Results The proposed method reached 73.50% and 56.32% of the F-measures for the PhysioNet and Mitra Keluarga Kemayoran Hospital data, respectively. Both values were the highest among all the machine learning methods considered in this study. The proposed method also had an efficient running time. The fast convolutional models of the PhysioNet and Mitra Keluarga Kemayoran Hospital data needed 42.60 and 0.06 seconds, respectively. Conclusions The fast convolutional method worked well on the tested datasets. It achieved a high F-measure result and an efficient running time. Thus, it can be considered a promising tool for sleep stage classification.
Collapse
Affiliation(s)
- Intan Nurma Yulita
- Machine Learning and Computer Vision (MLCV) Lab, Faculty of Computer Science, Universitas Indonesia, Jawa Barat, Indonesia.,Department of Computer Science, Universitas Padjadjaran, Sumedang, Indonesia
| | - Mohamad Ivan Fanany
- Machine Learning and Computer Vision (MLCV) Lab, Faculty of Computer Science, Universitas Indonesia, Jawa Barat, Indonesia
| | - Aniati Murni Arymurthy
- Machine Learning and Computer Vision (MLCV) Lab, Faculty of Computer Science, Universitas Indonesia, Jawa Barat, Indonesia
| |
Collapse
|
36
|
Gupta A, Liu T, Shepherd S, Paiva W. Using Statistical and Machine Learning Methods to Evaluate the Prognostic Accuracy of SIRS and qSOFA. Healthc Inform Res 2018; 24:139-147. [PMID: 29770247 PMCID: PMC5944188 DOI: 10.4258/hir.2018.24.2.139] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2018] [Revised: 04/19/2018] [Accepted: 04/20/2018] [Indexed: 01/20/2023] Open
Abstract
Objectives The objective of this study was to compare the performance of two popularly used early sepsis diagnostic criteria, systemic inflammatory response syndrome (SIRS) and quick Sepsis-related Organ Failure Assessment (qSOFA), using statistical and machine learning approaches. Methods This retrospective study examined patient visits in Emergency Department (ED) with sepsis related diagnosis. The outcome was 28-day in-hospital mortality. Using odds ratio (OR) and modeling methods (decision tree [DT], multivariate logistic regression [LR], and naïve Bayes [NB]), the relationships between diagnostic criteria and mortality were examined. Results Of 132,704 eligible patient visits, 14% died within 28 days of ED admission. The association of qSOFA ≥2 with mortality (OR = 3.06; 95% confidence interval [CI], 2.96–3.17) greater than the association of SIRS ≥2 with mortality (OR = 1.22; 95% CI, 1.18–1.26). The area under the ROC curve for qSOFA (AUROC = 0.70) was significantly greater than for SIRS (AUROC = 0.63). For qSOFA, the sensitivity and specificity were DT = 0.39, LR = 0.64, NB = 0.62 and DT = 0.89, LR = 0.63, NB = 0.66, respectively. For SIRS, the sensitivity and specificity were DT = 0.46, LR = 0.62, NB = 0.62 and DT = 0.70, LR = 0.59, NB = 0.58, respectively. Conclusions The evidences suggest that qSOFA is a better diagnostic criteria than SIRS. The low sensitivity of qSOFA can be improved by carefully selecting the threshold to translate the predicted probabilities into labels. These findings can guide healthcare providers in selecting risk-stratification measures for patients presenting to an ED with sepsis.
Collapse
Affiliation(s)
- Akash Gupta
- Industrial Engineering and Management, Oklahoma State University, Stillwater, OK, USA
| | - Tieming Liu
- Industrial Engineering and Management, Oklahoma State University, Stillwater, OK, USA
| | - Scott Shepherd
- Center for Health Systems Innovation, Oklahoma State University, Stillwater, OK, USA
| | - William Paiva
- Center for Health Systems Innovation, Oklahoma State University, Stillwater, OK, USA
| |
Collapse
|