1
|
Hejazi-Garcia C, Howard SD, Quinones A, Hsu JY, Ali ZS. The association between surgical start time and spine surgery outcomes. Clin Neurol Neurosurg 2025; 248:108663. [PMID: 39603109 DOI: 10.1016/j.clineuro.2024.108663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2024] [Revised: 11/11/2024] [Accepted: 11/23/2024] [Indexed: 11/29/2024]
Abstract
OBJECTIVE Neurosurgical operations, including spine surgeries, often occur outside "normal business hours" due to the urgent or emergent nature of cases. This study investigates the association of surgical start time (SST) with spine surgery outcomes. METHODS A retrospective cross-sectional study was performed using electronic health record data from a multi-hospital academic health system from 2017 to 2024. Eligible patients included adults who underwent spine surgery with a recorded SST. Patients were separated into a regular hours group (7:00 A.M. to 5:00 P.M.) and an afterhours group (SST outside this time window). The association between SST and extended length of stay (greater than 3 days), readmission, and discharge disposition was examined. RESULTS The sample included 12,658 patients with 10,737 (84.8 %) patients in the regular hours group and 1921 (15.2 %) patients in the afterhours group. Afterhours SST had significantly increased rates of extended length of stay, non-home discharge disposition, and readmission compared to regular hours SST. Adjusting for age, comorbidities, case classification, the time from admission to SST, and surgery type, afterhours SST was significantly associated with non-home discharge disposition (OR 1.27, 95 % CI 1.12 - 1.45, p < 0.001). CONCLUSION This is the largest study to examine the association of SST with outcomes of spine surgery. Controlling for potential confounders, afterhours SST was significantly associated with non-home discharge disposition.
Collapse
Affiliation(s)
| | - Susanna D Howard
- Department of Neurosurgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Addison Quinones
- Department of Neurosurgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Jesse Y Hsu
- Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Zarina S Ali
- Department of Neurosurgery, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
2
|
Han H, Li R, Fu D, Zhou H, Zhan Z, Wu Y, Meng B. Revolutionizing spinal interventions: a systematic review of artificial intelligence technology applications in contemporary surgery. BMC Surg 2024; 24:345. [PMID: 39501233 PMCID: PMC11536876 DOI: 10.1186/s12893-024-02646-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 10/28/2024] [Indexed: 11/09/2024] Open
Abstract
Leveraging its ability to handle large and complex datasets, artificial intelligence can uncover subtle patterns and correlations that human observation may overlook. This is particularly valuable for understanding the intricate dynamics of spinal surgery and its multifaceted impacts on patient prognosis. This review aims to delineate the role of artificial intelligence in spinal surgery. A search of the PubMed database from 1992 to 2023 was conducted using relevant English publications related to the application of artificial intelligence in spinal surgery. The search strategy involved a combination of the following keywords: "Artificial neural network," "deep learning," "artificial intelligence," "spinal," "musculoskeletal," "lumbar," "vertebra," "disc," "cervical," "cord," "stenosis," "procedure," "operation," "surgery," "preoperative," "postoperative," and "operative." A total of 1,182 articles were retrieved. After a careful evaluation of abstracts, 90 articles were found to meet the inclusion criteria for this review. Our review highlights various applications of artificial neural networks in spinal disease management, including (1) assessing surgical indications, (2) assisting in surgical procedures, (3) preoperatively predicting surgical outcomes, and (4) estimating the occurrence of various surgical complications and adverse events. By utilizing these technologies, surgical outcomes can be improved, ultimately enhancing the quality of life for patients.
Collapse
Affiliation(s)
- Hao Han
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Ran Li
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Dongming Fu
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Hongyou Zhou
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Zihao Zhan
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Yi'ang Wu
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Bin Meng
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China.
| |
Collapse
|
3
|
Li R, Wang L, Wang X, Grzegorzek M, Chen AT, Quan X, Hu Z, Liu X, Zhang Y, Xiang T, Zhang Y, Chen A, Jiang H, Hou X, Xu Q, He W, Chen L, Zhou X, Zhang Q, Huang W, Luan H, Song X, Yu X, Xi X, Wang K, Wu SN, Liu W, Zhang Y, Zheng J, Yin C, Liu Q, Ding H, Xu C, Zhao H, Yan L, Li W. Development of machine learning model for predicting prolonged operation time in lumbar stenosis undergoing posterior lumbar interbody fusion: a multicenter study. Spine J 2024:S1529-9430(24)01057-X. [PMID: 39427930 DOI: 10.1016/j.spinee.2024.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 10/01/2024] [Accepted: 10/01/2024] [Indexed: 10/22/2024]
Abstract
BACKGROUND CONTEXT Longer posterior lumbar interbody fusion (PLIF) surgeries for individuals with lumbar spinal stenosis are linked to more complications and negatively affect recovery after the operation. Therefore, there is a critical need for a method to accurately predict patients who are at risk for prolonged operation times. PURPOSE This research aimed to develop a clinical model to predict prolonged operation time for patients undergoing PLIF procedures. STUDY DESIGN/SETTING This study employs a machine-learning approach to analyze data retrospectively collected. PATIENT SAMPLE About 3,233 patients diagnosed with lumbar spinal stenosis (LSS) had posterior lumbar interbody fusion (PLIF) at 22 hospitals in China from January 2015 to December 2022. OUTCOME MEASURES The primary outcome was operation time. Prolonged operation time defined as exceeded 75% of the overall surgical duration, which mean exceeding 240 minutes. METHODS A total of 3,233 patients who underwent PLIF surgery with lumbar spinal stenosis (LSS) were divided into one training group and four test groups based on different district areas. The training group included 1,569 patients, while Test1 had 541, Test2 had 403, Test3 had 351, and Test4 had 369 patients. Variables consisted of demographics, perioperative details, preoperative laboratory examinations and other Additional factors. Six algorithms were employed for variable screening, and variables identified by more than two screening methods were incorporated into the final model. In the training cohort, a 10-fold cross-validation (CV) and Bayesian hyperparameter optimization techniques were utilized to construct a model using eleven machine learning algorithms. Following this, the model was evaluated using four separate external test sets, and the mean Area Under the Curve (AUC) was computed to determine the best-performing model. Further performance metrics of the best model were evaluated, and SHapley Additive exPlanations (SHAP) were used for interpretability analysis to enhance decision-making transparency. Ultimately, an online calculator was created. RESULTS Among the various machine learning models, the Random Forest achieved the highest performance in the validation set, with AUROC scores of 0.832 in Test1, 0.834 in Test2, 0.816 inTest3, 0.822 in Test4) compared with other machine learning models. The top contributing variables were number of levels fusion, pre-APTT, weight and age. The predictive model was further refined by developing a web-based calculator for clinical application (https://wenle.shinyapps.io/PPOT_LSS/). CONCLUSIONS This predictive model can facilitate identification of risk for prolonged operation time following PLIF surgery. Predictive calculators are expected to improve preoperative planning, identify patients with high risk factors, and help clinicians facilitating the improvement of treatment plans and the implementation of clinical intervention.
Collapse
Affiliation(s)
- Runmin Li
- Department of Spinal Surgery, Honghui Hospital of Xi'an Jiaotong University, Xi'an, China
| | - Lin Wang
- Department of Critical Care Medicine, Xidian Hospital, Xi'an, Shaanxi Province, China
| | - Xinghao Wang
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China; Institute for Medical Informatics, University of Luebeck, Luebeck, Germany
| | - Marcin Grzegorzek
- Institute for Medical Informatics, University of Luebeck, Luebeck, Germany
| | - An-Tian Chen
- Department of Cardiology, State Key Laboratory of Cardiovascular Disease, Chinese Academy of Medical Sciences & Peking Union Medical College/National Center for Cardiovascular Diseases, Beijing, China; Department of Computer Science, University of Texas at Austin, Austin, TX, USA
| | - Xubin Quan
- Department of Spinal Surgery, Guangxi Medical University Affiliated Liuzhou People's Hospital, Liuzhou, China
| | - Zhaohui Hu
- Department of Spinal Surgery, Guangxi Medical University Affiliated Liuzhou People's Hospital, Liuzhou, China
| | - Xiaozhu Liu
- Department of Critical Care Medicine, Beijing Shijitan Hospital, Capital Medical University, Beijing, China; Department of Cardiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Yang Zhang
- College of Medical Informatics, Chongqing Medical University, Chongqing, China; Medical Data Science Academy, Chongqing Medical University, Chongqing, China
| | - Tianyu Xiang
- Information Center, The University-Town Hospital of Chongqing Medical University, Chongqing, China
| | - Yingang Zhang
- Department of Orthopedics of the First Affiliated Hospital, Medical School, Xi'an Jiaotong University, Xi'an, China
| | - Anfa Chen
- Department of Orthopedics, Jiangxi Province Hospital of Integrated Chinese & Western Medicine, China
| | - Hao Jiang
- Spine Tumor Center, Changzheng Hospital, Second Military Medical University, Shanghai, China
| | - Xuewen Hou
- Department of Radiology, The First Dongguan Affiliated Hospital, Guangdong Medical University, Dongguan, China
| | - Qizhong Xu
- Department of Radiology, The First Affiliated Hospital of Shenzhen University, Shenzhen Second People's Hospital, Shenzhen, China
| | - Weiheng He
- Department of Radiology, People's Hospital of Ningxia Hui Autonomous Region, Yinchuan, China
| | - Liang Chen
- Department of Radiology, Hubei Provincial Hospital of Traditional Chinese Medicine, Wuhan, China
| | - Xin Zhou
- Department of Orthopedics, Shanxi Bethune Hospital of Shanxi Academy of Medical Sciences, Taiyuan, China
| | - Qiang Zhang
- Department of Orthopedics, Xi'an Central Hospital, Xi'an, Shaanxi Province, China
| | - Wei Huang
- Department of Orthopedics, The Sixth Affiliated Hospital, School of Medicine, South China University of Technology, Foshan, Guangdong, China
| | - Haopeng Luan
- Department of Spine Surgery, The Six Affiliated Hospital of Xinjiang Medical University, Urumqi, Xinjiang, China
| | - Xinghua Song
- Department of Spine Surgery, The Six Affiliated Hospital of Xinjiang Medical University, Urumqi, Xinjiang, China
| | - Xiaolin Yu
- Department of Orthopedics, Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Xiangdong Xi
- Department of Joint Surgery, No.215 Hospital of Shaanxi Nuclear Industry, Shaanxi Province, China
| | - Kai Wang
- Key Laboratory of Neurological Diseases, The Second Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
| | - Shi-Nan Wu
- Eye Institute of Xiamen University, School of Medicine, Xiamen University, Xiamen, Fujian, China
| | - Wencai Liu
- Department of Orthopedics, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yusi Zhang
- Cancer Center, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, China; Precision Medicine Center, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, China; Department of Medical Oncology, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, China
| | - Jialiang Zheng
- School of Medicine, Zhejiang University, Xihu, Hangzhou, Zhejiang, China
| | - Chengliang Yin
- Faculty of Medicine, Macau University of Science and Technology, Macau, China
| | - Qiang Liu
- Department of Orthopedics, Xianyang Central Hospital, Xianyang, Shannxi, China
| | - Haizhen Ding
- State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics & Center for Molecular Imaging and Translational Medicine, School of Public Health, Xiamen University, Xiamen, China
| | - Chan Xu
- State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics & Center for Molecular Imaging and Translational Medicine, School of Public Health, Xiamen University, Xiamen, China
| | - Hongmou Zhao
- Department of Foot and Ankle Surgery, Honghui Hospital of Xi'an Jiaotong University, Xi'an, China
| | - Liang Yan
- Department of Spinal Surgery, Honghui Hospital of Xi'an Jiaotong University, Xi'an, China
| | - Wenle Li
- Key Laboratory of Neurological Diseases, The Second Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China; State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics & Center for Molecular Imaging and Translational Medicine, School of Public Health, Xiamen University, Xiamen, China.
| |
Collapse
|
4
|
Pahlevani M, Taghavi M, Vanberkel P. A systematic literature review of predicting patient discharges using statistical methods and machine learning. Health Care Manag Sci 2024; 27:458-478. [PMID: 39037567 PMCID: PMC11461599 DOI: 10.1007/s10729-024-09682-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 06/29/2024] [Indexed: 07/23/2024]
Abstract
Discharge planning is integral to patient flow as delays can lead to hospital-wide congestion. Because a structured discharge plan can reduce hospital length of stay while enhancing patient satisfaction, this topic has caught the interest of many healthcare professionals and researchers. Predicting discharge outcomes, such as destination and time, is crucial in discharge planning by helping healthcare providers anticipate patient needs and resource requirements. This article examines the literature on the prediction of various discharge outcomes. Our review discovered papers that explore the use of prediction models to forecast the time, volume, and destination of discharged patients. Of the 101 reviewed papers, 49.5% looked at the prediction with machine learning tools, and 50.5% focused on prediction with statistical methods. The fact that knowing discharge outcomes in advance affects operational, tactical, medical, and administrative aspects is a frequent theme in the papers studied. Furthermore, conducting system-wide optimization, predicting the time and destination of patients after discharge, and addressing the primary causes of discharge delay in the process are among the recommendations for further research in this field.
Collapse
Affiliation(s)
- Mahsa Pahlevani
- Department of Industrial Engineering, Dalhousie University, 5269 Morris Street, Halifax, B3H 4R2, NS, Canada
| | - Majid Taghavi
- Department of Industrial Engineering, Dalhousie University, 5269 Morris Street, Halifax, B3H 4R2, NS, Canada
- Sobey School of Business, Saint Mary's University, 923 Robie, Halifax, B3H 3C3, NS, Canada
| | - Peter Vanberkel
- Department of Industrial Engineering, Dalhousie University, 5269 Morris Street, Halifax, B3H 4R2, NS, Canada.
| |
Collapse
|
5
|
Chen L, Zong W, Luo M, Yu H. The impact of comprehensive geriatric assessment on postoperative outcomes in elderly surgery: A systematic review and meta-analysis. PLoS One 2024; 19:e0306308. [PMID: 39197016 PMCID: PMC11356442 DOI: 10.1371/journal.pone.0306308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Accepted: 06/15/2024] [Indexed: 08/30/2024] Open
Abstract
INTRODUCTION The elderly population experiences more postoperative complications. A comprehensive geriatric assessment, which is multidimensional and coordinated, could help reduce these unfavorable outcomes. However, its effectiveness is still uncertain. METHODS We searched multiple online databases, including Medline, PubMed, Web of Science, Cochrane Library, Embase, CINAL, ProQuest, and Wiley, for relevant literature from their inception to October 2023. We included randomized trials of individuals aged 65 and older undergoing surgery. These trials compared comprehensive geriatric assessment with usual surgical care and reported on postoperative outcomes. Two researchers independently screened the literature, extracted data, and assessed the certainty of evidence from the identified articles. We conducted a meta-analysis using RevMan 5.3 to calculate the Odds Ratio (OR) and Mean Difference (MD) of the pooled data. RESULTS The study included 1325 individuals from seven randomized trials. Comprehensive geriatric assessment reduced the rate of postoperative delirium (28.5% vs. 37.0%; OR: 0.63; CI: 0.47-0.85; I2: 54%; P = 0.003) based on pooled data. However, it did not significantly improve other parameters such as length of stay (MD: -0.36; 95% CI: -0.376, 3.05; I2: 96%; P = 0.84), readmission rate (18.6% vs. 15.4%; OR: 1.26; CI: 0.86-1.84; I2: 0%; P = 0.24), and ADL function (MD: -0.24; 95% CI: -1.27, 0.19; I2: 0%; P = 0.64). CONCLUSIONS Apart from reducing delirium, it is still unclear whether comprehensive geriatric assessment improves other postoperative outcomes. More evidence from higher-quality randomized trials is needed.
Collapse
Affiliation(s)
- Lin Chen
- Anesthesia and Surgery Department, Chengdu Second People’s Hospital, Chengdu, Sichuan, China
| | - Wei Zong
- Department of Critical Care Medicine, First Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jangsu, China
| | - Manyue Luo
- Endocrinology and Metabolism Department, Changsha People’s Hospital, Changsha, Hunan, China
| | - Huiqin Yu
- Anesthesia and Surgery Department, Chengdu Second People’s Hospital, Chengdu, Sichuan, China
| |
Collapse
|
6
|
Zaidat B, Kurapatti M, Gal JS, Cho SK, Kim JS. Explainable Machine Learning Approach to Prediction of Prolonged Intesive Care Unit Stay in Adult Spinal Deformity Patients: Machine Learning Outperforms Logistic Regression. Global Spine J 2024:21925682241277771. [PMID: 39169510 PMCID: PMC11571784 DOI: 10.1177/21925682241277771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 08/23/2024] Open
Abstract
STUDY DESIGN Retrospective cohort study. OBJECTIVES Prolonged ICU stay is a driver of higher costs and inferior outcomes in Adult Spinal Deformity (ASD) patients. Machine learning (ML) models have recently been seen as a viable method of predicting pre-operative risk but are often 'black boxes' that do not fully explain the decision-making process. This study aims to demonstrate ML can achieve similar or greater predictive power as traditional statistical methods and follows traditional clinical decision-making processes. METHODS Five ML models (Decision Tree, Random Forest, Support Vector Classifier, GradBoost, and a CNN) were trained on data collected from a large urban academic center to predict whether prolonged ICU stay would be required post-operatively. 535 patients who underwent posterior fusion or combined fusion for treatment of ASD were included in each model with a 70-20-10 train-test-validation split. Further analysis was performed using Shapley Additive Explanation (SHAP) values to provide insight into each model's decision-making process. RESULTS The model's Area Under the Receiver Operating Curve (AUROC) ranged from 0.67 to 0.83. The Random Forest model achieved the highest score. The model considered length of surgery, complications, and estimated blood loss to be the greatest predictors of prolonged ICU stay based on SHAP values. CONCLUSIONS We developed a ML model that was able to predict whether prolonged ICU stay was required in ASD patients. Further SHAP analysis demonstrated our model aligned with traditional clinical thinking. Thus, ML models have strong potential to assist with risk stratification and more effective and cost-efficient care.
Collapse
Affiliation(s)
- Bashar Zaidat
- Department of Orthopaedics, The Mount Sinai Hospital, New York, NY, USA
| | - Mark Kurapatti
- Department of Orthopaedics, The Mount Sinai Hospital, New York, NY, USA
| | - Jonathan S. Gal
- Department of Orthopaedics, The Mount Sinai Hospital, New York, NY, USA
| | - Samuel K. Cho
- Department of Orthopaedics, The Mount Sinai Hospital, New York, NY, USA
| | - Jun S. Kim
- Department of Orthopaedics, The Mount Sinai Hospital, New York, NY, USA
| |
Collapse
|
7
|
Ton A, Wishart D, Ball JR, Shah I, Murakami K, Ordon MP, Alluri RK, Hah R, Safaee MM. The Evolution of Risk Assessment in Spine Surgery: A Narrative Review. World Neurosurg 2024; 188:1-14. [PMID: 38677646 DOI: 10.1016/j.wneu.2024.04.117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 04/17/2024] [Accepted: 04/18/2024] [Indexed: 04/29/2024]
Abstract
BACKGROUND Risk assessment is critically important in elective and high-risk interventions, particularly spine surgery. This narrative review describes the evolution of risk assessment from the earliest instruments focused on general surgical risk stratification, to more accurate and spine-specific risk calculators that quantified risk, to the current era of big data. METHODS The PubMed and SCOPUS databases were queried on October 11, 2023 using search terms to identify risk assessment tools (RATs) in spine surgery. A total of 108 manuscripts were included after screening with full-text review using the following inclusion criteria: 1) study population of adult spine surgical patients, 2) studies describing validation and subsequent performance of preoperative RATs, and 3) studies published in English. RESULTS Early RATs provided stratified patients into broad categories and allowed for improved communication between physicians. Subsequent risk calculators attempted to quantify risk by estimating general outcomes such as mortality, but then evolved to estimate spine-specific surgical complications. The integration of novel concepts such as invasiveness, frailty, genetic biomarkers, and sarcopenia led to the development of more sophisticated predictive models that estimate the risk of spine-specific complications and long-term outcomes. CONCLUSIONS RATs have undergone a transformative shift from generalized risk stratification to quantitative predictive models. The next generation of tools will likely involve integration of radiographic and genetic biomarkers, machine learning, and artificial intelligence to improve the accuracy of these models and better inform patients, surgeons, and payers.
Collapse
Affiliation(s)
- Andy Ton
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Danielle Wishart
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Jacob R Ball
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Ishan Shah
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Kiley Murakami
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Matthew P Ordon
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - R Kiran Alluri
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Raymond Hah
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Michael M Safaee
- Department of Neurological Surgery, Keck School of MedicineUniversity of Southern California, Los Angeles, California, USA.
| |
Collapse
|
8
|
Yajima S, Masuda H. The significance of G8 and other geriatric assessments in urologic cancer management: A comprehensive review. Int J Urol 2024; 31:607-615. [PMID: 38402450 DOI: 10.1111/iju.15432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 02/12/2024] [Indexed: 02/26/2024]
Abstract
In urologic oncology, which often involves older patients, it is important to consider how to manage their care appropriately. Geriatric assessment (GA) is a method that can address the specific needs of older cancer patients. The GA encompasses various assessment domains, but these domains exhibit variations across the literature. Some of the common items include functional ability, nutrition, comorbidities, cognitive ability, psychosocial disorders, polypharmacy, social and financial support, falls/imbalance, and vision/hearing. Despite the diversity of domains, there is limited consensus on reliable measurement methods. This review discusses the role of GA in managing urologic cancer in unique scenarios, such as those necessitating temporary or permanent urinary catheters or stomas due to urinary diversion. A comprehensive GA is time and human-resource-intensive in real-world clinical practice. Hence, simpler tools such as the Geriatric-8 (G8), capable of identifying high-risk patients requiring a detailed GA, are also under investigation in various contexts. Therefore, we conducted a systematic literature review on the G8. Our findings indicate that patients with low G8 scores encounter difficulties with stoma self-care after urinary diversion and have higher risks of urinary tract infections and ileus after radical cystectomy. The utilization of G8 as a screening tool for urologic cancer patients may facilitate the delivery of appropriate and personalized treatment and care.
Collapse
Affiliation(s)
- Shugo Yajima
- Department of Urology, National Cancer Center Hospital East, Chiba, Japan
| | - Hitoshi Masuda
- Department of Urology, National Cancer Center Hospital East, Chiba, Japan
| |
Collapse
|
9
|
Adida S, Legarreta AD, Hudson JS, McCarthy D, Andrews E, Shanahan R, Taori S, Lavadi RS, Buell TJ, Hamilton DK, Agarwal N, Gerszten PC. Machine Learning in Spine Surgery: A Narrative Review. Neurosurgery 2024; 94:53-64. [PMID: 37930259 DOI: 10.1227/neu.0000000000002660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 07/06/2023] [Indexed: 11/07/2023] Open
Abstract
Artificial intelligence and machine learning (ML) can offer revolutionary advances in their application to the field of spine surgery. Within the past 5 years, novel applications of ML have assisted in surgical decision-making, intraoperative imaging and navigation, and optimization of clinical outcomes. ML has the capacity to address many different clinical needs and improve diagnostic and surgical techniques. This review will discuss current applications of ML in the context of spine surgery by breaking down its implementation preoperatively, intraoperatively, and postoperatively. Ethical considerations to ML and challenges in ML implementation must be addressed to maximally benefit patients, spine surgeons, and the healthcare system. Areas for future research in augmented reality and mixed reality, along with limitations in generalizability and bias, will also be highlighted.
Collapse
Affiliation(s)
- Samuel Adida
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Andrew D Legarreta
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Joseph S Hudson
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - David McCarthy
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Edward Andrews
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Regan Shanahan
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Suchet Taori
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Raj Swaroop Lavadi
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Thomas J Buell
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - D Kojo Hamilton
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Nitin Agarwal
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
- Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh , Pennsylvania , USA
| | - Peter C Gerszten
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| |
Collapse
|
10
|
Ghanem M, Ghaith AK, El-Hajj VG, Bhandarkar A, de Giorgio A, Elmi-Terander A, Bydon M. Limitations in Evaluating Machine Learning Models for Imbalanced Binary Outcome Classification in Spine Surgery: A Systematic Review. Brain Sci 2023; 13:1723. [PMID: 38137171 PMCID: PMC10741524 DOI: 10.3390/brainsci13121723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 12/12/2023] [Accepted: 12/15/2023] [Indexed: 12/24/2023] Open
Abstract
Clinical prediction models for spine surgery applications are on the rise, with an increasing reliance on machine learning (ML) and deep learning (DL). Many of the predicted outcomes are uncommon; therefore, to ensure the models' effectiveness in clinical practice it is crucial to properly evaluate them. This systematic review aims to identify and evaluate current research-based ML and DL models applied for spine surgery, specifically those predicting binary outcomes with a focus on their evaluation metrics. Overall, 60 papers were included, and the findings were reported according to the PRISMA guidelines. A total of 13 papers focused on lengths of stay (LOS), 12 on readmissions, 12 on non-home discharge, 6 on mortality, and 5 on reoperations. The target outcomes exhibited data imbalances ranging from 0.44% to 42.4%. A total of 59 papers reported the model's area under the receiver operating characteristic (AUROC), 28 mentioned accuracies, 33 provided sensitivity, 29 discussed specificity, 28 addressed positive predictive value (PPV), 24 included the negative predictive value (NPV), 25 indicated the Brier score with 10 providing a null model Brier, and 8 detailed the F1 score. Additionally, data visualization varied among the included papers. This review discusses the use of appropriate evaluation schemes in ML and identifies several common errors and potential bias sources in the literature. Embracing these recommendations as the field advances may facilitate the integration of reliable and effective ML models in clinical settings.
Collapse
Affiliation(s)
- Marc Ghanem
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
- School of Medicine, Lebanese American University, Byblos 4504, Lebanon
| | - Abdul Karim Ghaith
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| | - Victor Gabriel El-Hajj
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
- Department of Clinical Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
| | - Archis Bhandarkar
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| | - Andrea de Giorgio
- Artificial Engineering, Via del Rione Sirignano, 80121 Naples, Italy;
| | - Adrian Elmi-Terander
- Department of Clinical Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
- Department of Surgical Sciences, Uppsala University, 75236 Uppsala, Sweden
| | - Mohamad Bydon
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| |
Collapse
|
11
|
Tragaris T, Benetos IS, Vlamis J, Pneumaticos S. Machine Learning Applications in Spine Surgery. Cureus 2023; 15:e48078. [PMID: 38046496 PMCID: PMC10689893 DOI: 10.7759/cureus.48078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/31/2023] [Indexed: 12/05/2023] Open
Abstract
This literature review sought to identify and evaluate the current applications of artificial intelligence (AI)/machine learning (ML) in spine surgery that can effectively guide clinical decision-making and surgical planning. By using specific keywords to maximize search sensitivity, a thorough literature research was conducted in several online databases: Scopus, PubMed, and Google Scholar, and the findings were filtered according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A total of 46 studies met the requirements and were included in this review. According to this study, AI/ML models were sufficiently accurate with a mean overall value of 74.9%, and performed best at preoperative patient selection, cost prediction, and length of stay. Performance was also good at predicting functional outcomes and postoperative mortality. Regression analysis was the most frequently utilized application whereas deep learning/artificial neural networks had the highest sensitivity score (81.5%). Despite the relatively brief history of engagement with AI/ML, as evidenced by the fact that 77.5% of studies were published after 2018, the outcomes have been promising. In light of the Big Data era, the increasing prevalence of National Registries, and the wide-ranging applications of AI, such as exemplified by ChatGPT (OpenAI, San Francisco, California), it is highly likely that the field of spine surgery will gradually adopt and integrate AI/ML into its clinical practices. Consequently, it is of great significance for spine surgeons to acquaint themselves with the fundamental principles of AI/ML, as these technologies hold the potential for substantial improvements in overall patient care.
Collapse
Affiliation(s)
- Themistoklis Tragaris
- 1st Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - Ioannis S Benetos
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - John Vlamis
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - Spyridon Pneumaticos
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| |
Collapse
|
12
|
Cabrera A, Bouterse A, Nelson M, Razzouk J, Ramos O, Bono CM, Cheng W, Danisa O. Accounting for age in prediction of discharge destination following elective lumbar fusion: a supervised machine learning approach. Spine J 2023; 23:997-1006. [PMID: 37028603 DOI: 10.1016/j.spinee.2023.03.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 03/01/2023] [Accepted: 03/26/2023] [Indexed: 04/09/2023]
Abstract
BACKGROUND CONTEXT The number of elective spinal fusion procedures performed each year continues to grow, making risk factors for post-operative complications following this procedure increasingly clinically relevant. Nonhome discharge (NHD) is of particular interest due to its associations with increased costs of care and rates of complications. Notably, increased age has been found to influence rates of NHD. PURPOSE To identify aged-adjusted risk factors for nonhome discharge following elective lumbar fusion through the utilization of Machine Learning-generated predictions within stratified age groupings. STUDY DESIGN Retrospective Database Study. PATIENT SAMPLE The American College of Surgeons National Quality Improvement Program (ACS-NSQIP) database years 2008 to 2018. OUTCOME MEASURES Postoperative discharge destination. METHODS ACS-NSQIP was queried to identify adult patients undergoing elective lumbar spinal fusion from 2008 to 2018. Patients were then stratified into the following age ranges: 30 to 44 years, 45 to 64 years, and ≥65 years. These groups were then analyzed by eight ML algorithms, each tasked with predicting post-operative discharge destination. RESULTS Prediction of NHD was performed with average AUCs of 0.591, 0.681, and 0.693 for those aged 30 to 44, 45 to 64, and ≥65 years respectively. In patients aged 30 to 44, operative time (p<.001), African American/Black race (p=.003), female sex (p=.002), ASA class three designation (p=.002), and preoperative hematocrit (p=.002) were predictive of NHD. In ages 45 to 64, predictive variables included operative time, age, preoperative hematocrit, ASA class two or class three designation, insulin-dependent diabetes, female sex, BMI, and African American/Black race all with p<.001. In patients ≥65 years, operative time, adult spinal deformity, BMI, insulin-dependent diabetes, female sex, ASA class four designation, inpatient status, age, African American/Black race, and preoperative hematocrit were predictive of NHD with p<.001. Several variables were distinguished as predictive for only one age group including ASA Class two designation in ages 45 to 64 and adult spinal deformity, ASA class four designation, and inpatient status for patients ≥65 years. CONCLUSIONS Application of ML algorithms to the ACS-NSQIP dataset identified a number of highly predictive and age-adjusted variables for NHD. As age is a risk factor for NHD following spinal fusion, our findings may be useful in both guiding perioperative decision-making and recognizing unique predictors of NHD among specific age groups.
Collapse
Affiliation(s)
- Andrew Cabrera
- School of Medicine, Loma Linda University, Loma Linda, CA, 92354, USA
| | | | - Michael Nelson
- School of Medicine, Loma Linda University, Loma Linda, CA, 92354, USA
| | - Jacob Razzouk
- School of Medicine, Loma Linda University, Loma Linda, CA, 92354, USA
| | - Omar Ramos
- Orthopaedic Surgery, Twin Cities Spine Center, MN 55404, USA
| | - Christopher M Bono
- Department of Orthopedics, Harvard Medical School, Massachusetts General Hospital, Boston, MA, 02114, USA
| | - Wayne Cheng
- Division of Orthopaedic Surgery, Jerry L. Pettis VA Medical Center, Loma Linda, CA 92354 , USA
| | - Olumide Danisa
- Department of Orthopedics, Loma Linda University, Loma Linda, CA, 92354, USA.
| |
Collapse
|
13
|
Khazanchi R, Bajaj A, Shah RM, Chen AR, Reyes SG, Kurapaty SS, Hsu WK, Patel AA, Divi SN. Using Machine Learning and Deep Learning Algorithms to Predict Postoperative Outcomes Following Anterior Cervical Discectomy and Fusion. Clin Spine Surg 2023; 36:143-149. [PMID: 36920355 DOI: 10.1097/bsd.0000000000001443] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Accepted: 01/25/2023] [Indexed: 03/16/2023]
Abstract
STUDY DESIGN A retrospective cohort study from a multisite academic medical center. OBJECTIVE To construct, evaluate, and interpret a series of machine learning models to predict outcomes related to inpatient health care resource utilization for patients undergoing anterior cervical discectomy and fusion (ACDF). SUMMARY OF BACKGROUND DATA Reducing postoperative health care utilization is an important goal for improving the delivery of surgical care and serves as a metric for quality assessment. Recent data has shown marked hospital resource utilization after ACDF surgery, including readmissions, and ED visits. The burden of postoperative health care use presents a potential application of machine learning techniques, which may be capable of accurately identifying at-risk patients using patient-specific predictors. METHODS Patients 18-88 years old who underwent ACDF from 2011 to 2021 at a multisite academic center and had preoperative lab values within 3 months of surgery were included. Outcomes analyzed included 90-day readmissions, postoperative length of stay, and nonhome discharge. Four machine learning models-Extreme Gradient Boosted Trees, Balanced Random Forest, Elastic-Net Penalized Logistic Regression, and a Neural Network-were trained and evaluated through the Area Under the Curve estimates. Feature importance scores were computed for the highest-performing model per outcome through model-specific metrics. RESULTS A total of 1026 cases were included in the analysis cohort. All machine learning models were predictive for outcomes of interest, with the Random Forest algorithm consistently demonstrating the strongest average area under the curve performance, with a peak performance of 0.84 for nonhome discharge. Important features varied per outcome, though age, body mass index, American Society of Anesthesiologists classification >2, and medical comorbidities were highly weighted in the studied outcomes. CONCLUSIONS Machine learning models were successfully applied and predictive of postoperative health utilization after ACDF. Deployment of these tools can assist clinicians in determining high-risk patients. LEVEL OF EVIDENCE III.
Collapse
Affiliation(s)
- Rushmin Khazanchi
- Department of Orthopaedic Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL
| | | | | | | | | | | | | | | | | |
Collapse
|
14
|
Alini M, Diwan AD, Erwin WM, Little CB, Melrose J. An update on animal models of intervertebral disc degeneration and low back pain: Exploring the potential of artificial intelligence to improve research analysis and development of prospective therapeutics. JOR Spine 2023; 6:e1230. [PMID: 36994457 PMCID: PMC10041392 DOI: 10.1002/jsp2.1230] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/13/2022] [Revised: 08/31/2022] [Accepted: 09/11/2022] [Indexed: 02/03/2023] Open
Abstract
Animal models have been invaluable in the identification of molecular events occurring in and contributing to intervertebral disc (IVD) degeneration and important therapeutic targets have been identified. Some outstanding animal models (murine, ovine, chondrodystrophoid canine) have been identified with their own strengths and weaknesses. The llama/alpaca, horse and kangaroo have emerged as new large species for IVD studies, and only time will tell if they will surpass the utility of existing models. The complexity of IVD degeneration poses difficulties in the selection of the most appropriate molecular target of many potential candidates, to focus on in the formulation of strategies to effect disc repair and regeneration. It may well be that many therapeutic objectives should be targeted simultaneously to effect a favorable outcome in human IVD degeneration. Use of animal models in isolation will not allow resolution of this complex issue and a paradigm shift and adoption of new methodologies is required to provide the next step forward in the determination of an effective repairative strategy for the IVD. AI has improved the accuracy and assessment of spinal imaging supporting clinical diagnostics and research efforts to better understand IVD degeneration and its treatment. Implementation of AI in the evaluation of histology data has improved the usefulness of a popular murine IVD model and could also be used in an ovine histopathological grading scheme that has been used to quantify degenerative IVD changes and stem cell mediated regeneration. These models are also attractive candidates for the evaluation of novel anti-oxidant compounds that counter inflammatory conditions in degenerate IVDs and promote IVD regeneration. Some of these compounds also have pain-relieving properties. AI has facilitated development of facial recognition pain assessment in animal IVD models offering the possibility of correlating the potential pain alleviating properties of some of these compounds with IVD regeneration.
Collapse
Affiliation(s)
| | - Ashish D. Diwan
- Spine Service, Department of Orthopedic Surgery, St. George & Sutherland Campus, Clinical SchoolUniversity of New South WalesSydneyNew South WalesAustralia
| | - W. Mark Erwin
- Department of SurgeryUniversity of TorontoOntarioCanada
| | - Chirstopher B. Little
- Raymond Purves Bone and Joint Research LaboratoryKolling Institute, Sydney University Faculty of Medicine and Health, Northern Sydney Area Health District, Royal North Shore HospitalSt. LeonardsNew South WalesAustralia
| | - James Melrose
- Raymond Purves Bone and Joint Research LaboratoryKolling Institute, Sydney University Faculty of Medicine and Health, Northern Sydney Area Health District, Royal North Shore HospitalSt. LeonardsNew South WalesAustralia
- Graduate School of Biomedical EngineeringThe University of New South WalesSydneyNew South WalesAustralia
| |
Collapse
|
15
|
Lans A, Kanbier LN, Bernstein DN, Groot OQ, Ogink PT, Tobert DG, Verlaan JJ, Schwab JH. Social determinants of health in prognostic machine learning models for orthopaedic outcomes: A systematic review. J Eval Clin Pract 2023; 29:292-299. [PMID: 36099267 DOI: 10.1111/jep.13765] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 08/22/2022] [Accepted: 08/27/2022] [Indexed: 11/26/2022]
Abstract
RATIONAL Social determinants of health (SDOH) are being considered more frequently when providing orthopaedic care due to their impact on treatment outcomes. Simultaneously, prognostic machine learning (ML) models that facilitate clinical decision making have become popular tools in the field of orthopaedic surgery. When ML-driven tools are developed, it is important that the perpetuation of potential disparities is minimized. One approach is to consider SDOH during model development. To date, it remains unclear whether and how existing prognostic ML models for orthopaedic outcomes consider SDOH variables. OBJECTIVE To investigate whether prognostic ML models for orthopaedic surgery outcomes account for SDOH, and to what extent SDOH variables are included in the final models. METHODS A systematic search was conducted in PubMed, Embase and Cochrane for studies published up to 17 November 2020. Two reviewers independently extracted SDOH features using the PROGRESS+ framework (place of residence, race/ethnicity, Occupation, gender/sex, religion, education, social capital, socioeconomic status, 'Plus+' age, disability, and sexual orientation). RESULTS The search yielded 7138 studies, of which 59 met the inclusion criteria. Across all studies, 96% (57/59) considered at least one PROGRESS+ factor during development. The most common factors were age (95%; 56/59) and gender/sex (96%; 57/59). Differential effect analyses, such as subgroup analysis, covariate adjustment, and baseline comparison, were rarely reported (10%; 6/59). The majority of models included age (92%; 54/59) and gender/sex (69%; 41/59) as final input variables. However, factors such as insurance status (7%; 4/59), marital status (7%; 4/59) and income (3%; 2/59) were seldom included. CONCLUSION The current level of reporting and consideration of SDOH during the development of prognostic ML models for orthopaedic outcomes is limited. Healthcare providers should be critical of the models they consider using and knowledgeable regarding the quality of model development, such as adherence to recognized methodological standards. Future efforts should aim to avoid bias and disparities when developing ML-driven applications for orthopaedics.
Collapse
Affiliation(s)
- Amanda Lans
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA.,Department of Orthopaedic Surgery, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Laura N Kanbier
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - David N Bernstein
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Olivier Q Groot
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA.,Department of Orthopaedic Surgery, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Paul T Ogink
- Department of Orthopaedic Surgery, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Daniel G Tobert
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Jorrit-Jan Verlaan
- Department of Orthopaedic Surgery, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Joseph H Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
16
|
Teixeira MJC, Khouri M, Martinez E, Bench S. Implementing a discharge process for patients undergoing elective surgery: Rapid review. Int J Orthop Trauma Nurs 2023; 48:101001. [PMID: 36805314 DOI: 10.1016/j.ijotn.2023.101001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2022] [Revised: 01/14/2023] [Accepted: 02/04/2023] [Indexed: 02/11/2023]
Abstract
BACKGROUND Hospital discharge is a 'vulnerable stage' in care. A delayed, inappropriate or poorly planned discharge increases hazards and costs, inhibiting recovery, and often leading to unplanned readmission. New discharge processes could boost practice, reduce the length of stay, and, consequently, reduce costs and improve patients' quality of life. AIM To identify technology based interventions that have been implemented to facilitate a safe and timely discharge procedure after elective surgery, and to describe implementation barriers and facilitators and patient satisfaction. METHOD This rapid review followed a restricted systematic review framework, searching Medline, EMBASE, CINAHL, PsychINFO, and ClinicalTrials.gov. for relevant studies published from 2015 to 2021 in English. RESULTS Eleven studies were included. Most interventions were machine-learning-based, and only one study reported patient involvement. Effective leadership, team work and communication were stated as implementation facilitators. The main barriers to implementation were: lack of support from leaders, poor clinical documentation, resistance to change, and financial and logistical concerns. None of the studies evaluated patient satisfaction. CONCLUSIONS Findings highlight factors that support the implementation of technology based interventions aimed at a safe and timely discharge process following elective surgery. Nurses play an important role in the provision of information, and in the development and implementation of discharge processes.
Collapse
Affiliation(s)
- Maria J C Teixeira
- Nursing Research Department, Royal National Orthopaedic Hospital NHS Trust, London, UK; London South Bank University, London, UK; Nuffield Health, The Manor Hospital, Oxford, UK.
| | - Ma'ali Khouri
- Institute of Orthopaedics Library, University College London, London, UK
| | - Evangeline Martinez
- Functional and Restorative Services, London Spinal Cord Injury Research Centre, Royal National Orthopaedic Hospital NHS Trust, London, UK; University College London, London, UK
| | - Suzanne Bench
- London South Bank University, London, UK; ACORN A Centre of Research for Nurses & Midwives, Guys and St Thomas's NHS Trust, Lond, UK
| |
Collapse
|
17
|
Sweeny L, Slijepcevic A, Curry JM, Philips R, Bonaventure CA, DiLeo M, Luginbuhl AJ, Crawley MB, Guice KM, McCreary E, Buncke M, Petrisor D, Wax MK. Factors Impacting Discharge Destination Following Head and Neck Microvascular Reconstruction. Laryngoscope 2023; 133:95-104. [PMID: 35562185 DOI: 10.1002/lary.30149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Revised: 03/14/2022] [Accepted: 04/16/2022] [Indexed: 02/02/2023]
Abstract
OBJECTIVE Determine which variables impact postoperative discharge destination following head and neck microvascular free flap reconstruction. STUDY DESIGN Retrospective review of prospectively collected databases. METHODS Consecutive patients undergoing head and neck microvascular free flap reconstruction between January 2010 and December 2019 (n = 1972) were included. Preoperative, operative and postoperative variables were correlated with discharge destination (home, skilled nursing facility [SNF], rehabilitation facility, death). RESULTS The mean age of patients discharged home was lower (60 SD ± 13, n = 1450) compared to those discharged to an SNF (68 SD ± 14, n = 168) or a rehabilitation facility (71 SD ± 14, n = 200; p < 0.0001). Operative duration greater than 10 h correlated with a higher percentage of patients being discharged to a rehabilitation or SNF (25% vs. 15%; p < 0.001). Patients were less likely to be discharged home if they had a known history of cardiac disease (71% vs. 82%; p < 0.0001). Patients were less likely to be discharged home if they experienced alcohol withdrawal (67% vs. 80%; p = 0.006), thromboembolism (59% vs. 80%; p = 0.001), a pulmonary complication (46% vs. 81%; p < 0.0001), a cardiac complication (46% vs. 80%; p < 0.0001), or a cerebral vascular event (25% vs. 80%; p < 0.0001). There was no correlation between discharge destination and occurrence of postoperative wound infection, salivary fistula, partial tissue necrosis or free flap failure. Thirty-day readmission rates were similar when stratified by discharge destination. CONCLUSION There was no correlation with the anatomic site, free flap donor selection, or free flap survival and discharge destination. Patient age, operative duration and occurrence of a medical complication postoperatively did correlate with discharge destination. LEVEL OF EVIDENCE 4 Laryngoscope, 133:95-104, 2023.
Collapse
Affiliation(s)
- Larissa Sweeny
- Department of Otolaryngology-Head and Neck Surgery, University of Miami, Miami, Florida, U.S.A
| | - Allison Slijepcevic
- Department of Otolaryngology-Head and Neck Surgery, Oregon Health and Science University, Portland, Oregon, U.S.A
| | - Joseph M Curry
- Department of Otolaryngology-Head and Neck Surgery, Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A
| | - Ramez Philips
- Department of Otolaryngology-Head and Neck Surgery, Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A
| | - Caroline A Bonaventure
- School of Medicine, Louisiana State University Health Science Center - New Orleans, New Orleans, Louisiana, U.S.A
| | - Michael DiLeo
- Department of Otolaryngology-Head and Neck Surgery, Louisiana State University Health Science Center - New Orleans, New Orleans, Louisiana, U.S.A
| | - Adam J Luginbuhl
- Department of Otolaryngology-Head and Neck Surgery, Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A
| | - Meghan B Crawley
- Department of Otolaryngology-Head and Neck Surgery, Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A
| | - Kelsie M Guice
- School of Medicine, Louisiana State University Health Science Center - New Orleans, New Orleans, Louisiana, U.S.A
| | - Eleanor McCreary
- Oregon Health and Science University School of Medicine, Portland, Oregon, U.S.A
| | - Michelle Buncke
- Oregon Health and Science University School of Medicine, Portland, Oregon, U.S.A
| | - Daniel Petrisor
- Department of Otolaryngology-Head and Neck Surgery, Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A
| | - Mark K Wax
- Department of Otolaryngology-Head and Neck Surgery, Oregon Health and Science University, Portland, Oregon, U.S.A
| |
Collapse
|
18
|
Rentsch S, Vitale CA, Zietlow K. Prioritizing geriatrics in medical education improves care for all. MEDICAL EDUCATION ONLINE 2022; 27:2105549. [PMID: 35899375 PMCID: PMC9341335 DOI: 10.1080/10872981.2022.2105549] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Revised: 07/19/2022] [Accepted: 07/20/2022] [Indexed: 06/15/2023]
Abstract
Within the United States, there is a deficit of Geriatricians providing care for older adults, and this deficit will only grow as the population continues to age, meaning all clinicians, particularly Internal Medicine (IM) and Family Medicine (FM) trained physicians, will provide the bulk of primary care for older adults. However, geriatric training requirements for clinicians fall short, and in the case of IM were reduced as of 2022). Serving as a call to action, this article provides insight on ways to enhance geriatric education for all graduate medical trainees, utilizing both conventional teaching and newer, non-traditional media, such as national online journal clubs, podcasts, and online teaching curricula, as well as expanding sites of training to include evidence-based models of care, such as the Program of All-Inclusive Care for the Elderly (PACE). Providing geriatric education improves care for older adults and our future selves, ensuring trainees are prepared to care and advocate for this diverse and often vulnerable population.
Collapse
Affiliation(s)
- Samuel Rentsch
- Department of Anesthesiology, University of Michigan, Ann Arbor, MI, USA
| | - Caroline A. Vitale
- Department of Medicine, University of Michigan and Geriatric Research Education and Clinical Center (GRECC), Veterans Affairs Healthcare System, Ann Arbor, MI, USA
| | - Kahli Zietlow
- Department of Medicine, University of Michigan and Geriatric Research Education and Clinical Center (GRECC), Veterans Affairs Healthcare System, Ann Arbor, MI, USA
| |
Collapse
|
19
|
Neighborhood-level socioeconomic status, extended length of stay, and discharge disposition following elective lumbar spine surgery. NORTH AMERICAN SPINE SOCIETY JOURNAL 2022; 12:100187. [PMID: 36561892 PMCID: PMC9763740 DOI: 10.1016/j.xnsj.2022.100187] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Revised: 11/21/2022] [Accepted: 11/21/2022] [Indexed: 11/27/2022]
Abstract
Background In the context of increased attention afforded to hospital efficiency and improved but safe patient throughput, decreasing unnecessary hospital length of stay (LOS) is imperative. Given that lumbar spine procedures may be among a hospital's most profitable services, identifying patients at risk of increased healthcare resource utilization prior to surgery is a valuable opportunity to develop targeted pre- and peri-operative intervention and quality improvement initiatives. The purpose of the present investigation was to examine patient factors that predict prolonged LOS as well as discharge disposition following elective, posterior, lumbar spine surgery. Methods We employed a retrospective cohort analysis on 779 consecutive patients treated with lumbar surgery without fusion. Our primary outcome measures were extended LOS (three or more midnights) and discharge disposition. Patient sociodemographic, procedural, and discharge characteristics were adjusted for in our analysis. Sociodemographic variables included Area of Deprivation Index (ADI), a comprehensive metric of socioeconomic status, utilizing income, education, employment, and housing quality based on patient zip code. Multivariable logistic regression and ordinal logistic regression analyses were performed to assess whether covariates were independently predictive of extended LOS and discharge disposition, respectively. Results 779 patients were studied, with a median age of 66 years (±15) and a median LOS of 1 midnight (range, 1-10 midnights). Patients in the most disadvantaged ADI quintile (adjusted odds ratio, aOR 2.48 95% CI 1.15-5.47), those who underwent a minimally-invasive or tubular retractor surgery (aOR 3.03 95% CI 1.02-8.56), those who had an intra-operative drain placed (aOR 4.46 95% CI 2.53-7.26), who had a cerebrospinal fluid leak (aOR 3.46 95% CI 1.55-7.58), who were discharged anywhere but home (aOR 17.11 95% CI 9.24-33.00), and those who were evaluated by physical therapy (aOR 7.23 95% CI 2.13-45.30) or OT (aOR 2.20 95% CI 1.13-4.22) had a significantly increased chance of an extended LOS. Preoperative opioid use was not associated with an increased LOS following surgery (aOR 1.12 95% CI 0.56-1.46). Extended LOS was not associated with post-discharge emergency department representation or unplanned readmission within 90 days following discharge (p=0.148). Patients who were older (aOR 1.99 95% CI 1.62-2.48), in higher quintiles on ADI (3rd quintile; aOR 1.90 95% CI 1.12-3.23, 4th quintile; aOR 1.79, 95% CI 1.05-3.05, 5th quintile; aOR 2.16 95% CI 1.26-3.75), who had a CSF leak (aOR 2.18 95% CI 1.22-3.86), or who had a longer procedure duration (aOR 1.38 95% CI 1.17-1.62) were more likely to require additional services or be sent to a subacute facility upon discharge. Conclusions Patient sociodemographics, along with procedural factors, and discharge disposition were all associated with an increased likelihood of prolonged LOS and resource intensive discharges following elective lumbar spine surgery. Several of these factors could be reliably identified pre-operatively and may be amenable to targeted preoperative intervention. Improving discharge disposition planning in the peri-operative period may allow for more efficient use of hospitalization and inpatient and post-acute resources.
Collapse
|
20
|
Lopez CD, Boddapati V, Lombardi JM, Lee NJ, Mathew J, Danford NC, Iyer RR, Dyrszka MD, Sardar ZM, Lenke LG, Lehman RA. Artificial Learning and Machine Learning Applications in Spine Surgery: A Systematic Review. Global Spine J 2022; 12:1561-1572. [PMID: 35227128 PMCID: PMC9393994 DOI: 10.1177/21925682211049164] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
OBJECTIVES This current systematic review sought to identify and evaluate all current research-based spine surgery applications of AI/ML in optimizing preoperative patient selection, as well as predicting and managing postoperative outcomes and complications. METHODS A comprehensive search of publications was conducted through the EMBASE, Medline, and PubMed databases using relevant keywords to maximize the sensitivity of the search. No limits were placed on level of evidence or timing of the study. Findings were reported according to the PRISMA guidelines. RESULTS After application of inclusion and exclusion criteria, 41 studies were included in this review. Bayesian networks had the highest average AUC (.80), and neural networks had the best accuracy (83.0%), sensitivity (81.5%), and specificity (71.8%). Preoperative planning/cost prediction models (.89,82.2%) and discharge/length of stay models (.80,78.0%) each reported significantly higher average AUC and accuracy compared to readmissions/reoperation prediction models (.67,70.2%) (P < .001, P = .005, respectively). Model performance also significantly varied across postoperative management applications for average AUC and accuracy values (P < .001, P < .027, respectively). CONCLUSIONS Generally, authors of the reviewed studies concluded that AI/ML offers a potentially beneficial tool for providers to optimize patient care and improve cost-efficiency. More specifically, AI/ML models performed best, on average, when optimizing preoperative patient selection and planning and predicting costs, hospital discharge, and length of stay. However, models were not as accurate in predicting postoperative complications, adverse events, and readmissions and reoperations. An understanding of AI/ML-based applications is becoming increasingly important, particularly in spine surgery, as the volume of reported literature, technology accessibility, and clinical applications continue to rapidly expand.
Collapse
Affiliation(s)
- Cesar D. Lopez
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Venkat Boddapati
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA,Venkat Boddapati, MD, Columbia University Irving Medical Center, 622 W. 168th St., PH-11, New York, NY 10032, USA.
| | - Joseph M. Lombardi
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Nathan J. Lee
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Justin Mathew
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Nicholas C. Danford
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Rajiv R. Iyer
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Marc D. Dyrszka
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Zeeshan M. Sardar
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Lawrence G. Lenke
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Ronald A. Lehman
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| |
Collapse
|
21
|
Hornung AL, Hornung CM, Mallow GM, Barajas JN, Rush A, Sayari AJ, Galbusera F, Wilke HJ, Colman M, Phillips FM, An HS, Samartzis D. Artificial intelligence in spine care: current applications and future utility. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2022; 31:2057-2081. [PMID: 35347425 DOI: 10.1007/s00586-022-07176-0] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 01/18/2022] [Accepted: 03/08/2022] [Indexed: 01/20/2023]
Abstract
PURPOSE The field of artificial intelligence is ever growing and the applications of machine learning in spine care are continuously advancing. Given the advent of the intelligence-based spine care model, understanding the evolution of computation as it applies to diagnosis, treatment, and adverse event prediction is of great importance. Therefore, the current review sought to synthesize findings from the literature at the interface of artificial intelligence and spine research. METHODS A narrative review was performed based on the literature of three databases (MEDLINE, CINAHL, and Scopus) from January 2015 to March 2021 that examined historical and recent advancements in the understanding of artificial intelligence and machine learning in spine research. Studies were appraised for their role in, or description of, advancements within image recognition and predictive modeling for spinal research. Only English articles that fulfilled inclusion criteria were ultimately incorporated in this review. RESULTS This review briefly summarizes the history and applications of artificial intelligence and machine learning in spine. Three basic machine learning training paradigms: supervised learning, unsupervised learning, and reinforced learning are also discussed. Artificial intelligence and machine learning have been utilized in almost every facet of spine ranging from localization and segmentation techniques in spinal imaging to pathology specific algorithms which include but not limited to; preoperative risk assessment of postoperative complications, screening algorithms for patients at risk of osteoporosis and clustering analysis to identify subgroups within adolescent idiopathic scoliosis. The future of artificial intelligence and machine learning in spine surgery is also discussed with focusing on novel algorithms, data collection techniques and increased utilization of automated systems. CONCLUSION Improvements to modern-day computing and accessibility to various imaging modalities allow for innovative discoveries that may arise, for example, from management. Given the imminent future of AI in spine surgery, it is of great importance that practitioners continue to inform themselves regarding AI, its goals, use, and progression. In the future, it will be critical for the spine specialist to be able to discern the utility of novel AI research, particularly as it continues to pervade facets of everyday spine surgery.
Collapse
Affiliation(s)
- Alexander L Hornung
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | | | - G Michael Mallow
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - J Nicolás Barajas
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Augustus Rush
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Arash J Sayari
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | | | - Hans-Joachim Wilke
- Institute of Orthopaedic Research and Biomechanics, Trauma Research Center Ulm, Ulm University, Ulm, Germany
| | - Matthew Colman
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Frank M Phillips
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Howard S An
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Dino Samartzis
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA.
| |
Collapse
|
22
|
Klemt C, Uzosike AC, Harvey MJ, Laurencin S, Habibi Y, Kwon YM. Neural network models accurately predict discharge disposition after revision total knee arthroplasty? Knee Surg Sports Traumatol Arthrosc 2022; 30:2591-2599. [PMID: 34716766 DOI: 10.1007/s00167-021-06778-3] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 10/15/2021] [Indexed: 01/18/2023]
Abstract
PURPOSE Based on the rising incidence of revision total knee arthroplasty (TKA), bundled payment models may be applied to revision TKA in the near future. Facility discharge represents a significant cost factor for those bundled payment models; however, accurately predicting discharge disposition remains a clinical challenge. The purpose of this study was to develop and validate artificial intelligence algorithms to predict discharge disposition following revision total knee arthroplasty. METHODS A retrospective review of electronic patient records was conducted to identify patients who underwent revision total knee arthroplasty. Discharge disposition was defined as either home discharge or non-home discharge, which included rehabilitation and skilled nursing facilities. Four artificial intelligence algorithms were developed to predict this outcome and were assessed by discrimination, calibration and decision curve analysis. RESULTS A total of 2228 patients underwent revision TKA, of which 1405 patients (63.1%) were discharged home, whereas 823 patients (36.9%) were discharged to a non-home facility. The strongest predictors for non-home discharge following revision TKA were American Society of Anesthesiologist (ASA) score, Medicare insurance type and revision surgery for peri-prosthetic joint infection, non-white ethnicity and social status (living alone). The best performing artificial intelligence algorithm was the neural network model which achieved excellent performance across discrimination (AUC = 0.87), calibration and decision curve analysis. CONCLUSION This study developed four artificial intelligence algorithms for the prediction of non-home discharge disposition for patients following revision total knee arthroplasty. The study findings show excellent performance on discrimination, calibration and decision curve analysis for all four candidate algorithms. Therefore, these models have the potential to guide preoperative patient counselling and improve the value (clinical and functional outcomes divided by costs) of revision total knee arthroplasty patients. LEVEL OF EVIDENCE IV.
Collapse
Affiliation(s)
- Christian Klemt
- Bioengineering Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Boston, MA, 02114, USA
| | - Akachimere Cosmas Uzosike
- Bioengineering Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Boston, MA, 02114, USA
| | - Michael Joseph Harvey
- Bioengineering Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Boston, MA, 02114, USA
| | - Samuel Laurencin
- Bioengineering Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Boston, MA, 02114, USA
| | - Yasamin Habibi
- Bioengineering Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Boston, MA, 02114, USA
| | - Young-Min Kwon
- Bioengineering Laboratory, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Boston, MA, 02114, USA.
| |
Collapse
|
23
|
Bulstra AEJ. A Machine Learning Algorithm to Estimate the Probability of a True Scaphoid Fracture After Wrist Trauma. J Hand Surg Am 2022; 47:709-718. [PMID: 35667955 DOI: 10.1016/j.jhsa.2022.02.023] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/25/2021] [Revised: 01/12/2022] [Accepted: 02/23/2022] [Indexed: 02/02/2023]
Abstract
PURPOSE To identify predictors of a true scaphoid fracture among patients with radial wrist pain following acute trauma, train 5 machine learning (ML) algorithms in predicting scaphoid fracture probability, and design a decision rule to initiate advanced imaging in high-risk patients. METHODS Two prospective cohorts including 422 patients with radial wrist pain following wrist trauma were combined. There were 117 scaphoid fractures (28%) confirmed on computed tomography, magnetic resonance imaging, or radiographs. Eighteen fractures (15%) were occult. Predictors of a scaphoid fracture were identified among demographics, mechanism of injury and examination maneuvers. Five ML-algorithms were trained in calculating scaphoid fracture probability. ML-algorithms were assessed on ability to discriminate between patients with and without a fracture (area under the receiver operating characteristic curve), agreement between observed and predicted probabilities (calibration), and overall performance (Brier score). The best performing ML-algorithm was incorporated into a probability calculator. A decision rule was proposed to initiate advanced imaging among patients with negative radiographs. RESULTS Pain over the scaphoid on ulnar deviation, sex, age, and mechanism of injury were most strongly associated with a true scaphoid fracture. The best performing ML-algorithm yielded an area under the receiver operating characteristic curve, calibration slope, intercept, and Brier score of 0.77, 0.84, -0.01 and 0.159, respectively. The ML-derived decision rule proposes to initiate advanced imaging in patients with radial-sided wrist pain, negative radiographs, and a fracture probability of ≥10%. When applied to our cohort, this would yield 100% sensitivity, 38% specificity, and would have reduced the number of patients undergoing advanced imaging by 36% without missing a fracture. CONCLUSIONS The ML-algorithm accurately calculated scaphoid fracture probability based on scaphoid pain on ulnar deviation, sex, age, and mechanism of injury. The ML-decision rule may reduce the number of patients undergoing advanced imaging by a third with a small risk of missing a fracture. External validation is required before implementation. TYPE OF STUDY/LEVEL OF EVIDENCE Diagnostic II.
Collapse
Affiliation(s)
- Anne Eva J Bulstra
- Department of Orthopaedic Surgery, Amsterdam University Medical Centre (UMC), Amsterdam, the Netherlands; Department of Orthopaedic and Trauma Surgery, Flinders Medical Centre, Flinders University, Bedford Park, South Australia, Australia.
| | | |
Collapse
|
24
|
Staartjes VE, Joswig H, Corniola MV, Schaller K, Gautschi OP, Stienen MN. Association of Medical Comorbidities With Objective Functional Impairment in Lumbar Degenerative Disc Disease. Global Spine J 2022; 12:1184-1191. [PMID: 33334183 PMCID: PMC9210248 DOI: 10.1177/2192568220979120] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
STUDY DESIGN Analysis of a prospective 2-center database. OBJECTIVES Medical comorbidities co-determine clinical outcome. Objective functional impairment (OFI) provides a supplementary dimension of patient assessment. We set out to study whether comorbidities are associated with the presence and degree of OFI in this patient population. METHODS Patients with degenerative diseases of the spine preoperatively performed the timed-up-and-go (TUG) test and a battery of questionnaires. Comorbidities were quantified using the Charlson Comorbidity Index (CCI) and the American Society of Anesthesiology (ASA) grading. Crude and adjusted linear regression models were fitted. RESULTS Of 375 included patients, 97 (25.9%) presented at least some degree of medical comorbidity according to the CCI, and 312 (83.2%) according to ASA grading. In the univariate analysis, the CCI was inconsistently associated with OFI. Only patients with low-grade CCI comorbidity displayed significantly higher TUG test times (p = 0.004). In the multivariable analysis, this effect persisted for patients with CCI = 1 (p = 0.030). Regarding ASA grade, patients with ASA = 3 exhibited significantly increased TUG test times (p = 0.003) and t-scores (p = 0.015). This effect disappeared after multivariable adjustment (p = 0.786 and p = 0.969). In addition, subjective functional impairment according to ODI, and EQ5D index was moderately associated with comorbidities according to ASA (all p < 0.05). CONCLUSION The degree of medical comorbidities appears only weakly and inconsistently associated with OFI in patients scheduled for degenerative lumbar spine surgery, especially after controlling for potential confounders. TUG testing may be valid even in patients with relatively severe comorbidities who are able to complete the test.
Collapse
Affiliation(s)
- Victor E. Staartjes
- Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Holger Joswig
- Department of Neurosurgery, Health and Medical University Potsdam, Ernst von Bergmann Hospital, Potsdam, Germany
| | - Marco V. Corniola
- Department of Neurosurgery, Geneva University Hospital and Faculty of Medicine, Geneva, Switzerland
| | - Karl Schaller
- Department of Neurosurgery, Geneva University Hospital and Faculty of Medicine, Geneva, Switzerland
| | - Oliver P. Gautschi
- Neuro- und Wirbelsäulenzentrum Zentralschweiz, Klinik St.Anna, Luzern, Switzerland
| | - Martin N. Stienen
- Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland,Department of Neurosurgery, Kantonsspital St.Gallen, St.Gallen, Switzerland,Martin N. Stienen, MD/FEBNS, Department of Neurosurgery, Kantonsspital St.Gallen, Rorschacher Str. 95, 9007 St.Gallen, Switzerland.
| |
Collapse
|
25
|
André A, Peyrou B, Carpentier A, Vignaux JJ. Feasibility and Assessment of a Machine Learning-Based Predictive Model of Outcome After Lumbar Decompression Surgery. Global Spine J 2022; 12:894-908. [PMID: 33207969 PMCID: PMC9344503 DOI: 10.1177/2192568220969373] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
STUDY DESIGN Retrospective study at a unique center. OBJECTIVE The aim of this study is twofold, to develop a virtual patients model for lumbar decompression surgery and to evaluate the precision of an artificial neural network (ANN) model designed to accurately predict the clinical outcomes of lumbar decompression surgery. METHODS We performed a retrospective study of complete Electronic Health Records (EHR) to identify potential unfavorable criteria for spine surgery (predictors). A cohort of synthetics EHR was created to classify patients by surgical success (green zone) or partial failure (orange zone) using an Artificial Neural Network which screens all the available predictors. RESULTS In the actual cohort, we included 60 patients, with complete EHR allowing efficient analysis, 26 patients were in the orange zone (43.4%) and 34 were in the green zone (56.6%). The average positive criteria amount for actual patients was 8.62 for the green zone (SD+/- 3.09) and 10.92 for the orange zone (SD 3.38). The classifier (a neural network) was trained using 10,000 virtual patients and 2000 virtual patients were used for test purposes. The 12,000 virtual patients were generated from the 60 EHR, of which half were in the green zone and half in the orange zone. The model showed an accuracy of 72% and a ROC score of 0.78. The sensitivity was 0.885 and the specificity 0.59. CONCLUSION Our method can be used to predict a favorable patient to have lumbar decompression surgery. However, there is still a need to further develop its ability to analyze patients in the "failure of treatment" zone to offer precise management of patient health before spinal surgery.
Collapse
Affiliation(s)
- Arthur André
- Ramsay santé, Clinique Geoffroy
Saint-Hilaire, Paris, France,Neurosurgery Department,
Pitié-Salpêtrière University Hospital, Paris, France,Cortexx Medical Intelligence, Paris,
France,Arthur André, Cortexx Medical Intelligence,
156 Boulevard, Haussmann 75008, Paris.
| | | | | | | |
Collapse
|
26
|
Can machine learning models predict failure of revision total hip arthroplasty? Arch Orthop Trauma Surg 2022; 143:2805-2812. [PMID: 35507088 DOI: 10.1007/s00402-022-04453-x] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 04/15/2022] [Indexed: 12/11/2022]
Abstract
INTRODUCTION Revision total hip arthroplasty (THA) represents a technically demanding surgical procedure which is associated with significant morbidity and mortality. Understanding risk factors for failure of revision THA is of clinical importance to identify at-risk patients. This study aimed to develop and validate novel machine learning algorithms for the prediction of re-revision surgery for patients following revision total hip arthroplasty. METHODS A total of 2588 consecutive patients that underwent revision THA was evaluated, including 408 patients (15.7%) with confirmed re-revision THA. Electronic patient records were manually reviewed to identify patient demographics, implant characteristics and surgical variables that may be associated with re-revision THA. Machine learning algorithms were developed to predict re-revision THA and these models were assessed by discrimination, calibration and decision curve analysis. RESULTS The strongest predictors for re-revision THA as predicted by the four validated machine learning models were the American Society of Anaesthesiology score, obesity (> 35 kg/m2) and indication for revision THA. The four machine learning models all achieved excellent performance across discrimination (AUC > 0.80), calibration and decision curve analysis. Higher net benefits for all machine learning models were demonstrated, when compared to the default strategies of changing management for all patients or no patients. CONCLUSION This study developed four machine learning models for the prediction of re-revision surgery for patients following revision total hip arthroplasty. The study findings show excellent model performance, highlighting the potential of these computational models to assist in preoperative patient optimization and counselling to improve revision THA patient outcomes. LEVEL OF EVIDENCE Level III, case-control retrospective analysis.
Collapse
|
27
|
Doerr SA, Weber-Levine C, Hersh AM, Awosika T, Judy B, Jin Y, Raj D, Liu A, Lubelski D, Jones CK, Sair HI, Theodore N. Automated prediction of the Thoracolumbar Injury Classification and Severity Score from CT using a novel deep learning algorithm. Neurosurg Focus 2022; 52:E5. [PMID: 35364582 DOI: 10.3171/2022.1.focus21745] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 01/18/2022] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Damage to the thoracolumbar spine can confer significant morbidity and mortality. The Thoracolumbar Injury Classification and Severity Score (TLICS) is used to categorize injuries and determine patients at risk of spinal instability for whom surgical intervention is warranted. However, calculating this score can constitute a bottleneck in triaging and treating patients, as it relies on multiple imaging studies and a neurological examination. Therefore, the authors sought to develop and validate a deep learning model that can automatically categorize vertebral morphology and determine posterior ligamentous complex (PLC) integrity, two critical features of TLICS, using only CT scans. METHODS All patients who underwent neurosurgical consultation for traumatic spine injury or degenerative pathology resulting in spine injury at a single tertiary center from January 2018 to December 2019 were retrospectively evaluated for inclusion. The morphology of injury and integrity of the PLC were categorized on CT scans. A state-of-the-art object detection region-based convolutional neural network (R-CNN), Faster R-CNN, was leveraged to predict both vertebral locations and the corresponding TLICS. The network was trained with patient CT scans, manually labeled vertebral bounding boxes, TLICS morphology, and PLC annotations, thus allowing the model to output the location of vertebrae, categorize their morphology, and determine the status of PLC integrity. RESULTS A total of 111 patients were included (mean ± SD age 62 ± 20 years) with a total of 129 separate injury classifications. Vertebral localization and PLC integrity classification achieved Dice scores of 0.92 and 0.88, respectively. Binary classification between noninjured and injured morphological scores demonstrated 95.1% accuracy. TLICS morphology accuracy, the true positive rate, and positive injury mismatch classification rate were 86.3%, 76.2%, and 22.7%, respectively. Classification accuracy between no injury and suspected PLC injury was 86.8%, while true positive, false negative, and false positive rates were 90.0%, 10.0%, and 21.8%, respectively. CONCLUSIONS In this study, the authors demonstrate a novel deep learning method to automatically predict injury morphology and PLC disruption with high accuracy. This model may streamline and improve diagnostic decision support for patients with thoracolumbar spinal trauma.
Collapse
Affiliation(s)
- Sophia A Doerr
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Carly Weber-Levine
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Andrew M Hersh
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Tolulope Awosika
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Brendan Judy
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Yike Jin
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Divyaansh Raj
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Ann Liu
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Daniel Lubelski
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| | - Craig K Jones
- 2Malone Center for Engineering in Healthcare, Johns Hopkins University, Baltimore; and
| | - Haris I Sair
- 3Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Nicholas Theodore
- 1Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore
| |
Collapse
|
28
|
Saravi B, Hassel F, Ülkümen S, Zink A, Shavlokhova V, Couillard-Despres S, Boeker M, Obid P, Lang GM. Artificial Intelligence-Driven Prediction Modeling and Decision Making in Spine Surgery Using Hybrid Machine Learning Models. J Pers Med 2022; 12:jpm12040509. [PMID: 35455625 PMCID: PMC9029065 DOI: 10.3390/jpm12040509] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 03/18/2022] [Accepted: 03/19/2022] [Indexed: 12/22/2022] Open
Abstract
Healthcare systems worldwide generate vast amounts of data from many different sources. Although of high complexity for a human being, it is essential to determine the patterns and minor variations in the genomic, radiological, laboratory, or clinical data that reliably differentiate phenotypes or allow high predictive accuracy in health-related tasks. Convolutional neural networks (CNN) are increasingly applied to image data for various tasks. Its use for non-imaging data becomes feasible through different modern machine learning techniques, converting non-imaging data into images before inputting them into the CNN model. Considering also that healthcare providers do not solely use one data modality for their decisions, this approach opens the door for multi-input/mixed data models which use a combination of patient information, such as genomic, radiological, and clinical data, to train a hybrid deep learning model. Thus, this reflects the main characteristic of artificial intelligence: simulating natural human behavior. The present review focuses on key advances in machine and deep learning, allowing for multi-perspective pattern recognition across the entire information set of patients in spine surgery. This is the first review of artificial intelligence focusing on hybrid models for deep learning applications in spine surgery, to the best of our knowledge. This is especially interesting as future tools are unlikely to use solely one data modality. The techniques discussed could become important in establishing a new approach to decision-making in spine surgery based on three fundamental pillars: (1) patient-specific, (2) artificial intelligence-driven, (3) integrating multimodal data. The findings reveal promising research that already took place to develop multi-input mixed-data hybrid decision-supporting models. Their implementation in spine surgery may hence be only a matter of time.
Collapse
Affiliation(s)
- Babak Saravi
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
- Institute of Experimental Neuroregeneration, Spinal Cord Injury and Tissue Regeneration Center Salzburg (SCI-TReCS), Paracelsus Medical University, 5020 Salzburg, Austria;
- Correspondence:
| | - Frank Hassel
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Sara Ülkümen
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Alisia Zink
- Department of Spine Surgery, Loretto Hospital, 79100 Freiburg, Germany; (F.H.); (A.Z.)
| | - Veronika Shavlokhova
- Department of Oral and Maxillofacial Surgery, University Hospital Heidelberg, 69120 Heidelberg, Germany;
| | - Sebastien Couillard-Despres
- Institute of Experimental Neuroregeneration, Spinal Cord Injury and Tissue Regeneration Center Salzburg (SCI-TReCS), Paracelsus Medical University, 5020 Salzburg, Austria;
- Austrian Cluster for Tissue Regeneration, 1200 Vienna, Austria
| | - Martin Boeker
- Intelligence and Informatics in Medicine, Medical Center Rechts der Isar, School of Medicine, Technical University of Munich, 81675 Munich, Germany;
| | - Peter Obid
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
| | - Gernot Michael Lang
- Department of Orthopedics and Trauma Surgery, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, 79108 Freiburg, Germany; (S.Ü.); (P.O.); (G.M.L.)
| |
Collapse
|
29
|
DelSole EM, Keck WL, Patel AA. The State of Machine Learning in Spine Surgery: A Systematic Review. Clin Spine Surg 2022; 35:80-89. [PMID: 34121074 DOI: 10.1097/bsd.0000000000001208] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Accepted: 04/14/2021] [Indexed: 11/27/2022]
Abstract
STUDY DESIGN This was a systematic review of existing literature. OBJECTIVE The objective of this study was to evaluate the current state-of-the-art trends and utilization of machine learning in the field of spine surgery. SUMMARY OF BACKGROUND DATA The past decade has seen a rise in the clinical use of machine learning in many fields including diagnostic radiology and oncology. While studies have been performed that specifically pertain to spinal surgery, there have been relatively few aggregate reviews of the existing scientific literature as applied to clinical spine surgery. METHODS This study utilized Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to review the scientific literature from 2009 to 2019 with syntax specific for machine learning and spine surgery applications. Specific data was extracted from the available literature including algorithm application, algorithms tested, database type and size, algorithm training method, and outcome of interest. RESULTS A total of 44 studies met inclusion criteria, of which the majority were level III evidence. Studies were grouped into 4 general types: diagnostic tools, clinical outcome prediction, surgical assessment tools, and decision support tools. Across studies, a wide swath of algorithms were used, which were trained across multiple disparate databases. There were no studies identified that assessed the ethical implementation or patient perceptions of machine learning in clinical care. CONCLUSIONS The results reveal the broad range of clinical applications and methods used to create machine learning algorithms for use in the field of spine surgery. Notable disparities exist in algorithm choice, database characteristics, and training methods. Ongoing research is needed to make machine learning operational on a large scale.
Collapse
Affiliation(s)
- Edward M DelSole
- Department of Orthopaedic Surgery, Division of Spine Surgery, Geisinger Musculoskeletal Institute
| | - Wyatt L Keck
- Geisinger Commonwealth School of Medicine, Scranton
| | - Aalpen A Patel
- Department of Radiology (Geisinger), Steele Institute for Health Innovation and Geisinger, Danville, PA
| |
Collapse
|
30
|
Hori T, Imura T, Tanaka R. Development of a clinical prediction rule for patients with cervical spinal cord injury who have difficulty in obtaining independent living. Spine J 2022; 22:321-328. [PMID: 34487911 DOI: 10.1016/j.spinee.2021.08.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/02/2021] [Revised: 08/27/2021] [Accepted: 08/27/2021] [Indexed: 02/03/2023]
Abstract
BACKGROUND CONTEXT A simple and easy to use clinical prediction rule (CPR) to detect patients with a cervical spinal cord injury (SCI) who would have difficulty in obtaining independent living status is vital for providing the optimal rehabilitation and education in both care recipients and caregivers. A machine learning approach was recently applied to the field of rehabilitation and has the possibility to develop an accurate and useful CPR. PURPOSE The aim of this study was to develop and assess a CPR using a decision tree algorithm for predicting which patients with a cervical SCI would have difficulty in obtaining an independent living. STUDY DESIGN The present study was a cohort study. PATIENT SAMPLE In the present study, the data was obtained from the nationwide Japan Rehabilitation Database (JRD). The data on the SCIs was collected from 10 hospitals and the data was collected from the registries obtained between 2005 and 2015. The severity of SCI can vary, and patient prognosis differs depending on the damage site. In this study, the patients with cervical SCI were included. OUTCOME MEASURES In this study, the degree of the independent living at discharge was investigated. The degree of the independent living was classified and listed as below: independent in social, independent at home, need care at home, independent at facility, need care at facility. In this study, the independent in social and independent at home were defined as "independent," and the other situations were defined as "non-independent." METHODS We performed a classification and regression tree (CART) analysis to develop the CPR to predict whether the cervical SCI patients obtain an independent living at discharge. The area under the curve, the classification accuracy, sensitivity, specificity, and positive predictive value were used for model evaluation. RESULTS A total of 4181 patients with SCI were registered in the JRD and the CART analysis was performed for 1282 patients with the cervical SCI. The Functional Independence Measure (FIM) total score and the American Spinal Injury Association impairment scale were identified as the first and second discriminators for predicting the degree of the independence, respectively. Subsequently, the CART model identified FIM eating, the residual function level, and the FIM bed to chair transfer as next discriminators. Each parameter for evaluating the CART model were the area under the curve 0.813, the classification accuracy 78.6%, the sensitivity 80.7%, the specificity 75.1%, and the positive predictive value 84.5%. CONCLUSIONS In this study, we developed a clinically useful CPR with moderate accuracy to predict whether the cervical SCI patients obtain independent living at the discharge.
Collapse
Affiliation(s)
- Tomonari Hori
- Department of Rehabilitation, Fukuyama Rehabilitation Hospital, 2-15-41, Myojincho, Fukuyama 721-0961, Japan
| | - Takeshi Imura
- Department of Rehabilitation, Faculty of Health Sciences, Hiroshima Cosmopolitan University, 3-2-1, Otsuka-higashi, Hiroshima 731-3166, Japan; Graduate School of Humanities and Social Sciences, Hiroshima University, 1-3-2, Kagamiyama, Higashihiroshima 739-8511, Japan.
| | - Ryo Tanaka
- Graduate School of Humanities and Social Sciences, Hiroshima University, 1-3-2, Kagamiyama, Higashihiroshima 739-8511, Japan
| |
Collapse
|
31
|
Zietlow KE, Wong S, Heflin MT, McDonald SR, Sickeler R, Devinney M, Blitz J, Lagoo-Deenadayalan S, Berger M. Geriatric Preoperative Optimization: A Review. Am J Med 2022; 135:39-48. [PMID: 34416164 PMCID: PMC8688225 DOI: 10.1016/j.amjmed.2021.07.028] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Revised: 07/07/2021] [Accepted: 07/13/2021] [Indexed: 02/07/2023]
Abstract
This review summarizes best practices for the perioperative care of older adults as recommended by the American Geriatrics Society, American Society of Anesthesiologists, and American College of Surgeons, with practical implementation strategies that can be readily implemented in busy preoperative or primary care clinics. In addition to traditional cardiopulmonary screening, older patients should undergo a comprehensive geriatric assessment. Rapid screening tools such as the Mini-Cog, Patient Health Questionnaire-2, and Frail Non-Disabled Survey and Clinical Frailty Scale, can be performed by multiple provider types and allow for quick, accurate assessments of cognition, functional status, and frailty screening. To assess polypharmacy, online resources can help providers identify and safely taper high-risk medications. Based on preoperative assessment findings, providers can recommend targeted prehabilitation, rehabilitation, medication management, care coordination, and/or delirium prevention interventions to improve postoperative outcomes for older surgical patients. Structured goals of care discussions utilizing the question-prompt list ensures that older patients have a realistic understanding of their surgery, risks, and recovery. This preoperative workup, combined with engaging with family members and interdisciplinary teams, can improve postoperative outcomes.
Collapse
Affiliation(s)
- Kahli E Zietlow
- Division of Geriatrics and Palliative Medicine, Department of Medicine, Michigan Medicine, Ann Arbor.
| | - Serena Wong
- Division of Geriatrics, Department of Medicine, Duke Health, Durham, NC
| | - Mitchell T Heflin
- Division of Geriatrics, Department of Medicine, Duke Health, Durham, NC; Geriatric Research Education and Clinical Center, Durham Veterans Affairs Medical Center, Durham, NC
| | - Shelley R McDonald
- Division of Geriatrics, Department of Medicine, Duke Health, Durham, NC; Geriatric Research Education and Clinical Center, Durham Veterans Affairs Medical Center, Durham, NC
| | | | - Michael Devinney
- Department of Anesthesiology, Duke University School of Medicine, Durham, NC
| | - Jeanna Blitz
- Department of Anesthesiology, Duke University School of Medicine, Durham, NC
| | | | - Miles Berger
- Department of Anesthesiology, Duke University School of Medicine, Durham, NC
| |
Collapse
|
32
|
Affiliation(s)
- Samir Kendale
- Department of Anesthesia, Critical Care & Pain Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| |
Collapse
|
33
|
Kennedy EE, Bowles KH, Aryal S. Systematic review of prediction models for postacute care destination decision-making. J Am Med Inform Assoc 2021; 29:176-186. [PMID: 34757383 PMCID: PMC8714284 DOI: 10.1093/jamia/ocab197] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Revised: 07/21/2021] [Accepted: 09/01/2021] [Indexed: 01/12/2023] Open
Abstract
OBJECTIVE This article reports a systematic review of studies containing development and validation of models predicting postacute care destination after adult inpatient hospitalization, summarizes clinical populations and variables, evaluates model performance, assesses risk of bias and applicability, and makes recommendations to reduce bias in future models. MATERIALS AND METHODS A systematic literature review was conducted following PRISMA guidelines and the Cochrane Prognosis Methods Group criteria. Online databases were searched in June 2020 to identify all published studies in this area. Data were extracted based on the CHARMS checklist, and studies were evaluated based on predictor variables, validation, performance in validation, risk of bias, and applicability using the Prediction Model Risk of Bias Assessment Tool (PROBAST) tool. RESULTS The final sample contained 28 articles with 35 models for evaluation. Models focused on surgical (22), medical (5), or both (8) populations. Eighteen models were internally validated, 10 were externally validated, and 7 models underwent both types. Model performance varied within and across populations. Most models used retrospective data, the median number of predictors was 8.5, and most models demonstrated risk of bias. DISCUSSION AND CONCLUSION Prediction modeling studies for postacute care destinations are becoming more prolific in the literature, but model development and validation strategies are inconsistent, and performance is variable. Most models are developed using regression, but machine learning methods are increasing in frequency. Future studies should ensure the rigorous variable selection and follow TRIPOD guidelines. Only 14% of the models have been tested or implemented beyond original studies, so translation into practice requires further investigation.
Collapse
Affiliation(s)
- Erin E Kennedy
- NewCourtland Center for Transitions and Health, University of Pennsylvania School of Nursing, Philadelphia, Pennsylvania, USA
- Leonard Davis Institute for Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Kathryn H Bowles
- NewCourtland Center for Transitions and Health, University of Pennsylvania School of Nursing, Philadelphia, Pennsylvania, USA
- Leonard Davis Institute for Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Subhash Aryal
- Biostatistics, Evaluation, Collaboration, Consultation, and Analysis Lab, University of Pennsylvania School of Nursing, Philadelphia, Pennsylvania, USA
- Department of Family and Community Health, University of Pennsylvania School of Nursing, Philadelphia, Pennsylvania, USA
| |
Collapse
|
34
|
Federer SJ, Jones GG. Artificial intelligence in orthopaedics: A scoping review. PLoS One 2021; 16:e0260471. [PMID: 34813611 PMCID: PMC8610245 DOI: 10.1371/journal.pone.0260471] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 11/11/2021] [Indexed: 11/19/2022] Open
Abstract
There is a growing interest in the application of artificial intelligence (AI) to orthopaedic surgery. This review aims to identify and characterise research in this field, in order to understand the extent, range and nature of this work, and act as springboard to stimulate future studies. A scoping review, a form of structured evidence synthesis, was conducted to summarise the use of AI in orthopaedics. A literature search (1946-2019) identified 222 studies eligible for inclusion. These studies were predominantly small and retrospective. There has been significant growth in the number of papers published in the last three years, mainly from the USA (37%). The majority of research used AI for image interpretation (45%) or as a clinical decision tool (25%). Spine (43%), knee (23%) and hip (14%) were the regions of the body most commonly studied. The application of artificial intelligence to orthopaedics is growing. However, the scope of its use so far remains limited, both in terms of its possible clinical applications, and the sub-specialty areas of the body which have been studied. A standardized method of reporting AI studies would allow direct assessment and comparison. Prospective studies are required to validate AI tools for clinical use.
Collapse
Affiliation(s)
- Simon J. Federer
- MSk Lab, Sir Michael Uren Hub, Imperial College London, London, United Kingdom
- * E-mail:
| | - Gareth G. Jones
- MSk Lab, Sir Michael Uren Hub, Imperial College London, London, United Kingdom
| |
Collapse
|
35
|
Danilov GV, Shifrin MA, Kotik KV, Ishankulov TA, Orlov YN, Kulikov AS, Potapov AA. Artificial Intelligence Technologies in Neurosurgery: a Systematic Literature Review Using Topic Modeling. Part II: Research Objectives and Perspectives. Sovrem Tekhnologii Med 2021; 12:111-118. [PMID: 34796024 PMCID: PMC8596229 DOI: 10.17691/stm2020.12.6.12] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Indexed: 12/29/2022] Open
Abstract
The current increase in the number of publications on the use of artificial intelligence (AI) technologies in neurosurgery indicates a new trend in clinical neuroscience. The aim of the study was to conduct a systematic literature review to highlight the main directions and trends in the use of AI in neurosurgery.
Collapse
Affiliation(s)
- G V Danilov
- Scientific Board Secretary; N.N. Burdenko National Medical Research Center for Neurosurgery, Ministry of Health of the Russian Federation, 16, 4 Tverskaya-Yamskaya St., Moscow, 125047, Russia; Head of the Laboratory of Biomedical Informatics and Artificial Intelligence; N.N. Burdenko National Medical Research Center for Neurosurgery, Ministry of Health of the Russian Federation, 16, 4 Tverskaya-Yamskaya St., Moscow, 125047, Russia
| | - M A Shifrin
- Scientific Consultant, Laboratory of Biomedical Informatics and Artificial Intelligence; N.N. Burdenko National Medical Research Center for Neurosurgery, Ministry of Health of the Russian Federation, 16, 4 Tverskaya-Yamskaya St., Moscow, 125047, Russia
| | - K V Kotik
- Physics Engineer, Laboratory of Biomedical Informatics and Artificial Intelligence; N.N. Burdenko National Medical Research Center for Neurosurgery, Ministry of Health of the Russian Federation, 16, 4 Tverskaya-Yamskaya St., Moscow, 125047, Russia
| | - T A Ishankulov
- Engineer, Laboratory of Biomedical Informatics and Artificial Intelligence; N.N. Burdenko National Medical Research Center for Neurosurgery, Ministry of Health of the Russian Federation, 16, 4 Tverskaya-Yamskaya St., Moscow, 125047, Russia
| | - Yu N Orlov
- Head of the Department of Computational Physics and Kinetic Equations; Keldysh Institute of Applied Mathematics, Russian Academy of Sciences, 4 Miusskaya Sq., Moscow, 125047, Russia
| | - A S Kulikov
- Staff Anesthesiologist; N.N. Burdenko National Medical Research Center for Neurosurgery, Ministry of Health of the Russian Federation, 16, 4 Tverskaya-Yamskaya St., Moscow, 125047, Russia
| | - A A Potapov
- Professor, Academician of the Russian Academy of Sciences, Chief Scientific Supervisor N.N. Burdenko National Medical Research Center for Neurosurgery, Ministry of Health of the Russian Federation, 16, 4 Tverskaya-Yamskaya St., Moscow, 125047, Russia
| |
Collapse
|
36
|
Katsuura Y, Colón LF, Perez AA, Albert TJ, Qureshi SA. A Primer on the Use of Artificial Intelligence in Spine Surgery. Clin Spine Surg 2021; 34:316-321. [PMID: 34050043 DOI: 10.1097/bsd.0000000000001211] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Accepted: 04/14/2021] [Indexed: 11/26/2022]
Abstract
DESIGN This was a narrative review. PURPOSE Summarize artificial intelligence (AI) fundamentals as well as current and potential future uses in spine surgery. SUMMARY OF BACKGROUND DATA Although considered futuristic, the field of AI has already had a profound impact on many industries, including health care. Its ability to recognize patterns and self-correct to improve over time mimics human cognitive function, but on a much larger scale. METHODS Review of literature on AI fundamentals and uses in spine pathology. RESULTS Machine learning (ML), a subset of AI, increases in hierarchy of complexity from classic ML to unsupervised ML to deep leaning, where Language Processing and Computer Vision are possible. AI-based tools have been developed to segment spinal structures, acquire basic spinal measurements, and even identify pathology such as tumor or degeneration. AI algorithms could have use in guiding clinical management through treatment selection, patient-specific prognostication, and even has the potential to power neuroprosthetic devices after spinal cord injury. CONCLUSION While the use of AI has pitfalls and should be adopted with caution, future use is promising in the field of spine surgery and medicine as a whole. LEVEL OF EVIDENCE Level IV.
Collapse
Affiliation(s)
| | - Luis F Colón
- Department of Orthopedic Surgery, University of Tennessee College of Medicine in Chattanooga, Chattanooga, TN
| | - Alberto A Perez
- School of Medicine and Public Health, University of Wisconsin, Madison, WI
| | - Todd J Albert
- Hospital for Special Surgery
- Weill Cornell Medical College, New York, NY
| | - Sheeraz A Qureshi
- Hospital for Special Surgery
- Weill Cornell Medical College, New York, NY
| |
Collapse
|
37
|
A Machine Learning Algorithm to Identify Patients at Risk of Unplanned Subsequent Surgery After Intramedullary Nailing for Tibial Shaft Fractures. J Orthop Trauma 2021; 35:e381-e388. [PMID: 34533505 DOI: 10.1097/bot.0000000000002070] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/25/2021] [Indexed: 02/02/2023]
Abstract
OBJECTIVES In the SPRINT trial, 18% of patients with a tibial shaft fracture (TSF) treated with intramedullary nailing (IMN) had one or more unplanned subsequent surgical procedures. It is clinically relevant for surgeon and patient to anticipate unplanned secondary procedures, other than operations that can be readily expected such as reconstructive procedures for soft tissue defects. Therefore, the objective of this study was to develop a machine learning (ML) prediction model using the SPRINT data that can give individual patients and their care team an estimate of their particular probability of an unplanned second surgery. METHODS Patients from the SPRINT trial with unilateral TSFs were randomly divided into a training set (80%) and test set (20%). Five ML algorithms were trained in recognizing patterns associated with subsequent surgery in the training set based on a subset of variables identified by random forest algorithms. Performance of each ML algorithm was evaluated and compared based on (1) area under the ROC curve, (2) calibration slope and intercept, and (3) the Brier score. RESULTS Total data set comprised 1198 patients, of whom 214 patients (18%) underwent subsequent surgery. Seven variables were used to train ML algorithms: (1) Gustilo-Anderson classification, (2) Tscherne classification, (3) fracture location, (4) fracture gap, (5) polytrauma, (6) injury mechanism, and (7) OTA/AO classification. The best-performing ML algorithm had an area under the ROC curve, calibration slope, calibration intercept, and the Brier score of 0.766, 0.954, -0.002, and 0.120 in the training set and 0.773, 0.922, 0, and 0.119 in the test set, respectively. CONCLUSIONS An ML algorithm was developed to predict the probability of subsequent surgery after IMN for TSFs. This ML algorithm may assist surgeons to inform patients about the probability of subsequent surgery and might help to identify patients who need a different perioperative plan or a more intensive approach. LEVEL OF EVIDENCE Prognostic Level II. See Instructions for Authors for a complete description of levels of evidence.
Collapse
|
38
|
SMART on FHIR in spine: integrating clinical prediction models into electronic health records for precision medicine at the point of care. Spine J 2021; 21:1649-1651. [PMID: 32599144 PMCID: PMC7762727 DOI: 10.1016/j.spinee.2020.06.014] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Accepted: 06/17/2020] [Indexed: 02/03/2023]
Abstract
Recent applications of artificial intelligence have shown great promise for improving the quality and efficiency of clinical care. Numerous clinical decision support tools exist in today's electronic health records (EHRs) such as medication dosing support, order facilitators (eg, procedure specific order sets), and point of care alerts. However, less has been done to integrate artificial intelligence (AI)-enabled risk predictors into EHRs despite wide availability of validated risk prediction tools. An interoperability standard known as SMART on FHIR (substitutable medical applications and reusable technologies on fast health interoperability resources) offers a promising path forward, enabling digital innovations to be seamlessly integrated with the EHR with regard to the user interface and patient data. For the next step in progress towards the goal of learning healthcare and informatics-enabled spine surgery, we propose the application of SMART on FHIR to integrate existing and new risk predictions tools in spine surgery through an EHR add-on-application.
Collapse
|
39
|
Stephens ME, O'Neal CM, Westrup AM, Muhammad FY, McKenzie DM, Fagg AH, Smith ZA. Utility of machine learning algorithms in degenerative cervical and lumbar spine disease: a systematic review. Neurosurg Rev 2021; 45:965-978. [PMID: 34490539 DOI: 10.1007/s10143-021-01624-z] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Revised: 06/28/2021] [Accepted: 08/09/2021] [Indexed: 10/20/2022]
Abstract
Machine learning is a rapidly evolving field that offers physicians an innovative and comprehensive mechanism to examine various aspects of patient data. Cervical and lumbar degenerative spine disorders are commonly age-related disease processes that can utilize machine learning to improve patient outcomes with careful patient selection and intervention. The aim of this study is to examine the current applications of machine learning in cervical and lumbar degenerative spine disease. A systematic review was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A search of PubMed, Embase, Medline, and Cochrane was conducted through May 31st, 2020, using the following terms: "artificial intelligence" OR "machine learning" AND "neurosurgery" AND "spine." Studies were included if original research on machine learning was utilized in patient care for degenerative spine disease, including radiographic machine learning applications. Studies focusing on robotic applications in neurosurgery, navigation, or stereotactic radiosurgery were excluded. The literature search identified 296 papers, with 35 articles meeting inclusion criteria. There were nine studies involving cervical degenerative spine disease and 26 studies on lumbar degenerative spine disease. The majority of studies for both cervical and lumbar spines utilized machine learning for the prediction of postoperative outcomes, with 5 (55.6%) and 15 (61.5%) studies, respectively. Machine learning applications focusing on degenerative lumbar spine greatly outnumber the current volume of cervical spine studies. The current research in lumbar spine also demonstrates more advanced clinical applications of radiographic, diagnostic, and predictive machine learning models.
Collapse
Affiliation(s)
- Mark E Stephens
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, 1000 N Lincoln Blvd, Suite 4000, Oklahoma City, OK, 73104, USA
| | - Christen M O'Neal
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, 1000 N Lincoln Blvd, Suite 4000, Oklahoma City, OK, 73104, USA
| | - Alison M Westrup
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, 1000 N Lincoln Blvd, Suite 4000, Oklahoma City, OK, 73104, USA
| | - Fauziyya Y Muhammad
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, 1000 N Lincoln Blvd, Suite 4000, Oklahoma City, OK, 73104, USA
| | - Daniel M McKenzie
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, 1000 N Lincoln Blvd, Suite 4000, Oklahoma City, OK, 73104, USA
| | - Andrew H Fagg
- School of Computer Science, University of Oklahoma, Norman, OK, USA
| | - Zachary A Smith
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, 1000 N Lincoln Blvd, Suite 4000, Oklahoma City, OK, 73104, USA.
| |
Collapse
|
40
|
Wei C, Quan T, Wang KY, Gu A, Fassihi SC, Kahlenberg CA, Malahias MA, Liu J, Thakkar S, Gonzalez Della Valle A, Sculco PK. Artificial neural network prediction of same-day discharge following primary total knee arthroplasty based on preoperative and intraoperative variables. Bone Joint J 2021; 103-B:1358-1366. [PMID: 34334050 DOI: 10.1302/0301-620x.103b8.bjj-2020-1013.r2] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
AIMS This study used an artificial neural network (ANN) model to determine the most important pre- and perioperative variables to predict same-day discharge in patients undergoing total knee arthroplasty (TKA). METHODS Data for this study were collected from the National Surgery Quality Improvement Program (NSQIP) database from the year 2018. Patients who received a primary, elective, unilateral TKA with a diagnosis of primary osteoarthritis were included. Demographic, preoperative, and intraoperative variables were analyzed. The ANN model was compared to a logistic regression model, which is a conventional machine-learning algorithm. Variables collected from 28,742 patients were analyzed based on their contribution to hospital length of stay. RESULTS The predictability of the ANN model, area under the curve (AUC) = 0.801, was similar to the logistic regression model (AUC = 0.796) and identified certain variables as important factors to predict same-day discharge. The ten most important factors favouring same-day discharge in the ANN model include preoperative sodium, preoperative international normalized ratio, BMI, age, anaesthesia type, operating time, dyspnoea status, functional status, race, anaemia status, and chronic obstructive pulmonary disease (COPD). Six of these variables were also found to be significant on logistic regression analysis. CONCLUSION Both ANN modelling and logistic regression analysis revealed clinically important factors in predicting patients who can undergo safely undergo same-day discharge from an outpatient TKA. The ANN model provides a beneficial approach to help determine which perioperative factors can predict same-day discharge as of 2018 perioperative recovery protocols. Cite this article: Bone Joint J 2021;103-B(8):1358-1366.
Collapse
Affiliation(s)
- Chapman Wei
- Department of Orthopaedic Surgery, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, USA
| | - Theodore Quan
- Department of Orthopaedic Surgery, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, USA
| | - Kevin Y Wang
- Johns Hopkins Department of Orthopaedic Surgery, Adult Reconstruction Division, John Hopkins Medicine, Baltimore, Maryland, USA
| | - Alex Gu
- Department of Orthopaedic Surgery, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, USA.,The Stavros Niarchos Foundation Complex Joint Reconstruction Center, Department of Orthopaedic Surgery, Hospital for Special Surgery, Washington, District of Columbia, USA
| | - Safa C Fassihi
- Department of Orthopaedic Surgery, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, USA
| | - Cynthia A Kahlenberg
- Adult Reconstruction and Joint Replacement Division, Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, New York, USA
| | - Michael-Alexander Malahias
- Adult Reconstruction and Joint Replacement Division, Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, New York, USA
| | - Jiabin Liu
- Department of Anesthesiology, Critical Care & Pain Management, Hospital for Special Surgery, New York, New York, USA
| | - Savyasachi Thakkar
- Johns Hopkins Department of Orthopaedic Surgery, Adult Reconstruction Division, John Hopkins Medicine, Baltimore, Maryland, USA
| | - Alejandro Gonzalez Della Valle
- The Stavros Niarchos Foundation Complex Joint Reconstruction Center, Department of Orthopaedic Surgery, Hospital for Special Surgery, Washington, District of Columbia, USA
| | - Peter K Sculco
- The Stavros Niarchos Foundation Complex Joint Reconstruction Center, Department of Orthopaedic Surgery, Hospital for Special Surgery, Washington, District of Columbia, USA
| |
Collapse
|
41
|
Groot OQ, Bindels BJJ, Ogink PT, Kapoor ND, Twining PK, Collins AK, Bongers MER, Lans A, Oosterhoff JHF, Karhade AV, Verlaan JJ, Schwab JH. Availability and reporting quality of external validations of machine-learning prediction models with orthopedic surgical outcomes: a systematic review. Acta Orthop 2021; 92:385-393. [PMID: 33870837 PMCID: PMC8436968 DOI: 10.1080/17453674.2021.1910448] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023] Open
Abstract
Background and purpose - External validation of machine learning (ML) prediction models is an essential step before clinical application. We assessed the proportion, performance, and transparent reporting of externally validated ML prediction models in orthopedic surgery, using the Transparent Reporting for Individual Prognosis or Diagnosis (TRIPOD) guidelines.Material and methods - We performed a systematic search using synonyms for every orthopedic specialty, ML, and external validation. The proportion was determined by using 59 ML prediction models with only internal validation in orthopedic surgical outcome published up until June 18, 2020, previously identified by our group. Model performance was evaluated using discrimination, calibration, and decision-curve analysis. The TRIPOD guidelines assessed transparent reporting.Results - We included 18 studies externally validating 10 different ML prediction models of the 59 available ML models after screening 4,682 studies. All external validations identified in this review retained good discrimination. Other key performance measures were provided in only 3 studies, rendering overall performance evaluation difficult. The overall median TRIPOD completeness was 61% (IQR 43-89), with 6 items being reported in less than 4/18 of the studies.Interpretation - Most current predictive ML models are not externally validated. The 18 available external validation studies were characterized by incomplete reporting of performance measures, limiting a transparent examination of model performance. Further prospective studies are needed to validate or refute the myriad of predictive ML models in orthopedics while adhering to existing guidelines. This ensures clinicians can take full advantage of validated and clinically implementable ML decision tools.
Collapse
Affiliation(s)
- Olivier Q Groot
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
- Department of Orthopedic Surgery, University Medical Center Utrecht, Utrecht University, The Netherlands
| | - Bas J J Bindels
- Department of Orthopedic Surgery, University Medical Center Utrecht, Utrecht University, The Netherlands
| | - Paul T Ogink
- Department of Orthopedic Surgery, University Medical Center Utrecht, Utrecht University, The Netherlands
| | - Neal D Kapoor
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
| | - Peter K Twining
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
| | - Austin K Collins
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
| | - Michiel E R Bongers
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
| | - Amanda Lans
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
- Department of Orthopedic Surgery, University Medical Center Utrecht, Utrecht University, The Netherlands
| | - Jacobien H F Oosterhoff
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
| | - Aditya V Karhade
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
| | - Jorrit-Jan Verlaan
- Department of Orthopedic Surgery, University Medical Center Utrecht, Utrecht University, The Netherlands
| | - Joseph H Schwab
- Orthopedic Oncology Service, Massachusetts General Hospital, Harvard Medical School, Boston, USA;;
| |
Collapse
|
42
|
Raju B, Jumah F, Ashraf O, Narayan V, Gupta G, Sun H, Hilden P, Nanda A. Big data, machine learning, and artificial intelligence: a field guide for neurosurgeons. J Neurosurg 2021; 135:373-383. [PMID: 33007750 DOI: 10.3171/2020.5.jns201288] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Accepted: 05/27/2020] [Indexed: 11/06/2022]
Abstract
Big data has transformed into a trend phrase in healthcare and neurosurgery, becoming a pervasive and inescapable phrase in everyday life. The upsurge in big data applications is a direct consequence of the drastic boom in information technology as well as the growing number of internet-connected devices called the Internet of Things in healthcare. Compared with business, marketing, and other sectors, healthcare applications are lagging due to a lack of technical knowledge among healthcare workers, technological limitations in acquiring and analyzing the data, and improper governance of healthcare big data. Despite these limitations, the medical literature is flooded with big data-related articles, and most of these are filled with abstruse terminologies such as machine learning, artificial intelligence, artificial neural network, and algorithm. Many of the recent articles are restricted to neurosurgical registries, creating a false impression that big data is synonymous with registries. Others advocate that the utilization of big data will be the panacea to all healthcare problems and research in the future. Without a proper understanding of these principles, it becomes easy to get lost without the ability to differentiate hype from reality. To that end, the authors give a brief narrative of big data analysis in neurosurgery and review its applications, limitations, and the challenges it presents for neurosurgeons and healthcare professionals naive to this field. Awareness of these basic concepts will allow neurosurgeons to understand the literature regarding big data, enabling them to make better decisions and deliver personalized care.
Collapse
Affiliation(s)
- Bharath Raju
- 1Department of Neurosurgery, Rutgers-Robert Wood Johnson Medical School and University Hospital; and
| | - Fareed Jumah
- 1Department of Neurosurgery, Rutgers-Robert Wood Johnson Medical School and University Hospital; and
| | - Omar Ashraf
- 1Department of Neurosurgery, Rutgers-Robert Wood Johnson Medical School and University Hospital; and
| | - Vinayak Narayan
- 1Department of Neurosurgery, Rutgers-Robert Wood Johnson Medical School and University Hospital; and
| | - Gaurav Gupta
- 1Department of Neurosurgery, Rutgers-Robert Wood Johnson Medical School and University Hospital; and
| | - Hai Sun
- 1Department of Neurosurgery, Rutgers-Robert Wood Johnson Medical School and University Hospital; and
| | - Patrick Hilden
- 2Rutgers Neurosurgery Health Outcomes, Policy, and Economics (HOPE) Center, New Brunswick, New Jersey
| | - Anil Nanda
- 1Department of Neurosurgery, Rutgers-Robert Wood Johnson Medical School and University Hospital; and
| |
Collapse
|
43
|
Martini ML, Neifert SN, Oermann EK, Gilligan JT, Rothrock RJ, Yuk FJ, Gal JS, Nistal DA, Caridi JM. Application of Cooperative Game Theory Principles to Interpret Machine Learning Models of Nonhome Discharge Following Spine Surgery. Spine (Phila Pa 1976) 2021; 46:803-812. [PMID: 33394980 DOI: 10.1097/brs.0000000000003910] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
STUDY DESIGN Retrospective analysis of prospectively acquired data. OBJECTIVE The aim of this study was to identify interaction effects that modulate nonhome discharge (NHD) risk by applying coalitional game theory principles to interpret machine learning models and understand variable interaction effects underlying NHD risk. SUMMARY OF BACKGROUND DATA NHD may predispose patients to adverse outcomes during their care. Previous studies identified potential factors implicated in NHD; however, it is unclear how interaction effects between these factors contribute to overall NHD risk. METHODS Of the 11,150 reviewed cases involving procedures for degenerative spine conditions, 1764 cases (15.8%) involved NHD. Gradient boosting classifiers were used to construct predictive models for NHD for each patient. Shapley values, which assign a unique distribution of the total NHD risk to each model variable using an optimal cost-sharing rule, quantified feature importance and examined interaction effects between variables. RESULTS Models constructed from features identified by Shapley values were highly predictive of patient-level NHD risk (mean C-statistic = 0.91). Supervised clustering identified distinct patient subgroups with variable NHD risk and their shared characteristics. Focused interaction analysis of surgical invasiveness, age, and comorbidity burden suggested age as a worse risk factor than comorbidity burden due to stronger positive interaction effects. Additionally, negative interaction effects were found between age and low blood loss, indicating that intraoperative hemostasis may be critical for reducing NHD risk in the elderly. CONCLUSION This strategy provides novel insights into feature interactions that contribute to NHD risk after spine surgery. Patients with positively interacting risk factors may require special attention during their hospitalization to control NHD risk.Level of Evidence: 3.
Collapse
Affiliation(s)
- Michael L Martini
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Sean N Neifert
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Eric K Oermann
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Jeffrey T Gilligan
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Robert J Rothrock
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Frank J Yuk
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Jonathan S Gal
- Department of Anesthesiology, Perioperative, and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Dominic A Nistal
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY
| | - John M Caridi
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY
| |
Collapse
|
44
|
Muhlestein WE, Monsour MA, Friedman GN, Zinzuwadia A, Zachariah MA, Coumans JV, Carter BS, Chambless LB. Predicting Discharge Disposition Following Meningioma Resection Using a Multi-Institutional Natural Language Processing Model. Neurosurgery 2021; 88:838-845. [PMID: 33483747 DOI: 10.1093/neuros/nyaa585] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2020] [Accepted: 10/10/2020] [Indexed: 11/14/2022] Open
Abstract
BACKGROUND Machine learning (ML)-based predictive models are increasingly common in neurosurgery, but typically require large databases of discrete variables for training. Natural language processing (NLP) can extract meaningful data from unstructured text. OBJECTIVE To present an NLP model that predicts nonhome discharge and a point-of-care implementation. METHODS We retrospectively collected age, preoperative notes, and radiology reports from 595 adults who underwent meningioma resection in an academic center from 1995 to 2015. A total of 32 algorithms were trained with the data; the 3 best performing algorithms were combined to form an ensemble. Predictive ability, assessed by area under the receiver operating characteristic curve (AUC) and calibration, was compared to a previously published model utilizing 52 neurosurgeon-selected variables. We then built a multi-institutional model by incorporating notes from 693 patients at another center into algorithm training. Permutation importance was used to analyze the relative importance of each input to model performance. Word clouds and non-negative matrix factorization were used to analyze predictive features of text. RESULTS The single-institution NLP model predicted nonhome discharge with AUC of 0.80 (95% CI = 0.74-0.86) on internal and 0.76 on holdout validation compared to AUC of 0.77 (95% CI = 0.73-0.81) and 0.74 for the 52-variable ensemble. The multi-institutional model performed similarly well with AUC = 0.78 (95% CI = 0.74-0.81) on internal and 0.76 on holdout validation. Preoperative notes most influenced predictions. The model is available at http://nlp-home.insds.org. CONCLUSION ML and NLP are underutilized in neurosurgery. Here, we construct a multi-institutional NLP model that predicts nonhome discharge.
Collapse
Affiliation(s)
- Whitney E Muhlestein
- Department of Neurosurgery, University of Michigan Medical Center, Ann Arbor, Michigan
| | | | - Gabriel N Friedman
- Department of Neurosurgery, Massachusetts General Hospital, Boston, Massachusetts, USA
| | | | - Marcus A Zachariah
- Department of Neurosurgery, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Jean-Valery Coumans
- Department of Neurosurgery, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Bob S Carter
- Department of Neurosurgery, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Lola B Chambless
- Department of Neurosurgery, Vanderbilt University Medical Center, Nashville, Tennessee
| |
Collapse
|
45
|
Elfanagely O, Toyoda Y, Othman S, Mellia JA, Basta M, Liu T, Kording K, Ungar L, Fischer JP. Machine Learning and Surgical Outcomes Prediction: A Systematic Review. J Surg Res 2021; 264:346-361. [PMID: 33848833 DOI: 10.1016/j.jss.2021.02.045] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 02/13/2021] [Accepted: 02/27/2021] [Indexed: 12/20/2022]
Abstract
BACKGROUND Machine learning (ML) has garnered increasing attention as a means to quantitatively analyze the growing and complex medical data to improve individualized patient care. We herein aim to critically examine the current state of ML in predicting surgical outcomes, evaluate the quality of currently available research, and propose areas of improvement for future uses of ML in surgery. METHODS A systematic review was conducted in accordance with the Preferred Reporting Items for a Systematic Review and Meta-Analysis (PRISMA) checklist. PubMed, MEDLINE, and Embase databases were reviewed under search syntax "machine learning" and "surgery" for papers published between 2015 and 2020. RESULTS Of the initial 2677 studies, 45 papers met inclusion and exclusion criteria. Fourteen different subspecialties were represented with neurosurgery being most common. The most frequently used ML algorithms were random forest (n = 19), artificial neural network (n = 17), and logistic regression (n = 17). Common outcomes included postoperative mortality, complications, patient reported quality of life and pain improvement. All studies which compared ML algorithms to conventional studies which used area under the curve (AUC) to measure accuracy found improved outcome prediction with ML models. CONCLUSIONS While still in its early stages, ML models offer surgeons an opportunity to capitalize on the myriad of clinical data available and improve individualized patient care. Limitations included heterogeneous outcome and imperfect quality of some of the papers. We therefore urge future research to agree upon methods of outcome reporting and require basic quality standards.
Collapse
Affiliation(s)
- Omar Elfanagely
- Division of Plastic Surgery, Department of Surgery, University of Pennsylvania, Philadelphia, Pennsylvania.
| | - Yoshiko Toyoda
- Division of Plastic Surgery, Department of Surgery, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Sammy Othman
- Division of Plastic Surgery, Department of Surgery, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Joseph A Mellia
- Division of Plastic Surgery, Department of Surgery, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Marten Basta
- Department of Plastic and Reconstructive Surgery, Brown University, Providence, Rhode Island
| | - Tony Liu
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Konrad Kording
- Department of Neuroscience, University of Pennsylvania, Philadelphia, Pennsylvania; Department of Bioengineering, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Lyle Ungar
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, Pennsylvania
| | - John P Fischer
- Division of Plastic Surgery, Department of Surgery, University of Pennsylvania, Philadelphia, Pennsylvania
| |
Collapse
|
46
|
Lubelski D, Hersh A, Azad TD, Ehresman J, Pennington Z, Lehner K, Sciubba DM. Prediction Models in Degenerative Spine Surgery: A Systematic Review. Global Spine J 2021; 11:79S-88S. [PMID: 33890803 PMCID: PMC8076813 DOI: 10.1177/2192568220959037] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
STUDY DESIGN Systematic review. OBJECTIVES To review the existing literature of prediction models in degenerative spinal surgery. METHODS Review of PubMed/Medline and Embase databases was conducted to identify articles between January 1, 2000 and March 1, 2020 that reported prediction model performance for outcomes following elective degenerative spine surgery. RESULTS Thirty-one articles were included. Twenty studies were of thoracolumbar, 5 were of cervical, and 6 included all spine patients. Five studies were externally validated. Prediction models were developed using machine learning (42%) and logistic regression (42%) as well as other techniques. Web-based calculators were included in 45% of published articles. Various outcomes were investigated, including complications, infection, length of stay, discharge disposition, reoperation, readmission, disability score, back pain, leg pain, return to work, and opioid dependence. CONCLUSIONS Significant heterogeneity exists in methods used to develop prediction models of postoperative outcomes after degenerative spine surgery. Most internally validate their scores, but a few have been externally validated. Areas under the curve for most models range from 0.6 to 0.9. Techniques for development are becoming increasingly sophisticated with different machine learning tools. With further external validation, these models can be deployed online for patient, physician, and administrative use, and have the potential to optimize outcomes and maximize value in spine surgery.
Collapse
Affiliation(s)
- Daniel Lubelski
- Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Andrew Hersh
- Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Tej D. Azad
- Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Jeff Ehresman
- Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | | | - Kurt Lehner
- Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Daniel M. Sciubba
- Johns Hopkins University School of Medicine, Baltimore, MD, USA,Daniel M. Sciubba, Department of Neurosurgery, Johns Hopkins University School of Medicine, 600 North Wolfe Street, Meyer 5-185A, Baltimore, MD 21287, USA.
| |
Collapse
|
47
|
Ehresman J, Pennington Z, Feghali J, Schilling A, Hersh A, Hung B, Lubelski D, Sciubba DM. Predicting nonroutine discharge in patients undergoing surgery for vertebral column tumors. J Neurosurg Spine 2021; 34:364-373. [PMID: 33254138 DOI: 10.3171/2020.6.spine201024] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Accepted: 06/29/2020] [Indexed: 11/06/2022]
Abstract
OBJECTIVE More than 8000 patients are treated annually for vertebral column tumors, of whom roughly two-thirds will be discharged to an inpatient facility (nonroutine discharge). Nonroutine discharge is associated with increased care costs as well as delays in discharge and poorer patient outcomes. In this study, the authors sought to develop a prediction model of nonroutine discharge in the population of vertebral column tumor patients. METHODS Patients treated for primary or metastatic vertebral column tumors at a single comprehensive cancer center were identified for inclusion. Data were gathered regarding surgical procedure, patient demographics, insurance status, and medical comorbidities. Frailty was assessed using the modified 5-item Frailty Index (mFI-5) and medical complexity was assessed using the modified Charlson Comorbidity Index (mCCI). Multivariable logistic regression was used to identify independent predictors of nonroutine discharge, and multivariable linear regression was used to identify predictors of prolonged length of stay (LOS). The discharge model was internally validated using 1000 bootstrapped samples. RESULTS The authors identified 350 patients (mean age 57.0 ± 13.6 years, 53.1% male, and 67.1% treated for metastatic vs primary disease). Significant predictors of prolonged LOS included higher mCCI score (β = 0.74; p = 0.026), higher serum absolute neutrophil count (β = 0.35; p = 0.001), lower hematocrit (β = -0.34; p = 0.001), use of a staged operation (β = 4.99; p < 0.001), occurrence of postoperative pulmonary embolism (β = 3.93; p = 0.004), and surgical site infection (β = 9.93; p < 0.001). Significant predictors of nonroutine discharge included emergency admission (OR 3.09; p = 0.001), higher mFI-5 score (OR 1.90; p = 0.001), lower serum albumin level (OR 0.43 per g/dL; p < 0.001), and operations with multiple stages (OR 4.10; p < 0.001). The resulting statistical model was deployed as a web-based calculator (https://jhuspine4.shinyapps.io/Nonroutine_Discharge_Tumor/). CONCLUSIONS The authors found that nonroutine discharge of patients with surgically treated vertebral column tumors was predicted by emergency admission, increased frailty, lower serum albumin level, and staged surgical procedures. The resulting web-based calculator tool may be useful clinically to aid in discharge planning for spinal oncology patients by preoperatively identifying patients likely to require placement in an inpatient facility postoperatively.
Collapse
|
48
|
Comparison of machine learning techniques to predict unplanned readmission following total shoulder arthroplasty. J Shoulder Elbow Surg 2021; 30:e50-e59. [PMID: 32868011 DOI: 10.1016/j.jse.2020.05.013] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Revised: 04/29/2020] [Accepted: 05/04/2020] [Indexed: 02/01/2023]
Abstract
BACKGROUND Machine learning (ML) techniques have been shown to successfully predict postoperative complications for high-volume orthopedic procedures such as hip and knee arthroplasty and to stratify patients for risk-adjusted bundled payments. The latter has not been done for more heterogeneous, lower-volume procedures such as total shoulder arthroplasty (TSA) with equally limited discussion around strategies to optimize the predictive ability of ML algorithms. The purpose of this study was to (1) assess which of 5 ML algorithms best predicts 30-day readmission, (2) test select ML strategies to optimize the algorithms, and (3) report on which patient variables contribute most to risk prediction in TSA across algorithms. METHODS We identified 9043 patients in the American College of Surgeons National Surgical Quality Improvement Database who underwent primary TSA between 2011 and 2015. Predictors included demographics, comorbidities, laboratory data, and intraoperative variables. The outcome of interest was 30-day unplanned readmission. Five ML algorithms-support-vector machine (SVM), logistic regression, random forest (RF), an adaptive boosting algorithm, and neural network-were trained on the derivation cohort (2011-2014 TSA patients) to predict 30-day unplanned readmission rates. After training, weights for each respective model were fixed and the classifiers were evaluated on the 2015 TSA cohort to simulate a prospective evaluation. C-statistic and f1 scores were used to assess the performance of each classifier. After evaluation, features were removed independently to assess which features most affected classifier performance. RESULTS The derivation and validation cohorts comprised 5857 and 3186 primary TSA patients, respectively, with similar demographics, comorbidities, and 30-day unplanned readmission rates (2.9% vs. 2.7%). Of the ML algorithms, SVM performed the worst with a c-statistic of 0.54 and an f1-score of 0.07, whereas the random-forest classifier performed the best with the highest c-statistic of 0.74 and an f1-score of 0.18. In addition, SVM was most sensitive to loss of single features, whereas the performance of RF did not dramatically decrease after loss of single features. Within the trained RF classifier, 5 variables achieved weights >0.5 in descending order: high bilirubin (>1.9 mg/dL), age >65, race, chronic obstructive pulmonary disease, and American Society of Anesthesiologists' scores ≥3. In our validation cohort, we observed a 2.7% readmission rate. From this cohort, using the RF classifier we were then able to identify 436 high-risk patients with a predicted risk score >0.6, of whom 36 were readmitted (readmission rate of 8.2%). CONCLUSION Predictive analytics algorithms can achieve acceptable prediction of unplanned readmission for TSA with the RF classifier outperforming other common algorithms.
Collapse
|
49
|
Staartjes VE, Stumpo V, Kernbach JM, Klukowska AM, Gadjradj PS, Schröder ML, Veeravagu A, Stienen MN, van Niftrik CHB, Serra C, Regli L. Machine learning in neurosurgery: a global survey. Acta Neurochir (Wien) 2020; 162:3081-3091. [PMID: 32812067 PMCID: PMC7593280 DOI: 10.1007/s00701-020-04532-1] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Accepted: 08/10/2020] [Indexed: 12/11/2022]
Abstract
Background Recent technological advances have led to the development and implementation of machine learning (ML) in various disciplines, including neurosurgery. Our goal was to conduct a comprehensive survey of neurosurgeons to assess the acceptance of and attitudes toward ML in neurosurgical practice and to identify factors associated with its use. Methods The online survey consisted of nine or ten mandatory questions and was distributed in February and March 2019 through the European Association of Neurosurgical Societies (EANS) and the Congress of Neurosurgeons (CNS). Results Out of 7280 neurosurgeons who received the survey, we received 362 responses, with a response rate of 5%, mainly in Europe and North America. In total, 103 neurosurgeons (28.5%) reported using ML in their clinical practice, and 31.1% in research. Adoption rates of ML were relatively evenly distributed, with 25.6% for North America, 30.9% for Europe, 33.3% for Latin America and the Middle East, 44.4% for Asia and Pacific and 100% for Africa with only two responses. No predictors of clinical ML use were identified, although academic settings and subspecialties neuro-oncology, functional, trauma and epilepsy predicted use of ML in research. The most common applications were for predicting outcomes and complications, as well as interpretation of imaging. Conclusions This report provides a global overview of the neurosurgical applications of ML. A relevant proportion of the surveyed neurosurgeons reported clinical experience with ML algorithms. Future studies should aim to clarify the role and potential benefits of ML in neurosurgery and to reconcile these potential advantages with bioethical considerations.
Collapse
Affiliation(s)
- Victor E Staartjes
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Frauenklinikstrasse 10, 8091, Zurich, Switzerland.
- Amsterdam UMC, Vrije Universiteit Amsterdam, Neurosurgery, Amsterdam Movement Sciences, Amsterdam, The Netherlands.
- Department of Neurosurgery, Bergman Clinics, Amsterdam, The Netherlands.
| | - Vittorio Stumpo
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Frauenklinikstrasse 10, 8091, Zurich, Switzerland
- Università Cattolica del Sacro Cuore, Rome, Italy
| | - Julius M Kernbach
- Department of Neurosurgery, RWTH Aachen University Hospital, Aachen, Germany
| | - Anita M Klukowska
- Department of Neurosurgery, Bergman Clinics, Amsterdam, The Netherlands
- School of Medicine, University of Nottingham, Nottingham, UK
| | - Pravesh S Gadjradj
- Department of Neurosurgery, Leiden University Medical Centre, Leiden, The Netherlands
- Department of Neurosurgery, Erasmus MC, University Medical Centre, Rotterdam, The Netherlands
| | - Marc L Schröder
- Department of Neurosurgery, Bergman Clinics, Amsterdam, The Netherlands
| | - Anand Veeravagu
- Neurosurgery AI Lab, Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - Martin N Stienen
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Frauenklinikstrasse 10, 8091, Zurich, Switzerland
| | - Christiaan H B van Niftrik
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Frauenklinikstrasse 10, 8091, Zurich, Switzerland
| | - Carlo Serra
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Frauenklinikstrasse 10, 8091, Zurich, Switzerland
| | - Luca Regli
- Machine Intelligence in Clinical Neuroscience (MICN) Lab, Department of Neurosurgery, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Frauenklinikstrasse 10, 8091, Zurich, Switzerland
| |
Collapse
|
50
|
Huq S, Khalafallah AM, Patel P, Sharma P, Dux H, White T, Jimenez AE, Mukherjee D. Predictive Model and Online Calculator for Discharge Disposition in Brain Tumor Patients. World Neurosurg 2020; 146:e786-e798. [PMID: 33181381 DOI: 10.1016/j.wneu.2020.11.018] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2020] [Revised: 11/03/2020] [Accepted: 11/04/2020] [Indexed: 12/23/2022]
Abstract
BACKGROUND In the era of value-based payment models, it is imperative for neurosurgeons to eliminate inefficiencies and provide high-quality care. Discharge disposition is a relevant consideration with clinical and economic ramifications in brain tumor patients. We developed a predictive model and online calculator for postoperative non-home discharge disposition in brain tumor patients that can be incorporated into preoperative workflows. METHODS We reviewed all brain tumor patients at our institution from 2017 to 2019. A predictive model of discharge disposition containing preoperatively available variables was developed using stepwise multivariable logistic regression. Model performance was assessed using receiver operating characteristic curves and calibration curves. Internal validation was performed using bootstrapping with 2000 samples. RESULTS Our cohort included 2335 patients who underwent 2586 surgeries with a 16% non-home discharge rate. Significant predictors of non-home discharge were age >60 years (odds ratio [OR], 2.02), African American (OR, 1.73) or Asian (OR, 2.05) race, unmarried status (OR, 1.48), Medicaid insurance (OR, 1.90), admission from another health care facility (OR, 2.30), higher 5-factor modified frailty index (OR, 1.61 for 5-factor modified frailty index ≥2), and lower Karnofsky Performance Status (increasing OR with each 10-point decrease in Karnofsky Performance Status). The model was well calibrated and had excellent discrimination (optimism-corrected C-statistic, 0.82). An open-access calculator was deployed (https://neurooncsurgery.shinyapps.io/discharge_calc/). CONCLUSIONS A strongly performing predictive model and online calculator for non-home discharge disposition in brain tumor patients was developed. With further validation, this tool may facilitate more efficient discharge planning, with consequent improvements in quality and value of care for brain tumor patients.
Collapse
Affiliation(s)
- Sakibul Huq
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Adham M Khalafallah
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Palak Patel
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Paarth Sharma
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Hayden Dux
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Taija White
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Adrian E Jimenez
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Debraj Mukherjee
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.
| |
Collapse
|