1
|
Ghadirinejad K, Milimonfared R, Taylor M, Solomon LB, Graves S, Pratt N, de Steiger R, Hashemi R. Supervised machine learning for the prediction of post-operative clinical outcomes of hip and knee replacements: a review. ANZ J Surg 2024; 94:1228-1233. [PMID: 38597170 DOI: 10.1111/ans.19003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 02/28/2024] [Accepted: 03/27/2024] [Indexed: 04/11/2024]
Abstract
Prediction models are being increasingly used in the medical field to identify risk factors and possible outcomes. Some of these are presently being used to develop guidelines for improving clinical practice. The application of machine learning (ML), comprising a powerful set of computational tools for analysing data, has been clearly expanding in the role of predictive modelling. This paper reviews the latest developments of supervised ML techniques that have been used to analyse data related to post-operative total hip and knee replacements. The aim was to review the most recent findings of relevant published studies by outlining the methodologies employed (most-widely used supervised ML techniques), data sources, domains, limitations of predictive analytics and the quality of predictions.
Collapse
Affiliation(s)
- Khashayar Ghadirinejad
- The Medical Device Research Institute, College of Science and Engineering, Flinders University, Clovelly Park, South Australia, Australia
| | - Roohollah Milimonfared
- The Medical Device Research Institute, College of Science and Engineering, Flinders University, Clovelly Park, South Australia, Australia
| | - Mark Taylor
- The Medical Device Research Institute, College of Science and Engineering, Flinders University, Clovelly Park, South Australia, Australia
| | - Lucian B Solomon
- Department of Orthopaedics and Trauma, Royal Adelaide Hospital, Adelaide, South Australia, Australia
- Centre for Orthopaedic & Trauma Research, University of Adelaide, Adelaide, South Australia, Australia
| | - Stephen Graves
- Department of Surgery, Epworth HealthCare, The University of Melbourne, Parkville, Victoria, Australia
| | - Nicole Pratt
- The Australian Orthopaedic Association National Joint Replacement Registry, South Australian Health and Medical Research Institute, Adelaide, South Australia, Australia
| | - Richard de Steiger
- Quality Use of Medicines and Pharmacy Research Centre, School of Pharmacy and Medical Sciences, University of South Australia, Adelaide, South Australia, Australia
- Department of Surgery, Epworth HealthCare, The University of Melbourne, Parkville, Victoria, Australia
| | - Reza Hashemi
- The Medical Device Research Institute, College of Science and Engineering, Flinders University, Clovelly Park, South Australia, Australia
| |
Collapse
|
2
|
Turan O, Pan X, Kunze KN, Rullan PJ, Emara AK, Molloy RM, Piuzzi NS. 30-day to 10-year mortality rates following total hip arthroplasty: a meta-analysis of the last decade (2011-2021). Hip Int 2024; 34:4-14. [PMID: 36705090 DOI: 10.1177/11207000231151235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
BACKGROUND Mortality after total hip arthroplasty (THA) is a rare but devastating complication. This meta-analysis aimed to: (1) determine the mortality rates at 30 days, 90 days, 1 year, 5 years and 10 years after THA; (2) identify risk factors and causes of mortality after THA. METHODS Pubmed, MEDLINE, Cochrane, EBSCO Host, and Google Scholar databases were queried for studies reporting mortality rates after primary elective, unilateral THA. Inverse-proportion models were constructed to quantify the incidence of all-cause mortality at 30 days, 90 days, 1 year, 5 years and 10 years after THA. Random-effects multiple regression was performed to investigate the potential effect modifiers of age (at time of THA), body mass index, and gender. RESULTS A total of 53 studies (3,297,363 patients) were included. The overall mortality rate was 3.9%. The 30-day mortality was 0.49% (95% CI; 0.23-0.84). Mortality at 90 days was 0.47% (95% CI, 0.38-0.57). Mortality increased exponentially between 90 days and 5 years, with a 1-year mortality rate of 1.90% (95% CI, 1.22-2.73) and a 5-year mortality rate of 9.85% (95% CI, 5.53-15.22). At 10-year follow-up, the mortality rate was 16.43% (95% CI, 1.17-22.48). Increasing comorbidity indices, socioeconomic disadvantage, age, anaemia, and smoking were found to be risk factors for mortality. The most commonly reported causes of death were ischaemic heart disease, malignancy, and pulmonary disease. CONCLUSIONS All-cause mortality remains low after contemporary THA. However, 1 out of 10 patients and 1 out of 6 patients were deceased after 5 years and 10 years of THA, respectively. As expected, age, but not BMI or gender, was significantly associated with mortality.
Collapse
Affiliation(s)
- Oguz Turan
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, OH, USA
| | - Xuankang Pan
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, OH, USA
| | - Kyle N Kunze
- Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, NY, USA
| | - Pedro J Rullan
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, OH, USA
| | - Ahmed K Emara
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, OH, USA
| | - Robert M Molloy
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, OH, USA
| | - Nicolas S Piuzzi
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, OH, USA
- Department of Biomedical Engineering, Cleveland Clinic, Cleveland, OH, USA
| |
Collapse
|
3
|
Pan X, Turan O, Rullan PJ, Simmons H, Emara AK, Piuzzi NS. 30-Days to 10-Years Mortality Rates following Total Knee Arthroplasty: A Systematic Review and Meta-Analysis of the Last Decade (2011-2021). J Knee Surg 2023; 36:1323-1340. [PMID: 35901803 DOI: 10.1055/a-1911-3892] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Mortality data following primary total knee arthroplasty (TKA) beyond 1-year postoperative time period is sparse. This systematic review and meta-analysis aimed to: (1) estimate contemporary mortality rates at 30 days, 90 days, 1 year, 5 years, and 10 years following primary TKA; and (2) identify risk factors and causes of mortality following TKA. PubMed, MEDLINE, Cochrane, EBSCO host, and Google Scholar databases were queried from January 1, 2011 to October 30, 2021 for all studies reporting mortality rates following primary TKA. A meta-analysis of proportions was conducted using a random-effects model to ascertain pooled mortality rates (95% confidence interval [CI]). Meta-regression was utilized to account for confounding effects on mortality rates due to the study's country of origin, median date of study data, average patient age, and patient gender ratios, with a level of significance maintained at p-value <0.05. A total of 44 articles were included in quantitative synthesis. The pooled 30-day mortality rate was 0.14% (95% CI:0.05-0.22%; n = 1,817,647). The pooled 90-day mortality rate was 0.35% (95% CI:0.0.28-0.43%; n = 1,641,974). The pooled 1-year mortality rate was 1.1% (95% CI:0.71-1.49%; n = 1,178,698). The pooled 5-year mortality rate was 5.38% (95% CI:4.35-6.42%; n = 597,041). The pooled 10-year mortality rate was 10.18% (95% CI:7.78-12.64%; n = 815,901). Our 30-day mortality rate was lower than previously reported. The most common causes of death at all time points were due to cardiac disease, cerebrovascular disease, and malignancy. Obesity demonstrated mixed effects on long-term mortality rates. Overall mortality rates of TKA remain low worldwide at all time points and immediate postoperative mortality rates continue to fall. Compared to symptomatic knee osteoarthritic patients reported in the literature, TKA patients qualitatively exhibited lower mortality rates, which may support the value of TKA in improving quality of life without associated excess mortality. Future long-term mortality studies should be conducted to account for geographical variability in mortality rates and further elucidate modifiable risk factors associated with mortality among TKA patients.
Collapse
Affiliation(s)
- Xuankang Pan
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, Ohio
| | - Oguz Turan
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, Ohio
| | - Pedro J Rullan
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, Ohio
| | - Hannah Simmons
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, Ohio
| | - Ahmed K Emara
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, Ohio
| | - Nicolas S Piuzzi
- Department of Orthopaedic Surgery, Cleveland Clinic, Cleveland, Ohio
| |
Collapse
|
4
|
Sweerts L, Dekkers PW, van der Wees PJ, van Susante JLC, de Jong LD, Hoogeboom TJ, van de Groes SAW. External Validation of Prediction Models for Surgical Complications in People Considering Total Hip or Knee Arthroplasty Was Successful for Delirium but Not for Surgical Site Infection, Postoperative Bleeding, and Nerve Damage: A Retrospective Cohort Study. J Pers Med 2023; 13:jpm13020277. [PMID: 36836512 PMCID: PMC9964485 DOI: 10.3390/jpm13020277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 01/22/2023] [Accepted: 01/30/2023] [Indexed: 02/04/2023] Open
Abstract
Although several models for the prediction of surgical complications after primary total hip or total knee replacement (THA and TKA, respectively) are available, only a few models have been externally validated. The aim of this study was to externally validate four previously developed models for the prediction of surgical complications in people considering primary THA or TKA. We included 2614 patients who underwent primary THA or TKA in secondary care between 2017 and 2020. Individual predicted probabilities of the risk for surgical complication per outcome (i.e., surgical site infection, postoperative bleeding, delirium, and nerve damage) were calculated for each model. The discriminative performance of patients with and without the outcome was assessed with the area under the receiver operating characteristic curve (AUC), and predictive performance was assessed with calibration plots. The predicted risk for all models varied between <0.01 and 33.5%. Good discriminative performance was found for the model for delirium with an AUC of 84% (95% CI of 0.82-0.87). For all other outcomes, poor discriminative performance was found; 55% (95% CI of 0.52-0.58) for the model for surgical site infection, 61% (95% CI of 0.59-0.64) for the model for postoperative bleeding, and 57% (95% CI of 0.53-0.61) for the model for nerve damage. Calibration of the model for delirium was moderate, resulting in an underestimation of the actual probability between 2 and 6%, and exceeding 8%. Calibration of all other models was poor. Our external validation of four internally validated prediction models for surgical complications after THA and TKA demonstrated a lack of predictive accuracy when applied in another Dutch hospital population, with the exception of the model for delirium. This model included age, the presence of a heart disease, and the presence of a disease of the central nervous system as predictor variables. We recommend that clinicians use this simple and straightforward delirium model during preoperative counselling, shared decision-making, and early delirium precautionary interventions.
Collapse
Affiliation(s)
- Lieke Sweerts
- Department of Orthopaedics, Radboud Institute for Health Sciences, Radboud University Medical Center, 6500 HB Nijmegen, The Netherlands
- IQ Healthcare, Radboud Institute for Health Sciences, Radboud University Medical Center, 6500 HB Nijmegen, The Netherlands
- Correspondence:
| | - Pepijn W. Dekkers
- Department of Orthopaedics, Radboud Institute for Health Sciences, Radboud University Medical Center, 6500 HB Nijmegen, The Netherlands
| | - Philip J. van der Wees
- IQ Healthcare, Radboud Institute for Health Sciences, Radboud University Medical Center, 6500 HB Nijmegen, The Netherlands
- Department of Rehabilitation, Radboud Institute for Health Sciences, Radboud University Medical Center, 6500 HB Nijmegen, The Netherlands
| | | | - Lex D. de Jong
- Department of Orthopedics, Rijnstate Hospital, 6800 TA Arnhem, The Netherlands
| | - Thomas J. Hoogeboom
- IQ Healthcare, Radboud Institute for Health Sciences, Radboud University Medical Center, 6500 HB Nijmegen, The Netherlands
| | - Sebastiaan A. W. van de Groes
- Department of Orthopaedics, Radboud Institute for Health Sciences, Radboud University Medical Center, 6500 HB Nijmegen, The Netherlands
| |
Collapse
|
5
|
Artificial intelligence and machine learning as a viable solution for hip implant failure diagnosis-Review of literature and in vitro case study. Med Biol Eng Comput 2023; 61:1239-1255. [PMID: 36701013 DOI: 10.1007/s11517-023-02779-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 01/09/2023] [Indexed: 01/27/2023]
Abstract
The digital health industry is experiencing fast-paced research which can provide digital care programs and technologies to enhance the competence of healthcare delivery. Orthopedic literature also confirms the applicability of artificial intelligence (AI) and machine learning (ML) models to medical diagnosis and clinical decision-making. However, implant monitoring after primary surgery often happens with a wellness visit or when a patient complains about it. Neglecting implant design and other technical errors in this scenario, unmonitored circumstances, and lack of post-surgery monitoring may ultimately lead to the implant system's failure and leave us with the only option of high-risk revision surgery. Preventive maintenance seems to be a good choice to identify the onset of an irreversible prosthesis failure. Considering all these aspects for hip implant monitoring, this paper explores existing studies linking ML models and intelligent systems for hip implant diagnosis. This paper explores the feasibility of an alternative continuous monitoring technique for post-surgery implant monitoring backed by an in vitro ML case study. Tribocorrosion and acoustic emission (AE) data are considered based on their efficacy in determining irreversible alteration of implant material to prevent total failures. This study also facilitates the relevance of developing an artificially intelligent implant monitoring methodology that can function with daily patient activities and how it can influence the digital orthopedic diagnosis. AI-based non-invasive hip implant monitoring system enabling point-of-care testing.
Collapse
|
6
|
Wu JM, Cheng BW, Ou CY, Chiu JE, Tsou SS. Applying machine learning methods to predict the hospital re-admission within 30 days of total hip arthroplasty and hemiarthroplasty. J Healthc Qual Res 2022:S2603-6479(22)00104-X. [PMID: 36581557 DOI: 10.1016/j.jhqr.2022.11.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 10/09/2022] [Accepted: 11/29/2022] [Indexed: 12/28/2022]
Abstract
BACKGROUND Total hip arthroplasty (THA) and hemiarthroplasty are common treatments for severe hip joint disease. To predict the probability of re-admission after discharge when patients are hospitalized will support providing appropriate health education and guidance. METHODS The research aims to use logistic regression (LR), decision trees (DT), random forests (RF), and artificial neural networks (ANN) to establish predictive models and compare their performances on re-admissions within 30 days after THA or hemiarthroplasty. The data of this study includes patient demographics, physiological measurements, disease history, and clinical laboratory test results. RESULTS There were 508 and 309 patients in the THA and hemiarthroplasty studies respectively from September 2016 to December 2018. The accuracies of the four models LR, DT, RF, and ANN in the THA experiment are 94.3%, 93.2%, 97.3%, and 93.9%, respectively. In the hemiarthroplasty experiment, the accuracies of the four models are 92.4%, 86.1%, 94.2%, and 94.8%, respectively. Among these, we found that the RF model has the best sensitivity and ANN model has the best area under the receiver operating characteristic (AUROC) score in both experiments. CONCLUSIONS The THA experiment confirmed that the performance of the RF model is better than the other models. The key factors affecting the prognosis after THA surgery are creatinine, sodium, anesthesia duration, and dialysis. In the hemiarthroplasty experiment, the ANN model showed more accurate results. Poor kidney function increases the risk of hospital re-admission. This research highlights that RF and ANN model perform well on the hip replacement surgery outcome prediction.
Collapse
Affiliation(s)
- J-M Wu
- Tungs' Taichung MetroHarbor Hospital, Taichung City, Taiwan, ROC; Department of Industrial Engineering and Management, National Yunlin University of Science and Technology, Yunlin City, Taiwan, ROC
| | - B-W Cheng
- Department of Industrial Engineering and Management, National Yunlin University of Science and Technology, Yunlin City, Taiwan, ROC
| | - C-Y Ou
- Department of Industrial Engineering and Management, National Yunlin University of Science and Technology, Yunlin City, Taiwan, ROC
| | - J-E Chiu
- Department of Industrial Engineering and Management, National Yunlin University of Science and Technology, Yunlin City, Taiwan, ROC
| | - S-S Tsou
- Tungs' Taichung MetroHarbor Hospital, Taichung City, Taiwan, ROC.
| |
Collapse
|
7
|
Sweerts L, Hoogeboom TJ, van Wessel T, van der Wees PJ, van de Groes SAW. Development of prediction models for complications after primary total hip and knee arthroplasty: a single-centre retrospective cohort study in the Netherlands. BMJ Open 2022; 12:e062065. [PMID: 36002218 PMCID: PMC9413190 DOI: 10.1136/bmjopen-2022-062065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVE The aim of this study was to develop prediction models for patients with total hip arthroplasty (THA) and total knee arthroplasty (TKA) to predict the risk for surgical complications based on personal factors, comorbidities and medication use. DESIGN Retrospective cohort study. SETTING Tertiary care in outpatient clinic of university medical centre. PARTICIPANTS 3776 patients with a primary THA or TKA between 2004 and 2018. PRIMARY AND SECONDARY OUTCOME MEASURES Multivariable logistic regression models were developed for primary outcome surgical site infection (SSI), and secondary outcomes venous thromboembolism (VTE), postoperative bleeding (POB), luxation, delirium and nerve damage (NER). RESULTS For SSI, age, smoking status, body mass index, presence of immunological disorder, diabetes mellitus, liver disease and use of non-steroidal anti-inflammatory drugs were included. An area under the receiver operating characteristic curve (AUC) of 71.9% (95% CI=69.4% to 74.4%) was found. For this model, liver disease showed to be the strongest predictor with an OR of 10.7 (95% CI=2.4 to 46.6). The models for POB and NER showed AUCs of 73.0% (95% CI=70.7% to 75.4%) and 76.6% (95% CI=73.2% to 80.0%), respectively. For delirium an AUC of 85.9% (95% CI=83.8% to 87.9%) was found, and for the predictive algorithms for luxation and VTE we found least favourable results (AUC=58.4% (95% CI=55.0% to 61.8%) and AUC=66.3% (95% CI=62.7% to 69.9%)). CONCLUSIONS Discriminative ability was reasonable for SSI and predicted probabilities ranged from 0.01% to 51.0%. We expect this to enhance shared decision-making in considering THA or TKA since current counselling is predicated on population-based probability of risk, rather than using personalised prediction. We consider our models for SSI, delirium and NER appropriate for clinical use when taking underestimation and overestimation of predicted risk into account. For VTE and POB, caution concerning overestimation exceeding a predicted probability of 0.08 for VTE and 0.05 for POB should be taken into account. Furthermore, future studies should evaluate clinical impact and whether the models are feasible in an external population.
Collapse
Affiliation(s)
- Lieke Sweerts
- Radboud Institute of Health Sciences, Department of Orthopaedics, Radboud university medical center, Nijmegen, The Netherlands
- Radboud Institute of Health Sciences, IQ healthcare, Radboud university medical center, Nijmegen, The Netherlands
| | - Thomas J Hoogeboom
- Radboud Institute of Health Sciences, IQ healthcare, Radboud university medical center, Nijmegen, The Netherlands
| | - Thierry van Wessel
- Radboud Institute of Health Sciences, Department of Orthopaedics, Radboud university medical center, Nijmegen, The Netherlands
| | - Philip J van der Wees
- Radboud Institute of Health Sciences, IQ healthcare, Radboud university medical center, Nijmegen, The Netherlands
- Radboud Institute for Health Sciences, Department of Rehabilitation, Radboud university medical center, Nijmegen, The Netherlands
| | - Sebastiaan A W van de Groes
- Radboud Institute of Health Sciences, Department of Orthopaedics, Radboud university medical center, Nijmegen, The Netherlands
| |
Collapse
|
8
|
Chang WJ, Naylor J, Natarajan P, Liu V, Adie S. Evaluating methodological quality of prognostic prediction models on patient reported outcome measurements after total hip replacement and total knee replacement surgery: a systematic review protocol. Syst Rev 2022; 11:165. [PMID: 35948989 PMCID: PMC9364604 DOI: 10.1186/s13643-022-02039-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 07/28/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Prediction models for poor patient-reported surgical outcomes after total hip replacement (THR) and total knee replacement (TKR) may provide a method for improving appropriate surgical care for hip and knee osteoarthritis. There are concerns about methodological issues and the risk of bias of studies producing prediction models. A critical evaluation of the methodological quality of prediction modelling studies in THR and TKR is needed to ensure their clinical usefulness. This systematic review aims to (1) evaluate and report the quality of risk stratification and prediction modelling studies that predict patient-reported outcomes after THR and TKR; (2) identify areas of methodological deficit and provide recommendations for future research; and (3) synthesise the evidence on prediction models associated with post-operative patient-reported outcomes after THR and TKR surgeries. METHODS MEDLINE, EMBASE, and CINAHL electronic databases will be searched to identify relevant studies. Title and abstract and full-text screening will be performed by two independent reviewers. We will include (1) prediction model development studies without external validation; (2) prediction model development studies with external validation of independent data; (3) external model validation studies; and (4) studies updating a previously developed prediction model. Data extraction spreadsheets will be developed based on the CHARMS checklist and TRIPOD statement and piloted on two relevant studies. Study quality and risk of bias will be assessed using the PROBAST tool. Prediction models will be summarised qualitatively. Meta-analyses on the predictive performance of included models will be conducted if appropriate. A narrative review will be used to synthesis the evidence if there are insufficient data to perform meta-analyses. DISCUSSION This systematic review will evaluate the methodological quality and usefulness of prediction models for poor outcomes after THR or TKR. This information is essential to provide evidence-based healthcare for end-stage hip and knee osteoarthritis. Findings of this review will contribute to the identification of key areas for improvement in conducting prognostic research in this field and facilitate the progress in evidence-based tailored treatments for hip and knee osteoarthritis. SYSTEMATIC REVIEW REGISTRATION PROSPERO registration number CRD42021271828.
Collapse
Affiliation(s)
- Wei-Ju Chang
- Centre for Pain IMPACT, Neuroscience Research Australia (NeuRA), 139 Barker St, Randwick, NSW, 2031, Australia. .,School of Health Sciences, College of Health, Medicine and Wellbeing, The University of Newcastle, Callaghan, NSW, 2038, Australia.
| | - Justine Naylor
- School of Clinical Medicine, UNSW Medicine & Health, South West Clinical Campuses, Discipline of Surgery, Faculty of Medicine and Health, UNSW, Sydney, NSW, Australia.,Whitlam Orthopaedic Research Centre, Ingham Institute for Applied Medical Research, 1 Campbell St, Liverpool, NSW, 2170, Australia
| | - Pragadesh Natarajan
- St George and Sutherland Clinical School, University of New South Wales, Clinical Sciences (WRPitney) Building, Short Street, St George Hospital, Kogarah, NSW, 2217, Australia
| | - Victor Liu
- St George and Sutherland Clinical School, University of New South Wales, Clinical Sciences (WRPitney) Building, Short Street, St George Hospital, Kogarah, NSW, 2217, Australia
| | - Sam Adie
- St George and Sutherland Clinical School, University of New South Wales, Clinical Sciences (WRPitney) Building, Short Street, St George Hospital, Kogarah, NSW, 2217, Australia.,St. George and Sutherland Centre for Clinical Orthopaedic Research (SCORe), Suite 201, Level 2 131 Princes Highway, Kogarah, NSW, 2217, Australia.,School of Clinical Medicine, UNSW Medicine & Health, UNSW, New South Wales, Sydney, Australia
| |
Collapse
|
9
|
Zalikha AK, El-Othmani MM, Shah RP. Predictive capacity of four machine learning models for in-hospital postoperative outcomes following total knee arthroplasty. J Orthop 2022; 31:22-28. [PMID: 35345622 PMCID: PMC8956845 DOI: 10.1016/j.jor.2022.03.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 02/13/2022] [Accepted: 03/17/2022] [Indexed: 11/26/2022] Open
Abstract
Background Machine learning (ML) methods have shown promise in the development of patient-specific predictive models prior to surgical interventions. The purpose of this study was to develop, test, and compare four distinct ML models to predict postoperative parameters following primary total knee arthroplasty (TKA). Methods Data from the Nationwide Inpatient Sample was used to identify patients undergoing TKA during 2016-2017. Four distinct ML models predictive of mortality, length of stay (LOS), and discharge disposition were developed and validated using 15 predictive patient and hospital-specific factors. Area under the curve of the receiver operating characteristic curve (AUCROC) and accuracy were used as validity metrics, and the strongest predictive variables under each model were assessed. Results A total of 305,577 patients were included. For mortality, the XGBoost, neural network (NN), and LSVM models all had excellent responsiveness during validation, while random forest (RF) had fair responsiveness. For predicting LOS, all four models had poor responsiveness. For the discharge disposition outcome, the LSVM, NN, and XGBoost models had good responsiveness, while the RF model had poor responsiveness. LSVM and XGBoost had the highest responsiveness for predicting discharge disposition with an AUCROC of 0.747. Discussion The ML models tested demonstrated a range of poor to excellent responsiveness and accuracy in the prediction of the assessed metrics, with considerable variability noted in the predictive precision between the models. The continued development of ML models should be encouraged, with eventual integration into clinical practice in order to inform patient discussions, management decision making, and health policy.
Collapse
|
10
|
Pritchard KT, Hong I, Goodwin JS, Westra JR, Kuo YF, Ottenbacher KJ. Association of Social Behaviors With Community Discharge in Patients with Total Hip and Knee Replacement. J Am Med Dir Assoc 2021; 22:1735-1743.e3. [PMID: 33041232 PMCID: PMC8026771 DOI: 10.1016/j.jamda.2020.08.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 07/07/2020] [Accepted: 08/18/2020] [Indexed: 12/20/2022]
Abstract
OBJECTIVES Understand the association between social determinants of health and community discharge after elective total joint arthroplasty. DESIGN Retrospective cohort design using Optum de-identified electronic health record dataset. SETTING AND PARTICIPANTS A total of 38 hospital networks and 18 non-network hospitals in the United States; 79,725 patients with total hip arthroplasty and 136,070 patients with total knee arthroplasty between 2011 and 2018. METHODS Logistic regression models were used to examine the association among pain, weight status, smoking status, alcohol use, substance disorder, and postsurgical community discharge, adjusted for patient demographics. RESULTS Mean ages for patients with hip and knee arthroplasty were 64.5 (SD 11.3) and 65.9 (SD 9.6) years; most patients were women (53.6%, 60.2%), respectively. The unadjusted community discharge rate was 82.8% after hip and 81.1% after knee arthroplasty. After adjusting for demographics, clinical factors, and behavioral factors, we found obesity [hip: odds ratio (OR) 0.81, 95% confidence interval (CI) 0.76-0.85; knee: OR 0.73, 95% CI 0.69-0.77], current smoking (hip: OR 0.82, 95% CI 0.77-0.88; knee: OR 0.90, 95% CI 0.85-0.95), and history of substance use disorder (hip: OR 0.55, 95% CI 0.50-0.60; knee: OR 0.57, 95% CI 0.53-0.62) were associated with lower odds of community discharge after hip and knee arthroplasty, respectively. CONCLUSIONS AND IMPLICATIONS Social determinants of health are associated with odds of community discharge after total hip and knee joint arthroplasty. Our findings demonstrate the value of using electronic health record data to analyze more granular patient factors associated with patient discharge location after total joint arthroplasty. Although bundled payment is increasing community discharge rates, post-acute care facilities must be prepared to manage more complex patients because odds of community discharge are diminished in those who are obese, smoking, or have a history of substance use disorder.
Collapse
Affiliation(s)
- Kevin T Pritchard
- Division of Rehabilitation Sciences, School of Health Professions, University of Texas Medical Branch, Galveston, TX, USA
| | - Ickpyo Hong
- Department of Occupational Therapy, Yonsei University, Wonju-si, South Korea.
| | - James S Goodwin
- Division of Rehabilitation Sciences, School of Health Professions, University of Texas Medical Branch, Galveston, TX, USA; Department of Internal Medicine, School of Medicine, University of Texas Medical Branch, Galveston, TX, USA; Sealy Center on Aging, University of Texas Medical Branch, Galveston, TX, USA
| | - Jordan R Westra
- Department of Preventive Medicine and Population Health, School of Medicine, University of Texas Medical Branch, Galveston, TX, USA
| | - Yong-Fang Kuo
- Sealy Center on Aging, University of Texas Medical Branch, Galveston, TX, USA; Department of Preventive Medicine and Population Health, School of Medicine, University of Texas Medical Branch, Galveston, TX, USA
| | - Kenneth J Ottenbacher
- Division of Rehabilitation Sciences, School of Health Professions, University of Texas Medical Branch, Galveston, TX, USA; Sealy Center on Aging, University of Texas Medical Branch, Galveston, TX, USA
| |
Collapse
|
11
|
Devana SK, Shah AA, Lee C, Roney AR, van der Schaar M, SooHoo NF. A Novel, Potentially Universal Machine Learning Algorithm to Predict Complications in Total Knee Arthroplasty. Arthroplast Today 2021; 10:135-143. [PMID: 34401416 PMCID: PMC8349766 DOI: 10.1016/j.artd.2021.06.020] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Revised: 06/23/2021] [Accepted: 06/25/2021] [Indexed: 11/26/2022] Open
Abstract
BACKGROUND There remains a lack of accurate and validated outcome-prediction models in total knee arthroplasty (TKA). While machine learning (ML) is a powerful predictive tool, determining the proper algorithm to apply across diverse data sets is challenging. AutoPrognosis (AP) is a novel method that uses automated ML framework to incorporate the best performing stages of prognostic modeling into a single well-calibrated algorithm. We aimed to compare various ML methods to AP in predictive performance of complications after TKA. METHODS Thirty-eight preoperative patient demographics and clinical features from all primary TKAs performed at California-licensed hospitals between 2015 and 2017 were evaluated as predictors of major complications after TKA. Traditional logistic regression (LR), various other ML methods (XGBoost, Gradient Boosting, AdaBoost, and Random Forest), and AP were used for model building to determine discriminative power (area under receiver operating curve), calibration (Brier score), and feature importance. RESULTS Between 2015 and 2017, there were a total of 156,750 TKAs with 1109 (0.7%) total major complications. AP had the highest discriminative performance with area under receiver operating curve 0.679 compared with LR, XGBoost, Gradient Boosting, AdaBoost, and Random Forest (0.617, 0.601, 0.662, 0.657, and 0.545, respectively). AP (Brier score 0.007) had similar calibration as the other ML methods (0.006, 0.006, 0.022, 0.007, and 0.008, respectively). The variables that are most important for AP differ from those that are most important for LR. CONCLUSION Compared to conventional ML algorithms, AP has superior discriminative ability with similar calibration and suggests nonlinear relationships between variables in outcomes of TKA.
Collapse
Affiliation(s)
- Sai K. Devana
- Department of Orthopaedic Surgery, University of California, Los Angeles, USA
| | - Akash A. Shah
- Department of Orthopaedic Surgery, University of California, Los Angeles, USA
| | - Changhee Lee
- Department of Electrical and Computer Engineering, University of California, Los Angeles, USA
| | - Andrew R. Roney
- Department of Orthopaedic Surgery, University of California, Los Angeles, USA
| | - Mihaela van der Schaar
- Department of Electrical and Computer Engineering, University of California, Los Angeles, USA
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, London, UK
- The Alan Turing Institute, London, UK
| | - Nelson F. SooHoo
- Department of Orthopaedic Surgery, University of California, Los Angeles, USA
| |
Collapse
|
12
|
Shah AA, Devana SK, Lee C, Kianian R, van der Schaar M, SooHoo NF. Development of a Novel, Potentially Universal Machine Learning Algorithm for Prediction of Complications After Total Hip Arthroplasty. J Arthroplasty 2021; 36:1655-1662.e1. [PMID: 33478891 PMCID: PMC10371358 DOI: 10.1016/j.arth.2020.12.040] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 11/19/2020] [Accepted: 12/22/2020] [Indexed: 02/02/2023] Open
Abstract
BACKGROUND As the prevalence of hip osteoarthritis increases, the number of total hip arthroplasty (THA) procedures performed is also projected to increase. Accurately risk-stratifying patients who undergo THA would be of great utility, given the significant cost and morbidity associated with developing perioperative complications. We aim to develop a novel machine learning (ML)-based ensemble algorithm for the prediction of major complications after THA, as well as compare its performance against standard benchmark ML methods. METHODS This is a retrospective cohort study of 89,986 adults who underwent primary THA at any California-licensed hospital between 2015 and 2017. The primary outcome was major complications (eg infection, venous thromboembolism, cardiac complication, pulmonary complication). We developed a model predicting complication risk using AutoPrognosis, an automated ML framework that configures the optimally performing ensemble of ML-based prognostic models. We compared our model with logistic regression and standard benchmark ML models, assessing discrimination and calibration. RESULTS There were 545 patients who had major complications (0.61%). Our novel algorithm was well-calibrated and improved risk prediction compared to logistic regression, as well as outperformed the other four standard benchmark ML algorithms. The variables most important for AutoPrognosis (eg malnutrition, dementia, cancer) differ from those that are most important for logistic regression (eg chronic atherosclerosis, renal failure, chronic obstructive pulmonary disease). CONCLUSION We report a novel ensemble ML algorithm for the prediction of major complications after THA. It demonstrates superior risk prediction compared to logistic regression and other standard ML benchmark algorithms. By providing accurate prognostic information, this algorithm may facilitate more informed preoperative shared decision-making.
Collapse
Affiliation(s)
- Akash A Shah
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Sai K Devana
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Changhee Lee
- Department of Electrical and Computer Engineering, University of California, Los Angeles, CA
| | - Reza Kianian
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Mihaela van der Schaar
- Department of Electrical and Computer Engineering, University of California, Los Angeles, CA; Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, United Kingdom
| | - Nelson F SooHoo
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| |
Collapse
|
13
|
Stiegel KR, Valentine MT, Lash JG, Cardenas JM, Harrington MA, Green DM. Early and Direct Rehab Transfer Leads to Significant Cost Savings and Decreased Hospital Length of Stay for Total Joint Arthroplasty in a Veteran Population. J Arthroplasty 2021; 36:1478-1483. [PMID: 33546951 DOI: 10.1016/j.arth.2020.12.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/17/2020] [Revised: 11/25/2020] [Accepted: 12/08/2020] [Indexed: 02/02/2023] Open
Abstract
BACKGROUND Total joint arthroplasty is the most common elective orthopedic procedure in the Veterans Affairs hospital system. In 2019, physical medicine and rehabilitation began screening patients before surgery to select candidates for direct transfer to acute rehab after surgery. The primary outcome of this study was to demonstrate that the accelerated program was successful in decreasing inpatient costs and length of stay (LOS). The secondary outcome was to show that there was no increase in complication, reoperation, and readmission rates. METHODS A retrospective review of total joint arthroplasty patients was conducted with three cohorts: 1) control (n = 193), 2) transfer to rehab orders on postop day #1 (n = 178), and 3) direct transfers to rehab (n = 173). To assess for demographic disparities between cohorts, multiple analysis of variance tests followed by a Bonferroni P-value correction were used. Differences between test groups regarding primary outcomes were assessed with analysis of variance tests followed by pairwise t-tests with Bonferroni P-value corrections. RESULTS There were no significant differences between the cohort demographics or comorbidities. The mean total LOS decreased from 7.0 days in the first cohort, to 6.9 in the second, and 6.0 in the third (P = .00034). The mean decrease in cost per patient was $14,006 between cohorts 1 and 3, equating to over $5.6 million in savings annually. There was no significant change in preintervention and postintervention short-term complications (P = .295). CONCLUSIONS Significant cost savings and decrease in total LOS was observed. In the current health care climate focused on value-based care, a similar intervention could be applied nationwide to improve Veterans Affair services.
Collapse
Affiliation(s)
- Kelly R Stiegel
- Joseph Barnhart Department of Orthopedic Surgery, Baylor College of Medicine, Houston, TX
| | - Matthew T Valentine
- Joseph Barnhart Department of Orthopedic Surgery, Baylor College of Medicine, Houston, TX
| | - Jonathan G Lash
- Joseph Barnhart Department of Orthopedic Surgery, Baylor College of Medicine, Houston, TX
| | - Justin M Cardenas
- Joseph Barnhart Department of Orthopedic Surgery, Baylor College of Medicine, Houston, TX
| | - Melvyn A Harrington
- Joseph Barnhart Department of Orthopedic Surgery, Baylor College of Medicine, Houston, TX
| | - David M Green
- Joseph Barnhart Department of Orthopedic Surgery, Baylor College of Medicine, Houston, TX; Department of Orthopedic Surgery, Michael E. DeBakey Veterans Administration Hospital, Houston, TX
| |
Collapse
|
14
|
Garland A, Bülow E, Lenguerrand E, Blom A, Wilkinson M, Sayers A, Rolfson O, Hailer NP. Prediction of 90-day mortality after total hip arthroplasty. Bone Joint J 2021; 103-B:469-478. [PMID: 33641419 DOI: 10.1302/0301-620x.103b3.bjj-2020-1249.r1] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
AIMS To develop and externally validate a parsimonious statistical prediction model of 90-day mortality after elective total hip arthroplasty (THA), and to provide a web calculator for clinical usage. METHODS We included 53,099 patients with cemented THA due to osteoarthritis from the Swedish Hip Arthroplasty Registry for model derivation and internal validation, as well as 125,428 patients from England and Wales recorded in the National Joint Register for England, Wales, Northern Ireland, the Isle of Man, and the States of Guernsey (NJR) for external model validation. A model was developed using a bootstrap ranking procedure with a least absolute shrinkage and selection operator (LASSO) logistic regression model combined with piecewise linear regression. Discriminative ability was evaluated by the area under the receiver operating characteristic curve (AUC). Calibration belt plots were used to assess model calibration. RESULTS A main effects model combining age, sex, American Society for Anesthesiologists (ASA) class, the presence of cancer, diseases of the central nervous system, kidney disease, and diagnosed obesity had good discrimination, both internally (AUC = 0.78, 95% confidence interval (CI) 0.75 to 0.81) and externally (AUC = 0.75, 95% CI 0.73 to 0.76). This model was superior to traditional models based on the Charlson (AUC = 0.66, 95% CI 0.62 to 0.70) and Elixhauser (AUC = 0.64, 95% CI 0.59 to 0.68) comorbidity indices. The model was well calibrated for predicted probabilities up to 5%. CONCLUSION We developed a parsimonious model that may facilitate individualized risk assessment prior to one of the most common surgical interventions. We have published a web calculator to aid clinical decision-making. Cite this article: Bone Joint J 2021;103-B(3):469-478.
Collapse
Affiliation(s)
- Anne Garland
- Department of Surgical Sciences/Orthopaedics, Institute of Surgical Sciences, Uppsala University Hospital, Uppsala, Sweden.,The Swedish Hip Arthroplasty Register, Gothenburg, Sweden.,Department of Orthopaedics, Visby Hospital, Visby, Sweden
| | - Erik Bülow
- The Swedish Hip Arthroplasty Register, Gothenburg, Sweden.,Department of Orthopaedics, Institute of Clinical Sciences, The Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Erik Lenguerrand
- Translational Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Ashley Blom
- Translational Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK.,The National Institute of Health Research Biomedical Research Centre, Bristol, UK
| | - Mark Wilkinson
- Department of Oncology and Metabolism, University of Sheffield, Sheffield, UK
| | - Adrian Sayers
- Translational Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Ola Rolfson
- The Swedish Hip Arthroplasty Register, Gothenburg, Sweden.,Department of Orthopaedics, Institute of Clinical Sciences, The Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Nils P Hailer
- Department of Surgical Sciences/Orthopaedics, Institute of Surgical Sciences, Uppsala University Hospital, Uppsala, Sweden.,The Swedish Hip Arthroplasty Register, Gothenburg, Sweden
| |
Collapse
|
15
|
Harris AHS, Kuo AC, Bowe TR, Manfredi L, Lalani NF, Giori NJ. Can Machine Learning Methods Produce Accurate and Easy-to-Use Preoperative Prediction Models of One-Year Improvements in Pain and Functioning After Knee Arthroplasty? J Arthroplasty 2021; 36:112-117.e6. [PMID: 32798181 DOI: 10.1016/j.arth.2020.07.026] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/08/2020] [Revised: 06/23/2020] [Accepted: 07/11/2020] [Indexed: 02/02/2023] Open
Abstract
BACKGROUND Approximately 15%-20% of total knee arthroplasty (TKA) patients do not experience clinically meaningful improvements. We sought to compare the accuracy and parsimony of several machine learning strategies for developing predictive models of failing to experience minimal clinically important differences in patient-reported outcome measures (PROMs) 1 year after TKA. METHODS Patients (N = 587) in 3 large Veteran Health Administration facilities completed PROMs before and 1 year after TKA (92% follow-up). Preoperative PROMs and electronic health record data were used to develop and validate models to predict failing to experience at least a minimal clinically important difference in Knee Injury and Osteoarthritis Outcome Score (KOOS) Total, KOOS JR, and KOOS subscales (Pain, Symptoms, Activities of Daily Living, Quality of Life, and recreation). Several machine learning strategies were used for model development. Ten-fold cross-validation and bootstrapping were used to produce measures of overall accuracy (C-statistic, Brier Score). The sensitivity and specificity of various predicted probability cut-points were examined. RESULTS The most accurate models produced were for the Activities of Daily Living, Pain, Symptoms, and Quality of Life subscales of the KOOS (C-statistics 0.76, 0.72, 0.72, and 0.71, respectively). Strategies varied substantially in terms of the numbers of inputs required to achieve similar accuracy, with none being superior for all outcomes. CONCLUSION Models produced in this project provide estimates of patient-specific improvements in major outcomes 1 year after TKA. Integrating these models into clinical decision support, informed consent and shared decision making could improve patient selection, education, and satisfaction. LEVEL OF EVIDENCE Level III, diagnostic study.
Collapse
Affiliation(s)
- Alex H S Harris
- Center for Innovation to Implementation, VA Palo Alto Healthcare System, Palo Alto, CA; Department of Surgery, Stanford-Surgical Policy Improvement Research and Education (S-SPIRE) Center, Stanford, CA
| | - Alfred C Kuo
- San Francisco Veterans Affairs Medical Center, University of California, San Francisco, CA
| | - Thomas R Bowe
- Center for Innovation to Implementation, VA Palo Alto Healthcare System, Palo Alto, CA
| | - Luisa Manfredi
- Center for Innovation to Implementation, VA Palo Alto Healthcare System, Palo Alto, CA
| | - Narlina F Lalani
- Center for Care Delivery and Outcomes Research, VA Minneapolis Healthcare System, Minneapolis, MN
| | - Nicholas J Giori
- Center for Innovation to Implementation, VA Palo Alto Healthcare System, Palo Alto, CA; Department of Orthopedic Surgery, Stanford University School of Medicine, Stanford, CA
| |
Collapse
|
16
|
Clinical and Budget Impact of Treating Preoperative Anemia in Major Orthopedic Surgery-A Retrospective Observational Study. J Arthroplasty 2020; 35:3084-3088. [PMID: 32654943 DOI: 10.1016/j.arth.2020.06.018] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/20/2020] [Revised: 06/01/2020] [Accepted: 06/09/2020] [Indexed: 02/02/2023] Open
Abstract
BACKGROUND Preoperative anemia (POA) in elective surgery is associated with worse outcome. In this retrospective study, in elective hip and knee arthroplasties, the prevalence of POA and its associations with outcome were analyzed, followed by a model estimating the budget impact of screening and treatment of POA. METHODS All elective hip/knee arthroplasties performed during the period 2016-2018 were included. Patients with normal hemoglobin and patients with POA (hemoglobin < 13.0 g/dL in men and <12.0 g/dL in women) were compared. Outcome measures were allogeneic blood transfusion (ABT), length of stay (LOS), complications, mortality, and costs. The budget impact of screening for POA and treatment with intravenous iron when relevant was modeled based on the results of the costs related to POA. RESULTS In 881 procedures, the prevalence of POA was 21.5%. POA independently predicted increased risks of ABT (odds ratio [OR]adj, 9.5 [confidence interval-CI, 6.4-13.9]), prolonged LOS (ORadj, 2.8 [CI, 1.8-4.2]), and was associated with increased complications (ORadj, 1.9 [CI, 0.7-4.9]) and mortality (ORadj, 3.2 [CI, 0.8-13.5]). POA resulted in increased costs per patient (P < .001). The budget impact model showed a cost reduction of 254 euros per patient based on the assumption that patients screened and treated for iron-deficient anemia would have the same outcome as non-POA. CONCLUSION The prevalence of POA in elective orthopedic surgery in Sweden is at the same level as previously reported by others. Screening and treatment of POA would reduce costs based on less ABT and decreased LOS and may reduce complications in elective major orthopedic surgery.
Collapse
|
17
|
Perestelo-Pérez L, Álvarez-Pérez Y, Rivero-Santana A, Ramos-García V, Duarte-Díaz A, Torres-Castaño A, Toledo-Chávarri A, Herrera-Perez M, País-Brito JL, Del Castillo JC, Vázquez JR, Orrego C, Serrano-Aguilar P. The effectiveness of a web-based decision aid for patients with hip osteoarthritis: study protocol for a randomized controlled trial. Trials 2020; 21:736. [PMID: 32838800 PMCID: PMC7445920 DOI: 10.1186/s13063-020-04661-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Accepted: 08/07/2020] [Indexed: 11/23/2022] Open
Abstract
Background Osteoarthritis (OA) is a health condition sensitive to patient’s preferences and values regarding the benefits and risks of the different treatment options. In this sense, patient decision aids (PtDA) can play an important role in helping patients to incorporate their values, needs, and preferences into the decision-making process, thus improving person-centered care. Previous research has focused almost exclusively on knee OA, and therefore, the aim of this study is to develop and evaluate the effectiveness of a PtDA for patients with hip OA. Methods The general design consists of two phases: (1) design a web-based PtDA for patients with hip OA, following the recommended procedures: systematic review of safety/effectiveness of treatments, and an iterative process of development with the help of an Advisory Committee composed of health professionals and patients, and (2) to evaluate the impact of the PtDA on hip OA patients’ decision-making process related with their treatment. For that aim, a multicenter randomized controlled trial will be carried out with 124 patients with hip OA in Tenerife (Spain) comparing intervention or usual care. Discussion PtDAs have been recommended as a useful and effective resource for improving PCC in many health conditions. The intervention is intended to empower patients by fostering their active participation during the decision-making process about their treatment and by ensuring they make informed decisions congruent with their values and preferences. This study will contribute to the scientific knowledge about effectiveness of PtDAs in hip OA, in order to improve the quality of health care offered to these patients. Trial registration ClinicalTrials.gov NCT04241978. Registered on 24 January 2020.
Collapse
Affiliation(s)
- Lilisbeth Perestelo-Pérez
- Evaluation Unit of the Canary Islands Health Service (SESCS), Camino Candelaria, s/n. 38109, El Rosario, S/C de Tenerife, Spain. .,Health Services Research on Chronic Patients Network (REDISSEC), Tenerife, Spain. .,Center for Biomedical Research of the Canary Islands (CIBICAN), Tenerife, Spain.
| | - Yolanda Álvarez-Pérez
- Fundación Canaria Instituto de Investigación Sanitaria de Canarias (FIISC), Tenerife, Spain
| | - Amado Rivero-Santana
- Health Services Research on Chronic Patients Network (REDISSEC), Tenerife, Spain.,Center for Biomedical Research of the Canary Islands (CIBICAN), Tenerife, Spain.,Fundación Canaria Instituto de Investigación Sanitaria de Canarias (FIISC), Tenerife, Spain
| | - Vanesa Ramos-García
- Fundación Canaria Instituto de Investigación Sanitaria de Canarias (FIISC), Tenerife, Spain
| | - Andrea Duarte-Díaz
- Fundación Canaria Instituto de Investigación Sanitaria de Canarias (FIISC), Tenerife, Spain
| | | | - Ana Toledo-Chávarri
- Health Services Research on Chronic Patients Network (REDISSEC), Tenerife, Spain.,Fundación Canaria Instituto de Investigación Sanitaria de Canarias (FIISC), Tenerife, Spain
| | | | - José Luis País-Brito
- Health Services Research on Chronic Patients Network (REDISSEC), Tenerife, Spain.,Hospital Universitario de Canarias (HUC), Tenerife, Spain
| | | | - José Ramón Vázquez
- Gerencia de Atención Primaria de Tenerife del Servicio Canario de la Salud, Tenerife, Spain
| | - Carola Orrego
- Health Services Research on Chronic Patients Network (REDISSEC), Tenerife, Spain.,Avedis Donabedian Research Institute (FAD), Barcelona, Spain
| | - Pedro Serrano-Aguilar
- Evaluation Unit of the Canary Islands Health Service (SESCS), Camino Candelaria, s/n. 38109, El Rosario, S/C de Tenerife, Spain.,Health Services Research on Chronic Patients Network (REDISSEC), Tenerife, Spain.,Center for Biomedical Research of the Canary Islands (CIBICAN), Tenerife, Spain
| |
Collapse
|
18
|
Trickey AW, Harris AHS. Reply to the Letter to the Editor: How Accurate Are the Surgical Risk Preoperative Assessment System (SURPAS) Universal Calculators in Total Joint Arthroplasty? Clin Orthop Relat Res 2020; 478:1948-1949. [PMID: 32732582 PMCID: PMC7371081 DOI: 10.1097/corr.0000000000001372] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/13/2020] [Accepted: 05/28/2020] [Indexed: 01/31/2023]
Affiliation(s)
- Amber W Trickey
- A W. Trickey, A. H. S. Harris, Stanford-Surgery Policy Improvement Research and Education Center, Department of Surgery, Stanford University School of Medicine, Stanford, CA, USA
| | - Alex H S Harris
- A W. Trickey, A. H. S. Harris, Stanford-Surgery Policy Improvement Research and Education Center, Department of Surgery, Stanford University School of Medicine, Stanford, CA, USA
- A. H. S. Harris, Center for Innovation to Implementation, VA Palo Alto Healthcare System, Palo Alto, CA, USA
| |
Collapse
|
19
|
Katakam A, Karhade AV, Schwab JH, Chen AF, Bedair HS. Development and validation of machine learning algorithms for postoperative opioid prescriptions after TKA. J Orthop 2020; 22:95-99. [PMID: 32300270 DOI: 10.1016/j.jor.2020.03.052] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2020] [Accepted: 03/26/2020] [Indexed: 12/16/2022] Open
Abstract
Objective The aims of this study were to develop machine learning algorithms for preoperative prediction of prolonged opioid prescriptions after TKA and to identify variables that can predict the probability of this adverse outcome. Methods Five algorithms were developed for prediction of prolonged postoperative opioid prescriptions. Results The stochastic gradient boosting (SGB) model had the best performance. Age, history of preoperative opioid use, marital status, diagnosis of diabetes, and several preoperative medications were predictive of prolonged postoperative opioid prescriptions. Conclusion The SGB algorithm developed could help improve preoperative identification of TKA patients at risk for prolonged postoperative opioid prescriptions.
Collapse
Affiliation(s)
- Akhil Katakam
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Aditya V Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Joseph H Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Antonia F Chen
- Department of Orthopaedic Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Hany S Bedair
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
20
|
Poduval M, Ghose A, Manchanda S, Bagaria V, Sinha A. Artificial Intelligence and Machine Learning: A New Disruptive Force in Orthopaedics. Indian J Orthop 2020; 54:109-122. [PMID: 32257027 PMCID: PMC7096590 DOI: 10.1007/s43465-019-00023-3] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/10/2019] [Accepted: 09/18/2019] [Indexed: 02/04/2023]
Abstract
Orthopaedics as a surgical discipline requires a combination of good clinical acumen, good surgical skill, a reasonable physical strength and most of all, good understanding of technology. The last few decades have seen rapid adoption of new technologies into orthopaedic practice, power tools, new implants, CAD-CAM design, 3-D printing, additive manufacturing just to name a few. The new disruption in orthopaedics in the current time and era is undoubtedly the advent of artificial intelligence and robotics. As these technologies take root and innovative applications continue to be incorporated into the main-stream orthopedics, as we know it today, it is imperative to look at and understand the basics of artificial intelligence and what work is being done in the field today. This article takes the form of a loosely structured narrative review and will introduce the reader to key concepts in the field of artificial intelligence as well as some of the directions in application of the same in orthopaedics. Some of the recent work has been summarised and we present our viewpoint at the conclusion as to why we must consider artificial intelligence as a disrupting positive influence on orthopaedic surgery.
Collapse
Affiliation(s)
- Murali Poduval
- Tata Consultancy Services, Unit 129/130, SDF V, SEEPZ, Andheri East, Mumbai, 400093 India
| | - Avik Ghose
- TCS Research and Innovation, Tata Consultancy Services, Kolkata, 700160 India
| | - Sanjeev Manchanda
- TCS Research and Innovation, Tata Consultancy Services, Unit 129/130, SEEPZ, Andheri East, Mumbai, 400096 India
| | | | - Aniruddha Sinha
- TCS Research and Innovation, Tata Consultancy Services, Kolkata, 700160 India
| |
Collapse
|
21
|
Morrell AT, Golladay GJ, Kates SL. Surgical selection criteria compliance is associated with a lower risk of periprosthetic joint infection in total hip arthroplasty. Arthroplast Today 2019; 5:521-524. [PMID: 31886401 PMCID: PMC6921180 DOI: 10.1016/j.artd.2019.10.007] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/08/2019] [Revised: 10/24/2019] [Accepted: 10/26/2019] [Indexed: 12/17/2022] Open
Abstract
Background Periprosthetic joint infection (PJI) is a devastating complication of total hip arthroplasty (THA). Patient optimization represents an important target for PJI prevention. Unfortunately, best practice screening guidelines are not consistently followed by all surgeons. Our study aimed to determine both the degree and the effect that compliance with our institutional preoperative surgical selection criteria had on PJI rates for patients undergoing elective primary THA. Methods A retrospective review was conducted on 455 elective primary THA procedures performed at an academic tertiary care center over a 2-year period. Institutional preoperative surgical selection criteria included the following: body mass index ≤40 kg/m2, hemoglobin A1c ≤7.5%, hemoglobin ≥12 g/dL, albumin ≥3.5 g/dL, no smoking within 30 days prior to surgery, and completion of a decolonization protocol if a nasal polymerase chain reaction was positive for Staphylococcus aureus. PJI was assessed for a minimum 1-year follow-up using Musculoskeletal Infection Society criteria from 2011. Rates of compliance and PJI were compared using a chi-squared test. Results Surgeon compliance with institutional preoperative selection criteria was 62.4% and ranged from 0.0% to 83.9%. Five of 455 patients developed a PJI. The total PJI rate was 1.1%. The compliant patient cohort had a PJI rate of 0.0%, while the noncompliant cohort had a PJI rate of 2.9% (P = .0038). Conclusions This study identified a statistically significant decrease in PJI rates among patients who met all preoperative screening criteria.
Collapse
Affiliation(s)
- Aidan T Morrell
- School of Medicine, Virginia Commonwealth University, Richmond, VA, USA
| | - Gregory J Golladay
- Department of Orthopaedic Surgery, Virginia Commonwealth University, Richmond, VA, USA
| | - Stephen L Kates
- Department of Orthopaedic Surgery, Virginia Commonwealth University, Richmond, VA, USA
| |
Collapse
|
22
|
Mudumbai SC, Pershing S, Bowe T, Kamal RN, Sears ED, Finlay AK, Eisenberg D, Hawn MT, Weng Y, Trickey AW, Mariano ER, Harris AHS. Development and validation of a predictive model for American Society of Anesthesiologists Physical Status. BMC Health Serv Res 2019; 19:859. [PMID: 31752856 PMCID: PMC6868867 DOI: 10.1186/s12913-019-4640-x] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Accepted: 10/15/2019] [Indexed: 01/16/2023] Open
Abstract
BACKGROUND The American Society of Anesthesiologists Physical Status (ASA-PS) classification system was developed to categorize the fitness of patients before surgery. Increasingly, the ASA-PS has been applied to other uses including justification of inpatient admission. Our objectives were to develop and cross-validate a statistical model for predicting ASA-PS; and 2) assess the concurrent and predictive validity of the model by assessing associations between model-derived ASA-PS, observed ASA-PS, and a diverse set of 30-day outcomes. METHODS Using the 2014 American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) Participant Use Data File, we developed and internally cross-validated multinomial regression models to predict ASA-PS using preoperative NSQIP data. Accuracy was assessed with C-Statistics and calibration plots. We assessed both concurrent and predictive validity of model-derived ASA-PS relative to observed ASA-PS and 30-day outcomes. To aid further research and use of the ASA-PS model, we implemented it into an online calculator. RESULTS Of the 566,797 elective procedures in the final analytic dataset, 8.9% were ASA-PS 1, 48.9% were ASA-PS 2, 39.1% were ASA-PS 3, and 3.2% were ASA-PS 4. The accuracy of the 21-variable model to predict ASA-PS was C = 0.77 +/- 0.0025. The model-derived ASA-PS had stronger association with key indicators of preoperative status including comorbidities and higher BMI (concurrent validity) compared to observed ASA-PS, but less strong associations with postoperative complications (predictive validity). The online ASA-PS calculator may be accessed at https://s-spire-clintools.shinyapps.io/ASA_PS_Estimator/ CONCLUSIONS: Model-derived ASA-PS better tracked key indicators of preoperative status compared to observed ASA-PS. The ability to have an electronically derived measure of ASA-PS can potentially be useful in research, quality measurement, and clinical applications.
Collapse
Affiliation(s)
- Seshadri C Mudumbai
- Anesthesiology and Perioperative Care Service, Veterans Affairs Palo Alto Health Care System, 3801 Miranda Avenue, Palo Alto, CA, 94402, USA. .,Department of Anesthesiology, Perioperative and Pain Medicine, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA. .,Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, 795 Willow Road (152-MPD), Menlo Park, California, 94025, USA.
| | - Suzann Pershing
- Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, 795 Willow Road (152-MPD), Menlo Park, California, 94025, USA.,Department of Ophthalmology, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA
| | - Thomas Bowe
- Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, 795 Willow Road (152-MPD), Menlo Park, California, 94025, USA
| | - Robin N Kamal
- Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, 795 Willow Road (152-MPD), Menlo Park, California, 94025, USA.,Department of Orthopaedic Surgery, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA
| | - Erika D Sears
- Department of Surgery, Section of Plastic Surgery at the University of Michigan, 2101 Taubman Center 1500 E. Medical Center Drive, Ann Arbor, MI, 48109, USA.,Center for Clinical Management Research, VA Ann Arbor Healthcare System, 2215 Fuller Rd, Ann Arbor, MI, 48105, USA
| | - Andrea K Finlay
- Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, 795 Willow Road (152-MPD), Menlo Park, California, 94025, USA
| | - Dan Eisenberg
- Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, 795 Willow Road (152-MPD), Menlo Park, California, 94025, USA.,Department of Surgery Surgery Policy Improvement Research and Education (S-SPIRE) Center, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA
| | - Mary T Hawn
- Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, 795 Willow Road (152-MPD), Menlo Park, California, 94025, USA.,Department of Surgery Surgery Policy Improvement Research and Education (S-SPIRE) Center, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA
| | - Yingjie Weng
- Department of Surgery Surgery Policy Improvement Research and Education (S-SPIRE) Center, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA
| | - Amber W Trickey
- Department of Surgery Surgery Policy Improvement Research and Education (S-SPIRE) Center, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA
| | - Edward R Mariano
- Anesthesiology and Perioperative Care Service, Veterans Affairs Palo Alto Health Care System, 3801 Miranda Avenue, Palo Alto, CA, 94402, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA
| | - Alex H S Harris
- Center for Innovation to Implementation, Veterans Affairs Palo Alto Health Care System, 795 Willow Road (152-MPD), Menlo Park, California, 94025, USA.,Department of Surgery Surgery Policy Improvement Research and Education (S-SPIRE) Center, Stanford University School of Medicine, 291 Campus Drive, Stanford, CA, 94305, USA
| |
Collapse
|
23
|
Can Machine Learning Methods Produce Accurate and Easy-to-use Prediction Models of 30-day Complications and Mortality After Knee or Hip Arthroplasty? Clin Orthop Relat Res 2019; 477:452-460. [PMID: 30624314 PMCID: PMC6370104 DOI: 10.1097/corr.0000000000000601] [Citation(s) in RCA: 96] [Impact Index Per Article: 19.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
BACKGROUND Existing universal and procedure-specific surgical risk prediction models of death and major complications after elective total joint arthroplasty (TJA) have limitations including poor transparency, poor to modest accuracy, and insufficient validation to establish performance across diverse settings. Thus, the need remains for accurate and validated prediction models for use in preoperative management, informed consent, shared decision-making, and risk adjustment for reimbursement. QUESTIONS/PURPOSES The purpose of this study was to use machine learning methods and large national databases to develop and validate (both internally and externally) parsimonious risk-prediction models for mortality and complications after TJA. METHODS Preoperative demographic and clinical variables from all 107,792 nonemergent primary THAs and TKAs in the 2013 to 2014 American College of Surgeons-National Surgical Quality Improvement Program (ACS-NSQIP) were evaluated as predictors of 30-day death and major complications. The NSQIP database was chosen for its high-quality data on important outcomes and rich characterization of preoperative demographic and clinical predictors for demographically and geographically diverse patients. Least absolute shrinkage and selection operator (LASSO) regression, a type of machine learning that optimizes accuracy and parsimony, was used for model development. Tenfold validation was used to produce C-statistics, a measure of how well models discriminate patients who experience an outcome from those who do not. External validation, which evaluates the generalizability of the models to new data sources and patient groups, was accomplished using data from the Veterans Affairs Surgical Quality Improvement Program (VASQIP). Models previously developed from VASQIP data were also externally validated using NSQIP data to examine the generalizability of their performance with a different group of patients outside the VASQIP context. RESULTS The models, developed using LASSO regression with diverse clinical (for example, American Society of Anesthesiologists classification, comorbidities) and demographic (for example, age, gender) inputs, had good accuracy in terms of discriminating the likelihood a patient would experience, within 30 days of arthroplasty, a renal complication (C-statistic, 0.78; 95% confidence interval [CI], 0.76-0.80), death (0.73; 95% CI, 0.70-0.76), or a cardiac complication (0.73; 95% CI, 0.71-0.75) from one who would not. By contrast, the models demonstrated poor accuracy for venous thromboembolism (C-statistic, 0.61; 95% CI, 0.60-0.62) and any complication (C-statistic, 0.64; 95% CI, 0.63-0.65). External validation of the NSQIP- derived models using VASQIP data found them to be robust in terms of predictions about mortality and cardiac complications, but not for predicting renal complications. Models previously developed with VASQIP data had poor accuracy when externally validated with NSQIP data, suggesting they should not be used outside the context of the Veterans Health Administration. CONCLUSIONS Moderately accurate predictive models of 30-day mortality and cardiac complications after elective primary TJA were developed as well as internally and externally validated. To our knowledge, these are the most accurate and rigorously validated TJA-specific prediction models currently available (http://med.stanford.edu/s-spire/Resources/clinical-tools-.html). Methods to improve these models, including the addition of nonstandard inputs such as natural language processing of preoperative clinical progress notes or radiographs, should be pursued as should the development and validation of models to predict longer term improvements in pain and function. LEVEL OF EVIDENCE Level III, diagnostic study.
Collapse
|
24
|
American Joint Replacement Registry Risk Calculator Does Not Predict 90-day Mortality in Veterans Undergoing Total Joint Replacement. Clin Orthop Relat Res 2018; 476:1869-1875. [PMID: 30113939 PMCID: PMC6259803 DOI: 10.1097/corr.0000000000000377] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
BACKGROUND The American Joint Replacement Registry (AJRR) Total Joint Risk Calculator uses demographic and clinical parameters to provide risk estimates for 90-day mortality and 2-year periprosthetic joint infection (PJI). The tool is intended to help surgeons counsel their Medicare-eligible patients about their risk of death and PJI after total joint arthroplasty (TJA). However, for a predictive risk model to be useful, it must be accurate when applied to new patients; this has yet to be established for this calculator. QUESTIONS/PURPOSES To produce accuracy metrics (ie, discrimination, calibration) for the AJRR mortality calculator using data from Medicare-eligible patients undergoing TJA in the Veterans Health Administration (VHA), the largest integrated healthcare system in the United States, where more than 10,000 TJAs are performed annually. METHODS We used the AJRR calculator to predict risk of death within 90 days of surgery among 31,214 VHA patients older than 64 years of age who underwent primary TJA; data was drawn from the Veterans Affairs Surgical Quality Improvement Project (VASQIP) and VA Corporate Data Warehouse (CDW). We then used VHA mortality data to evaluate the extent to which the AJRR calculator estimates distinguished individuals who died compared with those who did not (C-statistic), and graphically depicted the relationship between estimated risk and observed mortality (calibration). As a secondary evaluation of the calculator, a sample of 39,300 patients younger than 65 years old was assigned to the youngest age group available to the user (65-69 years) as might be done in real-world practice. RESULTS C-statistics for 90-day mortality for the older samples were 0.62 (95% CI, 0.60-0.64) and for the younger samples they were 0.46 (95% CI, 0.43-0.49), suggesting poor discrimination. Calibration analysis revealed poor correspondence between deciles of predicted risk and observed mortality rates. Poor discrimination and calibration mean that patients who died will frequently have a lower estimated risk of death than surviving patients. CONCLUSIONS For Medicare-eligible patients receiving TJA in the VA, the AJRR risk calculator had a poor performance in the prediction of 90-day mortality. There are several possible reasons for the model's poor performance. Veterans Health Administration patients, 97% of whom were men, represent only a subset of the broader Medicare population. However, applying the calculator to a subset of the target population should not affect its accuracy. Other reasons for poor performance include a lack of an underlying statistical model in the calculator's implementation and simply the challenge of predicting rare events. External validation in a more representative sample of Medicare patients should be conducted to before assuming this tool is accurate for its intended use. LEVEL OF EVIDENCE Level I, diagnostic study.
Collapse
|
25
|
CORR Insights®: American Joint Replacement Registry Risk Calculator Does Not Predict 90-day Mortality in Veterans Undergoing Total Joint Replacement. Clin Orthop Relat Res 2018; 476:1876-1877. [PMID: 30024464 PMCID: PMC6259810 DOI: 10.1097/corr.0000000000000408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
|