Using machine-learned bayesian belief networks to predict perioperative risk of clostridium difficile infection following colon surgery

Machine Learning-Based Prediction Models for Clostridioides difficile Infection: A Systematic Review

INTRODUCTION

Despite research efforts, predicting Clostridioides difficile incidence and its outcomes remains challenging. The aim of this systematic review was to evaluate the performance of machine learning (ML) models in predicting C. difficile infection (CDI) incidence and complications using clinical data from electronic health records.

METHODS

We conducted a comprehensive search of databases (OVID, Embase, MEDLINE ALL, Web of Science, and Scopus) from inception up to September 2023. Studies employing ML techniques for predicting CDI or its complications were included. The primary outcome was the type and performance of ML models assessed using the area under the receiver operating characteristic curve.

RESULTS

Twelve retrospective studies that evaluated CDI incidence and/or outcomes were included. The most commonly used ML models were random forest and gradient boosting. The area under the receiver operating characteristic curve ranged from 0.60 to 0.81 for predicting CDI incidence, 0.59 to 0.80 for recurrence, and 0.64 to 0.88 for predicting complications. Advanced ML models demonstrated similar performance to traditional logistic regression. However, there was notable heterogeneity in defining CDI and the different outcomes, including incidence, recurrence, and complications, and a lack of external validation in most studies.

DISCUSSION

ML models show promise in predicting CDI incidence and outcomes. However, the observed heterogeneity in CDI definitions and the lack of real-world validation highlight challenges in clinical implementation. Future research should focus on external validation and the use of standardized definitions across studies.

Identification of patients at risk of Clostridioides difficile infection for enrollment in vaccine clinical trials

BACKGROUND

Clostridioides difficile infection (CDI) is an important cause of diarrheal disease associated with increasing morbidity and mortality. Efforts to develop a preventive vaccine are ongoing. The goal of this study was to develop an algorithm to identify patients at high risk of CDI for enrollment in a vaccine efficacy trial.

METHODS

We conducted a 2-stage retrospective study of patients aged ≥ 50 within the US Department of Veterans Affairs Health system between January 1, 2009 and December 31, 2013. Included patients had at least 1 visit in each of the 2 years prior to the study, with no CDI in the past year. We used multivariable logistic regression with elastic net regularization to identify predictors of CDI in months 2-12 (i.e., days 31 - 365) to allow time for antibodies to develop. Performance was measured using the positive predictive value (PPV) and the area under the curve (AUC).

RESULTS

Elements of the predictive algorithm included age, baseline comorbidity score, acute renal failure, recent infections or high-risk antibiotic use, hemodialysis in the last month, race, and measures of recent healthcare utilization. The final algorithm resulted in an AUC of 0.69 and a PPV of 3.4%.

CONCLUSIONS

We developed a predictive algorithm to identify a patient population with increased risk of CDI over the next 2-12 months. Our algorithm can be used prospectively with clinical and administrative data to facilitate the feasibility of conducting efficacy studies in a timely manner in an appropriate population.

Paradigm shift: cognitive surgery

In the last hundred years surgery has experienced a dramatic increase of scientific knowledge and innovation. The need to consider best available evidence and to apply technical innovations, such as minimally invasive approaches, challenges the surgeon both intellectually and manually. In order to overcome this challenge, computer scientists and surgeons within the interdisciplinary field of "cognitive surgery" explore and innovate new ways of data processing and management. This article gives a general overview of the topic and outlines selected pre-, intra- and postoperative applications. It explores the possibilities of new intelligent devices and software across the entire treatment process of patients ending in the consideration of an "Intelligent Hospital" or "Hospital 4.0", in which the borders between IT infrastructures, medical devices, medical personnel and patients are bridged by technology. Thereby, the "Hospital 4.0" is an intelligent system, which gives the right information, at the right time, at the right place to the individual stakeholder and thereby helps to decrease complications and improve clinical processes as well as patient outcome.

Can a Bayesian Belief Network Be Used to Estimate 1-year Survival in Patients With Bone Sarcomas?

BACKGROUND

Extremity sarcoma has a preponderance to present late with advanced stage at diagnosis. It is important to know why these patients die early from sarcoma and to predict those at high risk. Currently we have mid- to long-term outcome data on which to counsel patients and support treatment decisions, but in contrast to other cancer groups, very little on short-term mortality. Bayesian belief network modeling has been used to develop decision-support tools in various oncologic diagnoses, but to our knowledge, this approach has not been applied to patients with extremity sarcoma.

QUESTIONS/PURPOSES

We sought to (1) determine whether a Bayesian belief network could be used to estimate the likelihood of 1-year mortality using receiver operator characteristic analysis; (2) describe the hierarchal relationships between prognostic and outcome variables; and (3) determine whether the model was suitable for clinical use using decision curve analysis.

METHODS

We considered all patients treated for primary bone sarcoma between 1970 and 2012, and excluded secondary metastasis, presentation with local recurrence, and benign tumors. The institution's database yielded 3499 patients, of which six (0.2%) were excluded. Data extracted for analysis focused on patient demographics (age, sex), tumor characteristics at diagnosis (size, metastasis, pathologic fracture), survival, and cause of death. A Bayesian belief network generated conditional probabilities of variables and survival outcome at 1 year. A lift analysis determined the hierarchal relationship of variables. Internal validation of 699 test patients (20% dataset) determined model accuracy. Decision curve analysis was performed comparing net benefit (capped at 85.5%) for all threshold probabilities (survival output from model).

RESULTS

We successfully generated a Bayesian belief network with five first-degree associates and describe their conditional relationship with survival after the diagnosis of primary bone sarcoma. On internal validation, the resultant model showed good predictive accuracy (area under the curve [AUC] = 0.767; 95% CI, 0.72-0.83). The factors that predict the outcome of interest, 1-year mortality, in order of relative importance are synchronous metastasis (6.4), patient's age (3), tumor size (2.1), histologic grade (1.8), and presentation with a pathologic fracture (1). Patient's sex, tumor location, and inadvertent excision were second-degree associates and not directly related to the outcome of interest. Decision curve analysis shows that clinicians can accurately base treatment decisions on the 1-year model rather than assuming all patients, or no patients, will survive greater than 1 year. For threshold probabilities less than approximately 0.5, the model is no better or no worse than assuming all patients will survive.

CONCLUSIONS

We showed that a Bayesian belief network can be used to predict 1-year mortality in patients presenting with a primary malignancy of bone and quantified the primary factors responsible for an increased risk of death. Synchronous metastasis, patient's age, and the size of the tumor had the largest prognostic effect. We believe models such as these can be useful as clinical decision-support tools and, when properly externally validated, provide clinicians and patients with information germane to the treatment of bone sarcomas.

CLINICAL RELEVANCE

Bone sarcomas are difficult to treat requiring multidisciplinary input to strategize management. An evidence-based survival prediction can be a powerful adjunctive to clinicians in this scenario. We believe the short-term predictions can be used to evaluate services, with 1-year mortality already being a quality indicator. Mortality predictors also can be incorporated in clinical trials, for example, to identify patients who are least likely to experience the side effects of experimental toxic chemotherapeutic agents.

Bayesian neural network approach for determining the risk of re-intervention after endovascular aortic aneurysm repair

This article proposes a Bayesian neural network approach to determine the risk of re-intervention after endovascular aortic aneurysm repair surgery. The target of proposed technique is to determine which patients have high chance to re-intervention (high-risk patients) and which are not (low-risk patients) after 5 years of the surgery. Two censored datasets relating to the clinical conditions of aortic aneurysms have been collected from two different vascular centers in the United Kingdom. A Bayesian network was first employed to solve the censoring issue in the datasets. Then, a back propagation neural network model was built using the uncensored data of the first center to predict re-intervention on the second center and classify the patients into high-risk and low-risk groups. Kaplan-Meier curves were plotted for each group of patients separately to show whether there is a significant difference between the two risk groups. Finally, the logrank test was applied to determine whether the neural network model was capable of predicting and distinguishing between the two risk groups. The results show that the Bayesian network used for uncensoring the data has improved the performance of the neural networks that were built for the two centers separately. More importantly, the neural network that was trained with uncensored data of the first center was able to predict and discriminate between groups of low risk and high risk of re-intervention after 5 years of endovascular aortic aneurysm surgery at center 2 (p = 0.0037 in the logrank test).