A Machine Learning Model for Accurate Prediction of Sepsis in ICU Patients

Evaluating automated machine learning platforms for use in healthcare

Objective

To describe development and application of a checklist of criteria for selecting an automated machine learning (Auto ML) platform for use in creating clinical ML models.

Materials and Methods

Evaluation criteria for selecting an Auto ML platform suited to ML needs of a local health district were developed in 3 steps: (1) identification of key requirements, (2) a market scan, and (3) an assessment process with desired outcomes.

Results

The final checklist comprising 21 functional and 6 non-functional criteria was applied to vendor submissions in selecting a platform for creating a ML heparin dosing model as a use case.

Discussion

A team of clinicians, data scientists, and key stakeholders developed a checklist which can be adapted to ML needs of healthcare organizations, the use case providing a relevant example.

Conclusion

An evaluative checklist was developed for selecting Auto ML platforms which requires validation in larger multi-site studies.

Diagnostic performance of machine-learning algorithms for sepsis prediction: An updated meta-analysis

BACKGROUND

Early identification of sepsis has been shown to significantly improve patient prognosis.

OBJECTIVE

Therefore, the aim of this meta-analysis is to systematically evaluate the diagnostic efficacy of machine-learning algorithms for sepsis prediction.

METHODS

Systematic searches were conducted in PubMed, Embase and Cochrane databases, covering literature up to December 2023. The keywords included machine learning, sepsis and prediction. After screening, data were extracted and analysed from studies meeting the inclusion criteria. Key evaluation metrics included sensitivity, specificity and the area under the curve (AUC) for diagnostic accuracy.

RESULTS

The meta-analysis included a total of 21 studies with a data sample size of 4,158,941. Overall, the pooled sensitivity was 0.82 (95% confidence interval [CI] = 0.70-0.90; P< 0.001; I2=99.7%), the specificity was 0.91 (95% CI = 0.86-0.94; P< 0.001; I2= 99.9%), and the AUC was 0.94 (95% CI = 0.91-0.96). The subgroup analysis revealed that in the emergency department setting (6 studies), the pooled sensitivity was 0.79 (95% CI = 0.68-0.87; P< 0.001; I2= 99.6%), the specificity was 0.94 (95% CI 0.90-0.97; P< 0.001; I2= 99.9%), and the AUC was 0.94 (95% CI = 0.92-0.96). In the Intensive Care Unit setting (11 studies), the sensitivity was 0.91 (95% CI = 0.75-0.97; P< 0.001; I2= 98.3%), the specificity was 0.85 (95% CI = 0.75-0.92; P< 0.001; I2= 99.9%), and the AUC was 0.93 (95% CI = 0.91-0.95). Due to the limited number of studies in the in-hospital and mixed settings (n< 3), no pooled analysis was performed.

CONCLUSION

Machine-learning algorithms have demonstrated excellent diagnostic accuracy in predicting the occurrence of sepsis, showing potential for clinical application.

A scoping review of machine learning for sepsis prediction- feature engineering strategies and model performance: a step towards explainability

BACKGROUND

Sepsis, an acute and potentially fatal systemic response to infection, significantly impacts global health by affecting millions annually. Prompt identification of sepsis is vital, as treatment delays lead to increased fatalities through progressive organ dysfunction. While recent studies have delved into leveraging Machine Learning (ML) for predicting sepsis, focusing on aspects such as prognosis, diagnosis, and clinical application, there remains a notable deficiency in the discourse regarding feature engineering. Specifically, the role of feature selection and extraction in enhancing model accuracy has been underexplored.

OBJECTIVES

This scoping review aims to fulfill two primary objectives: To identify pivotal features for predicting sepsis across a variety of ML models, providing valuable insights for future model development, and To assess model efficacy through performance metrics including AUROC, sensitivity, and specificity.

RESULTS

The analysis included 29 studies across diverse clinical settings such as Intensive Care Units (ICU), Emergency Departments, and others, encompassing 1,147,202 patients. The review highlighted the diversity in prediction strategies and timeframes. It was found that feature extraction techniques notably outperformed others in terms of sensitivity and AUROC values, thus indicating their critical role in improving sepsis prediction models.

CONCLUSION

Key dynamic indicators, including vital signs and critical laboratory values, are instrumental in the early detection of sepsis. Applying feature selection methods significantly boosts model precision, with models like Random Forest and XG Boost showing promising results. Furthermore, Deep Learning models (DL) reveal unique insights, spotlighting the pivotal role of feature engineering in sepsis prediction, which could greatly benefit clinical practice.

Early prediction of sepsis-induced respiratory tract infection using a biomarker-based machine-learning algorithm

Early and differential diagnosis of sepsis is essential to avoid unnecessary antibiotic use and further reduce patient morbidity and mortality. Here, we aimed to identify predictors of sepsis and advance a machine-learning strategy to predict sepsis-induced respiratory tract infection (RTI). Patients with sepsis and RTI were selected via retrospective analysis, and essential population characteristics and laboratory parameters were recorded. To improve the performance of the primary model and avoid over-fitting, a recursive feature elimination with cross-validation (RFECV) strategy was used to screen the optimal subset of biomarkers and construct nine machine-learning models based on this subset; the average accuracy, precision, recall, and F1-score were used for evaluation of the models. We identified 430 patients with sepsis and 686 patients with RTI. A total of 39 features were collected, with 23 features identified for initial model construction. Using the RFECV algorithm, we found that the XGBoost classifier, which only needed to include seven biomarkers, demonstrated the best performance among all prediction models, with an average accuracy of 89.24 ± 2.28, while the Ridge classifier, which included 11 biomarkers, had an average accuracy of only 83.87 ± 4.69. The remaining models had prediction accuracies greater than 88%. We developed nine models for predicting sepsis using a strategy that combined RFECV with machine learning. Among these models, the XGBoost classifier, which included seven biomarkers, showed the best performance and highest accuracy for predicting sepsis and may be a promising tool for the timely identification of sepsis.

Harnessing of Artificial Intelligence for the Diagnosis and Prevention of Hospital-Acquired Infections: A Systematic Review

Healthcare-associated infections (HAIs) are the most common adverse events in healthcare and constitute a major global public health concern. Surveillance represents the foundation for the effective prevention and control of HAIs, yet conventional surveillance is costly and labor intensive. Artificial intelligence (AI) and machine learning (ML) have the potential to support the development of HAI surveillance algorithms for the understanding of HAI risk factors, the improvement of patient risk stratification as well as the prediction and timely detection and prevention of infections. AI-supported systems have so far been explored for clinical laboratory testing and imaging diagnosis, antimicrobial resistance profiling, antibiotic discovery and prediction-based clinical decision support tools in terms of HAIs. This review aims to provide a comprehensive summary of the current literature on AI applications in the field of HAIs and discuss the future potentials of this emerging technology in infection practice. Following the PRISMA guidelines, this study examined the articles in databases including PubMed and Scopus until November 2023, which were screened based on the inclusion and exclusion criteria, resulting in 162 included articles. By elucidating the advancements in the field, we aim to highlight the potential applications of AI in the field, report related issues and shortcomings and discuss the future directions.

Leveraging artificial intelligence to advance implementation science: potential opportunities and cautions

BACKGROUND

The field of implementation science was developed to address the significant time delay between establishing an evidence-based practice and its widespread use. Although implementation science has contributed much toward bridging this gap, the evidence-to-practice chasm remains a challenge. There are some key aspects of implementation science in which advances are needed, including speed and assessing causality and mechanisms. The increasing availability of artificial intelligence applications offers opportunities to help address specific issues faced by the field of implementation science and expand its methods.

MAIN TEXT

This paper discusses the many ways artificial intelligence can address key challenges in applying implementation science methods while also considering potential pitfalls to the use of artificial intelligence. We answer the questions of "why" the field of implementation science should consider artificial intelligence, for "what" (the purpose and methods), and the "what" (consequences and challenges). We describe specific ways artificial intelligence can address implementation science challenges related to (1) speed, (2) sustainability, (3) equity, (4) generalizability, (5) assessing context and context-outcome relationships, and (6) assessing causality and mechanisms. Examples are provided from global health systems, public health, and precision health that illustrate both potential advantages and hazards of integrating artificial intelligence applications into implementation science methods. We conclude by providing recommendations and resources for implementation researchers and practitioners to leverage artificial intelligence in their work responsibly.

CONCLUSIONS

Artificial intelligence holds promise to advance implementation science methods ("why") and accelerate its goals of closing the evidence-to-practice gap ("purpose"). However, evaluation of artificial intelligence's potential unintended consequences must be considered and proactively monitored. Given the technical nature of artificial intelligence applications as well as their potential impact on the field, transdisciplinary collaboration is needed and may suggest the need for a subset of implementation scientists cross-trained in both fields to ensure artificial intelligence is used optimally and ethically.

Development of Artificial Intelligence for Determining Major Depressive Disorder Based on Resting-State EEG and Single-Pulse Transcranial Magnetic Stimulation-Evoked EEG Indices

Depression is the disorder with the greatest socioeconomic burdens. Its diagnosis is still based on an operational diagnosis derived from symptoms, and no objective diagnostic indicators exist. Thus, the present study aimed to develop an artificial intelligence (AI) model to aid in the diagnosis of depression from electroencephalography (EEG) data by applying machine learning to resting-state EEG and transcranial magnetic stimulation (TMS)-evoked EEG acquired from patients with depression and healthy controls. Resting-state EEG and single-pulse TMS-EEG were acquired from 60 patients and 60 healthy controls. Power spectrum analysis, phase synchronization analysis, and phase-amplitude coupling analysis were conducted on EEG data to extract feature candidates to apply different types of machine learning algorithms. Furthermore, to address the limitation of the sample size, dimensionality reduction was performed in a manner to increase the quality of information by featuring robust neurophysiological metrics that showed significant differences between the two groups. Then, nine different machine learning models were applied to the data. For the EEG data, we created models combining four modalities, including (1) resting-state EEG, (2) pre-stimulus TMS-EEG, (3) post-stimulus TMS-EEG, and (4) differences between pre- and post-stimulus TMS-EEG, and evaluated their performance. We found that the best estimation performance (a mean area under the curve of 0.922) was obtained using receiver operating characteristic curve analysis when linear discriminant analysis (LDA) was applied to the combination of the four feature sets. This study showed that by using TMS-EEG neurophysiological indices as features, it is possible to develop a depression decision-support AI algorithm that exhibits high discrimination accuracy.

Deep learning-based prediction of in-hospital mortality for sepsis

As a serious blood infection disease, sepsis is characterized by a high mortality risk and many complications. Accurate assessment of mortality risk of patients with sepsis can help physicians in Intensive Care Unit make optimal clinical decisions, which in turn can effectively save patients' lives. However, most of the current clinical models used for assessing mortality risk in sepsis patients are based on conventional indicators. Unfortunately, some of the conventional indicators have been shown to be inapplicable in the accurate clinical diagnosis nowadays. Meanwhile, traditional evaluation models only focus on a small amount of personal data, causing misdiagnosis of sepsis patients. We refine the core indicators for mortality risk assessment of sepsis from massive clinical electronic medical records with machine learning, and propose a new mortality risk assessment model, DGFSD, for sepsis patients based on deep learning. The DGFSD model can not only learn individual clinical information about unassessed patients, but also obtain information about the structure of the similarity graph between diagnosed patients and patients to be assessed. Numerous experiments have shown that the accuracy of the DGFSD model is superior to baseline methods, and can significantly improve the efficiency of clinical auxiliary diagnosis.

An overview of clinical machine learning applications in neurology

Machine learning techniques for clinical applications are evolving, and the potential impact this will have on clinical neurology is important to recognize. By providing a broad overview on this growing paradigm of clinical tools, this article aims to help healthcare professionals in neurology prepare to navigate both the opportunities and challenges brought on through continued advancements in machine learning. This narrative review first elaborates on how machine learning models are organized and implemented. Machine learning tools are then classified by clinical application, with examples of uses within neurology described in more detail. Finally, this article addresses limitations and considerations regarding clinical machine learning applications in neurology.

Predicting prognosis in patients with stroke treated with intravenous alteplase through blood pressure changes: A machine learning-based approach

The use of machine learning (ML) in predicting disease prognosis has increased, and researchers have adopted different methods for variable selection to optimize early screening for AIS to determine its prognosis as soon as possible. We aimed to improve the understanding of the predictors of poor functional outcome at three months after discharge in AIS patients treated with intravenous thrombolysis and to construct a highly effective prognostic model to improve prediction accuracy. And four ML methods (random forest, support vector machine, naive Bayesian, and logistic regression) were used to screen and recombine the features for construction of an ML prognostic model. A total of 352 patients that had experienced AIS and had been treated with intravenous thrombolysis were recruited. The variables included in the model were NIHSS on admission, age, white blood cell count, percentage of neutrophils and triglyceride after thrombolysis, tirofiban, early neurological deterioration, early neurological improvement, and BP at each time point or period. The model's area under the curve for predicting 30-day modified Rankin scale was 0.790 with random forest, 0.542 with support vector machine, 0.411 with naive Bayesian, and 0.661 with logistic regression. The random forest model was shown to accurately evaluate the prognosis of AIS patients treated with intravenous thrombolysis, and therefore they may be helpful for accurate and personalized secondary prevention. The model offers improved prediction accuracy that may reduce rates of misdiagnosis and missed diagnosis in patients with AIS.

The application of artificial intelligence in the management of sepsis

Sepsis is a complex and heterogeneous syndrome that remains a serious challenge to healthcare worldwide. Patients afflicted by severe sepsis or septic shock are customarily placed under intensive care unit (ICU) supervision, where a multitude of apparatus is poised to produce high-granularity data. This reservoir of high-quality data forms the cornerstone for the integration of AI into clinical practice. However, existing reviews currently lack the inclusion of the latest advancements. This review examines the evolving integration of artificial intelligence (AI) in sepsis management. Applications of artificial intelligence include early detection, subtyping analysis, precise treatment and prognosis assessment. AI-driven early warning systems provide enhanced recognition and intervention capabilities, while profiling analyzes elucidate distinct sepsis manifestations for targeted therapy. Precision medicine harnesses the potential of artificial intelligence for pathogen identification, antibiotic selection, and fluid optimization. In conclusion, the seamless amalgamation of artificial intelligence into the domain of sepsis management heralds a transformative shift, ushering in novel prospects to elevate diagnostic precision, therapeutic efficacy, and prognostic acumen. As AI technologies develop, their impact on shaping the future of sepsis care warrants ongoing research and thoughtful implementation.

Machine learning prediction will be part of future treatment of depression

Machine learning (ML) is changing the way that medicine is practiced. While already clinically utilised in diagnostic radiology and outcome prediction in intensive care unit, ML approaches in psychiatry remain nascent. Implementing ML algorithms in psychiatry, particularly in the treatment of depression, is significantly more challenging than other areas of medicine in part because of the less demarcated disease nosology and greater variability in practice. Given the current exiguous capacity of clinicians to predict patient and treatment outcomes in depression, there is a significantly greater need for better predictive capability. Early studies have shown promising results. ML predictions were significantly better than chance within the sequenced treatment alternatives to relieve depression (STAR*D) trial (accuracy 64.6%, p < 0.0001) and combining medications to enhance depression outcomes (COMED) randomised Controlled Trial (RCT) (accuracy 59.6%, p = 0.043), with similar results found in larger scale, retrospective studies. The greater flexibility and dimensionality of ML approaches has been demonstrated in studies incorporating diverse input variables including electroencephalography scans, achieving 88% accuracy for treatment response, and cognitive test scores, achieving up to 72% accuracy for treatment response. The predicting response to depression treatment (PReDicT) trial tested ML informed prescribing of antidepressants against standard therapy and found there was both better outcomes for anxiety and functional endpoints despite the algorithm only having a balanced accuracy of 57.5%. Impeding the progress of ML algorithms in psychiatry are pragmatic hurdles, including accuracy, expense, acceptability and comprehensibility, and ethical hurdles, including medicolegal liability, clinical autonomy and data privacy. Notwithstanding impediments, it is clear that ML prediction algorithms will be part of depression treatment in the future and clinicians should be prepared for their arrival.

Predicting sepsis onset in ICU using machine learning models: a systematic review and meta-analysis

BACKGROUND

Sepsis is a life-threatening condition caused by an abnormal response of the body to infection and imposes a significant health and economic burden worldwide due to its high mortality rate. Early recognition of sepsis is crucial for effective treatment. This study aimed to systematically evaluate the performance of various machine learning models in predicting the onset of sepsis.

METHODS

We conducted a comprehensive search of the Cochrane Library, PubMed, Embase, and Web of Science databases, covering studies from database inception to November 14, 2022. We used the PROBAST tool to assess the risk of bias. We calculated the predictive performance for sepsis onset using the C-index and accuracy. We followed the PRISMA guidelines for this study.

RESULTS

We included 23 eligible studies with a total of 4,314,145 patients and 26 different machine learning models. The most frequently used models in the studies were random forest (n = 9), extreme gradient boost (n = 7), and logistic regression (n = 6) models. The random forest (test set n = 9, acc = 0.911) and extreme gradient boost (test set n = 7, acc = 0.957) models were the most accurate based on our analysis of the predictive performance. In terms of the C-index outcome, the random forest (n = 6, acc = 0.79) and extreme gradient boost (n = 7, acc = 0.83) models showed the highest performance.

CONCLUSION

Machine learning has proven to be an effective tool for predicting sepsis at an early stage. However, to obtain more accurate results, additional machine learning methods are needed. In our research, we discovered that the XGBoost and random forest models exhibited the best predictive performance and were most frequently utilized for predicting the onset of sepsis.

TRIAL REGISTRATION

CRD42022384015.

Machine learning models for predicting the risk factor of carotid plaque in cardiovascular disease

Introduction

Cardiovascular disease (CVD) is a group of diseases involving the heart or blood vessels and represents a leading cause of death and disability worldwide. Carotid plaque is an important risk factor for CVD that can reflect the severity of atherosclerosis. Accordingly, developing a prediction model for carotid plaque formation is essential to assist in the early prevention and management of CVD.

Methods

In this study, eight machine learning algorithms were established, and their performance in predicting carotid plaque risk was compared. Physical examination data were collected from 4,659 patients and used for model training and validation. The eight predictive models based on machine learning algorithms were optimized using the above dataset and 10-fold cross-validation. The Shapley Additive Explanations (SHAP) tool was used to compute and visualize feature importance. Then, the performance of the models was evaluated according to the area under the receiver operating characteristic curve (AUC), feature importance, accuracy and specificity.

Results

The experimental results indicated that the XGBoost algorithm outperformed the other machine learning algorithms, with an AUC, accuracy and specificity of 0.808, 0.749 and 0.762, respectively. Moreover, age, smoke, alcohol drink and BMI were the top four predictors of carotid plaque formation. It is feasible to predict carotid plaque risk using machine learning algorithms.

Conclusions

This study indicates that our models can be applied to routine chronic disease management procedures to enable more preemptive, broad-based screening for carotid plaque and improve the prognosis of CVD patients.

Construction and validation of machine learning models for sepsis prediction in patients with acute pancreatitis

BACKGROUND

This study aimed to construct predictive models for the risk of sepsis in patients with Acute pancreatitis (AP) using machine learning methods and compared optimal one with the logistic regression (LR) model and scoring systems.

METHODS

In this retrospective cohort study, data were collected from the Medical Information Mart for Intensive Care III (MIMIC III) database between 2001 and 2012 and the MIMIC IV database between 2008 and 2019. Patients were randomly divided into training and test sets (8:2). The least absolute shrinkage and selection operator (LASSO) regression plus 5-fold cross-validation were used to screen and confirm the predictive factors. Based on the selected predictive factors, 6 machine learning models were constructed, including support vector machine (SVM), K-nearest neighbour (KNN), multi-layer perceptron (MLP), LR, gradient boosting decision tree (GBDT) and adaptive enhancement algorithm (AdaBoost). The models and scoring systems were evaluated and compared using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, and the area under the curve (AUC).

RESULTS

A total of 1, 672 patients were eligible for participation. In the training set, 261 AP patients (19.51%) were diagnosed with sepsis. The predictive factors for the risk of sepsis in AP patients included age, insurance, vasopressors, mechanical ventilation, Glasgow Coma Scale (GCS), heart rate, respiratory rate, temperature, SpO2, platelet, red blood cell distribution width (RDW), International Normalized Ratio (INR), and blood urea nitrogen (BUN). The AUC of the GBDT model for sepsis prediction in the AP patients in the testing set was 0.985. The GBDT model showed better performance in sepsis prediction than the LR, systemic inflammatory response syndrome (SIRS) score, bedside index for severity in acute pancreatitis (BISAP) score, sequential organ failure assessment (SOFA) score, quick-SOFA (qSOFA), and simplified acute physiology score II (SAPS II).

CONCLUSION

The present findings suggest that compared to the classical LR model and SOFA, qSOFA, SAPS II, SIRS, and BISAP scores, the machine learning model-GBDT model had a better performance in predicting sepsis in the AP patients, which is a useful tool for early identification of high-risk patients and timely clinical interventions.

Machine Learning-Based Early Prediction of Sepsis Using Electronic Health Records: A Systematic Review

BACKGROUND

Sepsis, a life-threatening infection-induced inflammatory condition, has significant global health impacts. Timely detection is crucial for improving patient outcomes as sepsis can rapidly progress to severe forms. The application of machine learning (ML) and deep learning (DL) to predict sepsis using electronic health records (EHRs) has gained considerable attention for timely intervention.

METHODS

PubMed, IEEE Xplore, Google Scholar, and Scopus were searched for relevant studies. All studies that used ML/DL to detect or early-predict the onset of sepsis in the adult population using EHRs were considered. Data were extracted and analyzed from all studies that met the criteria and were also evaluated for their quality.

RESULTS

This systematic review examined 1942 articles, selecting 42 studies while adhering to strict criteria. The chosen studies were predominantly retrospective (n = 38) and spanned diverse geographic settings, with a focus on the United States. Different datasets, sepsis definitions, and prevalence rates were employed, necessitating data augmentation. Heterogeneous parameter utilization, diverse model distribution, and varying quality assessments were observed. Longitudinal data enabled early sepsis prediction, and quality criteria fulfillment varied, with inconsistent funding-article quality correlation.

CONCLUSIONS

This systematic review underscores the significance of ML/DL methods for sepsis detection and early prediction through EHR data.

A systematic comparison of machine learning algorithms to develop and validate prediction model to predict heart failure risk in middle-aged and elderly patients with periodontitis (NHANES 2009 to 2014)

Periodontitis is increasingly associated with heart failure, and the goal of this study was to develop and validate a prediction model based on machine learning algorithms for the risk of heart failure in middle-aged and elderly participants with periodontitis. We analyzed data from a total of 2876 participants with a history of periodontitis from the National Health and Nutrition Examination Survey (NHANES) 2009 to 2014, with a training set of 1980 subjects with periodontitis from the NHANES 2009 to 2012 and an external validation set of 896 subjects from the NHANES 2013 to 2014. The independent risk factors for heart failure were identified using univariate and multivariate logistic regression analysis. Machine learning algorithms such as logistic regression, k-nearest neighbor, support vector machine, random forest, gradient boosting machine, and multilayer perceptron were used on the training set to construct the models. The performance of the machine learning models was evaluated using 10-fold cross-validation on the training set and receiver operating characteristic curve (ROC) analysis in the validation set. Based on the results of univariate logistic regression and multivariate logistic regression, it was found that age, race, myocardial infarction, and diabetes mellitus status were independent predictors of the risk of heart failure in participants with periodontitis. Six machine learning models, including logistic regression, K-nearest neighbor, support vector machine, random forest, gradient boosting machine, and multilayer perceptron, were built on the training set, respectively. The area under the ROC for the 6 models was obtained using 10-fold cross-validation with values of 0 848, 0.936, 0.859, 0.889, 0.927, and 0.666, respectively. The areas under the ROC on the external validation set were 0.854, 0.949, 0.647, 0.933, 0.855, and 0.74, respectively. K-nearest neighbor model got the best prediction performance across all models. Out of 6 machine learning models, the K-nearest neighbor algorithm model performed the best. The prediction model offers early, individualized diagnosis and treatment plans and assists in identifying the risk of heart failure occurrence in middle-aged and elderly patients with periodontitis.

A predictive model for the risk of sepsis within 30 days of admission in patients with traumatic brain injury in the intensive care unit: a retrospective analysis based on MIMIC-IV database

PURPOSE

Traumatic brain injury (TBI) patients admitted to the intensive care unit (ICU) are at a high risk of infection and sepsis. However, there are few studies on predicting secondary sepsis in TBI patients in the ICU. This study aimed to build a prediction model for the risk of secondary sepsis in TBI patients in the ICU, and provide effective information for clinical diagnosis and treatment.

METHODS

Using the MIMIC IV database version 2.0 (Medical Information Mart for Intensive Care IV), we searched data on TBI patients admitted to ICU and considered them as a study cohort. The extracted data included patient demographic information, laboratory indicators, complications, and other clinical data. The study cohort was divided into a training cohort and a validation cohort. In the training cohort, variables were screened by LASSO (Least absolute shrinkage and selection operator) regression and stepwise Logistic regression to assess the predictive ability of each feature on the incidence of patients. The screened variables were included in the final Logistic regression model. Finally, the decision curve, calibration curve, and receiver operating character (ROC) were used to test the performance of the model.

RESULTS

Finally, a total of 1167 patients were included in the study, and these patients were randomly divided into the training (N = 817) and validation (N = 350) cohorts at a ratio of 7:3. In the training cohort, seven features were identified as key predictors of secondary sepsis in TBI patients in the ICU, including acute kidney injury (AKI), anemia, invasive ventilation, GCS (Glasgow Coma Scale) score, lactic acid, and blood calcium level, which were included in the final model. The areas under the ROC curve in the training cohort and the validation cohort were 0.756 and 0.711, respectively. The calibration curve and ROC curve show that the model has favorable predictive accuracy, while the decision curve shows that the model has favorable clinical benefits with good and robust predictive efficiency.

CONCLUSION

We have developed a nomogram model for predicting secondary sepsis in TBI patients admitted to the ICU, which can provide useful predictive information for clinical decision-making.

Integrative single-cell RNA sequencing and metabolomics decipher the imbalanced lipid-metabolism in maladaptive immune responses during sepsis

Background

To identify differentially expressed lipid metabolism-related genes (DE-LMRGs) responsible for immune dysfunction in sepsis.

Methods

The lipid metabolism-related hub genes were screened using machine learning algorithms, and the immune cell infiltration of these hub genes were assessed by CIBERSORT and Single-sample GSEA. Next, the immune function of these hub genes at the single-cell level were validated by comparing multiregional immune landscapes between septic patients (SP) and healthy control (HC). Then, the support vector machine-recursive feature elimination (SVM-RFE) algorithm was conducted to compare the significantly altered metabolites critical to hub genes between SP and HC. Furthermore, the role of the key hub gene was verified in sepsis rats and LPS-induced cardiomyocytes, respectively.

Results

A total of 508 DE-LMRGs were identified between SP and HC, and 5 hub genes relevant to lipid metabolism (MAPK14, EPHX2, BMX, FCER1A, and PAFAH2) were screened. Then, we found an immunosuppressive microenvironment in sepsis. The role of hub genes in immune cells was further confirmed by the single-cell RNA landscape. Moreover, significantly altered metabolites were mainly enriched in lipid metabolism-related signaling pathways and were associated with MAPK14. Finally, inhibiting MAPK14 decreased the levels of inflammatory cytokines and improved the survival and myocardial injury of sepsis.

Conclusion

The lipid metabolism-related hub genes may have great potential in prognosis prediction and precise treatment for sepsis patients.

Artificial intelligence for clinical decision support for monitoring patients in cardiovascular ICUs: A systematic review

Background

Artificial intelligence (AI) and machine learning (ML) models continue to evolve the clinical decision support systems (CDSS). However, challenges arise when it comes to the integration of AI/ML into clinical scenarios. In this systematic review, we followed the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA), the population, intervention, comparator, outcome, and study design (PICOS), and the medical AI life cycle guidelines to investigate studies and tools which address AI/ML-based approaches towards clinical decision support (CDS) for monitoring cardiovascular patients in intensive care units (ICUs). We further discuss recent advances, pitfalls, and future perspectives towards effective integration of AI into routine practices as were identified and elaborated over an extensive selection process for state-of-the-art manuscripts.

Methods

Studies with available English full text from PubMed and Google Scholar in the period from January 2018 to August 2022 were considered. The manuscripts were fetched through a combination of the search keywords including AI, ML, reinforcement learning (RL), deep learning, clinical decision support, and cardiovascular critical care and patients monitoring. The manuscripts were analyzed and filtered based on qualitative and quantitative criteria such as target population, proper study design, cross-validation, and risk of bias.

Results

More than 100 queries over two medical search engines and subjective literature research were developed which identified 89 studies. After extensive assessments of the studies both technically and medically, 21 studies were selected for the final qualitative assessment.

Discussion

Clinical time series and electronic health records (EHR) data were the most common input modalities, while methods such as gradient boosting, recurrent neural networks (RNNs) and RL were mostly used for the analysis. Seventy-five percent of the selected papers lacked validation against external datasets highlighting the generalizability issue. Also, interpretability of the AI decisions was identified as a central issue towards effective integration of AI in healthcare.

Diagnostic performance of machine learning models using cell population data for the detection of sepsis: a comparative study

OBJECTIVES

To compare the artificial intelligence algorithms as powerful machine learning methods for evaluating patients with suspected sepsis using data from routinely available blood tests performed on arrival at the hospital. Results were compared with those obtained from the classical logistic regression method.

METHODS

The study group consisted of consecutive patients with fever and suspected infection admitted to the Emergency Department. The complete blood counts (CBC) were acquired using the Mindray BC-6800 Plus analyser (Mindray Diagnostics, Shenzhen, China). Cell Population Data (CPD) were also recorded. The ML and artificial intelligence (AI) models were developed; their performance was evaluated using several indicators, such as the area under the receiver operating curve (AUC), calibration plots and decision curve analysis (DCA).

RESULTS

Overall, all the tested approaches obtained an AUC>0.90. The logistic regression (LR) performed well compared to the ML/AI models. The naïve Bayes and the K-nearest neighbour (KNN) methods did not show good calibration properties. The multi-layer perceptron (MLP) model was the best in terms of discrimination, calibration and clinical usefulness.

CONCLUSIONS

The best performance in the early detection of sepsis was achieved using the ML and AI models. However, external validation studies are needed to strengthen model derivation and procedure updating.

Early prediction of sepsis using double fusion of deep features and handcrafted features

Sepsis is a life-threatening medical condition that is characterized by the dysregulated immune system response to infections, having both high morbidity and mortality rates. Early prediction of sepsis is critical to the decrease of mortality. This paper presents a novel early warning model called Double Fusion Sepsis Predictor (DFSP) for sepsis onset. DFSP is a double fusion framework that combines the benefits of early and late fusion strategies. First, a hybrid deep learning model that combines both the convolutional and recurrent neural networks to extract deep features is proposed. Second, deep features and handcrafted features, such as clinical scores, are concatenated to build the joint feature representation (early fusion). Third, several tree-based models based on joint feature representation are developed to generate the risk scores of sepsis onset that are combined with an End-to-End neural network for final sepsis detection (late fusion). To evaluate DFSP, a retrospective study was conducted, which included patients admitted to the ICUs of a hospital in Shanghai China. The results demonstrate that the DFSP outperforms state-of-the-art approaches in early sepsis prediction.

Research frontiers and trends in the application of artificial intelligence to sepsis: A bibliometric analysis

Background

With the increasing interest of academics in the application of artificial intelligence to sepsis, thousands of papers on this field had been published in the past few decades. It is difficult for researchers to understand the themes and latest research frontiers in this field from a multi-dimensional perspective. Consequently, the purpose of this study is to analyze the relevant literature in the application of artificial intelligence to sepsis through bibliometrics software, so as to better understand the development status, study the core hotspots and future development trends of this field.

Methods

We collected relevant publications in the application of artificial intelligence to sepsis from the Web of Science Core Collection in 2000 to 2021. The type of publication was limited to articles and reviews, and language was limited to English. Research cooperation network, journals, cited references, keywords in this field were visually analyzed by using CiteSpace, VOSviewer, and COOC software.

Results

A total of 8,481 publications in the application of artificial intelligence to sepsis between 2000 and 2021 were included, involving 8,132 articles and 349 reviews. Over the past 22 years, the annual number of publications had gradually increased exponentially. The USA was the most productive country, followed by China. Harvard University, Schuetz, Philipp, and Intensive Care Medicine were the most productive institution, author, and journal, respectively. Vincent, Jl and Critical Care Medicine were the most cited author and cited journal, respectively. Several conclusions can be drawn from the analysis of the cited references, including the following: screening and identification of sepsis biomarkers, treatment and related complications of sepsis, and precise treatment of sepsis. Moreover, there were a spike in searches relating to machine learning, antibiotic resistance and accuracy based on burst detection analysis.

Conclusion

This study conducted a comprehensive and objective analysis of the publications on the application of artificial intelligence in sepsis. It can be predicted that precise treatment of sepsis through machine learning technology is still research hotspot in this field.

Development of a Nomogram for Predicting Mortality Risk in Sepsis Patients During Hospitalization: A Retrospective Study

Purpose

We attempted to establish a model for predicting the mortality risk of sepsis patients during hospitalization.

Patients and Methods

Data on patients with sepsis were collected from a clinical record mining database, who were hospitalized at the Affiliated Dongyang Hospital of Wenzhou Medical University between January 2013 and August 2022. These included patients were divided into modeling and validation groups. In the modeling group, the independent risk factors of death during hospitalization were determined using univariate and multi-variate regression analyses. After stepwise regression analysis (both directions), a nomogram was drawn. The discrimination ability of the model was evaluated using the area under the curve (AUC) of the receiver operating characteristic (ROC) curve, and the GiViTI calibration chart assessed the model calibration. The Decline Curve Analysis (DCA) was performed to evaluate the clinical effectiveness of the prediction model. Among the validation group, the logistic regression model was compared to the models established by the SOFA scoring system, random forest method, and stacking method.

Results

A total of 1740 subjects were included in this study, 1218 in the modeling population and 522 in the validation population. The results revealed that serum cholinesterase, total bilirubin, respiratory failure, lactic acid, creatinine, and pro-brain natriuretic peptide were the independent risk factors of death. The AUC values in the modeling group and validation group were 0.847 and 0.826. The P values of calibration charts in the two population sets were 0.838 and 0.771. The DCA curves were above the two extreme curves. Moreover, the AUC values of the models established by the SOFA scoring system, random forest method, and stacking method in the validation group were 0.777, 0.827, and 0.832, respectively.

Conclusion

The nomogram model established by combining multiple risk factors could effectively predict the mortality risk of sepsis patients during hospitalization.

In-Hospital Mortality of Sepsis Differs Depending on the Origin of Infection: An Investigation of Predisposing Factors

Sepsis is a heterogeneous syndrome characterized by a variety of clinical features. Analysis of large clinical datasets may serve to define groups of sepsis with different risks of adverse outcomes. Clinical experience supports the concept that prognosis, treatment, severity, and time course of sepsis vary depending on the source of infection. We analyzed a large publicly available database to test this hypothesis. In addition, we developed prognostic models for the three main types of sepsis: pulmonary, urinary, and abdominal sepsis. We used logistic regression using routinely available clinical data for mortality prediction in each of these groups. The data was extracted from the eICU collaborative research database, a multi-center intensive care unit with over 200,000 admissions. Sepsis cohorts were defined using admission diagnosis codes. We used univariate and multivariate analyses to establish factors relevant for outcome prediction in all three cohorts of sepsis (pulmonary, urinary and abdominal). For logistic regression, input variables were automatically selected using a sequential forward search algorithm over 10 dataset instances. Receiver operator characteristics were generated for each model and compared with established prognostication tools (APACHE IV and SOFA). A total of 3,958 sepsis admissions were included in the analysis. Sepsis in-hospital mortality differed depending on the cause of infection: abdominal 18.93%, pulmonary 19.27%, and renal 12.81%. Higher average heart rate was associated with increased mortality risk. Increased average Mean Arterial Pressure (MAP) showed a reduced mortality risk across all sepsis groups. Results from the LR models found significant factors that were relevant for specific sepsis groups. Our models outperformed APACHE IV and SOFA scores with AUC between 0.63 and 0.74. Predictive power decreased over time, with the best results achieved for data extracted for the first 24 h of admission. Mortality varied significantly between the three sepsis groups. We also demonstrate that factors of importance show considerable heterogeneity depending on the source of infection. The factors influencing in-hospital mortality vary depending on the source of sepsis which may explain why most sepsis trials have failed to identify an effective treatment. The source of infection should be considered when considering mortality risk. Planning of sepsis treatment trials may benefit from risk stratification based on the source of infection.

Machine Learning and Antibiotic Management

Machine learning and cluster analysis applied to the clinical setting of an intensive care unit can be a valuable aid for clinical management, especially with the increasing complexity of clinical monitoring. Providing a method to measure clinical experience, a proxy for that automatic gestalt evaluation that an experienced clinician sometimes effortlessly, but often only after long, hard consideration and consultation with colleagues, relies upon for decision making, is what we wanted to achieve with the application of machine learning to antibiotic therapy and clinical monitoring in the present work. This is a single-center retrospective analysis proposing methods for evaluation of vitals and antimicrobial therapy in intensive care patients. For each patient included in the present study, duration of antibiotic therapy, consecutive days of treatment and type and combination of antimicrobial agents have been assessed and considered as single unique daily record for analysis. Each parameter, composing a record was normalized using a fuzzy logic approach and assigned to five descriptive categories (fuzzy domain sub-sets ranging from “very low” to “very high”). Clustering of these normalized therapy records was performed, and each patient/day was considered to be a pertaining cluster. The same methodology was used for hourly bed-side monitoring. Changes in patient conditions (monitoring) can lead to a shift of clusters. This can provide an additional tool for assessing progress of complex patients. We used Fuzzy logic normalization to descriptive categories of parameters as a form nearer to human language than raw numbers.

Prediction Model of Immunosuppressive Medication Non-adherence for Renal Transplant Patients Based on Machine Learning Technology

Objectives

Predicting adherence to immunosuppressive medication (IM) is important to improve and design future prospective, personalized interventions in Chinese renal transplant patients (RTPs).

Methods

A retrospective, multicenter, cross-sectional study was performed in 1,191 RTPs from October 2020 to February 2021 in China. The BAASIS was used as the standard to determine the adherence of the patients. Variables of the combined theory, including the general data, the HBM, the TPB, the BMQ, the PSSS and the GSES, were used to build the models. The machine learning (ML) models included LR, RF, MLP, SVM, and XG Boost. The SHAP method was used to evaluate the contribution of predictors to predicting the risk of IM non-adherence in RTPs.

Results

The IM non-adherence rate in the derivation cohort was 38.5%. Ten predictors were screened to build the model based on the database. The SVM model performed better among the five models, with sensitivity of 0.59, specificity of 0.73, and average AUC of 0.75. The SHAP analysis showed that age, marital status, HBM-perceived barriers, use pill box after transplantation, and PSSS-family support were the most important predictors in the prediction model. All of the models had good performance validated by external data.

Conclusions

The IM non-adherence rate of RTPs was high, and it is important to improve IM adherence. The model developed by ML technology could identify high-risk patients and provide a basis for the development of relevant improvement measures.

Effective prediction model for preventing postoperative deep vein thrombosis during bladder cancer treatment

Objective

To begin to understand how to prevent deep vein thrombosis (DVT) after an innovative operation termed intracorporeal laparoscopic reconstruction of detenial sigmoid neobladder, we explored the factors that influence DVT following surgery, with the aim of constructing a model for predicting DVT occurrence.

Methods

This retrospective study included 151 bladder cancer patients who underwent intracorporeal laparoscopic reconstruction of detenial sigmoid neobladder. Data describing general clinical characteristics and other common parameters were collected and analyzed. Thereafter, we generated model evaluation curves and finally cross-validated their extrapolations.

Results

Age and body mass index were risk factors for DVT, whereas postoperative use of hemostatic agents and postoperative passive muscle massage were significant protective factors. Model evaluation curves showed that the model had high accuracy and little bias. Cross-validation affirmed the accuracy of our model.

Conclusion

The prediction model constructed herein was highly accurate and had little bias; thus, it can be used to predict the likelihood of developing DVT after surgery.