Early Detection of Sepsis With Machine Learning Techniques: A Brief Clinical Perspective

Investigating computational models for diagnosis and prognosis of sepsis based on clinical parameters: Opportunities, challenges, and future research directions

This study investigates the use of computational frameworks for sepsis. We consider two dimensions for investigation - early diagnosis of sepsis (EDS) and mortality prediction rate for sepsis patients (MPS). We concentrate on the clinical parameters on which sepsis diagnosis and prognosis are currently done, including customized treatment plans based on historical data of the patient. We identify the most notable literature that uses computational models to address EDS and MPS based on those clinical parameters. In addition to the review of the computational models built upon the clinical parameters, we also provide details regarding the popular publicly available data sources. We provide brief reviews for each model in terms of prior art and present an analysis of their results, as claimed by the respective authors. With respect to the use of machine learning models, we have provided avenues for model analysis in terms of model selection, model validation, model interpretation, and model comparison. We further present the challenges and limitations of the use of computational models, providing future research directions. This study intends to serve as a benchmark for first-hand impressions on the use of computational models for EDS and MPS of sepsis, along with the details regarding which model has been the most promising to date. We have provided details regarding all the ML models that have been used to date for EDS and MPS of sepsis.

Artificial intelligence and prescription of antibiotic therapy: present and future

INTRODUCTION

In the past few years, the use of artificial intelligence in healthcare has grown exponentially. Prescription of antibiotics is not exempt from its rapid diffusion, and various machine learning (ML) techniques, from logistic regression to deep neural networks and large language models, have been explored in the literature to support decisions regarding antibiotic prescription.

AREAS COVERED

In this narrative review, we discuss promises and challenges of the application of ML-based clinical decision support systems (ML-CDSSs) for antibiotic prescription. A search was conducted in PubMed up to April 2024.

EXPERT OPINION

Prescribing antibiotics is a complex process involving various dynamic phases. In each of these phases, the support of ML-CDSSs has shown the potential, and also the actual ability in some studies, to favorably impacting relevant clinical outcomes. Nonetheless, before widely exploiting this massive potential, there are still crucial challenges ahead that are being intensively investigated, pertaining to the transparency of training data, the definition of the sufficient degree of prediction explanations when predictions are obtained through black box models, and the legal and ethical framework for decision responsibility whenever an antibiotic prescription is supported by ML-CDSSs.

Prediction of candidemia with machine learning techniques: state of the art

In this narrative review, we discuss studies assessing the use of machine learning (ML) models for the early diagnosis of candidemia, focusing on employed models and the related implications. There are currently few studies evaluating ML techniques for the early diagnosis of candidemia as a prediction task based on clinical and laboratory features. The use of ML tools holds promise to provide highly accurate and real-time support to clinicians for relevant therapeutic decisions at the bedside of patients with suspected candidemia. However, further research is needed in terms of sample size, data quality, recognition of biases and interpretation of model outputs by clinicians to better understand if and how these techniques could be safely adopted in daily clinical practice.

Applying Machine Learning to Blood Count Data Predicts Sepsis with ICU Admission

BACKGROUND

Timely diagnosis is crucial for sepsis treatment. Current machine learning (ML) models suffer from high complexity and limited applicability. We therefore created an ML model using only complete blood count (CBC) diagnostics.

METHODS

We collected non-intensive care unit (non-ICU) data from a German tertiary care centre (January 2014 to December 2021). Using patient age, sex, and CBC parameters (haemoglobin, platelets, mean corpuscular volume, white and red blood cells), we trained a boosted random forest, which predicts sepsis with ICU admission. Two external validations were conducted using data from another German tertiary care centre and the Medical Information Mart for Intensive Care IV database (MIMIC-IV). Using the subset of laboratory orders also including procalcitonin (PCT), an analogous model was trained with PCT as an additional feature.

RESULTS

After exclusion, 1 381 358 laboratory requests (2016 from sepsis cases) were available. The CBC model shows an area under the receiver operating characteristic (AUROC) of 0.872 (95% CI, 0.857-0.887). External validations show AUROCs of 0.805 (95% CI, 0.787-0.824) for University Medicine Greifswald and 0.845 (95% CI, 0.837-0.852) for MIMIC-IV. The model including PCT revealed a significantly higher AUROC (0.857; 95% CI, 0.836-0.877) than PCT alone (0.790; 95% CI, 0.759-0.821; P < 0.001).

CONCLUSIONS

Our results demonstrate that routine CBC results could significantly improve diagnosis of sepsis when combined with ML. The CBC model can facilitate early sepsis prediction in non-ICU patients with high robustness in external validations. Its implementation in clinical decision support systems has strong potential to provide an essential time advantage and increase patient safety.

Subtle variation in sepsis-III definitions markedly influences predictive performance within and across methods

Early detection of sepsis is key to ensure timely clinical intervention. Since very few end-to-end pipelines are publicly available, fair comparisons between methodologies are difficult if not impossible. Progress is further limited by discrepancies in the reconstruction of sepsis onset time. This retrospective cohort study highlights the variation in performance of predictive models under three subtly different interpretations of sepsis onset from the sepsis-III definition and compares this against inter-model differences. The models are chosen to cover tree-based, deep learning, and survival analysis methods. Using the MIMIC-III database, between 867 and 2178 intensive care unit admissions with sepsis were identified, depending on the onset definition. We show that model performance can be more sensitive to differences in the definition of sepsis onset than to the model itself. Given a fixed sepsis definition, the best performing method had a gain of 1-5% in the area under the receiver operating characteristic (AUROC). However, the choice of onset time can cause a greater effect, with variation of 0-6% in AUROC. We illustrate that misleading conclusions can be drawn if models are compared without consideration of the sepsis definition used which emphasizes the need for a standardized definition for sepsis onset.

Machine learning algorithms in sepsis

Sepsis remains a significant global health challenge due to its high mortality and morbidity, compounded by the difficulty of early detection given its variable clinical manifestations. The integration of machine learning (ML) into laboratory medicine for timely sepsis identification and outcome forecasting is an emerging field of interest. This comprehensive review assesses the current body of research on ML applications for sepsis within the realm of laboratory diagnostics, detailing both their strengths and shortcomings. An extensive literature search was performed by two independent investigators across PubMed and Scopus databases, employing the keywords "Sepsis," "Machine Learning," and "Laboratory" without publication date limitations, culminating in January 2023. Each selected study was meticulously evaluated for various aspects, including its design, intent (diagnostic or prognostic), clinical environment, demographics, sepsis criteria, data gathering period, and the scope and nature of features, in addition to the ML methodologies and their validation procedures. Out of 135 articles reviewed, 39 fulfilled the criteria for inclusion. Among these, the majority (30 studies) were focused on devising ML algorithms for diagnosis, fewer (8 studies) on prognosis, and one study addressed both aspects. The dissemination of these studies across an array of journals reflects the interdisciplinary engagement in the development of ML algorithms for sepsis. This analysis highlights the promising role of ML in the early diagnosis of sepsis while drawing attention to the need for uniformity in validating models and defining features, crucial steps for ensuring the reliability and practicality of ML in clinical setting.

Optimizing artificial intelligence in sepsis management: Opportunities in the present and looking closely to the future

Sepsis remains a major challenge internationally for healthcare systems. Its incidence is rising due to poor public awareness and delays in its recognition and subsequent management. In sepsis, mortality increases with every hour left untreated. Artificial intelligence (AI) is transforming worldwide healthcare delivery at present. This review has outlined how AI can augment strategies to address this global disease burden. AI and machine learning (ML) algorithms can analyze vast quantities of increasingly complex clinical datasets from electronic medical records to assist clinicians in diagnosing and treating sepsis earlier than traditional methods. Our review highlights how these models can predict the risk of sepsis and organ failure even before it occurs. This gives providers additional time to plan and execute treatment plans, thereby avoiding increasing complications associated with delayed diagnosis of sepsis. The potential for cost savings with AI implementation is also discussed, including improving workflow efficiencies, reducing administrative costs, and improving healthcare outcomes. Despite these advantages, clinicians have been slow to adopt AI into clinical practice. Some of the limitations posed by AI solutions include the lack of diverse data sets for model building so that they are widely applicable for routine clinical use. Furthermore, the subsequent algorithms are often based on complex mathematics leading to clinician hesitancy to embrace such technologies. Finally, we highlight the need for robust political and regulatory frameworks in this area to achieve the trust and approval of clinicians and patients to implement this transformational technology.

Early diagnosis of candidemia with explainable machine learning on automatically extracted laboratory and microbiological data: results of the AUTO-CAND project

BACKGROUND

Candidemia is associated with a heavy burden of morbidity and mortality in hospitalized patients. The availability of blood culture results could require up to 48-72 h after blood draw; thus, early treatment decisions are made in the absence of a definite diagnosis.

METHODS

In this retrospective study, we assessed the performance of different supervised machine learning algorithms for the early differential diagnosis of candidemia and bacteremia in adult patients on a large dataset automatically extracted within the AUTO-CAND project.

RESULTS

Overall, 12,483 episodes of candidemia (1275; 10%) or bacteremia (11,208; 90%) were included in the analysis. A random forest classifier achieved the best diagnostic performance for candidemia, with sensitivity 0.98 and specificity 0.65 on the training set (true skill statistic [TSS] = 0.63) and sensitivity 0.74 and specificity 0.57 on the test set (TSS = 0.31). Then, the random classifier was trained in the subgroup of patients with available serum β-D-glucan (BDG) and procalcitonin (PCT) values by exploiting the feature ranking learned in the entire dataset. Although no statistically significant differences were observed from the performance measures obtained by employing BDG and PCT alone, the performance measures of the classifier that included the features selected in the entire dataset, plus BDG and PCT, were the highest in most cases.

CONCLUSIONS

Random forest classifiers trained on large datasets of automatically extracted data have the potential to improve current diagnostic algorithms for candidemia. However, further development through implementation of automatically extracted clinical features may be necessary to achieve crucial improvements.

Explainable artificial intelligence and machine learning: novel approaches to face infectious diseases challenges

Artificial intelligence (AI) and machine learning (ML) are revolutionizing human activities in various fields, with medicine and infectious diseases being not exempt from their rapid and exponential growth. Furthermore, the field of explainable AI and ML has gained particular relevance and is attracting increasing interest. Infectious diseases have already started to benefit from explainable AI/ML models. For example, they have been employed or proposed to better understand complex models aimed at improving the diagnosis and management of coronavirus disease 2019, in the field of antimicrobial resistance prediction and in quantum vaccine algorithms. Although some issues concerning the dichotomy between explainability and interpretability still require careful attention, an in-depth understanding of how complex AI/ML models arrive at their predictions or recommendations is becoming increasingly essential to properly face the growing challenges of infectious diseases in the present century.

Platelet count predicts mortality in patients with sepsis: A retrospective observational study

Platelet count is a key component of sepsis severity score. However, the predictive value of the platelet count at admission for mortality in sepsis remains unclear. We designed a retrospective observational study of patients with sepsis admitted to our hospital from January 2017 to September 2021 to explore the predictive value of platelet count at admission for mortality. A total of 290 patients with sepsis were included in this study. Multivariate logistic regression analysis was used to evaluate the risk factors for mortality and construct a predictive model with statistically significant factors. Compared with survivors, nonsurvivors tended to be much older and had significantly higher acute physiology and chronic health evaluation II and sequential organ failure assessment scores (P < .001). The platelet count was significantly lower in the nonsurvivor group than in the survivor group (P < .001). Multivariate logistic regression analysis indicated that age (P = .003), platelet count (P < .001) and lactate level (P = .018) were independent risk factors for mortality in patients with sepsis. Finally, the area under the receiver operating characteristic curve of platelet count predicting mortality in sepsis was 0.763 (95% confidence interval, 0.709-0.817, P < .001), with a sensitivity of 55.6% and a specificity of 91.8%. In our study, platelet count at admission as a single biomarker showed good predictability for mortality in patients with sepsis.

Using machine learning for process improvement in sepsis management

INTRODUCTION

In the U.S., sepsis afflicts 1.7 million adults, causing 270,000 deaths each year. Early detection of sepsis could decrease the number of deaths by 92,000 annually and decrease hospital expenditures by 1.5 billion USD. Few prior studies and reviews have presented a holistic understanding of the relationship between machine learning and existing process improvement measures. This study, in addition to discussing machine learning and existing process improvements measures, elaborates on the disadvantages and the barriers to integrating machine learning into the clinic. This article synthesizes previous studies to educate healthcare professionals on effectively managing sepsis by leveraging the benefits of machine learning.

METHODS

This study used the PubMed database. Search terms include sepsis antibiotics, sepsis process improvement, sepsis machine learning. Our search criteria included previous studies published between January 1, 2017, and February 1, 2022.

RESULTS/DISCUSSION

Although machine learning algorithms have better predictive capabilities, their effectiveness in the clinical setting is limited as studies show mixed results because the medical staff often fails to intervene. To overcome poor interventional response, clinicians need to work with the facility's IT department to ensure integration into clinical workflow and minimize alert-fatigue. Algorithms should enhance the productivity of clinical teams, not attempt to replace them entirely.

CONCLUSION

Hospitals can employ process improvement measures that effectively utilize machine learning algorithms to ensure integration into clinical workflows. Healthcare professionals can utilize workflow tools in addition to the predictive capabilities of machine learning to enhance clinical decisions in sepsis.

Machine Learning-Based Early Prediction of Sepsis Using Electronic Health Records: A Systematic Review

BACKGROUND

Sepsis, a life-threatening infection-induced inflammatory condition, has significant global health impacts. Timely detection is crucial for improving patient outcomes as sepsis can rapidly progress to severe forms. The application of machine learning (ML) and deep learning (DL) to predict sepsis using electronic health records (EHRs) has gained considerable attention for timely intervention.

METHODS

PubMed, IEEE Xplore, Google Scholar, and Scopus were searched for relevant studies. All studies that used ML/DL to detect or early-predict the onset of sepsis in the adult population using EHRs were considered. Data were extracted and analyzed from all studies that met the criteria and were also evaluated for their quality.

RESULTS

This systematic review examined 1942 articles, selecting 42 studies while adhering to strict criteria. The chosen studies were predominantly retrospective (n = 38) and spanned diverse geographic settings, with a focus on the United States. Different datasets, sepsis definitions, and prevalence rates were employed, necessitating data augmentation. Heterogeneous parameter utilization, diverse model distribution, and varying quality assessments were observed. Longitudinal data enabled early sepsis prediction, and quality criteria fulfillment varied, with inconsistent funding-article quality correlation.

CONCLUSIONS

This systematic review underscores the significance of ML/DL methods for sepsis detection and early prediction through EHR data.

State of the art review on machine learning and artificial intelligence in the study of neonatal necrotizing enterocolitis

Necrotizing Enterocolitis (NEC) is one of the leading causes of gastrointestinal emergency in preterm infants. Although NEC was formally described in the 1960's, there is still difficulty in diagnosis and ultimately treatment for NEC due in part to the multifactorial nature of the disease. Artificial intelligence (AI) and machine learning (ML) techniques have been applied by healthcare researchers over the past 30 years to better understand various diseases. Specifically, NEC researchers have used AI and ML to predict NEC diagnosis, NEC prognosis, discover biomarkers, and evaluate treatment strategies. In this review, we discuss AI and ML techniques, the current literature that has applied AI and ML to NEC, and some of the limitations in the field.

Weakly Supervised Classification of Vital Sign Alerts as Real or Artifact

A significant proportion of clinical physiologic monitoring alarms are false. This often leads to alarm fatigue in clinical personnel, inevitably compromising patient safety. To combat this issue, researchers have attempted to build Machine Learning (ML) models capable of accurately adjudicating Vital Sign (VS) alerts raised at the bedside of hemodynamically monitored patients as real or artifact. Previous studies have utilized supervised ML techniques that require substantial amounts of hand-labeled data. However, manually harvesting such data can be costly, time-consuming, and mundane, and is a key factor limiting the widespread adoption of ML in healthcare (HC). Instead, we explore the use of multiple, individually imperfect heuristics to automatically assign probabilistic labels to unlabeled training data using weak supervision. Our weakly supervised models perform competitively with traditional supervised techniques and require less involvement from domain experts, demonstrating their use as efficient and practical alternatives to supervised learning in HC applications of ML.

Online Critical-State Detection of Sepsis Among ICU Patients using Jensen-Shannon Divergence

Sepsis is a severe medical condition caused by a dysregulated host response to infection that has a high incidence and mortality rate. Even with such a high-level occurrence rate, the detection and diagnosis of sepsis continues to pose a challenge. There is a crucial need to accurately forecast the onset of sepsis promptly while also identifying the specific physiologic anomalies that contribute to this prediction in an interpretable fashion. This study proposes a novel approach to quantitatively measure the difference between patients and a reference group using non-parametric probability distribution estimates and highlight when abnormalities emerge using a Jensen-Shannon divergence- based single sample analysis approach. We show that we can quantitatively distinguish between these two groups and offer a measurement of divergence in real time while simultaneously identifying specific physiologic factors contributing to patient outcomes. We demonstrate our approach on a real-world dataset of patients admitted to Atlanta, Georgia's Grady Hospital.

Validation of an Automated System for the Extraction of a Wide Dataset for Clinical Studies Aimed at Improving the Early Diagnosis of Candidemia

There is increasing interest in assessing whether machine learning (ML) techniques could further improve the early diagnosis of candidemia among patients with a consistent clinical picture. The objective of the present study is to validate the accuracy of a system for the automated extraction from a hospital laboratory software of a large number of features from candidemia and/or bacteremia episodes as the first phase of the AUTO-CAND project. The manual validation was performed on a representative and randomly extracted subset of episodes of candidemia and/or bacteremia. The manual validation of the random extraction of 381 episodes of candidemia and/or bacteremia, with automated organization in structured features of laboratory and microbiological data resulted in ≥99% correct extractions (with confidence interval < ±1%) for all variables. The final automatically extracted dataset consisted of 1338 episodes of candidemia (8%), 14,112 episodes of bacteremia (90%), and 302 episodes of mixed candidemia/bacteremia (2%). The final dataset will serve to assess the performance of different ML models for the early diagnosis of candidemia in the second phase of the AUTO-CAND project.

LEUKOCYTE PHENOTYPING IN SEPSIS USING OMICS, FUNCTIONAL ANALYSIS, AND IN SILICO MODELING

ABSTRACT

Sepsis is a major health issue and a leading cause of death in hospitals globally. The treatment of sepsis is largely supportive, and there are no therapeutics available that target the underlying pathophysiology of the disease. The development of therapeutics for the treatment of sepsis is hindered by the heterogeneous nature of the disease. The presence of multiple, distinct immune phenotypes ranging from hyperimmune to immunosuppressed can significantly impact the host response to infection. Recently, omics, biomarkers, cell surface protein expression, and immune cell profiles have been used to classify immune status of sepsis patients. However, there has been limited studies of immune cell function during sepsis and even fewer correlating omics and biomarker alterations to functional consequences. In this review, we will discuss how the heterogeneity of sepsis and associated immune cell phenotypes result from changes in the omic makeup of cells and its correlation with leukocyte dysfunction. We will also discuss how emerging techniques such as in silico modeling and machine learning can help in phenotyping sepsis patients leading to precision medicine.

Performance effectiveness of vital parameter combinations for early warning of sepsis-an exhaustive study using machine learning

Objective

To carry out exhaustive data-driven computations for the performance of noninvasive vital signs heart rate (HR), respiratory rate (RR), peripheral oxygen saturation (SpO2), and temperature (Temp), considered both independently and in all possible combinations, for early detection of sepsis.

Materials and methods

By extracting features interpretable by clinicians, we applied Gradient Boosted Decision Tree machine learning on a dataset of 2630 patients to build 240 models. Validation was performed on a geographically distinct dataset. Relative to onset, predictions were clocked as per 16 pairs of monitoring intervals and prediction times, and the outcomes were ranked.

Results

The combination of HR and Temp was found to be a minimal feature set yielding maximal predictability with area under receiver operating curve 0.94, sensitivity of 0.85, and specificity of 0.90. Whereas HR and RR each directly enhance prediction, the effects of SpO2 and Temp are significant only when combined with HR or RR. In benchmarking relative to standard methods Systemic Inflammatory Response Syndrome (SIRS), National Early Warning Score (NEWS), and quick-Sequential Organ Failure Assessment (qSOFA), Vital-SEP outperformed all 3 of them.

Conclusion

It can be concluded that using intensive care unit data even 2 vital signs are adequate to predict sepsis upto 6 h in advance with promising accuracy comparable to standard scoring methods and other sepsis predictive tools reported in literature. Vital-SEP can be used for fast-track prediction especially in limited resource hospital settings where laboratory based hematologic or biochemical assays may be unavailable, inaccurate, or entail clinically inordinate delays. A prospective study is essential to determine the clinical impact of the proposed sepsis prediction model and evaluate other outcomes such as mortality and duration of hospital stay.

OnAI-Comp: An Online AI Experts Competing Framework for Early Sepsis Detection

Sepsis is a major public concern due to its high mortality, morbidity, and financial cost. There are many existing works of early sepsis prediction using different machine learning models to mitigate the outcomes brought by sepsis. In the practical scenario, the dataset grows dynamically as new patients visit the hospital. Most existing models, being "offline" models and having used retrospective observational data, cannot be updated and improved dynamically using the new observational data. Incorporating the new data to improve the offline models requires retraining the model, which is very computationally expensive. To solve the challenge mentioned above, we propose an Online Artificial Intelligence Experts Competing Framework (OnAI-Comp) for early sepsis detection using an online learning algorithm called Multi-armed Bandit. We selected several machine learning models as the artificial intelligence experts and used average regret to evaluate the performance of our model. The experimental analysis demonstrated that our model would converge to the optimal strategy in the long run. Meanwhile, our model can provide clinically interpretable predictions using existing local interpretable model-agnostic explanation technologies, which can aid clinicians in making decisions and might improve the probability of survival.

G-Sep: A Deep Learning Algorithm for Detection of Long-Term Sepsis Using Bidirectional Gated Recurrent Unit

Sepsis is a common and deadly condition that must be treated eloquently within 19 hours. Numerous deep learning techniques, including Recurrent Neural Networks, Convolution Neural Networks, Long Short-Term Memory, and Gated Recurrent Units, have been suggested for diagnosing long-term sepsis. Regardless, a sizable portion of them are computationally risky and have precision problems. The primary issue described is that output will degrade, and resource utilization will expand proportionately as the volume of dependencies grows. To overcome these issues, we propose a G-Sep technique utilizing Bidirectional Gated Recurrent Unit Algorithm, which consumes much less resource to detect the disease and in a short time with better accuracy than the existing methods to diagnose the sepsis. AI models could assist with distinguishing potential clinical factors and give better than existing conventional low-execution models. The proposed model is implemented utilizing Conda and Tensorflow Framework using the California Inpatient Severe Sepsis (CISS) Patient Dataset. The comparative simulation of the various existing models and the proposed G-Sep model is done using Conda and Tensor frameworks. The simulation results revealed that the proposed model had outperformed other frameworks in terms of mean average precision (mAP), receiver operating characteristic curve (ROC), and Area under the ROC Curve (AUROC) metrics linearly.

Assuring safe artificial intelligence in critical ambulance service response: study protocol

Introduction: Early recognition of out-of-hospital cardiac arrest (OHCA) by ambulance service call centre operators is important so that cardiopulmonary resuscitation can be delivered immediately, but around 25% of OHCAs are not picked up by call centre operators. An artificial intelligence (AI) system has been developed to support call centre operators in the detection of OHCA. The study aims to (1) explore ambulance service stakeholder perceptions on the safety of OHCA AI decision support in call centres, and (2) develop a clinical safety case for the OHCA AI decision-support system.Methods and analysis: The study will be undertaken within the Welsh Ambulance Service. The study is part research and part service evaluation. The research utilises a qualitative study design based on thematic analysis of interview data. The service evaluation consists of the development of a clinical safety case based on document analysis, analysis of the AI model and its development process and informal interviews with the technology developer.Conclusions: AI presents many opportunities for ambulance services, but safety assurance requirements need to be understood. The ASSIST project will continue to explore and build the body of knowledge in this area.

Prediction Models for Sepsis-Associated Thrombocytopenia Risk in Intensive Care Units Based on a Machine Learning Algorithm

Sepsis-associated thrombocytopenia (SAT) is a common complication in the intensive care unit (ICU), which significantly increases the mortality rate and leads to poor prognosis of diseases. Machine learning (ML) is widely used in disease prediction in critically ill patients. Here, we aimed to establish prediction models for platelet decrease and severe platelet decrease in ICU patients with sepsis based on four common ML algorithms and identify the best prediction model. The research subjects were 1,455 ICU sepsis patients admitted to Dongyang People's Hospital affiliated with Wenzhou Medical University from January 1, 2015, to October 31, 2019. Basic clinical demographic information, biochemical indicators, and clinical outcomes were recorded. The prediction models were based on four ML algorithms: random forest, neural network, gradient boosting machine, and Bayesian algorithms. Thrombocytopenia was found to occur in 732 patients (49.7%). The mechanical ventilation time and length of ICU stay were longer, and the mortality rate was higher for the thrombocytopenia group than for the non-thrombocytopenia group. The models were validated on an online international database (Medical Information Mart for Intensive Care III). The areas under the receiver operating characteristic curves (AUCs) of the four models for the prediction of thrombocytopenia were between 0.54 and 0.72. The AUCs of the models for the prediction of severe thrombocytopenia were between 0.70 and 0.77. The neural network and gradient boosting machine models effectively predicted the occurrence of SAT, and the Bayesian models had the best performance in predicting severe thrombocytopenia. Therefore, these models can be used to identify such high-risk patients at an early stage and guide individualized clinical treatment, to improve the prognosis of diseases.

Faster infection diagnostics for intensive care unit (ICU) patients

INTRODUCTION

: The patient admitted to intensive care units (ICU) is critically ill, to some extent immunosuppressed, with a high risk of infection, sometimes by multidrug-resistant microorganisms. In this context, the intensivist expects from the microbiology service quick and understandable information so that appropriate antimicrobial treatment for that particular patient and infection can be initiated.

AREAS COVERED

: In this review of recent literature (2015-2021), we identified diagnostic methods for the most prevalent infections in these patients through a search of the databases Pubmed, evidence-based medicine online, York University reviewers group, Cochrane, MBE-Trip, and Sumsearch using the terms: adult, clinical laboratory techniques, critical care, early diagnosis, microbiology, molecular diagnostic techniques, spectrometry and metagenomics.

EXPERT OPINION

: There has been an exponential surge in diagnostic systems used directly on blood and other samples to expedite microbial identification and antimicrobial susceptibility testing of pathogens. Few studies have thus far assessed their clinical impact; final outcomes will also depend on preanalytical and post-analytical factors. Besides, many of the resistance mechanisms cannot yet be detected with molecular techniques, which impairs the prediction of the actual resistance phenotype.

Nonetheless, this is an exciting field with much yet to explore.

Sepsis prediction, early detection, and identification using clinical text for machine learning: a systematic review

OBJECTIVE

To determine the effects of using unstructured clinical text in machine learning (ML) for prediction, early detection, and identification of sepsis.

MATERIALS AND METHODS

PubMed, Scopus, ACM DL, dblp, and IEEE Xplore databases were searched. Articles utilizing clinical text for ML or natural language processing (NLP) to detect, identify, recognize, diagnose, or predict the onset, development, progress, or prognosis of systemic inflammatory response syndrome, sepsis, severe sepsis, or septic shock were included. Sepsis definition, dataset, types of data, ML models, NLP techniques, and evaluation metrics were extracted.

RESULTS

The clinical text used in models include narrative notes written by nurses, physicians, and specialists in varying situations. This is often combined with common structured data such as demographics, vital signs, laboratory data, and medications. Area under the receiver operating characteristic curve (AUC) comparison of ML methods showed that utilizing both text and structured data predicts sepsis earlier and more accurately than structured data alone. No meta-analysis was performed because of incomparable measurements among the 9 included studies.

DISCUSSION

Studies focused on sepsis identification or early detection before onset; no studies used patient histories beyond the current episode of care to predict sepsis. Sepsis definition affects reporting methods, outcomes, and results. Many methods rely on continuous vital sign measurements in intensive care, making them not easily transferable to general ward units.

CONCLUSIONS

Approaches were heterogeneous, but studies showed that utilizing both unstructured text and structured data in ML can improve identification and early detection of sepsis.

Ground truth labels challenge the validity of sepsis consensus definitions in critical illness

BACKGROUND

Sepsis is the leading cause of death in the intensive care unit (ICU). Expediting its diagnosis, largely determined by clinical assessment, improves survival. Predictive and explanatory modelling of sepsis in the critically ill commonly bases both outcome definition and predictions on clinical criteria for consensus definitions of sepsis, leading to circularity. As a remedy, we collected ground truth labels for sepsis.

METHODS

In the Ground Truth for Sepsis Questionnaire (GTSQ), senior attending physicians in the ICU documented daily their opinion on each patient's condition regarding sepsis as a five-category working diagnosis and nine related items. Working diagnosis groups were described and compared and their SOFA-scores analyzed with a generalized linear mixed model. Agreement and discriminatory performance measures for clinical criteria of sepsis and GTSQ labels as reference class were derived.

RESULTS

We analyzed 7291 questionnaires and 761 complete encounters from the first survey year. Editing rates for all items were > 90%, and responses were consistent with current understanding of critical illness pathophysiology, including sepsis pathogenesis. Interrater agreement for presence and absence of sepsis was almost perfect but only slight for suspected infection. ICU mortality was 19.5% in encounters with SIRS as the "worst" working diagnosis compared to 5.9% with sepsis and 5.9% with severe sepsis without differences in admission and maximum SOFA. Compared to sepsis, proportions of GTSQs with SIRS plus acute organ dysfunction were equal and macrocirculatory abnormalities higher (p < 0.0001). SIRS proportionally ranked above sepsis in daily assessment of illness severity (p < 0.0001). Separate analyses of neurosurgical referrals revealed similar differences. Discriminatory performance of Sepsis-1/2 and Sepsis-3 compared to GTSQ labels was similar with sensitivities around 70% and specificities 92%. Essentially no difference between the prevalence of SIRS and SOFA ≥ 2 yielded sensitivities and specificities for detecting sepsis onset close to 55% and 83%, respectively.

CONCLUSIONS

GTSQ labels are a valid measure of sepsis in the ICU. They reveal suspicion of infection as an unclear clinical concept and refute an illness severity hierarchy in the SIRS-sepsis-severe sepsis spectrum. Ground truth challenges the accuracy of Sepsis-1/2 and Sepsis-3 in detecting sepsis onset. It is an indispensable intermediate step towards advancing diagnosis and therapy in the ICU and, potentially, other health care settings.

The Framing of machine learning risk prediction models illustrated by evaluation of sepsis in general wards

Problem framing is critical to developing risk prediction models because all subsequent development work and evaluation takes place within the context of how a problem has been framed and explicit documentation of framing choices makes it easier to compare evaluation metrics between published studies. In this work, we introduce the basic concepts of framing, including prediction windows, observation windows, window shifts and event-triggers for a prediction that strongly affects the risk of clinician fatigue caused by false positives. Building on this, we apply four different framing structures to the same generic dataset, using a sepsis risk prediction model as an example, and evaluate how framing affects model performance and learning. Our results show that an apparently good model with strong evaluation results in both discrimination and calibration is not necessarily clinically usable. Therefore, it is important to assess the results of objective evaluations within the context of more subjective evaluations of how a model is framed.

Improvement of APACHE II score system for disease severity based on XGBoost algorithm

BACKGROUND

Prognostication is an essential tool for risk adjustment and decision making in the intensive care units (ICUs). In order to improve patient outcomes, we have been trying to develop a more effective model than Acute Physiology and Chronic Health Evaluation (APACHE) II to measure the severity of the patients in ICUs. The aim of the present study was to provide a mortality prediction model for ICUs patients, and to assess its performance relative to prediction based on the APACHE II scoring system.

METHODS

We used the Medical Information Mart for Intensive Care version III (MIMIC-III) database to build our model. After comparing the APACHE II with 6 typical machine learning (ML) methods, the best performing model was screened for external validation on anther independent dataset. Performance measures were calculated using cross-validation to avoid making biased assessments. The primary outcome was hospital mortality. Finally, we used TreeSHAP algorithm to explain the variable relationships in the extreme gradient boosting algorithm (XGBoost) model.

RESULTS

We picked out 14 variables with 24,777 cases to form our basic data set. When the variables were the same as those contained in the APACHE II, the accuracy of XGBoost (accuracy: 0.858) was higher than that of APACHE II (accuracy: 0.742) and other algorithms. In addition, it exhibited better calibration properties than other methods, the result in the area under the ROC curve (AUC: 0.76). we then expand the variable set by adding five new variables to improve the performance of our model. The accuracy, precision, recall, F1, and AUC of the XGBoost model increased, and were still higher than other models (0.866, 0.853, 0.870, 0.845, and 0.81, respectively). On the external validation dataset, the AUC was 0.79 and calibration properties were good.

CONCLUSIONS

As compared to conventional severity scores APACHE II, our XGBoost proposal offers improved performance for predicting hospital mortality in ICUs patients. Furthermore, the TreeSHAP can help to enhance the understanding of our model by providing detailed insights into the impact of different features on the disease risk. In sum, our model could help clinicians determine prognosis and improve patient outcomes.

Deep Learning for Identification of Acute Illness and Facial Cues of Illness

Background: The inclusion of facial and bodily cues (clinical gestalt) in machine learning (ML) models improves the assessment of patients' health status, as shown in genetic syndromes and acute coronary syndrome. It is unknown if the inclusion of clinical gestalt improves ML-based classification of acutely ill patients. As in previous research in ML analysis of medical images, simulated or augmented data may be used to assess the usability of clinical gestalt. Objective: To assess whether a deep learning algorithm trained on a dataset of simulated and augmented facial photographs reflecting acutely ill patients can distinguish between healthy and LPS-infused, acutely ill individuals. Methods: Photographs from twenty-six volunteers whose facial features were manipulated to resemble a state of acute illness were used to extract features of illness and generate a synthetic dataset of acutely ill photographs, using a neural transfer convolutional neural network (NT-CNN) for data augmentation. Then, four distinct CNNs were trained on different parts of the facial photographs and concatenated into one final, stacked CNN which classified individuals as healthy or acutely ill. Finally, the stacked CNN was validated in an external dataset of volunteers injected with lipopolysaccharide (LPS). Results: In the external validation set, the four individual feature models distinguished acutely ill patients with sensitivities ranging from 10.5% (95% CI, 1.3-33.1% for the skin model) to 89.4% (66.9-98.7%, for the nose model). Specificity ranged from 42.1% (20.3-66.5%) for the nose model and 94.7% (73.9-99.9%) for skin. The stacked model combining all four facial features achieved an area under the receiver characteristic operating curve (AUROC) of 0.67 (0.62-0.71) and distinguished acutely ill patients with a sensitivity of 100% (82.35-100.00%) and specificity of 42.11% (20.25-66.50%). Conclusion: A deep learning algorithm trained on a synthetic, augmented dataset of facial photographs distinguished between healthy and simulated acutely ill individuals, demonstrating that synthetically generated data can be used to develop algorithms for health conditions in which large datasets are difficult to obtain. These results support the potential of facial feature analysis algorithms to support the diagnosis of acute illness.