Prediction of hypotension events with physiologic vital sign signatures in the intensive care unit

Establishment and Verification of an Artificial Intelligence Prediction Model for Children With Sepsis

BACKGROUND

Early identification of high-risk groups of children with sepsis is beneficial to reduce sepsis mortality. This article used artificial intelligence (AI) technology to predict the risk of death effectively and quickly in children with sepsis in the pediatric intensive care unit (PICU).

STUDY DESIGN

This retrospective observational study was conducted in the PICUs of the First Affiliated Hospital of Sun Yat-sen University from December 2016 to June 2019 and Shenzhen Children's Hospital from January 2019 to July 2020. The children were divided into a death group and a survival group. Different machine language (ML) models were used to predict the risk of death in children with sepsis.

RESULTS

A total of 671 children with sepsis were enrolled. The accuracy (ACC) of the artificial neural network model was better than that of support vector machine, logical regression analysis, Bayesian, K nearest neighbor method and decision tree models, with a training set ACC of 0.99 and a test set ACC of 0.96.

CONCLUSIONS

The AI model can be used to predict the risk of death due to sepsis in children in the PICU, and the artificial neural network model is better than other AI models in predicting mortality risk.

Role of artificial intelligence in critical care nutrition support and research

Nutrition plays a key role in the comprehensive care of critically ill patients. Determining optimal nutrition strategy, however, remains a subject of intense debate. Artificial intelligence (AI) applications are becoming increasingly common in medicine, and specifically in critical care, driven by the data-rich environment of intensive care units. In this review, we will examine the evidence regarding the application of AI in critical care nutrition. As of now, the use of AI in critical care nutrition is relatively limited, with its primary emphasis on malnutrition screening and tolerance of enteral nutrition. Despite the current scarcity of evidence, the potential for AI for more personalized nutrition management for critically ill patients is substantial. This stems from the ability of AI to integrate multiple data streams reflecting patients' changing needs while addressing inherent heterogeneity. The application of AI in critical care nutrition holds promise for optimizing patient outcomes through tailored and adaptive nutrition interventions. A successful implementation of AI, however, necessitates a multidisciplinary approach, coupled with careful consideration of challenges related to data management, financial aspects, and patient privacy.

Hypotension During Vasopressor Infusion Occurs in Predictable Clusters: A Multicenter Analysis

Background: Published evidence indicates that mean arterial pressure (MAP) below a goal range (hypotension) is associated with worse outcomes, though MAP management failures are common. We sought to characterize hypotension occurrences in ICUs and consider the implications for MAP management. Methods: Retrospective analysis of 3 hospitals' cohorts of adult ICU patients during continuous vasopressor infusion. Two cohorts were general, mixed ICU patients and one was exclusively acute spinal cord injury patients. "Hypotension-clusters" were defined where there were ≥10 min of cumulative hypotension over a 60-min period and "constant hypotension" was ≥10 continuous minutes. Trend analysis was performed (predicting future MAP using 14 min of preceding MAP data) to understand which hypotension-clusters could likely have been predicted by clinician awareness of MAP trends. Results: In cohorts of 155, 66, and 16 ICU stays, respectively, the majority of hypotension occurred within the hypotension-clusters. Failures to keep MAP above the hypotension threshold were notable in the bottom quartiles of each cohort, with hypotension durations of 436, 167, and 468 min, respectively, occurring within hypotension-clusters per day. Mean arterial pressure trend analysis identified most hypotension-clusters before any constant hypotension occurred (81.2%-93.6% sensitivity, range). The positive predictive value of hypotension predictions ranged from 51.4% to 72.9%. Conclusions: Across 3 cohorts, most hypotension occurred in temporal clusters of hypotension that were usually predictable from extrapolation of MAP trends.

LDSG-Net: an efficient lightweight convolutional neural network for acute hypotensive episode prediction during ICU hospitalization

Objective. Acute hypotension episode (AHE) is one of the most critical complications in intensive care unit (ICU). A timely and precise AHE prediction system can provide clinicians with sufficient time to respond with proper therapeutic measures, playing a crucial role in saving patients' lives. Recent studies have focused on utilizing more complex models to improve predictive performance. However, these models are not suitable for clinical application due to limited computing resources for bedside monitors.Approach. To address this challenge, we propose an efficient lightweight dilated shuffle group network. It effectively incorporates shuffling operations into grouped convolutions on the channel and dilated convolutions on the temporal dimension, enhancing global and local feature extraction while reducing computational load.Main results. Our benchmarking experiments on the MIMIC-III and VitalDB datasets, comprising 6036 samples from 1304 patients and 2958 samples from 1047 patients, respectively, demonstrate that our model outperforms other state-of-the-art lightweight CNNs in terms of balancing parameters and computational complexity. Additionally, we discovered that the utilization of multiple physiological signals significantly improves the performance of AHE prediction. External validation on the MIMIC-IV dataset confirmed our findings, with prediction accuracy for AHE 5 min prior reaching 93.04% and 92.04% on the MIMIC-III and VitalDB datasets, respectively, and 89.47% in external verification.Significance. Our study demonstrates the potential of lightweight CNN architectures in clinical applications, providing a promising solution for real-time AHE prediction under resource constraints in ICU settings, thereby marking a significant step forward in improving patient care.

Parsimonious Waveform-derived Features consisting of Pulse Arrival Time and Heart Rate Variability Predicts the Onset of Septic Shock

Sepsis is a major public health emergency and one of the leading causes of morbidity and mortality in critically ill patients. For each hour treatment is delayed, shock-related mortality increases, so early diagnosis and intervention is of utmost importance. However, earlier recognition of shock requires active monitoring, which may be delayed due to subclinical manifestations of the disease at the early phase of onset. Machine learning systems can increase timely detection of shock onset by exploiting complex interactions among continuous physiological waveforms. We use a dataset consisting of high-resolution physiological waveforms from intensive care unit (ICU) of a tertiary hospital system. We investigate the use of mean arterial blood pressure (MAP), pulse arrival time (PAT), heart rate variability (HRV), and heart rate (HR) for the early prediction of shock onset. Using only five minutes of the aforementioned vital signals from 239 ICU patients, our developed models can accurately predict septic shock onset 6 to 36 hours prior to clinical recognition with area under the receiver operating characteristic (AUROC) of 0.84 and 0.8 respectively. This work lays foundations for a robust, efficient, accurate and early prediction of septic shock onset which may help clinicians in their decision-making processes. This study introduces machine learning models that provide fast and accurate predictions of septic shock onset times up to 36 hours in advance. BP, PAT and HR dynamics can independently predict septic shock onset with a look-back period of only 5 mins.

Development and Validation of a Prediction Model for Acute Hypotensive Events in Intensive Care Unit Patients

Background: Persistent hypotension in the intensive care unit (ICU) is associated with increased mortality. Predicting acute hypotensive events can lead to timely intervention. We aimed to develop a prediction model of acute hypotensive events in patients admitted to the ICU. Methods: We included adult patients admitted to the Nagoya City University (NCU) Hospital ICU between January 2018 and December 2021 for model training and internal validation. The MIMIC-III database was used for external validation. A hypotensive event was defined as a mean arterial pressure < 60 mmHg for at least 5 min in 10 min. The input features were age, sex, and time-series data for vital signs. We compared the area under the receiver-operating characteristic curve (AUROC) of three machine-learning algorithms: logistic regression, the light gradient boosting machine (LightGBM), and long short-term memory (LSTM). Results: Acute hypotensive events were found in 1325/1777 (74.6%) and 2691/5266 (51.1%) of admissions in the NCU and MIMIC-III cohorts, respectively. In the internal validation, the LightGBM model had the highest AUROC (0.835), followed by the LSTM (AUROC 0.834) and logistic regression (AUROC 0.821) models. Applying only blood pressure-related features, the LSTM model achieved the highest AUROC (0.843) and consistently showed similar results in external and internal validation. Conclusions: The LSTM model using only blood pressure-related features had the highest AUROC with comparable performance in external validation.

Chinese experts' consensus on the application of intensive care big data

The development of intensive care medicine is inseparable from the diversified monitoring data. Intensive care medicine has been closely integrated with data since its birth. Critical care research requires an integrative approach that embraces the complexity of critical illness and the computational technology and algorithms that can make it possible. Considering the need of standardization of application of big data in intensive care, Intensive Care Medicine Branch of China Health Information and Health Care Big Data Society, Standard Committee has convened expert group, secretary group and the external audit expert group to formulate Chinese Experts' Consensus on the Application of Intensive Care Big Data (2022). This consensus makes 29 recommendations on the following five parts: Concept of intensive care big data, Important scientific issues, Standards and principles of database, Methodology in solving big data problems, Clinical application and safety consideration of intensive care big data. The consensus group believes this consensus is the starting step of application big data in the field of intensive care. More explorations and big data based retrospective research should be carried out in order to enhance safety and reliability of big data based models of critical care field.

Forecasting imminent atrial fibrillation in long-term electrocardiogram recordings

BACKGROUND

Despite the morbidity associated with acute atrial fibrillation (AF), no models currently exist to forecast its imminent onset. We sought to evaluate the ability of deep learning to forecast the imminent onset of AF with sufficient lead time, which has important implications for inpatient care.

METHODS

We utilized the Physiobank Long-Term AF Database, which contains 24-h, labeled ECG recordings from patients with a history of AF. AF episodes were defined as ≥5 min of sustained AF. Three deep learning models incorporating convolutional and transformer layers were created for forecasting, with two models focusing on the predictive nature of sinus rhythm segments and AF epochs separately preceding an AF episode, and one model utilizing all preceding waveform as input. Cross-validated performance was evaluated using area under time-dependent receiver operating characteristic curves (AUC(t)) at 7.5-, 15-, 30-, and 60-min lead times, precision-recall curves, and imminent AF risk trajectories.

RESULTS

There were 367 AF episodes from 84 ECG recordings. All models showed average risk trajectory divergence of those with an AF episode from those without ∼15 min before the episode. Highest AUC was associated with the sinus rhythm model [AUC = 0.74; 7.5-min lead time], though the model using all preceding waveform data had similar performance and higher AUCs at longer lead times.

CONCLUSIONS

In this proof-of-concept study, we demonstrated the potential utility of neural networks to forecast the onset of AF in long-term ECG recordings with a clinically relevant lead time. External validation in larger cohorts is required before deploying these models clinically.

Forecasting algorithms in the ICU

Despite significant advances in modeling methods and access to large datasets, there are very few real-time forecasting systems deployed in highly monitored environment such as the intensive care unit. Forecasting models may be developed as classification, regression or time-to-event tasks; each could be using a variety of machine learning algorithms. An accurate and useful forecasting systems include several components beyond a forecasting model, and its performance is assessed using end-user-centered metrics. Several barriers to implementation and acceptance persist and clinicians will play an active role in the successful deployment of this promising technology.

Comparison of mortality in emergency department patients with immediate versus delayed hypotension

BACKGROUND

Hypotension in the emergency department (ED) is known to be associated with increased mortality, however, the relationship between timing of hypotension and mortality has not been investigated. The objective of the study was to compare the mortality rate of patients presenting with hypotension with those who develop hypotension while in the ED.

METHODS

This was a retrospective cohort study in a large academic medical center collected from January 2018-December 2021. Patients were included if they were ≥ 18 years old and had at least one recorded systolic blood pressure (SBP) ≤ 90 in the ED. Patients were separated into medical and trauma presentations by chief compliant. The primary outcome was in-hospital mortality, which included any deaths between ED arrival and hospital discharge. Further analysis examined the association of time to the first hypotensive SBP measurement with mortality.

RESULTS

There were 212,085 adult patients who presented to the ED during the study period, with 4053 (1.9%) patients having at least one hypotensive blood pressure measurement. The mortality rate was 0.8% for all patients and 10.0% for patients with hypotension. There were 676 unique chief complaints, of which 86 (12.7%) were determined to be trauma related. This grouping resulted in 176,947(83.4%) patients classified as medical and 35,138(16.6%) patients as trauma. For patients presenting with medical complaints, there was not a significant difference in mortality for patients who were hypotensive on arrival and those who developed hypotension during their ED stay (RR 1.19 [95% CI:0.97-1.39]). Similarly, there was no difference for patients with trauma (RR 0.6 [95% CI: 0.31-1.24]). However, for all patients, there was a significant trend toward decreased mortality for every hour after arrival until the development of hypotension, and increased mortality with increasing number of hypotensive measurements recorded.

CONCLUSION

This study demonstrated hypotension in the ED was associated with a very significantly increased risk of in-hospital mortality. However, there was no significant increase in mortality between those patients with hypotension on arrival those who develop hypotension while in the ED. These finding underscore the importance of careful hemodynamic monitoring for patients in the ED throughout their stay.

EARLY PREDICTION OF UNEXPECTED LATENT SHOCK IN THE EMERGENCY DEPARTMENT USING VITAL SIGNS

ABSTRACT

Objective/Introduction : Sequential vital-sign information and trends in vital signs are useful for predicting changes in patient state. This study aims to predict latent shock by observing sequential changes in patient vital signs. Methods : The dataset for this retrospective study contained a total of 93,194 emergency department (ED) visits from January 1, 2016, and December 31, 2020, and Medical Information Mart for Intensive Care (MIMIC)-IV-ED data. We further divided the data into training and validation datasets by random sampling without replacement at a 7:3 ratio. We carried out external validation with MIMIC-IV-ED. Our prediction model included logistic regression (LR), random forest (RF) classifier, a multilayer perceptron (MLP), and a recurrent neural network (RNN). To analyze the model performance, we used area under the receiver operating characteristic curve (AUROC). Results : Data of 89,250 visits of patients who met prespecified criteria were used to develop a latent-shock prediction model. Data of 142,250 patient visits from MIMIC-IV-ED satisfying the same inclusion criteria were used for external validation of the prediction model. The AUROC values of prediction for latent shock were 0.822, 0.841, 0.852, and 0.830 with RNN, MLP, RF, and LR methods, respectively, at 3 h before latent shock. This is higher than the shock index or adjusted shock index. Conclusion : We developed a latent shock prediction model based on 24 h of vital-sign sequence that changed with time and predicted the results by individual.

Development of a urinometer for automatic measurement of urine flow in catheterized patients

Urinary flow measurement and colorimetry are vital medical indicators for critically ill patients in intensive care units. However, there is a clinical need for low-cost, continuous urinary flow monitoring devices that can automatically and in real-time measure urine flow. This need led to the development of a non-invasive device that is easy to use and does not require proprietary disposables. The device operates by detecting urine flow using an infrared barrier that returns an unequivocal pattern, and it is capable of measuring the volume of liquid in real-time, storing the history with a precise date, and returning alarms to detect critical trends. The device also has the ability to detect the color of urine, allowing for extended data and detecting problems in catheterized patients such as hematuria. The device is proposed as an automated clinical decision support system that utilizes the concept of the Internet of Medical Things. It works by using a LoRa communication method with the LoRaWAN protocol to maximize the distance to access points, reducing infrastructure costs in massive deployments. The device can send data wirelessly for remote monitoring and allows for the collection of data on a dashboard in a pseudonymous way. Tests conducted on the device using a gold standard medical grade infusion pump and fluid densities within the 1.005 g/ml to 1.030 g/ml urine density range showed that droplets were satisfactorily captured in the range of flows from less than 1 ml/h to 500 ml/h, which are acceptable ranges for urinary flow. Errors ranged below 15%, when compared to the values obtained by the hospital infusion pump used as gold standard. Such values are clinically adequate to detect changes in diuresis patterns, specially at low urine output ranges, related to renal disfunction. Additionally, tests carried out with different color patterns indicate that it detects different colors of urine with a precision in detecting RGB values <5%. In conclusion, the results suggest that the device can be useful in automatically monitoring diuresis and colorimetry in real-time, which can facilitate the work of nursing and provide automatic decision-making support to intensive care physicians.

Engaging Multidisciplinary Clinical Users in the Design of an Artificial Intelligence-Powered Graphical User Interface for Intensive Care Unit Instability Decision Support

BACKGROUND

Critical instability forecast and treatment can be optimized by artificial intelligence (AI)-enabled clinical decision support. It is important that the user-facing display of AI output facilitates clinical thinking and workflow for all disciplines involved in bedside care.

OBJECTIVES

Our objective is to engage multidisciplinary users (physicians, nurse practitioners, physician assistants) in the development of a graphical user interface (GUI) to present an AI-derived risk score.

METHODS

Intensive care unit (ICU) clinicians participated in focus groups seeking input on instability risk forecast presented in a prototype GUI. Two stratified rounds (three focus groups [only nurses, only providers, then combined]) were moderated by a focus group methodologist. After round 1, GUI design changes were made and presented in round 2. Focus groups were recorded, transcribed, and deidentified transcripts independently coded by three researchers. Codes were coalesced into emerging themes.

RESULTS

Twenty-three ICU clinicians participated (11 nurses, 12 medical providers [3 mid-level and 9 physicians]). Six themes emerged: (1) analytics transparency, (2) graphical interpretability, (3) impact on practice, (4) value of trend synthesis of dynamic patient data, (5) decisional weight (weighing AI output during decision-making), and (6) display location (usability, concerns for patient/family GUI view). Nurses emphasized having GUI objective information to support communication and optimal GUI location. While providers emphasized need for recommendation interpretability and concern for impairing trainee critical thinking. All disciplines valued synthesized views of vital signs, interventions, and risk trends but were skeptical of placing decisional weight on AI output until proven trustworthy.

CONCLUSION

Gaining input from all clinical users is important to consider when designing AI-derived GUIs. Results highlight that health care intelligent decisional support systems technologies need to be transparent on how they work, easy to read and interpret, cause little disruption to current workflow, as well as decisional support components need to be used as an adjunct to human decision-making.

Meaningful time-related aspects of alerts in Clinical Decision Support Systems. A unified framework

Alerts are a common functionality of clinical decision support systems (CDSSs). Although they have proven to be useful in clinical practice, the alert burden can lead to alert fatigue and significantly reduce their usability and acceptance. Based on a literature review, we propose a unified framework consisting of a set of meaningful timestamps that allows the use of state-of-the-art measures for alert burden, such as alert dwell time, alert think time, and response time. In addition, it can be used to investigate other measures that could be relevant as regards dealing with this problem. Furthermore, we provide a case study concerning three different types of alerts to which the framework was successfully applied. We consider that our framework can easily be adapted to other CDSSs and that it could be useful for dealing with alert burden measurement thus contributing to its appropriate management.

Artificial intelligence in critical illness and its impact on patient care: a comprehensive review

Artificial intelligence (AI) has great potential to improve the field of critical care and enhance patient outcomes. This paper provides an overview of current and future applications of AI in critical illness and its impact on patient care, including its use in perceiving disease, predicting changes in pathological processes, and assisting in clinical decision-making. To achieve this, it is important to ensure that the reasoning behind AI-generated recommendations is comprehensible and transparent and that AI systems are designed to be reliable and robust in the care of critically ill patients. These challenges must be addressed through research and the development of quality control measures to ensure that AI is used in a safe and effective manner. In conclusion, this paper highlights the numerous opportunities and potential applications of AI in critical care and provides guidance for future research and development in this field. By enabling the perception of disease, predicting changes in pathological processes, and assisting in the resolution of clinical decisions, AI has the potential to revolutionize patient care for critically ill patients and improve the efficiency of health systems.

Artificial Intelligence in Critical Care Medicine

This article is one of ten reviews selected from the Annual Update in Intensive Care and Emergency Medicine 2022. Other selected articles can be found online at https://www.biomedcentral.com/collections/annualupdate2022 . Further information about the Annual Update in Intensive Care and Emergency Medicine is available from https://link.springer.com/bookseries/8901 .

Intelligent Clinical Decision Support

Early recognition of pathologic cardiorespiratory stress and forecasting cardiorespiratory decompensation in the critically ill is difficult even in highly monitored patients in the Intensive Care Unit (ICU). Instability can be intuitively defined as the overt manifestation of the failure of the host to adequately respond to cardiorespiratory stress. The enormous volume of patient data available in ICU environments, both of high-frequency numeric and waveform data accessible from bedside monitors, plus Electronic Health Record (EHR) data, presents a platform ripe for Artificial Intelligence (AI) approaches for the detection and forecasting of instability, and data-driven intelligent clinical decision support (CDS). Building unbiased, reliable, and usable AI-based systems across health care sites is rapidly becoming a high priority, specifically as these systems relate to diagnostics, forecasting, and bedside clinical decision support. The ICU environment is particularly well-positioned to demonstrate the value of AI in saving lives. The goal is to create AI models embedded in a real-time CDS for forecasting and mitigation of critical instability in ICU patients of sufficient readiness to be deployed at the bedside. Such a system must leverage multi-source patient data, machine learning, systems engineering, and human action expertise, the latter being key to successful CDS implementation in the clinical workflow and evaluation of bias. We present one approach to create an operationally relevant AI-based forecasting CDS system.

Wearable Sensors and Machine Learning for Hypovolemia Problems in Occupational, Military and Sports Medicine: Physiological Basis, Hardware and Algorithms

Hypovolemia is a physiological state of reduced blood volume that can exist as either (1) absolute hypovolemia because of a lower circulating blood (plasma) volume for a given vascular space (dehydration, hemorrhage) or (2) relative hypovolemia resulting from an expanded vascular space (vasodilation) for a given circulating blood volume (e.g., heat stress, hypoxia, sepsis). This paper examines the physiology of hypovolemia and its association with health and performance problems common to occupational, military and sports medicine. We discuss the maturation of individual-specific compensatory reserve or decompensation measures for future wearable sensor systems to effectively manage these hypovolemia problems. The paper then presents areas of future work to allow such technologies to translate from lab settings to use as decision aids for managing hypovolemia. We envision a future that incorporates elements of the compensatory reserve measure with advances in sensing technology and multiple modalities of cardiovascular sensing, additional contextual measures, and advanced noise reduction algorithms into a fully wearable system, creating a robust and physiologically sound approach to manage physical work, fatigue, safety and health issues associated with hypovolemia for workers, warfighters and athletes in austere conditions.

An External-Validated Algorithm to Predict Postoperative Pneumonia Among Elderly Patients With Lung Cancer After Video-Assisted Thoracoscopic Surgery

The aim of the study was to develop an algorithm to predict postoperative pneumonia among elderly patients with lung cancer after video-assisted thoracoscopic surgery. We analyzed 3,009 patients from the Thoracic Perioperative Database for Geriatrics in our hospital and finally enrolled 1,585 elderly patients (age≧65 years) with lung cancer treated with video-assisted thoracoscopic surgery. The included patients were randomly divided into a training group (n = 793) and a validation group (n = 792). Patients in the training group were used to develop the algorithm after screening up to 30 potential risk factors, and patients in the validation group were used to internally validate the algorithm. External validation of the algorithm was achieved in the external validation dataset after enrolling 165 elderly patients with lung cancer treated with video-assisted thoracoscopic surgery from two hospitals in China. Of all included patients, 9.15% (145/1,585) of patients suffered from postoperative pneumonia in the Thoracic Perioperative Database for Geriatrics, and 10.30% (17/165) of patients had postoperative pneumonia in the external validation dataset. The algorithm consisted of seven variables, including sex, smoking, history of chronic obstructive pulmonary disease (COPD), surgery duration, leukocyte count, intraoperative injection of colloid, and intraoperative injection of hormone. The C-index from the receiver operating characteristic curve (AUROC) was 0.70 in the training group, 0.67 in the internal validation group, and 0.71 in the external validation dataset, and the corresponding calibration slopes were 0.88 (95% confident interval [CI]: 0.37–1.39), 0.90 (95% CI: 0.46–1.34), and 1.03 (95% CI: 0.24–1.83), respectively. The actual probabilities of postoperative pneumonia were 5.14% (53/1031) in the low-risk group, 15.07% (71/471) in the medium-risk group, and 25.30% (21/83) in the high-risk group (p < 0.001). The algorithm can be a useful prognostic tool to predict the risk of developing postoperative pneumonia among elderly patients with lung cancer after video-assisted thoracoscopic surgery.

Technical considerations for evaluating clinical prediction indices: a case study for predicting code blue events with MEWS

Objective.There have been many efforts to develop tools predictive of health deterioration in hospitalized patients, but comprehensive evaluation of their predictive ability is often lacking to guide implementation in clinical practice. In this work, we propose new techniques and metrics for evaluating the performance of predictive alert algorithms and illustrate the advantage of capturing the timeliness and the clinical burden of alerts through the example of the modified early warning score (MEWS) applied to the prediction of in-hospital code blue events.Approach. Different implementations of MEWS were calculated from available physiological parameter measurements collected from the electronic health records of ICU adult patients. The performance of MEWS was evaluated using conventional and a set of non-conventional metrics and approaches that take into account the timeliness and practicality of alarms as well as the false alarm burden.Main results. MEWS calculated using the worst-case measurement (i.e. values scoring 3 points in the MEWS definition) over 2 h intervals significantly reduced the false alarm rate by over 50% (from 0.19/h to 0.08/h) while maintaining similar sensitivity levels as MEWS calculated from raw measurements (∼80%). By considering a prediction horizon of 12 h preceding a code blue event, a significant improvement in the specificity (∼60%), the precision (∼155%), and the work-up to detection ratio (∼50%) could be achieved, at the cost of a relatively marginal decrease in sensitivity (∼10%).Significance. Performance aspects pertaining to the timeliness and burden of alarms can aid in understanding the potential utility of a predictive alarm algorithm in clinical settings.