The impact of delayed rapid response call activation on patient outcomes

Paediatric family activation rapid response (FARR) in acute care: a qualitative study for developing a multilingual application (app) intervention

BACKGROUND

Delayed recognition of clinical deterioration can result in harm to patients. Parents/carers can often recognise changes in the child's condition before healthcare professionals (HCPs). To mitigate the risk of failure to rescue and promote early intervention, family-activated rapid response (FARR) systems are part of family-integrated care. Mechanisms for parents/carers to escalate concerns regarding their child's clinical status remain limited to direct verbal communication, which may impede those with communication/linguistic challenges.

AIM

To develop a digital multilingual intervention by which families/carers can escalate their concerns directly to the rapid response team while in acute paediatric care.

METHODS

A single-centre qualitative, co-design app development study was conducted. Evidence synthesis from a systematic review of the international literature informed interviews on intervention prototype development using co-design focus groups. Participant recruitment targeted underserved communities for multilingual functionality validity. Data were analysed using qualitative content analysis.

RESULTS

Thirty parents/carers (n=16) and HCPs (n=14) participated in the study. Three themes were generated from the data analysis: (1) relational considerations; communication, professional and parental attributes, and collaborative working; (2) technology considerations; app content, usage and outcomes; and (3) individual and environmental considerations; parental and professional elements, and workload. A FARR app prototype was developed based on the data.

CONCLUSION

The prototype app provides a platform to develop a coordinated and consistent technological approach to paediatric FARR that acknowledges cultural nuances and preferences, ensuring that parents can communicate in a manner that aligns with their cultural background and communication abilities, thereby enhancing the quality of care delivered.

Multicenter Development and Prospective Validation of eCARTv5: A Gradient Boosted Machine Learning Early Warning Score

OBJECTIVE

Early detection of clinical deterioration using machine learning early warning scores may improve outcomes. However, most implemented scores were developed using logistic regression, only underwent retrospective validation, and were not tested in important subgroups. Our objective was to develop and prospectively validate a gradient boosted machine model (eCARTv5) for identifying clinical deterioration on the wards.

DESIGN

Multicenter retrospective and prospective observational study.

SETTING

Inpatient admissions to the medical-surgical wards at seven hospitals in three health systems for model development (2006-2022) and at 21 hospitals from three health systems for retrospective (2009-2023) and prospective (2023-2024) external validation.

PATIENTS

All adult patients hospitalized at each participating health system during the study years.

INTERVENTIONS

None MEASUREMENTS AND MAIN RESULTS: Predictor variables (demographics, vital signs, documentation, and laboratory values) were used in a gradient boosted trees algorithm to predict intensive care unit transfer or death in the next 24 hours. The developed model (eCART) was compared to the Modified Early Warning Score (MEWS) and the National Early Warning Score (NEWS) using the area under the receiver operating characteristic curve (AUROC). The development cohort included 901,491 admissions, the retrospective validation cohort included 1,769,461 admissions, and the prospective validation cohort included 205,946 admissions. In retrospective validation, eCART had the highest AUROC (0.835; 95%CI 0.834, 0.835), followed by NEWS (0.766 (95%CI 0.766, 0.767)), and MEWS (0.704 (95%CI 0.703, 0.704)). eCART's performance remained high (AUROC ≥0.80) across a range of patient demographics, clinical conditions, and during prospective validation.

CONCLUSIONS

We developed eCART, which performed better than the NEWS and MEWS retrospectively, prospectively, and across a range of subgroups. These results served as the foundation for Food and Drug Administration clearance for its use in identifying deterioration in hospitalized ward patients.

Early Warning Scores With and Without Artificial Intelligence

Importance

Early warning decision support tools to identify clinical deterioration in the hospital are widely used, but there is little information on their comparative performance.

Objective

To compare 3 proprietary artificial intelligence (AI) early warning scores and 3 publicly available simple aggregated weighted scores.

Design, Setting, and Participants

This retrospective cohort study was performed at 7 hospitals in the Yale New Haven Health System. All consecutive adult medical-surgical ward hospital encounters between March 9, 2019, and November 9, 2023, were included.

Exposures

Simultaneous Epic Deterioration Index (EDI), Rothman Index (RI), eCARTv5 (eCART), Modified Early Warning Score (MEWS), National Early Warning Score (NEWS), and NEWS2 scores.

Main Outcomes and Measures

Clinical deterioration, defined as a transfer from ward to intensive care unit or death within 24 hours of an observation.

Results

Of the 362 926 patient encounters (median patient age, 64 [IQR, 47-77] years; 200 642 [55.3%] female), 16 693 (4.6%) experienced a clinical deterioration event. eCART had the highest area under the receiver operating characteristic curve at 0.895 (95% CI, 0.891-0.900), followed by NEWS2 at 0.831 (95% CI, 0.826-0.836), NEWS at 0.829 (95% CI, 0.824-0.835), RI at 0.828 (95% CI, 0.823-0.834), EDI at 0.808 (95% CI, 0.802-0.812), and MEWS at 0.757 (95% CI, 0.750-0.764). After matching scores at the moderate-risk sensitivity level for a NEWS score of 5, overall positive predictive values (PPVs) ranged from a low of 6.3% (95% CI, 6.1%-6.4%) for an EDI score of 41 to a high of 17.3% (95% CI, 16.9%-17.8%) for an eCART score of 94. Matching scores at the high-risk specificity of a NEWS score of 7 yielded overall PPVs ranging from a low of 14.5% (95% CI, 14.0%-15.2%) for an EDI score of 54 to a high of 23.3% (95% CI, 22.7%-24.2%) for an eCART score of 97. The moderate-risk thresholds provided a median of at least 20 hours of lead time for all the scores. Median lead time at the high-risk threshold was 11 (IQR, 0-69) hours for eCART, 8 (IQR, 0-63) hours for NEWS, 6 (IQR, 0-62) hours for NEWS2, 5 (IQR, 0-56) hours for MEWS, 1 (IQR, 0-39) hour for EDI, and 0 (IQR, 0-42) hours for RI.

Conclusions and Relevance

In this cohort study of inpatient encounters, eCART outperformed the other AI and non-AI scores, identifying more deteriorating patients with fewer false alarms and sufficient time to intervene. NEWS, a non-AI, publicly available early warning score, significantly outperformed EDI. Given the wide variation in accuracy, additional transparency and oversight of early warning tools may be warranted.

Effects of a Rapid Response Team on Patient Outcomes: A Systematic Review

BACKGROUND

Despite the widespread adoption of the rapid response team (RRT) by many hospitals, questions remain regarding their effectiveness in improving several aspects of patient outcomes, such as hospital mortality, cardiopulmonary arrests, unplanned intensive care unit (ICU) admissions, and length of stay (LOS).

OBJECTIVES

To conduct a systematic review to understand the rapid response team's (RRT) effect on patient outcomes.

METHODS

A systematic search was conducted using PubMed, Cochrane, Embase, CINAHL, Web of Science, and two trial registers. The studies published up to May 6, 2022, from the inception date of the databases were included. Two researchers filtered the title, abstract and full text. The Version 2 of the Cochrane Risk of Bias tool and Bias in Non-Randomized Studies of Interventions (ROBINS-I) tool were used separately for randomized and non-randomized controlled trials for quality appraisal.

RESULTS

Sixty-one eligible studies were identified, four randomized controlled trials(RCTs), four non-randomized controlled trials, six interrupted time-series(ITS) design , and 47 pretest-posttest studies. A total of 52 studies reported hospital mortality, 51 studies reported cardiopulmonary arrests, 18 studies reported unplanned ICU admissions and ten studies reported LOS.

CONCLUSION

This systematic review found the variation in context and the type of RRT interventions restricts direct comparisons. The evidence for improving several aspects of patient outcomes was inconsistent, with most studies demonstrating that RRT positively impacts patient outcomes.

In-hospital outcomes among older medical inpatients admitted to aged care wards after activation of a 2-tier rapid response system

BACKGROUND

The outcomes of rapid response systems (RRS) are poorly established in older people. We examined the outcomes in older inpatients at a tertiary hospital that uses a 2-tier RRS, including the outcomes of each tier.

METHODS

The 2-tier RRS comprised the clinical review call (CRC) (tier one) and the medical emergency team call (MET) (tier two). We compared the outcomes in four configurations of MET and CRC (MET with CRC; MET without CRC; CRC without MET; neither MET nor CRC). The primary outcome was in-hospital death, and secondary outcomes were length of stay (LOS) and new residential facility placement. Statistical analyses were carried out using Fisher's exact tests, Kruskal-Wallis tests, and logistic regression.

RESULTS

A total of 433 METs and 1,395 CRCs occurred among 3,910 consecutive admissions of mean age 84 years. The effect of a MET on death was unaffected by the occurrence of a CRC. The rates of death for MET ± CRC, and CRC without MET, were 30.5% and 18.5%, respectively. Patients having one or more MET ± CRC (adjusted odds ratio [aOR] 4.04, 95% confidence interval [CI] 2.96-5.52), and those having one or more CRC without MET (aOR 2.22, 95% CI 1.68-2.93), were more likely to die in adjusted analysis. Patients who required a MET ± CRC were more likely to be placed in a high-care residential facility (aOR 1.52, 95% CI 1.03-2.24), as were patients who required a CRC without MET (aOR 1.61, 95% CI 1.22-2.14). The LOS of patients who required a MET ± CRC, and CRC without MET, was longer than that of patients who required neither (P < 0.001).

CONCLUSIONS

Both MET and CRC were associated with increased likelihood of death and new residential facility placement, after adjusting for factors such as age, comorbidity, and frailty. These data are important for patient prognostication, discussions on goals of care, and discharge planning. The high death rate of patients requiring a CRC (without a MET) has not been previously reported, and may suggest that CRCs among older inpatients should be expediated and attended by senior medical personnel.

Association between frailty and clinical outcomes in hospitalised patients requiring Code Blue activation

BACKGROUND

Code Blues allow a rapid, hospital wide response to acutely deteriorating patients. The concept of frailty is being increasingly recognised as an important element in determining outcomes of critically ill patients. We hypothesised that increasing frailty would be associated with worse outcomes following a Code Blue.

AIMS

To investigate the association between increasing frailty and outcomes of Code Blues.

METHODS

Single-centre retrospective design of patients admitted to Frankston Hospital in Australia between 1 January 2013 and 31 December 2017 who triggered a Code Blue. Frailty evaluation was made based on electronic medical records as were the details and the outcomes of the Code Blue. The primary outcome measure was a composite of hospital mortality or Cerebral Performance Categories scale ≥3. Secondary outcomes included the immediate outcome of the Code Blue and hospital mortality.

RESULTS

One hundred and forty-eight of 911 screened patients were included in the final analysis. Seventy-three were deemed 'frail' and the remainder deemed 'fit'. Seventy-eight  percent of frail patients reached the primary outcome, compared with 41% of fit patients (P < 0.001). Multivariable analysis demonstrated frailty to be associated with primary outcome (odds ratio = 2.87; 95% confidence interval (CI) 1.28-6.44; P = 0.01). A cardiac aetiology for the Code Blue was also associated with an increased odds of primary outcome (OR = 3.52; 95% CI 1.51-8.05; P = 0.004).

CONCLUSIONS

Frailty is independently associated with the composite outcome of hospital mortality or severe disability following a Code Blue. Frailty is an important tool in prognostication for these patients and might aid in discussions regarding treatment limitations.

Acute clinical deterioration and consumer escalation: The understanding and perceptions of hospital staff

Introduction

Consumer escalation systems allow patients and families to escalate concerns about acute clinical deterioration. Hospital staff can impact upon the success of this process. As part of evaluation processes within a Local Health Network, where a consumer escalation system was introduced in accordance with National requirements, we sought to explore clinicians’ understanding and perceptions of consumer escalation.

Methods

Voluntary and anonymous staff surveys pre, and post, system introduction. Quantitative data was analysed using descriptive statistics, chi-square independence, and non-parametric independent samples median tests. Qualitative data was evaluated using content analysis and cross-referenced with quantitative responses.

Results

Respondent’s (pre: 215; post: 89) area of work varied significantly between survey periods. Most agreed that patients/families have a sound knowledge of a patient’s typical health status (pre: 192/215 (89.3%); post 82/88 (93.2%)) and that patients/families should be encouraged to escalate concerns of deterioration to ward staff (pre: 209/212 (98.6%); post: 85/89 (95.5%)). Respondent perceptions of patient/family ability to recognise clinical deterioration varied. Staff agreement towards local response expectations decreased as the degree of clinical requirement increased. Staff concerns of increased workloads (pre: 90/214 (42.1%); post 12/72 (16.7%), p<0.001) and conflict generation (pre: 71/213 (33.3%); post: 7/71 (9.9%), p = 0.001) decreased significantly following system introduction. However, clinician perceptions of positive system effects also decreased (patient-staff rapport pre: 163/213 (76.5%); post: 38/72 (52.8%), p = 0.001; patient centred care pre: 188/214 (87.9%); post: 53/72 (73.6%), p = 0.012; patient safety pre: 173/214 (80.8%); post: 49/72 (68.1%), p = 0.077). Only 53% of respondents (pre: 112/213 (52.6%); post: 48/88 (54.5%)) perceived that patient/family have sufficient confidence to escalate concerns.

Conclusion

Consumer escalation systems require staff support. Staff perceptions may indicate, and act as, barriers to the operation of consumer escalation processes. Further exploration in identifying and managing staff barriers is crucial to the success of consumer escalation.

Weekend Mortality in an Italian Hospital: Immediate versus Delayed Bedside Critical Care Treatment

Background: a number of studies highlighted increased mortality associated with hospital admissions during weekends and holidays, the so–call “weekend effect”. In this retrospective study of mortality in an acute care public hospital in Italy between 2009 and 2015, we compared inpatient mortality before and after a major organizational change in 2012. The new model (Model 2) implied that the intensivist was available on call from outside the hospital during nighttime, weekends, and holidays. The previous model (Model 1) ensured the presence of the intensivist coordinating a Medical Emergency Team (MET) inside the hospital 24 h a day, 7 days a week. Methods: life status at discharge after 9298 and 8223 hospital admissions that occurred during two consecutive periods of 1185 days each (organizational Model 1 and 2), respectively, were classified into “discharged alive”, “deceased during nighttime–weekends–holidays” and “deceased during daytime-weekdays”. We estimated Relative Risk Ratios (RRR) for the associations between the organizational model and life status at discharge using multinomial logistic regression models adjusted for demographic and case-mix indicators, and timing of admission (nighttime–weekends–holidays vs. daytime-weekdays). Results: there were 802 and 840 deaths under Models 1 and 2, respectively. Total mortality was higher for hospital admissions under Model 2 compared to Model 1. Model 2 was associated with a significantly higher risk of death during nighttime–weekends–holidays (IRR: 1.38, 95% CI 1.20–1.59) compared to daytime–weekdays (RRR: 1.12, 95% CI 0.97–1.31) (p = 0.04). Respiratory diagnoses, in particular, acute and chronic respiratory failure (ICD 9 codes 510–519) were the leading causes of the mortality excess under Model 2. Conclusions: our data suggest that the immediate availability of an intensivist coordinating a MET 24 h, 7 days a week can result in a better prognosis of in-hospital emergencies compared to delayed consultation.

Outcomes of second-tier rapid response activations in a tertiary referral hospital: A prospective observational study

INTRODUCTION

A second-tier rapid response team (RRT) is activated for patients who do not respond to first-tier measures. The premise of a tiered response is that first-tier responses by a ward team may identify and correct early states of deterioration or establish goals of care, thereby reducing unnecessary escalation of care to the RRT. Currently, utilisation and outcomes of tiered RRTs remain poorly described.

METHODS

A prospective observational study of adult patients (age ≥18 years) who required RRT activations was conducted from February 2018 to December 2019.

RESULTS

There were 951 consecutive RRT activations from 869 patients and 76.0% patients had a National Early Warning Score (NEWS) ≥5 at the time of RRT activation. The majority (79.8%) of patients required RRT interventions that included endotracheal intubation (12.7%), point-of-care ultrasound (17.0%), discussing goals of care (14.7%) and intensive care unit (ICU) admission (24.2%). Approximately 1 in 3 (36.6%) patients died during hospitalisation or within 30 days of RRT activation. In multivariate analysis, age ≥65 years, NEWS ≥7, ICU admission, longer hospitalisation days at RRT activation, Eastern Cooperative Oncology Group performance scores ≥3 (OR [odds ratio] 2.24, 95% CI [confidence interval] 1.45-3.46), metastatic cancer (OR 2.64, 95% CI 1.71-4.08) and haematological cancer (OR 2.78, 95% CI 1.84-4.19) were independently associated with mortality.

CONCLUSION

Critical care interventions and escalation of care are common with second-tier RRTs. This supports the need for dedicated teams with specialised critical care services. Poor functional status, metastatic and haematological cancer are significantly associated with mortality, independent of age, NEWS and ICU admission. These factors should be considered during triage and goals of care discussion.

A systematic review of rapid response applications based on early warning score for early detection of inpatient deterioration

AIM

The aim of this study was to investigate the effectiveness of current rapid response applications available in acute care settings for escalation of patient deterioration. Current challenges and barriers, as well as key recommendations, were also discussed.

METHODS

We adopted PRISMA review methodology and screened a total of 559 articles. After considering the eligibility and selection criteria, we selected 13 articles published between 2015 and 2019. The selection criteria were based on the inclusion of studies that report on the advancement made to the current practice for providing rapid response to the patient deterioration in acute care settings.

RESULTS

We found that current rapid response applications are complicated and time-consuming for detecting inpatient deterioration. Existing applications are either siloed or challenging to use, where clinicians are required to move between two or three different applications to complete an end-to-end patient escalation workflow - from vital signs collection to escalation of deteriorating patients. We found significant differences in escalation and responses when using an electronic tool compared to the manual approach. Moreover, encouraging results were reported in extensive documentation of vital signs and timely alerts for patient deterioration.

CONCLUSION

The electronic vital signs monitoring applications are proved to be efficient and clinically suitable if they are user-friendly and interoperable. As an outcome, several key recommendations and features were identified that would be crucial to the successful implementation of any rapid response system in all clinical settings.

Comparison of clinical outcomes between nurse practitioner and registrar-led medical emergency teams: a propensity-matched analysis

OBJECTIVE

Medical emergency teams (MET) are mostly led by physicians. Some hospitals are currently using nurse practitioners (NP) to lead MET calls. These are no studies comparing clinical outcomes between these two care models. To determine whether NP-led MET calls are associated with lower risk of acute patient deterioration, when compared to intensive care (ICU) registrar (ICUR)-led MET calls.

METHODS

The composite primary outcome included recurrence of MET call, occurrence of code blue or ICU admission within 24 h. Secondary outcomes were mortality within 24 h of MET call, length of hospital stay, hospital mortality and proportion of patients discharged home. Propensity score matching was used to reduce selection bias from confounding factors between the ICUR and NP group.

RESULTS

A total of 1343 MET calls were included (1070 NP, 273 ICUR led). On Univariable analysis, the incidence of the primary outcome was higher in ICUR-led MET calls (26.7% vs. 20.6%, p = 0.03). Of the secondary outcome measures, mortality within 24 h (3.4% vs. 7.7%, p = 0.002) and hospital mortality (12.7% vs. 20.5%, p = 0.001) were higher in ICUR-led MET calls. Propensity score-matched analysis of 263 pairs revealed the composite primary outcome was comparable between both groups, but NP-led group was associated with reduced risk of hospital mortality (OR 0.57, 95% CI 0.35-0.91, p = 0.02) and higher likelihood of discharge home (OR 1.55, 95% CI 1.09-2.2, p = 0.015).

CONCLUSION

Acute patient deterioration was comparable between ICUR- and NP-led MET calls. NP-led MET calls were associated with lower hospital mortality and higher likelihood of discharge home.

Empowering nurses to activate the rapid response team

All clinical nurses need to be prepared to recognize deterioration in a patient's clinical status and activate the rapid response team when appropriate. This article explores the clinical nurse's role in recognizing and responding to deterioration in a patient's condition with a focus on hospital-based nurses practicing on a medical-surgical unit.

The effectiveness of a focused rapid response team on reducing the incidence of cardiac arrest in the general ward

Rapid response teams have been adopted to prevent unexpected in-ward cardiac arrest. However, there is no convincing evidence of optimal operation with rapid response team. Our aim was to address the impact of focused rapid response team on the safety of patients in wards. Comparison of focused with extended rapid response teams was performed in single center. The extended team operated on adult patients in whole ward (both medical and nonmedical ward) 24 hours per day, 7 days per week during 2012. In 2015, the operational time of the focused team was office hours from Monday to Friday and study population were limited to adult patients in the nonmedical ward. Unexpected in-ward cardiac arrests were compared between the extended team and focused team periods. During the focused team period, there was significant reduction in cardiac arrest per 1000 admissions in whole ward compared to the before the rapid response team period (1.09 vs 1.67, P < .001). Compared to that of the extended team period (1.42), there was also a significant reduction in cardiac arrest rate (P = .04). The cardiac arrest rate of nonmedical ward patients was also significantly decreased in the focused team period compared to that before the rapid response team period (0.43 vs 0.95, P < .001). Compared to the extended team period (0.64), there was a marginally significant reduction in cardiac arrest of nonmedical ward patients (P = .05). The focused rapid response team was associated with a reduced incidence of unexpected in-ward cardiac arrest. Further research on the optimal composition and operational time is needed.

Performance of the Afferent Limb of Rapid Response Systems in Managing Deteriorating Patients: A Systematic Review

Introduction

The clinical components of the rapid response system (RRS) are the afferent limb, to ensure identification of in-hospital patients who deteriorate and activation of a response, and the efferent limb, to provide the response. This review aims to evaluate the factors that influence the performance of the afferent limb in managing deteriorating ward patients and their effects on patient outcomes.

Methods

A systematic review was performed for the years 1995–2017 by employing five electronic databases. Articles were included assessing the ability of the ward staffs to monitor, recognize, and escalate care to patient deterioration. The findings were summarized using a narrative approach.

Results

Thirty-one studies met the inclusion criteria. The analysis revealed major themes enclosing several factors affecting management of patients having sudden deterioration. The monitoring and recognition process was conditioned by the lack of recording of physiological parameters, the influence of facilitators, including staff education and training, and barriers, including human and environmental factors, and poor compliance with the calling criteria. The escalation of care process highlighted the influence of cultural barriers and personal judgment on RRS activation. Mainly, delayed team calls were factors strongly associated with the increased risk of unplanned admissions to the intensive care unit and length of stay, hospital length of stay and mortality, and 30-day mortality.

Conclusions

A combination of factors affects the timely identification and response to sudden deterioration by general ward staffs, leading to suboptimal care of patients, delayed or failed activation of RRS teams, and increased risks of worsening outcomes. The research efforts and clinical involvement to improve the governance of the factors limiting the performance of the afferent limb may ensure proper management of hospitalized patients showing physiological deterioration.

Comparison of maternal and neonatal outcomes for patients with placenta accreta spectrum between online-to-offline management model with standard care model

OBJECTIVE

Online-to-offline is a new model for emergent medical service with the ability to connect care providers with patients on instant basis. This study aims to evaluate maternal and neonatal outcomes in patients with placenta accreta spectrum managed by an online-to-offline care model.

METHODS

Starting from January 1, 2015, management of patients with placenta accreta spectrum was changed from standard care model into an online-to-offline care model through "Wechat" in Guangzhou Medical Centre for Critical Obstetrical Care. This study compared maternal and neonatal outcomes in patients affected by placenta accreta spectrum between 2015 (online-to-offline model) and 2014 (standard care model).

RESULTS

A total of 209 cases of placenta accrete spectrum were treated in our center in 2015 and 218 such cases were treated in 2014. Patients treated in 2015 had lower rate of hysterectomy (14.83% versus 20.64%) and shorter hospital stay (7 days versus 8 days). The average interval from admission to emergency cesarean section for critically ill patients was 38.5 min in 2015 versus 50.7 min in 2014.

CONCLUSION

Patients affected by placenta accreta spectrum managed by online-to-offline care model have reduced risk of hysterectomy, shorter hospital stay, and shorter response time from admission to emergency cesarean section.