Family initiated escalation of care for the deteriorating patient in hospital: Family centred care or just “box ticking”

Impact of Rapid Response Teams on Pediatric Care: An Interrupted Time Series Analysis of Unplanned PICU Admissions and Cardiac Arrests

Pediatric rapid response teams (RRTs) are expected to significantly lower pediatric mortality in healthcare settings. This study evaluates RRTs' effectiveness in decreasing cardiac arrests and unexpected Pediatric Intensive Care Unit (PICU) admissions. A quasi-experimental study (2014-2017) at King Abdulaziz University Hospital, Jeddah, Saudi Arabia, involved 3261 pediatric inpatients, split into pre-intervention (1604) and post-intervention (1657) groups. Baseline pediatric warning scores and monthly data on admissions, transfers, arrests, and mortality were analyzed pre- and post-intervention. Statistical methods including bootstrapping, segmented regression, and a Zero-Inflation Poisson model were employed to ensure a comprehensive evaluation of the intervention's impact. RRT was activated 471 times, primarily for respiratory distress (29.30%), sepsis (22.30%), clinical anxiety (13.80%), and hematological abnormalities (6.7%). Family concerns triggered 0.1% of activations. Post-RRT implementation, unplanned PICU admissions significantly reduced (RR = 0.552, 95% CI 0.485-0.628, p < 0.0001), and non-ICU cardiac arrests were eliminated (RR = 0). Patient care improvement was notable, with a -9.61 coefficient for PICU admissions (95% CI: -12.65 to -6.57, p < 0.001) and a -1.641 coefficient for non-ICU cardiac arrests (95% CI: -2.22 to -1.06, p < 0.001). Sensitivity analysis showed mixed results for PICU admissions, while zero-inflation Poisson analysis confirmed a reduction in non-ICU arrests. The deployment of pediatric RRTs is associated with fewer unexpected PICU admissions and non-ICU cardiopulmonary arrests, indicating improved PICU management. Further research using robust scientific methods is necessary to conclusively determine RRTs' clinical benefits.

Acute clinical deterioration and consumer escalation: The understanding and perceptions of hospital staff

Introduction

Consumer escalation systems allow patients and families to escalate concerns about acute clinical deterioration. Hospital staff can impact upon the success of this process. As part of evaluation processes within a Local Health Network, where a consumer escalation system was introduced in accordance with National requirements, we sought to explore clinicians’ understanding and perceptions of consumer escalation.

Methods

Voluntary and anonymous staff surveys pre, and post, system introduction. Quantitative data was analysed using descriptive statistics, chi-square independence, and non-parametric independent samples median tests. Qualitative data was evaluated using content analysis and cross-referenced with quantitative responses.

Results

Respondent’s (pre: 215; post: 89) area of work varied significantly between survey periods. Most agreed that patients/families have a sound knowledge of a patient’s typical health status (pre: 192/215 (89.3%); post 82/88 (93.2%)) and that patients/families should be encouraged to escalate concerns of deterioration to ward staff (pre: 209/212 (98.6%); post: 85/89 (95.5%)). Respondent perceptions of patient/family ability to recognise clinical deterioration varied. Staff agreement towards local response expectations decreased as the degree of clinical requirement increased. Staff concerns of increased workloads (pre: 90/214 (42.1%); post 12/72 (16.7%), p<0.001) and conflict generation (pre: 71/213 (33.3%); post: 7/71 (9.9%), p = 0.001) decreased significantly following system introduction. However, clinician perceptions of positive system effects also decreased (patient-staff rapport pre: 163/213 (76.5%); post: 38/72 (52.8%), p = 0.001; patient centred care pre: 188/214 (87.9%); post: 53/72 (73.6%), p = 0.012; patient safety pre: 173/214 (80.8%); post: 49/72 (68.1%), p = 0.077). Only 53% of respondents (pre: 112/213 (52.6%); post: 48/88 (54.5%)) perceived that patient/family have sufficient confidence to escalate concerns.

Conclusion

Consumer escalation systems require staff support. Staff perceptions may indicate, and act as, barriers to the operation of consumer escalation processes. Further exploration in identifying and managing staff barriers is crucial to the success of consumer escalation.

Aboriginal perspectives on recognising clinical deterioration in their child and communicating concerns to clinicians

AIMS AND OBJECTIVES

To explore the perspectives of family members of Aboriginal children about a) their involvement in recognising clinical deterioration in a hospital setting and b) the effectiveness of a poster designed to promote family involvement.

BACKGROUND

To assist in the early recognition and response to clinical deterioration for hospitalised children, many escalation of care processes now include family involvement. Little is currently known about the perspectives of Australian Aboriginal families in recognising deterioration in their child and raising the alarm, or if current escalation of care systems meet the needs of Aboriginal families.

DESIGN

Qualitative pragmatist approach using semi-structured interviews.

METHODS

Seven interviews were conducted with five mothers and two grandmothers of Aboriginal children who were inpatients at a children's hospital. Thematic analysis was undertaken.

FINDINGS

Two themes were identified: Theme one was: Family role in recognising and responding to clinical deterioration, with two subthemes of knowing when to worry and communicating concerns. Participants reported that some families needed more knowledge to recognise clinical deterioration. Communication barriers between families and clinicians were identified. Theme two was: Effective visual communication with three subthemes of linguistic clarity, visual appeal and content.

CONCLUSIONS

Additional strategies are needed to promote effective communication between clinicians and families of Aboriginal children in hospital. Posters were considered effective, particularly if including a cultural connection, images and simplified language.

PRACTICE IMPLICATIONS

These insights provide important information for health professionals and health service managers to be aware that additional communication strategies are required to support Aboriginal family involvement in recognising clinical deterioration and escalation of care.

A Qualitative Analysis of Observed Behavior of Pediatric Rapid Response Team Performance

BACKGROUND AND OBJECTIVES

Pediatric rapid response teams (RRTs) enhance patient safety, reduce cardiorespiratory arrests outside the PICU, and detect deteriorating patients before decompensation. RRT performance may be affected by failures in communication, poor team dynamics, and poor shared decision-making. We aimed to describe factors associated with team performance using direct observation of pediatric RRTs.

METHODS

Our team directly observed 73 in situ RRT activations, collected field notes of qualitative data, and analyzed the data using conventional content analysis. To assess accuracy of coding, 20% of the coded observations were reassessed for interrater reliability. The codes influencing team performance were categorized as enhancers or threats to RRT teamwork and organized under themes. We constructed a framework of the codes and themes, organized along a spectrum of orderly versus chaotic RRTs.

RESULTS

Three themes influencing RRT performance were teamwork, leadership, and patient and family factors, with underlying codes that enhanced or threatened RRT performance. Novel factors that were found to threaten team performance included indecision, disruptive behavior, changing leadership, and family or patient distress. Our framework delineating features of orderly and chaotic RRTs may be used to inform training and design of RRTs to optimize performance.

CONCLUSIONS

Observations of in situ RRT activations in a pediatric hospital both verified previously described characteristics of RRTs and identified new characteristics of team function. Our proposed framework for understanding these enhancers and threats may be used to inform future interventions to improve RRT performance.

A delirium prevalence audit and a pre and post evaluation of an interprofessional education intervention to increase staff knowledge about delirium in older adults

Background

Delirium is more prevalent in older people and estimated to occur in up to 50% of the hospital population. Delirium comprises a spectrum of behaviours, including cognitive and attention deficits, and fluctuating levels of consciousness, often associated with an underlying physiological disturbance. Delirium has been increasingly associated with adverse outcomes. Although often preventable or can at least be mitigated, delirium may not be a standard part of assessment and thus may not be recognized in the early stages when it is most likely to be treated successfully. The aim of this study was to evaluate the level of knowledge of delirium amongst clinicians caring for patients at high risk of developing delirium and to determine whether education can improve clinical assessment of delirium.

Methods

Two hundred and forty-six case notes were audited before and 149 were reviewed after the education intervention and implementation of a delirium screening tool. Clinicians at the hospital were invited to complete a questionnaire on knowledge of delirium. The questionnaire was based on a validated tool which contained 39 questions about delirium. The questionnaire also contained 28 questions on delirium knowledge. Additional questions were included to gather demographic information specific to the hospital. Descriptive statistics, chi square and independent t-tests were conducted to test for differences in knowledge between the pre and post periods. The Squire Checklist Reporting Guidelines for Quality Improvement Studies informed the preparation of the manuscript.

Results

The audit demonstrated that the use of a cognitive assessment tool overall increased from 8.5% in pre education to 43% in the post education period. One hundred and fifty-nine staff completed the questionnaire in total, 118 the pre and 41 post. The knowledge subscale score was high pre and post education and no statistically significant difference was observed. The greatest increase in knowledge was related to knowledge of the risk factors subscale. The increase in knowledge (6.8%) was statistically significant.

Conclusion

An interprofessional approach to delirium education was effective in not only increasing awareness of the factors associated with this syndrome but also increased the use of a delirium assessment tool.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12912-021-00692-2.

Framework for patient, family-centred care within an Australian Community Hospital: development and description

OBJECTIVE

To describe the development of a patient and family-centred care (PFCC) conceptual framework within a small community Australian Hospital.

METHODS

A scoping review of scientific and grey literature and community hospital stakeholder discussions were used to identify and design a conceptual framework for PFCC across five core pillars of leadership, engagement, service delivery, learning and environment.

RESULTS

107 publications were identified and 76 were included for data extraction. A draft framework was constructed and modified following consultation with hospital stakeholders across a small Australian Community Hospital. The 'Caring Together' framework outlines three core layers: (1) the focus of our care is the experiences of our consumers and staff; (2) concepts of leadership, environment, service delivery, engagement and learning; and (3) the overarching fundamental values of being heard, respected, valued and supported by staff and consumers at all levels in an organisation.

CONCLUSIONS

The conceptual Caring Together framework structures key PFCC concepts across organisational priority areas within an Australian healthcare setting and can be used to guide implementation of PFCC at other small hospital facilities. Changes to national and state healthcare funding may help facilitate improved hospital facility implementation of PFCC, and ultimately improve consumer healthcare satisfaction and clinical outcomes.

Patient and family involvement in escalating concerns about clinical deterioration in acute adult wards: A qualitative systematic review

BACKGROUND

Despite international standards for recognition and response to deterioration, warning signs are not always identified by staff on acute hospital wards. Patient and family-initiated escalation of care schemes have shown some benefit in assisting early recognition, but are not widely used in many clinical practice areas.

OBJECTIVES

To explore (a) patients' and relatives' experiences of acute deterioration and (b) patients', relatives' and healthcare professionals' perceptions of the barriers or facilitators to patient and family-initiated escalation of care in acute adult hospital wards.

METHODS

We conducted a qualitative review using Cochrane methodology. Two reviewers independently screened studies, extracted data, and appraised the quality using a qualitative critical appraisal tool. Findings were analysed using thematic synthesis and confidence in findings was assessed using GRADE-CERQual.

SEARCH STRATEGY

MEDLINE, CINAHL, EMBASE, PsychINFO databases and grey literature from 2005 to August 2019.

INCLUSION CRITERIA

Any research design that had a qualitative element and focused on adult patients' and relatives' experiences of deterioration and perceptions of escalating care.

RESULTS

We included five studies representing 120 participants and assessed the certainty of evidence as moderate using GRADE-CERQual. Findings indicated that a number of patients/relatives have the ability to detect acute deterioration, however, various factors act as both barriers and facilitators to being heard. These include personal factors, perceptions of role, quality of relationships with healthcare staff, and organisational factors. Theoretical understanding suggests that patient and relative involvement in escalation is dependent on both inherent capabilities and the factors that influence empowerment.

CONCLUSION

This review highlights that patient and family escalation of care interventions need to be designed with the aim of improving patient/relative-clinician collaboration and the sharing of responsibility.

RELEVANCE TO PRACTICE

These factors need to be addressed to promote more active partnerships when designing and implementing patient and family-initiated escalation of care interventions.

Acute clinical deterioration and consumer escalation in the hospital setting: A literature review

BACKGROUND

Consumer escalation systems that allow patients and/or their family/carers to escalate concerns about clinical deterioration have been proposed as a way of enhancing patient safety. However, evidence to guide implementation or to support system effectiveness remains unclear.

AIM

To critically evaluate the current evidence surrounding consumer escalation within the context of clinical deterioration to identify the strengths, weaknesses and gaps in existing knowledge, essential themes, and directions for further investigation.

METHOD

Database searches were conducted within Cumulative Index of Nursing and Allied Health Literature, PubMed, and the Cochrane Library for articles directly relating to consumer escalation systems published, in English, within the previous 10 year-period. Titles and abstracts were screened and relevant full-text articles included. Content was examined to identify breadth of knowledge, essential themes, and the effectiveness of current systems.

RESULTS

27 articles, containing a mixture of both quantitative and qualitative findings, were identified. Within the context of limitations in the overall depth and quality of current evidence, four key areas (relating to consumer understanding and awareness of clinical deterioration, confidence and ability to escalate concerns, education, and staff attitudes) were identified as potentially critical to the foundation, functioning, and success of consumer escalation systems. Consumer escalation processes may contribute positive effects beyond mortality rates; however, an agreed method of assessing effectiveness remains undetermined.

CONCLUSIONS

The ability of consumer escalation processes to achieve their underlying goals is still to be adequately assessed. Further research is required to inform how to best implement, support and optimise consumer escalation systems.

Optimising paediatric afferent component early warning systems: a hermeneutic systematic literature review and model development

OBJECTIVE

To identify the core components of successful early warning systems for detecting and initiating action in response to clinical deterioration in paediatric inpatients.

METHODS

A hermeneutic systematic literature review informed by translational mobilisation theory and normalisation process theory was used to synthesise 82 studies of paediatric and adult early warning systems and interventions to support the detection of clinical deterioration and escalation of care. This method, which is designed to develop understanding, enabled the development of a propositional model of an optimal afferent component early warning system.

RESULTS

Detecting deterioration and initiating action in response to clinical deterioration in paediatric inpatients involves several challenges, and the potential failure points in early warning systems are well documented. Track and trigger tools (TTT) are commonly used and have value in supporting key mechanisms of action but depend on certain preconditions for successful integration into practice. Several supplementary interventions have been proposed to improve the effectiveness of early warning systems but there is limited evidence to recommend their wider use, due to the weight and quality of the evidence; the extent to which systems are conditioned by the local clinical context; and the need to attend to system component relationships, which do not work in isolation. While it was not possible to make empirical recommendations for practice, the review methodology generated theoretical inferences about the core components of an optimal system for early warning systems. These are presented as a propositional model conceptualised as three subsystems: detection, planning and action.

CONCLUSIONS

There is a growing consensus of the need to think beyond TTTs in improving action to detect and respond to clinical deterioration. Clinical teams wishing to improve early warning systems can use the model to consider systematically the constellation of factors necessary to support detection, planning and action and consider how these arrangements can be implemented in their local context.

PROSPERO REGISTRATION NUMBER

CRD42015015326.

Parent escalation of care for the deteriorating child in hospital: A health-care improvement study

OBJECTIVE

To evaluate the implementation of an intervention for parents to escalate care if concerned about their child's clinical condition.

DESIGN

Mixed-methods health-care improvement approach guided by the Theoretical Domains Framework.

METHODS

Implementation of the 'Calling for Help' (C4H) intervention was informed by previously identified barriers and facilitators. Evaluation involved audit, review of clinical deterioration incidents, interviews and focus groups.

SETTING

Australian specialist paediatric hospital.

PARTICIPANTS

Convenience sample of 75 parents from inpatient areas during the audit, interviews with ten parents who had expressed concern about their child's clinical condition; five focus groups with 35 ward nurses.

MAIN OUTCOME MEASURES

Parent awareness and utilization of C4H, parent and nurse views of factors influencing implementation.

RESULTS

Parent awareness of C4H improved to 35% (25/75). Parent concern was documented prior to 21/174 (12%) clinical deterioration events. All interviewed parents and nurses who participated in focus groups were positive about C4H. Parents preferred to be informed about C4H by nurses, but nurses described this as time-consuming and selectively chose parents who they believed would benefit most. Parents and nurses described frustrations with and trepidation in escalating care. Nurses had used C4H to expedite urgent medical review.

CONCLUSIONS

There was an improvement in the level of parent awareness of C4H, which was viewed positively by parents and nurses alike. To achieve a high level of parent awareness in a sustainable way, a multifaceted approach is required. Further strategies will be required for parents to feel confident enough to use C4H and to address interprofessional communication barriers.

Patients' experiences of acute deterioration: A scoping review

BACKGROUND

Patient experience is recognised as a means of assessing healthcare delivery with organisations in many countries now gathering patient experience or satisfaction data. It is well documented that the benefits of improving a patients' experience include increased satisfaction, reduced length of stay, improved patient outcomes and reduction of costs. The experience of acute clinical deterioration is unique, extensive and complex as well as being a difficult experience for all involved. However, little is known about this experience from the patient's perspective.

AIM

To explore what is known about the experiences of acute deterioration from the perspective of the patient.

DESIGN

A scoping review of international, peer-reviewed research studies and grey literature published between the years of 2000 and 2018. This review was guided by the three-step search strategy recommended by the Joanna Briggs Institute (JBI).

DATA SOURCES

A range of databases were searched, including CINAHL, Medline, Health Source, Joanna Briggs Institute, PsycINFO, Embase via Ovid, Cochrane library, Ovid Emcare, Scopus as well as grey literature, reference lists and the search engine Google Scholar.

REVIEW METHODS

Joanna Briggs Institute (JBI) scoping review framework was utilised to identify patients' experiences of acute deterioration. Ten databases were searched, and 249 articles were retrieved. After screening the titles and abstracts, 102 articles were assessed in full text for eligibility, and finally 23 articles were further analysed and synthesised using inductive thematic analysis.

RESULTS

19 qualitative studies, three quantitative and one mixed methods study met the inclusion criteria. Seven key themes emerged related to patients' experience of acute deterioration: (1) transformation of perception: memories of factual events; (2) psychological transformation: emotional distress and well-being; (3) physiological transformation: physical distress; (4) facing death; (5) the severity of acute deterioration: from the perspective of the patient; (6) relationship with healthcare professionals and the clinical environment; and (7) the value of relationships: the support of family and friends.

CONCLUSIONS

Participants had considerable recall of their experiences and hospital admissions. The themes highlight the important issues patients face during their own acute physiological deterioration. This review has highlighted that further research is needed to specifically explore the patients' experience of acute deterioration and the emergency management they receive, for example from a hospital's rapid response team (RRT) or medical emergency team (MET).

Patient and family-initiated escalation of care: a qualitative systematic review protocol

BACKGROUND

Despite the introduction of rapid response systems and early warning scores, clinical deterioration that is not recognised or responded to early enough prevails in acute care areas. One intervention that aims to address this issue and that is gaining increased attention is patient- and family-initiated escalation of care schemes. Existing systematic review evidence to date has tended to focus on identifying the impact or effectiveness of these schemes in practice. However, they have not tended to focus on qualitative evidence to consider the experience of deterioration and the factors that may promote or hinder engagement with these schemes in the practice setting. This systematic review will address this gap. The aim of this review is to explore patients', relatives' and healthcare professionals' experiences of deterioration and their perceptions of the barriers or facilitators to patient and family-initiated escalation of care in acute adult hospital wards.

METHODS

We will search Medline, CINAHL, Embase and PsycINFO databases using free-text and MESH terms relating to deterioration, family-initiated rapid response, families, patients, healthcare staff, hospital and experiences. We will search grey literature and reference lists of included studies for further published and unpublished literature. All studies with a qualitative design or method will be included. Two reviewers will independently assess studies for eligibility, extract data and appraise the quality of included studies. Data will be synthesised using a thematic synthesis approach, and findings will be presented narratively.

DISCUSSION

Patient- and family-initiated escalation of care schemes have been developed and implemented in several countries including the United States, the United Kingdom and Australia, but there is limited evidence regarding patients' or families' perceptions of deterioration or the barriers and facilitators to using these schemes in practice, particularly in acute adult areas. This systematic review will provide evidence for the development of a patient and family escalation of care scheme that can be tested in a feasibility study.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42018106952.

Patient and/or family activated rapid response service: Patients' perceptions of deterioration and need for a service

BACKGROUND

Patient and/or family activated escalation may improve care to deteriorating patients. However, limited literature describes patients' and families' experience of deterioration and what barriers might restrict call activation.

OBJECTIVE

This study explored patients' and families' experiences of acute ward deterioration, their perception of a need for a patient and/or family activated escalation service and barriers that may prevent them from using it.

DESIGN

Using a qualitative cross sectional research design and a co-design approach, data were collected using face-to-face semi-structured interviews, field notes and reflective journaling. Between December 2015 and February 2016, purposeful sampling recruited 41 adult ward patients and family who either experienced a recent Medical Emergency team (MET) or Patient at Risk team (PART) escalation, or no recent MET or PART escalation.

FINDINGS

Themes included: (1) patient awareness of their illness and deterioration, 2) the importance of returning to their normal lives, (3) reassurance on arrival of the PART and MET, (4) beliefs held to prevent use of such a service, and (5) support for a patient and/or family activated escalation service.

CONCLUSION

Most participants supported a patient and/or family activated escalation service, however barriers may prevent some patients from using it.

Barriers and facilitators to implementing a process to enable parent escalation of care for the deteriorating child in hospital

OBJECTIVE

To identify barriers and facilitators to implementing a parent escalation of care process: Calling for Help (C4H).

DESIGN

Audits, semi-structured interviews and focus groups guided by the Theoretical Domains Framework.

SETTING

Australian paediatric hospital where a parent escalation of care process was introduced in the previous 6 months.

PARTICIPANTS

Four children, 13 parents, 91 nurses and doctors including Medical Emergency Team (MET) members.

MAIN OUTCOME MEASURES

Parent awareness and involvement in escalating care and factors impacting implementation of C4H.

RESULTS

Two audits identified low level of parent awareness (16/88, 19% and 5/85, 6%). Parent involvement in escalation of care was documented in 11/62 (18%) events. The main facilitators included uniformly positive views that C4H was in the child's best interest, acknowledgement that parents had skills to recognize deterioration and would take action. C4H was considered to add to patient safety and being reviewed by the MET was a patient benefit. Key barriers were the low level of awareness, doubt about parent capabilities, concern about parents' information overload, anticipated overuse of resources, staff unease about possible repercussions and anticipated difficulty for parents to question staff with potential negative effects on parent-staff relationships. Overall C4H presents a challenge to traditional hospital hierarchy and culture.

CONCLUSIONS

Although there was a low level of awareness about C4H in practice, there was in-principle support for the concept. Initial strategies had primarily targeted policy change without taking into account the need for practice and organizational behaviour changes. Using a theoretical approach to identify key factors will enable a targeted approach to implementation.

Comparison of policies for recognising and responding to clinical deterioration across five Victorian health services

Objectives The aim of the present study was to describe and compare organisational guidance documents related to recognising and responding to clinical deterioration across five health services in Victoria, Australia. Methods Guidance documents were obtained from five health services, comprising 13 acute care hospitals, eight subacute care hospitals and approximately 5500 beds. Analysis was guided by a specific policy analysis framework and a priori themes. Results In all, 22 guidance documents and five graphic observation and response charts were reviewed. Variation was observed in terminology, content and recommendations between the health services. Most health services’ definitions of physiological observations fulfilled national standards in terms of minimum parameters and frequency of assessment. All health services had three-tier rapid response systems (RRS) in place at both acute and subacute care sites, consisting of activation criteria and an expected response. RRS activation criteria varied between sites, with all sites requiring modifications to RRS activation criteria to be made by medical staff. All sites had processes for patient and family escalation of care. Conclusions Current guidance documents related to the frequency of observations and escalation of care omit the vital role of nurses in these processes. Inconsistencies between health services may lead to confusion in a mobile workforce and may reduce system dependability. What is known about the topic? Recognising and responding to clinical deterioration is a major patient safety priority. To comply with national standards, health services must have systems in place for recognising and responding to clinical deterioration. What does this paper add? There is some variability in terminology, definitions and specifications of physiological observations and medical emergency team (MET) activation criteria between health services. Although nurses are largely responsible for physiological observations and escalation of care, they have little authority to direct frequency of observations and triggers for care escalation or tailor assessment to individual patient needs. Failure to identify nurses’ role in policy is concerning and contrary to the evidence regarding nurses and MET activations in practice. What are the implications for practitioners? Inconsistencies in recommendations regarding physiological observations and escalation of care criteria may create patient safety issues when students and staff work across organisations or move from one organisation to another. The validity of other parameters, such as appearance, pain, skin colour and cognition, warrant further consideration as early indicators of deterioration that may be used by nurses to identify clinical deterioration earlier. A better understanding of the relationship between the sensitivity, specificity and frequency of monitoring of particular physiological observations and patient outcomes is needed to improve the predictive validity for identification of clinical deterioration.