Five-Level Triage: A Report from the ACEP/ENA Five-Level Triage Task Force

Emergency Severity Index version 4: a valid and reliable tool in pediatric emergency department triage

OBJECTIVES

The Emergency Severity Index version 4 (ESI v.4) is the most recently implemented 5-level triage system. The validity and reliability of this triage tool in the pediatric population have not been extensively established. The goals of this study were to assess the validity of ESI v.4 in predicting hospital admission, emergency department (ED) length of stay (LOS), and number of resources utilized, as well as its reliability in a prospective cohort of pediatric patients.

METHODS

The first arm of the study was a retrospective chart review of 780 pediatric patients presenting to a pediatric ED to determine the validity of ESI v.4. Abstracted data included acuity level assigned by the triage nurse using ESI v.4 algorithm, disposition (admission vs discharge), LOS, and number of resources utilized in the ED. To analyze the validity of ESI v.4, patients were divided into 2 groups for comparison: higher-acuity patients (ESI levels 1, 2, and 3) and lower-acuity patients (ESI levels 4 and 5). Pearson χ analysis was performed for categorical variables. For continuous variables, we conducted a comparison of means based on parametric distribution of variables. The second arm was a prospective cohort study to determine the interrater reliability of ESI v.4 among and between pediatric triage (PT) nurses and pediatric emergency medicine (PEM) physicians. Three raters (2 PT nurses and 1 PEM physician) independently assigned triage scores to 100 patients; k and interclass correlation coefficient were calculated among PT nurses and between the primary PT nurses and physicians.

RESULTS

In the validity arm, the distribution of ESI score levels among the 780 cases are as follows: ESI 1: 2 (0.25%); ESI 2: 73 (9.4%); ESI 3: 289 (37%); ESI 4: 251 (32%); and ESI 5: 165 (21%). Hospital admission rates by ESI level were 1: 100%, 2: 42%, 3: 14.9%, 4: 1.2%, and 5: 0.6%. The admission rate of the higher-acuity group (76/364, 21%) was significantly greater than the lower-acuity group (4/415, 0.96%), P < 0.001. The mean ED LOS (in minutes) for the higher-acuity group was 257 (SD, 132) versus 143 (SD, 81) in the lower-acuity group, P < 0.001. The higher-acuity group also had significantly greater use of resources than the lower-acuity group, P < 0.001. The percentage of low-acuity patients receiving no resources was 54%, compared with only 26% in the higher-acuity group. Conversely, a greater percentage of higher-acuity patients utilized 2 or more resources than the lower-acuity cohorts, 43% vs 12%, respectively, P < 0.001. In the prospective reliability arm of the study, 15 PT nurses and 8 PEM attending physicians participated in the study; k among nurses was 0.92 and between the primary triage nurses and physicians was 0.78, P < 0.001. The intraclass correlation coefficient was 0.96 for PT nurses and 0.91 between the primary triage nurse and physicians, P < 0.001.

CONCLUSIONS

Emergency Severity Index v.4 is a valid predictor of hospital admission, ED LOS, and resource utilization in the pediatric ED population. It is a reliable pediatric triage instrument with high agreement among PT nurses and between PT nurses and PEM physicians.

The HEADS-ED: a rapid mental health screening tool for pediatric patients in the emergency department

BACKGROUND AND OBJECTIVE

The American Academy of Pediatrics called for action for improved screening of mental health issues in the emergency department (ED). We developed the rapid screening tool home, education, activities/peers, drugs/alcohol, suicidality, emotions/behavior, discharge resources (HEADS-ED), which is a modification of "HEADS," a mnemonic widely used to obtain a psychosocial history in adolescents. The reliability and validity of the tool and its potential for use as a screening measure are presented.

METHODS

ED patients presenting with mental health concerns from March 1 to May 30, 2011 were included. Crisis intervention workers completed the HEADS-ED and the Child and Adolescent Needs and Strengths-Mental Health tool (CANS MH) and patients completed the Children's Depression Inventory (CDI). Interrater reliability was assessed by using a second HEADS-ED rater for 20% of the sample.

RESULTS

A total of 313 patients were included, mean age was 14.3 (SD 2.63), and there were 182 females (58.1%). Interrater reliability was 0.785 (P < .001). Correlations were computed for each HEADS-ED category and items from the CANS MH and the CDI. Correlations ranged from r = 0.17, P < .05 to r = 0.89, P < .000. The HEADS-ED also predicted psychiatric consult and admission to inpatient psychiatry (sensitivity of 82% and a specificity of 87%; area under the receiver operator characteristic curve of 0.82, P < .01).

CONCLUSIONS

The results provide evidence to support the psychometric properties of the HEADS-ED. The study shows promising results for use in ED decision-making for pediatric patients with mental health concerns.

The Pediatric Assessment Triangle: accuracy of its application by nurses in the triage of children

INTRODUCTION

The Pediatric Assessment Triangle (PAT) is a rapid evaluation tool that establishes a child's clinical status and his or her category of illness to direct initial management priorities. Recently the PAT has been incorporated widely into the pediatric resuscitation curriculum. Although intuitive, its performance characteristics have yet to be quantified. The purpose of this research is to determine quantitatively its accuracy, reliability, and validity as applied by nurses at triage.

METHODS

In this prospective observational study, triage nurses performed the PAT on all patients presenting to the pediatric emergency department of an urban teaching hospital. Researchers performed blinded chart review using the physician's initial assessment and final diagnosis as the criterion standard for comparison.

RESULTS

A total of 528 children were included in the analysis. Likelihood ratios (LRs) were found for instability and category of pathophysiology using the PAT. Children deemed stable by initial PAT were almost 10 times more likely to be stable on further assessment (LR 0.12, 95% confidence interval [CI] 0.06-0.25). The PAT further specified categories of pathophysiology: respiratory distress (LR+ 4, 95% CI 3.1-4.8), respiratory failure (LR+ 12, 95% CI 4.0-37), shock (LR+ 4.2, 95% CI 3.1-5.6), central nervous system/metabolic disorder (LR+ 7, 95% CI 4.3-11), and cardiopulmonary failure (LR+ 49, 95% CI 20-120).

DISCUSSION

The structured assessment of the initial PAT, as performed by nurses in triage, readily and reliably identifies high-acuity pediatric patients and their category of pathophysiology. The PAT is highly predictive of the child's clinical status on further evaluation.

During and beyond the triage encounter: chronically ill elderly patients' experiences throughout their emergency department attendances

BACKGROUND

Chronically ill elderly patients are frequent users of care in emergency departments (EDs). Due to their presenting symptoms, these patients are often assessed on a low urgency level of priority by the triage nurse.

AIM

The aim of the study was to explore and describe the experiences of a group of chronically ill elderly patients' during their triage encounter and subsequent ED stay.

METHOD

The data consisted of 14 open-ended interviews with chronically ill patients aged between 71 and 90years. A lifeworld approach was used in order to describe the essence of patient experiences. The study was carried out with a descriptive phenomenological research perspective.

CONCLUSION

The visit to the ED was experienced as contradictory. The triage encounter fostered confidence and set promising expectations, but during the rest of the visit, the patient felt abandoned and considered the staff to be uncommitted and reluctant. These ambiguous experiences of their ED visits indicate a need for exploring possible ways of improving the situation for the chronically ill older person in ED.

Development and validation of the excess mortality ratio-based Emergency Severity Index

PURPOSE

The purpose of this study is to develop and validate the excess mortality ratio-based Emergency Severity Index (EMR-ESI) that feasibly and objectively assesses the severity of emergency department (ED) patients based on their chief complaints.

METHODS

We used data from the National Emergency Department Information System of Korea from January 2006 to December 2009. We obtained information on mortality and the corresponding chief complaints exhibited by patients presenting to all EDs. The EMR-ESI was computed from the ratio of sex-age standardized hospital mortality for each chief complaint and the sex-age standardized mortality of the entire population of Korea. We tested the discriminatory power of the EMR-ESI on the prediction of hospital outcomes using the area under the receiver operating characteristic curve (AUC) from a multivariate logistic regression model. This model was adjusted for clinical parameters, and the goodness of fit was estimated using the Hosmer-Lemeshow logistic model.

RESULTS

Included in the study were 4 713 462 patients who presented 7557 chief complaint codes from 2006 to 2008. The EMR-ESI had a range of 0 to 6389.45 (mean ± SD, 1.11 ± 4.67; median, 0.70). The adjusted odds ratio of the EMR-ESI (unit, 1.0) for hospital mortality was 1.11 (95% confidence interval, 1.11-1.12). The AUCs for predicting hospital mortality, ED mortality, admission mortality, and admission were 0.95, 0.98, 0.90, and 0.74, respectively. There were 3 422 865 patients from 2009 who were included for external validation, and the AUCs for predicting mortality in the hospital, the ED, the inpatient ward, and for predicting admission were 0.95, 0.99, 0.90, and 0.75, respectively.

CONCLUSION

The EMR-ESI was notably useful in predicting hospital mortality and the admission of emergency patients.

Experience of being a low priority patient during waiting time at an emergency department

BACKGROUND

Work in the emergency department is characterized by fast and efficient medical efforts to save lives, but can also involve a long waiting time for patients. Patients are given a priority rating upon their arrival in the clinic based on the seriousness of their problem, and nursing care for lower priority patients is given a lower prioritization. Regardless of their medical prioritization, all patients have a right to expect good nursing care while they are waiting. The purpose of this study was to illustrate the experience of the low prioritized patient during their waiting time in the emergency department.

METHODS

A phenomenological hermeneutic research method was used to analyze an interview transcript. Data collection consisted of narrative interviews. The interviewees were 14 patients who had waited more than three hours for surgical, orthopedic, or other medical care.

RESULTS

The findings resulted in four different themes, ie, being dependent on care, being exposed, being vulnerable, and being secure. Lower priority patients are not paid as much attention by nursing staff. Patients reported feeling powerless, insulted, and humiliated when their care was delayed without their understanding what was happening to them. Not understanding results in exposure that violates self-esteem.

CONCLUSION

The goal of the health care provider must be to minimize and prevent suffering, prevent feelings of vulnerability, and to create conditions for optimal patient well being.

More patients are triaged using the Emergency Severity Index than any other triage acuity system in the United States

OBJECTIVES

Patient acuity triage systems can play an important role in supporting patient safety and emergency department (ED) operations. In 2003, the boards of the American College of Emergency Physicians (ACEP) and the Emergency Nurses Association (ENA) approved a joint statement calling for hospitals to adopt a reliable, valid, five-level triage scale such as the Emergency Severity Index (ESI). Still, there appears to be considerable variation in use of triage acuity systems in the United States, with many hospitals using three- and four-level systems that have not been validated. The purpose of this effort was to measure the use of various triage acuity systems in U.S. hospitals.

METHODS

The authors conducted a cross-sectional analysis of secondary data. Data were obtained from the 2009 American Hospital Association (AHA) Annual Survey--an intensive questionnaire mailed to all U.S. general medical and surgical hospitals. In 2009, a question was added to the survey about hospitals' use of triage systems in EDs. Descriptive statistics were used to explore various triage acuity systems used by different types of hospitals.

RESULTS

Of the 4,897 hospitals surveyed, 82% responded, and 62% (3,024 hospitals) provided information on their ED triage system. The 2009 data revealed that the most commonly used triage system types were the five-level ESI (56.9% of responding hospitals) and three-level triage systems (25.2%). More than 70% of large hospitals and teaching hospitals use the ESI, and the unvalidated three-level systems were more common in small hospitals, public hospitals, nonteaching hospitals, and hospitals in the Midwest. The majority (72.1%) of all ED patient visits to hospitals in our sample were assessed using ESI; only 13.1% of visits were assessed using a three-level system.

CONCLUSIONS

Among our sample of more than 3,000 hospitals, the ESI was the most commonly used triage system, and more patients were triaged using the ESI than any other triage acuity system. Still, there is an opportunity to further promote the adoption of validated, reliable triage systems.

Emergency department triage: do experienced nurses agree on triage scores?

BACKGROUND

The reproducibility of the Canadian Triage & Acuity Scale (CTAS), designed and introduced in the late 1990s in all Canadian emergency departments (EDs), has been studied mostly using measures of interrater agreement. However, each of these studies shares a common limitation: the nurses had received fresh CTAS training, which is likely to have led to an overestimation of the reproducibility of CTAS.

OBJECTIVES

This study aims to assess the interrater reliability of the CTAS in current clinical practice, that is, as used by experienced ED nurses without recent certification or recertification.

METHODS

A prospective sample of 100 patients arriving by ambulance was identified and yielded a set of 100 written scenarios. Five experienced ED nurses reviewed and blindly assigned a CTAS score to each scenario. The agreement among nurses was measured using the Kappa statistic calculated with quadratic weights. Kappa values were generated for each pair of nurses and a global Kappa coefficient was calculated to measure overall agreement.

RESULTS

Overall interrater agreement was moderate, with a global Kappa of 0.44 (95% confidence interval 0.40-0.48). However, pairwise, Kappa values were heterogeneous (0.30 to 0.61, p=0.0013).

CONCLUSIONS

The moderate interrater agreement observed in this study is disappointingly low and suggests that CTAS reliability may be lower than expected, and this warrants further research. Intra-observer reliability of CTAS should be ascertained more extensively among experienced nurses, and a future evaluation should involve several institutions.

Swedish emergency department triage and interventions for improved patient flows: a national update

BACKGROUND

In Scandinavia, emergency department triage and patient flow processes, are under development. In Sweden, the triage development has resulted in two new triage scales, the Adaptive Process Triage and the Medical Emergency Triage and Treatment System. Both these scales have logistic components, aiming to improve patient flows. The aim of this study was to report the development and current status of emergency department triage and patient flow processes in Sweden.

METHODS

In 2009 and 2010 the Swedish Council on Health Technology Assessment sent out a questionnaire to the ED managers in all (74) Swedish hospital emergency departments. The questionnaire comprised questions about triage and interventions to improve patient flows.

RESULTS

Nearly all (97%) EDs in Sweden employed a triage scale in 2010, which was an increase from 2009 (73%). Further, the Medical Emergency Triage and Treatment System was the triage scale most commonly implemented across the country. The implementation of flow-related interventions was not as common, but more than half (59%) of the EDs have implemented or plan to implement nurse requested X-ray.

CONCLUSIONS

There has been an increase in the use of triage scales in Swedish EDs during the last few years, with acceleration for the past two years. Most EDs have come to use the Medical Emergency Triage and Treatment System, which also indicates regional co-operation. The implementation of different interventions for improved patient flows in EDs most likely is explained by the problem of crowding. Generally, more studies are needed to investigate the economical aspects of these interventions.

A computerized pneumococcal vaccination reminder system in the adult emergency department

BACKGROUND

Pneumococcal vaccination is an effective strategy to prevent invasive pneumococcal disease in the elderly. Emergency department (ED) visits present an underutilized opportunity to increase vaccination rates; however, designing a sustainable vaccination program in an ED is challenging. We examined whether an information technology supported approach would provide a feasible and sustainable method to increase vaccination rates in an adult ED.

METHODS

During a 1-year period we prospectively evaluated a team-oriented, workflow-embedded reminder system that integrated four different information systems. The computerized triage application screened all patients 65 years and older for pneumococcal vaccine eligibility with information from the electronic patient record. For eligible patients the computerized provider order entry system reminded clinicians to place a vaccination order, which was passed to the order tracking application. Documentation of vaccine administration was then added to the longitudinal electronic patient record. The primary outcome was the vaccine administration rate in the ED. Multivariate logistic regression analysis was used to estimate the odds ratios and their 95% confidence intervals, representing the overall relative risks of ED workload related variables associated with vaccination rate.

RESULTS

Among 3371 patients 65 years old and older screened at triage 1309 (38.8%) were up-to-date with pneumococcal vaccination and 2062 (61.2%) were eligible for vaccination. Of the eligible patients, 621 (30.1%) consented to receive the vaccination during their ED visit. Physicians received prompts for 428 (68.9%) patients. When prompted, physicians declined to order the vaccine in 192 (30.9%) patients, while 222 (10.8%) of eligible patients actually received the vaccine. The computerized reminder system increased vaccination rate from a baseline of 38.8% to 45.4%. Vaccination during the ED visit was associated younger age (OR: 0.972, CI: 0.953-0.991), Caucasian race (OR: 0.329, CI: 0.241-0.448), and longer ED boarding times (OR: 1.039, CI: 1.013-1.065).

CONCLUSION

The integrated informatics solution seems to be a feasible and sustainable model to increase vaccination rates in a challenging ED environment.

Emergency department triage scales and their components: a systematic review of the scientific evidence

Emergency department (ED) triage is used to identify patients' level of urgency and treat them based on their triage level. The global advancement of triage scales in the past two decades has generated considerable research on the validity and reliability of these scales. This systematic review aims to investigate the scientific evidence for published ED triage scales. The following questions are addressed: 1. Does assessment of individual vital signs or chief complaints affect mortality during the hospital stay or within 30 days after arrival at the ED?2. What is the level of agreement between clinicians' triage decisions compared to each other or to a gold standard for each scale (reliability)? 3. How valid is each triage scale in predicting hospitalization and hospital mortality? A systematic search of the international literature published from 1966 through March 31, 2009 explored the British Nursing Index, Business Source Premier, CINAHL, Cochrane Library, EMBASE, and PubMed. Inclusion was limited to controlled studies of adult patients (≥ 15 years) visiting EDs for somatic reasons. Outcome variables were death in ED or hospital and need for hospitalization (validity). Methodological quality and clinical relevance of each study were rated as high, medium, or low. The results from the studies that met the inclusion criteria and quality standards were synthesized applying the internationally developed GRADE system. Each conclusion was then assessed as having strong, moderately strong, limited, or insufficient scientific evidence. If studies were not available, this was also noted.We found ED triage scales to be supported, at best, by limited and often insufficient evidence.The ability of the individual vital signs included in the different scales to predict outcome is seldom, if at all, studied in the ED setting. The scientific evidence to assess interrater agreement (reliability) was limited for one triage scale and insufficient or lacking for all other scales. Two of the scales yielded limited scientific evidence, and one scale yielded insufficient evidence, on which to assess the risk of early death or hospitalization in patients assigned to the two lowest triage levels on a 5-level scale (validity).

Emergency department abnormal vital sign "triggers" program improves time to therapy

BACKGROUND

Implementation of rapid response systems to identify deteriorating patients in the inpatient setting has demonstrated improved patient outcomes. A "trigger" system using vital sign abnormalities to initiate evaluation by physician was recently described as an effective rapid response method.

OBJECTIVES

The objective was to evaluate the effect of a triage-based trigger system on the primary outcome of time to physician evaluation and the secondary outcomes of therapeutic intervention, antibiotics, and disposition in emergency department (ED) patients.

METHODS

A separate-samples pre- and postintervention study was conducted using retrospective chart review of outcomes in ED patients for three arbitrarily selected 5-day periods in 2007 (pretriggers) and 2008 (posttriggers). There were 2,165 and 2,212 charts in the pre- and posttriggers chart review, with 71 and 79 patients meeting trigger criteria. Trigger criteria used to identify patients at triage were: heart rate of <40 or >130 beats/min, respiratory rate of <8 or >30 breaths/min, systolic blood pressure of <90 mm Hg, and oxygen saturation of <90% on room air. Median times (in minutes) were compared between pre- and posttrigger groups with interquartile ranges (IQRs 25-75), with the Wilcoxon rank sum test used to determine statistical significance.

RESULTS

Overall median times were decreased among the posttriggers group. Median times to physician evaluation (21 minutes [IQR = 13-41 minutes] vs. 11 minutes [IQR = 5-21 minutes]; p < 0.001), first intervention (58 minutes [IQR = 20-139 minutes] vs. 26 minutes [IQR = 11-71 minutes]; p < 0.01), and antibiotics (110 minutes [IQR = 74-171 minutes] vs. 69 minutes [IQR = 23-130 minutes]; p < 0.01) were significant. Median times to disposition (177 minutes [IQR = 121-303 minutes] vs. 162 minutes [IQR = 114-230 minutes]; p = 0.18) were not significant.

CONCLUSIONS

Implementation of an ED triggers program allows for more rapid time to physician evaluation, therapeutic intervention, and antibiotics.

Exploring differences in the clinical management of pediatric mental health in the emergency department

OBJECTIVE

: We examine psychiatric and pediatric clinical management of pediatric mental health in the emergency department (ED).

METHODS

: We conducted a retrospective review of health care delivery with a random sample of all pediatric mental health presentations (≤18 years) to 2 urban tertiary care EDs between 2004 and 2006 (N = 580).

RESULTS

: The EDs differed significantly in services offered. General emergency medicine-trained physicians provided care at 1 site (54.6%) with a number of visits also managed by a psychiatric crisis team (45.4%). Care at the other ED was delivered by pediatric emergency medicine-trained physicians (99.4%) with no regular on-site psychiatric services. The most common assessment provided across sites and all presentations was for suicidality (66.2%). After controlling for potential confounders, receipt of clinical assessment for homicidality, mood, or reality testing differed between EDs (P = 0.044, P = 0.006, and P = 0.002) with more assessments documented at the psychiatric-resourced ED. Brief counseling was lacking for visits (absence of documentation: 56.1% pediatric-resourced, 23.1% psychiatric-resourced ED); there was no evidence of site differences in provision. More psychiatric consultation was provided at the psychiatric-resourced ED (34.1% vs 27.4%, P = 0.030). Discharge recommendations were lacking in both EDs but were more incomplete for pediatric-resourced ED visits (P = 0.035).

CONCLUSIONS

: Consistent and comprehensive clinical management of pediatric mental health presentations was lacking in EDs that had pediatric and psychiatric resources. Prospective evaluations are needed to determine the effect of current clinical ED practices on patient and family outcomes, including symptom reduction and stress, as well as subsequent system use.

Modern triage in the emergency department

BACKGROUND

Because the volume of patient admissions to an emergency department (ED) cannot be precisely planned, the available resources may become overwhelmed at times ("crowding"), with resulting risks for patient safety. The aim of this study is to identify modern triage instruments and assess their validity and reliability.

METHODS

Review of selected literature retrieved by a search on the terms "emergency department" and "triage."

RESULTS

Emergency departments around the world use different triage systems to assess the severity of incoming patients' conditions and assign treatment priorities. Our study identified four such instruments: the Australasian Triage Scale (ATS), the Canadian Triage and Acuity Scale (CTAS), the Manchester Triage System (MTS), and the Emergency Severity Index (ESI). Triage instruments with 5 levels are superior to those with 3 levels in both validity and reliability (p<0.01). Good to very good reliability has been shown for the best-studied instruments, CTAS and ESI (κ-statistics: 0.7 to 0.95), while ATS and MTS have been found to be only moderately reliable (κ-statistics: 0.3 to 0.6). MTS and ESI are both available in German; of these two, only the ESI has been validated in German-speaking countries.

CONCLUSION

Five-level triage systems are valid and reliable methods for assessment of the severity of incoming patients' conditions by nursing staff in the emergency department. They should be used in German emergency departments to assign treatment priorities in a structured and dependable fashion.

Transporting clinical tools to new settings: cultural adaptation and validation of the Emergency Severity Index in German

STUDY OBJECTIVE

To date, no German triage tool with proven reliability and validity exists. The goal of this project is to translate and culturally adapt the Emergency Severity Index (ESI) and to assess reliability and validity of the German version.

METHODS

The ESI was translated following principles recommended for the translation and cultural adaptation of instruments. We performed a prospective, single-center cohort study. Reliability was assessed by calculating Cohen's weighted κ for agreement of 2 experts who reviewed the triage nurses' notes. To assess validity, associations of the number of resources, hospitalization, admission to intensive care, length of stay, and mortality with the assigned ESI level were investigated.

RESULTS

Only small cultural adaptations had to be made during the translation process. Interrater agreement was high (κ(w) = 0.985) in a sample of 125 patients. For the assessment of validity, a sample of 2,114 patients was used. Spearman's rank correlation coefficient between ESI category and number of resources was ρ = -0.567. The association (Kendall's τ) between ESI category and disposition, and hospitalization was τ = -0.429 and τ = -0.453, respectively. The areas under the curves for the predictive ability of the ESI for hospitalization in general and hospitalization to an ICU were 0.788 and 0.856, respectively. The association between emergency department length of stay and ESI category was also significant (Kruskal-Wallis χ² = 450.8; df = 4; P < .001). Furthermore, the association between ESI category and survival probability was significant (log-rank χ² = 36.06; df = 3; P < .001).

CONCLUSION

Translation of the ESI following guidelines was feasible and resulted in a reliable and valid German version.

The use of and satisfaction with the Emergency Severity Index

INTRODUCTION

The Emergency Severity Index (ESI) is a 5-level emergency department triage algorithm designed to facilitate the sorting and streaming of patients. The purpose of this study was to assess the use of the ESI in emergency departments, including satisfaction with the ESI, usefulness of the ESI compared with other triage algorithms, and lessons learned from implementation.

METHODS

A self-administered questionnaire was sent to 935 people who requested the ESI training materials from the Agency for Healthcare Research and Quality (AHRQ) at the U.S. Department of Health and Human Services and who volunteered to participate in a study about the ESI. The response rate for the survey was 42% (n = 392). Telephone interviews were conducted with an additional 19 ED professionals. Descriptive statistics and qualitative content analysis were used in the data analysis.

RESULTS

Three hundred twenty-two survey respondents (82%) reported that they use the ESI in their emergency department. Satisfaction with the ESI triage algorithm is high. ESI users indicated that the ESI is more accurate than other triage algorithms and that its strengths are simplicity of use and the ability to reduce the subjectivity of triage.

DISCUSSION

The majority of ED professionals who reported using the ESI were very satisfied with the tool. Users found that it was more accurate than other triage algorithms and reduced the subjectivity of the triage process. Both survey and interview findings indicated that few emergency departments have formally assessed the impact of the ESI on ED operations.

Factors influencing patient assignment to level 2 and level 3 within the 5-level ESI triage system

INTRODUCTION

Prospectively assessing factors that influence triage nurse assignment of patients to the higher risk level 2 compared to the lower risk level 3 has not previously been explored within the 5-level Emergency Severity Index (ESI) triage system. Considering the large amount of information available about the patient, less experienced triage nurses often struggle in deciding what patient information is truly relevant when assessing if a high-risk situation exists. The primary aim of this study was to identify specific factors used by triage nurses to differentiate level 2 patients from level 3 patients.

METHODS

A convenience sample of triage nurses was recruited from 2 ED sites. If at the completion of the nurse-patient triage interaction the nurse assigned the patient to either level 2 or level 3, the triage nurse then completed a questionnaire related to factors that influenced patient assignment.

RESULTS

Overall, 18 triage nurses participated in the study with a total of 334 nurse-patient triage interactions collected. Patient age, vital signs, and need for a timely intervention were found to be significant factors that influenced patient assignment to level 2 while expected number of resources influenced patient assignment to level 3.

DISCUSSION

Utilizing experienced triage nurses on average, this study identified specific, objective factors that, combined with factors already delineated in the ESI Version 4 Implementation Manual, have useful implications for less experienced triage nurses by providing a more comprehensive and relevant foundation for data gathering and decision making.

Calculating kappas from adjusted data improved the comparability of the reliability of triage systems: a comparative study

OBJECTIVES

It is difficult to compare the reliability of triage systems with the kappa statistic. In this article, a method for comparing triage systems was developed and applied to previously conducted triage reliability studies.

STUDY DESIGN AND SETTING

From simulations with theoretical distributions, the minimum, normal, and maximum weighted kappa for 3- to 5-level triage systems were computed. To compare the reliability of triage systems in previously conducted triage reliability studies, the normal kappa was calculated. Furthermore, the reported quadratically weighted kappas were compared with the minimum, normal, and maximum weighted kappa to characterize the degree and direction of skewness of the data.

RESULTS

The normal kappa was higher in 3-level triage systems (median: κ=0.84) compared with 4-level (median: κ=0.37) and 5-level (median: κ=0.57) systems. In 3-level triage systems, the percentages observed agreement were unequally distributed, which resulted in small quadratically weighted kappas. In 4- and 5-level systems, the percentages observed agreement were more equally distributed compared with 3-level systems, which resulted in higher quadratically weighted kappa values.

CONCLUSION

When comparing triage systems with different numbers of categories, one should report both the normal and quadratically weighted kappa. Calculating normal kappas from previously conducted triage reliability studies revealed substantial theoretical differences in interrater reliability of triage systems than previously reported.

Development and validation of a mass casualty conceptual model

PURPOSE

To develop and validate a conceptual model that provides a framework for the development and evaluation of information systems for mass casualty events.

DESIGN

The model was designed based on extant literature and existing theoretical models. A purposeful sample of 18 experts validated the model. Open-ended questions, as well as a 7-point Likert scale, were used to measure expert consensus on the importance of each construct and its relationship in the model and the usefulness of the model to future research.

METHODS

Computer-mediated applications were used to facilitate a modified Delphi technique through which a panel of experts provided validation for the conceptual model. Rounds of questions continued until consensus was reached, as measured by an interquartile range (no more than 1 scale point for each item); stability (change in the distribution of responses less than 15% between rounds); and percent agreement (70% or greater) for indicator questions.

FINDINGS

Two rounds of the Delphi process were needed to satisfy the criteria for consensus or stability related to the constructs, relationships, and indicators in the model. The panel reached consensus or sufficient stability to retain all 10 constructs, 9 relationships, and 39 of 44 indicators. Experts viewed the model as useful (mean of 5.3 on a 7-point scale).

CONCLUSIONS

Validation of the model provides the first step in understanding the context in which mass casualty events take place and identifying variables that impact outcomes of care.

CLINICAL RELEVANCE

This study provides a foundation for understanding the complexity of mass casualty care, the roles that nurses play in mass casualty events, and factors that must be considered in designing and evaluating information-communication systems to support effective triage under these conditions.

US emergency department performance on wait time and length of visit

STUDY OBJECTIVE

Prolonged emergency department (ED) wait time and length of visit reduce quality of care and increase adverse events. Previous studies have not examined hospital-level performance on ED wait time and visit length in the United States. The purpose of this study is to describe hospital-level performance on ED wait time and visit length.

METHODS

We conducted a retrospective cross-sectional study of a stratified random sampling of 35,849 patient visits to 364 nonfederal US hospital EDs in 2006, weighted to represent 119,191,528 visits to 4,654 EDs. Measures included EDs' median wait times and visit lengths, EDs' median proportion of patients treated by a physician within the time recommended at triage, and EDs' median proportion of patients dispositioned within 4 or 6 hours.

RESULTS

In the median ED, 78% (interquartile range [IQR], 63% to 90%) of all patients and 67% (IQR, 52% to 82%) of patients who were triaged to be treated within 1 hour were treated by a physician within the target triage time. A total of 31% of EDs achieved the triage target for more than 90% of their patients; 14% of EDs achieved the triage target for 90% or more of patients triaged to be treated within an hour. In the median ED, 76% (IQR 54% to 94%) of patients were admitted within 6 hours. A total of 48% of EDs admitted more than 90% of their patients within 6 hours, but only 25% of EDs admitted more than 90% of their patients within 4 hours.

CONCLUSION

A minority of hospitals consistently achieved recommended wait times for all ED patients, and fewer than half of hospitals consistently admitted their ED patients within 6 hours.

Who comes back? Characteristics and predictors of return to emergency department services for pediatric mental health care

OBJECTIVES

The objective of this study was to investigate predictors of emergency department (ED) return visits for pediatric mental health care. The authors hypothesized that through the identification of clinical and health system variables that predict return ED visits, which children and adolescents would benefit from targeted interventions for persistent mental health needs could be determined.

METHODS

Data on 16,154 presentations by 12,589 pediatric patients (<or=17 years old) were examined from 2002 to 2006, using the Ambulatory Care Classification System (ACCS), a provincewide database for Alberta, Canada. Multivariable logistic regressions identified predictors, while survival analyses estimated time to ED return.

RESULTS

In the multivariable analysis, there were four patient factors significantly associated with ED return. Male sex (odds ratio [OR] = 0.78; 99% confidence interval [CI] = 0.69 to 0.89) was associated with a lower rate of return, as was child age. The likelihood of ED return increased with age. Children <or=5 years (OR = 0.26; 99% CI = 0.14 to 0.46) and between ages 6 and 12 (OR = 0.64; 99% CI = 0.51 to 0.79) were less likely to return, compared to 13- to 17-year-olds. Patients with families receiving full assistance for covering government health care premiums were more likely to return compared to those with no assistance (OR = 1.59; 99% CI = 1.33 to 1.91). Patients were more likely to return if their initial presentation was for a mood disorder (OR = 1.72; 99% CI = 1.46 to 2.01) or psychotic-related illness (OR = 2.53; 99% CI = 1.80 to 3.56). There were two modest health care system predictors in the model. The likelihood of return decreased for patients triaged as nonurgent (OR = 0.62; 99% CI = 0.45 to 0.87) versus those triaged as urgent (level 3 acuity) and increased for patients with visits to general (vs. pediatric) EDs (OR = 1.25; 99% CI = 1.03 to 1.52). ED region (urban vs. rural) did not predict return. Within 72 hours of discharge, 6.1 and 8.7% of patients diagnosed with a mood disorder and psychotic-related illness, respectively, returned to the ED. Throughout the study period, 28.5 and 36.6% of these diagnostic populations, respectively, returned to the ED.

CONCLUSIONS

Among children and adolescents who accessed the ED for mental health concerns, being female, older in age, in receipt of social assistance, and having an initial visit for a mood disorder or psychotic-related illness were associated with return for further care. How patient presentations were triaged and whether visits were made to a pediatric or general ED also affected the likelihood of return.

Percentage of US emergency department patients seen within the recommended triage time: 1997 to 2006

BACKGROUND

The wait time to see a physician in US emergency departments (EDs) is increasing and may differentially affect patients with varied insurance status and racial/ethnic backgrounds.

METHODS

Using a stratified random sampling of 151 999 visits, representing 539 million ED visits from 1997 to 2006, we examined trends in the percentage of patients seen within the triage target time by triage category (emergent, urgent, semiurgent, and nonurgent), payer type, and race/ethnicity.

RESULTS

The percentage of patients seen within the triage target time declined a mean of 0.8% per year, from 80.0% in 1997 to 75.9% in 2006 (P < .001). The percentage of patients seen within the triage target time declined 2.3% per year for emergent patients (59.2% to 48.0%; P < .001) compared with 0.7% per year for semiurgent patients (90.6% to 84.7%; P < .001). In 2006, the adjusted odds of being seen within the triage target time were 30% lower than in 1997 (odds ratio, 0.70; 95% confidence interval, 0.55-0.89). The adjusted odds of being seen within the triage target time were 87% lower (odds ratio, 0.13; 95% confidence interval, 0.11-0.15) for emergent patients compared with semiurgent patients. Patients of each payment type experienced similar decreases in the percentage seen within the triage target over time (P for interaction = .24), as did patients of each racial/ethnic group (P = .05).

CONCLUSIONS

The percentage of patients in the ED who are seen by a physician within the time recommended at triage has been steadily declining and is at its lowest point in at least 10 years. Of all patients in the ED, the most emergent are the least likely to be seen within the triage target time. Patients of all racial/ethnic backgrounds and payer types have been similarly affected.

Patient experience of the triage encounter in a Swedish emergency department

Emergency department triage is a prerequisite for the rapid identification of critically ill patients and for allocation of the correct acuity level which is pivotal for medical safety. The patient's first encounter with a medical professional in the emergency department is often with the triage nurse.

OBJECTIVES

To identify patient experience of the triage encounter.

METHODS

A questionnaire focusing on the patient-triage nurse relationship in terms of satisfaction with the medical and administrative information, privacy and confidentiality in the triage area as well as triage nurse competence and attitude was answered by 146 participating patients.

RESULTS

The majority of patients perceived that while they were triaged immediately upon arrival to the emergency department, they were often given limited information about the waiting time. Although almost a quarter of the patients did not wish to have information about their medical condition from the triage nurse, 97% of the patients considered the triage nurse to be medically competent for the triage task.

CONCLUSIONS

Patients were generally satisfied with the reception and care given by the triage nurses, but less satisfied about information about expected waiting time. We suggest therefore, that patients should be routinely informed about their estimated waiting time to be seen by the doctor in addition to their triage level.

Reliability and validity of the emergency severity index for pediatric triage

OBJECTIVES

The Emergency Severity Index (ESI) triage algorithm is a five-level triage acuity tool used by emergency department (ED) triage nurses to rate patients from Level 1 (most acute) to Level 5 (least acute). ESI has established reliability and validity in an all-age population, but has not been well studied for pediatric triage. This study assessed the reliability and validity of the ESI for pediatric triage at five sites.

METHODS

Interrater reliability was measured with weighted kappa for 40 written pediatric case scenarios and 100 actual patient triages at each of five research sites (independently rated by both a triage nurse and a research nurse). Validity was evaluated with a sample of 200 patients per site. The ESI ratings were compared with outcomes, including hospital admission, resource consumption, and ED length of stay.

RESULTS

Interrater reliability was 0.77 (95% confidence interval [CI] = 0.76 to 0.78) for the scenarios (n = 155 nurses) and 0.57 (95% CI = 0.52 to 0.62) for actual patients (n = 498 patients). Inconsistencies in triage were noted for the most acute and least acute patients, as well as those less than 1 year of age and those with medical (rather than trauma) chief complaints. For the validity cohort (n = 1,173 patients), outcomes differed by ESI level, including hospital admission, which went from 83% for Level 1 patients to 0% for Level 5 (chi-square, p < 0.0001). Nurses from dedicated pediatric EDs were 31% less likely to undertriage patients than nurses in general EDs (odds ratio [OR] = 0.31, 95% CI = 0.14 to 0.67).

CONCLUSIONS

Reliability of the ESI for pediatric triage is moderate. The ESI provides a valid stratification of pediatric patients into five distinct groups. We found several areas in which nurses have difficulty triaging pediatric patients consistently. The study results are being used to develop pediatric-specific ESI educational materials to strengthen reliability and validity for pediatric triage.

The Emergency Severity Index Version 4: reliability in pediatric patients

OBJECTIVES

The Emergency Severity Index version 4 (ESI v.4) is a triage system, which demonstrates reliability in adult populations, however, it has not been extensively studied in pediatrics. The goal of this study was to measure interrater reliability and agreement rates within and between a group of pediatric emergency medicine physicians and pediatric triage (PT) nurses using ESI v.4 in a pediatric population.

METHODS

Pediatric emergency medicine physicians and PT nurses completed ESI v.4 training and a survey of 20 pediatric case scenarios, requiring them to assign a triage category to each case. Cases and standardized responses were adapted from the ESI v.4 training materials. Unweighted and weighted kappa was measured, and agreement rates for each group were compared with the standard response.

RESULTS

Sixteen physicians and 17 nurses completed the study. The group had a mean of 10.2 (+/-7.7) years experience in pediatrics. Nurses had a mean of 7.6 (+/-8.7) years experience in triage. Unweighted kappa for physicians and nurses was 0.68 and 0.67, respectively. Weighted kappa for physicians and nurses was 0.92 and 0.93, respectively. The agreement rate among physicians and nurses with the standardized responses to case scenarios was 83%.

CONCLUSIONS

ESI v.4 is a reliable tool for triage assessments in pediatric patients when used by experienced pediatric emergency medicine physicians and PT nurses. It is a triage system with high agreement between physicians and nurses.

Reliability of a computerized version of the Pediatric Canadian Triage and Acuity Scale

BACKGROUND

The use of a standardized triage tool allows better comparison of the patients; a computerized version could theoretically improve its reliability.

OBJECTIVES

To compare the interrater agreement of the Pediatric Canadian Triage and Acuity Scale (PedCTAS) and a computerized version (Staturg).

METHODS

A two-phase experimental study was conducted to compare the interrater agreement between nurses assigning triage level to written case scenarios using either traditional PedCTAS or Staturg. Participants were nurses with at least one year of experience in pediatric emergency medicine and trained at triage. Each of the 54 scenarios was evaluated first by all nurses using either one of the strategies. Four weeks later, they evaluated the same scenarios using the other tool. The primary outcome was the interrater agreement measured using kappa score.

RESULTS

Eighteen of the 29 eligible nurses participated in the study. The computerized triage tool showed a better interrater agreement, with a Staturg kappa score of 0.55 (95% confidence interval = 0.53 to 0.57) versus a PedCTAS kappa score of 0.51 (95% confidence interval = 0.49 to 0.53). The computerized version was also associated with higher agreements for scenarios describing patients with the highest severity of triage (kappa score of 0.72 vs. 0.55 for level 1; kappa score of 0.70 vs. 0.51 for level 2).

CONCLUSIONS

A computerized version of the PedCTAS showed a statistically significant improvement in the interrater agreement for nurses evaluating the triage level of 54 clinical scenarios, but this difference has probably small clinical significance.

Limitations in validating emergency department triage scales

OBJECTIVE

To examine whether current validation methods of emergency department triage scales actually assess the instrument's validity.

METHODS

Optimal methods of emergency department triage scale validation are examined in developed countries and their application to developing countries is considered.

RESULTS AND CONCLUSION

Numerous limitations are embedded in the process of validating triage scales. Methods of triage scale validation in developed countries may not be appropriate and repeatable in developing countries. Even in developed countries there are problems in conceptualising validation methods. A new consensus building validation approach has been constructed and recommended for a developing country setting. The Delphi method, a consensual validation process, is advanced as a more appropriate alternative for validating triage scales in developing countries.

Influence of task properties and subjectivity on consistency of triage: a simulation study

AIM

This paper reports a study to determine nurses' levels of agreement using a standard 5-point triage scale and to explore the influence of task properties and subjectivity on decision-making consistency.

BACKGROUND

Triage scales are used to define time-to-treatment in hospital emergency departments. Studies of the inter-rater reliability of these scales using paper-based simulation methods report varying levels of consistency. Understanding how various components of the decision task and individual perceptions of the case influence agreement is critical to the development of strategies to improve consistency of triage.

METHOD

Simulations were constructed from naturalistic observation, cue types and frequencies were classified. Data collection was conducted in 2002, and the final response rate was 41 x 3%. Participants were asked to allocate an urgency code for 12 scenarios using the Australasian Triage Scale, and provide estimates of case complexity, levels of certainty and available information. Data were analysed descriptively, agreement between raters was calculated using kappa. The influence of task properties and participants' subjective estimates of case complexity, levels of certainty and available information on agreement were explored using a general linear model.

FINDINGS

Agreement among raters varied from moderate to poor (kappa=0 x 18-0 x 64). Participants' subjective estimates of levels of available information were found to influence consistency of triage by statistically significant amounts (F 5 x 68; <or=0 x 01).

CONCLUSIONS

Strategies employed to optimize consistency of triage should focus on improving the quality of the simulations that are used. In particular, attention should be paid to the development of interactive simulations that will accommodate individual differences in information-seeking behaviour.

Triage in medicine, part I: Concept, history, and types

This 2-article series offers a conceptual, historical, and moral analysis of the practice of triage. Part I distinguishes triage from related concepts, reviews the evolution of triage principles and practices, and describes the settings in which triage is commonly practiced. Part II identifies and examines the moral values and principles underlying the practice of triage.

Emergency department triage: is there a link between nurses' personal characteristics and accuracy in triage decisions?

INTRODUCTION

A common task of registered nurses is to perform emergency department triage, often using an especially designed triage scale in their assessment. However, little information is available about the factors that promote the quality of these decisions. This study investigated personal characteristics of registered nurses and the accuracy in their acuity ratings of patient scenarios.

METHODS

Using the Canadian Triage and Acuity Scale (CTAS), 423 registered nurses from 48 (62%) Swedish emergency departments individually triaged 18 patient scenarios.

RESULTS

The registered nurses' percentage of accurate acuity ratings was 58%, with a range from 22% to 89% accurate acuity ratings per registered nurse. In total, 60.3% of the registered nurses accurately triaged the scenarios in 50-69% of the cases. No relationship was found between personal characteristics of the registered nurses and their ability to triage.

DISCUSSION

The lack of a relationship between personal characteristics of registered nurses and their ability to triage suggests that there might be intrapersonal characteristics, particularly the decision-making strategies used which can partly explain this dispersion. Future research that focuses on decision-making is likely to contribute in identifying and describing essential nursing characteristics for successful emergency department triage.

Accuracy and concordance of nurses in emergency department triage

In the emergency department (ED) Registered Nurses (RNs) often perform triage, i.e. the sorting and prioritizing of patients. The allocation of acuity ratings is commonly based on a triage scale. To date, three reliable 5-level triage scales exist, of which the Canadian Triage and Acuity Scale (CTAS) is one. In Sweden, few studies on ED triage have been conducted and the organization of triage has been found to vary considerably with no common triage scale. The aim of this study was to investigate the accuracy and concordance of emergency nurses acuity ratings of patient scenarios in the ED setting. Totally, 423 RNs from 48 (62%) Swedish EDs each triaged 18 patient scenarios using the CTAS. Of the 7,550 triage ratings, 57.6% were triaged in concordance with the expected outcome and no scenario was triaged into the same triage level by all RNs. Inter-rater agreement for all RNs was kappa = 0.46 (unweighted) and kappa = 0.71 (weighted). The fact that the kappa-values are only moderate to good and the low concordance between the RNs call for further studies, especially from a patient safety perspective.