Reliability of the Canadian Triage and Acuity Scale: interrater and intrarater agreement from a community and an academic emergency department

Feasibility and acceptability of a serious game to study the effects of environmental distractors on emergency room nurse triage accuracy: A pilot study

BACKGROUND

Emergency triage, which involves complex decision-making under stress and time constraints, may suffer from inaccuracies due to workplace distractions. A serious game was developed to simulate the triage process and environment. A pilot study was undertaken to collect preliminary data on the effects of distractors on emergency nurse triage accuracy.

METHOD

A 2 × 2 factorial randomized controlled trial (RCT) was designed for the study. A sample of 70 emergency room nurses was randomly assigned to three experimental groups exposed to different distractors (noise, task interruptions, and both) and one control group. Nurses had two hours to complete a series of 20 clinical vignettes, in which they had to establish a chief complaint and assign an emergency level.

RESULTS

Fifty-five nurses completed approximately 15 vignettes each during the allotted time. No intergroup differences emerged in terms of triage performance. Nurses had a very favorable appreciation of the serious game focusing on triage.

CONCLUSION

The results show that both the structure of our study and the serious game can be used to carry out a future RCT on a larger scale. The lack of a distractor effect raises questions about the frequency and intensity required to find a significant impact on triage performance.

A comparison between the impacts of lecturing and flipped classrooms in virtual learning on triage nurses' knowledge and professional capability: an experimental study

BACKGROUND

The quality of triage in emergency department depends on regular evaluation of triage nurses' professional capabilities and development of programs to improve them. Flipped classrooms are a new approach to learning which can be employed to improve professional capabilities. The present study aims to compare the impact of lecturing to flipped classrooms in virtual learning on the knowledge and professional capabilities of triage nurses in the emergency departments of the state hospitals of Yazd province in south-western Iran in 2022.

METHODS

The present study is an experimental work of research. Seventy-four triage nurses participated in the study. Seventy-four triage nurses were randomly allocated to the two groups, including flipped classrooms (group B) and lecturing (group A). The data collection instruments were an emergency department triage nurses' professional capability questionnaire and a triage knowledge questionnaire. The collected data were analyzed in SPSS v.22 using independent t-test, chi-squared test, and repeated measures analysis of variance. Level of significance was set at p ≥ 0.05.

RESULTS

The participants' mean age was 33.1 ± 4.3 years. As measured one month after the education, the triage knowledge mean score of the nurses who were educated using the flipped classroom method (9.29 ± 1.73) was higher than that of the nurses who were educated via lecturing (8.45 ± 1.788), and the difference was statistically significant (p = 0.001). Also, measured one month after the education, the professional capability mean score of the nurses who were educated using the flipped classroom method (140.27 ± 11.744) was higher than that of the nurses who were educated via lecturing (132.84 ± 10.817), and the difference was statistically significant (p = 0.006).

CONCLUSION

There was a significant difference between the pretest and posttest knowledge and professional capability mean scores of both groups immediately after the education. However, measured one month after the education, the mean and standard deviation of the knowledge and professional capability scores of the triage nurses who had been educated via flipped classrooms were higher than those of the nurses in the lecturing group. Thus, virtual learning using flipped classrooms is more effective than lecturing in improving triage nurses' knowledge and professional capability in the long run.

Does the definition of preventable emergency department visit matter? An empirical analysis using 20 million visits in Ontario and Alberta

OBJECTIVES

This study had two objectives: (1) to estimate the prevalence of preventable emergency department (ED) visits during the 2016-2020 time period among those living in 19 large urban centers in Alberta and Ontario, Canada, and (2) to assess if the definition of preventable ED visits matters in estimating the prevalence.

METHODS

A retrospective, population-based study of ED visits that were reported to the National Ambulatory Care Reporting System from April 1, 2016, to March 31, 2020, was conducted. Preventable ED visits were operationalized based on the following approaches: (1) Canadian Triage and Acuity Scale (CTAS), (2) ambulatory care-sensitive conditions (ACSC), (3) family practice-sensitive conditions (FPSC), and (4) sentinel nonurgent conditions (SNC). The overall proportion of ED visits that were preventable was estimated. We also estimated the adjusted relative risks of preventable ED visits by patients' sex and age, fiscal year, province of residence, and census metropolitan area (CMA) of residence.

RESULTS

There were 20,171,319 ED visits made by 8,919,618 patients ages 1 to 74 who resided in one of the 19 CMAs in Alberta or Ontario. On average, there were 2.26 visits per patient over the period of 4 fiscal years; most patients made one (44.22%) or two ED visits (20.72%). The overall unadjusted prevalence of preventable ED visits varied by definition; 35.33% of ED visits were defined as preventable based on CTAS, 12.88% based on FPSC, 3.41% based on SNC, and 2.33% based on ACSC.

CONCLUSIONS

There is a substantial level of variation in prevalence estimates across definitions of preventable ED visits, and care should be taken when interpreting these estimates as each has a different meaning and may lead to different conclusions. The conceptualization and measurement of preventable ED visits is complex and multifaceted and may not be adequately captured by a single definition.

Development and validation of an algorithm using health administrative data to define patient attachment to primary care providers

Purpose

The authors developed and validated an algorithm using health administrative data to identify patients who are attached or uncertainly attached to a primary care provider (PCP) using patient responses to a survey conducted in Ontario, Canada.

Design/methodology/approach

The authors conducted a validation study using as a reference standard respondents to a community-based survey who indicated they did or did not have a PCP. The authors developed and tested health administrative algorithms against this reference standard. The authors calculated the sensitivity, specificity positive predictive value (PPV) and negative predictive value (NPV) on the final patient attachment algorithm. The authors then applied the attachment algorithm to the 2017 Ontario population.

Findings

The patient attachment algorithm had an excellent sensitivity (90.5%) and PPV (96.8%), though modest specificity (46.1%) and a low NPV (21.3%). This means that the algorithm assigned survey respondents as being attached to a PCP and when in fact they said they had a PCP, yet a significant proportion of those found to be uncertainly attached had indicated they did have a PCP. In 2017, most people in Ontario, Canada (85.4%) were attached to a PCP but 14.6% were uncertainly attached.

Research limitations/implications

Administrative data for nurse practitioner's encounters and other interprofessional care providers are not currently available. The authors also cannot separately identify primary care visits conducted in walk in clinics using our health administrative data. Finally, the definition of hospital-based healthcare use did not include outpatient specialty care.

Practical implications

Uncertain attachment to a primary health care provider is a recurrent problem that results in inequitable access in health services delivery. Providing annual reports on uncertainly attached patients can help evaluate primary care system changes developed to improve access. This algorithm can be used by health care planners and policy makers to examine the geographic variability and time trends of the uncertainly attached population to inform the development of programs to improve primary care access.

Social implications

As primary care is an essential component of a person's medical home, identifying regions or high need populations that have higher levels of uncertainly attached patients will help target programs to support their primary care access and needs. Furthermore, this approach will be useful in future research to determine the health impacts of uncertain attachment to primary care, especially in view of a growing body of the literature highlighting the importance of primary care continuity.

Originality/value

This patient attachment algorithm is the first to use existing health administrative data validated with responses from a patient survey. Using patient surveys alone to assess attachment levels is expensive and time consuming to complete. They can also be subject to poor response rates and recall bias. Utilizing existing health administrative data provides more accurate, timely estimates of patient attachment for everyone in the population.

Development of a Web-Based Korean Triage and Acuity Scale Learning Program for Emergency Department Nurses

The Korean Triage and Acuity Scale is a tool developed to classify severity and urgency of emergency department patients, focusing on their symptoms. Considering the importance of the Korean Triage and Acuity Scale, learning for emergency department nurses who perform the Korean Triage and Acuity Scale must be structured to ensure that the knowledge they gain can be applied to various clinical situations of the emergency department. Moreover, Web-based learning is considered appropriate in this situation. This is a methodological research study that was conducted to develop a Web-based Korean Triage and Acuity Scale learning program for emergency department nurses. The learning program was developed using each of the five phases of the "analysis, design, development, implementation, and evaluation" model, that is, analysis, design, development, implementation, and evaluation. The learning program was composed of 22 cases of emergency situations based on the Korean Triage and Acuity Scale teaching material with an approval from the Korean Triage and Acuity Scale committee in the Korean Society of Emergency Medicine. The developed program was delivered in 4-hour sessions over 4 weeks. Emergency department nurses who were given the Web-based Korean Triage and Acuity Scale learning program showed improvement in work-site transfer and reported satisfactory learning. The findings indicate that the Web-based learning program for nurses can be used as an effective tool that is easily accessible and provides multiple learning opportunities.

Epidemiology of Frequent Visits to the Emergency Department at a Tertiary Care Hospital in Saudi Arabia: Rate, Visitors' Characteristics, and Associated Factors

Background

Emergency department overcrowding is becoming a challenge for the healthcare management system globally and locally. This study aimed to estimate the frequency of ED visits, describe the patients’ profile along with visit-related characteristics, and associated factors in a tertiary care hospital.

Methods

A retrospective cohort study was conducted at a tertiary care hospital. The study included patients age 14 years and above visiting the main emergency department in year 2013. Data were extracted from electronic medical records by a qualified data extraction team. Statistical analyses were performed, including the odds ratio and 95% confidence interval for the factors associated with highly frequent (≥14 visits) ED visits using logistic regression models.

Results

There were 150,727 visits to the emergency department within a year. The number of frequent visitors was 7696 (9.38%), with 42,226 visits (28.01% of total ED visits). Highly frequent visitors totaled 249 (0.30%), with 5173 visits (3.43% of total ED visits). The frequent visitors’ average age was 42.55 (SD 20.14), and 48.99 (SD 21.33) for the highly frequent visitors’ group. More than half of the emergency visitors were females. The most common complaints among the highly frequent visitors were Gastrointestinal (21.34%), followed by Respiratory (13.47%), Orthopedic (12.57%), and Cardiovascular (12.43%). Multivariate analysis indicated that age, history of diabetes, history of cardiac diseases, insurance status, and nationality were significant predicators of highly frequent visits to the hospital emergency.

Conclusion

Frequent and highly frequent visitors to emergency departments represent a significant proportion of adult patients presenting to ED. Their visits constitute almost one-third of total ED visits. Several factors associated with highly frequent ED visits have been identified. This study provides local empirical evidence to develop improvement policy and actions related to chronic issue of frequent and highly frequent visitation to hospital ED.

Validity and reliability of the South African Triage Scale in prehospital providers

Background

The South African Triage Scale (SATS) is a validated in-hospital triage tool that has been innovatively adopted for use in the prehospital setting by Western Cape Government (WCG) Emergency Medical Services (EMS) in South Africa. The performance of SATS by EMS providers has not been formally assessed. The study sought to assess the validity and reliability of SATS when used by WCG EMS prehospital providers for single-patient triage.

Methods

This is a prospective, assessment-based validation study among WCG EMS providers from March to September 2017 in Cape Town, South Africa. Participants completed an assessment containing 50 clinical vignettes by calculating the three components — triage early warning score (TEWS), discriminators (pre-defined clinical conditions), and a final SATS triage color. Responses were scored against gold standard answers. Validity was assessed by calculating over- and under-triage rates compared to gold standard. Inter-rater reliability was assessed by calculating agreement among EMS providers’ responses.

Results

A total of 102 EMS providers completed the assessment. The final SATS triage color was accurately determined in 56.5%, under-triaged in 29.5%, and over-triaged in 13.1% of vignette responses. TEWS was calculated correctly in 42.6% of vignettes, under-calculated in 45.0% and over-calculated in 10.9%. Discriminators were correctly identified in only 58.8% of vignettes. There was substantial inter-rater and gold standard agreement for both the TEWS component and final SATS color, but there was lower inter-rater agreement for clinical discriminators.

Conclusion

This is the first assessment of SATS as used by EMS providers for prehospital triage. We found that SATS generally under-performed as a triage tool, mainly due to the clinical discriminators. We found good inter-rater reliability, but poor validity. The under-triage rate of 30% was higher than previous reports from the in-hospital setting. The over-triage rate of 13% was acceptable. Further clinically-based and qualitative studies are needed.

Trial registration

Not applicable.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12873-021-00406-6.

Consistency of triage scores by presenting complaint pre- and post-implementation of a real-time electronic triage decision support tool

OBJECTIVE

eCTAS is a real-time electronic decision-support tool designed to standardize the application of the Canadian Triage and Acuity Scale (CTAS). This study addresses the variability of CTAS score distributions across institutions pre- and post-eCTAS implementation.

METHODS

We used population-based administrative data from 2016-2018 from all emergency departments (EDs) that had implemented eCTAS for 9 months. Following a 3-month stabilization period, we compared 6 months post-eCTAS data to the same 6 months the previous year (pre-eCTAS). We included triage encounters of adult (≥17 years) patients who presented with 1 of 16 pre-specified, high-volume complaints. For each ED, consistency was calculated as the absolute difference in CTAS distribution compared to the average of all included EDs for each presenting complaint. Pre-eCTAS and post-eCTAS change scores were compared using a paired-samples t-test. We also assessed if eCTAS modifiers were associated with triage consistency.

RESULTS

There were 363,214 (183,231 pre-eCTAS, 179,983 post-eCTAS) triage encounters included from 35 EDs. Triage scores were more consistent (P < 0.05) post-eCTAS for 6 (37.5%) presenting complaints: chest pain (cardiac features), extremity weakness/symptoms of cerebrovascular accident, fever, shortness of breath, syncope, and hyperglycemia. Triage consistency was similar pre- and post-eCTAS for altered level of consciousness, anxiety/situational crisis, confusion, depression/suicidal/deliberate self-harm, general weakness, head injury, palpitations, seizure, substance misuse/intoxication, and vertigo. Use of eCTAS modifiers was associated with increased triage consistency.

CONCLUSIONS

eCTAS increased triage consistency across many, but not all, high-volume presenting complaints. Modifier use was associated with increased triage consistency, particularly for non-specific complaints such as fever and general weakness.

Performance of a three-level triage scale in live triage encounters in an emergency department in Hong Kong

Background

Despite its continued use in many low-volume emergency departments (EDs), 3-level triage systems have not been extensively studied, especially on live triage cases. We have modified from the Australasian Triage Scale and developed a 3-level triage scale, and sought to evaluate its validity, reliability, and over- and under-triage rates in real patient encounters in our setting.

Method

This was a cross-sectional study in a single ED with 24,000 attendances per year. At triage, each patient was simultaneously assessed by a triage nurse, an adjudicator (the “criterion standard”), and a study nurse independently. Predictive validity was determined by comparing clinical outcomes, such as hospitalization, across triage levels. The discriminating performance of the triage tool in identifying patients requiring earlier medical attention was determined. Inter-observer reliability between the triage nurse and criterion standard, and across providers were determined using kappa statistics.

Results

In total, 453 triage ratings of 151 triage cases, involving 17 ED triage nurses and 57 nurse pairs, were analysed. The proportion of hospital admission significantly increased with a higher triage rating. The performance of the scale in identifying patients requiring earlier medical attention was as follows: sensitivity, 68.2% (95% CI 45.1–86.1%); specificity, 99.2% (95% CI 95.8–100%); positive predictive value, 93.8% (95% CI 67.6–99.1%); and negative predictive value, 94.8% (95% CI 90.8–97.1%). The over-triage and under-triage rates were 0.7% and 4.6%, respectively. Agreement between the triage nurse and criterion standard was substantial (quadratic-weighted kappa = 0.76, 95% CI, 0.60–0.92, p < 0.001), so was the agreement across nurses (quadratic-weighted kappa = 0.81, 95% CI 0.65–0.97, p < 0.001).

Conclusions

The 3-level triage system appears to have good validity and reasonable reliability in a low-volume ED setting. Further studies comparing 3-level and prevailing 5-level triage scales in live triage encounters and different ED settings are warranted.

Interrater Reliability, Accuracy, and Triage Time Pre- and Post-implementation of a Real-Time Electronic Triage Decision-Support Tool

STUDY OBJECTIVE

The electronic Canadian Triage and Acuity Scale (eCTAS) is a real-time electronic triage decision-support tool designed to improve patient safety and quality of care by standardizing the application of the Canadian Triage and Acuity Scale (CTAS). The objective of this study is to determine interrater agreement of triage scores pre- and post-implementation of eCTAS.

METHODS

This was a prospective, observational study conducted in 7 emergency departments (EDs), selected to represent a mix of triage documentation practices, hospital types, and patient volumes. A provincial CTAS auditor observed triage nurses in the ED pre- and post-implementation of eCTAS and assigned an independent CTAS score in real time. Research assistants independently recorded triage time. Interrater agreement was estimated with κ statistics with 95% confidence intervals (CIs).

RESULTS

A total of 1,491 individual triage assessments (752 pre-eCTAS, 739 post-implementation) were audited during 42 7-hour triage shifts (21 pre-eCTAS, 21 post-implementation). Exact modal agreement was achieved for 567 patients (75.4%) pre-eCTAS compared with 685 patients (92.7%) triaged with eCTAS. With the auditor's CTAS score as the reference, eCTAS significantly reduced the number of patients over-triaged (12.0% versus 5.1%; Δ 6.9; 95% CI 4.0 to 9.7) and under-triaged (12.6% versus 2.2%; Δ 10.4; 95% CI 7.9 to 13.2). Interrater agreement was higher with eCTAS (unweighted κ 0.89 versus 0.63; quadratic-weighted κ 0.93 versus 0.79). Median triage time was 312 seconds (n=3,808 patients) pre-eCTAS and 347 seconds (n=3,489 patients) with eCTAS (Δ 35 seconds; 95% CI 29 to 40 seconds).

CONCLUSION

A standardized, electronic approach to performing triage assessments improves both interrater agreement and data accuracy without substantially increasing triage time.

Reliability of Korean Triage and Acuity Scale: Interrater Agreement between Two Experienced Nurses by Real-Time Triage and Analysis of Influencing Factors to Disagreement of Triage Levels

BACKGROUND

All emergency centers in Korea use the Korean Triage and Acuity Scale (KTAS) as their initial triage tool. However, KTAS has been used without verification of its reliability. In this study, we assess the interrater agreement of KTAS by two independent nurses in real-time and analyse the factors which have an effect on the disagreement of KTAS levels.

METHODS

This study was a prospective observational study conducted with patients who visited an emergency department (ED). Two teams, each composed of two nurses, triaged patients and recorded KTAS level and the main complaint from the list of 167 KTAS complaints, as well as modifiers. Interrater reliability between the two nurses in each team was assessed by weighted-kappa. Pearson's χ² test was conducted to determine if there were differences between each nurse's KTAS levels, depending on whether they chose the same complaints and the same modifiers or not.

RESULTS

The two teams triaged a total of 1,998 patients who visited the ED. Weighted-kappa value was 0.772 (95% confidence interval [CI], 0.750-0.794). Patients triaged by different chosen complaints showed (38.0%) higher inconsistency rate in KTAS levels than those triaged by the same complaint (10.9%, P < 0.001). When nurses chose the same complaint and different modifiers, the ratio of different levels (50.5%) was higher than that of the same complaint and same modifier (8.1%, P < 0.001).

CONCLUSION

This study showed that KTAS is a reliable tool. Selected complaints and modifiers are confirmed as important factors for reliability; therefore, selecting them properly should be emphasized during KTAS training courses.

Over-triage occurs when considering the patient's pain in Korean Triage and Acuity Scale (KTAS)

Background

The Korean Triage and Acuity Scale (KTAS) was developed based on the Canadian Emergency Department Triage and Acuity Scale. In patients with pain, to determine the KTAS level, the pain scale is considered; however, since the degree of pain is subjective, this may affect the accuracy of KTAS. The purpose of this study was to evaluate the accuracy of KTAS in predicting patient's severity with the degree of pain used as a modifier.

Method

A retrospective observational cohort study was conducted in an urban tertiary hospital emergency department (ED). We investigated patients over 16 years old from January to June 2016. The patients were divided into the pain and non-pain groups according to whether the degree of pain was used as a modifier or not. We compared the predictive power of KTAS on the urgency of patients between the two groups. Acute area registration in the ED, emergency procedure, emergency operation, hospitalization, intensive care unit admission, and 7-day mortality were used as markers to determine urgent patients.

Results

Overall, 24,253 patients were included in the study, with 9,175 (37.8%) in the pain group. The proportions of patients with KTAS 1–3 were 61.4% in the pain and 75.6% in the non-pain groups. Among patients with KTAS 2–3, the proportion of urgent patients was higher in the non-pain group than the pain group (p<0.001). The odds ratios for urgent patients at each KTAS level revealed a more evident discriminatory power of KTAS for urgent patients in the non-pain group. The predictability of KTAS for urgent patients was higher in the non-pain group than the pain group (area under the curve; 0.736 vs. 0.765, p-value <0.001).

Conclusions

Considering the degree of pain with KTAS led to overestimation of patient severity and had a negative impact on the predictability of KTAS for urgent patients.

Triage Performance in Emergency Medicine: A Systematic Review

STUDY OBJECTIVE

Rapid growth in emergency department (ED) triage literature has been accompanied by diversity in study design, methodology, and outcome assessment. We aim to synthesize existing ED triage literature by using a framework that enables performance comparisons and benchmarking across triage systems, with respect to clinical outcomes and reliability.

METHODS

PubMed, EMBASE, Scopus, and Web of Science were systematically searched for studies of adult ED triage systems through 2016. Studies evaluating triage systems with evidence of widespread adoption (Australian Triage Scale, Canadian Triage and Acuity Scale, Emergency Severity Index, Manchester Triage Scale, and South African Triage Scale) were cataloged and compared for performance in identifying patients at risk for mortality, critical illness and hospitalization, and interrater reliability. This study was performed and reported in adherence to Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines.

RESULTS

A total of 6,160 publications were identified, with 182 meeting eligibility criteria and 50 with sufficient data for inclusion in comparative analysis. The Canadian Triage and Acuity Scale (32 studies), Emergency Severity Index (43), and Manchester Triage Scale (38) were the most frequently studied triage scales, and all demonstrated similar performance. Most studies (6 of 8) reported high sensitivity (>90%) of triage scales for identifying patients with ED mortality as high acuity at triage. However, sensitivity was low (<80%) for identification of patients who had critical illness outcomes and those who died within days of the ED visit or during the index hospitalization. Sensitivity varied by critical illness and was lower for severe sepsis (36% to 74%), pulmonary embolism (54%), and non-ST-segment elevation myocardial infarction (44% to 85%) compared with ST-segment elevation myocardial infarction (56% to 92%) and general outcomes of ICU admission (58% to 100%) and lifesaving intervention (77% to 98%). Some proportion of hospitalized patients (3% to 45%) were triaged to low acuity (level 4 to 5) in all studies. Reliability measures (κ) were variable across evaluations, with only a minority (11 of 42) reporting κ above 0.8.

CONCLUSION

We found that a substantial proportion of ED patients who die postencounter or are critically ill are not designated as high acuity at triage. Opportunity to improve interrater reliability and triage performance in identifying patients at risk of adverse outcome exists.

Reliability of the revised Swiss Emergency Triage Scale: a computer simulation study

Background

The Swiss Emergency Triage Scale (SETS) is a four-level emergency scale that previously showed moderate reliability and high rates of undertriage due to a lack of standardization. It was revised to better standardize the measurement and interpretation of vital signs during the triage process.

Objective

The aim of this study was to explore the inter-rater and test–retest reliability, and the rate of correct triage of the revised SETS.

Patients and methods

Thirty clinical scenarios were evaluated twice at a 3-month interval using an interactive computerized triage simulator by 58 triage nurses at an urban teaching emergency department admitting 60 000 patients a year. Inter-rater and test–retest reliabilities were determined using κ statistics. Triage decisions were compared with a gold standard attributed by an expert panel. Rates of correct triage, undertriage, and overtriage were computed. A logistic regression model was used to identify the predictors of correct triage.

Results

A total of 3387 triage situations were analyzed. Inter-rater reliability showed substantial agreement [mean κ: 0.68; 95% confidence interval (CI): 0.60–0.78] and test–retest almost perfect agreement (mean κ: 0.86; 95% CI: 0.84–0.88). The rate of correct triage was 84.1%, and rates of undertriage and overtriage were 7.2 and 8.7%, respectively. Vital sign measurement was an independent predictor of correct triage (odds ratios for correct triage: 1.29 for each additional vital sign measured, 95% CI: 1.20–1.39).

Conclusion

The revised SETS incorporating standardized vital sign measurement and interpretation during the triage process resulted in high reliability and low rates of mistriage.

Embracing the wild profusion: A Foucauldian analysis of the impact of healthcare standardization on nursing knowledge and practice

Standardization has emerged as the dominant principle guiding the organization and provision of healthcare, with standards resultantly shaping how nurses conceptualize and deliver patient care. Standardization has been critiqued as homogenizing diverse patient experiences and diminishing nurses' skills and critical thinking; however, there has been limited examination of the philosophical implications of standardization for nursing knowledge and practice. In this manuscript, I draw on Foucault's philosophy of order and categorization to inform an analysis of the consequences of healthcare standardization for the profession of nursing. I utilize three exemplars to illustrate the impact of the primacy of standardized thinking and practices on nurses, patients and families: pain assessments using the 0-10 pain scale; patient triage emergency departments through the Canadian Triage and Acuity Scale; and determination of cause of death within the context of the current opioid crisis. Through each exemplar, I demonstrate that standardization reductively constrains nursing knowledge and the health and healthcare experiences of patients and populations. I argue that the centrality of standardization must be re-envisioned to embrace the complexity of health and more effectively and meaningfully frame nursing knowledge and practice within healthcare systems.

Understanding discharge communication behaviours in a pediatric emergency care context: a mixed methods observation study protocol

BACKGROUND

One of the most important transitions in the continuum of care for children is discharge to home. Optimal discharge communication between healthcare providers and caregivers (e.g., parents or other guardians) who present to the emergency department (ED) with their children is not well understood. The lack of policies and considerable variation in practice regarding discharge communication in pediatric EDs pose a quality and safety risk for children and their parents.

METHODS

The aim of this mixed methods study is to better understand the process and structure of discharge communication in a pediatric ED context to contribute to the design and development of discharge communication interventions. We will use surveys, administrative data and real-time video observation to characterize discharge communication for six common illness presentations in a pediatric ED: (1) asthma, (2) bronchiolitis, (3) abdominal pain, (4) fever, (5) diarrhea and vomiting, and (6) minor head injury. Participants will be recruited from one of two urban pediatric EDs in Canada. Video recordings will be analyzed using Observer XT. We will use logistic regression to identify potential demographic and visit characteristic cofounders and multivariate logistic regression to examine association between verbal and non-verbal behaviours and parent recall and comprehension.

DISCUSSION

Video recording of discharge communication will provide an opportunity to capture important data such as temporality, sequence and non-verbal behaviours that might influence the communication process. Given the importance of better characterizing discharge communication to identify potential barriers and enablers, we anticipate that the findings from this study will contribute to the development of more effective discharge communication policies and interventions.

Validation of an emergency triage scale for obstetrics and gynaecology: a prospective study

OBJECTIVE

To evaluate the reliability of a four-level triage scale for obstetrics and gynaecology emergencies and to explore the factors associated with an optimal triage.

DESIGN

Thirty clinical vignettes presenting the most frequent indications for obstetrics and gynaecology emergency consultations were evaluated twice using a computerised simulator.

SETTING

The study was performed at the emergency unit of obstetrics and gynaecology at the Geneva University Hospitals.

SAMPLE

The vignettes were submitted to nurses and midwives.

METHODS

We assessed inter- and intra-rater reliability and agreement using a two-way mixed-effects intra-class correlation (ICC). We also performed a generalised linear mixed model to evaluate factors associated triage correctness.

MAIN OUTCOME MEASURES

Triage acuity.

RESULTS

We obtained a total of 1191 evaluations. Inter-rater reliability was good (ICC 0.748; 95% CI 0.633-0.858) and intra-rater reliability was almost perfect (ICC 0.812; 95% CI 0.726-0.889). We observed a wide variability: the mean number of questions varied from 6.9 to 18.9 across individuals and from 8.4 to 16.9 across vignettes. Triage acuity was underestimated in 12.4% of cases and overestimated in 9.3%. Undertriage occurred less frequently for gynaecology compared with obstetric vignettes [odds ratio (OR) 0.45; 95% CI 0.23-0.91; P = 0.035] and decreased with the number of questions asked (OR 0.94; 95% CI 0.88-0.99; P = 0.047). Certification in obstetrics and gynaecology emergencies was an independent factor for the avoidance of undertriage (OR 0.35; 95% CI 0.17-0.70; P = 0.003).

CONCLUSION

The four-level triage scale is a valid and reliable tool for the integrated emergency management of obstetrics and gynaecology patients.

TWEETABLE ABSTRACT

The Swiss Emergency Triage Scale is a valid and reliable tool for obstetrics and gynaecology emergency triage.

Proposing a two-criterion quality loss function using critical process capability indices

Purpose

Average quadratic quality loss function (QQLF) measures quality of a given process using mean shift from its target value and variance. While it has a target parameter for the mean, it lacks a target for the variance revisable for counting any progress of the process across different quality levels, above/below the standard level; thus, it appears too general. Hence, in this research, it was initially supposed that all processes are located at two possible quality spaces, above/below the standard level. The purpose of this paper is to propose a two-criterion QQLF, in which each criterion is specifically proper to one of the quality spaces.

Design/methodology/approach

Since 1.33 is a literarily standard or satisfactory value for two most important process capability indicesCpandCpk, its upper/lower spaces are assumed as high-/low-quality spaces. Then the indices are integrated into traditional QQLF, of type nominal the best (NTB), to develop a two-criterion QQLF, in which each criterion is more suitable for each quality space. These two criteria have also been innovatively embedded in the plan-do-check-act (PDCA) cycle to help continuous improvement. Finally, the proposed function has been examined in comparison with the traditional one in Feiz Hospital in the province of Isfahan, Iran.

Findings

Results indicate that the internal process of the studied case is placed on the lower quality space. So the first criterion of revised QQLF gives a more relevant evaluation for that process, compared with the traditional function. Moreover, this study has embedded both proposed criteria in the PDCA cycle as well.

Research limitations/implications

Formulating the two-criterion QQLF only for observations of normal and symmetric distributions, and offering it solely for NTB characteristics are limitations of this study.

Practical implications

Two more relevant quality loss criteria have been formulated for each process (service or manufacturing). However, in order to show the comprehensiveness of the proposed method even in service institutes, emergency function of Feiz Hospital has been examined.

Originality/value

The traditional loss function of type NTB merely and implicitly targets zero defect for variance. In fact, it calculates quality loss of all processes placed on different quality spaces using a same measure. This study, however, provides a practitioner with opportunity of targeting excellent or satisfactory targets.

Importance of respiratory rate for the prediction of clinical deterioration after emergency department discharge: a single-center, case-control study

Aim

The purpose of the present study was to investigate the predictors of clinical deterioration soon after emergency department (ED) discharge.

Methods

We undertook a case–control study using the ED database of the Nagano Municipal Hospital (Nagano, Japan) from January 2012 to December 2013. We selected adult patients with medical conditions who revisited the ED with deterioration within 2 days of ED discharge (deterioration group). The deterioration group was compared with a control group.

Results

During the study period, 15,724 adult medical patients were discharged from the ED. Of these, 170 patients revisited the ED because of clinical deterioration within 2 days. Among the initial vital signs, respiratory rate was less frequently recorded than other vital signs (P < 0.001 versus all other vital signs in each group). The frequency of recording each vital sign did not differ significantly between the groups. Overall, patients in the deterioration group had significantly higher respiratory rates than those in the control group (21 ± 5/min versus 18 ± 5/min, respectively; P = 0.002). A binary logistic regression analysis revealed that respiratory rate was an independent risk factor for clinical deterioration (unadjusted odds ratio, 1.15; 95% confidence interval, 1.04−1.26; adjusted odds ratio, 1.15; 95% confidence interval, 1.01−1.29).

Conclusions

An increased respiratory rate is a predictor of early clinical deterioration after ED discharge. Vital signs, especially respiratory rate, should be carefully evaluated when making decisions about patient disposition in the ED.

A pilot study examining the speed and accuracy of triage for simulated disaster patients in an emergency department setting: Comparison of a computerized version of Canadian Triage Acuity Scale (CTAS) and Simple Triage and Rapid Treatment (START) methods

Objective

To compare emergency department triage nurses’ time to triage and accuracy of a simulated mass casualty incident (MCI) population using a computerized version of CTAS or START systems.

Methods

This pilot study was a prospective trial using a convenience sample. A total of 20 ED triage nurses, 10 in each arm of the study, were recruited. The paper-based questionnaire contained nine simulated MCI vignettes. An expert panel arrived at consensuses on the wording of the vignettes and created a standard triage score from which to compare the study participants. Linear regression and chi-squared test were used to examine the time to triage and accuracy of triage, respectively.

Results

The mean triage time for computerized CTAS (cCTAS) and START were 138 seconds/patient and 33 seconds/patient, respectively. The effect size due to triage method was 108 seconds/patient (95% CI 83-134 seconds/patient). The cumulative triage accuracy for the cCTAS and START tools were 70/90 (77.8%) and 65/90 (72.2%), respectively. The percent difference between cumulative triage was 6% (95% CI −19-8%).

Conclusions

Triage nurses completed START triage 105 seconds/patient faster when compared to cCTAS triage and a similar level of accuracy between the two methods was achieved. However, when the typing time is taken into consideration cCTAS took 45 seconds/patient longer. The use of either CTAS or START in the ED during a MCI may be reasonable but choosing one method over another is not justified from this investigation.

Prehospital Application of the Canadian Triage and Acuity Scale by Emergency Medical Services

OBJECTIVES

Triage is fundamental to emergency patient assessment. Effective triage systems accurately prioritize patients and help predict resource utilization. CTAS is a validated five-level triage score utilized in Emergency Departments (EDs) across Canada and internationally. Historically CTAS has been applied by triage nurses in EDs. Observational evidence suggests that the CTAS might be implemented reliably by paramedics in the prehospital setting. This is the first system-wide assessment of CTAS interrater reliability between paramedics and triage nurses during clinical practice.

METHODS

Variables were extracted from hospital and EMS databases. EMS providers determined CTAS on-scene, CTAS pre-transport, and CTAS on-arrival at hospital for each patient (N=14,378). The hospital arrival EMS CTAS (CTAS arrival ) score was compared to the initial nursing CTAS score (CTAS initial ) and the final nursing CTAS score (CTAS final ) incuding nursing overrides. Interrater reliability between ED CTAS initial and EMS CTAS arrival scores was assessed. Interrater reliability between ED CTAS final and EMS CTAS arrival scores, as well as proportion of patient encounters with perfect or near-perfect agreement, were evaluated.

RESULTS

Our primary outcome, interrater reliability [kappa=0.437 (p<0.001, 95% CI 0.421-0.452)], indicated moderate agreement. EMS CTAS arrival and ED CTAS initial scores had an exact or within one point match 84.3% of the time. The secondary interrater reliability outcome between hospital arrival EMS CTAS (CTAS arrival ) score and the final ED triage CTAS score (CTAS final ) showed moderate agreement with kappa =0.452 (p<0.001, 95% CI 0.437-0.466).

CONCLUSIONS

Interrater reliability of CTAS scoring between triage nurses and paramedics was moderate in this system-wide implementation study.

Validation of the modified Japanese Triage and Acuity Scale-based triage system emphasizing the physiologic variables or mechanism of injuries

Background

The Canadian Triage and Acuity Scale is a valid triage system. The system was translated and implemented in the Japanese emergency departments (EDs) from 2012. This system was named the Japanese Triage and Acuity Scale; however, the validation studies of the Japanese Triage and Acuity Scale have been limited. In addition, for a patient with multiple complaints, it could become challenging, due to its requirement of a single complaint. Therefore, we hypothesized that a modified version of the Japanese Triage and Acuity Scale using first-order modifiers without chief complaint detection is accurate.

Methods

A retrospective cohort study evaluated a correlation between the modified triage scale level and outcomes of all adult emergency department patients at a Japanese hospital.

Construct validity of the modified triage scale level was assessed based on comparisons of total admission rate (including hospitalizations, emergency department deaths) and length of stay between triage levels.

Results

The distributions of five levels of the triage scale (level 1 is the most urgent) among the 17,121 cases are as follows: 1:451, 2:1148, 3:7703, 4:7652, and 5:167. Total admission rates by each level were 1:89.8, 2:68.2, 3:26.4, 4:6.6, and 5:0.6 %, which progressively increased from level 5 to 1 and were significant (p < 0.01). Compared with patients in level 3, the odds of total admission rates were 14.4, 5.1, 0.27, and 0.030 for the patients in levels 1, 2, 4, and 5. The length of stay was longer in the patients with the more urgent levels except for those with level 1.

Conclusions

The modified version of the Japanese Triage and Acuity Scale is a valid predictor of total admission and length of stay and may enable the nurses to triage patients without detecting the chief complaints.

Canadian Triage and Acuity Scale: testing the mental health categories

PURPOSE

The study tested the inter-rater reliability and accuracy of triage nurses' assignment of urgency ratings for mental health patient scenarios based on the 2008 Canadian Triage and Acuity Scale (CTAS) guidelines, using a standardized triage tool. The influence of triage experience, educational preparation, and comfort level with mental health presentations on the accuracy of urgency ratings was also explored.

METHODS

Study participants assigned urgency ratings to 20 mental health patient scenarios in randomized order using the CTAS. The scenarios were developed using actual triage notes and were reviewed by an expert panel of emergency and mental health clinicians for face and content validity.

RESULTS

The overall Fleiss' kappa, the measure of inter-rater reliability for this sample of triage nurses (n=18), was 0.312, representing only fair albeit statistically significant (P<0.0001) agreement. Kendall's coefficient of concordance for the sample was calculated to be 0.680 (P<0.0001), which signifies moderate agreement. Although the sample reported high levels of education, comfort with mental health presentations, and experience, accuracy in urgency ratings measured by the percentage of correct responses ranged from 0.05% to 94% (mean: 54%). Greater accuracy in urgency ratings was recorded for triage nurses who used second-order modifiers and avoided the use of override.

CONCLUSION

Specific focus on the use of second-order modifiers in orientation and ongoing education of triage nurses may improve the reliability and validity of the CTAS when used to assign urgency ratings to mental health presentations.

The Reliability of the Canadian Triage and Acuity Scale: Meta-analysis

Background:

Although the Canadian Triage and Acuity Scale (CTAS) have been developed since two decades ago, the reliability of the CTAS has not been questioned comparing to moderating variable.

Aims:

The study was to provide a meta-analytic review of the reliability of the CTAS in order to reveal to what extent the CTAS is reliable.

Materials and Methods:

Electronic databases were searched to March 2014. Only studies were included that had reported samples size, reliability coefficients, adequate description of the CTAS reliability assessment. The guidelines for reporting reliability and agreement studies (GRRAS) were used. Two reviewers independently examined abstracts and extracted data. The effect size was obtained by the z-transformation of reliability coefficients. Data were pooled with random-effects models and meta-regression was done based on method of moments estimator.

Results:

Fourteen studies were included. Pooled coefficient for the CTAS was substantial 0.672 (CI 95%: 0.599-0.735). Mistriage is less than 50%. Agreement upon the adult version, among nurse-physician and near countries is higher than pediatrics version, other raters and farther countries, respectively.

Conclusion:

The CTAS showed acceptable level of overall reliability in the emergency department but need more development to reach almost perfect agreement.

Reliability of Canadian Emergency Department Triage and Acuity Scale (CTAS) in Saudi Arabia

Background

The Canadian Emergency Department Triage and Acuity Scale (CTAS) is an integral part of the Canadian emergency medicine triaging system. There is growing interest and implementation of CTAS worldwide. However, little is known about its reliability outside Canada. The aim of this study was to determine the reliability agreement of CTAS in a tertiary care emergency center in Saudi Arabia.

Methods

Ten triage nurses (five senior and five junior nurses) utilized CTAS guidelines to independently assign a triage level for 160 real case-based scenarios. Quadratic weighted kappa statistics were used to measure raters’ agreements.

Results

Raters provided 1600 triage category assignments to case scenarios for analysis. Intra-rater agreement was similar for both senior and junior nurses; for senior nurses (SN1) kappa 0.871 95 % CI (0.840–0.897), and for junior nurses (SN2) kappa 0.871 95 % CI (0.839–0.898). Inter-rater agreement for the SN1 versus SN2 nurses had statistically meaningful agreement across different triage levels (weighted kappa = 0.770) 95 % CI (0.742–0.797).

Conclusions

CTAS has good reliability among emergency department (ED) triage nurses in King Abdulaziz Medical City (KAMC), Saudi Arabia. The findings suggest that CTAS might be a reliable instrument when applied in countries outside Canada.

Evaluating the effect of emergency department crowding on triage destination

Background

Emergency Department (ED) crowding has been studied for the last 20 years, yet many questions remain about its impact on patient care. In this study, we aimed to determine if ED crowding influenced patient triage destination and intensity of investigation, as well as rates of unscheduled returns to the ED. We focused on patients presenting with chest pain or shortness of breath, triaged as high acuity, and who were subsequently discharged home.

Methods

This pilot study was a health records review of 500 patients presenting to two urban tertiary care EDs with chest pain or shortness of breath, triaged as high acuity and subsequently discharged home. Data extracted included triage time, date, treatment area, time to physician initial assessment, investigations ordered, disposition, and return ED visits within 14 days. We defined ED crowding as ED occupancy greater than 1.5. Data were analyzed using descriptive statistics and the χ² and Fisher exact tests.

Results

Over half of the patients, 260/500 (52.0%) presented during conditions of ED crowding. More patients were triaged to the non-monitored area of the ED during ED crowding (65/260 (25.0%) vs. 39/240 (16.3%) when not crowded, P = 0.02). During ED crowding, mean time to physician initial assessment was 132.0 minutes in the non-monitored area vs. 99.1 minutes in the monitored area, P <0.0001. When the ED was not crowded, mean time to physician initial assessment was 122.3 minutes in the non-monitored area vs. 67 minutes in the monitored area, P = 0.0003. Patients did not return to the ED more often when triaged during ED crowding: 24/260 (9.3%) vs. 29/240 (12.1%) when ED was not crowded (P = 0.31). Overall, when triaged to the non-monitored area of the ED, 44/396 (11.1%) patients returned, whereas in the monitored area 9/104 (8.7%) patients returned, P = 0.46.

Conclusions

ED crowding conditions appeared to influence triage destination in our ED leading to longer wait times for high acuity patients. This did not appear to lead to higher rates of return ED visits amongst discharged patients in this cohort. Further research is needed to determine whether these delays lead to adverse patient outcomes.