Interactive triage simulator revealed important variability in both process and outcome of emergency triage

Feasibility and acceptability of a serious game to study the effects of environmental distractors on emergency room nurse triage accuracy: A pilot study

BACKGROUND

Emergency triage, which involves complex decision-making under stress and time constraints, may suffer from inaccuracies due to workplace distractions. A serious game was developed to simulate the triage process and environment. A pilot study was undertaken to collect preliminary data on the effects of distractors on emergency nurse triage accuracy.

METHOD

A 2 × 2 factorial randomized controlled trial (RCT) was designed for the study. A sample of 70 emergency room nurses was randomly assigned to three experimental groups exposed to different distractors (noise, task interruptions, and both) and one control group. Nurses had two hours to complete a series of 20 clinical vignettes, in which they had to establish a chief complaint and assign an emergency level.

RESULTS

Fifty-five nurses completed approximately 15 vignettes each during the allotted time. No intergroup differences emerged in terms of triage performance. Nurses had a very favorable appreciation of the serious game focusing on triage.

CONCLUSION

The results show that both the structure of our study and the serious game can be used to carry out a future RCT on a larger scale. The lack of a distractor effect raises questions about the frequency and intensity required to find a significant impact on triage performance.

Reliability and Accuracy of the Pediatric Swiss Emergency Triage Scale-the SETSped Study

BACKGROUND AND IMPORTANCE

The Swiss Emergency Triage Scale (SETS) is an adult triage tool used in several emergency departments. It has been recently adapted to the pediatric population but, before advocating for its use, performance assessment of this tool is needed.

OBJECTIVES

The purpose of this study was to assess the reliability and the accuracy of the pediatric version of the SETS for the triage of pediatric patients.

DESIGN, SETTING, AND PARTICIPANTS

This study was a cross-sectional study among a sample of emergency triage nurses (ETNs) exposed to 17 clinical scenarios using a computerized simulator.

OUTCOME MEASURES AND ANALYSIS

The primary outcome was the reliability of the triage level performed by the ETNs. It was assessed using an intraclass correlation coefficient.Secondary outcomes included accuracy of triage compared with expert-based triage levels and factors associated with accurate triage.

MAIN RESULTS

Eighteen ETNs participated in the study and completed the evaluation of all scenarios, for a total of 306 triage decisions. The intraclass correlation coefficient was 0.80 (95% confidence interval, 0.69-0.91), with an agreement by scenario ranging from 61.1% to 100%. The overall accuracy was 85.8%, and nurses were more likely to undertriage (16.0%) than to overtriage (4.3%). No factor for accurate triage was identified.

CONCLUSIONS

This simulator-based study showed that the SETS is reliable and accurate among a pediatric population. Future research is needed to confirm these results, compare this triage scale head-to-head with other recognized international tools, and study the SETSped in real-life setting.

Incidence and outcomes of emergency department patients requiring emergency general surgery: a 5-year retrospective cohort study

AIMS

Patients undergoing emergency general surgery are at high risk of complications and death. Our objectives were to estimate the incidence of emergency general surgery in a Swiss University Hospital, to describe the characteristics and outcomes of patients undergoing such procedures, and to study the impact of age on clinical outcomes.

METHODS

This was a retrospective cohort study of adult patients who visited the emergency department (ED) of Geneva University Hospitals between January 2015 and December 2019. Routinely collected data were extracted from electronic medical records. The primary outcome was the incidence of emergency general surgery among patients visiting the emergency department, defined as general surgery within three days of emergency department admission. We also assessed demographic characteristics, mortality, intensive care unit admission and patient disposition. Multivariable log-binomial regression was used to study the associations of age with intensive care unit (ICU) admission, one-year mortality and dependence at discharge. Age was modelled as a continuous variable using restricted cubic splines and we compared older patients (75th percentile) with younger patients (25th percentile).

RESULTS

Between January 2015 and December 2019, a total of 310,914 emergency department visits met our inclusion criteria. Among them, 3592 patients underwent emergency general surgery within 3 days of emergency department admission, yielding an annual incidence of 116 events per 10,000 emergency department visits (95% CI: 112-119), with a higher incidence in females and young patients. Overall, 5.3% of patients were admitted to ICU, 7.8% were dependent on rehabilitation or assisted living at discharge and 4.8% were dead after one year. Older patients had a higher risk of ICU admission (adjusted risk ratio (aRR) 2.9 [1.5-5.4]), dependence at discharge (aRR 15.3 [5.5-42.4]) and one-year mortality (aRR 5.4 [2.2-13.4]).

CONCLUSION

Emergency department visits resulting in emergency general surgery are frequent, but their incidence decreases with patient age. Mortality, ICU admission and dependence at discharge following emergency general surgery are more frequent in older patients. Taking into account the increased risk for older patients, a shared process is appropriate for making more informed decisions about their options for care.

Disaster Triage Skills Training: An Introductory Virtual Simulation for Medical Students

Background Disaster triage training equips learners with the critical skills to rapidly evaluate patients, yet few medical schools include formal triage training in their curriculum. Simulation exercises can successfully teach triage skills, but few studies have specifically evaluated online simulation to teach these skills to medical students. Aims We sought to develop and evaluate a largely asynchronous activity for senior medical students to practice their triage skills in an online format. Methods We developed an online, interactive triage exercise for fourth-year medical students. For the exercise, the student participants acted as triage officers for an emergency department (ED) at a large tertiary care center during an outbreak of a severe respiratory illness. Following the exercise, a faculty member led a debriefing session using a structured debriefing guide. Pre- and post-test educational assessments used a five-point Likert scale to capture the helpfulness of the exercise and their self-reported pre- and post-competency in triage. Change in self-reported competency was analyzed for statistical significance and effect size. Results Since May 2021, 33 senior medical students have completed this simulation and pre- and post-test educational assessments. Most students found the exercise "very" or "extremely" helpful for learning, with a mean of 4.61 (SD: ±0.67). Most students rated their pre-exercise competency as "beginner" or "developing" and their post-exercise competency as "developing" or "proficient" on a four-point rubric. The average increase in self-reported competency was 1.17 points (SD: ±0.62), yielding a statistically significant difference (p < 0.001) and large effect size (Hedges' g: 1.94). Conclusions We conclude that a virtual simulation can increase students' sense of competence in triage skills, using fewer resources than in-person simulation of disaster triage. As a next step, the simulation and the source code are publicly available for anyone to engage with the simulation or adapt it for their respective learners.

Exploring the effectiveness of artificial intelligence, machine learning and deep learning in trauma triage: A systematic review and meta-analysis

Background

The development of artificial intelligence (AI), machine learning (ML) and deep learning (DL) has advanced rapidly in the medical field, notably in trauma medicine. We aimed to systematically appraise the efficacy of AI, ML and DL models for predicting outcomes in trauma triage compared to conventional triage tools.

Methods

We searched PubMed, MEDLINE, ProQuest, Embase and reference lists for studies published from 1 January 2010 to 9 June 2022. We included studies which analysed the use of AI, ML and DL models for trauma triage in human subjects. Reviews and AI/ML/DL models used for other purposes such as teaching, or diagnosis were excluded. Data was extracted on AI/ML/DL model type, comparison tools, primary outcomes and secondary outcomes. We performed meta-analysis on studies reporting our main outcomes of mortality, hospitalisation and critical care admission.

Results

One hundred and fourteen studies were identified in our search, of which 14 studies were included in the systematic review and 10 were included in the meta-analysis. All studies performed external validation. The best-performing AI/ML/DL models outperformed conventional trauma triage tools for all outcomes in all studies except two. For mortality, the mean area under the receiver operating characteristic (AUROC) score difference between AI/ML/DL models and conventional trauma triage was 0.09, 95% CI (0.02, 0.15), favouring AI/ML/DL models (p = 0.008). The mean AUROC score difference for hospitalisation was 0.11, 95% CI (0.10, 0.13), favouring AI/ML/DL models (p = 0.0001). For critical care admission, the mean AUROC score difference was 0.09, 95% CI (0.08, 0.10) favouring AI/ML/DL models (p = 0.00001).

Conclusions

This review demonstrates that the predictive ability of AI/ML/DL models is significantly better than conventional trauma triage tools for outcomes of mortality, hospitalisation and critical care admission. However, further research and in particular randomised controlled trials are required to evaluate the clinical and economic impacts of using AI/ML/DL models in trauma medicine.

Determinants of regulatory compliance in health and social care services: a systematic review protocol

Background: The delivery of high quality health and social care services is a fundamental goal for health systems worldwide. Identifying the determinants of quality is a complex task as there are a myriad of variables to choose from. Researchers in this field have assessed a range of organisational and environmental factors (for example: staff composition, facility ownership, facility size) for an association with various quality metrics. Less attention has been paid to the determinants of compliance with quality regulation. Identifying the determinants of compliance has the potential to improve regulatory processes and can inform quality improvement initiatives undertaken by service providers and policy makers. This protocol describes a systematic review which will review literature from a wide range of study designs and sources to develop an overview of the determinants of regulatory compliance in health and social care services. Methods: A wide range of study designs and grey literature will be sought for this review. Searches will be conducted using PubMed, MEDLINE, PsycInfo, SocINDEX and CINAHL databases. The studies included in the review will be subject to quality appraisal with reference to the collection of tools available from the Joanna Briggs Institute. Data extraction will be informed by the Consolidated Framework for Implementation Research (CFIR). A narrative synthesis will be conducted on the barriers, facilitators and factors associated with compliance, with reference to the concepts mapped onto the CFIR. GRADE-CERQual will be used to grade the overall body of evidence. Conclusion: The findings of this review will be useful to regulators to inform regulatory policy and practice. Service providers and policy makers may also use the findings to inform quality improvement initiatives aimed at improving compliance and quality across a range of health and social care services.

Determinants of regulatory compliance in health and social care services: a systematic review protocol

Background: The delivery of high quality health and social care services is a fundamental goal for health systems worldwide. Identifying the determinants of quality is a complex task as there are a myriad of variables to choose from. Researchers in this field have assessed a range of organisational and environmental factors (for example: staff composition, facility ownership, facility size) for an association with various quality metrics. Less attention has been paid to the determinants of compliance with quality regulation. Identifying the determinants of compliance has the potential to improve regulatory processes and can inform quality improvement initiatives undertaken by service providers and policy makers. This protocol describes a systematic review which will review literature from a wide range of study designs and sources to develop an overview of the determinants of regulatory compliance in health and social care services. Methods: A wide range of study designs and grey literature will be sought for this review. Searches will be conducted using PubMed, MEDLINE, PsycInfo, SocINDEX and CINAHL databases. The studies included in the review will be subject to quality appraisal with reference to the collection of tools available from the Joanna Briggs Institute. Data extraction will be informed by the Consolidated Framework for Implementation Research (CFIR). A narrative synthesis will be conducted on the barriers, facilitators and factors associated with compliance, with reference to the concepts mapped onto the CFIR. GRADE-CERQual will be used to grade the overall body of evidence. Conclusion: The findings of this review will be useful to regulators to inform regulatory policy and practice. Service providers and policy makers may also use the findings to inform quality improvement initiatives aimed at improving compliance and quality across a range of health and social care services.

Effects of environmental distractors on nurse emergency triage accuracy: a pilot study protocol

Background

The clinical decisions of emergency department triage nurses need to be of the highest accuracy. However, studies have found repeatedly that these nurses over- or underestimate the severity of patient health conditions. This has major consequences for patient safety and patient flow management. Workplace distractors such as noise and task interruptions have been pointed to as factors that might explain this inaccuracy. The use of a serious game reproducing the work environment during triage affords the opportunity to explore the impact of these distractors on nurse emergency triage accuracy, in a safe setting.

Methods/design

A pilot study with a factorial design will be carried out to test the acceptability and feasibility of a serious game developed specifically to simulate the triage process in emergency departments and to explore the primary effects of distractors on nurse emergency triage accuracy. Eighty emergency nurses will be randomized into four groups: three groups exposed to different distractors (A, noise; B, task interruptions; C, noise and task interruptions) and one control group. All nurses will have to complete 20 clinical vignettes within 2 h. For each vignette, a gold standard assessment will be determined by experts. Pre-tests will be conducted with clinicians and certified emergency nurses to evaluate the appeal of the serious game.

Discussion

Study results will inform the design of large-scale investigations and will help identify teaching, training, and research areas that require further development.

Limited reliability of experts' assessment of telephone triage in primary care patients with chest discomfort

OBJECTIVE

Root cause analyses of serious adverse events (SAE) in out-of-hours primary care (OHS-PC) often point to errors in telephone triage. Such analyses are, however, hampered by hindsight bias. We assessed whether experts, blinded to the outcome, recognize (un)safety of triage of patients with chest discomfort, and we quantified inter-rater reliability.

STUDY DESIGN AND SETTING

This is a case-control study with triage recordings from 2013-2017 at OHS-PC. Cases were missed acute coronary syndromes (ACSs, considered as SAE). These cases were age- and gender-matched 1:8 with the controls, sampled from the remainder of people calling for chest discomfort. Fifteen experts listened to the recordings and rated the safety of triage. We calculated sensitivity and specificity of recognizing an ACS and the intraclass correlation.

RESULTS

In total, 135 calls (15 SAE, 120 matched controls) were relistened. The experts identified ACSs with a sensitivity of 0.86 (95% CI: 0.71-0.95) and a specificity of 0.51 (95% CI: 0.43-0.58). Cases were rated significantly more often as unsafe than the controls (73.3% vs. 22.5%, P < 0.001). The inter-rater reliability for safety was poor: ICC 0.16 (95% CI: 0.00-0.32).

CONCLUSIONS

Blinded experts rated calls of missed ACSs more often as unsafe than matched control calls, but with a low level of agreement among the experts.

Benefit of a nurse-led telephone-based intervention prior to the first urogynecology outpatient visit: a randomized-controlled trial

Introduction and hypothesis

Triage has become a valid tool to reduce workload during the first consultation in a specialized clinic. A nurse-led telephone intervention prior to the first urogynecologic visit reduces visit duration and increases patients’ and physicians’ satisfaction.

Methods

All patients scheduled for their very first visit were recruited. They were randomized into an intervention group (prior contact by a specialized urogynecology nurse) and a control group (no contact). The intervention included a questionnaire about history and symptoms. Patients were prompted to complete a bladder diary. Primary outcome was duration of the consultation; secondary outcomes were patients’ and physicians’ satisfaction with the intervention.

Results

Fifty-five patients were allocated to the intervention group and 53 to the control group with no difference regarding age, BMI, parity, menopausal status and primary diagnosis. Mean duration of the telephone call was 10.8 min (SD 4.4). The consultation was significantly shorter in the intervention group than in the control group (mean difference: 4 min and 8 s, p = 0.017). In the intervention group, 79% of the patients found the consultation quality “excellent,” 86% would return, and 77% would recommend our clinic to a relative or friend compared with 68%, 67% and 66%, respectively, in the control group. Physicians were “very satisfied” or “satisfied” with the patient preparation.

Conclusions

A nurse-led intervention reduces the duration of the first uroynecologic consultation and is associated with high patient and physician satisfaction. Further research should evaluate whether it also decreases the number of follow-up visits and further referrals.

Electronic supplementary material

The online version of this article (10.1007/s00192-020-04318-0) contains supplementary material, which is available to authorized users.

Pitfalls in the triage and evaluation of patients with suspected acute ethanol intoxication in an emergency department

Acute ethanol intoxication (AEI) is frequent in emergency departments (EDs). These patients are at risk of mistriage, and to leave the ED without being seen. This study's objective was to describe the process and performance of triage and trajectory for patients with suspected AEI. Retrospective, observational study on adults admitted with a suspected AEI within 1 year at the ED of an urban teaching hospital. Data on the triage process, patients' characteristics, and their ED stay were extracted from electronic patient records. Predictors for leaving without being seen were identified using logistic regression analyzes. Of 60,488 ED patients within 1 year, 776 (1.3%) were triaged with suspected AEI. This population was young (mean age 38), primarily male (64%), and professionally inactive (56%). A large proportion were admitted on weekends (45%), at night (46%), and arrived by ambulance (85%). The recommendations of our triage scale were entirely respected in a minority of cases. In 22.7% of triage situations, a triage reason other than "alcohol abuse/intoxication" (such as suicidal ideation, head trauma or other substance abuse) should have been selected. Nearly, half of the patients (49%) left without being seen (LWBS). This risk was especially high amongst men (OR 1.56, 95% CI 1.12-2.19), younger patients (< 26 years of age; OR 1.97, 95% CI 1.16-3.35), night-time admissions (OR 1.97, 95% CI 1.16-3.35), and patients assigned a lower emergency level (OR 2.32, 95% CI 1.58-3.42). Despite a standardized triage protocol, patients admitted with suspected AEI are at risk of poor assessment, and of not receiving optimal care.

Overuse of plain abdominal radiography in emergency departments: a retrospective cohort study

BACKGROUND

Plain abdominal radiography (PAR) is routinely performed in emergency departments (EDs). This study aimed to (1) identify the indications for PAR in EDs and compare them against international guidelines, (2) uncover predictors of non-compliance with guidelines, and (3) describe the use of additional radiological examinations in EDs.

METHODS

Retrospective cohort study in the EDs of two hospitals in Geneva, Switzerland, including all adult patients who underwent PAR in the EDs. Indications were considered "appropriate" if complying with guidelines. Predictors of non-compliance were identified by univariate and multivariate analyses.

RESULTS

Over 1 year, PAR was performed in 1997 patients (2.2% of all admissions). Their mean age was 59.7 years, with 53.1% of female patients. The most common indications were constipation (30.8%), suspected ileus (28.9%), and abdominal pain (15.3%). According to the French and American guidelines, only 11.8% of the PARs were indicated, while 46.2% of them complied with the Australian and British guidelines. On multivariate analysis, admission to the private hospital ED (odds ratio [OR] 3.88, 95% CI 1.78-8.45), female gender (OR 1.95, 95% CI 1.46-2.59), and an age >  65 years (OR 2.41, 95%CI 1.74-3.32) were associated with a higher risk of inappropriate PAR. Additional radiological examinations were performed in 73.7% of patients.

CONCLUSIONS

Most indications for PAR did not comply with guidelines and elderly women appeared particularly at risk of being exposed to inappropriate examination. PAR did not prevent the need for additional examinations. Local guidelines should be developed, and initiatives should be implemented to reduce unnecessary PARs.

TRIAL REGISTRATION

ClinicalTrials.gov , identifier NCT02980081 .

Impact of a patient-flow physician coordinator on waiting times and length of stay in an emergency department: A before-after cohort study

OBJECTIVE

Overcrowding is common in most emergency departments (ED). Despite the use of validated triage systems, some patients are at risk of delayed medical evaluation. The objective of this study was to assess the impact of a patient-flow physician coordinator (PFPC) on the proportion of patients offered medical evaluation within time limits imposed by the Swiss Emergency Triage Scale (SETS) and on patient flow within the emergency department of a teaching urban hospital.

METHODS

In this before-after retrospective cohort study, we compared the proportions of patients who received their first medical contact within SETS-imposed time limits, mean waiting times before first medical consultation, mean length of stay, and number of patients who left without being seen by a physician, between two periods before and after introducing a PFPC. The PFPC was a senior physician charged with quickly assessing in the waiting area patients who could not immediately be seen and managing patient flow within the department.

RESULTS

Before introducing the PFPC position, 33,605 patients were admitted, versus 36,288 after. Introducing a PFPC enabled the department to increase the proportion of patients seen within the SETS-imposed time limits from 60.1% to 69.0% (p <0.0001). Waiting times until first medical consultation were reduced on average by 27.7 minutes (95% confidence interval [95% CI]: 25.9-29.5, p < .0001). No significant differences were observed as to length of stay or number of patients who left without being seen between the two study periods.

CONCLUSIONS

Introducing a physician dedicated to managing patient flow enabled waiting times until first medical consultation to be reduced, yet had no significant benefit for patient flow within the ED, nor did it reduce the number of patients who left without being seen.

Reliability of the revised Swiss Emergency Triage Scale: a computer simulation study

Background

The Swiss Emergency Triage Scale (SETS) is a four-level emergency scale that previously showed moderate reliability and high rates of undertriage due to a lack of standardization. It was revised to better standardize the measurement and interpretation of vital signs during the triage process.

Objective

The aim of this study was to explore the inter-rater and test–retest reliability, and the rate of correct triage of the revised SETS.

Patients and methods

Thirty clinical scenarios were evaluated twice at a 3-month interval using an interactive computerized triage simulator by 58 triage nurses at an urban teaching emergency department admitting 60 000 patients a year. Inter-rater and test–retest reliabilities were determined using κ statistics. Triage decisions were compared with a gold standard attributed by an expert panel. Rates of correct triage, undertriage, and overtriage were computed. A logistic regression model was used to identify the predictors of correct triage.

Results

A total of 3387 triage situations were analyzed. Inter-rater reliability showed substantial agreement [mean κ: 0.68; 95% confidence interval (CI): 0.60–0.78] and test–retest almost perfect agreement (mean κ: 0.86; 95% CI: 0.84–0.88). The rate of correct triage was 84.1%, and rates of undertriage and overtriage were 7.2 and 8.7%, respectively. Vital sign measurement was an independent predictor of correct triage (odds ratios for correct triage: 1.29 for each additional vital sign measured, 95% CI: 1.20–1.39).

Conclusion

The revised SETS incorporating standardized vital sign measurement and interpretation during the triage process resulted in high reliability and low rates of mistriage.

Mechanical restraint in an emergency department: a consecutive series of 593 cases

The objective is to describe the characteristics of mechanically restrained patients in the emergency department (ED) of a university hospital and to evaluate the quality of restraint documentation that was filled out according to the dedicated protocol with respect to the law on restraint. All adult patients (≥16 years) who were admitted to the ED from January 2009 to December 2010 and were mechanically restrained were included. We assessed medical and demographic characteristics, the completeness of the dedicated protocol, and the concomitant use of chemical sedation. 72,844 patients were admitted to the ED. Of these, 593 (0.81%) were mechanically restrained. Two types of patients were restrained: young patients under the influence of psychoactive substances who were usually discharged home, and confused older patients who were hospitalized. 186 dedicated protocols were missing (31.4%). From the 407 filled-out protocols, only 119 (29.2%) were complete. Of the mechanically restrained patients, 215 (36.2%) received additional chemical sedation. Even though restraint is strictly regulated by law, many protocols justifying the privation of liberty were not filled out. This emphasizes the need for strict respect of the dedicated protocol and the use of guidelines and training sessions for nursing and medical staff that address specific procedures for the two categories of patients needing to be restrained.

A retrospective study of complaint letters sent to a Swiss Emergency Department between 2009 and 2014

OBJECTIVE

Patient complaints are a valuable resource for monitoring and improving patient safety and quality of care. The purpose of this study was to analyze the complaint letters received at a Swiss academic emergency department (ED) over six years.

METHODS

A retrospective study of all complaint letters sent to a Swiss academic ED between 2009 and 2014 was conducted. The following data were extracted: epidemiology items, reasons for complaints, hospital responses, follow-up, and severity of the events mentioned in the complaints. All complaint letters related to adult patients evaluated in the ED between 2009 and 2014 were included and a qualitative evaluation was performed based on a systematic taxonomy. Context, patient characteristics, mode of resolution and clinical severity of the related adverse event were evaluated.

RESULTS

A total number of 156 complaints were recorded, corresponding to an annual complaint rate of 5.5 to 8.8 per 10,000 visits. The complaints concerned mostly three domains (clinical care, management and patient or caregiver relationship) with a slight predominance for organisation and logistics (39%) compared with 31.4% for standard of care and 29.6% for communication/relational complaints. The majority of complaints were sent within one month of the ED visit. Most complaints were resolved with written apologies or explanations. The consequences of 73.5% of the events in question were considered minor or negligible, 19% moderate, and 6.5% major. Only 1% (two cases) was related to situations with catastrophic consequences.

CONCLUSION

Complaint incidence in our ED was low and remained stable over the six-year observation period. Most of the complaints pertained to incidents that entailed negligible or minor consequences. As most complaints were due to inadequate communication, interventions targeting improvement of the doctor/patient communication are required.

Reliability and performance of the Swiss Emergency Triage Scale used by paramedics

Objectives

No general emergency department triage scale has been evaluated for prehospital triage. The objective of this study was to evaluate the reliability and the performance of the Swiss Emergency Triage Scale (SETS) used by paramedics to determine the emergency level and orientation of simulated patients.

Patients and methods

In a prospective cross-sectional study, 23 paramedics evaluated 28 clinical scenarios with the SETS using interactive computerized triage software simulating real-life triage. The primary outcome was inter-rater reliability regarding the triage level among participants measured by intraclass correlation coefficient (ICC). Secondary outcomes were the accuracy of triage level and the reliability and accuracy of orientation of patients of at least 75 years to a dedicated geriatric emergency centre.

Results

Twenty-three paramedics completed the evaluation of the 28 scenarios (644 triage decisions). Overall, ICC for triage level was 0.84 (95% confidence interval: 0.77–0.99). Correct emergency level was assigned in 89% of cases, overtriage rate was 4.8%, and undertriage was 6.2%. ICC regarding orientation in the subgroup of simulated patients of at least 75 years was 0.76 (95% confidence interval: 0.61–0.89), with 93% correct orientation.

Conclusion

Reliability of paramedics rating simulated emergency situations using the SETS was excellent, and the accuracy of their rating was very high. This suggests that in Switzerland, the SETS could be safely used in the prehospital setting by paramedics to determine the level of emergency and guide patients to the most appropriate hospital.

Validation of an emergency triage scale for obstetrics and gynaecology: a prospective study

OBJECTIVE

To evaluate the reliability of a four-level triage scale for obstetrics and gynaecology emergencies and to explore the factors associated with an optimal triage.

DESIGN

Thirty clinical vignettes presenting the most frequent indications for obstetrics and gynaecology emergency consultations were evaluated twice using a computerised simulator.

SETTING

The study was performed at the emergency unit of obstetrics and gynaecology at the Geneva University Hospitals.

SAMPLE

The vignettes were submitted to nurses and midwives.

METHODS

We assessed inter- and intra-rater reliability and agreement using a two-way mixed-effects intra-class correlation (ICC). We also performed a generalised linear mixed model to evaluate factors associated triage correctness.

MAIN OUTCOME MEASURES

Triage acuity.

RESULTS

We obtained a total of 1191 evaluations. Inter-rater reliability was good (ICC 0.748; 95% CI 0.633-0.858) and intra-rater reliability was almost perfect (ICC 0.812; 95% CI 0.726-0.889). We observed a wide variability: the mean number of questions varied from 6.9 to 18.9 across individuals and from 8.4 to 16.9 across vignettes. Triage acuity was underestimated in 12.4% of cases and overestimated in 9.3%. Undertriage occurred less frequently for gynaecology compared with obstetric vignettes [odds ratio (OR) 0.45; 95% CI 0.23-0.91; P = 0.035] and decreased with the number of questions asked (OR 0.94; 95% CI 0.88-0.99; P = 0.047). Certification in obstetrics and gynaecology emergencies was an independent factor for the avoidance of undertriage (OR 0.35; 95% CI 0.17-0.70; P = 0.003).

CONCLUSION

The four-level triage scale is a valid and reliable tool for the integrated emergency management of obstetrics and gynaecology patients.

TWEETABLE ABSTRACT

The Swiss Emergency Triage Scale is a valid and reliable tool for obstetrics and gynaecology emergency triage.

Nursing home residents at the Emergency Department: a 6-year retrospective analysis in a Swiss academic hospital

The increasing number of elderly persons produces an increase in emergency department (ED) visits by these patients, including nursing home (NH) residents. This trend implies a major challenge for the ED. This study sought to investigate ED visits by NH residents in an academic hospital. A retrospective monocentric analysis of all ED visits by NH residents between 2005 and 2010 in a Swiss urban academic hospital. All NH residents aged 65 years and over were included. Socio-demographic data, mode of transfer to ED, triage severity rating, main reason for visit, ED and hospital length of stay, discharge dispositions, readmission at 30 and 90 day were collected. Annual ED visits by NH residents increased by 50 % (from 465 to 698) over the study period, accounting for 1.5 to 1.9 % of all ED visits from 2005 to 2010, respectively. Over the period, yearly rates of ED visits increased steadily from 18.8 to 27.5 per 100 NH residents. Main reasons for ED visits were trauma, respiratory, cardiovascular, digestive, and neurological problems. 52 % were for urgent situations. Less than 2 % of NH residents died during their ED stay and 60 % were admitted to hospital wards. ED use by NH residents disproportionately increased over the period, likely reflecting changes in residents and caregivers' expectations, NH staff care delivery, as well as possible correction of prior ED underuse. These results highlight the need to improve ED process of care for these patients and to identify interventions to prevent potentially unnecessary ED transfers.

Nurses' accuracy and self-perceived ability using the Emergency Severity Index triage tool: a cross-sectional study in four Swiss hospitals

Background

The Emergency Severity Index (ESI) is an English language emergency department patient triage tool. After translation, it has been adapted for use to triage patients in growing numbers of emergency departments in non-English-speaking countries. Few reports of the proficiency of triage nurses to score an ESI exist. We sought to determine accuracy, inter-rater reliability, and subjective confidence of triage nurses at four hospitals to determine an ESI from standardized ESI scenarios.

Methods

Triage nurses assigned an ESI score to each of 30 standard ESI (ESI Implementation Handbook Version 4) translated teaching case scenarios. Accuracy and Inter-rater reliability (Krippendorff’s alpha) of the ESI scoring was measured. Nurses’ subjective confidence applying the ESI algorithm was obtained by a Likert scale.

Results

Sixty-nine nurses from four EDs participated in the study. They scored 59.6 % of the case scenarios correctly. Inter-rater reliability was 0.78 (Krippendorff’s alpha). Most (54/69, 78 %) felt confident in their ability to apply the ESI.

Conclusions

Low accuracy of ESI score assignment was observed when nurses scored an ESI for 30 standard written case scenarios, translated into nurses’ native language, despite a good inter-rater reliability and high nurse confidence in their ability to apply the ESI. Although feasible, using standard written case scenarios to determine ESI triage scoring effectiveness may not be the optimum means to rate nurses’ triage skills.

Missed opportunities: evolution of patients leaving without being seen or against medical advice during a six-year period in a Swiss tertiary hospital emergency department

Aim. The study aimed at describing the evolution over a 6-year period of patients leaving the emergency department (ED) before being seen (“left without being seen” or LWBS) or against medical advice (“left against medical advice” or LAMA) and at describing their characteristics. Methods. A retrospective database analysis of all adult patients who are admitted to the ED, between 2005 and 2010, and who left before being evaluated or against medical advice, in a tertiary university hospital. Results. During the study period, among the 307,716 patients who were registered in the ED, 1,157 LWBS (0.4%) and 1,853 LAMA (0.9%) patients were identified. These proportions remained stable over the period. The patients had an average age of 38.5 ± 15.9 years for LWBS and 41.9 ± 17.4 years for LAMA. The median time spent in the ED before leaving was 102.4 minutes for the LWBS patients and 226 minutes for LAMA patients. The most frequent reason for LAMA was related to the excessive length of stay. Conclusion. The rates of LWBS and LAMA patients were low and remained stable. The patients shared similar characteristics and reasons for leaving were largely related to the length of stay or waiting time.

Swedish emergency department triage and interventions for improved patient flows: a national update

BACKGROUND

In Scandinavia, emergency department triage and patient flow processes, are under development. In Sweden, the triage development has resulted in two new triage scales, the Adaptive Process Triage and the Medical Emergency Triage and Treatment System. Both these scales have logistic components, aiming to improve patient flows. The aim of this study was to report the development and current status of emergency department triage and patient flow processes in Sweden.

METHODS

In 2009 and 2010 the Swedish Council on Health Technology Assessment sent out a questionnaire to the ED managers in all (74) Swedish hospital emergency departments. The questionnaire comprised questions about triage and interventions to improve patient flows.

RESULTS

Nearly all (97%) EDs in Sweden employed a triage scale in 2010, which was an increase from 2009 (73%). Further, the Medical Emergency Triage and Treatment System was the triage scale most commonly implemented across the country. The implementation of flow-related interventions was not as common, but more than half (59%) of the EDs have implemented or plan to implement nurse requested X-ray.

CONCLUSIONS

There has been an increase in the use of triage scales in Swedish EDs during the last few years, with acceleration for the past two years. Most EDs have come to use the Medical Emergency Triage and Treatment System, which also indicates regional co-operation. The implementation of different interventions for improved patient flows in EDs most likely is explained by the problem of crowding. Generally, more studies are needed to investigate the economical aspects of these interventions.

Emergency department triage scales and their components: a systematic review of the scientific evidence

Emergency department (ED) triage is used to identify patients' level of urgency and treat them based on their triage level. The global advancement of triage scales in the past two decades has generated considerable research on the validity and reliability of these scales. This systematic review aims to investigate the scientific evidence for published ED triage scales. The following questions are addressed: 1. Does assessment of individual vital signs or chief complaints affect mortality during the hospital stay or within 30 days after arrival at the ED?2. What is the level of agreement between clinicians' triage decisions compared to each other or to a gold standard for each scale (reliability)? 3. How valid is each triage scale in predicting hospitalization and hospital mortality? A systematic search of the international literature published from 1966 through March 31, 2009 explored the British Nursing Index, Business Source Premier, CINAHL, Cochrane Library, EMBASE, and PubMed. Inclusion was limited to controlled studies of adult patients (≥ 15 years) visiting EDs for somatic reasons. Outcome variables were death in ED or hospital and need for hospitalization (validity). Methodological quality and clinical relevance of each study were rated as high, medium, or low. The results from the studies that met the inclusion criteria and quality standards were synthesized applying the internationally developed GRADE system. Each conclusion was then assessed as having strong, moderately strong, limited, or insufficient scientific evidence. If studies were not available, this was also noted.We found ED triage scales to be supported, at best, by limited and often insufficient evidence.The ability of the individual vital signs included in the different scales to predict outcome is seldom, if at all, studied in the ED setting. The scientific evidence to assess interrater agreement (reliability) was limited for one triage scale and insufficient or lacking for all other scales. Two of the scales yielded limited scientific evidence, and one scale yielded insufficient evidence, on which to assess the risk of early death or hospitalization in patients assigned to the two lowest triage levels on a 5-level scale (validity).

Telephone triage by nurses in primary care out-of-hours services in Norway: an evaluation study based on written case scenarios

Background

The use of nurses for telephone-based triage in out-of-hours services is increasing in several countries. No investigations have been carried out in Norway into the quality of decisions made by nurses regarding our priority degree system. There are three levels: acute, urgent and non-urgent.

Methods

Nurses working in seven casualty clinics in out-of-hours districts in Norway (The Watchtowers) were all invited to participate in a study to assess priority grade on 20 written medical scenarios validated by an expert group. 83 nurses (response rate 76%) participated in the study. A one-out-of-five sample of the nurses assessed the same written cases after 3 months (n=18, response rate 90%) as a test–retest assessment.

Results

Among the acute, urgent and non-urgent scenarios, 82%, 74% and 81% were correctly classified according to national guidelines. There were significant differences in the proportion of correct classifications among the casualty clinics, but neither employment percentage nor profession or work experience affected the triage decision. The mean intraobserver variability measured by the Cohen kappa was 0.61 (CI 0.52 to 0.70), and there were significant differences in kappa with employment percentage. Casualty clinics and work experience did not affect intrarater agreement.

Conclusion

Correct classification of acute and non-urgent cases among nurses was quite high. Work experience and employment percentage did not affect triage decision. The intrarater agreement was good and about the same as in previous studies performed in other countries. Kappa increased significantly with increasing employment percentage.

Modern triage in the emergency department

BACKGROUND

Because the volume of patient admissions to an emergency department (ED) cannot be precisely planned, the available resources may become overwhelmed at times ("crowding"), with resulting risks for patient safety. The aim of this study is to identify modern triage instruments and assess their validity and reliability.

METHODS

Review of selected literature retrieved by a search on the terms "emergency department" and "triage."

RESULTS

Emergency departments around the world use different triage systems to assess the severity of incoming patients' conditions and assign treatment priorities. Our study identified four such instruments: the Australasian Triage Scale (ATS), the Canadian Triage and Acuity Scale (CTAS), the Manchester Triage System (MTS), and the Emergency Severity Index (ESI). Triage instruments with 5 levels are superior to those with 3 levels in both validity and reliability (p<0.01). Good to very good reliability has been shown for the best-studied instruments, CTAS and ESI (κ-statistics: 0.7 to 0.95), while ATS and MTS have been found to be only moderately reliable (κ-statistics: 0.3 to 0.6). MTS and ESI are both available in German; of these two, only the ESI has been validated in German-speaking countries.

CONCLUSION

Five-level triage systems are valid and reliable methods for assessment of the severity of incoming patients' conditions by nursing staff in the emergency department. They should be used in German emergency departments to assign treatment priorities in a structured and dependable fashion.

Calculating kappas from adjusted data improved the comparability of the reliability of triage systems: a comparative study

OBJECTIVES

It is difficult to compare the reliability of triage systems with the kappa statistic. In this article, a method for comparing triage systems was developed and applied to previously conducted triage reliability studies.

STUDY DESIGN AND SETTING

From simulations with theoretical distributions, the minimum, normal, and maximum weighted kappa for 3- to 5-level triage systems were computed. To compare the reliability of triage systems in previously conducted triage reliability studies, the normal kappa was calculated. Furthermore, the reported quadratically weighted kappas were compared with the minimum, normal, and maximum weighted kappa to characterize the degree and direction of skewness of the data.

RESULTS

The normal kappa was higher in 3-level triage systems (median: κ=0.84) compared with 4-level (median: κ=0.37) and 5-level (median: κ=0.57) systems. In 3-level triage systems, the percentages observed agreement were unequally distributed, which resulted in small quadratically weighted kappas. In 4- and 5-level systems, the percentages observed agreement were more equally distributed compared with 3-level systems, which resulted in higher quadratically weighted kappa values.

CONCLUSION

When comparing triage systems with different numbers of categories, one should report both the normal and quadratically weighted kappa. Calculating normal kappas from previously conducted triage reliability studies revealed substantial theoretical differences in interrater reliability of triage systems than previously reported.

Patient experience of the triage encounter in a Swedish emergency department

Emergency department triage is a prerequisite for the rapid identification of critically ill patients and for allocation of the correct acuity level which is pivotal for medical safety. The patient's first encounter with a medical professional in the emergency department is often with the triage nurse.

OBJECTIVES

To identify patient experience of the triage encounter.

METHODS

A questionnaire focusing on the patient-triage nurse relationship in terms of satisfaction with the medical and administrative information, privacy and confidentiality in the triage area as well as triage nurse competence and attitude was answered by 146 participating patients.

RESULTS

The majority of patients perceived that while they were triaged immediately upon arrival to the emergency department, they were often given limited information about the waiting time. Although almost a quarter of the patients did not wish to have information about their medical condition from the triage nurse, 97% of the patients considered the triage nurse to be medically competent for the triage task.

CONCLUSIONS

Patients were generally satisfied with the reception and care given by the triage nurses, but less satisfied about information about expected waiting time. We suggest therefore, that patients should be routinely informed about their estimated waiting time to be seen by the doctor in addition to their triage level.

Revealing triage behaviour patterns in ER using a new technology for handwritten data acquisition

INTRODUCTION

Data acquisition is still one of the important challenges to be met in clinical settings. This is even more critic in settings with high cognitive workloads, such as emergency room (ER). Observations in these settings are difficult to realize without biases and there is little means to trace fine acquisition activities done in natural environments, using pen and papers. This study is based on the usage of a digital pen and paper (DPP) technology for the acquisition of triage information by nurses in ER. The DPP technology has been used to ease acquisition using a natural mechanism; it also minimizes the external influence of observation during acquisition activities. The aim of this study is to determine whether data recorded by the DPP technology allows explaining how ER triage nurses use the triage forms in real working conditions.

METHODOLOGY

The chief physicians of the ER service wanted to have answers about three main concerns pertaining to the triage process: (1) the average time spent during the triage process; (2) the sequence in which the fields of the forms were filled and; (3) the contribution of objective measurements, such as vital signs, to the triage emergency level and decisions. In order to answer these questions, detailed log data recorded by the DPP during form filling as been analyzed and allowed to built several representations of the triage process. In addition, we completed this analysis with ethnographical-like observations.

RESULTS

For seven consecutive days, 1183 triage forms have been recorded in the ER for all patients admitted. Among them, 954 forms have been digitalized and 906 forms have been considered as valid and complete. Based on this set of data, the median duration of the triage process is 143 s. There are no converging habits in filling the forms and the sequence of filling fields present a high variability. The emphasis of the objective measurements in the decisional process is rather low, as vital signs are recorded in less than 17% of the cases.

CONCLUSION

The DPP technology is an original approach to study data acquisition processes in unbiased conditions. The technical raw data recorded by the DPP allows building the time series of all activities on the paper, therefore letting to constructing several representations of the process. However, the technology is not able to provide information about the context of use, for example interruptions of the form filling processes due to calls or other activities. Therefore, it is necessary to complete these analyses with qualitative approaches such as observational studies and interviews. Noticeably, as a result of this study, the head physicians of ER have redesigned the triage form to enforce the use of objective measurements and ease the data acquisition process.

Limitations in validating emergency department triage scales

OBJECTIVE

To examine whether current validation methods of emergency department triage scales actually assess the instrument's validity.

METHODS

Optimal methods of emergency department triage scale validation are examined in developed countries and their application to developing countries is considered.

RESULTS AND CONCLUSION

Numerous limitations are embedded in the process of validating triage scales. Methods of triage scale validation in developed countries may not be appropriate and repeatable in developing countries. Even in developed countries there are problems in conceptualising validation methods. A new consensus building validation approach has been constructed and recommended for a developing country setting. The Delphi method, a consensual validation process, is advanced as a more appropriate alternative for validating triage scales in developing countries.