The accuracy and consistency of rural, remote and outpost triage nurse decision making in one Western Australia Country Health Service Region

Emergency department triage decision-making by registered nurses: An instrument development study

AIM

To develop and psychometrically test the triage decision-making instrument, a tool to measure Emergency Department Registered Nurses decision-making.

DESIGN

Five phases: (1) defining the concept, (2) item generation, (3) face validity, (4) content validity and (5) pilot testing.

METHODS

Concept definition informed by a grounded theory study from which four domains emerged. Items relevant to the four domains were generated and revised. Face validity was established using three focus groups. The target population upon which the reliability and validity of the triage decision-making instrument was explored were triage registered nurses in emergency departments. Three expert judges assessed 89 items for content and domain designation using a 4-point scale. Psychometric properties were assessed by exploratory factor analysis, following which the names of the four domains were modified.

RESULTS

The triage decision-making instrument is a 22-item tool with four factors: clinical judgement, managing acuity, professional collaboration and creating space. Focus group data indicated support for the domains. Expert review resulted in 46 items with 100% agreement and 13 with 66% agreement. Fifty-nine items were distributed to a convenience sample of 204 triage nurses from six hospitals in 2019. The Kaiser-Meyer-Olkin measures indicated that the data were sufficient for exploratory factor analysis. Bartlett's test indicated patterned relationships among the items (X 2 (231) = 1156.69). An eigenvalue of >1.0 was used and four factors explained 48.64% of the variance. All factor loadings were ≥0.40. Internal consistency was demonstrated by Cronbach's alphas of .596 factor 1, .690 factor 2, .749 factor 3 and .822 for factor 4.

CONCLUSION

The triage decision-making instrument meets the criteria for face validity, content validity and internal consistency. It is suitable for further testing and refinement.

IMPACT

The instrument is a first step in quantifying triage decision-making in real-world clinical environments. The triage decision-making instrument can be used for targeted triage interventions aimed at improving throughput and staff education.

STATISTICAL SUPPORT

Dr. Tak Fung who is a member of the research team is a statistician.

STATISTICAL METHODS

Development, validation and assessment of instruments/scales. Descriptive statistics.

REPORTING METHOD

STROBE cross-sectional checklist.

IMPLICATIONS FOR THE PROFESSION AND/OR PATIENT CARE

The TDI makes the complexity of triage decision-making visible. Identifying the influence of decision-making factors in addition to acuity that affect triage decisions will enable nurse managers and educators to develop targeted interventions and staff development initiatives. By extension, this will enhance patient care and safety.

Incidence of overtriage and undertriage and associated factors: A cross-sectional study using a secondary data analysis

BACKGROUND

Improving triage accuracy for accurate patient identification and appropriate resource allocation is essential. Little is known about the trend of triage accuracy, and factors associated with mistriage vary from study to study.

AIM

To identify incidence and risk factors of mistriage, such as overtriage and undertriage.

DESIGN

This is a cross-sectional study.

METHODS

The data came from the National Emergency Department Information System database in 2016-2020. All patients 15 years and older visiting emergency departments in Korea were assessed for eligibility, and 20,641,411 emergency patients' data were used. Multivariable logistic regressions were conducted to confirm the associated factors with overtriage and undertriage compared to expected triage. Demographic characteristics, disease-related signs and triage-related factors were independent variables.

RESULTS

Expected triage decreased from 96.8% in 2016 to 95.7% in 2020. Overtriage (0.5%-0.7%) and undertriage (2.4%-3.3%) increased. The occupation that performed triage the most (over 85%) was nurses. Associated factors with overtriage were demographic characteristics (40-64 age group, female), disease-related signs (known disease, direct visit) and triage-related factors (regional emergency medical centre). Risk factors to undertriage were disease-related signs (systolic/diastolic blood pressure and pulse rates within normal range).

CONCLUSIONS

While the acuity degree remained within the recommended range, the accuracy of triage decreased, and there was a gradual increase in mistriaged cases. Nurses have performed most of the triage and played a key role in expected triage. Associated factors with overtriage were demographic characteristics, disease-related signs and triage-related factors and risk factors to undertriage were disease-related signs.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

IMPLICATIONS FOR THE PROFESSION

Nurses should be aware of what factors are associated with mistriage and why the factors cause mistriage to improve the triage accuracy because they are responsible for the majority of the triage assessments.

Triage Accuracy of Emergency Nurses: An Evidence-Based Review

INTRODUCTION

Accurate triage assessment by emergency nurses is essential for prioritizing patient care and providing appropriate treatment. Undertriage and overtriage remain an ongoing issue in care of patients who present to the emergency department. The purpose of this literature review was to examine factors associated with triage accuracy in the emergency department.

METHODS

We conducted an evidence-based literature review using the Cumulative Index to Nursing and Allied Health Literature, PubMed, and Embase. The search focused on peer-reviewed articles in English, available in full text, published between January 2011 and December 2021.

RESULTS

A total of 14 articles met inclusion criteria and revealed the following 3 themes for triage accuracy: triage nurse characteristics, patient characteristics, and work environment. Triage nurses' accuracy rates ranged from 59.3% to 82%, with experience in triage associated with higher accuracy. Patient characteristics influenced triage accuracy, with nontrauma patients being undertriaged and trauma patients often overtriaged. The work environment played a role, as accuracy rates varied based on shift time and patient volume. Competing systems between prehospital and ED triage posed challenges and affected accuracy during fluctuations in patient volumes.

DISCUSSION

This review underscores the complex nature of ED triage accuracy. It highlights the importance of nurse experience, training programs, patient characteristics, and the work environment in enhancing triage decision making. Enhanced understanding of these factors can inform strategies to optimize triage accuracy and improve patient outcomes.

Emergency department performance assessment using administrative data: A managerial framework

Administrative data play an important role in performance monitoring of healthcare providers. Nonetheless, little attention has been given so far to the emergency department (ED) evaluation. In addition, most of existing research focuses on a single core ED function, such as treatment or triage, thus providing a limited picture of performance. The goal of this study is to harness the value of routinely produced records proposing a framework for multidimensional performance evaluation of EDs able to support internal decision stakeholders in managing operations. Starting with the overview of administrative data, and the definition of the desired framework's characteristics from the perspective of decision stakeholders, a review of the academic literature on ED performance measures and indicators is conducted. A performance measurement framework is designed using 224 ED performance metrics (measures and indicators) satisfying established selection criteria. Real-world feedback on the framework is obtained through expert interviews. Metrics in the proposed ED performance measurement framework are arranged along three dimensions: performance (quality of care, time-efficiency, throughput), analysis unit (physician, disease etc.), and time-period (quarter, year, etc.). The framework has been judged as "clear and intuitive", "useful for planning", able to "reveal inefficiencies in care process" and "transform existing data into decision support information" by the key ED decision stakeholders of a teaching hospital. Administrative data can be a new cornerstone for health care operation management. A framework of ED-specific indicators based on administrative data enables multi-dimensional performance assessment in a timely and cost-effective manner, an essential requirement for nowadays resource-constrained hospitals. Moreover, such a framework can support different stakeholders' decision making as it allows the creation of a customized metrics sets for performance analysis with the desired granularity.

Training nurses to triage: a scoping review

Triage accuracy is important to ensure effective treatment and management of patients in the emergency department, however this requires nurses to receive high-quality triage training. This article reports the results of a scoping review that aimed to establish what research on triage training exists and what research is required to improve such training. Sixty-eight studies which used a range of training interventions and outcome measurements were reviewed. The authors conclude that the heterogeneity of these studies makes comparison challenging and that this, combined with low methodological quality, requires caution when applying the results in practice. The authors recommend establishing a gold standard for measuring triage training outcomes.

Characteristics and processes of registered nurses' clinical reasoning and factors relating to the use of clinical reasoning in practice: a scoping review

OBJECTIVE

The objective of this review was to examine the characteristics and processes of clinical reasoning used by registered nurses in clinical practice, and to identify factors reported to relate to the use of clinical reasoning by registered nurses in clinical practice.

INTRODUCTION

Significant variability in the clinical reasoning of graduate registered nurses has been identified in research, with underdeveloped and unsafe clinical reasoning being linked to failure-to-rescue and sentinel events in the clinical setting. The identification of characteristics and processes of clinical reasoning, and factors relating to registered nurses' clinical reasoning when engaged in clinical practice, will increase understanding of the clinical reasoning requirements for undergraduate registered nurses and of potential factors that may affect their clinical reasoning.

INCLUSION CRITERIA

Studies including registered nurses who met the criteria for registered nurse registration in Australia and who used clinical reasoning to engage with health care consumers in all practice environments were eligible for inclusion.

METHODS

Eight databases were searched, with articles identified through CINAHL, MedNar, PubMed, Science Direct, ERIC, PsycINFO, Scopus, and ProQuest Dissertations and Theses. Database searches were conducted on December 31, 2020, and updated August 20, 2021, with primary qualitative and quantitative research studies in English from 2000 onwards considered for inclusion. Opinion papers, text, and reports were not included. Data were extracted based on the draft charting tool from the scoping review protocol, with results presented in tabular format and in a narrative summary.

RESULTS

The 29 qualitative and 5 quantitative research studies included in the scoping review utilized exploratory descriptive, descriptive rationalist, narrative, ethnography, correlational, observational, and grounded theory methodologies in their research designs. Observation, think-aloud sessions, questionnaires, surveys, interviews, and focus groups were used to collect data from the 1099 participants in 9 countries. Multiple concepts related to the characteristics (n=35) and processes (n=30) of clinical reasoning were detected in the research studies, with 5 categories identified: i) situation management, ii) data management, iii) interpreting, iv) implementing and evaluating, and v) professional practice, with an additional processes category identified (decision-making processes). The factors (n=26) reported to relate to clinical reasoning were categorized into environment of care, care requirements, professional practice, experience, knowledge, and decision-making processes. Connections between the various concepts were evident throughout the review.

CONCLUSIONS

The scoping review identified characteristics and processes of clinical reasoning, as well as factors reported to relate to clinical reasoning in all studies. The concepts that comprise the clinical reasoning of registered nurses in clinical practice must be considered in undergraduate registered nurse education. Registered nurses must complete their baccalaureate program with well-developed clinical reasoning to ensure safe clinical practice. Understanding the characteristics and processes of registered nurses' clinical reasoning in clinical practice, and the factors reported to relate to clinical reasoning, supports the creation of targeted resources for development and assessment of clinical reasoning.

Errors in nurse-led triage: An observational study

BACKGROUND

Nurses play a crucial role in correctly prioritizing patients entering emergency departments. However, little is known of the accuracy of nurse-led triage systems.

OBJECTIVES

(1) To determine the frequency of nurse-led triage errors within the Manchester Triage System; (2) to explore patient, work environment and individual nurse factors associated with triage errors; and (3) to explore associations between triage errors and patient outcomes (i.e., length of emergency department stay, hospitalization, and 7- and 30-day mortality).

SETTING

This study was conducted in one emergency department in Northern Italy.

PARTICIPANTS

A random sample of 5% (n = 1,929) of all eligible patients accessing the emergency department over an 18-month period.

METHODS

For this retrospective observational study, electronic health record data on triage errors (i.e., incorrect presentational flowchart, specific discriminator and/or priority level) and triage nurses were combined with routine data on patient characteristics, outcomes and the work environment. To explore relationships between these variables, we performed univariate and multivariate logistic regression analyses.

RESULTS

We observed triage errors in 16.3% of patients (n = 314). These were significantly associated with patients' emergency department and hospital stays. Analyses revealed that when > one patient was triaged every 15 min (OR: 2.112;95%CI: 1.331-3.354), older patients (OR: 1.009; 95%CI: 1.003-1.015) with > than two chronic conditions (OR: 1.506; 95%CI: 1.091-2.081) and orange or red priority codes (OR: 1.314; 95%CI: 1.046-1.651,) whose triage nurse had previous experience with another triage system (OR: 3.189; 95%CI: 2.455-4.14) had higher odds of triage errors.

CONCLUSION

We provided primary evidence on triage errors. Confirming our findings on the prevalence, nature and consequences of such errors will require further prospective multicenter studies. Considering patient factors (e.g., age, polychronicity) as additional discriminators could make the nurse-led triage process using the Manchester Triage System more accurate. Investigating the roles of triage nurses' training and background and the emergency department work environment on their mental models regarding the triage process will require qualitative research.

Factors affecting the accuracy of nurse triage in tertiary care emergency departments

OBJECTIVES:

The accuracy and duration of triage is vital in emergency departments. However, patient density, diversity of cases, and time pressure make triage difficult. Triage performed properly and at the right time prevents patients from experiencing any untoward incidents that may occur because of waiting. Therefore, the study aimed to share the data obtained from the Hospital Information Management System (HIMS) regarding the accuracy and duration of nurse triage in an adult emergency department.

METHODS:

This descriptive and cross-sectional study evaluated the accuracy and duration of triage decisions made by nurses for patients admitted to an adult emergency department between June 15 and July 15, 2019. Statistical analysis was performed using Statistical analysis was performed using SPSS software version 23.00.

RESULTS:

The study included the data of 7705 adult patients. The accuracy rate of nurse triage was 59.3% (n = 4566), and the average duration of triage was 1.52 ± 2.10 min. It was observed that the average duration of accurate triage decisions was longer in patients with triage category 3. A statistically significant relationship was determined between the accuracy of nurse triage and the duration of triage, years of seniority of the nurse, and shifts (P < 0.05).

CONCLUSIONS:

The accuracy and duration of nurse triage in the hospital where the study was conducted can be evaluated via the HIMS. In order to increase the accuracy of nurse triage in the emergency department, it is necessary to employ experienced and trained nurses, develop computer-based support systems, and increase the number of nurses working in shifts providing care to a large number of patients.

The impact of emergency department triage on the treatment outcomes of cancer patients with febrile neutropenia: A retrospective review

INTRODUCTION

The emergency department (ED) is an important entry point for patients with cancer requiring acute care due to oncological emergencies. Febrile neutropenia (FN) is one of the most common oncological emergencies and carries a significant risk of morbidity and mortality. There is evidence from previous studies that FN patients wait far longer in the ED than recommended by international guidelines.

PURPOSE

The aim was to examine whether individuals with cancer presenting at the ED with FN were triaged appropriately, and to explore if, and how, triage affected their treatment outcomes.

METHODS

A retrospective cohort design was employed to collect data over five years from all available ED records of adult cancer patients who presented with fever.

RESULTS

Of the 431 eligible patients, 63% (n = 272) were assigned triage scores that were detrimental to their immediate health. Findings from the multiple linear regression analyses showed that inaccurate or under triage was significantly associated with delayed times for the initial physician assessment, administration of antibiotics, and decision on admission. The absence of fever at the time of triage assessment contributed significantly to the prediction of under triage.

CONCLUSION

The allocation of patients with FN to a lower, inaccurate priority was partly responsible for the inability of those patients to meet the standard benchmarks for the initial physician assessment and the administration of antibiotics identified by the triage and febrile neutropenia guidelines. Ongoing strategies are needed to both enhance the application of the triage guidelines and institute organizational and system changes that promote timeliness and effectiveness throughout the entire ED episode of care.

Using clinical based vignettes to further develop a mass gathering event triage tool

BACKGROUND

Previously published triage tools for use at mass gathering events (MGE) lack real-world validation. Non-health care professionals, such as first aiders, first responders, and advanced responders often undertake a triage role at MGEs. This research aimed to determine consistency in the decision-making of a MGE triage tool.

METHOD

Volunteer members of St John Ambulance Australia were recruited. Surveys included participant demographics and real-world clinical vignettes. Participants determined a triage category based on the vignettes and supplied triage tool. Demographics were analysed using descriptive statistics and responses to vignettes were analysed using Fleiss Kappa [p-bar].

RESULTS

There were 110 participants, the majority male (60%), having completed a Bachelor or higher degree (53.6%), and were non-health care professionals (70%). Of the vignettes, there was a slightly better than moderate agreement (items: 18, p-bar: 0.55). There was an excellent level of agreeance for the resuscitation category (items: 3, b-par 0.69), and moderate level of agreeance for the urgent (items: 10, b-par 0.52) and minor (items: 5, b-par 0.52) categories.

CONCLUSIONS

This research demonstrated similar findings to that of emergency department triage tool validation. Multi-country, multi-site, multi-type, real-world testing at MGEs is the next step to progress the development of this tool.

The use and feasibility of an online software system to support assessment of accuracy and consistency in applying the Australasian Triage Scale

BACKGROUND

The purpose of this study was to evaluate the use and feasibility of a software system called the Triage Quality Assessment Software in New South Wales emergency departments, to assist in evaluating triage decision accuracy and consistency of emergency nurses in applying the Australasian Triage Scale.

METHOD

A descriptive, exploratory study comprising of retrospective audit data and survey, was conducted 12-months post-implementation of the Triage Quality Assessment Software system.

RESULTS

Between January to December 2018, a total of 39 audits were completed comprising 4214 triage records, of which 3952 (93.3%) contained sufficient information to be evaluated. Triage decision accuracy was 58.3% with a moderate level (K_W=0.57) of consistency demonstrated. Overall feasibility was high (4.2). Findings confirmed learnability (4.3), usability (4.2) and acceptability (4.2) of Triage Quality Assessment Software.

CONCLUSION

This is the first software system to be developed to assist in evaluating triage decision accuracy and consistency in applying the Australasian Triage Scale. This study provides evidence that triage decision accuracy and consistency are detectable and quantifiable. The feasibility of Triage Quality Assessment Software is supported, with further testing needed to fully evaluate its role in emergency department triage quality improvement.

Triage in Australian emergency departments: Results of a New South Wales survey

AIM

To describe current models of triage, the preparation and education of triage nurses, and methods of auditing triage practice in New South Wales emergency departments.

BACKGROUND

Triage is a critical component of emergency department practice; affecting patient safety and access to emergency care. Within Australia, triage is an autonomous role predominantly conducted by trained emergency nurses. Patient safety and timely access to emergency care relies upon the experience, education and training of emergency triage nurses. To date, little is known about triage models of care, the preparation and education of triage nurses, and assessment of triage practice and decision accuracy.

METHOD

Descriptive, exploratory study design employing a self-reporting cross-sectional survey of clinical nurse consultants and educators in New South Wales.

RESULTS

The survey results reveal variability in models of triage, and the eligibility, preparation and education requirements of triage nurses; that appear geographically related. Auditing of triage practice was commonly undertaken retrospectively; feedback to triage nurses was infrequent. The survey found evidence of locally developed guidelines directing triage category allocation for specific conditions or symptoms.

CONCLUSION

The purpose of triage is to ensure that the level of emergency care provided is commensurate with clinical urgency. Variability in the preparation, education and evaluation of triage nurses may in and of itself, contribute to poor patient outcomes. Further, workforce size and geography may impede auditing and the provision of feedback, which are critical to improving triage practice and triage nurse performance. It is imperative that the Emergency Triage Education Kit be revised and maintained in tandem with future revisions of the Australasian Triage Scale.

Triage education in rural remote settings: A scoping review

BACKGROUND

Triage is a complex nursing task to prioritise patient care, based on acuity. Triage decisions can affect patient safety and must employ critical thinking. Graduate registered nurses are expected to triage in rural facilities, which is in contrast to current guidelines. The purpose of this review was; to discover how effective education support programs were in developing clinical decision-making skills for graduates at triage; and to determine what is known about triage education support programs for graduate or novice registered nurses undertaking triage in rural and remote settings.

METHOD

A scoping review was undertaken to identify and analyse primary research articles following PRISMA guidelines, sourced from four electronic databases.

RESULTS

6158 retrieved articles were found, after duplicate removal and screening against inclusion/exclusion criteria; fourteen articles were included. Themes included 'variability of triage accuracy and assessment'; 'education qualifications and experience'; and 'training and supervision'.

CONCLUSION

This review demonstrates significant gaps in the literature reporting on this topic area, particularly in the rural context. Common recommendations include standardised triage education strategies, and strategies that account for differences in resourcing levels. Further research is required to attempt to link education strategies in rural contexts to acceptable triage outcomes like triage accuracy.

Development and preliminary testing of an online software system to facilitate assessment of accuracy and consistency in applying the Australasian Triage Scale

PURPOSE

The aim of this project was to design and evaluate an online software system to facilitate the assessment of triage decision accuracy and consistency in applying the Australasian Triage Scale.

BACKGROUND

Triage is a critical component of emergency nursing practice, which affects patient access to emergency care. Accurate and consistent triage decisions are vital to ensuring patient safety, timely access to care and ED operation. Presently, there is no standard process to examine triage decisions, measure current performance and support department and individual performance development activities to improve patient safety and quality of emergency care.

METHOD

An iterative design guided by a human factors development approach was used to develop a retrospective, focus-based analysis system to evaluate triage decision accuracy and consistency, and enable the exploration of service gaps and opportunities for practice change and professional development.

RESULTS

Triage decision accuracy and consistency, including areas for improvement are detectable and quantifiable. Findings generated may aid in departmental performance and professional development of triage nurses.

CONCLUSION

This is the first system developed to assess decision accuracy and consistency in applying the Australasian Triage Scale. This paper has described the development and preliminary testing of a user-centred design process and implementation of a web-based system to evaluate triage decision accuracy and consistency.

Inter-rater reliability in the Paediatric Observation Priority Score (POPS)

OBJECTIVE

The primary objective of this study was to determine the level of inter-rater reliability between nursing staff for the Paediatric Observation Priority Score (POPS).

DESIGN

Retrospective observational study.

SETTING

Single-centre paediatric emergency department.

PARTICIPANTS

12 participants from a convenience sample of 21 nursing staff.

INTERVENTIONS

Participants were shown video footage of three pre-recorded paediatric assessments and asked to record their own POPS for each child. The participants were blinded to the original, in-person POPS. Further data were gathered in the form of a questionnaire to determine the level of training and experience the candidate had using the POPS score prior to undertaking this study.

MAIN OUTCOME MEASURES

Inter-rater reliability among participants scoring of the POPS.

RESULTS

Overall kappa value for case 1 was 0.74 (95% CI 0.605 to 0.865), case 2 was 1 (perfect agreement) and case 3 was 0.66 (95% CI 0.58 to 0.744).

CONCLUSION

This study suggests there is good inter-rater reliability between different nurses' use of POPS in assessing sick children in the emergency department.

Examining the relationship between critical-thinking skills and decision-making ability of emergency medicine students

BACKGROUND AND AIMS

Critical-thinking ability would enable students to think creatively and make better decisions and makes them make a greater effort to concentrate on situations related to clinical matters and emergencies. This can bridge the gap between the clinical and theoretical training. Therefore, the aim of the present study is to examine the relationship between critical-thinking ability and decision-making skills of the students of Emergency Medicine.

MATERIALS AND METHODS

This descriptive and analytical research was conducted on all the students of medical emergency students (n = 86) in Shahrekord, Iran. The demographic information questionnaire, the California Critical Thinking Skills Test, and a decision-making researcher-made questionnaire were used to collect data. The data were analyzed by SPSS software version 16 using descriptive and analytical statistical tests and Pearson's correlation coefficient.

RESULTS

The results of the present study indicate that the total mean score for the critical thinking was 8.32 ± 2.03 and for decision making 8.66 ± 1.89. There is a significant statistical relationship between the critical-thinking score and decision-making score (P < 0.05).

CONCLUSIONS

Although critical-thinking skills and decision-making ability are essential for medical emergency professional competence, the results of this study show that these skills are poor among the students.