Performance of the Manchester Triage System in patients with dyspnoea: A retrospective observational study

The effectiveness of a modified Manchester Triage System for geriatric patients: A retrospective quantitative study

AIM

Geriatric patients are increasingly dominating the daily routine in emergency department (ED). The atypical clinical presentation of disease, multimorbidity, frailty and cognitive impairment of geriatric patients pose particular challenges for triage in the ED. Efficient and accurate emergency triage plays a key role in differentiating between geriatric patients who need timely treatment and those who can wait safely. The purpose of this study was to evaluate the performance of the modified Manchester Triage System (mMTS) in classifying geriatric patients.

DESIGN

An observational retrospective study.

METHODS

A retrospective study of 18,796 geriatric patients (≥65 years) attending the ED of a tertiary care hospital in Zhejiang province between 1 June 2020 and 30 June 2022. Baseline information on patients was collected and divided into two different study groups according to triage level: high priority (red/orange) and low priority (yellow/green). The sensitivity and specificity of the mMTS were estimated by verifying the triage classification received by the emergency geriatric patients and their survival at 7 days or the need for acute surgery within 72 h.

RESULTS

The study included a total of 17,764 geriatric patients with a median age of 72 years in ED. 10.7% (1896/17,764) of the geriatric patients were assigned to the high priority code group (red/orange) and 89.3% (15,868/17,764) were in the low priority code group (yellow/green). The sensitivity of the mMTS associated with death within 7 days was 85.7% (77.5-91.4), specificity was 89.8% (89.3-90.2), and accuracy was 89.8% (89.3-90.2). 1.8% of patients required surgery within 72 h. The sensitivity was 62.6% (57.0-67.9), specificity was 90.3% (89.8-90.7), and negative predictive value was 99.2% (99.0-99.4).

CONCLUSIONS

The mMTS has good specificity, accuracy and negative predictive value for geriatric patients. However, its incorrect prediction of triage in high-priority code patients results in lower sensitivity, which may serve as a protective strategy for these individuals. The current emergency triage system does not completely screen geriatric patients with severe acute illness who present to the ED, and it is necessary to add comprehensive assessment tools that match the characteristics of geriatric patients to improve triage outcomes.

Enhancing triage accuracy: The influence of nursing education on risk prediction

AIM

This study aimed to compare the performance in risk prediction of various outcomes between specially trained triage nurses and the Manchester Triage System (MTS).

DESIGN

Prospective observational study.

METHODS

The study was conducted from June 1st to December 31st, 2023, at the Emergency Department of Merano Hospital. Triage nurses underwent continuous training through dedicated courses and daily audits. We compared the risk stratification performed by expert nurses with that of MTS on various outcomes such as mortality, hospitalisation, and urgency defined by the physicians. Comparisons were made using the Areas Under the Receiver Operating Characteristic curve (AUROC).

RESULTS

The agreement in code classification between the MTS and the expert nurse was very low. The AUROC curve analysis showed that the expert nurse outperformed the MTS in all outcomes. The triage nurse's experience led to statistically significant better stratification in admission rates, ICU admissions, and all outcomes based on the physician's assessment.

CONCLUSIONS

The continuous training of nurses enables them to achieve better risk prediction compared to standardized triage systems like MTS, emphasizing the utility and necessity of implementing continuous training pathways for these highly specialised personnel.

Accuracy of urgency allocation in patients with shortness of breath calling out-of-hours primary care: a cross-sectional study

BACKGROUND

In out-of-hours primary care (OHS-PC), semi-automatic decision support tools are often used during telephone triage. In the Netherlands, the Netherlands Triage Standard (NTS) is used. The NTS is mainly expert-based and evidence on the diagnostic accuracy of the NTS' urgency allocation against clinically relevant outcomes for patients calling with shortness of breath (SOB) is lacking.

METHODS

We included data from adults (≥18 years) who contacted two large Dutch OHS-PC centres for SOB between 1 September 2020 and 31 August 2021 and whose follow-up data about final diagnosis could be retrieved from their own general practitioner (GP). The diagnostic accuracy (sensitivity and specificity with corresponding 95% confidence intervals (CI)) of the NTS' urgency levels (high (U1/U2) versus low (U3/U4/U5) and 'final' urgency levels (including overruling of the urgency by triage nurses or supervising general practitioners (GPs)) was determined with life-threatening events (LTEs) as the reference. LTEs included, amongst others, acute coronary syndrome, pulmonary embolism, acute heart failure and severe pneumonia.

RESULTS

Out of 2012 eligible triage calls, we could include 1833 adults with SOB who called the OHS-PC, mean age 53.3 (SD 21.5) years, 55.5% female, and 16.6% showed to have had a LTE. Most often severe COVID-19 infection (6.0%), acute heart failure (2.6%), severe COPD exacerbation (2.1%) or severe pneumonia (1.9%). The NTS urgency level had a sensitivity of 0.56 (95% CI 0.50-0.61) and specificity of 0.61 (95% CI 0.58-0.63). Overruling of the NTS' urgency allocation by triage nurses and/or supervising GPs did not impact sensitivity (0.56 vs. 0.54, p = 0.458) but slightly improved specificity (0.61 vs. 0.65, p < 0.001).

CONCLUSIONS

The semi-automatic decision support tool NTS performs poorly with respect to safety (sensitivity) and efficiency (specificity) of urgency allocation in adults calling Dutch OHS-PC with SOB. There is room for improvement of telephone triage in patients calling OHS-PC with SOB.

TRIAL REGISTRATION

The Netherlands Trial Register, number: NL9682 .

Using emergency department triage for machine learning-based admission and mortality prediction

AIMS

Patient admission is a decision relying on sparsely available data. This study aims to provide prediction models for discharge versus admission for ward observation or intensive care, and 30 day-mortality for patients triaged with the Manchester Triage System.

METHODS

This is a single-centre, observational, retrospective cohort study from data within ten minutes of patient presentation at the interdisciplinary emergency department of the Kepler University Hospital, Linz, Austria. We trained machine learning models including Random Forests and Neural Networks individually to predict discharge versus ward observation or intensive care admission, and 30 day-mortality. For analysis of the features' relevance, we used permutation feature importance.

RESULTS

A total of 58323 adult patients between 1 December 2015 and 31 August 2020 were included. Neural Networks and Random Forests predicted admission to ward observation with an AUC-ROC of 0.842 ± 0.00 with the most important features being age and chief complaint. For admission to intensive care, the models had an AUC-ROC of 0.819 ± 0.002 with the most important features being the Manchester Triage category and heart rate, and for the outcome 30 day-mortality an AUC-ROC of 0.925 ± 0.001. The most important features for the prediction of 30 day-mortality were age and general ward admission.

CONCLUSION

Machine learning can provide prediction on discharge versus admission to general wards and intensive care and inform about risk on 30 day-mortality for patients in the emergency department.

Five Level Triage vs. Four Level Triage in a Quaternary Emergency Department: National Analysis on Waiting Time, Validity, and Crowding-The CREONTE (Crowding and RE-Organization National TriagE) Study Group

Background and Objectives: Triage systems help provide the right care at the right time for patients presenting to emergency departments (EDs). Triage systems are generally used to subdivide patients into three to five categories according to the system used, and their performance must be carefully monitored to ensure the best care for patients. Materials and Methods: We examined ED accesses in the context of 4-level (4LT) and 5-level triage systems (5LT), implemented from 1 January 2014 to 31 December 2020. This study assessed the effects of a 5LT on wait times and under-triage (UT) and over-triage (OT). We also examined how 5LT and 4LT systems reflected actual patient acuity by correlating triage codes with severity codes at discharge. Other outcomes included the impact of crowding indices and 5LT system function during the COVID-19 pandemic in the study populations. Results: We evaluated 423,257 ED presentations. Visits to the ED by more fragile and seriously ill individuals increased, with a progressive increase in crowding. The length of stay (LOS), exit block, boarding, and processing times increased, reflecting a net raise in throughput and output factors, with a consequent lengthening of wait times. The decreased UT trend was observed after implementing the 5LT system. Conversely, a slight rise in OT was reported, although this did not affect the medium-high-intensity care area. Conclusions: Introducing a 5LT improved ED performance and patient care.

Daily triage audit can improve nurses' triage stratification: A pre-post study

AIMS

The objective was to evaluate whether the error rate in the application of the triage system decreased after the introduction of daily auditing, and it was also evaluated if the agreement rate between physician and nurse on triage priority levels increased after the introduction of daily auditing and if the error-related variables in the pre-intervention period changed in the post-intervention period.

DESIGN

A quasi-experimental study was performed with a pre-post design, between June 2019 and June 2021 in one emergency department.

METHODS

The accuracy and error rate of triage in the pre- and post-intervention period were compared. Univariate and multivariate logistic regression analyses were performed to explore the relationships between the variables related to the error. The comparison between the priority level assigned by the physician and the triage nurse was analysed using Cohen's K.

RESULTS

Nine hundred four patients were enrolled in the pre-intervention period and 869 in the post-intervention period. The error rate in the pre-intervention period was 23.3% and in the post-intervention period was 9.7%. The concordance between the degree of priority expressed by the physician and the nurse varied from a quadratically weighted Cohen's K of 0.447 in the pre-intervention period to 0.881 in the post-intervention period.

CONCLUSION

Daily auditing is a clinical procedure that improves the nurse's application of the triage system. Daily auditing has reduced errors by the nurse, improving performance and concordance with the physician.

IMPACT

Triage systems are a key point for the stratification of the priority level of patients and it is therefore evident that they maintain high-quality standards. Through the practice of daily auditing, not only a reduction in the error rate, which ensures patient safety, but also an improvement in triage performance has been demonstrated.

NO PATIENT OR PUBLIC CONTRIBUTION

The study did not involve any patients during its conduction.

Effect of the Emergency Department Assessment of Chest Pain Score on the Triage Performance in Patients With Chest Pain

The sensitivity of triage systems in identifying acute cardiovascular events in patients presented to the emergency department with chest pain is not optimal. Recently, a clinical score, the Emergency Department Assessment of Chest Pain Score (EDACS), has been proposed for a rapid assessment without additional instruments. To evaluate whether the integration of EDACS into triage evaluation of patients with chest pain can improve the triage's predictive validity for an acute cardiovascular event, a single-center prospective observational study was conducted. This study involved all patients who needed a triage admission for chest pain between January 1, 2020, and December 31, 2020. All enrolled patients first underwent a standard triage assessment and then the EDACS was calculated. The primary outcome of the study was the presence of an acute cardiovascular event. The discriminatory ability of EDACS in triage compared with standard triage assessment was evaluated by comparing the areas under the receiver operating characteristic curve, decision curve analysis, and net reclassification improvement. The study involved 1,596 patients, of that 7.3% presented the study outcome. The discriminatory ability of triage presented an area under the receiver operating characteristic curve of 0.688 that increased to 0.818 after the application of EDACS in the triage assessment. EDACS improved the baseline assessment of priority assigned in triage, with a net reclassification improvement of 33.6% (p <0.001), and the decision curve analyses demonstrated that EDACS in triage resulted in a clear net clinical benefit. In conclusion, the results of the study suggest that EDACS has a good discriminatory capacity for acute cardiovascular events and that its implementation in routine triage may improve triage performance in patients with chest pain.

The Manchester Triage System's performance in clinical risk prioritisation of patients presenting with headache in emergency department: A retrospective observational study

OBJECTIVE

Non-traumatic headache is a frequent reason for visits to the emergency department (ED). We evaluated the performance of the Manchester Triage System (MTS) in prioritising patients presenting to the ED with non-traumatic headache.

METHODS

In this single-centre observational retrospective study, we compared the association of MTS priority classification codes with a final diagnosis of a severe neurological condition requiring timely management (ischaemic or haemorrhagic stroke, subarachnoid haemorrhage, cerebral sinus venous thrombosis, central nervous system infection or brain tumour). The study was conducted and reported according to the STROBE statement. The overall prioritisation accuracy of MTS was estimated by the area under the receiver operating characteristic (ROC) curve. The correctness of triage prediction was estimated based on the "very urgent" MTS grouping. An undertriage was defined as a patient with an urgent and severe neurological who received a low priority/urgency MTS code (green/yellow).

RESULTS

Over 30 months, 3002 triage evaluations of non-traumatic headache occurred (1.7% of ED visits). Of these, 2.3% (68/3002) were eventually diagnosed with an urgent and severe neurological condition. The MTS had an acceptable prioritisation accuracy, with an area under the ROC curve of 0.734 (95% CI 0.668-0.799). The sensitivity of the MTS for urgent codes (yellow, orange and red) was 79.4% (95% CI 74.5-84.3), with a specificity of 54.1% (95% CI 52.9-55.3). The triage prediction was incorrect in only 6.3% (190/3002) of patients with headache.

CONCLUSION

The MTS is a safe and accurate tool for prioritising patients with non-traumatic headache in the ED. However, MTS may need further specific tools for evaluating the more complicated symptoms and for correctly identifying patients with urgent and severe underlying pathologies.

RELEVANCE TO CLINICAL PRACTICE

The triage nurse using MTS may need additional tools to improve the assessment of patients with headache, although MTS provides a good safety profile.

Triage assessment of transitory loss of consciousness in the emergency department-A retrospective observational study

AIM

To establish how the Manchester Triage System can correctly prioritize patients admitted to the emergency department for transitory loss of consciousness in relation to their risk of presenting severe acute disease.

DESIGN

A observational retrospective study.

METHODS

A total of 2291 patients who required a triage evaluation for a transitory loss of consciousness at the emergency department of Merano Hospital between 1 January 2017 and 30 June 2019 were considered. Transitory loss of consciousness was classified according to European Society of Cardiology guidelines. The baseline characteristics of the patients were collected and divided according to the priority level assigned at triage into two different study groups: high priority (red/orange) and low priority (blue/green/yellow). The composite outcome of the study was defined as the diagnosis of a severe acute disease.

RESULTS

Of the patients enrolled, 17% (390/2291) had a high-priority code and 83% (1901/2291) received a low-priority code. Overall, a severe acute disease was present in 16.9% of patients (387/2291). The Manchester Triage System had a sensitivity of 42.4%, a specificity of 88.1% and an accuracy of 80.4% for predicting severe acute disease. The discriminatory ability had an area under the receiver operating characteristic curve of 0.651 (CI 95%: 0.618-0.685).

CONCLUSIONS

Despite the good specificity, the low sensitivity does not currently allow the Manchester Triage System to completely exclude patients with a severe acute disease who presented in the emergency department for a transitory loss of consciousness. Therefore, it is important to develop precise nursing tools or assessments that can improve triage performance.

IMPACT

The assessment of a complex symptom can create difficulties in the stratification of patients in triage, assigning low-priority codes to patients with a severe disease. Additional tools are needed to allow the correct triage assessment of patients presenting with transitory loss of consciousness.

The ROX index can be a useful tool for the triage evaluation of COVID-19 patients with dyspnoea

Aim

To assess whether the application of a non‐invasive tool, such as ratio of oxygen saturation (ROX) index, during triage can identify patients with COVID‐19 at high risk of developing acute respiratory distress syndrome (ARDS).

Design

A multi‐centre, observational, retrospective study.

Methods

Only COVID‐19 positive patients who required an emergency department evaluation for dyspnoea were considered. The primary objective of the study was to compare the ROX value obtained during triage with the medical diagnosis of ARDS and intubation in 72 h of the triage evaluation. The ROX index value was also compared with objective outcomes, such as the pressure of arterial O₂ (PaO₂)/fraction of inspired oxygen (FiO₂) ratio and the lung parenchyma volume involved in COVID‐19‐related inflammatory processes, based on 3D reconstructions of chest computed tomography (CT).

Results

During the study period, from 20 March 2020 until 31 May 2020, a total of 273 patients with confirmed SARS‐CoV‐2 infection were enrolled. The predictive ability of ROX for the risk of developing ARDS in 72 h after triage evaluation was associated with an area under the receiver operating characteristic (AUROC) of 0.845 (0.797–0.892, p < 0.001), whereas the AUROC value was 0.727 (0.634–0.821, p < 0.001) for the risk of intubation. ROX values were strongly correlated with PaO₂/FiO₂ values (r = 0.650, p < 0.001), decreased ROX values were associated with increased percentages of lung involvement based on 3D CT reconstruction (r = −0.371, p < 0.001).

Conclusion

The ROX index showed a good ability to identify triage patients at high evolutionary risk. Correlations with objective but more invasive indicators (PaO₂/FiO₂ and CT) confirmed the important role of ROX in identifying COVID‐19 patients with extensive pathological processes.

Impact

During the difficult triage evaluation of COVID‐19 patients, the ROX index can help the nurse to identify the real severity of the patient. The triage systems could integrate the ROX in the rapid patient assessment to stratify patients more accurately.

Acute abdominal pain in triage: A retrospective observational study of the Manchester triage system's validity

OBJECTIVE

Roughly 5% to 10% of patients admitted to the emergency department suffer from acute abdominal pain. Triage plays a key role in patient stratification, identifying patients who need prompt treatment versus those who can safely wait. In this regard, the aim of this study was to estimate the performance of the Manchester Triage System in classifying patients with acute abdominal pain.

METHODS

A total of 9,851 patients admitted at the Emergency Department of the Merano Hospital with acute abdominal pain were retrospectively enrolled between 1 January 2017 and 30 June 2019. The study was conducted and reported according to the STROBE statement. The sensitivity and specificity of the Manchester Triage System were estimated by verifying the triage classification received by the patients and their survival at seven days or the need for acute surgery within 72 h after emergency department access.

RESULTS

Among the patients with acute abdominal pain (median age 50 years), 0.4% died within seven days and 8.9% required surgery within 72 hours. The sensitivity was 44.7% (29.9-61.5), specificity was 95.4% (94.9-95.8), and negative predictive value was 99.7% (99.2-100) in relation to death at seven days.

CONCLUSIONS

The Manchester Triage System shows good specificity and negative predictive value. However, its sensitivity was low due to the amount of incorrect triage prediction in patients with high-priority codes (red/orange), suggesting overtriage in relation to seven-day mortality. This may be a protective measure for the patient. In contrast, the need for acute surgery within 72 h was affected by under-triage.

RELEVANCE TO CLINICAL PRACTICE

The triage nurse using Manchester Triage System can correctly prioritise the majority of patients with acute abdominal pain, especially in low acuity patients. The Manchester Triage System is safe and does not underestimate the severity of the patients.