Piloting an evaluation of triage

Nurse-led care: The importance of management support

The focus of this paper is the importance of proper management planning and support to underpin the provision of nurse-led care. The author's record of research in this field has left her with a lasting impression that nurse-led services often fail to reach their full potential, at least in part because of inadequate management.

The main body of the paper consists of a brief account of a Department of Health-funded project, Exploring New Roles in Practice (ENRiP). In this three-stage study, members of the teams undertook a mapping exercise in a 20% sample of acute trusts throughout England to identify the emerging range and purpose of new roles for nurses and members of the professions allied to medicine (PAMs). The resulting database provided the sampling frame for 32 case studies to clarify the range of issues relating to the introduction of new roles. The database in its entirety also provided the population for a survey designed to establish the generalisability of the conclusions emerging from Stages One and Two. The research findings provided evidence on which to base a guidance document encapsulating the lessons learned during the project. The implications of its findings for management of nurse-led services are discussed and compared with advice given by the author in 1995 in the report Catching the Tide.

Inter-observer agreement using the Canadian Emergency Department Triage and Acuity Scale

Objective:

To determine the inter-observer agreement on triage assignment by first-time users with diverse training and background using the Canadian Emergency Department Triage and Acuity Scale (CTAS).

Methods:

Twenty emergency care providers (5 physicians, 5 nurses, 5 Basic Life Support paramedics and 5 Advanced Life Support paramedics) at a large urban teaching hospital participated in the study. Observers used the 5-level CTAS to independently assign triage levels for 42 case scenarios abstracted from actual emergency department patient presentations. Case scenarios consisted of vital signs, mode of arrival, presenting complaint and verbatim triage nursing notes. Participants were not given any specific training on the scale, although a detailed one-page summary was included with each questionnaire. Kappa values with quadratic weights were used to measure agreement for the study group as a whole and for each profession.

Results:

For the 41 case scenarios analyzed, the overall agreement was significant (quadratic-weighted κ = 0.77, 95% confidence interval, 0.76–0.78). For all observers, modal agreement within one triage level was 94.9%. Exact modal agreement was 63.4%. Agreement varied by triage level and was highest for Level I (most urgent). A reasonably high level of intra- and inter-professional agreement was also seen.

Conclusions:

Despite minimal experience with the CTAS, inter-observer agreement among emergency care providers with different backgrounds was significant.

Classification of patients by severity grades during triage in the emergency department using data mining methods

OBJECTIVE

To test the feasibility of classifying emergency department patients into severity grades using data mining methods.

DESIGN

Emergency department records of 402 patients were classified into five severity grades by two expert physicians. The Naïve Bayes and C4.5 algorithms were applied to produce classifiers from patient data into severity grades. The classifiers' results over several subsets of the data were compared with the physicians' assessments, with a random classifier, and with a classifier that selects the maximal-prevalence class.

MEASUREMENTS

Positive predictive value, multiple-class extensions of sensitivity and specificity combinations, and entropy change.

RESULTS

The mean accuracy of the data mining classifiers was 52.94 ± 5.89%, significantly better (P < 0.05) than the mean accuracy of a random classifier (34.60 ± 2.40%). The entropy of the input data sets was reduced through classification by a mean of 10.1%. Allowing for classification deviations of one severity grade led to mean accuracy of 85.42 ± 1.42%. The classifiers' accuracy in that case was similar to the physicians' consensus rate. Learning from consensus records led to better performance. Reducing the number of severity grades improved results in certain cases. The performance of the Naïve Bayes and C4.5 algorithms was similar; in unbalanced data sets, Naïve Bayes performed better.

CONCLUSIONS

It is possible to produce a computerized classification model for the severity grade of triage patients, using data mining methods. Learning from patient records regarding which there is a consensus of several physicians is preferable to learning from each physician's patients. Either Naïve Bayes or C4.5 can be used; Naïve Bayes is preferable for unbalanced data sets. An ambiguity in the intermediate severity grades seems to hamper both the physicians' agreement and the classifiers' accuracy.

Triage in emergency departments: national survey

AIM

This paper reports a study the aim of which was to describe how triage-related work was organized and performed in Swedish emergency departments.

BACKGROUND

Hospitals in many developed countries use some kind of system to prioritize the patients attending emergency departments. Triage is a commonly used term to refer to the process of sorting and prioritizing patients for care. How the triage procedure is organized and which personnel perform this type of work vary considerably throughout the world. In Sweden, few studies have explored this important issue.

METHOD

A national survey was conducted using telephone interviews, with nurse managers at each of the emergency departments. The sample represented 87% of emergency departments in Sweden.

RESULTS

The findings clearly illustrate the organization of emergency department triage, focusing on personnel who perform triage, as well as the facilities, resources and procedures available for triage. However, the results indicate that work associated with such triage in Sweden is not organized in any consistent matter. In 81% of the emergency departments a clerk, Licensed Practical Nurse or Registered Nurse were assigned to assess patients not arriving by ambulance. There was also diversity in other areas, including requirements for staff to have particular qualifications and clinical experience for being allocated to triage work, as well as facilities for triage personnel assessing and prioritizing patients. The use of triage scales and acuity ratings also lacked uniformity and disparities were observed in both the design and use of triage scales. A little less than half (46%) of the emergency departments did not use any kind of triage scale to document patient acuity ratings.

CONCLUSION

In contrast to several other countries, this study shows that Swedish emergency departments do not adhere well to established standards and guidelines about triage in emergency care. Research on emergency department triage, especially in the areas of personnel performing triage, triage scales and standards and guidelines are recommended.

RELEVANCE TO CLINICAL PRACTICE

The diversity among several aspects of nursing triage (e.g. use of less qualified personnel performing triage, the use of different triage scales) presented in the study points to a safety risk for the patients. It also shows the need of further education for the personnel in clinical practice as well as further research on triage in order to gain national consensus about this nursing task.

Paramedics and triage: effect of one training session on triage in the emergency department

This 3-stage intervention study enrolled all adult patients referred to a university-based emergency department (ED) during randomly assigned 1-week preeducation or posteducation periods. Triage decisions recorded by ED paramedics (n = 8) both before and after an educational training session were compared to decisions made by emergency physicians (EPs). Triage decisions of paramedics and EPs in the preeducation phase showed poor consistency (K = 0.317, K = 0.388). Triage decisions in the posteducation phase increased slightly but were still found to be low. On the other hand, consistency between the triage assessments recorded by paramedics and EPs of the general appearance of patients increased from low in the preeducation phase to moderate in the posteducation phase (K = 0.327, K = 0.500, respectively). The training session was associated with a slight increase in the consistency of triage decisions recorded by paramedics and EPs.

Systematic triage in the emergency department using the Australian National Triage Scale: a pilot project

The objective of this study was to evaluate the validity in Belgium of the National Triage Scale for judgement of the urgency of a patient's condition and making a case-mix description of the patient profiles in the different urgency categories. The study is of a descriptive retrospective and descriptive correlational design and was carried out in the emergency department at the University Hospital Gasthuisberg in Leuven, Belgium. The urgency of patients arriving at the emergency department was evaluated during one randomly selected shift a day over 12 weeks in 1997 by one of the four triage-educated nurses, using an instrument based on the National Triage Scale. Patient identification and outcome parameters were retrieved from the existing computer system. The data were mainly analysed using the Ridit analysis. Overall 3650 patients were evaluated: Category 1, 4.19%; Category 2, 24.44%; Category 3, 39.32%; Category 4, 27.97%; Category 5, 4.08%. Any similarity between sentinel diagnoses as well as between the admission percentages in this pilot study and the reference from Australia (Z = 0.827; p > 0.05) was noted. Different aspects influenced the triage nurses while determining the degree of urgency. Urgency categories profiles revealed a significant effect of age (Kruskall-Wallis = 530.5; p = 0.000). Higher categories of urgency resulted in a higher degree of admission (t (df = 3640) = 643.45; p = 0.000). It is concluded that a resemblance between the pilot study and the reference confirms the predictive validity of the scale used. Patient profiles in the different urgency categories give a description of the emergency department population.

Consistency of retrospective triage decisions as a standardised instrument for audit

OBJECTIVES

To determine the level of agreement between senior medical staff when asked to perform retrospective case note review of nursing triage decisions, both before and after development of a consensus approach.

METHODS

Four medical reviewers independently allocated triage categories to 50 emergency department patients after review of their case notes. They were blind to the identity of the triage nurse and their triage categorisation. The process was repeated twice, firstly after agreement on a consensus approach and then using formal guidelines.

RESULTS

Agreement between reviewers was initially fair to moderate (kappa = 0.27 to 0.53). This failed to improve after development of a consensus approach (kappa = 0.29 to 0.57). There was a trend towards better agreement when guidelines were used but agreement was still only moderate (kappa = 0.31 to 0.63).

CONCLUSIONS

Audit of nurse triage categorisation by senior medical staff performing case note review has only fair to moderate consistency between reviewers. Use of this technique will result in frustration among those whose performance is being audited if they recognise inconsistency in the standard they are compared against.

The views of nurses to the conduct of a randomised controlled trial of problem drinkers in an accident and emergency department

The Trent Regional Health Authority funded a study in 1995 to train nurses in an accident and emergency (A&E) department to screen all adult attendees for alcohol problems with a view to identifying a sample of problem drinkers to participate in a randomised controlled trial (RCT). In the RCT identified drinkers were to be assigned either to health education plus brief counselling intervention or, as controls, to health education alone. Despite 16654 attendance's at A&E during the recruitment phase of the study only 20% of attendees were screened of whom a further 19% were identified as problem drinkers by the CAGE screening questionnaire. Less than half of the problem drinkers were, however, provided with feedback by the nurses, leaving a small group of 264 eligible for entry to the RCT. The great majority of this subgroup refused an initial appointment at the specialist clinic and so the trial was abandoned. A number of in-depth interviews were undertaken with the nurses in an attempt to understand ways in which the overall conduct of the study might have been improved. This paper outlines in some detail some of the reasons for the lack of success with the study which include; general environmental factors that undoubtedly led to stress and poor morale amongst the nursing team, the differences in perception between managers and clinical nurses concerning the value of research and the inadequacy of the initial training programme. The paper concludes that there are problems in the NHS which do not provide a helpful backcloth to the successful conduct of health services research.

The effects of technology on triage in A & E

Within the specialty of Accident and Emergency (A & E) nursing, triage is a term meaning to classify or sort patients according to their need for care (Blythin 1988). Burgess (1992) views this process as a means of prioritizing patients in order, so that the more seriously ill or injured are seen first (Table 1). Triage performance is measured in the author's department by computer. This technological source is used to record the patient's arrival time and the time at which the patient is triaged. Technology is defined by the Oxford Dictionary (1996) as 'the study of mechanical arts and science, their application in industry'. This paper explores the impact of this technology and the related issues on the A & E triage nurse, and will focus on issues related to the Patients' Charter (1991), resource implications, safety and staff training. In conclusion, the quality of a patient's total care, in which the author participated, is discussed with reference to the related issues and implications for future practice.

Does a physician visual assessment change triage?

A prospective comparative trial was conducted to determine the effect of a physician's visual assessment of emergency patients on triage categorization and ability at triage to predict admission. The setting was a university, county, referral center and residency training site. Participants were a consecutive sample of emergency department patients presenting between the times of 0700 and 2300 hours for 5 weeks. All patients were assigned a triage category by an emergency nurse (RN) who saw the patient and by an emergency physician (EP) who had the option of performing a visual assessment. Triage categorization was compared for interobserver agreement (Kappa [kappa] statistic) and by ability to predict admission (MacNemar's test). A total of 3,949 patients was entered. The patients that physicians visually assessed were triaged by nurses as more ill (P < .001). For triage categories visualized by the EP compared with RN categorization, interobserver agreement was 59.8%, kappa = .21. For triage categories not visualized by EP compared with RN categorization, interobserver agreement was 67.9%, kappa = .45 (P < .001). Sensitivity of EPs to predict admission is as follows: all RN triage, 41.3; not seen by EP, 54.9; seen by EP, 69.3. Specificity is as follows: all RN triage, 93.7; not seen by EP, 88.5, seen by EP, 83.9. When physician visual assessment was done, agreement between physicians and nurses decreased by more than half. Physicians who included visual assessment in patient triage were less likely to agree with RN categorization. A visual assessment by the physician improved the sensitivity for predicting admission with an only small cost in specificity.

The triage role in emergency nursing: development of an educational programme

This study explores the professional and educational development of emergency nurses and their beliefs regarding the appropriate content for a triage educational programme. A descriptive survey was conducted of emergency nurses employed by randomly selected teaching and non-teaching hospitals. Data analysis showed that emergency nurses used various methods to prepare and maintain their triage expertise. The survey found that the best method to prepare the novice emergency nurse for the triage role was to use a combination of a triage educational programme and clinical experience. Respondents indicated great interest in enrolling in an educational programme and, as a result of this survey, a comprehensive triage educational programme has been developed.

The effectiveness of nursing: a review

This paper describes the findings of a literature review of the effectiveness of nursing. Three journals were selected in which this type of study was most likely to be published. A diversity of attempts to measure nursing effectiveness with various types of patient was found. Generally, however, there was a lack of rigour in study design and sample sizes were too small to be able to draw conclusions. No studies were found which undertook a cost-effectiveness analysis of nursing interventions. Suggestions for the way forward in measuring nursing effectiveness are given, together with questions to be addressed by nursing research.

Do formal controls always achieve control? The case of triage in accident and emergency departments

Triage is the term used to describe the formal process of assigning urgency categories to patients arriving in a hospital accident and emergency department. This paper uses insights from literature on management control, medical sociology and nursing to illuminate the results of a research study comparing formal triage with an informal prioritisation process carried out by nurses. Topics discussed include whether triage is a bureaucratic process, whether it allows nurses' intuition to be expressed, whether it masks the urgency of the condition of the small number of seriously injured or ill patients, and whether responsibility for decisions on urgency should be separated from responsibility to act on those decisions. It is concluded that managers must consider these questions in the light of arrangements in their own hospital; departmental layout as well as the nursing staff's experience and commitment need to be taken into account.

Nurse triage in theory and in practice

'Nurse Triage' refers to the formal process of early assessment of patients attending an accident and emergency (A&E) department by a trained nurse, to ensure that they receive appropriate attention, in a suitable location, with the requisite degree of urgency. The benefits claimed for nurse triage include better patient outcomes, through clinical management reaching those in greatest need of it first. A recent study of nurse triage in a British A&E department failed to demonstrate the benefits claimed: patients undergoing triage were delayed, especially those in the most urgent groups. No differences were noted between the two study groups in levels of satisfaction with the A&E process. The results brought forth criticism from all quarters. In this paper the points made by the critics are considered, and an attempt to answer them is made.