Assessing the validity of using serious game technology to analyze physician decision making

Feasibility and acceptability of a serious game to study the effects of environmental distractors on emergency room nurse triage accuracy: A pilot study

BACKGROUND

Emergency triage, which involves complex decision-making under stress and time constraints, may suffer from inaccuracies due to workplace distractions. A serious game was developed to simulate the triage process and environment. A pilot study was undertaken to collect preliminary data on the effects of distractors on emergency nurse triage accuracy.

METHOD

A 2 × 2 factorial randomized controlled trial (RCT) was designed for the study. A sample of 70 emergency room nurses was randomly assigned to three experimental groups exposed to different distractors (noise, task interruptions, and both) and one control group. Nurses had two hours to complete a series of 20 clinical vignettes, in which they had to establish a chief complaint and assign an emergency level.

RESULTS

Fifty-five nurses completed approximately 15 vignettes each during the allotted time. No intergroup differences emerged in terms of triage performance. Nurses had a very favorable appreciation of the serious game focusing on triage.

CONCLUSION

The results show that both the structure of our study and the serious game can be used to carry out a future RCT on a larger scale. The lack of a distractor effect raises questions about the frequency and intensity required to find a significant impact on triage performance.

Development of a Competency-Based Triage Education Application and Usability Testing for Triage Training Based on the Korean Triage and Acuity Scale

BACKGROUND

Improving the quality of emergency nursing care requires enhancing triage competency through education programs that integrate the content of the Korean Triage and Acuity Scale, a triage system specifically developed for the Korean context. Thus, this study developed a competency-based triage education application (CTEA), based on the Korean Triage and Acuity Scale, and evaluated its effectiveness through usability testing.

METHOD

The CTEA used various teaching methods and game mechanisms, including lectures, case studies, and video-based scenarios, to improve triage competency.

RESULTS

In the usability testing phase, the CTEA was refined through expert heuristic evaluation and user interviews conducted with the think-aloud method. Six themes were derived from the interviews, highlighting the need for a well-structured program with realistic scenarios, easy accessibility, gamification, functional improvements, and future triage educational applications.

CONCLUSION

These findings suggest that the CTEA is effective and satisfactory for users and can contribute to improving the triage competency of emergency nurses. [J Contin Educ Nurs. 2024;55(1):33-41.].

Testing the feasibility, acceptability, and preliminary effect of a novel deliberate practice intervention to reduce diagnostic error in trauma triage: a study protocol for a randomized pilot trial

BACKGROUND

Non-compliance with clinical practice guidelines in trauma remains common, in part because physicians make diagnostic errors when triaging injured patients. Deliberate practice, purposeful participation in a training task under the oversight of a coach, effectively changes behavior in procedural domains of medicine but has rarely been used to improve diagnostic skill. We plan a pilot parallel randomized trial to test the feasibility, acceptability, and preliminary effect of a novel deliberate practice intervention to reduce physician diagnostic errors in trauma triage.

METHODS

We will randomize a national convenience sample of physicians who work at non-trauma centers (n = 60) in a 1:1 ratio to a deliberate practice intervention or to a passive control. We will use a customized, theory-based serious video game as the basis of our training task, selected based on its behavior change techniques and game mechanics, along with a coaching manual to standardize the fidelity of the intervention delivery. The intervention consists of three 30-min sessions with content experts (coaches), conducted remotely, during which physicians (trainees) play the game and receive feedback on their diagnostic processes. We will assess (a) the fidelity with which the intervention is delivered by reviewing video recordings of the coaching sessions; (b) the acceptability of the intervention through surveys and semi-structured interviews, and (c) the effect of the intervention by comparing the performance of trainees and a control group of physicians on a validated virtual simulation. We hypothesize that trainees will make ≥ 25% fewer diagnostic errors on the simulation than control physicians, a large effect size. We additionally hypothesize that ≥ 90% of trainees will receive their intervention as planned.

CONCLUSIONS

The results of the trial will inform the decision to proceed with a future hybrid effectiveness-implementation trial of the intervention. It will also provide a deeper understanding of the challenges of using deliberate practice to modify the diagnostic skill of physicians.

TRIAL REGISTRATION

Clinical trials.gov ( NCT05168579 ); 23 December 2021.

The Effect of Competency-Based Triage Education Application on Emergency Nurses’ Triage Competency and Performance

The Korean Triage and Acuity Scale (KTAS) is used to determine emergency patient priority. The purpose of this study was to develop the Competency-Based Triage Education Application (CTEA) using KTAS and evaluate its effectiveness on emergency nurses’ triage competency and performance. The developed CTEA mobile application comprised 4 lectures, 12 text-based cases, and 8 video-based triage scenarios. A quasi-experimental pre-post design with a comparison group (CG) was used to evaluate the effectiveness of the CTEA. Thirty-one participants were assigned to an intervention group (IG) and used the application for at least 100 min over one week. Thirty-five participants were assigned to a CG and underwent book-based learning, which covered the same content as the CTEA. Triage competency (t = 2.55, p = 0.013) and performance (t = 2.11, p = 0.039) were significantly improved in the IG. The IG’s undertriage error was significantly reduced compared to that of the CG (t = 2.08, p = 0.041). These results indicated that the CTEA was effective in improving the emergency nurses’ triage competency and performance. This application will be useful as a program for providing repeated and continuous triage education.

Outcomes after a Digital Behavior Change Intervention to Improve Trauma Triage: An Analysis of Medicare Claims

BACKGROUND

Under-triage in trauma remains prevalent, in part because of decisions made by physicians at non-trauma centers. We developed two digital behavior change interventions to recalibrate physician heuristics (pattern recognition), and randomized 688 emergency medicine physicians to use the interventions or to a control. In this observational follow-up, we evaluated whether exposure to the interventions changed physician performance in practice.

METHODS

We obtained 2016 - 2018 Medicare claims for severely injured patients, linked the names of trial participants to National Provider Identifiers (NPIs), and identified claims filed by trial participants for injured patients presenting to non-trauma centers in the year before and after their trial. The primary outcome measure was the triage status of severely injured patients.

RESULTS

We linked 670 (97%) participants to NPIs, identified claims filed for severely injured patients by 520 (76%) participants, and claims filed at non-trauma centers by 228 (33%). Most participants were white (64%), male (67%), and had more than three years of experience (91%). Patients had a median Injury Severity Score of 16 (IQR 16 - 17), and primarily sustained neuro-trauma. After adjustment, patients treated by physicians randomized to the interventions experienced less under-triage in the year after the trial than before (41% versus 58% [-17%], P = 0.015); patients treated by physicians randomized to the control experienced no difference in under-triage (49% versus 56% [-7%], P = 0.35). The difference-in-the-difference was non-significant (10%, P = 0.18).

CONCLUSIONS

It was feasible to track trial participants' performance in national claims. Sample size limitations constrained causal inference about the effect of the interventions.

Impact of nonclinical factors on intensive care unit admission decisions: a vignette-based randomized trial (V-TRIAGE)

OBJECTIVE

To assess the impact of intensive care unit bed availability, distractors and choice framing on intensive care unit admission decisions.

METHODS

This study was a randomized factorial trial using patient-based vignettes. The vignettes were deemed archetypical for intensive care unit admission or refusal, as judged by a group of experts. Intensive care unit physicians were randomized to 1) an increased distraction (intervention) or a control group, 2) an intensive care unit bed scarcity or nonscarcity (availability) setting, and 3) a multiple-choice or omission (status quo) vignette scenario. The primary outcome was the proportion of appropriate intensive care unit allocations, defined as concordance with the allocation decision made by the group of experts.

RESULTS

We analyzed 125 physicians. Overall, distractors had no impact on the outcome; however, there was a differential drop-out rate, with fewer physicians in the intervention arm completing the questionnaire. Intensive care unit bed availability was associated with an inappropriate allocation of vignettes deemed inappropriate for intensive care unit admission (OR = 2.47; 95%CI 1.19 - 5.11) but not of vignettes appropriate for intensive care unit admission. There was a significant interaction with the presence of distractors (p = 0.007), with intensive care unit bed availability being associated with increased intensive care unit admission of vignettes inappropriate for intensive care unit admission in the distractor (intervention) arm (OR = 9.82; 95%CI 2.68 - 25.93) but not in the control group (OR = 1.02; 95%CI 0.38 - 2.72). Multiple choices were associated with increased inappropriate allocation in comparison to the omission group (OR = 5.18; 95%CI 1.37 - 19.61).

CONCLUSION

Intensive care unit bed availability and cognitive biases were associated with inappropriate intensive care unit allocation decisions. These findings may have implications for intensive care unit admission policies.

Effects of environmental distractors on nurse emergency triage accuracy: a pilot study protocol

Background

The clinical decisions of emergency department triage nurses need to be of the highest accuracy. However, studies have found repeatedly that these nurses over- or underestimate the severity of patient health conditions. This has major consequences for patient safety and patient flow management. Workplace distractors such as noise and task interruptions have been pointed to as factors that might explain this inaccuracy. The use of a serious game reproducing the work environment during triage affords the opportunity to explore the impact of these distractors on nurse emergency triage accuracy, in a safe setting.

Methods/design

A pilot study with a factorial design will be carried out to test the acceptability and feasibility of a serious game developed specifically to simulate the triage process in emergency departments and to explore the primary effects of distractors on nurse emergency triage accuracy. Eighty emergency nurses will be randomized into four groups: three groups exposed to different distractors (A, noise; B, task interruptions; C, noise and task interruptions) and one control group. All nurses will have to complete 20 clinical vignettes within 2 h. For each vignette, a gold standard assessment will be determined by experts. Pre-tests will be conducted with clinicians and certified emergency nurses to evaluate the appeal of the serious game.

Discussion

Study results will inform the design of large-scale investigations and will help identify teaching, training, and research areas that require further development.

Does Preexisting Practice Modify How Video Games Recalibrate Physician Heuristics in Trauma Triage?

BACKGROUND

A majority of severely injured patients fail to receive care at trauma centers (undertriage), in part, because of physician judgment. We previously developed two educational video games that reduced physicians' undertriage compared with control in two clinical trials. In this secondary analysis, we investigated heterogeneity of treatment effect of the interventions by assessing physicians' preexisting practice patterns in claims data. We hypothesized that physicians with high preexisting undertriage would benefit most from game-based training.

METHODS

Using Medicare claims records from 2010 to 2015, we measured physicians' preexisting triage practices before their participation in one of two trials conducted in 2016 and 2017. We categorized physicians as having received game-based training versus control and noted their postintervention simulation triage performance in the trials. We used multivariable linear regression models to assess the heterogeneity of game-based training effect among physicians with high and low preexisting undertriage.

RESULTS

Of the 394 eligible physicians from our trials, we identified 275 (70%) with claims for Medicare fee-for-service beneficiaries suffering severe injury between 2010 and 2015. On average, the physicians were 44 y old (SD 8.4) with 12 y (SD 8.2) of experience. We found significant interaction between preexisting practice and intervention efficacy (P = 0.04). Physicians with high undertriage before enrollment improved significantly with game-based training compared with the control (46% versus 63%, P < 0.001). Those with low preexisting undertriage did not (58% versus 56%, P = 0.76).

CONCLUSIONS

Using claims-based data, we found heterogeneity of treatment effect of interventions designed to recalibrate physician heuristics. Physicians with high preexisting undertriage benefited most from game-based training.

A Scoping Review of Physicians' Clinical Reasoning in Emergency Departments

STUDY OBJECTIVE

Clinical reasoning is considered a core competency of physicians. Yet there is a paucity of research on clinical reasoning specifically in emergency medicine, as highlighted in the literature.

METHODS

We conducted a scoping review to examine the state of research on clinical reasoning in this specialty. Our team, composed of content and methodological experts, identified 3,763 articles in the literature, 95 of which were included.

RESULTS

Most studies were published after 2000. Few studies focused on the cognitive processes involved in decisionmaking (ie, clinical reasoning). Of these, many confirmed findings from the general literature on clinical reasoning; specifically, the role of both intuitive and analytic processes. We categorized factors that influence decisionmaking into contextual, patient, and physician factors. Many studies focused on decisions in regard to investigations and admission. Test ordering is influenced by physicians' experience, fear of litigation, and concerns about malpractice. Fear of litigation and malpractice also increases physicians' propensity to admit patients. Context influences reasoning but findings pertaining to specific factors, such as patient flow and workload, were inconsistent.

CONCLUSION

Many studies used designs such as descriptive or correlational methods, limiting the strength of findings. Many gray areas persist, in which studies are either scarce or yield conflicting results. The findings of this scoping review should encourage us to intensify research in the field of emergency physicians' clinical reasoning, particularly on the cognitive processes at play and the factors influencing them, using appropriate theoretical frameworks and more robust methods.

Recent Advances in Technology and Its Applications to Pediatric Emergency Care

Advances in technology are continuously transforming medical care, including pediatric emergency medicine. The increasing adoption of point-of-care ultrasound examination can improve timely diagnoses without radiation and aids the performance of common procedures. The recent dramatic increase in electronic health record adoption offers an opportunity for enhanced clinical decision-making support. Simulation training and advances in technologies can provide continued proficiency training despite decreasing opportunities for pediatric procedures and cardiorespiratory resuscitation performance. This article reviews these and other recent advances in technology that have had the greatest impact on the current practice of pediatric emergency medicine.

Serious games may improve physician heuristics in trauma triage

Trauma triage depends on fallible human judgment. We created two "serious" video game training interventions to improve that judgment. The interventions' central theoretical construct was the representativeness heuristic, which, in trauma triage, would mean judging the severity of an injury by how well it captures (or "represents") the key features of archetypes of cases requiring transfer to a trauma center. Drawing on clinical experience, medical records, and an expert panel, we identified features characteristic of representative and nonrepresentative cases. The two interventions instantiated both kinds of cases. One was an adventure game, seeking narrative engagement; the second was a puzzle-based game, emphasizing analogical reasoning. Both incorporated feedback on diagnostic errors, explaining their sources and consequences. In a four-arm study, they were compared with an intervention using traditional text-based continuing medical education materials (active control) and a no-intervention (passive control) condition. A sample of 320 physicians working at nontrauma centers in the United States was recruited and randomized to a study arm. The primary outcome was performance on a validated virtual simulation, measured as the proportion of undertriaged patients, defined as ones who had severe injuries (according to American College of Surgeons guidelines) but were not transferred. Compared with the control group, physicians exposed to either game undertriaged fewer such patients [difference = -18%, 95% CI: -30 to -6%, P = 0.002 (adventure game); -17%, 95% CI: -28 to -6%, P = 0.003 (puzzle game)]; those exposed to the text-based education undertriaged similar proportions (difference = +8%, 95% CI: -3 to +19%, P = 0.15).

Serious Gaming in Medical Education: A Proposed Structured Framework for Game Development

STATEMENT

Serious games are increasingly being used for medical education. However, the design and development of serious games for the education of health professionals is highly variable, and very few articles report the development process used for game development. There are many established processes for software development that can improve and streamline development, and incorporating the best practices from educational pedagogy and software development may enhance teamwork and communication, decrease development costs, and improve the quality of serious games. In this article, we review and summarize the literature for serious game development for medical education, and combining the best practices, we propose a structured three-phase iterative development framework for serious game development.

Nursing students' perceptions of a video-based serious game's educational value: A pilot study

BACKGROUND

Despite an increasing number of serious games (SGs) in nursing education, few evaluation studies specifically address their educational value in terms of face, content, and construct validity.

OBJECTIVES

To assess nursing students' perceptions of a video-based SG in terms of face, content, and construct validity. In addition, the study assessed perceptions of usability, individual factors, and preferences regarding future use.

DESIGN

A pilot study was conducted.

SETTING AND PARTICIPANTS

An SG prototype was implemented as part of two simulation courses in nursing education: one for home health care and one for hospital medical-surgical wards. The SG aimed to teach clinical reasoning and decision-making skills to nursing students caring for patients with chronic obstructive pulmonary disease. A total of 249second-year nursing students participated in pilot testing of the SG.

METHOD

A paper-based survey was used to assess students' perceptions of the SG's educational value.

RESULTS

Overall, students from both simulation courses perceived the SG as educationally valuable and easy to use. No significant differences were found in perceptions of educational value between nursing students with previous healthcare experience versus those with none. However, significantly more students in the home healthcare simulation course indicated that the SG tested their clinical reasoning and decision-making skills. Students from both the medical-surgical and home healthcare simulation courses suggested that more video-based SGs should be developed and used in nursing education.

CONCLUSIONS

Overall, the survey results indicate that the participants perceived the SG as educationally valuable, and that the SG has potential as an educational tool in nursing education, especially in caring for patients with chronic diseases and in home healthcare simulation. Showing a SG's educational value and user acceptance among nursing students may justify the development and application of more SGs in nursing education.

Using incentives to recruit physicians into behavioral trials: lessons learned from four studies

Objective

To describe lessons learned from the use of different strategies for recruiting physicians responsible for trauma triage, we summarize recruitment data from four behavioral trials run in the United States between 2010 and 2016.

Results

We ran a series of behavioral trials with the primary objective of understanding the influence of heuristics on physician decision making in trauma triage. Three studies were observational; one tested an intervention. The trials used different methods of recruitment (in-person vs. email), timing of the honorarium (pre-paid vs. conditional on completion), type of honorarium [a $100 gift card (monetary reward) vs. an iPad mini 2 (material incentive)], and study tasks (a vignette-based questionnaire, virtual simulation, and intervention plus virtual simulation). We recruited 989 physicians, asking each to complete a questionnaire or virtual simulation online. Recruitment and response rates were 80% in the study where we approached physicians in person, used a pre-paid material incentive, and required that they complete both an intervention plus a virtual simulation. They were 56% when we recruited physicians via email, used a monetary incentive conditional on completion of the task, and required that they complete a vignette-based questionnaire.

Trial registration clinicaltrials.gov; NCT02857348

Efficacy of educational video game versus traditional educational apps at improving physician decision making in trauma triage: randomized controlled trial

OBJECTIVE

To determine whether a behavioral intervention delivered through a video game can improve the appropriateness of trauma triage decisions in the emergency department of non-trauma centers.

DESIGN

Randomized clinical trial.

SETTING

Online intervention in national sample of emergency medicine physicians who make triage decisions at US hospitals.

PARTICIPANTS

368 emergency medicine physicians primarily working at non-trauma centers. A random sample (n=200) of those with primary outcome data was reassessed at six months.

INTERVENTIONS

Physicians were randomized in a 1:1 ratio to one hour of exposure to an adventure video game (Night Shift) or apps based on traditional didactic education (myATLS and Trauma Life Support MCQ Review), both on iPads. Night Shift was developed to recalibrate the process of using pattern recognition to recognize moderate-severe injuries (representativeness heuristics) through the use of stories to promote behavior change (narrative engagement). Physicians were randomized with a 2×2 factorial design to intervention (game v traditional education apps) and then to the experimental condition under which they completed the outcome assessment tool (low v high cognitive load). Blinding could not be maintained after allocation but group assignment was masked during the analysis phase.

MAIN OUTCOME MEASURES

Outcomes of a virtual simulation that included 10 cases; in four of these the patients had severe injuries. Participants completed the simulation within four weeks of their intervention. Decisions to admit, discharge, or transfer were measured. The proportion of patients under-triaged (patients with severe injuries not transferred to a trauma center) was calculated then (primary outcome) and again six months later, with a different set of cases (primary outcome of follow-up study). The secondary outcome was effect of cognitive load on under-triage.

RESULTS

149 (81%) physicians in the game arm and 148 (80%) in the traditional education arm completed the trial. Of these, 64/100 (64%) and 58/100 (58%), respectively, completed reassessment at six months. The mean age was 40 (SD 8.9), 283 (96%) were trained in emergency medicine, and 207 (70%) were ATLS (advanced trauma life support) certified. Physicians exposed to the game under-triaged fewer severely injured patients than those exposed to didactic education (316/596 (0.53) v 377/592 (0.64), estimated difference 0.11, 95% confidence interval 0.05 to 0.16; P<0.001). Cognitive load did not influence under-triage (161/308 (0.53) v 155/288 (0.54) in the game arm; 197/300 (0.66) v 180/292 (0.62) in the traditional educational apps arm; P=0.66). At six months, physicians exposed to the game remained less likely to under-triage patients (146/256 (0.57) v 172/232 (0.74), estimated difference 0.17, 0.09 to 0.25; P<0.001). No physician reported side effects. The sample might not reflect all emergency medicine physicians, and a small set of cases was used to assess performance.

CONCLUSIONS

Compared with apps based on traditional didactic education, exposure of physicians to a theoretically grounded video game improved triage decision making in a validated virtual simulation. Though the observed effect was large, the wide confidence intervals include the possibility of a small benefit, and the real world efficacy of this intervention remains uncertain.

TRIAL REGISTRATION

clinicaltrials.gov; NCT02857348 (initial study)/NCT03138304 (follow-up).

Testing a videogame intervention to recalibrate physician heuristics in trauma triage: study protocol for a randomized controlled trial

Background

Between 30 and 40 % of patients with severe injuries receive treatment at non-trauma centers (under-triage), largely because of physician decision making. Existing interventions to improve triage by physicians ignore the role that intuition (heuristics) plays in these decisions. One such heuristic is to form an initial impression based on representativeness (how typical does a patient appear of one with severe injuries). We created a video game (Night Shift) to recalibrate physician’s representativeness heuristic in trauma triage.

Methods

We developed Night Shift in collaboration with emergency medicine physicians, trauma surgeons, behavioral scientists, and game designers. Players take on the persona of Andy Jordan, an emergency medicine physician, who accepts a new job in a small town. Through a series of cases that go awry, they gain experience with the contextual cues that distinguish patients with minor and severe injuries (based on the theory of analogical encoding) and receive emotionally-laden feedback on their performance (based on the theory of narrative engagement). The planned study will compare the effect of Night Shift with that of an educational program on physician triage decisions and on physician heuristics. Psychological theory predicts that cognitive load increases reliance on heuristics, thereby increasing the under-triage rate when heuristics are poorly calibrated. We will randomize physicians (n = 366) either to play the game or to review an educational program, and will assess performance using a validated virtual simulation. The validated simulation includes both control and cognitive load conditions. We will compare rates of under-triage after exposure to the two interventions (primary outcome) and will compare the effect of cognitive load on physicians’ under-triage rates (secondary outcome). We hypothesize that: a) physicians exposed to Night Shift will have lower rates of under-triage compared to those exposed to the educational program, and b) cognitive load will not degrade triage performance among physicians exposed to Night Shift as much as it will among those exposed to the educational program.

Discussion

Serious games offer a new approach to the problem of poorly-calibrated heuristics in trauma triage. The results of this trial will contribute to the understanding of physician quality improvement and the efficacy of video games as behavioral interventions.

Trial registration

clinicaltrials.gov; NCT02857348; August 2, 2016.

The Influential Factor Analysis of Classification Partition Management Mode on the Emergency Triage

BACKGROUND

The aim of the study was to discuss on the influential factors of the mode of classification of partition management in the emergency triage.

METHOD

Retrospectively analyzing the effects of emergency triage of 156 cases who adopted the classification partition management mode during Oct 2014 to Oct 2015 in Xuzhou Central Hospital (Xuzhou, Jiangsu Province, China). They were divided into triage success group of 108 cases and triage failure group of 48 cases. Comparing the single factor analysis and multi-factor analysis, and selecting possible influential factors.

RESULT

According to the single factor analysis, for the patients who came to the doctor in the daytime and working days, the higher education degree and compliance they had, the faster the back-show time of emergency inspect and check came back, the more comprehensive the body examination and disease history taking were done, the simpler the disease condition was, the higher triage success rate they received. Compared to the emergency observation time between two groups, the difference was not statistically significant. According to the multi-factor analysis, the emergency check and examination back-show time, the comprehensive degree of body examination and disease history taking and the complexity degree of disease could be the independent risk factors for triage success.

CONCLUSION

Simplify the examination procedure, improve the efficiency of back-show and acquire detail disease information are important methods for the improvement of triage success.

Development of an algorithm to aid triage decisions for intensive care unit admission: a clinical vignette and retrospective cohort study

BACKGROUND

Intensive care unit (ICU) admission triage is performed routinely and is often based solely on clinical judgment, which could mask biases. A computerized algorithm to aid ICU triage decisions was developed to classify patients into the Society of Critical Care Medicine's prioritization system. In this study, we sought to evaluate the reliability and validity of this algorithm.

METHODS

Nine senior physicians evaluated forty clinical vignettes based on real patients. The reference standard was defined as the priorities ascribed by two investigators with full access to patients' records. Agreement of algorithm-based priorities with the reference standard and with intuitive priorities provided by the physicians were evaluated. Correlations between algorithm prioritization and physicians' judgment of the appropriateness of ICU admissions in scarcity and nonscarcity settings were also evaluated. Validity was further assessed by retrospectively applying this algorithm to 603 patients with requests for ICU admission for association with clinical outcomes.

RESULTS

Agreement between algorithm-based priorities and the reference standard was substantial, with a median κ of 0.72 (interquartile range [IQR] 0.52-0.77). Algorithm-based priorities demonstrated higher interrater reliability (overall κ 0.61, 95% confidence interval [CI] 0.57-0.65; median percentage agreement 0.64, IQR 0.59-0.70) than physicians' intuitive prioritization (overall κ 0.51, 95% CI 0.47-0.55; median percentage agreement 0.49, IQR 0.44-0.56) (p = 0.001). Algorithm-based priorities were also associated with physicians' judgment of appropriateness of ICU admission (priorities 1, 2, 3, and 4 vignettes would be admitted to the last ICU bed in 83.7%, 61.2%, 45.2%, and 16.8% of the scenarios, respectively; p < 0.001) and with actual ICU admission, palliative care consultation, and hospital mortality in the retrospective cohort.

CONCLUSIONS

This ICU admission triage algorithm demonstrated good reliability and validity. However, more studies are needed to evaluate a difference in benefit of ICU admission justifying the admission of one priority stratum over the others.

European trauma guideline compliance assessment: the ETRAUSS study

INTRODUCTION

Haemorrhagic shock is the leading cause of preventable death in trauma patients. The 2013 European trauma guidelines emphasise a comprehensive, multidisciplinary, protocol-based approach to trauma care. The aim of the present Europe-wide survey was to compare 2015 practice with the 2013 guidelines.

METHODS

A group of members of the Trauma and Emergency Medicine section of the European Society of Intensive Care Medicine developed a 50-item questionnaire based upon the core recommendations of the 2013 guidelines, employing a multistep approach. The questionnaire covered five fields: care structure and organisation, haemodynamic resuscitation targets, fluid management, transfusion and coagulopathy, and haemorrhage control. The sampling used a two-step approach comprising initial purposive sampling of eminent trauma care providers in each European country, followed by snowball sampling of a maximum number of trauma care providers.

RESULTS

A total of 296 responses were collected, 243 (81 %) from European countries. Those from outside the European Union were excluded from the analysis. Approximately three-fourths (74 %) of responders were working in a designated trauma centre. Blunt trauma predominated, accounting for more than 90 % of trauma cases. Considerable heterogeneity was observed in all five core aspects of trauma care, along with frequent deviations from the 2013 guidelines. Only 92 (38 %) of responders claimed to comply with the recommended systolic blood pressure target, and only 81 (33 %) responded that they complied with the target pressure in patients with traumatic brain injury. Crystalloid use was predominant (n = 209; 86 %), and vasopressor use was frequent (n = 171, 76 %) but remained controversial. Only 160 respondents (66 %) declared that they used tranexamic acid always or often.

CONCLUSIONS

This is the first European trauma survey, to our knowledge. Heterogeneity is significant across centres with regard to the clinical protocols for trauma patients and as to locally available resources. Deviations from guidelines are frequent, differ from region to region and are dependent upon specialty training. Further efforts are required to provide consensus guidelines and to improve their implementation across European countries.

Assessing electronic health record systems in emergency departments: Using a decision analytic Bayesian model

In the last decade, health providers have implemented information systems to improve accuracy in medical diagnosis and decision-making. This article evaluates the impact of an electronic health record on emergency department physicians' diagnosis and admission decisions. A decision analytic approach using a decision tree was constructed to model the admission decision process to assess the added value of medical information retrieved from the electronic health record. Using a Bayesian statistical model, this method was evaluated on two coronary artery disease scenarios. The results show that the cases of coronary artery disease were better diagnosed when the electronic health record was consulted and led to more informed admission decisions. Furthermore, the value of medical information required for a specific admission decision in emergency departments could be quantified. The findings support the notion that physicians and patient healthcare can benefit from implementing electronic health record systems in emergency departments.