The Haemostasis Traffic Light, a user-centred coagulation management tool for acute bleeding situations: a simulation-based randomised dual-centre trial

Visual Blood, Visualisation of Blood Gas Analysis in Virtual Reality, Leads to More Correct Diagnoses: A Computer-Based, Multicentre, Simulation Study

Interpreting blood gas analysis results can be challenging for the clinician, especially in stressful situations under time pressure. To foster fast and correct interpretation of blood gas results, we developed Visual Blood. This computer-based, multicentre, noninferiority study compared Visual Blood and conventional arterial blood gas (ABG) printouts. We presented six scenarios to anaesthesiologists, once with Visual Blood and once with the conventional ABG printout. The primary outcome was ABG parameter perception. The secondary outcomes included correct clinical diagnoses, perceived diagnostic confidence, and perceived workload. To analyse the results, we used mixed models and matched odds ratios. Analysing 300 within-subject cases, we showed noninferiority of Visual Blood compared to ABG printouts concerning the rate of correctly perceived ABG parameters (rate ratio, 0.96; 95% CI, 0.92–1.00; p = 0.06). Additionally, the study revealed two times higher odds of making the correct clinical diagnosis using Visual Blood (OR, 2.16; 95% CI, 1.42–3.29; p < 0.001) than using ABG printouts. There was no or, respectively, weak evidence for a difference in diagnostic confidence (OR, 0.84; 95% CI, 0.58–1.21; p = 0.34) and perceived workload (Coefficient, 2.44; 95% CI, −0.09–4.98; p = 0.06). This study showed that participants did not perceive the ABG parameters better, but using Visual Blood resulted in more correct clinical diagnoses than using conventional ABG printouts. This suggests that Visual Blood allows for a higher level of situation awareness beyond individual parameters’ perception. However, the study also highlighted the limitations of today’s virtual reality headsets and Visual Blood.

Visual Blood, a 3D Animated Computer Model to Optimize the Interpretation of Blood Gas Analysis

Acid–base homeostasis is crucial for all physiological processes in the body and is evaluated using arterial blood gas (ABG) analysis. Screens or printouts of ABG results require the interpretation of many textual elements and numbers, which may delay intuitive comprehension. To optimise the presentation of the results for the specific strengths of human perception, we developed Visual Blood, an animated virtual model of ABG results. In this study, we compared its performance with a conventional result printout. Seventy physicians from three European university hospitals participated in a computer-based simulation study. Initially, after an educational video, we tested the participants’ ability to assign individual Visual Blood visualisations to their corresponding ABG parameters. As the primary outcome, we tested caregivers’ ability to correctly diagnose simulated clinical ABG scenarios with Visual Blood or conventional ABG printouts. For user feedback, participants rated their agreement with statements at the end of the study. Physicians correctly assigned 90% of the individual Visual Blood visualisations. Regarding the primary outcome, the participants made the correct diagnosis 86% of the time when using Visual Blood, compared to 68% when using the conventional ABG printout. A mixed logistic regression model showed an odds ratio for correct diagnosis of 3.4 (95%CI 2.00–5.79, p < 0.001) and an odds ratio for perceived diagnostic confidence of 1.88 (95%CI 1.67–2.11, p < 0.001) in favour of Visual Blood. A linear mixed model showed a coefficient for perceived workload of −3.2 (95%CI −3.77 to −2.64) in favour of Visual Blood. Fifty-one of seventy (73%) participants agreed or strongly agreed that Visual Blood was easy to use, and fifty-five of seventy (79%) agreed that it was fun to use. In conclusion, Visual Blood improved physicians’ ability to diagnose ABG results. It also increased perceived diagnostic confidence and reduced perceived workload. This study adds to the growing body of research showing that decision-support tools developed around human cognitive abilities can streamline caregivers’ decision-making and may improve patient care.

Physicians' perceptions of two ways of algorithm presentation: graphic versus text-based approach

Acute bleeding during surgery or after trauma harms patients, and challenges involved physicians. Protocols and cognitive aids can help in such situations. This dual-centre study investigated physicians' opinions regarding two ways to present cognitive aids, graphic 'Haemostasis Traffic Light' and text-based, using the example of a coagulation management algorithm to identify the strengths and limitations of both presentation modalities. Using qualitative research methods, we identified recurring answer patterns and derived major topics and subthemes through inductive coding. Eighty-four physicians participated. We assigned each half randomly to one of the cognitive aids (graphic/text-based) and determined 447 usable statements. We qualitatively deduced the importance of having a cognitive aid for physicians. Furthermore, it is noticeable that the graphic group made more positive comments (154 of 242 (64%) statements), while the text-based participants made more negative annotations (126 of 205 (61%) statements), suggesting a generally stronger approval of this cognitive aid. Practitioner summary: This qualitative study provides an overview of physicians` positive and negative perceptions regarding two presentation ways for a coagulation management algorithm. Participants perceived the graphic method created according to user-centred design principles more positively. The analysis reveals components that an ideal algorithm should have to help streamline the decision-making process.

Improved Task Performance, Low Workload, and User-Centered Design in Medical Diagnostic Equipment Enhance Decision Confidence of Anesthesia Providers: A Meta-Analysis and a Multicenter Online Survey

Decision confidence—the subjective belief to have made the right decision—is central in planning actions in a complex environment such as the medical field. It is unclear by which factors it is influenced. We analyzed a pooled data set of eight studies and performed a multicenter online survey assessing anesthesiologists’ opinions on decision confidence. By applying mixed models and using multiple imputation to determine the effect of missing values from the dataset on the results, we investigated how task performance, perceived workload, the utilization of user-centered medical diagnostic devices, job, work experience, and gender affected decision confidence. The odds of being confident increased with better task performance (OR: 1.27, 95% CI: 0.94 to 1.7; p = 0.12; after multiple imputation OR: 3.19, 95% CI: 2.29 to 4.45; p < 0.001) and when user-centered medical devices were used (OR: 5.01, 95% CI: 3.67 to 6.85; p < 0.001; after multiple imputation OR: 3.58, 95% CI: 2.65 to 4.85; p < 0.001). The odds of being confident decreased with higher perceived workload (OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001; after multiple imputation, OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001). Other factors, such as gender, job, or professional experience, did not affect decision confidence. Most anesthesiologists who participated in the online survey agreed that task performance (25 of 30; 83%), perceived workload (24 of 30; 80%), work experience (28 of 30; 93%), and job (21 of 30; 70%) influence decision confidence. Improved task performance, lower perceived workload, and user-centered design in medical equipment enhanced the decision confidence of anesthesia providers.

Physicians' perceptions regarding acute bleeding management: an international mixed qualitative quantitative study

Background

Acute bleeding is an omnipresent challenge for all physicians. Uncontrolled hemorrhage is the most common preventable cause of death after trauma worldwide. In different surgical disciplines, hemorrhage represents an independent risk factor for increased postoperative morbimortality, directly affecting patients’ outcomes. This study asked anesthesiologists about their personal perceived challenges when treating bleeding patients.

Methods

This investigator-initiated, prospective, international, dual-center, mixed qualitative and quantitative study interrogated anesthesiologists about what they found easy and what difficult in treating acutely bleeding patients. Following the template approach for qualitative research, we identified major and minor topics through free inductive coding and word count. In a second step, we derived ten statements from the participants’ answers. Using a field survey, we then asked the participants to rate their level of agreement with the derived statements. We analyzed the answers using one sample Wilcoxon test and the Mann-Whitney test.

Results

We included a total of 84 physicians in the qualitative interrogations and a different group of 42 anesthesiologists in the quantitative part. We identified 11 major topics and 19 associated subtopics. The main topics and the degree of agreement (here as agree or strongly agree) were as follows: “Complexity of the topic” (52.4% agreed to find the topic complex), “Cognitive aids” (92.9% agreed to find them helpful), “Time management” (64.3% agreed to feeling time pressure), “Human factors” (95.2% agreed that human factors are essential), “Resources” (95.2% agreed that resources are essential), “Experience” and “Low frequency of cases” (57.1% agreed to lack practice), “Diagnostic methods” (31.0% agreed that the interpretation of test results is difficult), “Anticoagulation” (85.7% agreed to it being difficult), “Treatment” (81.0% agreed to knowing the first therapeutic steps), and “Nothing”.

Conclusions

Anesthesiologists in two large tertiary care facilities in different parts of the world found coagulation management, especially in anticoagulated patients, complex. We identified the delayed diagnostic test results and their interpretation as challenges. Resources, treatment protocols and human factors such as team communication were perceived to facilitate management. Future studies should explore the challenges in smaller hospitals and other parts of the world and test new technologies addressing the identified difficulties.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12871-021-01269-x.