1
|
Born C, Schwarz R, Böttcher TP, Hein A, Krcmar H. The role of information systems in emergency department decision-making-a literature review. J Am Med Inform Assoc 2024; 31:1608-1621. [PMID: 38781289 PMCID: PMC11187435 DOI: 10.1093/jamia/ocae096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 04/11/2024] [Accepted: 04/15/2024] [Indexed: 05/25/2024] Open
Abstract
OBJECTIVES Healthcare providers employ heuristic and analytical decision-making to navigate the high-stakes environment of the emergency department (ED). Despite the increasing integration of information systems (ISs), research on their efficacy is conflicting. Drawing on related fields, we investigate how timing and mode of delivery influence IS effectiveness. Our objective is to reconcile previous contradictory findings, shedding light on optimal IS design in the ED. MATERIALS AND METHODS We conducted a systematic review following PRISMA across PubMed, Scopus, and Web of Science. We coded the ISs' timing as heuristic or analytical, their mode of delivery as active for automatic alerts and passive when requiring user-initiated information retrieval, and their effect on process, economic, and clinical outcomes. RESULTS Our analysis included 83 studies. During early heuristic decision-making, most active interventions were ineffective, while passive interventions generally improved outcomes. In the analytical phase, the effects were reversed. Passive interventions that facilitate information extraction consistently improved outcomes. DISCUSSION Our findings suggest that the effectiveness of active interventions negatively correlates with the amount of information received during delivery. During early heuristic decision-making, when information overload is high, physicians are unresponsive to alerts and proactively consult passive resources. In the later analytical phases, physicians show increased receptivity to alerts due to decreased diagnostic uncertainty and information quantity. Interventions that limit information lead to positive outcomes, supporting our interpretation. CONCLUSION We synthesize our findings into an integrated model that reveals the underlying reasons for conflicting findings from previous reviews and can guide practitioners in designing ISs in the ED.
Collapse
Affiliation(s)
- Cornelius Born
- School of Computation, Information and Technology, Technical University of Munich, 85748 Garching bei München, Germany
| | - Romy Schwarz
- School of Computation, Information and Technology, Technical University of Munich, 85748 Garching bei München, Germany
| | - Timo Phillip Böttcher
- School of Computation, Information and Technology, Technical University of Munich, 85748 Garching bei München, Germany
| | - Andreas Hein
- Institute of Information Systems and Digital Business, University of St. Gallen, 9000 St. Gallen, Switzerland
| | - Helmut Krcmar
- School of Computation, Information and Technology, Technical University of Munich, 85748 Garching bei München, Germany
| |
Collapse
|
2
|
Strechen I, Herasevich S, Barwise A, Garcia-Mendez J, Rovati L, Pickering B, Diedrich D, Herasevich V. Centralized Multipatient Dashboards' Impact on Intensive Care Unit Clinician Performance and Satisfaction: A Systematic Review. Appl Clin Inform 2024; 15:414-427. [PMID: 38574763 PMCID: PMC11136527 DOI: 10.1055/a-2299-7643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Accepted: 04/03/2024] [Indexed: 04/06/2024] Open
Abstract
BACKGROUND Intensive care unit (ICU) clinicians encounter frequent challenges with managing vast amounts of fragmented data while caring for multiple critically ill patients simultaneously. This may lead to increased provider cognitive load that may jeopardize patient safety. OBJECTIVES This systematic review assesses the impact of centralized multipatient dashboards on ICU clinician performance, perceptions regarding the use of these tools, and patient outcomes. METHODS A literature search was conducted on February 9, 2023, using the EBSCO CINAHL, Cochrane Central Register of Controlled Trials, Embase, IEEE Xplore, MEDLINE, Scopus, and Web of Science Core Collection databases. Eligible studies that included ICU clinicians as participants and tested the effect of dashboards designed for use by multiple users to manage multiple patients on user performance and/or satisfaction compared with the standard practice. We narratively synthesized eligible studies following the SWiM (Synthesis Without Meta-analysis) guidelines. Studies were grouped based on dashboard type and outcomes assessed. RESULTS The search yielded a total of 2,407 studies. Five studies met inclusion criteria and were included. Among these, three studies evaluated interactive displays in the ICU, one study assessed two dashboards in the pediatric ICU (PICU), and one study examined centralized monitor in the PICU. Most studies reported several positive outcomes, including reductions in data gathering time before rounds, a decrease in misrepresentations during multidisciplinary rounds, improved daily documentation compliance, faster decision-making, and user satisfaction. One study did not report any significant association. CONCLUSION The multipatient dashboards were associated with improved ICU clinician performance and were positively perceived in most of the included studies. The risk of bias was high, and the certainty of evidence was very low, due to inconsistencies, imprecision, indirectness in the outcome measure, and methodological limitations. Designing and evaluating multipatient tools using robust research methodologies is an important focus for future research.
Collapse
Affiliation(s)
- Inna Strechen
- Department of Anesthesiology and Perioperative Medicine, Division of Critical Care, Mayo Clinic, Rochester, Minnesota, United States
| | - Svetlana Herasevich
- Department of Anesthesiology and Perioperative Medicine, Division of Critical Care, Mayo Clinic, Rochester, Minnesota, United States
| | - Amelia Barwise
- Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, Minnesota, United States
| | - Juan Garcia-Mendez
- Department of Anesthesiology and Perioperative Medicine, Division of Critical Care, Mayo Clinic, Rochester, Minnesota, United States
| | - Lucrezia Rovati
- Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, Minnesota, United States
- Department of Emergency Medicine, University of Milano-Bicocca, School of Medicine and Surgery, Milan, Italy
| | - Brian Pickering
- Department of Anesthesiology and Perioperative Medicine, Division of Critical Care, Mayo Clinic, Rochester, Minnesota, United States
| | - Daniel Diedrich
- Department of Anesthesiology and Perioperative Medicine, Division of Critical Care, Mayo Clinic, Rochester, Minnesota, United States
| | - Vitaly Herasevich
- Department of Anesthesiology and Perioperative Medicine, Division of Critical Care, Mayo Clinic, Rochester, Minnesota, United States
| |
Collapse
|
3
|
Yang S, Galvagno S, Badjatia N, Stein D, Teeter W, Scalea T, Shackelford S, Fang R, Miller C, Hu P. A Novel Continuous Real-Time Vital Signs Viewer for Intensive Care Units: Design and Evaluation Study. JMIR Hum Factors 2024; 11:e46030. [PMID: 38180791 PMCID: PMC10799282 DOI: 10.2196/46030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 11/03/2023] [Accepted: 11/20/2023] [Indexed: 01/06/2024] Open
Abstract
BACKGROUND Clinicians working in intensive care units (ICUs) are immersed in a cacophony of alarms and a relentless onslaught of data. Within this frenetic environment, clinicians make high-stakes decisions using many data sources and are often oversaturated with information of varying quality. Traditional bedside monitors only depict static vital signs data, and these data are not easily viewable remotely. Clinicians must rely on separate nursing charts-handwritten or electric-to review physiological patterns, including signs of potential clinical deterioration. An automated physiological data viewer has been developed to provide at-a-glance summaries and to assist with prioritizing care for multiple patients who are critically ill. OBJECTIVE This study aims to evaluate a novel vital signs viewer system in a level 1 trauma center by subjectively assessing the viewer's utility in a high-volume ICU setting. METHODS ICU attendings were surveyed during morning rounds. Physicians were asked to conduct rounds normally, using data reported from nurse charts and briefs from fellows to inform their clinical decisions. After the physician finished their assessment and plan for the patient, they were asked to complete a questionnaire. Following completion of the questionnaire, the viewer was presented to ICU physicians on a tablet personal computer that displayed the patient's physiologic data (ie, shock index, blood pressure, heart rate, temperature, respiratory rate, and pulse oximetry), summarized for up to 72 hours. After examining the viewer, ICU physicians completed a postview questionnaire. In both questionnaires, the physicians were asked questions regarding the patient's stability, status, and need for a higher or lower level of care. A hierarchical clustering analysis was used to group participating ICU physicians and assess their general reception of the viewer. RESULTS A total of 908 anonymous surveys were collected from 28 ICU physicians from February 2015 to June 2017. Regarding physicians' perception of whether the viewer enhanced the ability to assess multiple patients in the ICU, 5% (45/908) strongly agreed, 56.6% (514/908) agreed, 35.3% (321/908) were neutral, 2.9% (26/908) disagreed, and 0.2% (2/908) strongly disagreed. CONCLUSIONS Morning rounds in a trauma center ICU are conducted in a busy environment with many data sources. This study demonstrates that organized physiologic data and visual assessment can improve situation awareness, assist clinicians with recognizing changes in patient status, and prioritize care.
Collapse
Affiliation(s)
- Shiming Yang
- Department of Anesthesiology, University of Maryland School of Medicine, Baltimore, MD, United States
| | - Samuel Galvagno
- Department of Anesthesiology, University of Maryland School of Medicine, Baltimore, MD, United States
| | - Neeraj Badjatia
- Department of Neurology, University of Maryland School of Medicine, Baltimore, MD, United States
| | - Deborah Stein
- Department of Surgery, University of Maryland School of Medicine, Baltimore, MD, United States
| | - William Teeter
- Emergency Medicine, University of Maryland School of Medicine, Baltimore, MD, United States
| | - Thomas Scalea
- Department of Surgery, University of Maryland School of Medicine, Baltimore, MD, United States
| | - Stacy Shackelford
- United States Air Force Academy, Colorado Springs, CO, United States
| | - Raymond Fang
- Department of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Catriona Miller
- Department of Surgery, University of Maryland School of Medicine, Baltimore, MD, United States
| | - Peter Hu
- Department of Anesthesiology, University of Maryland School of Medicine, Baltimore, MD, United States
| |
Collapse
|
4
|
Wan YKJ, Wright MC, McFarland MM, Dishman D, Nies MA, Rush A, Madaras-Kelly K, Jeppesen A, Del Fiol G. Information displays for automated surveillance algorithms of in-hospital patient deterioration: a scoping review. J Am Med Inform Assoc 2023; 31:256-273. [PMID: 37847664 PMCID: PMC10746326 DOI: 10.1093/jamia/ocad203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 09/12/2023] [Accepted: 10/02/2023] [Indexed: 10/19/2023] Open
Abstract
OBJECTIVE Surveillance algorithms that predict patient decompensation are increasingly integrated with clinical workflows to help identify patients at risk of in-hospital deterioration. This scoping review aimed to identify the design features of the information displays, the types of algorithm that drive the display, and the effect of these displays on process and patient outcomes. MATERIALS AND METHODS The scoping review followed Arksey and O'Malley's framework. Five databases were searched with dates between January 1, 2009 and January 26, 2022. Inclusion criteria were: participants-clinicians in inpatient settings; concepts-intervention as deterioration information displays that leveraged automated AI algorithms; comparison as usual care or alternative displays; outcomes as clinical, workflow process, and usability outcomes; and context as simulated or real-world in-hospital settings in any country. Screening, full-text review, and data extraction were reviewed independently by 2 researchers in each step. Display categories were identified inductively through consensus. RESULTS Of 14 575 articles, 64 were included in the review, describing 61 unique displays. Forty-one displays were designed for specific deteriorations (eg, sepsis), 24 provided simple alerts (ie, text-based prompts without relevant patient data), 48 leveraged well-accepted score-based algorithms, and 47 included nurses as the target users. Only 1 out of the 10 randomized controlled trials reported a significant effect on the primary outcome. CONCLUSIONS Despite significant advancements in surveillance algorithms, most information displays continue to leverage well-understood, well-accepted score-based algorithms. Users' trust, algorithmic transparency, and workflow integration are significant hurdles to adopting new algorithms into effective decision support tools.
Collapse
Affiliation(s)
- Yik-Ki Jacob Wan
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| | - Melanie C Wright
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Mary M McFarland
- Eccles Health Sciences Library, University of Utah, Salt Lake City, UT 84112, United States
| | - Deniz Dishman
- Cizik School of Nursing Department of Research, University of Texas Health Science Center at Houston, Houston, TX 77030, United States
| | - Mary A Nies
- College of Health, Idaho State University, Pocatello, ID 83209, United States
| | - Adriana Rush
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| | - Karl Madaras-Kelly
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Amanda Jeppesen
- College of Pharmacy, Idaho State University, Meridian, ID 83642, United States
| | - Guilherme Del Fiol
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT 84108, United States
| |
Collapse
|
5
|
Davis CL, Bjoring M, Hursh J, Smith S, Blevins C, Blackstone K, Nicholson E, Hoke T, Michel J, Noth I, Barros A, Enfield K. The Intensive Care Unit Bundle Board: A Novel Real-Time Data Visualization Tool to Improve Maintenance Care for Invasive Catheters. Appl Clin Inform 2023; 14:892-902. [PMID: 37666277 PMCID: PMC10651369 DOI: 10.1055/a-2165-5861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 08/14/2023] [Indexed: 09/06/2023] Open
Abstract
BACKGROUND Critically ill patients are at greater risk of healthcare-associated infections (HAIs). The use of maintenance bundles helps to reduce this risk but also generates a rapid accumulation of complex data that is difficult to aggregate and subsequently act upon. OBJECTIVES We hypothesized that a digital display summarizing nursing documentation of invasive catheters (including central venous access devices, arterial catheters, and urinary catheters) would improve invasive device maintenance care and documentation. Our secondary objectives were to see if this summary would reduce the duration of problematic conditions, that is, characteristics associated with increased risk of infection. METHODS We developed and implemented a data visualization tool called the "Bundle Board" to display nursing observations on invasive devices. The intervention was studied in a 28-bed medical intensive care unit (MICU). The Bundle Board was piloted for 6 weeks in June 2022 and followed by a comparison phase, where one MICU had Bundle Board access and another MICU at the same center did not. We retrospectively applied tile color coding logic to prior nursing documentation from 2021 until the pilot phase to facilitate comparison pre- and post-Bundle Board release. RESULTS After adjusting for time, other quality improvement efforts, and nursing shift, multiple linear regression demonstrated a statistically significant improvement in the completion of catheter care and documentation during the pilot phase (p < 0.0001) and comparison phase (p = 0.002). The median duration of documented problematic conditions was significantly reduced during the pilot phase (p < 0.0001) and in the MICU with the Bundle Board (comparison phase, p = 0.027). CONCLUSION We successfully developed a data visualization tool that changed ICU provider behavior, resulting in increased completion and documentation of maintenance care and reduced duration of problematic conditions for invasive catheters in MICU patients.
Collapse
Affiliation(s)
- Claire Leilani Davis
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Margot Bjoring
- Department of Quality and Performance Improvement, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Jordyn Hursh
- Department of Nursing, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Samuel Smith
- Department of Nursing, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Cheri Blevins
- Department of Nursing, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Kris Blackstone
- Department of Nursing, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Evie Nicholson
- Department of Quality and Performance Improvement, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Tracey Hoke
- Department of Quality and Performance Improvement, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Jonathan Michel
- Department of Quality and Performance Improvement, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Imre Noth
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Andrew Barros
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, University of Virginia Health System, Charlottesville, Virginia, United States
| | - Kyle Enfield
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, University of Virginia Health System, Charlottesville, Virginia, United States
| |
Collapse
|
6
|
Gasciauskaite G, Lunkiewicz J, Schweiger G, Budowski AD, Henckert D, Roche TR, Bergauer L, Meybohm P, Hottenrott S, Zacharowski K, Raimann FJ, Rivas E, López-Baamonde M, Ganter MT, Schmidt T, Nöthiger CB, Tscholl DW, Akbas S. User Perceptions of Visual Blood: An International Mixed Methods Study on Novel Blood Gas Analysis Visualization. Diagnostics (Basel) 2023; 13:3103. [PMID: 37835847 PMCID: PMC10572252 DOI: 10.3390/diagnostics13193103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 09/22/2023] [Accepted: 09/26/2023] [Indexed: 10/15/2023] Open
Abstract
Blood gas analysis plays a central role in modern medicine. Advances in technology have expanded the range of available parameters and increased the complexity of their interpretation. By applying user-centered design principles, it is possible to reduce the cognitive load associated with interpreting blood gas analysis. In this international, multicenter study, we explored anesthesiologists' perspectives on Visual Blood, a novel visualization technique for presenting blood gas analysis results. We conducted interviews with participants following two computer-based simulation studies, the first utilizing virtual reality (VR) (50 participants) and the second without VR (70 participants). Employing the template approach, we identified key themes in the interview responses and formulated six statements, which were rated using Likert scales from 1 (strongly disagree) to 5 (strongly agree) in an online questionnaire. The most frequently mentioned theme was the positive usability features of Visual Blood. The online survey revealed that participants found Visual Blood to be an intuitive method for interpreting blood gas analysis (median 4, interquartile range (IQR) 4-4, p < 0.001). Participants noted that minimal training was required to effectively learn how to interpret Visual Blood (median 4, IQR 4-4, p < 0.001). However, adjustments are necessary to reduce visual overload (median 4, IQR 2-4, p < 0.001). Overall, Visual Blood received a favorable response. The strengths and weaknesses derived from these data will help optimize future versions of Visual Blood to improve the presentation of blood gas analysis results.
Collapse
Affiliation(s)
- Greta Gasciauskaite
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - Justyna Lunkiewicz
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - Giovanna Schweiger
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - Alexandra D. Budowski
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - David Henckert
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - Tadzio R. Roche
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - Lisa Bergauer
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - Patrick Meybohm
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, University of Wuerzburg, 97080 Wuerzburg, Germany
| | - Sebastian Hottenrott
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, University of Wuerzburg, 97080 Wuerzburg, Germany
| | - Kai Zacharowski
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, University Hospital Frankfurt, Goethe University Frankfurt, 60323 Frankfurt, Germany
| | - Florian Jürgen Raimann
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, University Hospital Frankfurt, Goethe University Frankfurt, 60323 Frankfurt, Germany
| | - Eva Rivas
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, Hospital Clinic of Barcelona, University of Barcelona, 08036 Barcelona, Spain
| | - Manuel López-Baamonde
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, Hospital Clinic of Barcelona, University of Barcelona, 08036 Barcelona, Spain
| | - Michael Thomas Ganter
- Institute of Anaesthesiology and Critical Care Medicine, Clinic Hirslanden Zurich, 8032 Zurich, Switzerland
| | - Tanja Schmidt
- Institute of Anaesthesiology and Critical Care Medicine, Clinic Hirslanden Zurich, 8032 Zurich, Switzerland
| | - Christoph B. Nöthiger
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - David W. Tscholl
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - Samira Akbas
- Institute of Anesthesiology, University and University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| |
Collapse
|
7
|
Arnold M, Goldschmitt M, Rigotti T. Dealing with information overload: a comprehensive review. Front Psychol 2023; 14:1122200. [PMID: 37416535 PMCID: PMC10322198 DOI: 10.3389/fpsyg.2023.1122200] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Accepted: 04/26/2023] [Indexed: 07/08/2023] Open
Abstract
Information overload is a problem that is being exacerbated by the ongoing digitalization of the world of work and the growing use of information and communication technologies. Therefore, the aim of this systematic literature review is to provide an insight into existing measures for prevention and intervention related to information overload. The methodological approach of the systematic review is based on the PRISMA standards. A keyword search in three interdisciplinary scientific databases and other more practice-oriented databases resulted in the identification of 87 studies, field reports, and conceptual papers that were included in the review. The results show that a considerable number of papers have been published on interventions on the behavioral prevention level. At the level of structural prevention, there are also many proposals on how to design work to reduce information overload. A further distinction can be made between work design approaches at the level of information and communication technology and at the level of teamwork and organizational regulations. Although the identified studies cover a wide range of possible interventions and design approaches to address information overload, the strength of the evidence from these studies is mixed.
Collapse
Affiliation(s)
- Miriam Arnold
- Leibniz Institute for Resilience Research, Mainz, Germany
| | | | - Thomas Rigotti
- Leibniz Institute for Resilience Research, Mainz, Germany
- Work, Organizational and Business Psychology, Johannes Gutenberg-University Mainz, Mainz, Germany
| |
Collapse
|
8
|
Bergauer L, Braun J, Roche TR, Meybohm P, Hottenrott S, Zacharowski K, Raimann FJ, Rivas E, López-Baamonde M, Ganter MT, Nöthiger CB, Spahn DR, Tscholl DW, Akbas S. Avatar-based patient monitoring improves information transfer, diagnostic confidence and reduces perceived workload in intensive care units: computer-based, multicentre comparison study. Sci Rep 2023; 13:5908. [PMID: 37041316 PMCID: PMC10088750 DOI: 10.1038/s41598-023-33027-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 04/06/2023] [Indexed: 04/13/2023] Open
Abstract
Patient monitoring is the foundation of intensive care medicine. High workload and information overload can impair situation awareness of staff, thus leading to loss of important information about patients' conditions. To facilitate mental processing of patient monitoring data, we developed the Visual-Patient-avatar Intensive Care Unit (ICU), a virtual patient model animated from vital signs and patient installation data. It incorporates user-centred design principles to foster situation awareness. This study investigated the avatar's effects on information transfer measured by performance, diagnostic confidence and perceived workload. This computer-based study compared Visual-Patient-avatar ICU and conventional monitor modality for the first time. We recruited 25 nurses and 25 physicians from five centres. The participants completed an equal number of scenarios in both modalities. Information transfer, as the primary outcome, was defined as correctly assessing vital signs and installations. Secondary outcomes included diagnostic confidence and perceived workload. For analysis, we used mixed models and matched odds ratios. Comparing 250 within-subject cases revealed that Visual-Patient-avatar ICU led to a higher rate of correctly assessed vital signs and installations [rate ratio (RR) 1.25; 95% CI 1.19-1.31; P < 0.001], strengthened diagnostic confidence [odds ratio (OR) 3.32; 95% CI 2.15-5.11, P < 0.001] and lowered perceived workload (coefficient - 7.62; 95% CI - 9.17 to - 6.07; P < 0.001) than conventional modality. Using Visual-Patient-avatar ICU, participants retrieved more information with higher diagnostic confidence and lower perceived workload compared to the current industry standard monitor.
Collapse
Affiliation(s)
- Lisa Bergauer
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| | - Julia Braun
- Department of Epidemiology and Biostatistics, University of Zurich, Zurich, Switzerland
| | - Tadzio Raoul Roche
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland.
| | - Patrick Meybohm
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, University of Wuerzburg, Wuerzburg, Germany
| | - Sebastian Hottenrott
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, University of Wuerzburg, Wuerzburg, Germany
| | - Kai Zacharowski
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, University Hospital Frankfurt, Goethe University Frankfurt, Frankfurt, Germany
| | - Florian Jürgen Raimann
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, University Hospital Frankfurt, Goethe University Frankfurt, Frankfurt, Germany
| | - Eva Rivas
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, Hospital Clinic of Barcelona, University of Barcelona, Barcelona, Spain
| | - Manuel López-Baamonde
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, Hospital Clinic of Barcelona, University of Barcelona, Barcelona, Spain
| | - Michael Thomas Ganter
- Institute of Anaesthesiology and Critical Care Medicine, Clinic Hirslanden Zurich, Zurich, Switzerland
| | - Christoph Beat Nöthiger
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| | - Donat R Spahn
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| | - David Werner Tscholl
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| | - Samira Akbas
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Zurich, Switzerland
| |
Collapse
|
9
|
Xie CX, Chen Q, Hincapié CA, Hofstetter L, Maher CG, Machado GC. Effectiveness of clinical dashboards as audit and feedback or clinical decision support tools on medication use and test ordering: a systematic review of randomized controlled trials. J Am Med Inform Assoc 2022; 29:1773-1785. [PMID: 35689652 PMCID: PMC9471705 DOI: 10.1093/jamia/ocac094] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Revised: 05/04/2022] [Accepted: 05/31/2022] [Indexed: 11/14/2022] Open
Abstract
BACKGROUND Clinical dashboards used as audit and feedback (A&F) or clinical decision support systems (CDSS) are increasingly adopted in healthcare. However, their effectiveness in changing the behavior of clinicians or patients is still unclear. This systematic review aims to investigate the effectiveness of clinical dashboards used as CDSS or A&F tools (as a standalone intervention or part of a multifaceted intervention) in primary care or hospital settings on medication prescription/adherence and test ordering. METHODS Seven major databases were searched for relevant studies, from inception to August 2021. Two authors independently extracted data, assessed the risk of bias using the Cochrane RoB II scale, and evaluated the certainty of evidence using GRADE. Data on trial characteristics and intervention effect sizes were extracted. A narrative synthesis was performed to summarize the findings of the included trials. RESULTS Eleven randomized trials were included. Eight trials evaluated clinical dashboards as standalone interventions and provided conflicting evidence on changes in antibiotic prescribing and no effects on statin prescribing compared to usual care. Dashboards increased medication adherence in patients with inflammatory arthritis but not in kidney transplant recipients. Three trials investigated dashboards as part of multicomponent interventions revealing decreased use of opioids for low back pain, increased proportion of patients receiving cardiovascular risk screening, and reduced antibiotic prescribing for upper respiratory tract infections. CONCLUSION There is limited evidence that dashboards integrated into electronic medical record systems and used as feedback or decision support tools may be associated with improvements in medication use and test ordering.
Collapse
Affiliation(s)
- Charis Xuan Xie
- Wolfson Institute of Population Health, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, UK
| | - Qiuzhe Chen
- Institute for Musculoskeletal Health, Sydney, NSW, Australia.,Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| | - Cesar A Hincapié
- Department of Chiropractic Medicine, Faculty of Medicine, University of Zurich and Balgrist University Hospital, Zurich, Switzerland.,Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Léonie Hofstetter
- Department of Chiropractic Medicine, Faculty of Medicine, University of Zurich and Balgrist University Hospital, Zurich, Switzerland
| | - Chris G Maher
- Institute for Musculoskeletal Health, Sydney, NSW, Australia.,Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| | - Gustavo C Machado
- Institute for Musculoskeletal Health, Sydney, NSW, Australia.,Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
10
|
Zhuang M, Concannon D, Manley E. A Framework for Evaluating Dashboards in Healthcare. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2022; 28:1715-1731. [PMID: 35213306 DOI: 10.1109/tvcg.2022.3147154] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
In the era of 'information overload', effective information provision is essential for enabling rapid response and critical decision making. In making sense of diverse information sources, dashboards have become an indispensable tool, providing fast, effective, adaptable, and personalized access to information for professionals and the general public alike. However, these objectives place heavy requirements on dashboards as information systems in usability and effective design. Understanding these issues is challenging given the absence of consistent and comprehensive approaches to dashboard evaluation. In this article we systematically review literature on dashboard implementation in healthcare, where dashboards have been employed widely, and where there is widespread interest for improving the current state of the art, and subsequently analyse approaches taken towards evaluation. We draw upon consolidated dashboard literature and our own observations to introduce a general definition of dashboards which is more relevant to current trends, together with seven evaluation scenarios - task performance, behaviour change, interaction workflow, perceived engagement, potential utility, algorithm performance and system implementation. These scenarios distinguish different evaluation purposes which we illustrate through measurements, example studies, and common challenges in evaluation study design. We provide a breakdown of each evaluation scenario, and highlight some of the more subtle questions. We demonstrate the use of the proposed framework by a design study guided by this framework. We conclude by comparing this framework with existing literature, outlining a number of active discussion points and a set of dashboard evaluation best practices for the academic, clinical and software development communities alike.
Collapse
|
11
|
Ljubenovic A, Said S, Braun J, Grande B, Kolbe M, Spahn DR, Nöthiger CB, Tscholl DW, Roche TR. Anesthesia providers' visual attention in simulated anesthesia emergencies using conventional number-based and avatar-based patient monitoring: a prospective, eye-tracking study. JMIR Serious Games 2022; 10:e35642. [PMID: 35172958 PMCID: PMC8984829 DOI: 10.2196/35642] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 02/05/2022] [Accepted: 02/17/2022] [Indexed: 01/20/2023] Open
Abstract
BACKGROUND Inadequate situational awareness accounts for two-thirds of preventable complications in anesthesia. An essential tool for situational awareness in the perioperative setting is the patient monitor. However, the conventional monitor has several weaknesses. Avatar-based patient monitoring may address these shortcomings and promote situation awareness, a prerequisite for good decision making. OBJECTIVE The spatial distribution of visual attention is a fundamental process for achieving adequate situation awareness and thus a potential quantifiable surrogate for situation awareness. Moreover, measuring visual attention with a head-mounted eye-tracker may provide insights into usage and acceptance of the new avatar-based patient monitoring modality. METHODS This prospective eye-tracking study compared anesthesia providers' visual attention on conventional and avatar-based patient monitors during simulated critical anesthesia events. We defined visual attention, measured as fixation count and dwell time, as our primary outcome. We correlated visual attention with the potential confounders: performance in managing simulated critical anesthesia events (task performance), work experience, and profession. We used mixed linear models to analyze the results. RESULTS Fifty-two teams performed 156 simulations. After a manual quality check of the eye-tracking footage, we excluded 57 simulations due to technical problems and quality issues. Participants had a median of 198 (IQR 92.5 - 317.5) fixations on the patient monitor with a median dwell time of 30.2 (IQR 14.9 - 51.3) seconds. We found no significant difference in participants' visual attention when using avatar-based patient monitoring or conventional patient monitoring. However, we found that with each percentage point of better task performance, the number of fixations decreased by about 1.39 (coefficient -1.39; 95%CI: -2.44 to -0.34; P=.02), and the dwell time diminished by 0.23 seconds (coefficient -0.23; 95%CI: -0.4 to -0.06; P=.01). CONCLUSIONS Using eye-tracking, we found no significant difference in visual attention when anesthesia providers used avatar-based monitoring or conventional patient monitoring in simulated critical anesthesia events. However, we identified visual attention in conjunction with task performance as a surrogate for situational awareness. CLINICALTRIAL Business Management System for Ethics Committees Number Req-2020-00059.
Collapse
Affiliation(s)
- Arsène Ljubenovic
- Institute of Anesthesiology, University of Zurich and University Hospital Zurich, Rämistrasse 100, Zurich, CH
| | - Sadiq Said
- Institute of Anesthesiology, University of Zurich and University Hospital Zurich, Rämistrasse 100, Zurich, CH
| | - Julia Braun
- Departments of Epidemiology and Biostatistics, Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, CH
| | - Bastian Grande
- Institute of Anesthesiology, University of Zurich and University Hospital Zurich, Rämistrasse 100, Zurich, CH.,Simulation Centre, University Hospital Zurich, Zurich, CH
| | - Michaela Kolbe
- Simulation Centre, University Hospital Zurich, Zurich, CH
| | - Donat R Spahn
- Institute of Anesthesiology, University of Zurich and University Hospital Zurich, Rämistrasse 100, Zurich, CH
| | - Christoph B Nöthiger
- Institute of Anesthesiology, University of Zurich and University Hospital Zurich, Rämistrasse 100, Zurich, CH
| | - David W Tscholl
- Institute of Anesthesiology, University of Zurich and University Hospital Zurich, Rämistrasse 100, Zurich, CH
| | - Tadzio R Roche
- Institute of Anesthesiology, University of Zurich and University Hospital Zurich, Rämistrasse 100, Zurich, CH
| |
Collapse
|
12
|
Lai CH, Li KW, Hu FW, Su PF, Hsu IL, Huang MH, Huang YT, Liu PY, Shen MR. Integration of an ICU Visualization Dashboard (i-Dashboard) as a Platform to Facilitate Multidisciplinary Rounds: A Cluster Randomized Controlled Trial (Preprint). J Med Internet Res 2022; 24:e35981. [PMID: 35560107 PMCID: PMC9143774 DOI: 10.2196/35981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 02/20/2022] [Accepted: 04/25/2022] [Indexed: 11/13/2022] Open
Abstract
Background Multidisciplinary rounds (MDRs) are scheduled, patient-focused communication mechanisms among multidisciplinary providers in the intensive care unit (ICU). Objective i-Dashboard is a custom-developed visualization dashboard that supports (1) key information retrieval and reorganization, (2) time-series data, and (3) display on large touch screens during MDRs. This study aimed to evaluate the performance, including the efficiency of prerounding data gathering, communication accuracy, and information exchange, and clinical satisfaction of integrating i-Dashboard as a platform to facilitate MDRs. Methods A cluster-randomized controlled trial was performed in 2 surgical ICUs at a university hospital. Study participants included all multidisciplinary care team members. The performance and clinical satisfaction of i-Dashboard during MDRs were compared with those of the established electronic medical record (EMR) through direct observation and questionnaire surveys. Results Between April 26 and July 18, 2021, a total of 78 and 91 MDRs were performed with the established EMR and i-Dashboard, respectively. For prerounding data gathering, the median time was 10.4 (IQR 9.1-11.8) and 4.6 (IQR 3.5-5.8) minutes using the established EMR and i-Dashboard (P<.001), respectively. During MDRs, data misrepresentations were significantly less frequent with i-Dashboard (median 0, IQR 0-0) than with the established EMR (4, IQR 3-5; P<.001). Further, effective recommendations were significantly more frequent with i-Dashboard than with the established EMR (P<.001). The questionnaire results revealed that participants favored using i-Dashboard in association with the enhancement of care plan development and team participation during MDRs. Conclusions i-Dashboard increases efficiency in data gathering. Displaying i-Dashboard on large touch screens in MDRs may enhance communication accuracy, information exchange, and clinical satisfaction. The design concepts of i-Dashboard may help develop visualization dashboards that are more applicable for ICU MDRs. Trial Registration ClinicalTrials.gov NCT04845698; https://clinicaltrials.gov/ct2/show/NCT04845698
Collapse
Affiliation(s)
- Chao-Han Lai
- Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
- Department of Biochemistry and Molecular Biology, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
- Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, United States
| | - Kai-Wen Li
- Department of Nursing, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
| | - Fang-Wen Hu
- Department of Nursing, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
| | - Pei-Fang Su
- Department of Statistics, College of Management, National Cheng Kung University, Tainan City, Taiwan
| | - I-Lin Hsu
- Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
| | - Min-Hsin Huang
- Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
| | - Yen-Ta Huang
- Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
| | - Ping-Yen Liu
- Division of Cardiology, Department of Internal Medicine, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
- Institute of Clinical Medicine, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
- Department of Clinical Medical Research, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
| | - Meng-Ru Shen
- Department of Obstetrics and Gynecology, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan, Taiwan
- Department of Pharmacology, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
| |
Collapse
|
13
|
El-Kareh R, Sittig DF. Enhancing Diagnosis Through Technology: Decision Support, Artificial Intelligence, and Beyond. Crit Care Clin 2022; 38:129-139. [PMID: 34794627 PMCID: PMC8608279 DOI: 10.1016/j.ccc.2021.08.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Patient care in intensive care environments is complex, time-sensitive, and data-rich, factors that make these settings particularly well-suited to clinical decision support (CDS). A wide range of CDS interventions have been used in intensive care unit environments. The field needs well-designed studies to identify the most effective CDS approaches. Evolving artificial intelligence and machine learning models may reduce information-overload and enable teams to take better advantage of the large volume of patient data available to them. It is vital to effectively integrate new CDS into clinical workflows and to align closely with the cognitive processes of frontline clinicians.
Collapse
Affiliation(s)
- Robert El-Kareh
- University of California, San Diego, 9500 Gilman Drive, #0881 La Jolla, CA 92093-0881, USA.
| | - Dean F Sittig
- School of Biomedical Informatics, The University of Texas Health Science Center at Houston, UT-Memorial Hermann Center for Healthcare Quality & Safety, Houston, TX 77030, USA. https://twitter.com/DeanSittig
| |
Collapse
|
14
|
Reese TJ, Segall N, Del Fiol G, Tonna JE, Kawamoto K, Weir C, Wright MC. Iterative heuristic design of temporal graphic displays with clinical domain experts. J Clin Monit Comput 2021; 35:1119-1131. [PMID: 32743757 PMCID: PMC7854828 DOI: 10.1007/s10877-020-00571-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2019] [Accepted: 07/23/2020] [Indexed: 10/23/2022]
Abstract
Conventional electronic health record information displays are not optimized for efficient information processing. Graphical displays that integrate patient information can improve information processing, especially in data-rich environments such as critical care. We propose an adaptable and reusable approach to patient information display with modular graphical components (widgets). We had two study objectives. First, reduce numerous widget prototype alternatives to preferred designs. Second, derive widget design feature recommendations. Using iterative human-centered design methods, we interviewed experts to hone design features of widgets displaying frequently measured data elements, e.g., heart rate, for acute care patient monitoring and real-time clinical decision-making. Participant responses to design queries were coded to calculate feature-set agreement, average prototype score, and prototype agreement. Two iterative interview cycles covering 64 design queries and 86 prototypes were needed to reach consensus on six feature sets. Interviewers agreed that line graphs with a smoothed or averaged trendline, 24-h timeframe, and gradient coloring for urgency were useful and informative features. Moreover, users agreed that widgets should include key functions: (1) adjustable reference ranges, (2) expandable timeframes, and (3) access to details on demand. Participants stated graphical widgets would be used to identify correlating patterns and compare abnormal measures across related data elements at a specific time. Combining theoretical principles and validated design methods was an effective and reproducible approach to designing widgets for healthcare displays. The findings suggest our widget design features and recommendations match critical care clinician expectations for graphical information display of continuous and frequently updated patient data.
Collapse
Affiliation(s)
- Thomas J Reese
- Department of Biomedical Informatics, University of Utah School of Medicine, 421 Wakara Way, Ste 140, Salt Lake City, UT, 84108-3514, USA.
| | - Noa Segall
- Department of Anesthesiology, Duke University School of Medicine, Durham, USA
| | - Guilherme Del Fiol
- Department of Biomedical Informatics, University of Utah School of Medicine, 421 Wakara Way, Ste 140, Salt Lake City, UT, 84108-3514, USA
| | - Joseph E Tonna
- Divisions of Emergency Medicine and Cardiothoracic Surgery, University of Utah School of Medicine, Salt Lake City, USA
| | - Kensaku Kawamoto
- Department of Biomedical Informatics, University of Utah School of Medicine, 421 Wakara Way, Ste 140, Salt Lake City, UT, 84108-3514, USA
| | - Charlene Weir
- Department of Biomedical Informatics, University of Utah School of Medicine, 421 Wakara Way, Ste 140, Salt Lake City, UT, 84108-3514, USA
| | | |
Collapse
|
15
|
Reese TJ, Del Fiol G, Tonna JE, Kawamoto K, Segall N, Weir C, Macpherson BC, Kukhareva P, Wright MC. Impact of integrated graphical display on expert and novice diagnostic performance in critical care. J Am Med Inform Assoc 2021; 27:1287-1292. [PMID: 32548627 DOI: 10.1093/jamia/ocaa086] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2020] [Revised: 04/17/2020] [Accepted: 04/28/2020] [Indexed: 01/02/2023] Open
Abstract
OBJECTIVE To determine the impact of a graphical information display on diagnosing circulatory shock. MATERIALS AND METHODS This was an experimental study comparing integrated and conventional information displays. Participants were intensivists or critical care fellows (experts) and first-year medical residents (novices). RESULTS The integrated display was associated with higher performance (87% vs 82%; P < .001), less time (2.9 vs 3.5 min; P = .008), and more accurate etiology (67% vs 54%; P = .048) compared to the conventional display. When stratified by experience, novice physicians using the integrated display had higher performance (86% vs 69%; P < .001), less time (2.9 vs 3.7 min; P = .03), and more accurate etiology (65% vs 42%; P = .02); expert physicians using the integrated display had nonsignificantly improved performance (87% vs 82%; P = .09), time (2.9 vs 3.3; P = .28), and etiology (69% vs 67%; P = .81). DISCUSSION The integrated display appeared to support efficient information processing, which resulted in more rapid and accurate circulatory shock diagnosis. Evidence more strongly supported a difference for novices, suggesting that graphical displays may help reduce expert-novice performance gaps.
Collapse
Affiliation(s)
- Thomas J Reese
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Guilherme Del Fiol
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Joseph E Tonna
- Division of Emergency Medicine and Cardiothoracic Surgery, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Kensaku Kawamoto
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Noa Segall
- Department of Anesthesiology, Duke University School of Medicine, Durham, North Carolina, USA
| | - Charlene Weir
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Brekk C Macpherson
- School of Nursing, Virginia Commonwealth University, Richmond, Virginia, USA
| | - Polina Kukhareva
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Melanie C Wright
- College of Pharmacy, Idaho State University, Pocatello, Idaho, USA
| |
Collapse
|
16
|
Novak LL, Wanderer J, Owens DA, Fabbri D, Genkins JZ, Lasko TA. A Perioperative Care Display for Understanding High Acuity Patients. Appl Clin Inform 2021; 12:164-169. [PMID: 33657635 DOI: 10.1055/s-0041-1723023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022] Open
Abstract
BACKGROUND The data visualization literature asserts that the details of the optimal data display must be tailored to the specific task, the background of the user, and the characteristics of the data. The general organizing principle of a concept-oriented display is known to be useful for many tasks and data types. OBJECTIVES In this project, we used general principles of data visualization and a co-design process to produce a clinical display tailored to a specific cognitive task, chosen from the anesthesia domain, but with clear generalizability to other clinical tasks. To support the work of the anesthesia-in-charge (AIC) our task was, for a given day, to depict the acuity level and complexity of each patient in the collection of those that will be operated on the following day. The AIC uses this information to optimally allocate anesthesia staff and providers across operating rooms. METHODS We used a co-design process to collaborate with participants who work in the AIC role. We conducted two in-depth interviews with AICs and engaged them in subsequent input on iterative design solutions. RESULTS Through a co-design process, we found (1) the need to carefully match the level of detail in the display to the level required by the clinical task, (2) the impedance caused by irrelevant information on the screen such as icons relevant only to other tasks, and (3) the desire for a specific but optional trajectory of increasingly detailed textual summaries. CONCLUSION This study reports a real-world clinical informatics development project that engaged users as co-designers. Our process led to the user-preferred design of a single binary flag to identify the subset of patients needing further investigation, and then a trajectory of increasingly detailed, text-based abstractions for each patient that can be displayed when more information is needed.
Collapse
Affiliation(s)
- Laurie Lovett Novak
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| | - Jonathan Wanderer
- Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| | - David A Owens
- Vanderbilt University Owen Graduate School of Management, Nashville, Tennessee, United States
| | - Daniel Fabbri
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| | - Julian Z Genkins
- Department of Medicine, University of California San Francisco, San Francisco, California, United States
| | - Thomas A Lasko
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| |
Collapse
|
17
|
Tsang JY, Brown B, Peek N, Campbell S, Blakeman T. Mixed methods evaluation of a computerised audit and feedback dashboard to improve patient safety through targeting acute kidney injury (AKI) in primary care. Int J Med Inform 2021; 145:104299. [PMID: 33099183 DOI: 10.1016/j.ijmedinf.2020.104299] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Revised: 10/03/2020] [Accepted: 10/06/2020] [Indexed: 12/16/2022]
Abstract
BACKGROUND Reducing the harms associated with acute kidney injury (AKI) requires addressing a wide range of patient safety issues, including polypharmacy and transitions of care, particularly for vulnerable patient groups. Computerised audit and feedback can transform the way healthcare organisations measure, analyse and learn from quality and safety data across different care settings, potentially improving patient safety. OBJECTIVE To implement and evaluate an audit and feedback dashboard targeting AKI to improve patient safety, focusing on factors affecting a range of user characteristics in primary care. METHODS We performed a mixed methods study in three stages. Semi-structured interviews were initially performed with both primary (n = 10) and secondary care (n = 5) staff to gather user requirements for six quality indicators extracted from national guidance on post-discharge AKI care. Modified indicators were implemented in the Performance Improvement plaN GeneratoR (PINGR) audit and feedback dashboard for six months, across 45 general practices in Salford. Primary care professionals were then interviewed again (n = 7) and completed usability questionnaires. This was triangulated with an interrupted time series analysis on indicator performance, alongside software usage statistics. RESULTS Improvements were observed for the indicators for medication review (+9.01 %; 95 % Confidence Interval (CI), +6.95 % to +11.06 %) and blood pressure measurement (+5.20 %; 95 % CI + 3.61 % to +6.78 %). Variable performance and engagement were observed for other indicators including AKI coding (+0.39 %; 95 % CI -1.88 % to +2.65 %), serum creatinine (-3.40 %; 95 % CI -7.66 % to +0.85 %), proteinuria (-1.08 %; 95 % CI -1.47 % to +0.32 %) and providing patient information (+0.16 %; 95 % CI -0.41 % to +0.73 %). A key facilitator to engagement was the development of 'champions of change', achieved through a raised awareness of high-risk patients, guidelines, inconsistencies in coding practice and evidence for quality and safety performance. Barriers related to the specificity and perceived achievability of indicators, and limitations in resources. CONCLUSION In a six-month, quasi-experimental evaluation of an electronic audit and feedback dashboard targeting AKI, we found improvements for two out of six quality indicators. While information technology can facilitate improvements in patient safety, further allocation of protected staff time and investment into shared learning are needed to realise those improvements in practice.
Collapse
Affiliation(s)
- Jung Yin Tsang
- NIHR School for Primary Care Research, Centre for Primary Care and Health Services Research, University of Manchester, Manchester, UK; Centre for Health Informatics, The University of Manchester, Manchester, UK; NIHR Greater Manchester Patient Safety Translational Research Centre (GMPSTRC), University of Manchester, Manchester, UK.
| | - Benjamin Brown
- NIHR School for Primary Care Research, Centre for Primary Care and Health Services Research, University of Manchester, Manchester, UK; Centre for Health Informatics, The University of Manchester, Manchester, UK; NIHR Greater Manchester Patient Safety Translational Research Centre (GMPSTRC), University of Manchester, Manchester, UK
| | - Niels Peek
- Centre for Health Informatics, The University of Manchester, Manchester, UK; NIHR Greater Manchester Patient Safety Translational Research Centre (GMPSTRC), University of Manchester, Manchester, UK
| | - Stephen Campbell
- NIHR School for Primary Care Research, Centre for Primary Care and Health Services Research, University of Manchester, Manchester, UK; NIHR Greater Manchester Patient Safety Translational Research Centre (GMPSTRC), University of Manchester, Manchester, UK
| | - Thomas Blakeman
- NIHR School for Primary Care Research, Centre for Primary Care and Health Services Research, University of Manchester, Manchester, UK; NIHR Greater Manchester Patient Safety Translational Research Centre (GMPSTRC), University of Manchester, Manchester, UK
| |
Collapse
|
18
|
Lasko TA, Owens DA, Fabbri D, Wanderer JP, Genkins JZ, Novak LL. User-Centered Clinical Display Design Issues for Inpatient Providers. Appl Clin Inform 2020; 11:700-709. [PMID: 33086396 DOI: 10.1055/s-0040-1716746] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND Suboptimal information display in electronic health records (EHRs) is a notorious pain point for users. Designing an effective display is difficult, due in part to the complex and varied nature of clinical practice. OBJECTIVE This article aims to understand the goals, constraints, frustrations, and mental models of inpatient medical providers when accessing EHR data, to better inform the display of clinical information. METHODS A multidisciplinary ethnographic study of inpatient medical providers. RESULTS Our participants' primary goal was usually to assemble a clinical picture around a given question, under the constraints of time pressure and incomplete information. To do so, they tend to use a mental model of multiple layers of abstraction when thinking of patients and disease; they prefer immediate pattern recognition strategies for answering clinical questions, with breadth-first or depth-first search strategies used subsequently if needed; and they are sensitive to data relevance, completeness, and reliability when reading a record. CONCLUSION These results conflict with the ubiquitous display design practice of separating data by type (test results, medications, notes, etc.), a mismatch that is known to encumber efficient mental processing by increasing both navigation burden and memory demands on users. A popular and obvious solution is to select or filter the data to display exactly what is presumed to be relevant to the clinical question, but this solution is both brittle and mistrusted by users. A less brittle approach that is more aligned with our users' mental model could use abstraction to summarize details instead of filtering to hide data. An abstraction-based approach could allow clinicians to more easily assemble a clinical picture, to use immediate pattern recognition strategies, and to adjust the level of displayed detail to their particular needs. It could also help the user notice unanticipated patterns and to fluidly shift attention as understanding evolves.
Collapse
Affiliation(s)
- Thomas A Lasko
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| | - David A Owens
- Owen Graduate School of Management, Vanderbilt University, Nashville, Tennessee, United States
| | - Daniel Fabbri
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States.,Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, Tennessee, United States
| | - Jonathan P Wanderer
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States.,Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| | - Julian Z Genkins
- Department of Medicine, University of California, San Francisco, San Francisco, California, United States
| | - Laurie L Novak
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| |
Collapse
|
19
|
Kawamoto K, Kukhareva P, Shakib JH, Kramer H, Rodriguez S, Warner PB, Shields D, Weir C, Del Fiol G, Taft T, Stipelman CH. Association of an Electronic Health Record Add-on App for Neonatal Bilirubin Management With Physician Efficiency and Care Quality. JAMA Netw Open 2019; 2:e1915343. [PMID: 31730181 PMCID: PMC6902796 DOI: 10.1001/jamanetworkopen.2019.15343] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
IMPORTANCE The usefulness of electronic health record (EHR) systems could be significantly enhanced by innovative, third-party EHR add-on apps. OBJECTIVE To evaluate whether an EHR add-on app for neonatal bilirubin management can save clinicians time and improve patient care. DESIGN, SETTING, AND PARTICIPANTS This quality improvement study was conducted at the University of Utah Health Well Baby nursery and outpatient clinics and consisted of 4 substudies: (1) time savings were estimated in an experimental task-timing study comparing the time required for physicians to manage newborns' bilirubin levels with and without the add-on app, (2) app use was estimated from app logs, (3) health care use measures and guideline compliance were compared retrospectively before and after the intervention, and (4) clinician-perceived usability was measured through System Usability Scale surveys. The study took place between April 1, 2016, and September 3, 2019. Data analyses were conducted from October 30, 2018, to September 23, 2019. INTERVENTIONS At baseline, clinicians used a manual approach to ensure compliance with an evidence-based clinical guideline for neonatal bilirubin management. To facilitate guideline compliance, an EHR add-on app that automatically retrieves, organizes, and visualizes relevant patient data was developed. The app provides patient-specific assessments and recommendations, including the risk of rebound hyperbilirubinemia following phototherapy based on a predictive model. The add-on app was integrated with the University of Utah Health EHR on April 12, 2017. MAIN OUTCOMES AND MEASURES Clinician time savings, app use, health care use measures, guideline-compliant phototherapy ordering, and perceived usability as measured by the System Usability Scale survey. The survey is composed of 10 statements with responses ranging from 1 (strongly disagree) to 5 (strongly agree). The survey results in a single score ranging from 0 to 100, with ratings described as worst imaginable (mean System Usability Scale score, 12.5), awful (20.3), poor (35.7), okay (50.9), good (71.4), excellent (85.5), and best imaginable (90.9). RESULTS In 2018, the application was used 20 516 times by clinicians for 91.84% of eligible newborns. Use of the app saved 66 seconds for bilirubin management tasks compared with a commonly used tool (95% CI, 53-79 seconds; P < .001). Following the intervention, health care use rates remained stable, while orders for clinically appropriate phototherapy during hospitalization increased for newborns with bilirubin levels above the guideline-recommended threshold (odds ratio, 1.84; 95% CI, 1.16-2.90; P = .009). Surveys indicated excellent usability (System Usability Scale score, 83.90; 95% CI, 81.49-86.31). CONCLUSIONS AND RELEVANCE Well-designed EHR add-on apps may save clinicians time and improve patient care. If time-saving apps, such as the bilirubin app, were implemented widely across institutions and care domains, the potential association with improved patient care and clinician efficiency could be significant. The University of Utah Health bilirubin app is being prepared for release into EHR app stores as free-to-use software.
Collapse
Affiliation(s)
- Kensaku Kawamoto
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | - Polina Kukhareva
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | - Julie H. Shakib
- Department of Pediatrics, University of Utah, Salt Lake City
| | - Heidi Kramer
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | - Salvador Rodriguez
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | - Phillip B. Warner
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | - David Shields
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | - Charlene Weir
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | - Guilherme Del Fiol
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | - Teresa Taft
- Department of Biomedical Informatics, University of Utah, Salt Lake City
| | | |
Collapse
|
20
|
Wright MC, Borbolla D, Waller RG, Del Fiol G, Reese T, Nesbitt P, Segall N. Critical care information display approaches and design frameworks: A systematic review and meta-analysis. J Biomed Inform 2019; 3:100041. [PMID: 31423485 PMCID: PMC6696941 DOI: 10.1016/j.yjbinx.2019.100041] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2018] [Revised: 06/10/2019] [Accepted: 06/16/2019] [Indexed: 11/06/2022]
Abstract
OBJECTIVE To systematically review original user evaluations of patient information displays relevant to critical care and understand the impact of design frameworks and information presentation approaches on decision-making, efficiency, workload, and preferences of clinicians. METHODS We included studies that evaluated information displays designed to support real-time care decisions in critical care or anesthesiology using simulated tasks. We searched PubMed and IEEExplore from 1/1/1990 to 6/30/2018. The search strategy was developed iteratively with calibration against known references. Inclusion screening was completed independently by two authors. Extraction of display features, design processes, and evaluation method was completed by one and verified by a second author. RESULTS Fifty-six manuscripts evaluating 32 critical care and 22 anesthesia displays were included. Primary outcome metrics included clinician accuracy and efficiency in recognizing, diagnosing, and treating problems. Implementing user-centered design (UCD) processes, especially iterative evaluation and redesign, resulted in positive impact in outcomes such as accuracy and efficiency. Innovative display approaches that led to improved human-system performance in critical care included: (1) improving the integration and organization of information, (2) improving the representation of trend information, and (3) implementing graphical approaches to make relationships between data visible. CONCLUSION Our review affirms the value of key principles of UCD. Improved information presentation can facilitate faster information interpretation and more accurate diagnoses and treatment. Improvements to information organization and support for rapid interpretation of time-based relationships between related quantitative data is warranted. Designers and developers are encouraged to involve users in formal iterative design and evaluation activities in the design of electronic health records (EHRs), clinical informatics applications, and clinical devices.
Collapse
Affiliation(s)
- Melanie C. Wright
- Trinity Health, Livonia, MI, USA
- Saint Alphonsus Regional Medical Center, Boise, ID, USA
| | - Damian Borbolla
- Biomedical Informatics, University of Utah, Salt Lake City, UT, USA
| | | | | | - Thomas Reese
- Biomedical Informatics, University of Utah, Salt Lake City, UT, USA
| | - Paige Nesbitt
- Saint Alphonsus Regional Medical Center, Boise, ID, USA
| | - Noa Segall
- Anesthesiology, Duke University, Durham, NC, USA
| |
Collapse
|