1
|
Townsend BA, Plant KL, Hodge VJ, Ashaolu O, Calinescu R. Medical practitioner perspectives on AI in emergency triage. Front Digit Health 2023; 5:1297073. [PMID: 38125759 PMCID: PMC10731272 DOI: 10.3389/fdgth.2023.1297073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 11/20/2023] [Indexed: 12/23/2023] Open
Abstract
Introduction A proposed Diagnostic AI System for Robot-Assisted Triage ("DAISY") is under development to support Emergency Department ("ED") triage following increasing reports of overcrowding and shortage of staff in ED care experienced within National Health Service, England ("NHS") but also globally. DAISY aims to reduce ED patient wait times and medical practitioner overload. The objective of this study was to explore NHS health practitioners' perspectives and attitudes towards the future use of AI-supported technologies in ED triage. Methods Between July and August 2022 a qualitative-exploratory research study was conducted to collect and capture the perceptions and attitudes of nine NHS healthcare practitioners to better understand the challenges and benefits of a DAISY deployment. The study was based on a thematic analysis of semi-structured interviews. The study involved qualitative data analysis of the interviewees' responses. Audio-recordings were transcribed verbatim, and notes included into data documents. The transcripts were coded line-by-line, and data were organised into themes and sub-themes. Both inductive and deductive approaches to thematic analysis were used to analyse such data. Results Based on a qualitative analysis of coded interviews with the practitioners, responses were categorised into broad main thematic-types, namely: trust; current practice; social, legal, ethical, and cultural concerns; and empathetic practice. Sub-themes were identified for each main theme. Further quantitative analyses explored the vocabulary and sentiments of the participants when talking generally about NHS ED practices compared to discussing DAISY. Limitations include a small sample size and the requirement that research participants imagine a prototype AI-supported system still under development. The expectation is that such a system would work alongside the practitioner. Findings can be generalisable to other healthcare AI-supported systems and to other domains. Discussion This study highlights the benefits and challenges for an AI-supported triage healthcare solution. The study shows that most NHS ED practitioners interviewed were positive about such adoption. Benefits cited were a reduction in patient wait times in the ED, assistance in the streamlining of the triage process, support in calling for appropriate diagnostics and for further patient examination, and identification of those very unwell and requiring more immediate and urgent attention. Words used to describe the system were that DAISY is a "good idea", "help", helpful, "easier", "value", and "accurate". Our study demonstrates that trust in the system is a significant driver of use and a potential barrier to adoption. Participants emphasised social, legal, ethical, and cultural considerations and barriers to DAISY adoption and the importance of empathy and non-verbal cues in patient interactions. Findings demonstrate how DAISY might support and augment human medical performance in ED care, and provide an understanding of attitudinal barriers and considerations for the development and implementation of future triage AI-supported systems.
Collapse
Affiliation(s)
| | - Katherine L. Plant
- Faculty of Engineering & Physical Sciences, University of Southampton, Southampton, Hampshire, United Kingdom
| | - Victoria J. Hodge
- Department of Computer Science, University of York, York, United Kingdom
| | | | - Radu Calinescu
- Department of Computer Science, University of York, York, United Kingdom
| |
Collapse
|
2
|
Yuksen C, Savatmongkorngul S, Sunsuwan N, Sricharoen P, Jenpanitpong C, Maijan K, Watcharakitpaisan S, Kaninworapan P. Mortality in patients receiving prolonged invasive mechanical ventilation time in the emergency department: A retrospective cohort study. Int J Crit Illn Inj Sci 2022; 12:77-81. [PMID: 35845125 PMCID: PMC9285126 DOI: 10.4103/ijciis.ijciis_69_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 09/10/2021] [Accepted: 10/11/2021] [Indexed: 11/04/2022] Open
|
3
|
Gorodetzer R, Alpert EA, Orr Z, Unger S, Zalut T. Lessons learned from an evaluation of referrals to the emergency department. Isr J Health Policy Res 2020; 9:18. [PMID: 32340624 PMCID: PMC7184694 DOI: 10.1186/s13584-020-00377-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2019] [Accepted: 04/14/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Emergency department (ED) crowding is an international phenomenon dependent on input, throughput, and output factors. This study aims to determine whether patterns of potentially unnecessary referrals from either primary care physicians (PCPs) or urgent care centers (UCCs) can be identified, thereby to reduce ED visits by patients who could be treated elsewhere. Literature from the United States reports up to 35% unnecessary referrals from UCCs. METHODS A retrospective cohort study was conducted of patients referred to an ED in Jerusalem by either their PCP or a group of UCCs with a full range of laboratory tests and basic imaging capabilities between January 2017 and December 2017. The data were analyzed to identify referrals involving diagnoses, specialist consultations, and examinations unavailable in the PCP's office or UCC (e.g., ultrasound, CT, echocardiogram, or stress test); these referrals were considered necessary for completion of the patient work-up. If patients were evaluated by an ED physician and sent home after an examination or laboratory test available at least in the UCC, the referrals were considered potentially unnecessary. RESULTS Significantly more referrals were made by PCPs than UCCs (1712 vs. 280, p < 0.001). Significant differences were observed for orthopedics, general surgery, and obstetrics/gynecology referrals (p = 0.039, p < 0.001, p = 0.003). A higher percentage of patients referred by PCPs had potentially unnecessary visits compared to patients referred by UCCs (13.9% vs. 7.9%, p = 0.005). CONCLUSION A robust UCC system may help further reduce potentially unnecessary visits (including complex patients) to the ED.
Collapse
Affiliation(s)
- Roee Gorodetzer
- Faculty of Life and Health Sciences, Jerusalem College of Technology, 21 Havaad Haleumi St, 9372115, Jerusalem, Israel.
| | - Evan Avraham Alpert
- Department of Emergency Medicine, Shaare Zedek Medical Center, Jerusalem, Israel
| | - Zvika Orr
- Faculty of Life and Health Sciences, Jerusalem College of Technology, 21 Havaad Haleumi St, 9372115, Jerusalem, Israel
| | - Shifra Unger
- Faculty of Life and Health Sciences, Jerusalem College of Technology, 21 Havaad Haleumi St, 9372115, Jerusalem, Israel
| | - Todd Zalut
- Department of Emergency Medicine, Shaare Zedek Medical Center, Jerusalem, Israel
| |
Collapse
|
4
|
Lee SY, Chinnam RB, Dalkiran E, Krupp S, Nauss M. Prediction of emergency department patient disposition decision for proactive resource allocation for admission. Health Care Manag Sci 2019; 23:339-359. [PMID: 31444660 DOI: 10.1007/s10729-019-09496-y] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2019] [Accepted: 08/07/2019] [Indexed: 11/27/2022]
Abstract
We investigate the capability of information from electronic health records of an emergency department (ED) to predict patient disposition decisions for reducing "boarding" delays through the proactive initiation of admission processes (e.g., inpatient bed requests, transport, etc.). We model the process of ED disposition decision prediction as a hierarchical multiclass classification while dealing with the progressive accrual of clinical information throughout the ED caregiving process. Multinomial logistic regression as well as machine learning models are built for carrying out the predictions. Utilizing results from just the first set of ED laboratory tests along with other prior information gathered for each patient (2.5 h ahead of the actual disposition decision on average), our model predicts disposition decisions with positive predictive values of 55.4%, 45.1%, 56.9%, and 47.5%, while controlling false positive rates (1.4%, 1.0%, 4.3%, and 1.4%), with AUC values of 0.97, 0.95, 0.89, and 0.84 for the four admission (minor) classes, i.e., intensive care unit (3.6% of the testing samples), telemetry unit (2.2%), general practice unit (11.9%), and observation unit (6.6%) classes, respectively. Moreover, patients destined to intensive care unit present a more drastic increment in prediction quality at triage than others. Disposition decision classification models can provide more actionable information than a binary admission vs. discharge prediction model for the proactive initiation of admission processes for ED patients. Observing the distinct trajectories of information accrual and prediction quality evolvement for ED patients destined to different types of units, proactive coordination strategies should be tailored accordingly for each destination unit.
Collapse
Affiliation(s)
- Seung-Yup Lee
- Haskayne School of Business, University of Calgary, 2500 University Dr. NW, Calgary, AB, T2N 1N4, Canada.
| | - Ratna Babu Chinnam
- Department of Industrial & Systems Engineering, Wayne State University, 4815 Fourth St, Detroit, MI, 48202, USA
| | - Evrim Dalkiran
- Department of Industrial & Systems Engineering, Wayne State University, 4815 Fourth St, Detroit, MI, 48202, USA
| | - Seth Krupp
- Department of Emergency Medicine, Henry Ford Hospital, 2799 W. Grand Blvd, Detroit, MI, 48202, USA
| | - Michael Nauss
- Department of Emergency Medicine, Henry Ford Hospital, 2799 W. Grand Blvd, Detroit, MI, 48202, USA
| |
Collapse
|
5
|
Salmon A, Rachuba S, Briscoe S, Pitt M. A structured literature review of simulation modelling applied to Emergency Departments: Current patterns and emerging trends. ACTA ACUST UNITED AC 2018. [DOI: 10.1016/j.orhc.2018.01.001] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
6
|
Doupe MB, Chateau D, Chochinov A, Weber E, Enns JE, Derksen S, Sarkar J, Schull M, Lobato de Faria R, Katz A, Soodeen RA. Comparing the Effect of Throughput and Output Factors on Emergency Department Crowding: A Retrospective Observational Cohort Study. Ann Emerg Med 2018; 72:410-419. [DOI: 10.1016/j.annemergmed.2018.04.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2017] [Revised: 03/18/2018] [Accepted: 04/02/2018] [Indexed: 11/15/2022]
|
7
|
Amodio E, d'Oro LC, Chiarazzo E, Picco C, Migliori M, Trezzi I, Lopez S, Rinaldi O, Giupponi M. Emergency department performances during overcrowding: the experience of the health protection agency of Brianza. AIMS Public Health 2018; 5:217-224. [PMID: 30280113 PMCID: PMC6141554 DOI: 10.3934/publichealth.2018.3.217] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2018] [Accepted: 06/26/2018] [Indexed: 11/18/2022] Open
Abstract
Background: Hospital emergency departments (ED) can contribute to improve health outcomes and reduce costs of health care system. This study evaluated ED admissions during a twelve months period, analyzing characteristics of patients who underwent to emergency care in order to understand factors involved in ED overcrowding and promote adequate management. Methods: This retrospective study analyzed a twelve months window, with in-depth focus on December/January when almost all EDs reported overcrowding. All ED admissions were recorded in electronic schedules including: demographic characteristics, time/date of the access, incoming triage code, diagnosis, performed procedures, discharge, time/date of discharge. A backward multivariable logistic regression model was used to estimate relationships between investigated variables and ED pattern mortality. Results: A total of 416,299 ED admissions were analyzed. During the overcrowded period there was an increase in patients admissions (+32 patients per day, p = 0.0079) with a statistically significant rise of critical patients (+1.7% yellow codes and +0.7% red codes, p < 0.001) and older subjects (+1.4% patients aged 75 or more years, p < 0.001). Moreover, there were statistically significant increases in waiting times and in length of visits, a higher percentage of patients who were hospitalized (13.3% vs. 12.2%, p < 0.001), left ED (4.46% vs. 4.15%, p < 0.001) and died (0.27% vs. 0.17%, p < 0.0001). This latter result maintained a marginal statistical significance (OR = 1.16, 95% CI = 0.98–1.38, p = 0.075) after adjustment for confounding. Conclusion: Our study highlights that ED crowding can determine measurable worsening in ED services and patient outcomes as mortality, waiting times, lengths of stay, percentage of abandonment without being seen and, probably, costs. Thus, address ED crowding has to be considered an important public health priority requiring policymakers involvement.
Collapse
Affiliation(s)
- Emanuele Amodio
- Health Protection Agency of Brianza (Italy), Viale Elvezia n.2 Monza (MB) 20900
| | | | | | - Carlo Picco
- AREU-Urgency Emergency Regional Agency, Lombardy
| | | | - Isabella Trezzi
- Health Protection Agency of Brianza (Italy), Viale Elvezia n.2 Monza (MB) 20900
| | - Silvano Lopez
- Health Protection Agency of Brianza (Italy), Viale Elvezia n.2 Monza (MB) 20900
| | - Oliviero Rinaldi
- Health Protection Agency of Brianza (Italy), Viale Elvezia n.2 Monza (MB) 20900
| | - Massimo Giupponi
- Health Protection Agency of Brianza (Italy), Viale Elvezia n.2 Monza (MB) 20900
| |
Collapse
|
8
|
Hui Z, Ruiling T, Yupeng L, Yumei H. Optimal Strategy in Queueing Systems in Emergency Department. INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY AND WEB ENGINEERING 2018. [DOI: 10.4018/ijitwe.2018010105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The authors' study a noncooperative game problem for queueing control in emergency department (ED). One of the challenges to emergency department (ED) is the control of the urgent patients and the non-urgent patients. The urgent patient which is the primary customer, can be considered as the service interruption in a queueing system. The service interruptions occur frequently and can incur significant delays for the non-urgent patients. Therefore, a non-urgent patient needs to decide whether to join the queue or leave. The scenario is modeled as an M/M/1 queueing game with server interruption where each patient wants to optimize his benefit. It is shown that the individually optimal strategy for joining the queue is characterized by a threshold of queue length. The socially optimal threshold of queue length is also obtained. To bridge the gap between the individually and socially optimal strategies, a pricing mechanism is proposed to toll the service of each non-urgent patient, thus equalizing the two optimal strategies.
Collapse
Affiliation(s)
- Zeng Hui
- College of Economics and Management, College of Science, Yanshan University, Qinhuangdao, China
| | - Tian Ruiling
- College of Science, Yanshan University, Qinhuangdao, China
| | - Liu Yupeng
- First Hospital of QINHUANGDAO, Qinhuangdao, China
| | - Hou Yumei
- College of Economics and Management, Yanshan University, Qinhuangdao, China
| |
Collapse
|
9
|
Van Der Linden MC, Khursheed M, Hooda K, Pines JM, Van Der Linden N. Two emergency departments, 6000km apart: Differences in patient flow and staff perceptions about crowding. Int Emerg Nurs 2017; 35:30-36. [PMID: 28659247 DOI: 10.1016/j.ienj.2017.06.002] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2016] [Revised: 06/05/2017] [Accepted: 06/06/2017] [Indexed: 11/29/2022]
Abstract
INTRODUCTION Emergency department (ED) crowding is a worldwide public health issue. In this study, patient flow and staff perceptions of crowding were assessed in Pakistan (Aga Khan University Hospital (AKUH)) and in the Netherlands (Haaglanden Medical Centre Westeinde (HMCW)). Bottlenecks affecting ED patient flow were identified. METHODS First, a one-year review of patient visits was performed. Second, staff perceptions about ED crowding were collected using face-to-face interviews. Non-participant observation and document review were used to interpret the findings. RESULTS At AKUH 58,839 (160visits/day) and at HMCW 50,802 visits (140visits/day) were registered. Length of stay (LOS) at AKUH was significantly longer than at HMCW (279min (IQR 357) vs. 100min (IQR 152)). There were major differences in patient acuities, admission and mortality rates, indicating a sicker population at AKUH. Respondents from both departments experienced hampered patient flow on a daily basis, and perceived similar causes for crowding: increased patients' complexity, long treatment times, and poor availability of inpatient beds. CONCLUSION Despite differences in environment, demographics, and ED patient flow, respondents perceived similar bottlenecks in patient flow. Interventions should be tailored to specific ED and hospital needs. For both EDs, improving the outflow of boarded patients is essential.
Collapse
Affiliation(s)
| | - Munawar Khursheed
- Emergency Department, Aga Khan University Hospital, Karachi, Pakistan
| | | | - Jesse M Pines
- Office for Clinical Practice Innovation, Departments of Emergency Medicine and Health Policy & Management, George Washington University, Washington, DC, USA
| | - Naomi Van Der Linden
- Centre for Health Economics Research and Evaluation, University of Technology Sydney, Sydney, Australia
| |
Collapse
|