1
|
Kauppi W, Imberg H, Herlitz J, Molin O, Axelsson C, Magnusson C. Advancing a machine learning-based decision support tool for pre-hospital assessment of dyspnoea by emergency medical service clinicians: a retrospective observational study. BMC Emerg Med 2025; 25:2. [PMID: 39757181 PMCID: PMC11702062 DOI: 10.1186/s12873-024-01166-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2024] [Accepted: 12/26/2024] [Indexed: 01/07/2025] Open
Abstract
BACKGROUND In Sweden with about 10 million inhabitants, there are about one million primary ambulance missions every year. Among them, around 10% are assessed by Emergency Medical Service (EMS) clinicians with the primary symptom of dyspnoea. The risk of death among these patients has been reported to be remarkably high, at 11,1% and 13,2%. The aim was to develop a Machine Learning (ML) model to provide support in assessing patients in pre-hospital settings and to compare them with established triage tools. METHODS This was a retrospective observational study including 6,354 patients who called the Swedish emergency telephone number (112) between January and December 2017. Patients presenting with the main symptom of dyspnoea were included which were recruited from two EMS organisations in Göteborg and Södra Älvsborg. Serious Adverse Event (SAE) was used as outcome, defined as any of the following:1) death within 30 days after call for an ambulance, 2) a final diagnosis defined as time-sensitive, 3) admitted to intensive care unit, or 4) readmission within 72 h and admitted to hospital receiving a final time-sensitive diagnosis. Logistic regression, LASSO logistic regression and gradient boosting were compared to the Rapid Emergency Triage and Treatment System for Adults (RETTS-A) and National Early Warning Score2 (NEWS2) with respect to discrimination and calibration of predictions. Eighty percent (80%) of the data was used for model development and 20% for model validation. RESULTS All ML models showed better performance than RETTS-A and NEWS2 with respect to all evaluated performance metrics. The gradient boosting algorithm had the overall best performance, with excellent calibration of the predictions, and consistently showed higher sensitivity to detect SAE than the other methods. The ROC AUC on test data increased from 0.73 (95% CI 0.70-0.76) with RETTS-A to 0.81 (95% CI 0.78-0.84) using gradient boosting. CONCLUSIONS Among 6,354 ambulance missions caused by patients suffering from dyspnoea, an ML method using gradient boosting demonstrated excellent performance for predicting SAE, with substantial improvement over the more established methods RETTS-A and NEWS2.
Collapse
Affiliation(s)
- Wivica Kauppi
- PreHospen- Centre for Prehospital Research, Faculty of Caring Science, Work Life and Social Welfare, University of Borås, Borås, SE- 501 90, Sweden.
- Faculty of Caring Science, Work Life and Social Welfare, University of Borås, Borås, SE- 501 90, Sweden.
| | - Henrik Imberg
- Statistiska Konsultgruppen Sweden, Gothenburg, Sweden
- Department of Molecular and Clinical Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Johan Herlitz
- PreHospen- Centre for Prehospital Research, Faculty of Caring Science, Work Life and Social Welfare, University of Borås, Borås, SE- 501 90, Sweden
- Faculty of Caring Science, Work Life and Social Welfare, University of Borås, Borås, SE- 501 90, Sweden
| | - Oskar Molin
- Statistiska Konsultgruppen Sweden, Gothenburg, Sweden
| | - Christer Axelsson
- PreHospen- Centre for Prehospital Research, Faculty of Caring Science, Work Life and Social Welfare, University of Borås, Borås, SE- 501 90, Sweden
- Faculty of Caring Science, Work Life and Social Welfare, University of Borås, Borås, SE- 501 90, Sweden
- Department of Prehospital Emergency Care, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Carl Magnusson
- PreHospen- Centre for Prehospital Research, Faculty of Caring Science, Work Life and Social Welfare, University of Borås, Borås, SE- 501 90, Sweden
- Department of Molecular and Clinical Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Department of Prehospital Emergency Care, Sahlgrenska University Hospital, Gothenburg, Sweden
| |
Collapse
|
2
|
Pelletier P, Geuna A, Souza D. Artificial intelligence research in Canadian hospitals: The development of metropolitan competencies. Healthc Manage Forum 2024; 37:445-450. [PMID: 39171796 DOI: 10.1177/08404704241271218] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/23/2024]
Abstract
This study explores the deployment of Artificial Intelligence (AI) in Canadian hospitals from 2000 to 2021, focusing on metropolitan areas. We investigate how local public and private research ecosystems and links to national and international AI hubs influence the adoption of AI in healthcare. Our analysis shows that AI research outputs from public institutions have a significant impact on AI competences in hospitals. In addition, collaborations between hospitals are critical to the successful integration of AI. Metropolitan areas such as Toronto, Montreal, and Vancouver are leading the way in AI deployment. These findings highlight the importance of local AI research capabilities and international hospital collaborations and provide guidance to policy-makers and health leaders to drive the diffusion of AI technology in healthcare.
Collapse
Affiliation(s)
- Pierre Pelletier
- University of Turin, Torino, Italy
- University of Strasbourg, Strasbourg, France
| | - Aldo Geuna
- University of Turin, Torino, Italy
- Collegio Carlo Alberto, Turin, Italy
- Canadian Institute for Advanced Research, Toronto, Ontario, Canada
| | | |
Collapse
|
3
|
Toy J, Warren J, Wilhelm K, Putnam B, Whitfield D, Gausche-Hill M, Bosson N, Donaldson R, Schlesinger S, Cheng T, Goolsby C. Use of artificial intelligence to support prehospital traumatic injury care: A scoping review. J Am Coll Emerg Physicians Open 2024; 5:e13251. [PMID: 39234533 PMCID: PMC11372236 DOI: 10.1002/emp2.13251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Revised: 05/09/2024] [Accepted: 07/03/2024] [Indexed: 09/06/2024] Open
Abstract
Background Artificial intelligence (AI) has transformative potential to support prehospital clinicians, emergency physicians, and trauma surgeons in acute traumatic injury care. This scoping review examines the literature evaluating AI models using prehospital features to support early traumatic injury care. Methods We conducted a systematic search in August 2023 of PubMed, Embase, and Web of Science. Two independent reviewers screened titles/abstracts, with a third reviewer for adjudication, followed by a full-text analysis. We included original research and conference presentations evaluating AI models-machine learning (ML), deep learning (DL), and natural language processing (NLP)-that used prehospital features or features available immediately upon emergency department arrival. Review articles were excluded. The same investigators extracted data and systematically categorized outcomes to ensure consistency and transparency. We calculated kappa for interrater reliability and descriptive statistics. Results We identified 1050 unique publications, with 49 meeting inclusion criteria after title and abstract review (kappa 0.58) and full-text review. Publications increased annually from 2 in 2007 to 10 in 2022. Geographic analysis revealed a 61% focus on data from the United States. Studies were predominantly retrospective (88%), used local (45%) or national level (41%) data, focused on adults only (59%) or did not specify adults or pediatrics (27%), and 57% encompassed both blunt and penetrating injury mechanisms. The majority used machine learning (88%) alone or in conjunction with DL or NLP, and the top three algorithms used were support vector machine, logistic regression, and random forest. The most common study objectives were to predict the need for critical care and life-saving interventions (29%), assist in triage (22%), and predict survival (20%). Conclusions A small but growing body of literature described AI models based on prehospital features that may support decisions made by dispatchers, Emergency Medical Services clinicians, and trauma teams in early traumatic injury care.
Collapse
Affiliation(s)
- Jake Toy
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- Los Angeles Emergency Medical Services Agency Santa Fe Springs California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| | - Jonathan Warren
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- Los Angeles Emergency Medical Services Agency Santa Fe Springs California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| | - Kelsey Wilhelm
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- Los Angeles Emergency Medical Services Agency Santa Fe Springs California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| | - Brant Putnam
- Department of Surgery Harbor-UCLA Medical Center Torrance California USA
| | - Denise Whitfield
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- Los Angeles Emergency Medical Services Agency Santa Fe Springs California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| | - Marianne Gausche-Hill
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- Los Angeles Emergency Medical Services Agency Santa Fe Springs California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| | - Nichole Bosson
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- Los Angeles Emergency Medical Services Agency Santa Fe Springs California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| | - Ross Donaldson
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
- Critical Innovations LLC Los Angeles California USA
| | - Shira Schlesinger
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- Los Angeles Emergency Medical Services Agency Santa Fe Springs California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| | - Tabitha Cheng
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| | - Craig Goolsby
- The Lundquist Institute, Department of Emergency Medicine Harbor-UCLA Medical Center Torrance California USA
- David Geffen School of Medicine at UCLA Los Angeles California USA
| |
Collapse
|
4
|
Röhrs KJ, Audebert H. Pre-Hospital Stroke Care beyond the MSU. Curr Neurol Neurosci Rep 2024; 24:315-322. [PMID: 38907812 PMCID: PMC11258185 DOI: 10.1007/s11910-024-01351-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/11/2024] [Indexed: 06/24/2024]
Abstract
PURPOSE OF REVIEW Mobile stroke units (MSU) have established a new, evidence-based treatment in prehospital stroke care, endorsed by current international guidelines and can facilitate pre-hospital research efforts. In addition, other novel pre-hospital modalities beyond the MSU are emerging. In this review, we will summarize existing evidence and outline future trajectories of prehospital stroke care & research on and off MSUs. RECENT FINDINGS The proof of MSUs' positive effect on patient outcomes is leading to their increased adoption in emergency medical services of many countries. Nevertheless, prehospital stroke care worldwide largely consists of regular ambulances. Advancements in portable technology for detecting neurocardiovascular diseases, telemedicine, AI and large-scale ultra-early biobanking have the potential to transform prehospital stroke care also beyond the MSU concept. The increasing implementation of telemedicine in emergency medical services is demonstrating beneficial effects in the pre-hospital setting. In synergy with telemedicine the exponential growth of AI-technology is already changing and will likely further transform pre-hospital stroke care in the future. Other promising areas include the development and validation of miniaturized portable devices for the pre-hospital detection of acute stroke. MSUs are enabling large-scale screening for ultra-early blood-based biomarkers, facilitating the differentiation between ischemia, hemorrhage, and stroke mimics. The development of suitable point-of-care tests for such biomarkers holds the potential to advance pre-hospital stroke care outside the MSU-concept. A multimodal approach of AI-supported telemedicine, portable devices and blood-based biomarkers appears to be an increasingly realistic scenario for improving prehospital stroke care in regular ambulances in the future.
Collapse
Affiliation(s)
- Kian J Röhrs
- Department of Neurology, Campus Benjamin Franklin, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität Zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany
| | - Heinrich Audebert
- Department of Neurology, Campus Benjamin Franklin, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität Zu Berlin, Hindenburgdamm 30, 12203, Berlin, Germany.
- Center for Stroke Research Berlin, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.
| |
Collapse
|
5
|
Zhang J, Jin Z, Tang B, Huang X, Wang Z, Chen Q, He J. Enhancing Trauma Care: A Machine Learning Approach with XGBoost for Predicting Urgent Hemorrhage Interventions Using NTDB Data. Bioengineering (Basel) 2024; 11:768. [PMID: 39199726 PMCID: PMC11352089 DOI: 10.3390/bioengineering11080768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Revised: 07/21/2024] [Accepted: 07/25/2024] [Indexed: 09/01/2024] Open
Abstract
OBJECTIVE Trauma is a leading cause of death worldwide, with many incidents resulting in hemorrhage before the patient reaches the hospital. Despite advances in trauma care, the majority of deaths occur within the first three hours of hospital admission, offering a very limited window for effective intervention. Unfortunately, a significant increase in mortality from hemorrhagic trauma is primarily due to delays in hemorrhage control. Therefore, we propose a machine learning model to predict the need for urgent hemorrhage intervention. METHODS This study developed and validated an XGBoost-based machine learning model using data from the National Trauma Data Bank (NTDB) from 2017 to 2019. It focuses on demographic and clinical data from the initial hours following trauma for model training and validation, aiming to predict whether trauma patients require urgent hemorrhage intervention. RESULTS The XGBoost model demonstrated superior performance across multiple datasets, achieving an AUROC of 0.872 on the training set, 0.869 on the internal validation set, and 0.875 on the external validation set. The model also showed high sensitivity (77.8% on the external validation set) and specificity (82.1% on the external validation set), with an accuracy exceeding 81% across all datasets, highlighting its high reliability for clinical applications. CONCLUSIONS Our study shows that the XGBoost model effectively predicts urgent hemorrhage interventions using data from the National Trauma Data Bank (NTDB). It outperforms other machine learning algorithms in accuracy and robustness across various datasets. These results highlight machine learning's potential to improve emergency responses and decision-making in trauma care.
Collapse
Affiliation(s)
- Jin Zhang
- School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200000, China; (J.Z.); (X.H.); (Z.W.)
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Zhichao Jin
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Bihan Tang
- Department of Health Management, Naval Medical University, Shanghai 200433, China;
| | - Xiangtong Huang
- School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200000, China; (J.Z.); (X.H.); (Z.W.)
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Zongyu Wang
- School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200000, China; (J.Z.); (X.H.); (Z.W.)
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Qi Chen
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Jia He
- School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200000, China; (J.Z.); (X.H.); (Z.W.)
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| |
Collapse
|
6
|
Jain H, Marsool MDM, Odat RM, Noori H, Jain J, Shakhatreh Z, Patel N, Goyal A, Gole S, Passey S. Emergence of Artificial Intelligence and Machine Learning Models in Sudden Cardiac Arrest: A Comprehensive Review of Predictive Performance and Clinical Decision Support. Cardiol Rev 2024:00045415-990000000-00260. [PMID: 38836621 DOI: 10.1097/crd.0000000000000708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/06/2024]
Abstract
Sudden cardiac death/sudden cardiac arrest (SCD/SCA) is an increasingly prevalent cause of mortality globally, particularly in individuals with preexisting cardiac conditions. The ambiguous premortem warnings and the restricted interventional window related to SCD account for the complexity of the condition. Current reports suggest SCD to be accountable for 20% of all deaths hence accurately predicting SCD risk is an imminent concern. Traditional approaches for predicting SCA, particularly "track-and-trigger" warning systems have demonstrated considerable inadequacies, including low sensitivity, false alarms, decreased diagnostic liability, reliance on clinician involvement, and human errors. Artificial intelligence (AI) and machine learning (ML) models have demonstrated near-perfect accuracy in predicting SCA risk, allowing clinicians to intervene timely. Given the constraints of current diagnostics, exploring the benefits of AI and ML models in enhancing outcomes for SCA/SCD is imperative. This review article aims to investigate the efficacy of AI and ML models in predicting and managing SCD, particularly targeting accuracy in prediction.
Collapse
Affiliation(s)
- Hritvik Jain
- From the Department of Internal Medicine, All India Institte of Medical Sciences (AIIMS), Jodhpur, India
| | | | - Ramez M Odat
- Department of Internal Medicine, Faculty of Medicine, Jordan University of Science and Technology, Irbid, Jordan
| | - Hamid Noori
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Jyoti Jain
- From the Department of Internal Medicine, All India Institte of Medical Sciences (AIIMS), Jodhpur, India
| | - Zaid Shakhatreh
- Department of Internal Medicine, Faculty of Medicine, Jordan University of Science and Technology, Irbid, Jordan
| | - Nandan Patel
- From the Department of Internal Medicine, All India Institte of Medical Sciences (AIIMS), Jodhpur, India
| | - Aman Goyal
- Department of Internal Medicine, Seth GS Medical College and KEM Hospital, Mumbai, India
| | - Shrey Gole
- Department of Immunology and Rheumatology, Stanford University, CA; and
| | - Siddhant Passey
- Department of Internal Medicine, University of Connecticut Health Center, CT
| |
Collapse
|
7
|
Hsueh J, Fritz C, Thomas CE, Reimer AP, Reisner AT, Schoenfeld D, Haimovich A, Thomas SH. Applications of Artificial Intelligence in Helicopter Emergency Medical Services: A Scoping Review. Air Med J 2024; 43:90-95. [PMID: 38490791 DOI: 10.1016/j.amj.2023.11.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2023] [Revised: 11/15/2023] [Accepted: 11/18/2023] [Indexed: 03/17/2024]
Abstract
OBJECTIVE Recent systematic reviews of acute care medicine applications of artificial intelligence (AI) have focused on hospital and general prehospital uses. The purpose of this scoping review was to identify and describe the literature on AI use with a focus on applications in helicopter emergency medical services (HEMS). METHODS A literature search was performed with specific inclusion and exclusion criteria. Articles were grouped by characteristics such as publication year and general subject matter with categoric and temporal trend analyses. RESULTS We identified 21 records focused on the use of AI in HEMS. These applications included both clinical and triage uses and nonclinical uses. The earliest study appeared in 2006, but over one third of the identified studies have been published in 2021 or later. The passage of time has seen an increased likelihood of HEMS AI studies focusing on nonclinical issues; for each year, the likelihood of a nonclinical focus had an odds ratio of 1.3. CONCLUSION This scoping review provides overview and hypothesis-generating information regarding AI applications specific to HEMS. HEMS AI may be ultimately deployed in nonclinical arenas as much as or more than for clinical decision support. Future studies will inform future decisions as to how AI may improve HEMS systems design, asset deployment, and clinical care.
Collapse
Affiliation(s)
- Jennifer Hsueh
- Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA.
| | - Christie Fritz
- Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | | | - Andrew P Reimer
- Case Western Reserve University Frances Payne Bolton School of Nursing, Cleveland, OH; Cleveland Clinic Critical Care Transport, Cleveland, OH
| | - Andrew T Reisner
- Department of Emergency Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - David Schoenfeld
- Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Adrian Haimovich
- Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Stephen H Thomas
- Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA; Blizard Institute, Barts and The London School of Medicine, London, United Kingdom
| |
Collapse
|