AI and machine learning in resuscitation: Ongoing research, new concepts, and key challenges

Taxonomy development methods regarding patient safety in health sciences - A systematic review

BACKGROUND

Taxonomies are needed for automated analysis of clinical data in healthcare. Few reviews of the taxonomy development methods used in health sciences are found. This systematic review aimed to describe the scope of the available taxonomies relative to patient safety, the methods used for taxonomy development, and the strengths and limitations of the methods. The purpose of this systematic review is to guide future taxonomy development projects.

METHODS

The CINAHL, PubMed, Scopus, and Web of Science databases were searched for studies from January 2012 to April 25, 2023. Two authors selected the studies using inclusion and exclusion criteria and critical appraisal checklists. The data were analysed inductively, and the results were reported narratively.

RESULTS

The studies (n = 13) across healthcare concerned mainly taxonomies of adverse events and medication safety but little for specialised fields and information technology. Critical appraisal indicated inadequate reporting of the used taxonomy development methods. Ten phases of taxonomy development were identified: (1) defining purpose and (2) the theory base for development, (3) relevant data sources' identification, (4) main terms' identification and definitions, (5) items' coding and pooling, (6) reliability and validity evaluation of coding and/or codes, (7) development of a hierarchical structure, (8) testing the structure, (9) piloting the taxonomy and (10) reporting application and validation of the final taxonomy. Seventeen statistical tests and seven software systems were utilised, but automated data extraction methods were used rarely. Multimethod and multi-stakeholder approach, code- and hierarchy testing and piloting were strengths and time consumption and small samples in testing limitations.

CONCLUSION

New taxonomies are needed on diverse specialities and information technology related to patient safety. Structured method is needed for taxonomy development, reporting and appraisal to strengthen taxonomies' quality. A new guide was proposed for taxonomy development, for which testing is required. Prospero registration number CRD42023411022.

Implementation considerations for the adoption of artificial intelligence in the emergency department

OBJECTIVE

Artificial intelligence (AI) has emerged as a potentially transformative force, particularly in the realm of emergency medicine (EM). The implementation of AI in emergency departments (ED) has the potential to improve patient care through various modalities. However, the implementation of AI in the ED presents unique challenges that influence its clinical adoption. This scoping review summarizes the current literature exploring the barriers and facilitators of the clinical implementation of AI in the ED.

METHODS

We systematically searched Embase (Ovid), MEDLINE (Ovid), Web of Science, and Engineering Village. All articles were published in English through November 20th, 2023. Two reviewers screened the search results, with disagreements resolved through third-party adjudication.

RESULTS

A total of 8172 studies were included in the preliminary search, with 22 selected for the final data extraction. 10 studies were reviews and the remaining 12 were primary quantitative, qualitative, and mixed-methods studies. Out of the 22, 13 studies investigated a specific AI tool or application. Common barriers to implementation included a lack of model interpretability and explainability, encroachment on physician autonomy, and medicolegal considerations. Common facilitators to implementation included educating staff on the model, efficient integration into existing workflows, and sound external validation.

CONCLUSION

There is increasing literature on AI implementation in the ED. Our research suggests that the most common barrier facing AI implementation in the ED is model interpretability and explainability. More primary research investigating the implementation of specific AI tools should be undertaken to help facilitate their successful clinical adoption in the ED.

The Role of Large Language Models in Transforming Emergency Medicine: Scoping Review

BACKGROUND

Artificial intelligence (AI), more specifically large language models (LLMs), holds significant potential in revolutionizing emergency care delivery by optimizing clinical workflows and enhancing the quality of decision-making. Although enthusiasm for integrating LLMs into emergency medicine (EM) is growing, the existing literature is characterized by a disparate collection of individual studies, conceptual analyses, and preliminary implementations. Given these complexities and gaps in understanding, a cohesive framework is needed to comprehend the existing body of knowledge on the application of LLMs in EM.

OBJECTIVE

Given the absence of a comprehensive framework for exploring the roles of LLMs in EM, this scoping review aims to systematically map the existing literature on LLMs' potential applications within EM and identify directions for future research. Addressing this gap will allow for informed advancements in the field.

METHODS

Using PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) criteria, we searched Ovid MEDLINE, Embase, Web of Science, and Google Scholar for papers published between January 2018 and August 2023 that discussed LLMs' use in EM. We excluded other forms of AI. A total of 1994 unique titles and abstracts were screened, and each full-text paper was independently reviewed by 2 authors. Data were abstracted independently, and 5 authors performed a collaborative quantitative and qualitative synthesis of the data.

RESULTS

A total of 43 papers were included. Studies were predominantly from 2022 to 2023 and conducted in the United States and China. We uncovered four major themes: (1) clinical decision-making and support was highlighted as a pivotal area, with LLMs playing a substantial role in enhancing patient care, notably through their application in real-time triage, allowing early recognition of patient urgency; (2) efficiency, workflow, and information management demonstrated the capacity of LLMs to significantly boost operational efficiency, particularly through the automation of patient record synthesis, which could reduce administrative burden and enhance patient-centric care; (3) risks, ethics, and transparency were identified as areas of concern, especially regarding the reliability of LLMs' outputs, and specific studies highlighted the challenges of ensuring unbiased decision-making amidst potentially flawed training data sets, stressing the importance of thorough validation and ethical oversight; and (4) education and communication possibilities included LLMs' capacity to enrich medical training, such as through using simulated patient interactions that enhance communication skills.

CONCLUSIONS

LLMs have the potential to fundamentally transform EM, enhancing clinical decision-making, optimizing workflows, and improving patient outcomes. This review sets the stage for future advancements by identifying key research areas: prospective validation of LLM applications, establishing standards for responsible use, understanding provider and patient perceptions, and improving physicians' AI literacy. Effective integration of LLMs into EM will require collaborative efforts and thorough evaluation to ensure these technologies can be safely and effectively applied.

[Artificial intelligence in intensive care medicine]

The integration of artificial intelligence (AI) into intensive care medicine has made considerable progress in recent studies, particularly in the areas of predictive analytics, early detection of complications, and the development of decision support systems. The main challenges remain availability and quality of data, reduction of bias and the need for explainable results from algorithms and models. Methods to explain these systems are essential to increase trust, understanding, and ethical considerations among healthcare professionals and patients. Proper training of healthcare professionals in AI principles, terminology, ethical considerations, and practical application is crucial for the successful use of AI. Careful assessment of the impact of AI on patient autonomy and data protection is essential for its responsible use in intensive care medicine. A balance between ethical and practical considerations must be maintained to ensure patient-centered care while complying with data protection regulations. Synergistic collaboration between clinicians, AI engineers, and regulators is critical to realizing the full potential of AI in intensive care medicine and maximizing its positive impact on patient care. Future research and development efforts should focus on improving AI models for real-time predictions, increasing the accuracy and utility of AI-based closed-loop systems, and overcoming ethical, technical, and regulatory challenges, especially in generative AI systems.

Revolutionizing Breast Cancer Care: AI-Enhanced Diagnosis and Patient History

Breast cancer poses a significant global health challenge, demanding enhanced diagnostic accuracy and streamlined medical history documentation. This study presents a holistic approach that harnesses the power of artificial intelligence (AI) and machine learning (ML) to address these pressing needs. This study presents a comprehensive methodology for breast cancer diagnosis and medical history generation, integrating data collection, feature extraction, machine learning, and AI-driven history-taking. The research employs a systematic approach to ensure accurate diagnosis and efficient history collection. Data preprocessing merges similar attributes to streamline analysis. Three key algorithms, Support Vector Machine (SVM), K-Nearest Neighbours (KNN), and Fuzzy Logic, are applied. Fuzzy Logic shows exceptional accuracy in handling uncertain data. Deep learning models enhance predictive accuracy, emphasizing the synergy between traditional and deep learning approaches. The AI-driven history collection simplifies the patient history-taking process, adapting questions dynamically based on patient responses. Comprehensive medical history reports summarize patient data, facilitating informed healthcare decisions. The research prioritizes ethical compliance and data privacy. OpenAI has integrated GPT-3.5 to generate automated patient reports, offering structured overviews of patient health history. The study's results indicate the potential for enhanced disease prediction accuracy and streamlined medical history collection, contributing to more reliable healthcare assessments and patient care. Machine learning, deep learning, and AI-driven approaches hold promise for a wide range of applications, particularly in healthcare and beyond.

Explainable artificial intelligence in emergency medicine: an overview

Artificial intelligence (AI) and machine learning (ML) have potential to revolutionize emergency medical care by enhancing triage systems, improving diagnostic accuracy, refining prognostication, and optimizing various aspects of clinical care. However, as clinicians often lack AI expertise, they might perceive AI as a "black box," leading to trust issues. To address this, "explainable AI," which teaches AI functionalities to end-users, is important. This review presents the definitions, importance, and role of explainable AI, as well as potential challenges in emergency medicine. First, we introduce the terms explainability, interpretability, and transparency of AI models. These terms sound similar but have different roles in discussion of AI. Second, we indicate that explainable AI is required in clinical settings for reasons of justification, control, improvement, and discovery and provide examples. Third, we describe three major categories of explainability: pre-modeling explainability, interpretable models, and post-modeling explainability and present examples (especially for post-modeling explainability), such as visualization, simplification, text justification, and feature relevance. Last, we show the challenges of implementing AI and ML models in clinical settings and highlight the importance of collaboration between clinicians, developers, and researchers. This paper summarizes the concept of "explainable AI" for emergency medicine clinicians. This review may help clinicians understand explainable AI in emergency contexts.

Discrepancies between Retrospective Review of "Real-Time" Electronic Health Record Documentation and Prospective Observer Documentation of In-Hospital Cardiac Arrest Quality Metrics in an Academic Cardiac Intensive Care Unit

BACKGROUND

Every year, approximately 200,000 patients will experience in-hospital cardiac arrest (IHCA) in the United States. Survival has been shown to be greatest with the prompt initiation of CPR and early interventions, leading to the development of time-based quality measures. It is uncertain how documentation practices affect reports of compliance with time-based quality measures in IHCA.

METHODS

A retrospective review of all cases of IHCA that occurred in the Cardiac Intensive Care Unit (CICU) at an academic quaternary hospital was conducted. For each case, a member of the code team (observer) documented performance measures as part of a prospective cardiac arrest quality improvement database. We compared those data to those abstracted in the retrospective review of "real-time" documentation in a Resuscitation Narrator module within electronic health records (EHRs) to investigate for discrepancies.

RESULTS

We identified 52 cases of IHCA, all of which were witnessed events. In total, 47 (90%) cases were reviewed by observers as receiving epinephrine within 5 min, but only 42 (81%) were documented as such in the EHR review (p = 0.04), meaning that the interrater agreement for this metric was low (Kappa = 0.27, 95% CI 0.16-0.36). Four (27%) eligible patients were reported as having defibrillation within 2 min by observers, compared to five (33%) reported by the EHR review (p = 0.90), and with substantial agreement (Kappa = 0.73, 95% CI 0.66-0.79). There was almost perfect agreement (Kappa = 0.82, 95% CI 0.76-0.88) for the initial rhythm of cardiac arrest (25% shockable rhythm by observers vs. 29% for EHR review, p = 0.31).

CONCLUSION

There was a discrepancy between prospective observers' documentation of meeting quality standards and that of the retrospective review of "real-time" EHR documentation. A further study is required to understand the cause of discrepancy and its consequences.