Deep ensemble multitask classification of emergency medical call incidents combining multimodal data improves emergency medical dispatch

Precision emergency medicine

BACKGROUND

Precision health is a burgeoning scientific discipline that aims to incorporate individual variability in biological, behavioral, and social factors to develop personalized health solutions. To date, emergency medicine has not deeply engaged in the precision health movement. However, rapid advances in health technology, data science, and medical informatics offer new opportunities for emergency medicine to realize the promises of precision health.

METHODS

In this article, we conceptualize precision emergency medicine as an emerging paradigm and identify key drivers of its implementation into current and future clinical practice. We acknowledge important obstacles to the specialty-wide adoption of precision emergency medicine and offer solutions that conceive a successful path forward.

RESULTS

Precision emergency medicine is defined as the use of information and technology to deliver acute care effectively, efficiently, and authentically to individual patients and their communities. Key drivers and opportunities include leveraging human data, capitalizing on technology and digital tools, providing deliberate access to care, advancing population health, and reimagining provider education and roles. Overcoming challenges in equity, privacy, and cost is essential for success. We close with a call to action to proactively incorporate precision health into the clinical practice of emergency medicine, the training of future emergency physicians, and the research agenda of the specialty.

CONCLUSIONS

Precision emergency medicine leverages new technology and data-driven artificial intelligence to advance diagnostic testing, individualize patient care plans and therapeutics, and strategically refine the convergence of the health system and the community.

Pre-Hospital Stroke Care beyond the MSU

PURPOSE OF REVIEW

Mobile stroke units (MSU) have established a new, evidence-based treatment in prehospital stroke care, endorsed by current international guidelines and can facilitate pre-hospital research efforts. In addition, other novel pre-hospital modalities beyond the MSU are emerging. In this review, we will summarize existing evidence and outline future trajectories of prehospital stroke care & research on and off MSUs.

RECENT FINDINGS

The proof of MSUs' positive effect on patient outcomes is leading to their increased adoption in emergency medical services of many countries. Nevertheless, prehospital stroke care worldwide largely consists of regular ambulances. Advancements in portable technology for detecting neurocardiovascular diseases, telemedicine, AI and large-scale ultra-early biobanking have the potential to transform prehospital stroke care also beyond the MSU concept. The increasing implementation of telemedicine in emergency medical services is demonstrating beneficial effects in the pre-hospital setting. In synergy with telemedicine the exponential growth of AI-technology is already changing and will likely further transform pre-hospital stroke care in the future. Other promising areas include the development and validation of miniaturized portable devices for the pre-hospital detection of acute stroke. MSUs are enabling large-scale screening for ultra-early blood-based biomarkers, facilitating the differentiation between ischemia, hemorrhage, and stroke mimics. The development of suitable point-of-care tests for such biomarkers holds the potential to advance pre-hospital stroke care outside the MSU-concept. A multimodal approach of AI-supported telemedicine, portable devices and blood-based biomarkers appears to be an increasingly realistic scenario for improving prehospital stroke care in regular ambulances in the future.

Deep continual learning for medical call incidents text classification under the presence of dataset shifts

The aim of this work is to develop and evaluate a deep classifier that can effectively prioritize Emergency Medical Call Incidents (EMCI) according to their life-threatening level under the presence of dataset shifts. We utilized a dataset consisting of 1982746 independent EMCI instances obtained from the Health Services Department of the Region of Valencia (Spain), with a time span from 2009 to 2019 (excluding 2013). The dataset includes free text dispatcher observations recorded during the call, as well as a binary variable indicating whether the event was life-threatening. To evaluate the presence of dataset shifts, we examined prior probability shifts, covariate shifts, and concept shifts. Subsequently, we designed and implemented four deep Continual Learning (CL) strategies-cumulative learning, continual fine-tuning, experience replay, and synaptic intelligence-alongside three deep CL baselines-joint training, static approach, and single fine-tuning-based on DistilBERT models. Our results demonstrated evidence of prior probability shifts, covariate shifts, and concept shifts in the data. Applying CL techniques had a statistically significant (α=0.05) positive impact on both backward and forward knowledge transfer, as measured by the F1-score, compared to non-continual approaches. We can argue that the utilization of CL techniques in the context of EMCI is effective in adapting deep learning classifiers to changes in data distributions, thereby maintaining the stability of model performance over time. To our knowledge, this study represents the first exploration of a CL approach using real EMCI data.

Clinical decision support system in emergency telephone triage: A scoping review of technical design, implementation and evaluation

OBJECTIVES

Emergency department overcrowding could be improved by upstream telephone triage. Emergency telephone triage aims at managing and orientating adequately patients as early as possible and distributing limited supply of staff and materials. This complex task could be improved with the use of Clinical decision support systems (CDSS). The aim of this scoping review was to identify literature gaps for the future development and evaluation of CDSS for Emergency telephone triage.

MATERIALS AND METHODS

We present here a scoping review of CDSS designed for emergency telephone triage, and compared them in terms of functional characteristics, technical design, health care implementation and methodologies used for evaluation, following the PRISMA-ScR guidelines.

RESULTS

Regarding design, 19 CDSS were retrieved: 12 were knowledge based CDSS (decisional algorithms built according to guidelines or clinical expertise) and 7 were data driven (statistical, machine learning, or deep learning models). Most of them aimed at assisting nurses or non-medical staff by providing patient orientation and/or severity/priority assessment. Eleven were implemented in real life, and only three were connected to the Electronic Health Record. Regarding evaluation, CDSS were assessed through various aspects: intrinsic characteristics, impact on clinical practice or user apprehension. Only one pragmatic trial and one randomized controlled trial were conducted.

CONCLUSION

This review highlights the potential of a hybrid system, user tailored, flexible, connected to the electronic health record, which could work with oral, video and digital data; and the need to evaluate CDSS on intrinsic characteristics and impact on clinical practice, iteratively at each distinct stage of the IT lifecycle.

Extremely missing numerical data in Electronic Health Records for machine learning can be managed through simple imputation methods considering informative missingness: A comparative of solutions in a COVID-19 mortality case study

BACKGROUND AND OBJECTIVE

Reusing Electronic Health Records (EHRs) for Machine Learning (ML) leads on many occasions to extremely incomplete and sparse tabular datasets, which can hinder the model development processes and limit their performance and generalization. In this study, we aimed to characterize the most effective data imputation techniques and ML models for dealing with highly missing numerical data in EHRs, in the case where only a very limited number of data are complete, as opposed to the usual case of having a reduced number of missing values.

METHODS

We used a case study including full blood count laboratory data, demographic and survival data in the context of COVID-19 hospital admissions and evaluated 30 processing pipelines combining imputation methods with ML classifiers. The imputation methods included missing mask, translation and encoding, mean imputation, k-nearest neighbors' imputation, Bayesian ridge regression imputation and generative adversarial imputation networks. The classifiers included k-nearest neighbors, logistic regression, random forest, gradient boosting and deep multilayer perceptron.

RESULTS

Our results suggest that in the presence of highly missing data, combining translation and encoding imputation-which considers informative missingness-with tree ensemble classifiers-random forest and gradient boosting-is a sensible choice when aiming to maximize performance, in terms of area under curve.

CONCLUSIONS

Based on our findings, we recommend the consideration of this imputer-classifier configuration when constructing models in the presence of extremely incomplete numerical data in EHR.

Artificial intelligence and machine learning in prehospital emergency care: A scoping review

Our scoping review provides a comprehensive analysis of the landscape of artificial intelligence (AI) applications in prehospital emergency care (PEC). It contributes to the field by highlighting the most studied AI applications and identifying the most common methodological approaches across 106 included studies. The findings indicate a promising future for AI in PEC, with many unique use cases, such as prognostication, demand prediction, resource optimization, and the Internet of Things continuous monitoring systems. Comparisons with other approaches showed AI outperforming clinicians and non-AI algorithms in most cases. However, most studies were internally validated and retrospective, highlighting the need for rigorous prospective validation of AI applications before implementation in clinical settings. We identified knowledge and methodological gaps using an evidence map, offering a roadmap for future investigators. We also discussed the significance of explainable AI for establishing trust in AI systems among clinicians and facilitating real-world validation of AI models.

Challenges in evaluating the accuracy of AI-containing digital triage systems: A systematic review

INTRODUCTION

Patient-operated digital triage systems with AI components are becoming increasingly common. However, previous reviews have found a limited amount of research on such systems' accuracy. This systematic review of the literature aimed to identify the main challenges in determining the accuracy of patient-operated digital AI-based triage systems.

METHODS

A systematic review was designed and conducted in accordance with PRISMA guidelines in October 2021 using PubMed, Scopus and Web of Science. Articles were included if they assessed the accuracy of a patient-operated digital triage system that had an AI-component and could triage a general primary care population. Limitations and other pertinent data were extracted, synthesized and analysed. Risk of bias was not analysed as this review studied the included articles' limitations (rather than results). Results were synthesized qualitatively using a thematic analysis.

RESULTS

The search generated 76 articles and following exclusion 8 articles (6 primary articles and 2 reviews) were included in the analysis. Articles' limitations were synthesized into three groups: epistemological, ontological and methodological limitations. Limitations varied with regards to intractability and the level to which they can be addressed through methodological choices. Certain methodological limitations related to testing triage systems using vignettes can be addressed through methodological adjustments, whereas epistemological and ontological limitations require that readers of such studies appraise the studies with limitations in mind.

DISCUSSION

The reviewed literature highlights recurring limitations and challenges in studying the accuracy of patient-operated digital triage systems with AI components. Some of these challenges can be addressed through methodology whereas others are intrinsic to the area of inquiry and involve unavoidable trade-offs. Future studies should take these limitations in consideration in order to better address the current knowledge gaps in the literature.

Improving ambulance dispatch triage to trauma: A scoping review using the framework of development and evaluation of clinical prediction rules

OBJECTIVE

Ambulance dispatch algorithms should function as clinical prediction rules, identifying high acuity patients for advanced life support, and low acuity patients for non-urgent transport. Systematic reviews of dispatch algorithms are rare and focus on study types specific to the final phases of rule development, such as impact studies, and may miss the complete value-added evidence chain. We sought to summarise the literature for studies seeking to improve dispatch in trauma by performing a scoping review according to standard frameworks for developing and evaluating clinical prediction rules.

METHODS

We performed a scoping review searching MEDLINE, EMBASE, CINAHL, the CENTRAL trials registry, and grey literature from January 2005 to October 2021. We included all study types investigating dispatch triage to injured patients in the English language. We reported the clinical prediction rule phase (derivation, validation, impact analysis, or user acceptance) and the performance and outcomes measured for high and low acuity trauma patients.

RESULTS

Of 2067 papers screened, we identified 12 low and 30 high acuity studies. Derivation studies were most common (52%) and rule-based computer-aided dispatch was the most frequently investigated (23 studies). Impact studies rarely reported a prior validation phase, and few validation studies had their impact investigated. Common outcome measures in each phase were infrequent (0 to 27%), making a comparison between protocols difficult. A series of papers for low acuity patients and another for pediatric trauma followed clinical prediction rule development. Some low acuity Medical Priority Dispatch System codes are associated with the infrequent requirement for advanced life support and clinician review of computer-aided dispatch may enhance dispatch triage accuracy in studies of helicopter emergency medical services.

CONCLUSIONS

Few derivation and validation studies were followed by an impact study, indicating important gaps in the value-added evidence chain. While impact studies suggest clinician oversight may enhance dispatch, the opportunity exists to standardize outcomes, identify trauma-specific low acuity codes, and develop intelligent dispatch systems.